Cannot delete Glue Failed partition index EntityNotFoundException

Question

I attempted to create a partition index on a table.  The index failed to create with a backfill error.  I see this by calling client.get_partition_indexes().  
'IndexStatus': 'FAILED', 'BackfillErrors': [{'Code': 'ENCRYPTED_PARTITION_ERROR'.....

I cannot delete this failed index either through the console or via API client.delete_partition_index().  The attempt to delete returns:
EntityNotFoundException: An error occurred (EntityNotFoundException) when calling the DeletePartitionIndex operation: Index with the given indexName :  does not exist.

The failed index continues to be visible in the console.  
2 questions:
1. How do I get rid of this failed index?
2. What encryption is causing the error?  Is it the bucket being encrypted where the data is stored?  Or is it catalog metadata encryption?  Or other?

Answer

You can try deleting the index using the AWS Command Line Interface (CLI) by running the following command:

```
 aws glue delete-partition-index --catalog-id  --database-name  --table-name  --index-name . 
```

As for the encryption causing the error, the error message suggests that there is an issue with an encrypted partition. This could be due to encryption of the data in the partition or encryption of the metadata for the partition. You can check if the data in the partition is encrypted by looking at the properties of the S3 object or checking the encryption settings for the S3 bucket. You can check if the metadata for the partition is encrypted by checking the encryption settings for the Glue Data Catalog.

In addition to checking the S3 object or bucket encryption settings and Glue Data Catalog encryption settings, you can also check if the partition itself is encrypted.

You can do this by running a GET command on the partition in question using the AWS Glue API or AWS CLI, and checking if the partition has encryption enabled.

For example, using the AWS CLI, you can run the following command to retrieve information about a specific partition:

```
aws glue get-partition --catalog-id  --database-name  --table-name  --partition-values 
```
In the response, look for the Encryption field, which indicates whether encryption is enabled for the partition or not.

If encryption is enabled, you can check the encryption key settings and permissions to ensure they are correctly set up.

Cannot delete Glue Failed partition index EntityNotFoundException

Relevant content