- Newest
- Most votes
- Most comments
Hello,
This issue usually happens for a couple of reasons.
- Table associated with the database might not have the permissions to allow the specified user, querying the table, to perform the necessary Lake Formation actions. Granting the user who executes the query, to needed Lake Formation permissions on the given table for the database might fix the issue.
- Table that had been created with their LOCATION set to a specific file in an S3 path (rather than an S3 path prefix) might fail with above error. Based on this I would recommend placing the files for each table into separate subfolders(instead of specific file) to make the data queryable as described in this article
To recrawl the s3 data source with specific s3 prefix as shown below,
-
Navigate to the Glue Crawler Page.
-
Click on Create Crawler, and enter a crawler name and click Next.
-
Click on Add a Data Source.
-
Choose S3 as the data source and the include path of your files 's3://<bucket-name>/data_table/' (Please note that folder 'data_table' contains source files) and click on Update S3 data source. Click Next
-
Create an IAM Role and enter a name and click Next.
-
Click on Add database and enter a database name.
-
Select Run on demand for the frequency and click Next.
-
Select all remaining defaults. Once the Crawler has been created, click on Run Crawler.
-
Once the Crawler has completed its run, you will see a new table in the Glue Catalo
-
Run 'Select' command in Redshift
Reference here
Relevant content
- asked 5 months ago
- asked 5 months ago
- Accepted Answerasked a year ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated a year ago