Questions tagged with Data Lakes
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
This is the third time I've run into this error.
I don't know is it a real issue or I just forget to set something up.
So basically when I try to add data permission to all table in Lakeformation...
Config of Redshift Cluster:
- Enhanced VPC routing has enabled
- Redshift subnet in the same subnet as S3 vpc endpoint
Config of S3
- VPC endpoints created for S3
- Routing has configured to...
hello, in planning phase of a Datalake project and came across LakeFormation which seems to be the preferred way. I understand that essentially it is a group of S3 buckets so resiliency & durability...
HIVE_CURSOR_ERROR: incorrect data check
This query ran against the "dbreport" database, unless qualified by the query. Please post the error message on our forum or contact customer support with...
I've got a fairly simple ETL job that reads several catalog tables or views and does some joins. the job errors out with the following error:
```
Error Category: UNCLASSIFIED_ERROR; An error...
Is it possible to integrate opentelemetry(ADOT) and promethus managed by AWS with a data lake. The data lake could be both on edge or on AWS? If yes then how does it work? How can oepntemetry and...
At every 30 minutes it saying "ICEBERG_VACUUM_MORE_RUNS_NEEDED: Removed 20000 files in this round of vacuum" but when I calculate the my table metadata size it didn't changed before and after the...
Hi! I have been searching and playing around with services and cannot seem to find what I need.
I am using the following architecture to guide me in building out my end-to-end solution:...
When executing a task the last step is validating the data migrated with the source against target apparently using Athena, I have the following error:
2023-11-07T22:09:04 [VALIDATOR_TARGE ]E: Not...
Hello
I have created a resource link to a shared database from a different account. I am able to query the tables within the database but "Show tables from <database>" and "View Tables" on the AWS...
My Glue 4.0 jobs have suddenly stopped working with error message below. As it is related to boto3, I am unable to make any changes to library config. Pls advise.
NB: I noticed that urllib3 released...
Hello everyone,
### 1. Context
We have a Delta Lake where we write our tables in **S3** in **Delta format**, and we use the **Glue Catalog** for queries in **Athena**. Tables are created both with...