Questions tagged with Data Lakes

Content language: English

Select up to 5 tags to filter
Sort by most recent

Browse through the questions and answers listed below or filter and sort to narrow down your results.

92 results
In AWS DMS, I have a Serverless replication, but I want to modify it now justs to add an extra table. No matter what I change, I get this error: Task Settings CloudWatchLogGroup or CloudWatchLogStream...
1
answers
0
votes
24
views
JT
asked 10 days ago
This is the third time I've run into this error. I don't know is it a real issue or I just forget to set something up. So basically when I try to add data permission to all table in Lakeformation...
0
answers
0
votes
13
views
asked a month ago
Config of Redshift Cluster: - Enhanced VPC routing has enabled - Redshift subnet in the same subnet as S3 vpc endpoint Config of S3 - VPC endpoints created for S3 - Routing has configured to...
1
answers
0
votes
61
views
asked a month ago
hello, in planning phase of a Datalake project and came across LakeFormation which seems to be the preferred way. I understand that essentially it is a group of S3 buckets so resiliency & durability...
1
answers
0
votes
371
views
asked 3 months ago
HIVE_CURSOR_ERROR: incorrect data check This query ran against the "dbreport" database, unless qualified by the query. Please post the error message on our forum or contact customer support with...
1
answers
0
votes
168
views
Chris J
asked 3 months ago
I've got a fairly simple ETL job that reads several catalog tables or views and does some joins. the job errors out with the following error: ``` Error Category: UNCLASSIFIED_ERROR; An error...
0
answers
0
votes
262
views
asked 4 months ago
Is it possible to integrate opentelemetry(ADOT) and promethus managed by AWS with a data lake. The data lake could be both on edge or on AWS? If yes then how does it work? How can oepntemetry and...
1
answers
0
votes
180
views
Haritha
asked 4 months ago
At every 30 minutes it saying "ICEBERG_VACUUM_MORE_RUNS_NEEDED: Removed 20000 files in this round of vacuum" but when I calculate the my table metadata size it didn't changed before and after the...
2
answers
0
votes
611
views
Naresh
asked 7 months ago
Hi! I have been searching and playing around with services and cannot seem to find what I need. I am using the following architecture to guide me in building out my end-to-end solution:...
2
answers
0
votes
377
views
tsimp
asked a year ago
When executing a task the last step is validating the data migrated with the source against target apparently using Athena, I have the following error: 2023-11-07T22:09:04 [VALIDATOR_TARGE ]E: Not...
1
answers
1
votes
977
views
lelem
asked a year ago
Hello I have created a resource link to a shared database from a different account. I am able to query the tables within the database but "Show tables from <database>" and "View Tables" on the AWS...
1
answers
0
votes
607
views
asked a year ago
My Glue 4.0 jobs have suddenly stopped working with error message below. As it is related to boto3, I am unable to make any changes to library config. Pls advise. NB: I noticed that urllib3 released...
0
answers
0
votes
267
views
Timi_PP
asked a year ago