Explore how you can quickly prepare for, respond to, and recover from security events. Learn more.
Questions tagged with Data Lakes
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
91 results
Hello everyone,
### 1. Context
We have a Delta Lake where we write our tables in **S3** in **Delta format**, and we use the **Glue Catalog** for queries in **Athena**. Tables are created both with an...
I am trying to create a Delta Table from spark sql using the Glue meta catalog.
I can correctly query a Delta table using the Glue metastore:
```
%%sql
select * from `my_table` VERSION AS OF 1 limit ...
asked a year ago
Looks like attempting to write to a Delta Lake table from a DynamicFrame is not working. The Visual Glue interface generates a script like:
```
s3 = glueContext.write_dynamic_frame.from_optio...
asked a year ago
Hello team,
We are planning to build a data lake in AWS that will contain regularly extracted data from an on-prem data warehouse. The purpose of this data lake is to serve the following purposes in ...
This CDK code produces a "Resource did not stabilize" error:
```
data_location = lakeformation.CfnPrincipalPermissions.DataLocationResourceProperty(
catalog_id=Aws.ACCOUNT_ID,
res...
In CDK, I am registering a datalake location with the following code:
```
lakeformation.CfnResource(scope, "S3BucketRegistrationResource",
resource_arn="arn:aws:s3:::my-s3-bucket-here/my_db_fol...
Hi AWS community!
I am new for AWS.
How can I learn and land sucessful on AWS technology?
We are utilizing AWS Glue Catalog along with Athena v3 and Iceberg for our data solution.
We create tables using a CREATE TABLE query in Athena, setting the ‘table_type’ parameter to ‘ICEBERG’. Our da...
Hello everybody,
I'm working for a small retail company, where we want to move our data to aws. Our data can be from different sources (postgresDB, MySQL DB or other unstructured data sources or APIs)...
The goal is to create an ETL job that can be altered and executed by non-technical users in our organization, which is why we are sticking to only visuals and not code.
The problem is that the nodes...
Hi TEam,
Me ew to AWS Data lake configuration. As per the doc, it refers to create the Glue connection which will be internally used by AWS BluePrint.
My database is running on EC2 instance of differ...
After using a crawler to create a table it shows the following error which I don't know how to fix.
