Skip to content

All Content tagged with AWS Lake Formation

AWS Lake Formation is a service that makes it easy to set up a secure data lake in days. A data lake is a centralized, curated, and secured repository that stores all your data, both in its original form and prepared for analysis.

Content language: English

Filter content
Select tags to filter
Sort by
Sort by most recent
217 results
Hi, I'm working on a Spark Scala App that reads Delta Lake (with CDF) tables directly from S3 (not catalog registred) and writes a parquet table. The productive process is being executed on EMR 6.11 ...
3
answers
0
votes
102
views

asked a month ago

AWS

AarthiEXPERT

published a month ago0 votes126 views

In this guide, I will provide the EMR cluster configuration and Spark config required to launch it in FTA mode. EMR Spark and Glue Spark are available in FTA and FGAC modes, to work with AWS Lake For...
This article aims to provide a practical guide for cross account setup
Compare Glue Data Catalog views with Glue Iceberg materialized views, and learn when to use each for governed data sharing, query performance, freshness, and cost.
Amazon EMR and AWS Glue Spark provides two modes for Apache Spark workloads that access tables in the AWS Glue Data Catalog that are governed by AWS Lake Formation. Learn when to use what configuratio...
When trying to run queries in Athena for a table, I'm getting this error: COLUMN_NOT_FOUND: Column *didn't include column name* cannot be resolved or requester is not authorized to access requested re...
1
answers
0
votes
60
views
AWS

asked 2 months ago

This article explains how to use Lake Formation tag-based access control (LF-TBAC) to automate permissions management at scale for data mesh architectures.
Enterprises upgrading their AWS Lake Formation cross-account sharing to Version 5 may get blocked from granting data access across accounts breaking cross-account data lake workflows. This article pro...
When you enable Lake Formation runtime roles on an EMR 7.x cluster, all Spark steps may silently time out after 300 seconds. This happens because S3 locations registered with the default Service-Linke...
This article provides the step-by-step guidance for setting up and accessing Amazon S3 Tables (Iceberg) with AWS Lake Formation permissions in a 3 account data mesh architecture.
Is Lake Formation credential vending through the Glue Iceberg REST endpoint (`https://glue.<region>.amazonaws.com/iceberg`) supported for AWS Lambda execution roles when reading and writing S3 Tables?...
1
answers
1
votes
241
views

asked 4 months ago

as anyone else seen `ICEBERG_CURSOR_ERROR: Failed to read Parquet file` from Athena engine v3 against Apache Iceberg tables managed by Amazon Security Lake (the OCSF v2.0 source tables in `amazon_secu...
2
answers
1
votes
233
views

asked 4 months ago

  • 1
  • 2
  • 3
  • 4
  • 5
  • •••
  • 19
  • Page size
    12 / page