Questions tagged with AWS Glue
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
We connected Timestream to Athena using the [Athena Timestream connector](https://docs.aws.amazon.com/athena/latest/ug/connectors-timestream.html). When running a federated query through Athena to...
2
answers
0
votes
796
views
asked 5 months agolg...
i got a mongodb atlas cluster outside aws. I want to use aws glue with my mongo db databases so i created a connection but im getting "InvalidInputException: Unable to resolve any valid connection". ...
1
answers
1
votes
303
views
asked 5 months agolg...
```
df = spark.read.parquet("s3://folder/")
df = df.withColumn('filename', input_file_name())
AmazonS3_node1697616892615 = DynamicFrame.fromDF(df, glueContext, "s3sparkread")
```
if this is the code...
1
answers
0
votes
417
views
asked 5 months agolg...
I'm trying to achieve data change capture using AWS Glue and don't want to use DMS. I'm trying to transfer data between two Oracle RDS instances which are in different AWS Account. Here I am trying to...
1
answers
0
votes
550
views
asked 5 months agolg...
I'm trying to achieve data change capture using AWS Glue and don't want to use DMS. I'm trying to transfer data between two Oracle RDS instances which are in different AWS Account. Here I am trying to...
1
answers
0
votes
513
views
asked 5 months agolg...
Hi all,
I'm recently introduced to AWS DataZone.
I'm have created 2 domain in a single account.
**df-test-1 and df-test-2**
Both domains do have data created by AWS Athena environment but I can...
3
answers
0
votes
729
views
asked 5 months agolg...
I tried to add through 2 ways
```
newdf = newdf.withColumn('filename2', input_file_name())
```
also tried
```
AmazonS3_node = glueContext.create_dynamic_frame.from_options(
...
1
answers
0
votes
555
views
asked 5 months agolg...
For a DeltaTarget, glue.create_crawler is not recognizing the parameter "CreateNativeDeltaTable"lg...
Unknown parameter in Targets.DeltaTargets[0]: "CreateNativeDeltaTable", must be one of: DeltaTables, ConnectionName, WriteManifest.
However, in the documentation it shows the parameter (see...
1
answers
0
votes
185
views
asked 5 months agolg...
Hi,
I am trying to use Athena to query the s3 file which is in csv format and contains the json objects.
**S3 CSV file:**
```
Id, data, last_update
001, {"key1":"value1"}, 10-01-2024
002,...
1
answers
0
votes
601
views
asked 5 months agolg...
Hi,
could you please help me creating crawler in aws glue. when we create aws crawler with all IAM access then we get error account account id is denied access.
1
answers
0
votes
221
views
asked 5 months agolg...
I am trying to create a glue notebook using an IAM role that has policies 'AWSGlueConsoleFullAccess', 'AWSGlueServiceNotebookRole' and a custom policy as below:
```
{
"Version": "2012-10-17",
...
1
answers
0
votes
220
views
asked 5 months agolg...
Just curious when will AWS Glue support Java 11 or Java 17? AWS Glue 4.0 only supports Java 8 so far and due to this our project can't use the new features of Java 11.
1
answers
0
votes
629
views
asked 5 months agolg...