Questions tagged with AWS Data Pipeline
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have a dashboard and I do not want to have any access restrictions for Amazon employees. Is it possible? any ANT group that provides access to all Amazon employees?
1
answers
0
votes
334
views
asked 2 years agolg...
I have AWS DB of Production and AWS DB of UAT environment. I want whenever needed I can get Production data of few tables to my UAT Database by clicking button from GUI. So GUI means we will design...
1
answers
0
votes
311
views
asked 2 years agolg...
I am trying to write data from S3 to BigQuery using Glue, this is working perfectly fine -** have used the Glue BQ connector from Marketplace**. I am able to write the data to the table at BQ but when...
1
answers
0
votes
901
views
asked 2 years agolg...
Hi, I'm searching a AWS tool to help me to move data from an database in redshift to an target database, but the target database is only accessible via API.
I need to do some transformationsn in the...
2
answers
0
votes
319
views
asked 2 years agolg...
Hello,
I have created a Lambda function that fetched the static/hash token from the environment variables in the Configuration section.
When I try to export the Lambda function using the Action >...
1
answers
0
votes
1544
views
asked 2 years agolg...
I'm working on a sample to output an Aurora query to a fixed-width file (each column is converted to a specific width in the file, regardless of column data length), but every attempt to use the RegEx...
1
answers
0
votes
347
views
asked 2 years agolg...
I am migrating data from a MySQL DB to DynamoDB. I am using object-mapping rule to transform the data to match my needs. However I have a EPOCH timestamp stored in MySQL DB that I would like to...
0
answers
2
votes
168
views
asked 2 years agolg...
I am creating a data pipeline using Template-ShellCommandActivity, but I am facing an issue while attaching the resource role. I am not able to get the resource role I created in the dropdown. And...
0
answers
0
votes
165
views
asked 2 years agolg...
I have a use-case where I have to read DynamoDB table data and convert this into csv file and write into a s3 bucket using AWS lambda function. DynamoDB tables data is bit low around 2-3 MB so I want...
1
answers
0
votes
2318
views
asked 2 years agolg...
I followed [this AWS blog post](https://aws.amazon.com/blogs/aws/introducing-amazon-kinesis-data-analytics-studio-quickly-interact-with-streaming-data-using-sql-python-or-scala/) to create KDA app,...
0
answers
1
votes
166
views
asked 2 years agolg...
Hi There,
I'm sourcing data from dynamo db and residing into s3 bucket using AWS data pipeline. I have been running this pipeline once in a week to get up-to date the records from dynamo db table....
1
answers
0
votes
1032
views
asked 2 years agolg...
**Transfer data from RDS MySQL to S3 bucket
**
I set up a data pipeline to transfer data from RDS Mysql to S3 Bucket, where before thet I set up the RDS mysql database with username and password....
1
answers
0
votes
1540
views
asked 2 years agolg...