Questions tagged with AWS Data Pipeline
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi, I'm searching a AWS tool to help me to move data from an database in redshift to an target database, but the target database is only accessible via API.
I need to do some transformationsn in the...
2
answers
0
votes
295
views
asked 2 years agolg...
Hello,
I have created a Lambda function that fetched the static/hash token from the environment variables in the Configuration section.
When I try to export the Lambda function using the Action >...
1
answers
0
votes
1466
views
asked 2 years agolg...
I'm working on a sample to output an Aurora query to a fixed-width file (each column is converted to a specific width in the file, regardless of column data length), but every attempt to use the RegEx...
1
answers
0
votes
285
views
asked 2 years agolg...
I am migrating data from a MySQL DB to DynamoDB. I am using object-mapping rule to transform the data to match my needs. However I have a EPOCH timestamp stored in MySQL DB that I would like to...
0
answers
2
votes
155
views
asked 2 years agolg...
I am creating a data pipeline using Template-ShellCommandActivity, but I am facing an issue while attaching the resource role. I am not able to get the resource role I created in the dropdown. And...
0
answers
0
votes
153
views
asked 2 years agolg...
I have a use-case where I have to read DynamoDB table data and convert this into csv file and write into a s3 bucket using AWS lambda function. DynamoDB tables data is bit low around 2-3 MB so I want...
1
answers
0
votes
2266
views
asked 2 years agolg...
I followed [this AWS blog post](https://aws.amazon.com/blogs/aws/introducing-amazon-kinesis-data-analytics-studio-quickly-interact-with-streaming-data-using-sql-python-or-scala/) to create KDA app,...
0
answers
1
votes
152
views
asked 2 years agolg...
Hi There,
I'm sourcing data from dynamo db and residing into s3 bucket using AWS data pipeline. I have been running this pipeline once in a week to get up-to date the records from dynamo db table....
1
answers
0
votes
985
views
asked 2 years agolg...
**Transfer data from RDS MySQL to S3 bucket
**
I set up a data pipeline to transfer data from RDS Mysql to S3 Bucket, where before thet I set up the RDS mysql database with username and password....
1
answers
0
votes
1487
views
asked 2 years agolg...
Hi,
I have a use case where I am fetching data on certain items (unique itemID) multiple times a day (identified by day_BatchTime) and storing them on a dyanmoDB. My composite primary key consists...
3
answers
0
votes
526
views
asked 2 years agolg...
Hello
I am working on serverless application, and i was looking for something handle the frontend part and I found Honeycode since its native and its codeless.
So is it possible to my Honeycode app...
1
answers
0
votes
485
views
asked 2 years agolg...
Hi,
I have a problem in that I make heavy use of EMRs, and I orchestrate their use with Data Pipeline - multiple daily runs are automated and EMRs are launched and terminated on conclusion.
However,...
1
answers
0
votes
354
views
asked 2 years agolg...