Explore how you can quickly prepare for, respond to, and recover from security events. Learn more.
Questions tagged with AWS Data Pipeline
AWS Data Pipeline is a web service that helps you reliably process and move data between different AWS compute and storage services, as well as on-premises data sources, at specified intervals.
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
89 results
As a publisher of data set on AWS Data Exchange, we would like the data asset downloaded by customers on their server from AWS Data Exchange to be technically un-usable when they terminate the subscri...
Would like to know what would be the way to migrate per user data currently hosted at on-prem vdi to AWS workspaces? Will this be a case to case migration since the on-prem VDI data might be only acce...
How can DMS do more complex mapping that is not simply 1-1 from source to target?
For example, if you need to check for data across multiple tables for some business logic and based on those results,...
AWS DataPipeline Is Failed for EMrClusterBackup with Error Resource Not Healthy:- JobFlow retired
I have a dashboard and I do not want to have any access restrictions for Amazon employees. Is it possible? any ANT group that provides access to all Amazon employees?
I have AWS DB of Production and AWS DB of UAT environment. I want whenever needed I can get Production data of few tables to my UAT Database by clicking button from GUI. So GUI means we will design on...
I am trying to write data from S3 to BigQuery using Glue, this is working perfectly fine -** have used the Glue BQ connector from Marketplace**. I am able to write the data to the table at BQ but when...
Hi, I'm searching a AWS tool to help me to move data from an database in redshift to an target database, but the target database is only accessible via API.
I need to do some transformationsn in the d...
Hello,
I have created a Lambda function that fetched the static/hash token from the environment variables in the Configuration section.
When I try to export the Lambda function using the Action > Ex...
I'm working on a sample to output an Aurora query to a fixed-width file (each column is converted to a specific width in the file, regardless of column data length), but every attempt to use the RegEx...
I am migrating data from a MySQL DB to DynamoDB. I am using object-mapping rule to transform the data to match my needs. However I have a EPOCH timestamp stored in MySQL DB that I would like to transf...
I am creating a data pipeline using Template-ShellCommandActivity, but I am facing an issue while attaching the resource role. I am not able to get the resource role I created in the dropdown. And whe...