Questions tagged with Amazon AppFlow

Content language: English

Sort by most recent

Browse through the questions and answers listed below or filter and sort to narrow down your results.

  • 1
  • 2
  • 12 / page
"error while communicating with connector client error the request to sap failed with status code 400 connection time out" Hi, when trying to make a connection between SAP & Appflow with SAP OData connector, we are getting the above error message, please guide on resolution
0
answers
0
votes
20
views
Prem
asked 8 days ago
My connection from GA4 to AWS is established and working well but an error occurs as soon as I click on "Run flow" : "Amazon AppFlow received the following error: The request failed because the service Source Google Analytics 4 returned the following error: Details: **Google Analytics 4 returned the following error: The request failed with status code 400 (Bad Request)., ErrorCode: ClientError."** I also followed the documentation carefully. Do you have any suggestions ? Thank you !
0
answers
0
votes
10
views
Samuel
asked 9 days ago
Hi, I have successfully connected to FB Ads via AppFlow. I would like to set a filter to only download ads that was created in the last 24 hours. This way, i can schedule the appflow to run once a day. Currently the "created_time" filter can only take a specific date and time. How can I set it to filter only the last 24 hours? Thanks
0
answers
0
votes
8
views
asked 17 days ago
Hello I need to create a flow in AppFlow using the Quickbooks connector. After I enter the ID, Secret, URL and CompanyId I get the following error (for now I'm using the sandbox enviroment, not production): "The redirect_uri query parameter value is invalid. Make sure it is listed in the Redirect URIs section on your app's keys tab and matches it exactly. Click here to learn more about the redirect_uri query parameter." After looking up in the QuickBooks Documentation, looks like I need to set a special URI that belongs to the connector (Postman in their example), but I don't know which one should I use with Amazon AppFlow. This Redirect URI is entered in the Settings of the QuicbkBooks app (not in AWS of course). I tried adding the following ones in the QuickBooks Redirect URI settings, but the same error appears: "https://us-east-1.console.aws.amazon.com/appflow/oauth" "https://developer.intuit.com/v2/OAuth2Playground/RedirectUrl" "http://localhost" "https://sandbox-quickbooks.api.intuit.com/v2/OAuth2Playground/RedirectUrl"
0
answers
0
votes
11
views
hector
asked 24 days ago
I'm calling CreateConnectorProfile from a Lambda, and I get the following error : ``` An error occurred (ValidationException) when calling the CreateConnectorProfile operation: CreateConnectorProfile failed as AppFlow is unable to create secret in customer account {MyAWSAccountId}. Ensure the IAM user has permissions secretsmanager:CreateSecret and secretsManager:PutResourcePolicy. If customer managed KMS key was provided, ensure AppFlow also has access to the key. Please give the required permissions and try to create the connector profile again. ``` My Lambda's execution role has the Managed Policy `AmazonAppFlowFullAccess` attached. The customer managed KMS Key (which is passed in as the `kmsArn` to the CreateConnectorProfile call) has the following policy : ``` { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Principal": { "Service": "appflow.amazonaws.com" }, "Action": [ "kms:Encrypt", "kms:GenerateDataKey", "kms:Decrpyt" ], "Resource": "*" }, { "Effect": "Allow", "Principal": { "AWS": "arn:aws:iam::{MyAwsAccountId}:root" }, "Action": "kms:*", "Resource": "*" } ] } ``` What permissions am I missing?
0
answers
0
votes
29
views
asked a month ago
I was recently setting up an AWS AppFlow Flow to pull data from SAP and store them into an S3 data lake. As the SAP source Sytem was reachable via a dedicated VPN connection only it was required to setup a private connection and so I was following the tutorial at https://aws.amazon.com/blogs/awsforsap/share-sap-odata-services-securely-through-aws-privatelink-and-the-amazon-appflow-sap-connector/ to make it work. As several things like a VPC, an ACM certificate and the required NLB were already in place I was able to skip those steps and start with setting up a PrivateLink endpoint service with a private DNS name dedicated for the SAP connection to be used by the AppFlow Connector. And as the default HTTPS port 443 was already in use at the NLB I just picked another one that was available and added a new listener for that port having attached a target group pointing to the on-premise SAP instace's IP address. But unfortunately this setup didn't work and setting up the Connector using this Private Link Service Endpoint's DNS name and the respective NLB's port for the SAP instance always failed with error message "Error while communicating to connector: Client error: The request to SAP failed with the status code: 400 and error message: Call to SAP endpoint timed out for GET http request". After hours of debugging, research, documentation lookup and somehow trying to find or at least getting an idea for the mistake in our setup a colleague of mine came up with the desperate proposal to setup a new NLB and again setup everything from scratch using this NLB and use exactly the values outlined in the tutorial - and it worked! After a bit of testing it turned out that initially using a different port then 443 for the Connector was the root cause of our problem. Was anyone else already able to make such a connection work using a different port than 443? As in the Connector setup the port selection is not limited (via any kind of validation rule nor is it mentioned at any place of the official documentation - only found a hint that using HTTPS is necessary somewhere) so I can only hardly imagine that this setup is so limited to be only possible with port 443.
0
answers
0
votes
15
views
asked a month ago
And if so, which [object and subobject](https://docs.aws.amazon.com/appflow/latest/userguide/connectors-github.html#github-objects) would that be? The file content of my CSV file does not show up when I use Repository (repos) as the object and ystoneman (my GitHub username) as the subjobject. Instead, the columns all contain only metadata. The GitHub REST API itself seems to support this via the [Repository Contents API](https://docs.github.com/en/rest/repos/contents?apiVersion=2022-11-28). For example, I'm able to get the contents of an 18 MB file with the following cURL command: ``` curl \ -H "Accept: application/vnd.github.raw+json" \ -H "Authorization: Bearer TOKEN"\ -H "X-GitHub-Api-Version: 2022-11-28" \ https://api.github.com/repos/ystoneman/hotel-bookings/contents/hotel_bookings.csv ``` And here's an example of the output ([data from Kaggle](https://www.kaggle.com/datasets/jessemostipak/hotel-booking-demand)): ``` City Hotel,0,34,2017,August,35,31,2,5,2,0,0,BB,DEU,Online TA,TA/TO,0,0,0,D,D,0,No Deposit,9,NULL,0,Transient,157.71,0,4,Check-Out,2017-09-07 City Hotel,0,109,2017,August,35,31,2,5,2,0,0,BB,GBR,Online TA,TA/TO,0,0,0,A,A,0,No Deposit,89,NULL,0,Transient,104.4,0,0,Check-Out,2017-09-07 City Hotel,0,205,2017,August,35,29,2,7,2,0,0,HB,DEU,Online TA,TA/TO,0,0,0,A,A,0,No Deposit,9,NULL,0,Transient,151.2,0,2,Check-Out,2017-09-07 ``` Seems like using a source object of Repository, Branch, and Commit does not yield this data, even when I use an auth token with all read actions allowed on the repository, destination as S3, and I choose "Map all fields directly".
Accepted AnswerAmazon AppFlow
1
answers
0
votes
30
views
AWS
asked 2 months ago
I created an Appflow and use RDS Postgres as destination. When doing the fields mapping after setting set the connection to DB, only 4 fields can be selected from RDS Postgres, but there are 20 fields created in that table. I tried to use the different tables but still got this same situation. What possible issue this could be? Thank you!
0
answers
0
votes
21
views
Eric
asked 2 months ago
In the AppFlow UI, it appears to indicate that maintaining the source datatypes is possible via the option underneath parquet: ![Enter image description here](/media/postImages/original/IMJzz-QU1CRyefHPWRbm4a4g) However, in documentation (https://docs.aws.amazon.com/appflow/latest/userguide/s3.html), it states: > If you choose Parquet as the format for your destination file in Amazon S3, the option to aggregate all records into one file per flow run will not be available. **When choosing Parquet, Amazon AppFlow will write the output as string, and not declare the data types as defined by the source.** These two sources conflict with each other. The behavior I am seeing is what the documentation describes and all data is being written as string type. I am trying to determine if this is intended or a bug. If the latter, I can open a support ticket.
1
answers
2
votes
49
views
tjtoll
asked 2 months ago
Does AWS Infrastructure such as AppFlow automatically trust AWS Private CA certs? [This ](https://aws.amazon.com/blogs/awsforsap/share-sap-odata-services-securely-through-aws-privatelink-and-the-amazon-appflow-sap-connector/) page seems to suggest that it does: > The SAP instance must have a certificate installed for end-to-end TLS communication. You can use Amazon private CA for obtaining server certificates and installing them on the SAP system via transaction code STRUST. If you want to terminate the SSL at the load balancer, then you can skip this step and just forward the traffic to the target group on a port where SAP does not require a certificate for SSL communication.
1
answers
0
votes
27
views
wooly
asked 2 months ago
Does AppFlow SAP OData Connector trust certificates with Certificate Transparency (CT) logging disabled? Our company has security concerns about using standard public certs.
0
answers
0
votes
32
views
wooly
asked 2 months ago
I am looking to expose SAP S/4 OData to AppFlow using PrivateLink as described [here](https://aws.amazon.com/blogs/awsforsap/share-sap-odata-services-securely-through-aws-privatelink-and-the-amazon-appflow-sap-connector/). Just wanting to know if it is possible to deploy the SAP Web Dispatcher in between the NLB and the SAP Gateways. AppFlow => NLB => Web Dispatcher => SAP Gateway.
1
answers
0
votes
47
views
wooly
asked 2 months ago
  • 1
  • 2
  • 12 / page