2 réponses
- Le plus récent
- Le plus de votes
- La plupart des commentaires
0
Hello,
Could you share your DAG code after removing any sensitive information, if any?
Thanks!
0
Hello,
In general as mentioned in the document[1], there are three options when overriding the configurations in the job run for an EMR Serverless application.
- Override an existing configuration
- Add an additional configuration
- Remove an existing configuration
I suspect that the MWAA EMR serverless Job run/submit operator might be removing an existing configuration by passing an empty set which is overriding the the default configuration defined at application level.
To confirm this, i would recommend you to compare the Cloudtrail events of StartJobRun invoked from API Console and from MWAA.
References: [1] https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/default-configs.html#default-configs-override
répondu il y a un mois
Contenus pertinents
- demandé il y a 6 mois
- demandé il y a un an
- demandé il y a 2 mois
- AWS OFFICIELA mis à jour il y a 2 ans
- AWS OFFICIELA mis à jour il y a 2 ans
- AWS OFFICIELA mis à jour il y a un an
- AWS OFFICIELA mis à jour il y a un an