Questions tagged with Amazon Managed Workflows for Apache Airflow (MWAA)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
In Airflow, we have a series of tasks. But to simplify let us consider there are 2 tasks. The first task lists files from an S3 bucket and the second task picks those files to...
1
answers
0
votes
86
views
asked 6 months agolg...
i'm trying to execute my dag file to upload S3 bucket
but, cant see the task on Airflow UI
when i checked the same issue in google search and referenced the...
1
answers
0
votes
137
views
asked 7 months agolg...
I get the following error when Airflow tries to import my DAG file on MWAA:
```
Broken DAG: [/usr/local/airflow/dags/file.py] Traceback (most recent call last):
File...
1
answers
0
votes
371
views
asked 7 months agolg...
Hello Community,
I am trying to move our airflow from single Node EC2 instance. But I can't find any documentation on how to
- Install a ODBC driver used by our application in MWAA or supply a...
1
answers
0
votes
348
views
asked 7 months agolg...
We are experimenting a significant increase in CloudWatch metrics costs since deploying Amazon MWAA. We noticed that AWS MWAA utilizes CloudWatch as the default metrics destination via Statsd.
We...
1
answers
0
votes
397
views
asked 7 months agolg...
I want to follow up on https://repost.aws/questions/QUmuAqDG_yT2KCtu7G1zsukQ/cost-of-aws-mwaa.
I understand the hourly cost is started once the Environment is established (not per DAG execution)
My...
1
answers
0
votes
252
views
asked 7 months agolg...
After switching the alternate secrets backend to the Parameter store I was able to retrieve connections/variables from the SSM Parameter store, but the only issue was the task logs page in the Airflow...
1
answers
0
votes
87
views
asked 8 months agolg...
We recently updated our Airflow environment to version 2.6.3. \
After few days we wanted to update the plugins without changing the requirements, but started getting an error \
`WARNING:...
1
answers
1
votes
264
views
asked 8 months agolg...
MWAA / Dag / Sizelg...
We are reaching the maximum number of jobs for our MWAA and we are using the Small instance - which is listed on this page (https://aws.amazon.com/managed-workflows-for-apache-airflow/pricing/) as...
1
answers
0
votes
506
views
asked 8 months agolg...
Hi, recently at my company, we started using MWAA and we noticed our CloudWatch bill is spiking a lot. I found that this might be due to metrics pushed from MWAA and I want to stop all the metrics...
3
answers
0
votes
672
views
asked 9 months agolg...
"I have multiple Python scripts stored within a Docker image, each with its set of input parameters. My goal is to execute these scripts on Amazon Elastic Container Service (ECS) as required. Inside...
1
answers
0
votes
405
views
asked 9 months agolg...
Hi,
After upgrading Airflow version in MWAA to 2.6.3, every call to Airflow CLI returns following sterror message:
"
/usr/local/airflow/.local/lib/python3.10/site-packages/airflow/stats.py:604...
1
answers
0
votes
84
views
asked 9 months agolg...