Concurrent jobs in emr serverless

A bit of additional information.

As you can submit multiple jobs to an EMR-S application and each job will continue to run in parallel, however ensure those jobs hit the configured application limit or account level limit which has to be increased depends on your usecase and requirement. If you submit a single job with full capacity of application resource limit/account limit, then another job might not be executed in parallel.

Besides, to add more and more jobs with a fixed application maximum capacity limits, you need to handle them via AWS Step function and retry job submission in case the resources not available to serve the new jobs as of today.

To control the number of jobs that can run in parallel, we need the EMR serverless queue which can manage temporal overloads and force the jobs to wait for free resources when the application max capacity reached. This feature will be included in future soon.