glue job not running ??

0

''failed to execute with exception Task allocated capacity exceeded the limit. (Service: AWSGlueJobExecutor; Status Code: 400; Error Code: InvalidInputException; Request ID: 8d31d112-91e4-4892-900f-048d993e0da1; Proxy: null) this error is coming when ever I run a job.

1 Antwort
0

It would be helpful to understand more details to understand why you are facing this issue.

In my experience, I have faced this exact same issue when I use more than 300 under "Requested number of workers". The maximum number of workers you can define is

  • 299 for G.1X (For AWS Glue version 2.0 or later jobs)
  • 149 for G.2X (For AWS Glue version 2.0 or later jobs)
  • For older job types that use "Standard", choose an integer from 2 to 100. The default is 10.

Another reason could be the service quotas and you could check your quotas. You can use Service Quotas console to view and request increases for most AWS quotas.

profile pictureAWS
beantwortet vor 2 Jahren

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen