glue job not running ??

0

''failed to execute with exception Task allocated capacity exceeded the limit. (Service: AWSGlueJobExecutor; Status Code: 400; Error Code: InvalidInputException; Request ID: 8d31d112-91e4-4892-900f-048d993e0da1; Proxy: null) this error is coming when ever I run a job.

1 Risposta
0

It would be helpful to understand more details to understand why you are facing this issue.

In my experience, I have faced this exact same issue when I use more than 300 under "Requested number of workers". The maximum number of workers you can define is

  • 299 for G.1X (For AWS Glue version 2.0 or later jobs)
  • 149 for G.2X (For AWS Glue version 2.0 or later jobs)
  • For older job types that use "Standard", choose an integer from 2 to 100. The default is 10.

Another reason could be the service quotas and you could check your quotas. You can use Service Quotas console to view and request increases for most AWS quotas.

profile pictureAWS
con risposta 2 anni fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande