2 Answers
- Newest
- Most votes
- Most comments
1
By updating the S3 location of the script, you are only creating a new version of the code in S3. To completely replace the code in Glue, you would have to use boto3 to update Glue job with the location of the new script- https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/glue.html#Glue.Client.update_job. This will not reset any of the other parameters.
response = client.update_job({
"JobName": "string",
"JobUpdate": {
"Command": {
"Name": "string",
"PythonVersion": "string",
"ScriptLocation": "string"
}
}
})
answered 2 years ago
0
I followed ananthtm's answer and could update the jobs.It however overwrote the other parameters like Connections etc when I passed the basic ones as mentioned . I then added the other parameters in the update statement and it worked fine.
answered 2 years ago
Relevant content
- asked 7 months ago
- How can I use a Lambda function to automatically start an AWS Glue job when a crawler run completes?AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 2 years ago