Sample glue streaming job in python from reading data from kafka to glue and write into s3 in iceberg format
0
I am looking for sample glue streaming script that reads data from kafka and writes into s3 in iceberg format .
I have gone through aws documentation , but did not find enough details to start with the work . I have to read data from kafka not AWS managed kafka (MSK ).
It's easier if you just search for those separate, how to create a streaming job for kafka and how to write to Iceberg, you shouldn't have difficulty finding those separately
AWS OFFICIALUpdated 3 years ago
It's easier if you just search for those separate, how to create a streaming job for kafka and how to write to Iceberg, you shouldn't have difficulty finding those separately