Error Category: UNCLASSIFIED_ERROR; An error occurred while calling o109.pyWriteDynamicFrame. Cannot write map field DetectedEntities to CSV

0

"In my AWS Glue job, I've configured an ETL process to extract data from the Data Catalog, apply a transformation to detect Personally Identifiable Information (PII), and then store the transformed data in an S3 bucket. However, during execution, I encountered the following errors:

Error Category: UNCLASSIFIED_ERROR: When attempting to write the dynamic frame to CSV format, an error occurred stating 'Cannot write map field DetectedEntities to CSV.'

Error at the S3 target: 'Target node not supported. You have selected a data target node which is not supported for data preview.'

I'm seeking guidance on resolving these issues to ensure the successful execution of my AWS Glue job. How can I troubleshoot and address these errors effectively?"

demandé il y a un mois162 vues
1 réponse
0
Réponse acceptée

As the error says, the output is a nested structure. It cannot be represented on a CSV file. Try storing to parquet.

AWS
répondu il y a un mois
AWS
INGÉNIEUR EN ASSISTANCE TECHNIQUE
vérifié il y a 18 jours
  • yes, thank you for clarification

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions