Error Category: UNCLASSIFIED_ERROR; An error occurred while calling o109.pyWriteDynamicFrame. Cannot write map field DetectedEntities to CSV

0

"In my AWS Glue job, I've configured an ETL process to extract data from the Data Catalog, apply a transformation to detect Personally Identifiable Information (PII), and then store the transformed data in an S3 bucket. However, during execution, I encountered the following errors:

Error Category: UNCLASSIFIED_ERROR: When attempting to write the dynamic frame to CSV format, an error occurred stating 'Cannot write map field DetectedEntities to CSV.'

Error at the S3 target: 'Target node not supported. You have selected a data target node which is not supported for data preview.'

I'm seeking guidance on resolving these issues to ensure the successful execution of my AWS Glue job. How can I troubleshoot and address these errors effectively?"

feita há um mês158 visualizações
1 Resposta
0
Resposta aceita

As the error says, the output is a nested structure. It cannot be represented on a CSV file. Try storing to parquet.

AWS
respondido há um mês
AWS
ENGENHEIRO DE SUPORTE
avaliado há 18 dias
  • yes, thank you for clarification

Você não está conectado. Fazer login para postar uma resposta.

Uma boa resposta responde claramente à pergunta, dá feedback construtivo e incentiva o crescimento profissional de quem perguntou.

Diretrizes para responder a perguntas