By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

AWS Glue - Data Catalog Read Extra Column

0

I'm running into an issue when reading a Glue Data Catalog data source in an Visual ETL AWS Glue job. An extra column is being added in called 'col40', which is not in the underlying file that was crawled. When I look at the Data Catalog table schema, I'm not seeing this extra column. Any idea what could be causing this unexpected behavior to occur?

Topics
StorageAnalytics
Tags
Amazon Simple Storage ServiceAWS Glue
Language
English
Matt
asked 2 months ago192 views
1 Answer
0

The generated code uses DynamicFrame to infer the schema dynamically. You must be using CSV files and one or more of the rows have an extra field (or the separator escaping is not working correctly)

profile pictureAWS
EXPERT
Gonzalo Herreros
answered 2 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content