Glue crawler ignores Int/Long with trailing whitespaces

0

We have incoming file with the fixed length field length (.dat). For example: |2|123 |AWS |0505 |3 When Glue Crawler crawles the file, it ignores all the int/long values that have trailing spaces. In this case 123 value won't appear in the result when querying created table in athena. I have tried to create the custom classifier to remove the white spaces however there is no specific custom Quote symbol that I can provide in the config to make crawler pick it up instead of default csv one. Any help would be appreciated

Denys
asked 2 years ago125 views
No Answers

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions