AWS Glue Studio Visual Editor Data Preview changing schema data types incorrectly

0

We have a file that we used the default XML crawler to crawl the data for, and it correctly created a table and schema for the data (relevant column shown): Correct schema

However when creating a job in the Visual ETL tool it changes the datatype from bigint to choice in the data preview session, and shows the data as mostly longs, with a couple of int values: Choice data

Attempting to do a change schema node doesn't allow me to change the choice value: No change schema option

Trying to do any data transform (such as flatten) results in an error: Error

Things I've tried to do to correct the issue:

  1. Change the schema type in the table from bigint to int.
  2. Use the resolveChoice function
  3. Restarting data preview sessions
  4. Recreating the job / data catalog source node
  5. Recrawl the data

Also, if i don't use the data preview session, but just run the job, it runs successfully and outputs the data as expected, so it appears to just be a problem with the data preview (however this renders data preview useless).

Is there any way to resolve this issue? We've had it show up not just in this set of data, but multiple sets of data over the last few days, and we hadn't seen it before last friday (Jan 19, 2024).

jeff
질문됨 4달 전135회 조회
답변 없음

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠