Unable to Parse file Error in AWS Glue

0

We are trying to read a CSV file to process the data using AWS Glue and we are getting an error message as below:

Py4JJavaError: An error occurred while calling o91.schema. : org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 3.0 failed 4 times, most recent failure: Lost task 0.3 in stage 3.0 (TID 8) executor 3): com.amazonaws.services.glue.util.FatalException: Unable to parse file:

We have already verified the codification, it is UTF-8 so there should be no problem. When we read the CSV using from_options function it was able show the data but printSchema() raised an error. We could not read the data using from_catalog function.

Appreciate any help on resolving this

sravan
질문됨 2달 전300회 조회
1개 답변
2
수락된 답변

Issue could be with special characters in the file. Refer the post - https://repost.aws/questions/QUe2LFXWv6Rh-GhxJajJKcoQ/aws-glue-jobs-3-0-unable-to-parse-csv-file for similar issue and resolution.

AWS
답변함 2달 전
profile picture
전문가
검토됨 2달 전
profile picture
전문가
검토됨 2달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠