Problem with reading jpg image in Sagemaker, imageclassification algorithm
Dears,
I created a sagemaker job but I see the following error:
[01/06/2023 11:29:21 ERROR 140033245599552] Customer Error: imread read blank (None) image for file: /opt/ml/input/data/train/s3://dbimgraces/output/af/af05.jpg
As far as I can see from my label file, the location is fine and the image also looks fine. Is any problem with the imread itself?
- Newest
- Most votes
- Most comments
Not sure if you are using a sample code or writing on your own. If you can share the details, that would be helpful.
If you are using Image Classification - MXNet, the SageMaker Image Classification algorithm supports both RecordIO (application/x-recordio) and image (image/png, image/jpeg, and application/x-image) content types for training in file mode, and supports the RecordIO (application/x-recordio) content type for training in pipe mode. However, you can also train in pipe mode using the image files (image/png, image/jpeg, and application/x-image), without creating RecordIO files, by using the augmented manifest format.
Reference : https://docs.aws.amazon.com/sagemaker/latest/dg/image-classification.html
Dear @aws-user-Nitin, tnx for your comment. No I use Image Classification - MXNet, the SageMaker Image Classification algorithm itself. I havent impelement any coding yet. I also tested with Pipe and (application/x-recordio and application/x-image ) and it still do not work. You can contact me for more demonstation via skype/teams greencomputinguae at g mail dot c@m
with leave type for channel emtpy as optional:
ClientError: Unable to initialize the algorithm. ContentType for channel 'train_lst' is empty. Please set content type for channel 'train_lst'. (caused by KeyError) Caused by: 'train_lst', exit code: 2
with setting type for channel application/x-image: ClientError: ContentType must be specified for train channel., exit code: 2
By setting to application/x-recordio ClientError: Invalid RecordIO format. Please make sure that the RecordIO files are not corrupted. , exit code: 2
By setting to application/x-image:
ClientError: Invalid RecordIO format. Please make sure that the RecordIO files are not corrupted. , exit code: 2
It is strange, if it mentions the field is optional, then why user force to set it?
Relevant content
- Accepted Answerasked 4 years ago
AWS OFFICIALUpdated 2 years ago- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 2 years ago
Can you provide more information on how you are creating the estimator and passing the data. Looks like the data path the script is reading is wrong.
@arun tnx for your comment. I am not sure what you mean by estimator but I pass the data via S3 location with S3 data type S3prefix and s3 data distribution type:FullyReplicate. Actually, two channel are created for training/validation and two more channels for lables for training and validation.