Tracking record-level failure from Databrew validation

0

Hi,

This is question with Databrew data profile capability. I am looking for record-level tracking per rule validation status. This will provide while rules has failed on a record from the dataset.

At least, I am looking to separate records after data profiling, valid vs invalid records.

Thanks,

질문됨 2년 전455회 조회
1개 답변
0

Hello, this functionality is currently not supported, I will provide feedback to the team owning the service.

Today, to solve your issue you could use a implement in a project recipe the same logic in the quality check you are interested in and using a conditional transform associate a value (true/False or 1/0) to a new column isCol1Valid .

when you run the processing job and write the output to your target you could easily find all rows that are not satisfying the specific check.

I am aware this is currently a workaround.

hope it helps

AWS
전문가
답변함 2년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠