Glue Job - Inner Join unexpected data results

0

I have a basic example of 2 CSV files where I'm doing an INNER JOIN by one of the columns in the CSV. I believe the results in the Data preview are not correct:

  • Contacts csv
  • Accounts csv
  • Inner Join result

Thanks!

Joel 0
asked 6 months ago218 views
1 Answer
0

If I add a Change Shema action to rename the columns, then the INNER JOIN does not return any results

  • Enter image description here

Thanks!

Joel 0
answered 6 months ago
  • The data preview shows you want the job produces, if it's not what you need then it's correct to change schema accordingly, but sounds you have some issue there on that step, impossible to tell without the data and change schema details

  • Any luck with this? I'm facing the same issue with empty schema tabs after joins

  • The data is there in the first 2 images. I have 2 CSV files with only 2 rows each, as shown in the first two data previews in the images. I'm trying to do a join by the account number column

    Now, there are 2 issues:

    • Third image: The result of the INNER JOIN is not correct, even if I run the job the result is not correct.
    • Fourth image: When I add a change schema (just to rename the columns), the INNER JOIN now does not return any data

    The problems seem to occur only with INNER JOIN, LEFT JOIN and RIGHT JOIN seem to be working fine Thanks!

  • inner join is done using DynamicFrame while outer joins internally uses DataFrame, the main difference is that DynamicFrame is case sensitive, could that be the issue?

  • That could be the issue. The CSV files that I'm using for testing have the columns in camel case, but every time that I infer the schema using the data previews the output is in lowercase. That is why I tried to manually edit the schema with the Apply button, but as I mentioned before it's not working, it does not save the changes.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions