1 Answer
- Newest
- Most votes
- Most comments
0
I managed to get this working with a custom connector using spark-bigquery-with-dependencies_2.12-0.28.0.jar from https://github.com/GoogleCloudDataproc/spark-bigquery-connector/releases
Looks like that's all the AWS package is anyways. It's even pulling in my AWS secret ok. Having the AWS connector updated would still be nice.
answered a year ago
Relevant content
- asked a year ago
- AWS OFFICIALUpdated a month ago
- AWS OFFICIALUpdated 2 months ago
- AWS OFFICIALUpdated 4 months ago
- AWS OFFICIALUpdated 3 years ago
Can you elaborate on how did you add this custom connector using the updated version? Did you use the same way as the previous version? I am new to AWS Glue