2 réponses
- Le plus récent
- Le plus de votes
- La plupart des commentaires
0
Hi,
You can run it for sure. The thing is that you can´t initialise the env that way.
See this post for inspiration.
https://plainenglish.io/blog/spark-on-aws-lambda-c65877c0ac96
If not, my suggestion here is to change to a Java based Lambda ( Spark and Iceberg are based on Java Virtual Machine).
Bests.
répondu il y a un an
0
Hi,
not sure I understand your use case, if you just need to read the Iceberg table from the Lambda Function, a better option might be to invoke a query in Athena using pyAthena or the aws-sdk-pandas, which is provided as a Lambda Layer as well.
if you are trying to run some specific spark jobs and you would like the semplicity of a serverless function you might want to have a look at AWS Glue.
hope this helps
Contenus pertinents
- demandé il y a 6 mois
- demandé il y a 7 mois
- AWS OFFICIELA mis à jour il y a 2 ans
- AWS OFFICIELA mis à jour il y a 4 mois
- AWS OFFICIELA mis à jour il y a 2 ans