2 回答
- 最新
- 投票最多
- 评论最多
1
Hello,
I could confirm that the root cause to be the a bug[1] in Livy resulting in the TypeError: required field "type_ignores"
missing from Module error. This is caused by a change in python >= 3.8 API [2] as reported in open JIRA for this issue [1]. This change caused IPython and PySpark code (Apache livy) to break with missing module. Please note this is known issue and EMR support as Livy officially support Python >=3.8.
[1] https://issues.apache.org/jira/browse/LIVY-795
[2] https://bugs.python.org/issue35894
Could you please test it in EMR 7.0 once and see if it works for you?
I am actually using version 7.0, and seeing this issue on it. I'm sure you'll be able to reproduce it too.