Odd Athena Query Performance Issue

0

Hello, I often use CTE's or views to create faux parameters as a way to improve reusability of code. For example, if I had a bunch of CTE's or subqueries (or different queries/views altogether) that all used a common value in a where clause, I would simply create a view/CTE containing the values and select the values from a subquery wherever needed. This typically has no meaningful impact on performance; however, it seems to degrade execution speed quite a bit in Athena and I'm not sure why this would be the case. What is the difference between: 'select * from table where foo = 'bar' versus 'with param as (select 'bar' as p) select * from table where foo = (select p from param)'? When querying a substantial amount of data, the second pattern makes the query speed untenable. These tables are partitioned to the hour also.

meowow
demandé il y a 2 ans487 vues
1 réponse
0

Hello,

Technically it should not effect the performance. Can you please provide Athena query ID's and AWS region for us to check the query plan and see where the delay is ? Feel free to open a support ticket with Athena support team with query ID's and we can provide you more insights.

AWS
INGÉNIEUR EN ASSISTANCE TECHNIQUE
répondu il y a 2 ans

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions