Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How do Federated Node contain "Predicate pushdown" ? #23

Closed
oikomi opened this issue Feb 29, 2024 · 1 comment
Closed

How do Federated Node contain "Predicate pushdown" ? #23

oikomi opened this issue Feb 29, 2024 · 1 comment

Comments

@oikomi
Copy link

oikomi commented Feb 29, 2024

hello all

I have test a sql like
SELECT t.TrackId, t.Name AS TrackName, a.Title AS AlbumTitle, ar.Name AS ArtistName FROM Track t JOIN Album a ON t.AlbumId = a.AlbumId JOIN Artist ar ON a.ArtistId = ar.ArtistId WHERE t.TrackId > 375 order by t.TrackId limit 10

I have get logic plan

image

where t.trackid > Int64 does not pushdown?

How to do this optimization?

@backkem
Copy link
Collaborator

backkem commented Mar 4, 2024

You are right. To improve on these cases, the plan will have to be re-written prior to cutting it into sub-plans for federation. I've yet to look into this.

To avoid full table reads on both sides of the join we'd need apache/datafusion#7955.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants