Skip to content

[BLOG] Using External Indexes, Metadata Stores, Catalogs and Caches to Accelerate Queries on Apache Parquet #99

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
alamb merged 20 commits into from
Aug 15, 2025
Merged

[BLOG] Using External Indexes, Metadata Stores, Catalogs and Caches to Accelerate Queries on Apache Parquet #99

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
b7202da
[BLOG] Using External Indexes and Metadata Stores to Accelerate Queri…
alamb Aug 1, 2025
b9c5c5e
Apply suggestions from code review
alamb Aug 9, 2025
3bf2165
Fix headings
alamb Aug 12, 2025
71e1344
Merge branch 'site/external_indexes' of github.com:apache/datafusion-…
alamb Aug 12, 2025
5870b12
Hone background section
alamb Aug 12, 2025
8aa40f8
fix link
alamb Aug 12, 2025
cc5ff1d
Update content/blog/2025-08-15-external-parquet-indexes.md
alamb Aug 12, 2025
6b64c90
strengthen first paragraph of background
alamb Aug 12, 2025
6cb589c
wordsmith
alamb Aug 12, 2025
3d5fa72
Merge branch 'site/external_indexes' of github.com:apache/datafusion-…
alamb Aug 12, 2025
c90576e
grammar
alamb Aug 12, 2025
4d5e133
improved ascii art
alamb Aug 12, 2025
6329006
more grammar
alamb Aug 12, 2025
f7e72ea
paren
alamb Aug 12, 2025
3fbd700
pages --> files in diagram
alamb Aug 12, 2025
fa633a7
grammar
alamb Aug 12, 2025
fcd4c3b
Implement @comphead's suggestion: highlighted the benefit of external…
alamb Aug 12, 2025
ef275b6
honing
alamb Aug 12, 2025
0746166
capitalization OCD
alamb Aug 12, 2025
d172d0e
Add acnknoeldgements section
alamb Aug 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
802 changes: 802 additions & 0 deletions content/blog/2025-08-15-external-parquet-indexes.md
View file
Open in desktop

Large diffs are not rendered by default.

Binary file added content/images/external-parquet-indexes/external-index-overview.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added content/images/external-parquet-indexes/parquet-filter-pushdown.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added content/images/external-parquet-indexes/parquet-layout.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added content/images/external-parquet-indexes/parquet-metadata.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added content/images/external-parquet-indexes/processing-pipeline.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added content/images/external-parquet-indexes/prune-files.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added content/images/external-parquet-indexes/prune-row-groups.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.