Skip to content

Blog: Practical Dive Into Late Materialization in arrow-rs Parquet Reads #740

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
alamb merged 37 commits into from
Dec 11, 2025
Merged

Blog: Practical Dive Into Late Materialization in arrow-rs Parquet Reads #740

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
dfcedb9
Add blog
hhhizzz Dec 3, 2025
d1aa9bb
Try to retrigger the render
hhhizzz Dec 3, 2025
5060e3d
refine content
hhhizzz Dec 4, 2025
048c79b
Update introduction figure
alamb Dec 5, 2025
3abd8e6
update markdown
alamb Dec 5, 2025
c9ff5ea
Wordsmith introduction section
alamb Dec 5, 2025
9594895
updates
alamb Dec 5, 2025
10f28d7
Updates to section 2.1
alamb Dec 5, 2025
c837d00
tweaks
alamb Dec 5, 2025
074356a
Update section 2.2
alamb Dec 5, 2025
01adc37
Commnets for section 3.1
alamb Dec 5, 2025
b0dc1af
Suggestions for section 3.2
alamb Dec 5, 2025
116412b
Proposed improvements to section 3.3 and 3.4
alamb Dec 5, 2025
a63bc62
Suggestions for section 3.5
alamb Dec 5, 2025
c2f4cd0
move example
alamb Dec 5, 2025
9aa2e75
Suggestions for conclusion
alamb Dec 5, 2025
5d7facd
tweak
alamb Dec 5, 2025
05a0425
Merge pull request #1 from alamb/alamb/update_figure
hhhizzz Dec 5, 2025
05722c0
Merge pull request #2 from alamb/alamb/intro
hhhizzz Dec 7, 2025
d3f1a7b
Merge pull request #3 from alamb/alamb/sec2
hhhizzz Dec 7, 2025
dbc10db
Merge pull request #4 from alamb/alamb/sec2.2
hhhizzz Dec 7, 2025
6d30cc4
Merge pull request #5 from alamb/alamb/sec3
hhhizzz Dec 7, 2025
b847e48
Merge pull request #6 from alamb/alamb/section3.2
hhhizzz Dec 7, 2025
6d97a25
Merge pull request #7 from alamb/alamb/3.3
hhhizzz Dec 7, 2025
1cc57e8
Merge pull request #9 from alamb/alamb/conclusion
hhhizzz Dec 7, 2025
d7f4d7c
Merge branch 'lm-pipeline-blog' into alamb/3.5
hhhizzz Dec 7, 2025
cc7ff60
Merge pull request #8 from alamb/alamb/3.5
hhhizzz Dec 7, 2025
3f7b1a2
Update the translation
hhhizzz Dec 7, 2025
9284e56
Update the link
hhhizzz Dec 8, 2025
b51a87a
Update author and links
alamb Dec 8, 2025
9b610d9
Fix broken links
alamb Dec 8, 2025
513aae2
Fix more links (using codex)
alamb Dec 8, 2025
0ef9ed4
Update according to comments
hhhizzz Dec 9, 2025
a1ed43e
Add 'the number of'
hhhizzz Dec 9, 2025
9615a90
Update date to 2025-12-11
alamb Dec 11, 2025
8386ead
fix link
alamb Dec 11, 2025
0cbfd56
fix link
alamb Dec 11, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions _data/contributors.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -76,4 +76,9 @@
- name: Andrew Lamb
apacheId: alamb
githubId: alamb
- name: Huang Qiwei
apacheId: hhhizzz # Not a real apacheId
githubId: hhhizzz


# End contributors.yml
322 changes: 322 additions & 0 deletions _posts/2025-12-11-parquet-late-materialization-deep-dive-zh.md
View file
Open in desktop

Large diffs are not rendered by default.

322 changes: 322 additions & 0 deletions _posts/2025-12-11-parquet-late-materialization-deep-dive.md
View file
Open in desktop

Large diffs are not rendered by default.

Binary file added img/late-materialization/3.1.1.png
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/late-materialization/3.3.2-fig1.jpg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/late-materialization/3.3.2-fig2.jpg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/late-materialization/3.3.2-fig3.jpg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/late-materialization/fig1.jpg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/late-materialization/fig2.jpg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/late-materialization/fig3.jpg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added img/late-materialization/fig4.jpg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.