Skip to content

Expose Avro reader to PyIceberg #1328

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 49 commits into from
Sep 17, 2025
Merged

Expose Avro reader to PyIceberg #1328

Show file tree
Hide file tree
Changes from 16 commits
Commits
Show all changes
49 commits
Select commit Hold shift + click to select a range
7249542
WIP
Fokko May 13, 2025
0260aa4
Merge branch 'main' of github.com:apache/iceberg-rust
Fokko May 13, 2025
cff3d2b
Expose Avro parsers in Python
Fokko May 14, 2025
ee6aeda
Merge branch 'main' of github.com:apache/iceberg-rust into fd-avro-py…
Fokko May 14, 2025
fb44a0a
Cleanup
Fokko May 14, 2025
9bc9baf
Thanks Scott!
Fokko May 14, 2025
24b02e3
Merge branch 'main' of github.com:apache/iceberg-rust into fd-avro-py…
Fokko May 15, 2025
d02aff8
Merge branch 'main' into fd-avro-pyiceberg
Fokko May 29, 2025
7c63887
Less is more
Fokko Jun 1, 2025
8ca7e90
Cleanup
Fokko Jun 1, 2025
2a14693
Merge branch 'main' of github.com:apache/iceberg-rust into fd-avro-py…
Fokko Jun 3, 2025
6b62d04
Merge branch 'main' of github.com:apache/iceberg-rust into fd-avro-py…
Fokko Jun 12, 2025
63918be
WIP
Fokko Jun 13, 2025
5e6bb10
fix: literal conversion to py
roeap Jun 26, 2025
2e62d7d
Merge pull request #1 from roeap/fix/pyo3-converty
Fokko Jun 26, 2025
846561a
Merge branch 'main' of github.com:apache/iceberg-rust into fd-avro-py…
Fokko Jun 26, 2025
820b895
Merge branch 'main' of github.com:apache/iceberg-rust into fd-avro-py…
Fokko Jul 16, 2025
9fc7ae5
Merge remote-tracking branch 'origin' into fd-avro-pyiceberg
kevinjqliu Jul 20, 2025
36aed09
fix clippy
kevinjqliu Jul 20, 2025
b0805a9
add unit test for `read_manifest_entries`
kevinjqliu Jul 21, 2025
bd904c5
Merge branch 'main' of github.com:apache/iceberg-rust into fd-avro-py…
Fokko Jul 23, 2025
7a33eaf
WIP
Fokko Jul 23, 2025
c3ccbc9
WIP
Fokko Jul 23, 2025
324e61f
Merge branch 'main' of github.com:apache/iceberg-rust into fd-avro-py…
Fokko Aug 7, 2025
4b0157e
MOAR
Fokko Aug 7, 2025
4490632
WIP
Fokko Aug 7, 2025
aed1078
Merge branch 'fd-avro-pyiceberg' of github.com:Fokko/iceberg-rust int…
Fokko Aug 7, 2025
9b3094b
Merge branch 'main' of github.com:apache/iceberg-rust into fd-avro-py…
Fokko Sep 1, 2025
a025533
Merge branch 'main' of github.com:apache/iceberg-rust into fd-avro-py…
Fokko Sep 1, 2025
9dec734
[WIP] Allow V2 reader to read v1 manifests
emkornfield Aug 28, 2025
6ca3f1e
defaults belong in serde
emkornfield Aug 29, 2025
73bae07
remove whitespace
emkornfield Aug 29, 2025
df15c22
Merge branch 'main' of github.com:apache/iceberg-rust into fd-avro-py…
Fokko Sep 1, 2025
3c661f4
Cleanup
Fokko Sep 1, 2025
248cc4b
Cleanup
Fokko Sep 1, 2025
589f480
Move PyDataFile to a separate file
Fokko Sep 1, 2025
66019f3
Bump Avro because of better error message
Fokko Sep 1, 2025
19fe632
Merge branch 'main' of github.com:apache/iceberg-rust into fd-avro-py…
Fokko Sep 3, 2025
53b833f
WIP
Fokko Sep 3, 2025
d52148d
Make teh linter happy
Fokko Sep 3, 2025
350cbc1
Merge branch 'main' of github.com:apache/iceberg-rust into fd-avro-py…
Fokko Sep 8, 2025
5549a1f
Merge branch 'main' into fd-avro-pyiceberg
Fokko Sep 15, 2025
d5f671c
Fix faulty testconf
Fokko Sep 16, 2025
1153a2a
Merge branch 'fd-avro-pyiceberg' of github.com:Fokko/iceberg-rust int…
Fokko Sep 16, 2025
2536d0c
Make ruff happy
Fokko Sep 16, 2025
628c782
Yikes!
Fokko Sep 16, 2025
7f6e579
Make tests happy
Fokko Sep 16, 2025
514e8f1
pass path with file:// scheme
kevinjqliu Sep 17, 2025
c2be1fc
Merge branch 'main' into fd-avro-pyiceberg
Fokko Sep 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading