Skip to content

PARQUET-2188: [parquet-cpp] Add SkipRecords API to RecordReader #14142

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
pitrou merged 29 commits into from
Oct 31, 2022
Merged

PARQUET-2188: [parquet-cpp] Add SkipRecords API to RecordReader #14142

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
66b6531
Add SkipRecords to RecordReader and corresponding unit tests.
fatemehp Sep 15, 2022
327f42d
Merge branch 'apache:master' into master
fatemehp Sep 15, 2022
c0fac59
Add test for reading and skipping partial records for repeated fields.
fatemehp Sep 16, 2022
2945559
Addressed comments.
fatemehp Sep 19, 2022
938e494
Addressed most comments. Working on adding a test for variable length
fatemehp Sep 20, 2022
ba87e4d
Use gmock ElementsAre for comparing vectors.
fatemehp Sep 20, 2022
921493b
Added test for Skipping ByteArrays. Added more scenarios to the existing
fatemehp Sep 22, 2022
7897740
Fix minor lint issue.
fatemehp Sep 22, 2022
3c90a0f
Merge branch 'master' into conflict
fatemehp Sep 26, 2022
1d0c22e
Address comments
fatemehp Sep 30, 2022
558efb8
Merge branch 'apache:master' into conflict
fatemehp Sep 30, 2022
84a9fe4
Merge branch 'conflict' of github.com:fatemehp/arrow into conflict
fatemehp Sep 30, 2022
e91ccf5
Fix ClangFormat.
fatemehp Oct 3, 2022
66e2058
Fix a bug in ThrowAwayLevels, only deal with repetition levels for
fatemehp Oct 4, 2022
613f0b0
Remove unnecessary comment
fatemehp Oct 4, 2022
59758ce
Fix a warning.
fatemehp Oct 4, 2022
57b249e
Fix build warnings.
fatemehp Oct 4, 2022
8f03b39
Fix ClangFormat.
fatemehp Oct 4, 2022
3357881
Add PARQUET_EXPORT for RecordReader.
fatemehp Oct 4, 2022
ce7c855
Address comments. Refactor/simplify the SkipRecords tests.
fatemehp Oct 5, 2022
1679747
Address a couple more comments.
fatemehp Oct 5, 2022
2e27262
SkipRecords, add a test that we first consume all the levels before l…
fatemehp Oct 17, 2022
7355db5
Add parameter comment shrink_to_fit for buffer Resize calls.
fatemehp Oct 25, 2022
0223c39
Address comments.
fatemehp Oct 25, 2022
3dd5fa3
Use std::make_unique and collapse declaration and definition to make …
fatemehp Oct 26, 2022
9c4d66f
Address comments.
fatemehp Oct 27, 2022
df873c7
Address some more comments.
fatemehp Oct 27, 2022
7ab5233
Merge branch 'master' into conflict
pitrou Oct 31, 2022
312abbc
Fix lint
pitrou Oct 31, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading