Skip to content

Conversation

@joellubi
Copy link
Member

@joellubi joellubi commented Jul 18, 2024

Rationale for this change

Go implementation of #43234

What changes are included in this PR?

  • Go implementation of the Bool8 extension type
  • Minor refactor of existing extension builder interfaces

Are these changes tested?

Yes, unit tests and basic read/write benchmarks are included.

Are there any user-facing changes?

  • A new extension type is added
  • Custom extension builders no longer need another builder created and released separately.

@v1gnesh v1gnesh mentioned this pull request Aug 5, 2024
joellubi added a commit that referenced this pull request Aug 8, 2024
### Rationale for this change

Closes: #17682

Arrow Boolean arrays store values as individual bits, which is a very compact representation but does not match the layout of many systems with which it interoperates. By adding an 8-bit Boolean extension type, zero-copy compatibility with many systems can be improved at the cost of large physical representation.

Go implementation: #43323
C++ / Python implementation: #43488

### What changes are included in this PR?

Proposal and documentation for `Bool8` canonical extension type.

### Are these changes tested?

N/A

### Are there any user-facing changes?

N/A

* GitHub Issue: #17682

Lead-authored-by: Joel Lubinitsky <[email protected]>
Co-authored-by: Joel Lubinitsky <[email protected]>
Co-authored-by: Felipe Oliveira Carvalho <[email protected]>
Signed-off-by: Joel Lubinitsky <[email protected]>
@joellubi joellubi marked this pull request as ready for review August 12, 2024 18:57
@joellubi joellubi requested a review from zeroshade as a code owner August 12, 2024 18:57
@github-actions github-actions bot added awaiting merge Awaiting merge and removed awaiting committer review Awaiting committer review labels Aug 12, 2024
@joellubi joellubi merged commit 39fe6fc into apache:main Aug 12, 2024
@joellubi joellubi removed the awaiting merge Awaiting merge label Aug 12, 2024
@conbench-apache-arrow
Copy link

After merging your PR, Conbench analyzed the 4 benchmarking runs that have been run so far on merge-commit 39fe6fc.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 2 possible false positives for unstable benchmarks that are known to sometimes produce them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants