ARROW-15471: [R] ExtensionType support in R#12467

Closed

paleolimbot wants to merge 66 commits intoapache:masterfrom

paleolimbot:r-extension-type

Commits on Apr 7, 2022

initial working extension type
paleolimbot
committed
simplify implementation
paleolimbot
committed
test subclasses
paleolimbot
committed
with some array infrastructure
paleolimbot
committed
with registration of custom subclasses
paleolimbot
committed
get array and type subclasses working better
paleolimbot
committed
clang-format
paleolimbot
committed
license
paleolimbot
committed
Update r/R/extension.R

paleolimbot
and
jonkeane
committed
make sure ExtensionEquals can be overridden from R
paleolimbot
committed
start on vctrs extension type + tests
paleolimbot
committed
improvement, but test still failing
paleolimbot
committed
fix Deserialize from C++
paleolimbot
committed
failing test for chunked array out
paleolimbot
committed
shuffle responsibility between ExtensionArray, ChunkedArray, and ExtensionType
paleolimbot
committed
test roundtripping through Table, RecordBatch, and ChunkedArray
paleolimbot
committed
clang-format
paleolimbot
committed
only register extension type if arrow is available
paleolimbot
committed
start to document, simplify circular logic in methods
paleolimbot
committed
more documentation and simplification
paleolimbot
committed
simplify C++--R6 interaction
paleolimbot
committed
more clarifying and simplifying the C++--R6 interaction
paleolimbot
committed
more documenting
paleolimbot
committed
more documentation and renaming methods
paleolimbot
committed
documentation for extension types and vctrs extension type
paleolimbot
committed
make sure new functions are in the pkgdown index
paleolimbot
committed
add missing pkgdown reference section
paleolimbot
committed
correct the docs
paleolimbot
committed
add setfaulting test for dataset
paleolimbot
committed
with non-segfaulting dataset read!
paleolimbot
committed
properly fence Dataset test
paleolimbot
committed
Update r/R/arrow-package.R

paleolimbot
and
jonkeane
committed
Update r/R/arrow-tabular.R

paleolimbot
and
jonkeane
committed
Update r/R/extension.R

paleolimbot
and
jonkeane
committed
actually use new_extension_array()!
paleolimbot
committed
fix roxygen include
paleolimbot
committed
typo in C++ comment
paleolimbot
committed
better default method for .chunked_array_as_vector()
paleolimbot
committed
add example, export ExtensionArray, support ExtensionType$create() and ExtensionArray$create() for consistency.
paleolimbot
committed
allow strings for extension_metadata (but make sure they're UTF-8 encoded before conversion to raw)
paleolimbot
committed
remove confusing methods
paleolimbot
committed
actually test UTF-8 conversion and printing of non-utf-8 metadata
paleolimbot
committed
better example
paleolimbot
committed
Less redundant .Deserialize() method
paleolimbot
committed
try to fix windows test
paleolimbot
committed
move extension type definition to extension.h so that the Convert method can be used elsewhere
paleolimbot
committed
use Converter for extension types
paleolimbot
committed
add license
paleolimbot
committed
reomve unused extension type method
paleolimbot
committed
.ToString -> ToString()
paleolimbot
committed
extension_metadata -> Serialize
paleolimbot
committed
.Deserialize -> Deserialize
paleolimbot
committed
.ExtensionEquals -> ExtensionEquals
paleolimbot
committed
consolidate .array_as_vector() and .chunked_array_as_vector() to as_vector()
paleolimbot
committed
better testing of array conversion
paleolimbot
committed
test with vctrs extension type
paleolimbot
committed
undo changes to Table/RecordBatch
paleolimbot
committed
fix typos, remove unused field in Converter_Extension
paleolimbot
committed
move extension type logic to the extension type converter
paleolimbot
committed
Use old ChunedArray$as_vector() method that used the converter API
paleolimbot
committed
update comments to remind about the future SafeCallIntoR.
paleolimbot
committed
Serialize -> extension_metadata
paleolimbot
committed
Deserialize -> populate_instance
paleolimbot
committed
populate_instance() -> deserialize_instance()
paleolimbot
committed
use SafeCallIntoR()
paleolimbot
committed
punt on SafeCallIntoR for Deserialize()
paleolimbot
committed