[WIP] Arrow conversion at partitions#23

Closed

BryanCutler wants to merge 11 commits intoarrow-integrationfrom

stc_toPandas_with_arrow

Commits on Feb 3, 2017

added param description pydoc for toPandas
BryanCutler
committed

Commits on Feb 7, 2017

changed conversion to use Iterator[InternalRow] instead of Array
BryanCutler
committed

Commits on Feb 8, 2017

arrow conversion done at partition, tests not working yet
BryanCutler
committed
modified python to concat tables, made Scala tests repartition to pass
BryanCutler
committed
changed empty frame test so that ArrowPayload on empty frame will be an empty iterator
BryanCutler
committed

Commits on Feb 9, 2017

removed option for initial vector capacity, using mapPartitionsInternal, updated Arrow and using microsecond timestamps
BryanCutler
committed

Commits on Feb 17, 2017

fixed partitioned conversion test, added test for empty partition collection
BryanCutler
committed