[INTERNAL] Tungsten Cache code review and refactoring#5

Closed

JoshRosen wants to merge 49 commits intomasterfrom

Commits on Sep 2, 2015

Adds handling for java.lang.String on getUTF8String
Feynman Liang
committed
Fixes whitespace and wording
Feynman Liang
committed
Fixes getUTF8String to support off-heap backed memory
Feynman Liang
committed
Adds project boilerplate
Feynman Liang
committed
Gets to working example, fixes bug in UnsafeRow.getUTF8String
Feynman Liang
committed
Makes tests work and cleans up code
Feynman Liang
committed
Adds tungsten caching
Feynman Liang
committed
Moves fix into UFT8String.fromAddress
Feynman Liang
committed
Adds handle to cachedRDD in return for uncaching
Feynman Liang
committed
Removes private access modifier for dogfood testing
Feynman Liang
committed
Adds toString
Feynman Liang
committed
Changes tungstenCache to store in contiguous block
Feynman Liang
committed
Makes buildScan only scan until end of buffer
Feynman Liang
committed
Cleans up rebase and imports
Feynman Liang
committed

Commits on Sep 3, 2015

Implements prototype for compressed tungstenCache
Feynman Liang
committed
Fixes serialization problems and adds padding for allocating compressed data
Feynman Liang
committed
Fixes decompression of compressed tungsten caches
Feynman Liang
committed
Removes extra copy during decompression
Feynman Liang
committed
Adds tests back and creates helper fromByteArray
Feynman Liang
committed

Commits on Sep 4, 2015

Changes buildScan to use uncompressed size
Feynman Liang
committed
Adds and fixes tests for multiblock compression
Feynman Liang
committed

Commits on Sep 8, 2015

Adds action for triggering lazy caching
Feynman Liang
committed

Commits on Sep 10, 2015

Fixes compression reading error
Feynman Liang
committed
Merge remote-tracking branch 'apache/master' into tungsten-cache
Feynman Liang
committed
Fixes compressed reading
Feynman Liang
committed
Uses DataInputStream.readFully
Feynman Liang
committed
Merge remote-tracking branch 'origin/master' into tungsten-cache
JoshRosen
committed

Commits on Sep 11, 2015

Commits on Sep 12, 2015

Test for correctness as well.
JoshRosen
committed