Branch 2.6.0#25

Closed

omkarksa wants to merge 6667 commits intotrunkfrom

This pull request is big! We're only showing the most recent 250 commits

Commits on Oct 13, 2014

YARN-2308. Changed CapacityScheduler to explicitly throw exception if the queue
jian-he
committed
Missing Changes.txt for YARN-2308
jian-he
committed
YARN-2566. DefaultContainerExecutor should pick a working directory randomly. (Zhihai Xu via kasha)
kambatla
committed

Commits on Oct 14, 2014

HADOOP-11176. KMSClientProvider authentication fails when both currentUgi and loginUgi are a proxied user. Contributed by Arun Suresh.
atm
committed
HDFS-7237. The command "hdfs namenode -rollingUpgrade" throws ArrayIndexOutOfBoundsException.
Tsz-Wo Nicholas Sze
committed
HADOOP-11198. Fix typo in javadoc for FileSystem#listStatus(). Contributed by Li Lu.
Haohui Mai
committed
HDFS-7228. Add an SSD policy into the default BlockStoragePolicySuite. Contributed by Jing Zhao.
Jing9
committed
HADOOP-11181. Generalized o.a.h.s.t.d.DelegationTokenManager to handle all sub-classes of AbstractDelegationTokenIdentifier. Contributed by Zhijie Shen.
zjshen14
committed

Commits on Oct 15, 2014

Commits on Oct 16, 2014

Commits on Oct 17, 2014

YARN-2699. Fixed a bug in CommonNodeLabelsManager that caused tests to fail when using ephemeral ports on NodeIDs. Contributed by Wangda Tan.
vinoduec
committed
YARN-2588. Standby RM fails to transitionToActive if previous transitionToActive failed with ZK exception. Contributed by Rohith Sharmaks
jian-he
committed
MAPREDUCE-5542. Killing a job just as it finishes can generate an NPE in client. Contributed by Rohith
jlowe
committed
HADOOP-11207. Enhanced common DelegationTokenAuthenticationHandler to support proxy-users on Delegation-token management operations. Contributed by Zhijie Shen.
vinoduec
committed
HDFS-6924. Add new RAM_DISK storage type. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-6922. Add LazyPersist flag to INodeFile, save it in FsImage and edit logs. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-6923. Propagate LazyPersist flag to DNs via DataTransferProtocol. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-6925. DataNode should attempt to place replicas on transient storage first if lazyPersist flag is received. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-6926. DN support for saving replicas to persistent storage and evicting in-memory replicas. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-6927. Initial unit tests for Lazy Persist files. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-6929. NN periodically unlinks lazy persist files with missing replicas from namespace. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-6928. 'hdfs put' command should accept lazyPersist flag for testing. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-6960. Bugfix in LazyWriter, fix test case and some refactoring. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-6931. Move lazily persisted replicas to finalized directory on DN startup. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-6950. Add Additional unit tests for HDFS-6581. (Contributed by Xiaoyu Yao)

arp7
authored and
Jitendra Pandey
committed
HDFS-6930. Improve replica eviction from RAM disk. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-6977. Delete all copies when a block is deleted from the block space. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-6991. Notify NN of evicted block before deleting it from RAM disk. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-7066. LazyWriter#evictBlocks misses a null check for replicaState. (Contributed by Xiaoyu Yao)

arp7
authored and
Jitendra Pandey
committed
HDFS-6978. Directory scanner should correctly reconcile blocks on RAM disk. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-7064. Fix unit test failures in HDFS-6581 branch. (Contributed by Xiaoyu Yao)

arp7
authored and
Jitendra Pandey
committed
HDFS-7079. Few more unit test fixes for HDFS-6581. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-7080. Fix finalize and upgrade unit test failures. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-7084. FsDatasetImpl#copyBlockFiles debug log can be improved. (Contributed by Xiaoyu Yao)

arp7
authored and
Jitendra Pandey
committed
HDFS-7091. Add forwarding constructor for INodeFile for existing callers. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-7108. Fix unit test failures in SimulatedFsDataset. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-7100. Make eviction scheme pluggable. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-6990. Add unit test for evict/delete RAM_DISK block with open handle. (Contributed by Xiaoyu Yao)

arp7
authored and
Jitendra Pandey
committed
HDFS-6932. Balancer and Mover tools should ignore replicas on RAM_DISK. (Contributed by Xiaoyu Yao)

arp7
authored and
Jitendra Pandey
committed
HDFS-7143. Fix findbugs warnings in HDFS-6581 branch. (Contributed by Tsz Wo Nicholas Sze)

arp7
authored and
Jitendra Pandey
committed
HDFS-7155. Bugfix in createLocatedFileStatus caused by bad merge. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-7144. Fix findbugs warnings in RamDiskReplicaTracker. (Contributed by Tsz Wo Nicholas Sze)

arp7
authored and
Jitendra Pandey
committed
HDFS-7159. Use block storage policy to set lazy persist preference. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-7129. Metrics to track usage of memory for writes. (Contributed by Xiaoyu Yao)

arp7
authored and
Jitendra Pandey
committed
HDFS-7171. Fix Jenkins failures in HDFS-6581 branch. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
HDFS-7112. LazyWriter should use either async IO or one thread per physical disk. Contributed by Xiaoyu Yao.

cnauroth
authored and
Jitendra Pandey
committed
HDFS-7090. Use unbuffered writes when persisting in-memory replicas. Contributed by Xiaoyu Yao.

cnauroth
authored and
Jitendra Pandey
committed
HDFS-6921. Add LazyPersist flag to FileStatus. (Arpit Agarwal)

arp7
authored and
Jitendra Pandey
committed
YARN-1879. Marked Idempotent/AtMostOnce annotations to ApplicationMasterProtocol for RM fail over. Contributed by Tsuyoshi OZAWA
jian-he
committed

Commits on Oct 18, 2014

Commits on Oct 19, 2014

MAPREDUCE-5911. Terasort TeraOutputFormat does not check for output directory existance. Contributed by Bruno P. Kinoshita.
Ivan Mitic
committed

Commits on Oct 20, 2014

Commits on Oct 21, 2014

Commits on Oct 22, 2014

Commits on Oct 23, 2014

Commits on Oct 24, 2014

Commits on Oct 25, 2014

Commits on Oct 26, 2014

Commits on Oct 27, 2014

Commits on Oct 28, 2014

Commits on Oct 29, 2014

Commits on Oct 30, 2014

Commits on Oct 31, 2014

Commits on Nov 1, 2014

Commits on Nov 2, 2014

YARN-2785. Fixed intermittent TestContainerResourceUsage failure. Contributed by Varun Vasudev.
zjshen14
committed

Commits on Nov 3, 2014

Commits on Nov 4, 2014

Commits on Nov 5, 2014

Commits on Nov 6, 2014

Commits on Nov 7, 2014

Commits on Nov 9, 2014

Commits on Nov 10, 2014

Commits on Nov 12, 2014

Commits on Nov 13, 2014