hadoop

Clone Tools
  • last updated 12 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HADOOP-15486. Make NetworkTopology#netLock fair. Contributed by Nanda kumar.

Additional check when unpacking archives. Contributed by Jason Lowe and Akira Ajisaka.

(cherry picked from commit cedc28d4ab2a27ba47e15ab2711218d96ec88d23)

HADOOP-15450. Avoid fsync storm triggered by DiskChecker and handle disk full situation. Contributed by Arpit Agarwal.

(cherry picked from commit bcc8e76badc1341a6cf995c8e44fa5e422158de8)

Conflicts:

hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/util/TestDiskChecker.java

Skip the proxy user check if the ugi has not been initialized. Contributed by Daryn Sharp

(cherry picked from commit 73e9120ad79c73703de21e0084591861813f3279)

HDFS-13581. DN UI logs link is broken when https is enabled. Contributed by Shashikant Banerjee.

(cherry picked from commit 0ce6290de6a08beab01cb5184d366d97c9abd811)

HADOOP-15441. Log kms url and token service at debug level. Contributed by Gabor Bota

(cherry picked from commit a5449d36312c3de953e05ba8b3b5acf818a0c7e7)

YARN-8232. RMContainer lost queue name when RM HA happens. (Hu Ziqian via wangda)

Change-Id: Ia21e1da6871570c993bbedde76ce32929e95970f

(cherry picked from commit 6b96a73bb0f0ad1c877a062b19091e3e15a33ec4)

Conflicts:

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/AbstractYarnScheduler.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestAbstractYarnScheduler.java

Revert "HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah."

This reverts commit 714a079ffb88540ec1e09d5023c35e1fa0dd016d.

Conflicts:

hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/KMSTokenRenewer.java

  1. … 3 more files in changeset.
Revert "HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445."

This reverts commit e3a49fe1dd9e95c63a628fbff60b76e7d947d1f9.

Preparing for 2.8.5 development.

    • -2
    • +2
    /hadoop-common-project/hadoop-kms/pom.xml
    • -2
    • +2
    /hadoop-common-project/hadoop-nfs/pom.xml
  1. … 55 more files in changeset.
HADOOP-14841 Kms client should disconnect if unable to get output stream from connection. Contributed by Rushabh S Shah

(cherry picked from commit 4cdbdce752e192b45c2b9756c2d4bd24ceffdabd)

MAPREDUCE-7073. Optimize TokenCache#obtainTokensForNamenodesInternal

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

(cherry picked from commit 1a95a4524a8c6c7be601ce8b92640a6a76164a2c)

(cherry picked from commit 58bcb90e7039bd4cec116fe66f1b1428dd493372)

HADOOP-15385. Many tests are failing in hadoop-distcp project in branch-2. Contributed by Jason Lowe.

(cherry picked from commit 2b48854cfd09a048d983c2a4870d9c95573b4fff)

HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter)

(cherry picked from commit 7ab08a9c37a76edbe02d556fcfb2e637f45afc21)

Conflicts:

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestDelegationTokenRenewer.java

HDFS-10183. Prevent race condition during class initialization. Contributed by Pavel Avgustinov.

(cherry picked from commit f40969a141ec6aff254c41e4185cc61ea9e4e554)

HADOOP-15396. Some java source files are executable

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

(cherry picked from commit e4c39f3247da77d03c6015de4f18be75924fcb22)

(cherry picked from commit 228869e5f922a04f3e8ce7e547fdc31ed9f12127)

HADOOP-15180. branch-2 : daemon processes' sysout overwrites 'ulimit -a' in daemon's out file. Contributed by Ranith Sardar

(cherry picked from commit cbcd16e6b7c84878bb2e26c398e3bdf943e364d0)

HDFS-12828. OIV ReverseXML Processor fails with escaped characters

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

(cherry picked from commit 2d9e791a9073de9f65fef5407efd3a42894bc97f)

(cherry picked from commit 8f341c673f4db981544faba79d0c20bfe9c3fd99)

HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445.

(cherry picked from commit 650359371175fba416331e73aa03d2a96ccb90e5)

HADOOP-14970. MiniHadoopClusterManager doesn't respect lack of format option. Contributed by Erik Krogen

(cherry picked from commit 1a407bc9906306801690bc75ff0f0456f8f265fd)

YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe

(cherry picked from commit 18844599aef42f79d2af4500aa2eee472dda95cb)

YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe.

(cherry picked from commit 6bb128dfb893cf0e4aa2d3ecc65440668a1fc8d7)

HDFS-13427. Fix the section titles of transparent encryption document.

(cherry picked from commit c7cd362afd21add324c3a82c594b133d41cf8d03)

(cherry picked from commit be627ccfe373cb5dc4e8bb2a17495ef898caaee1)

HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah.

  1. … 3 more files in changeset.
HADOOP-14987. Improve KMSClientProvider log around delegation token checking. Contributed by Xiaoyu Yao and Xiao Chen.

(cherry picked from commit 59d78a5088700350a5122c3a3ba5e76cd26d6a80)

(cherry picked from commit b8d8c25a18df467263b25677d45c9c60b43d4e68)

Conflicts:

hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/key/kms/KMSClientProvider.java

HADOOP-15317. Improve NetworkTopology chooseRandom's loop.

(cherry picked from commit 251fc1fb40b6ccd8d2955d8a60767a816749bb83)

HADOOP-15253. Should update maxQueueSize when refresh call queue. Contributed by Tao Jie.

(cherry picked from commit acfd764fcc9990e507c0e7cea746652375aaa632)

HADOOP-12862. LDAP Group Mapping over SSL can not specify trust store. Contributed by Wei-Chiu Chuang and Konstantin Shvachko.

(cherry picked from commit 2216bde322961c0fe33b5822510880a65d5c45fd)

HDFS-13195. DataNode conf page cannot display the current value after reconfig. Contributed by maobaolong.

(cherry picked from commit d2c3a56ad8cd331040d737d0da23d1cd108987a4)

HDFS-12884. BlockUnderConstructionFeature.truncateBlock should be of type BlockInfo. Contributed by chencan.

(cherry picked from commit 8d898ab25f1c2032a07c9bbd96ba3d0c4eb5be87)