hadoop

Clone Tools
  • last updated a few seconds ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Addendum for HADOOP-14146. Use commons Base64 instead of jdk8 Base64.

(cherry picked from commit 07193459091cfaf372634637096485154d39a176)

Addendum for HADOOP-14146 jdk7 support.

(cherry picked from commit 4c6184b41cfdab589a2fea4fb7665e28d044c681)

HADOOP-14146. KerberosAuthenticationHandler should authenticate with SPN in AP-REQ. Contributed by Daryn Sharp

HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee.

(cherry picked from commit 8f533ca76b3f3592dc8ec6e318382a54becf10f5)

HDFS-9754. Avoid unnecessary getBlockCollection calls in BlockManager. Contributed by Jing Zhao.

(cherry picked from commit 972782d9568e0849484c027f27c1638ba50ec56e)

(cherry picked from commit f8c9c0ff0e2d977fc0f69bde4cdbb03371c0bac4)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/Namesystem.java

hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestNameNodeMetadataConsistency.java

Revert "HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee."

This reverts commit 40e3cd24b068d08be8cf05668290b908f6b43c11.

HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee.

(cherry picked from commit 8f533ca76b3f3592dc8ec6e318382a54becf10f5)

HADOOP-14533. Size of args cannot be less than zero in TraceAdmin#run as its linkedlist. Contributed by Weisen Han.

(cherry picked from commit 2e9daa2e27536484846d9c5f020c6afaf27932ce)

YARN-6713. Fix dead link in the Javadoc of FairSchedulerEventLog.java. Contributed by Weiwei Yang.

(cherry picked from commit 099dfe92a9743bcb7e27506f8877b8b23b0ff95a)

(cherry picked from commit 35f6c7c9c78b2749c6527dd7829546970821ae30)

HDFS-11345. Document the configuration key for FSNamesystem lock fairness. Contributed by Erik Krogen.

(cherry picked from commit 2c769167dbdb66c52d2ba7b7193a686444085570)

(cherry picked from commit 6b3c13d543ddaba3b4a2e6a5649420982a107603)

HADOOP-14515. Specifically configure zookeeper-related log levels in KMS log4j.

(cherry picked from commit 4cdae5d88ef7851ae284a115868dc4bbe24ae1bd)

HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin.

(cherry picked from commit 71626fd0b92ee70ee113fde237352266aa599bfb)

HDFS-11995. HDFS Architecture documentation incorrectly describes writing to a local temporary file. Contributed by Nandakumar.

(cherry picked from commit d954a64730c00346476322743462cde857164177)

YARN-6680. Avoid locking overhead for NO_LABEL lookups. Contributed by Daryn Sharp

(cherry picked from commit ee89ac84e68d3e181b75c63f74a0444f9d28146f)

HADOOP-14540. Replace MRv1 specific terms in HostsFileReader. Contributed by hu xiaodong.

(cherry picked from commit 300804595e5b8fd447ecb530fcd0ae5b0e59bb63)

(cherry picked from commit 6d82db40d59684fdb7fcdc6159a975b3ca483c27)

YARN-6719. Fix findbugs warnings in SLSCapacityScheduler.java. Contributed by Akira Ajisaka.

Revert "MAPREDUCE-6898. TestKill.testKillTask is flaky. Contributed by Peter Bacsko"

This reverts commit ea26ccb7dd9026f0bbc5101c97581952d15a3a74.

MAPREDUCE-6898. TestKill.testKillTask is flaky. Contributed by Peter Bacsko

(cherry picked from commit e78542f4bea90e8545e9e06af9c07e89d2be43d9)

Revert "HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin."

This reverts commit a52315d2c3f758fff2be75e42928576752616bcd.

HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin.

(cherry picked from commit 315f07700dcfe32513b87f63070db854ecb3cf48)

(cherry picked from commit 88fa17c2383baafbfb6b43b69e08cf40493c774a)

HDFS-11967. TestJMXGet fails occasionally. Contributed by Arpit Agarwal.

YARN-6585. RM fails to start when upgrading from 2.7 for clusters with node labels. Contributed by Sunil G. (cherry picked from commit 5578af860335ae44c9780082508c3dcf726f60fc)

HADOOP-14512. WASB atomic rename should not throw exception if the file is neither in src nor in dst when doing the rename. Contributed by Duo Xu

(cherry picked from commit 325163f23f727e82379d4a385b73aa3a04a510f6)

YARN-6682. Improve performance of AssignmentInformation datastructures. Contributed by Daryn Sharp.

HADOOP-14511. WritableRpcEngine.Invocation#toString NPE on null parameters. Contributed by John Zhuge.

(cherry picked from commit 87f4428de017e5bfc4358304728bd2281d501d52)

HDFS-11945. Internal lease recovery may not be retried for a long time. Contributed by Kihwal Lee

(cherry picked from commit facb6812d9004ae509b2564150bbe28317a293f1)

HDFS-11861. ipc.Client.Connection#sendRpcRequest should log request name. Contributed by John Zhuge.

(cherry picked from commit 5672ae7b37ce75086a1cb5bb9a388288fc913eb7)

Preparing for 2.8.3 development

    • -2
    • +2
    /hadoop-common-project/hadoop-kms/pom.xml
    • -2
    • +2
    /hadoop-common-project/hadoop-nfs/pom.xml
  1. … 55 more files in changeset.
MAPREDUCE-6676. NNBench should Throw IOException when rename and delete fails. Contributed by Brahma Reddy Battula.

(cherry picked from commit 24181f559f008fc7945702c0fad7d1028f75bfc6)

HDFS-11711. DN should not delete the block On "Too many open files" Exception. Contributed by Brahma Reddy Battula.

(cherry picked from commit fca08f8362f0332b064f28c2625fd535004ef85d)