hadoop

Clone Tools
  • last updated a few seconds ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
YARN-5006. ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zk. Contributed by Bibin A Chundatt.

HADOOP-14543. ZKFC should use getAversion() while setting the zkacl. Contributed by Brahma Reddy Battula.

HADOOP-14547. [WASB] the configured retry policy is not used for all storage operations. Contributed by Thomas.

(cherry picked from commit c6bd73c6c5760c3a52203e6a51628587ceec6896)

YARN-5876. TestResourceTrackerService#testGracefulDecommissionWithApp fails intermittently on trunk. (Robert Kanter via Yufei Gu)

(cherry picked from commit 0b77262890d76b0a3a35fa64befc8a406bc70b27)

Addendum for HADOOP-14146. Use commons Base64 instead of jdk8 Base64.

Addendum for HADOOP-14146 jdk7 support.

HADOOP-14568. GenericTestUtils#waitFor missing parameter verification. Contributed by Yiqun Lin

(cherry picked from commit e5db9af8a00ded73ee1c75bb4c0d5d50e15a305c)

HDFS-12010. TestCopyPreserveFlag fails consistently because of mismatch in access time. Contributed by Mukul Kumar Singh.

YARN-6127. Add support for work preserving NM restart when AMRMProxy is enabled. (Botong Huang via asuresh).

HADOOP-14542. Add IOUtils.cleanupWithLogger that accepts slf4j logger API. Contributed by Chen Liang.

(cherry picked from commit b64951905e64f6fed581c28634be6ed15c190633)

HADOOP-14146. KerberosAuthenticationHandler should authenticate with SPN in AP-REQ. Contributed by Daryn Sharp

HADOOP-14429. FTPFileSystem#getFsAction always returns FsAction.NONE. (Hongyuan Li via Yongjun Zhang)

(cherry picked from commit 5157f6c46ec342fb650b3c5853061ed1e4a182b6)

HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee.

HADOOP-14533. Size of args cannot be less than zero in TraceAdmin#run as its linkedlist. Contributed by Weisen Han.

(cherry picked from commit 2e9daa2e27536484846d9c5f020c6afaf27932ce)

YARN-6713. Fix dead link in the Javadoc of FairSchedulerEventLog.java. Contributed by Weiwei Yang.

(cherry picked from commit 099dfe92a9743bcb7e27506f8877b8b23b0ff95a)

HDFS-11345. Document the configuration key for FSNamesystem lock fairness. Contributed by Erik Krogen.

(cherry picked from commit 2c769167dbdb66c52d2ba7b7193a686444085570)

HADOOP-14515. Specifically configure zookeeper-related log levels in KMS log4j.

(cherry picked from commit 4cdae5d88ef7851ae284a115868dc4bbe24ae1bd)

HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin.

HADOOP-14296. Move logging APIs over to slf4j in hadoop-tools.

HDFS-11995. HDFS Architecture documentation incorrectly describes writing to a local temporary file. Contributed by Nandakumar.

(cherry picked from commit d954a64730c00346476322743462cde857164177)

YARN-6680. Avoid locking overhead for NO_LABEL lookups. Contributed by Daryn Sharp

(cherry picked from commit ee89ac84e68d3e181b75c63f74a0444f9d28146f)

HDFS-10480. Add an admin command to list currently open files. Contributed by Manoj Govindassamy.

  1. … 6 more files in changeset.
HADOOP-14540. Replace MRv1 specific terms in HostsFileReader. Contributed by hu xiaodong.

(cherry picked from commit 300804595e5b8fd447ecb530fcd0ae5b0e59bb63)

HADOOP-14538. Fix TestFilterFileSystem and TestHarFileSystem failures after DistributedFileSystem.append API. Contributed by Lei (Eddy) Xu.

(cherry picked from commit 7ade5124b8b6c52a084ec187c531017eee0f1884)

YARN-6719. Fix findbugs warnings in SLSCapacityScheduler.java. Contributed by Akira Ajisaka.

HADOOP-14424. Add CRC32C performance test. Contributed by LiXin Ge.

(cherry picked from commit 75043d342935828cfe8bdabfab8784c83f797887)

YARN-6517. Fix warnings from Spotbugs in hadoop-yarn-common(addendum). Contributed by Weiwei Yang.

(cherry picked from commit 7582dedad1c73eabdc3eeece0a3a860e7bb33c1a)

HADOOP-14395. Provide Builder pattern for DistributedFileSystem.append. Contributed by Lei (Eddy) Xu.

(cherry picked from commit 6460df21a09a7fcc29eceb8dc3859d6298da6882)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/DistributedFileSystem.java

HADOOP-14503. Make RollingAverages a mutable metric. Contributed by Hanisha Koneru.

MAPREDUCE-6897. Add Unit Test to ensure Job end notification gets sent even when appMaster stop gets YarnRuntimeException. Contributed by Gergely Novák

(cherry picked from commit 82bbcbf37f8137112a6270932b2ad7572785c387)