hadoop

Clone Tools
  • last updated 21 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Remove unexpected file hadoop--src.tar.gz.mds that get checked in for previous commit.

Set the release date for 2.6.4.

    • -0
    • +0
    /hadoop--src.tar.gz.mds
Preparing for release 2.6.4: Committed generated release notes: python ./dev-support/relnotes.py -v 2.6.4

Preparing for release 2.6.4: updating index page and mvn versions:set -DnewVersion=2.6.4

    • -2
    • +2
    /hadoop-common-project/hadoop-kms/pom.xml
    • -2
    • +2
    /hadoop-common-project/hadoop-nfs/pom.xml
    • -2
    • +2
    /hadoop-hdfs-project/hadoop-hdfs/pom.xml
  1. … 48 more files in changeset.
MAPREDUCE-6621. Memory Leak in JobClient#submitJobInternal(). Contributed by Xuan Gong (cherry picked from commit 43e669b22d9ac0b81ab8cc397c5d6d92bac986c6)

Conflicts:

hadoop-mapreduce-project/CHANGES.txt

HDFS-8722. Optimize datanode writes for small writes and flushes. Contributed by Kihwal Lee.

HDFS-9178. Slow datanode I/O can cause a wrong node to be marked bad. Contributed by Kihwal Lee.

HDFS-4660. Block corruption can happen during pipeline recovery. Contributed by Kihwal Lee.

MAPREDUCE-6618. YarnClientProtocolProvider leaking the YarnClient thread. Contributed by Xuan Gong (cherry picked from commit 59a212b6e1265adfa9b55c71b65a22157dfccf77)

Conflicts:

hadoop-mapreduce-project/CHANGES.txt

MAPREDUCE-6619. HADOOP_CLASSPATH is overwritten in MR container. Contributed by Junping Du

(cherry picked from commit da18bbedaffad1f3ac9c078675583e7cfb68790f)

Revert HADOOP-12715 which cause build failure on branch-2.6.

HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen.

(cherry picked from commit 6eacdea0e475b4fff91cedce5005a7c11749cf64)

HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen.

(cherry picked from commit 643227927a7d7974655627d7e97aae42600692ae)

(cherry picked from commit 38ec290455a61a53f1f2c8fcc06f914de52fd5e2)

YARN-4598. Invalid event: RESOURCE_FAILED at CONTAINER_CLEANEDUP_AFTER_KILL. Contributed by tangshangwen (cherry picked from commit 46e5ea81e0e41646ba02391aea31481ead28aaf8)

Conflicts:

hadoop-yarn-project/CHANGES.txt

HDFS-9294. DFSClient deadlock when close file and failed to renew lease. Contributed by Brahma Reddy Battula

MAPREDUCE-6554. MRAppMaster servicestart failing with NPE in MRAppMaster#parsePreviousJobHistory. Contributed by Bibin A Chundatt (cherry picked from commit 296ecbd5ec9f7d2eed84217a3318b4a3bcd7bd99)

Conflicts:

hadoop-mapreduce-project/CHANGES.txt

YARN-4581. AHS writer thread leak makes RM crash while RM is recovering. Contributed by sandflee. (cherry picked from commit fc6d3a3b234efff2b0b646c31a4e6ff0a5118ef9)

Conflicts:

hadoop-yarn-project/CHANGES.txt

(cherry picked from commit e09222306f65227d14fe1e656102d225b232409c)

Conflicts:

hadoop-yarn-project/CHANGES.txt

HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe (cherry picked from commit cdf88952599a43b1ef5adda792bfb195c7529fad)

Conflicts:

hadoop-common-project/hadoop-common/CHANGES.txt

HADOOP-12107. long running apps may have a huge number of StatisticsData instances under FileSystem (Sangjin Lee via Ming Ma) (cherry picked from commit 8e1bdc17d9134e01115ae7c929503d8ac0325207)

Conflicts:

hadoop-common-project/hadoop-common/CHANGES.txt

HDFS-9415. Document dfs.cluster.administrators and dfs.permissions.superusergroup. (Contributed by Xiaobing Zhou)

Add missing CHANGES.txt entry for HDFS-8767 for branch-2.6

MAPREDUCE-6363. [NNBench] Lease mismatch error when running with multiple mappers. Contributed by Vlad Sharanhovich and Bibin A Chundatt.

(cherry picked from commit 7b0964f354e90968c2dac2f7acc17214732aed64)

(cherry picked from commit 6efee8907af3f21d8526927cf5e676d9922b686b)

YARN-4414. Nodemanager connection errors are retried at multiple levels. Contributed by Chang Li (cherry picked from commit 13de8359a1c6d9fc78cd5013c860c1086d86176f)

Conflicts:

hadoop-yarn-project/CHANGES.txt

YARN-3695. ServerProxy (NMProxy, etc.) shouldn't retry forever for non network exception. Contributed by Raju Bairishetti (cherry picked from commit 62e583c7dcbb30d95d8b32a4978fbdb3b98d67cc)

Conflicts:

hadoop-yarn-project/CHANGES.txt

YARN-3842. NMProxy should retry on NMNotYetReadyException. (Robert Kanter via kasha) (cherry picked from commit 5ebf2817e58e1be8214dc1916a694a912075aa0a)

Conflicts:

hadoop-yarn-project/CHANGES.txt

Move MR-5982 and MR-6492 to the appropriate section

MAPREDUCE-6492. AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask. Contributed by Bibin A Chundatt (cherry picked from commit ab11085b81353e1617875deb10f3c8e2a8b91a1e) (cherry picked from commit fc10c9983901cd231f8ec959675d741512716b9e)

Conflicts:

hadoop-mapreduce-project/CHANGES.txt

MAPREDUCE-5982. Task attempts that fail from the ASSIGNED state can disappear. Contributed by Chang Li (cherry picked from commit 7429438c859da06ed1ed34aec0ff9873bd33f98d)

Conflicts:

hadoop-mapreduce-project/CHANGES.txt

YARN-3849. Too much of preemption activity causing continuos killing of containers across queues. (Sunil G via wangda)

Supplement to HDFS-9574.