hadoop

Clone Tools
  • last updated 26 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Commit YARN-3866 addendum patches to branch

HDFS-11278. Add missing @Test annotation for TestSafeMode.testSafeModeUtils() (Contributed by Lukas Majercak via Daniel Templeton)

(cherry picked from commit ce3613c9656e57efdc73edd1787bd9622d1b716e)

(cherry picked from commit af266c8c85971da18c2675c5aa638907b5016fc5)

Revert "MAPREDUCE-5875. Make Counter limits consistent across JobClient, MRAppMaster, and YarnChild. (Gera Shegalov via kasha)"

This reverts commit 7bfd9e068d205f752c05d51778a4a4702329d31e.

Conflicts:

hadoop-mapreduce-project/CHANGES.txt

hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/JobSubmitter.java

hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/jobhistory/HistoryViewer.java

hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/main/java/org/apache/hadoop/mapreduce/v2/hs/CompletedJob.java

Revert "MAPREDUCE-6199. AbstractCounters are not reset completely on deserialization (adhoot via rkanter)"

This reverts commit f9341c1e2cffc4e3ac37cb7da4e535ca5c6d3913.

Conflicts:

hadoop-mapreduce-project/CHANGES.txt

Revert "MAPREDUCE-6286. A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly. Contributed by Zhihai Xu."

This reverts commit 7c72c7f5290f0991f65102c2bd413f965a8ca409.

Conflicts:

hadoop-mapreduce-project/CHANGES.txt

YARN-6024. Capacity Scheduler 'continuous reservation looking' doesn't work when sum of queue's used and reserved resources is equal to max. Contributed by Wangda Tan.

(cherry picked from commit f6715b26b65fc127b35368d0460b786ece88b5b8)

HDFS-11252. TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException. Contributed by Yiqun Lin.

(cherry picked from commit 0ddb8defad6a7fd5eb69847d1789ba51952c0cf0)

HDFS-11270. Document the missing options of NameNode bootstrap command. Contributed by Yiqun Lin

(cherry picked from commit c0e0ef29696109af9a018462059f08fd99ee3121)

HDFS-11272. Refine the assert messages in TestFSDirAttrOp. Contributed by Jimmy Xiang.

(cherry picked from commit ea547529cb17c931a756ebffa6942f71f761ad13)

(cherry picked from commit cd331556f61efac2de41a27c8e146ff925b56588)

HDFS-11250. Fix a typo in ReplicaUnderRecovery#setRecoveryID. Contributed by Yiqun Lin.

(cherry picked from commit 8f218ea2849477bdcb4918586aaefed0cd118341)

(cherry picked from commit 1b392682333ff7c95d9400bc1b49ef3adae37c54)

HDFS-11271. Typo in NameNode UI. Contributed by Wei-Chiu Chuang.

(cherry picked from commit 483cd06ad43b85e00a782fe225f1f40657bab204)

(cherry picked from commit a779b4ab8f76875228554d84c4a8448e2ba400cb)

HDFS-11258. Addendum patch to fix compile issue. Contributed by Jimmy Xiang.

(cherry picked from commit 16c4dcad854059f63fd3052b3c006ac6130fab8c)

YARN-4994. Use MiniYARNCluster with try-with-resources in tests. Contributed by Andras Bokor.

(cherry picked from commit ae401539eaf7745ec8690f9281726fb4cdcdbe94)

(cherry picked from commit 522bc98026c6a4a96bbf5246d9d0fbed23401eb6)

Conflicts:

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/TestHedgingRequestRMFailoverProxyProvider.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java

HDFS-11258. File mtime change could not save to editlog. Contributed by Jimmy Xiang.

HDFS-11261. Document missing NameNode metrics. Contributed by Yiqun Lin.

(cherry picked from commit f6e2521eb216dae820846cab31397e9a88ba2f88)

(cherry picked from commit 897b4a6a7732835b939f5b6f3c79369e61284379)

HDFS-11195. Return error when appending files by webhdfs rest api fails. Contributed by Yuanbo Liu.

(cherry picked from commit 5b7acdd206f5a7d1b7af29b68adaa7587d7d8c43)

HDFS-11263. ClassCastException when we use Bzipcodec for Fsimage compression. Contributed by Brahma Reddy Battula.

(cherry picked from commit 1b401f6a734df4e23a79b3bd89c816a1fc0de574)

HDFS-11262. Remove unused variables in FSImage.java. Contributed by Jagadesh Kiran N.

(cherry picked from commit d2026ae9e6c86f4fd9e48b80e71233181c1853d9)

(cherry picked from commit a95acbcb6e955cf1673f053cb9dab9e5e5dc6803)

HDFS-11094. Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter. Contributed by Eric Badger

(cherry picked from commit 012d28a1fa4a0dd7e5cdfefd85cdc8c27f6cfff6)

HDFS-11249. Redundant toString() in DFSConfigKeys.java. Contributed by Jagadesh Kiran N.

(cherry picked from commit 36947f79ba66bf8ce150813e5dc1d06c789f2b2a)

(cherry picked from commit eaa50a1087ce1c29349bc266bc485fb2222ac5c5)

HADOOP-13890. Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsing. Contributed by Xiaoyu Yao.

(cherry picked from commit f5e0bd30fde654ed48fe73e5c0523030365385a4)

(cherry picked from commit 85083567be22eba76dbf1f8c18149a0493f07526)

HDFS-11204. Document the missing options of hdfs zkfc command. Contributed by Yiqun Lin.

(cherry picked from commit 72bff192cd37ff97442e0f8dd477fbc2e58fc12d)

(cherry picked from commit 190b2dca6204e659ed8561c682c4a03f30258298)

HDFS-10684. WebHDFS DataNode calls fail without parameter createparent. Contributed by John Zhuge.

(cherry picked from commit fbdbbd57cdc3d8c778fca9266a7cadf298c8ff6c)

(cherry picked from commit 6b795c34d0c534a8d5214c64036ba73708d58fd0)

HADOOP-13871. ITestS3AInputStreamPerformance.testTimeToOpenAndReadWholeFileBlocks performance awful. Contributed by Steve Loughran

(cherry picked from commit c6a39232456fa0c98b2b9b6dbeaec762294ca01e)

HDFS-10570. Remove classpath conflicts of netty-all jar in hadoop-hdfs-client (Contributed by Vinayakumar B)

(cherry picked from commit c6fb9f0d0b63fdd735a6f455b6aee9d248852b41)

HADOOP-13565. KerberosAuthenticationHandler#authenticate should not rebuild SPN based on client request. Contributed by Xiaoyu Yao.

(cherry picked from commit 4c38f11cec0664b70e52f9563052dca8fb17c33f)

MAPREDUCE-6820. Fix dead links in Job relevant classes. Contributed by Yiqun Lin.

(cherry picked from commit 92a8917ca5a25bf6bee75acbb554aae87766a7e7)

(cherry picked from commit 1e1ab9bc1bde48593eceafb7380d7501d4bbc200)

HDFS-11229. HDFS-11056 failed to close meta file. Contributed by Wei-Chiu Chuang.

(cherry picked from commit 292bd78b4494ba1a1073b32b3f89d95e72f3204d)

HADOOP-13824. FsShell can suppress the real error if no error message is present. Contributed by John Zhuge.

(cherry picked from commit b606e025f10daed18b90b45ac00cd0c82e818581)

Conflicts:

hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/TestFsShell.java

(cherry picked from commit 6c93c1870c08be16876ee379cba6d59775ab6a14)

HDFS-8630. WebHDFS : Support get/set/unset StoragePolicy. Contributed by Surendra Singh Lilhore.