hadoop

Clone Tools
  • last updated 28 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
YARN-4976. Missing NullPointer check in ContainerLaunchContextPBImpl. Contributed by Giovanni Matteo Fumarola

YARN-4976. Missing NullPointer check in ContainerLaunchContextPBImpl. Contributed by Giovanni Matteo Fumarola

(cherry picked from commit 95a50466075c28110fa7c297e9c5246892076ca8)

HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou.

HDFS-10207. Support enable Hadoop IPC backoff without namenode restart. Contributed by Xiaobing Zhou.

(cherry picked from commit b4be288c5d6801988f555a566c2eb793c88a15a4)

MAPREDUCE-2398. MRBench: setting the baseDir parameter has no effect. Contributed by Michael Noll and Wilfred Spiegelenburg.

MAPREDUCE-2398. MRBench: setting the baseDir parameter has no effect. Contributed by Michael Noll and Wilfred Spiegelenburg.

(cherry picked from commit 7da5847cf10bc61f2131d578f16ee37cb32c4639)

YARN-4784. Fairscheduler: defaultQueueSchedulingPolicy should not accept FIFO. (Yufei Gu via kasha)

(cherry picked from commit 170c4fd4cdbb8b4c1c4bb219e4c74fa0ba81b055)

YARN-4784. Fairscheduler: defaultQueueSchedulingPolicy should not accept FIFO. (Yufei Gu via kasha)

YARN-4935. TestYarnClient#testSubmitIncorrectQueue fails when FairScheduler is the default. (Yufei Gu via kasha)

(cherry picked from commit 6e297836d64498d90d0cd343789db2f2d490378a)

YARN-4935. TestYarnClient#testSubmitIncorrectQueue fails when FairScheduler is the default. (Yufei Gu via kasha)

HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao.

(cherry picked from commit 5bd7b592e5fbe4d448fd127c15d29f3121b8a833)

HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao.

(cherry picked from commit 5bd7b592e5fbe4d448fd127c15d29f3121b8a833)

(cherry picked from commit a2a65922dd9783b76d9abacc07ba8cb32e81caea)

HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao.

MAPREDUCE-6680. JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc. Contributed by Junping Du

(cherry picked from commit 1e48eefe5800975ea0c4295c9911ae3f572ed37d)

MAPREDUCE-6680. JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc. Contributed by Junping Du

(cherry picked from commit 1e48eefe5800975ea0c4295c9911ae3f572ed37d)

MAPREDUCE-6680. JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc. Contributed by Junping Du

MAPREDUCE-6680. JHS UserLogDir scan algorithm sometime could skip directory with update in CloudFS (Azure FileSystem, S3, etc. Contributed by Junping Du

(cherry picked from commit 1e48eefe5800975ea0c4295c9911ae3f572ed37d)

YARN-4890. Unit test intermittent failure: TestNodeLabelContainerAllocation#testQueueUsedCapacitiesUpdate. (Sunil G via wangda)

(cherry picked from commit 33fd95a99c4df6c4de6b0a53dc6679f3cab629e0)

YARN-4890. Unit test intermittent failure: TestNodeLabelContainerAllocation#testQueueUsedCapacitiesUpdate. (Sunil G via wangda)

HDFS-10312. Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction. Contributed by Chris Nauroth.

(cherry picked from commit 63ac2db59af2b50e74dc892cae1dbc4d2e061423)

HDFS-10312. Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction. Contributed by Chris Nauroth.

(cherry picked from commit 63ac2db59af2b50e74dc892cae1dbc4d2e061423)

(cherry picked from commit cc56bed6867f844810f5fda0cba3cbc9a9367269)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/BlockPoolSlice.java

hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImplTestUtils.java

HDFS-10312. Large block reports may fail to decode at NameNode due to 64 MB protobuf maximum length restriction. Contributed by Chris Nauroth.

HDFS-10308. TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing (Rakesh R via cmccabe)

(cherry picked from commit ad36fa6f42870c517526618a30204b443bfc6b5a)

(cherry picked from commit 76d963acb422f7b7e8e83768ab4be538ea5ad94e)

HDFS-10308. TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing (Rakesh R via cmccabe)

HDFS-10308. TestRetryCacheWithHA#testRetryCacheOnStandbyNN failing (Rakesh R via cmccabe)

(cherry picked from commit ad36fa6f42870c517526618a30204b443bfc6b5a)

YARN-2883. Queuing of container requests in the NM. (Konstantinos Karanasos and Arun Suresh via kasha)

  1. … 5 more files in changeset.
YARN-2883. Queuing of container requests in the NM. (Konstantinos Karanasos and Arun Suresh via kasha)

(cherry picked from commit c8172f5f143d2fefafa5a412899ab7cd081b406d)

  1. … 5 more files in changeset.
HADOOP-12924. Configure raw erasure coders for supported codecs. Contributed by Rui Li.

  1. … 6 more files in changeset.
HDFS-10264. Logging improvements in FSImageFormatProtobuf.Saver. (Contributed by Xiaobing Zhou)

HDFS-10264. Logging improvements in FSImageFormatProtobuf.Saver. (Contributed by Xiaobing Zhou)