hadoop

Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
YARN-10200. Add number of containers to RMAppManager summary

(cherry picked from commit 2de0572cdc1c6fdbfaab108b169b2d5b0c077e86)

  1. … 4 more files in changeset.
YARN-10200. Add number of containers to RMAppManager summary

(cherry picked from commit 2de0572cdc1c6fdbfaab108b169b2d5b0c077e86)

(cherry picked from commit 5d3fb0ebe9d3f3395320b82a76194ba6fad01e00)

(cherry picked from commit 9c6dd8c83a29183d70cd4a69a8317a9303954cc1)

  1. … 4 more files in changeset.
HDFS-15113. Addendum: Missing IBR when NameNode restart if open processCommand async feature. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HADOOP-14918. Remove the Local Dynamo DB test option (branch-2.10) (#1864). Contributed by Jonathan Hung and Gabor Bota.

ABFS Streams to update FileSystem.Statistics counters on IO.

Contributed by Mehakmeet Singh

YARN-10198. Remove Validation of Queue Exist under Managed Parent Queue

Contributed by Peter Bacsko. Reviewed by Manikandan R.

HDFS-15227. NPE if the last block changes from COMMITTED to COMPLETE during FSCK. Contributed by Ayush Saxena.

HDFS-15214. WebHDFS: Add snapshot counts to Content Summary. Contributed by hemanthboyina.

HADOOP-16818. ABFS: Combine append+flush calls for blockblob & appendblob

Contributed by Ishani Ahuja.

YARN-10120. Https Support in Router WebServiceClient.

Contributed by Bilwa S T.

HDFS-15200. Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage. Contributed by Ayush Saxena.

HDFS-15223. FSCK fails if one namenode is not available. Contributed by Ayush Saxena.

HDFS-15223. FSCK fails if one namenode is not available. Contributed by Ayush Saxena.

(cherry picked from commit bb41ddaf1e0c9bf44830b2cf0ac653b7354abf46)

HADOOP-16927. Update hadoop-thirdparty dependency version to 1.0.0 (#1900). Contributed by Vinayakumar B.

YARN-10034. Remove Allocation Tags from released container from Decommission node

Contributed by Kyungwan Nam. Reviewed by Adam Antal.

HDFS-14919. Provide Non DFS Used per DataNode in DataNode UI. Contributed by Lisheng Sun.

HADOOP-16920 ABFS: Make list page size configurable.

Contributed by Bilahari T H.

The page limit is set in "fs.azure.list.max.results"; default value is 500.

There's currently a limit of 5000 in the store -there are no range checks

in the client code so that limit can be changed on the server without

any need to update the abfs connector.

HADOOP-16054. Update Dockerfile to use Bionic.

Contributed by Akira Ajisaka.

HDFS-15208. Suppress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs.

Contributed by Wei-Chiu Chuang.

Change-Id: I7abeaf4b65e2a4758356aa69ab8930f7e993077d

(cherry picked from commit 096533c2dc0afd51367030725d797480a22ba7e2)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/test/resources/log4j.properties

(cherry picked from commit 1d55e1e229d835a6743523b9cf4c1e97b4259128)

HDFS-15208. Suppress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs.

Contributed by Wei-Chiu Chuang.

Change-Id: I7abeaf4b65e2a4758356aa69ab8930f7e993077d

(cherry picked from commit 096533c2dc0afd51367030725d797480a22ba7e2)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/test/resources/log4j.properties

HDFS-15208. Suppress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs.

Contributed by Wei-Chiu Chuang.

Change-Id: I7abeaf4b65e2a4758356aa69ab8930f7e993077d

HADOOP-16858. S3Guard fsck: Add option to remove orphaned entries (#1851). Contributed by Gabor Bota.

Adding a new feature to S3GuardTool's fsck: -fix.

Change-Id: I2cdb6601fea1d859b54370046b827ef06eb1107d

Revert "YARN-2710. RM HA tests failed intermittently on trunk. Contributed by Ahmed"

This reverts commit 85eac8b0dfec30c2ecc7310cc65f6023097b2c26.

HADOOP-16319. S3A Etag tests fail with default encryption enabled on bucket.

Contributed by Ben Roling.

ETag values are unpredictable with some S3 encryption algorithms.

Skip ITestS3AMiscOperations tests which make assertions about etags

when default encryption on a bucket is enabled.

When testing with an AWS an account which lacks the privilege

for a call to getBucketEncryption(), we don't skip the tests.

In the event of failure, developers get to expand the

permissions of the account or relax default encryption settings.

YARN-2710. RM HA tests failed intermittently on trunk. Contributed by Ahmed Hussein.

YARN-2710. RM HA tests failed intermittently on trunk. Contributed by Ahmed Hussein.

HADOOP-16661. Support TLS 1.3 (#1880)

MAPREDUCE-7237. Supports config the shuffle's path cache related parameters (#1397)

HDFS-15211. EC: File write hangs during close in case of Exception during updatePipeline. Contributed by Ayush Saxena.

HDFS-15211. EC: File write hangs during close in case of Exception during updatePipeline. Contributed by Ayush Saxena.