hadoop

Clone Tools
  • last updated 19 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Revert ""HADOOP-16910. ABFS Streams to update FileSystem.Statistics counters on IO."

This reverts commit e2c7ac71b5ee47bb40294acd10c0c21dd6ee430f.

Change-Id: I5b5a93f5a36cdb0c3d56d1b3f747c318f089de20

HDFS-15201 SnapshotCounter hits MaxSnapshotID limit (#1870)

HDFS-15088. RBF: Correct annotation typo of RouterPermissionChecker#checkPermission. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-15232. Fix libhdfspp test failures with GCC 7. (#1906)

HDFS-15232. Fix libhdfspp test failures with GCC 7. (#1906)

(cherry picked from commit f59f6891c8bf70bdddc1f2535588bea41155b480)

YARN-10200. Add number of containers to RMAppManager summary

(cherry picked from commit 2de0572cdc1c6fdbfaab108b169b2d5b0c077e86)

(cherry picked from commit 5d3fb0ebe9d3f3395320b82a76194ba6fad01e00)

  1. … 4 more files in changeset.
YARN-10200. Add number of containers to RMAppManager summary

  1. … 5 more files in changeset.
YARN-10200. Add number of containers to RMAppManager summary

(cherry picked from commit 2de0572cdc1c6fdbfaab108b169b2d5b0c077e86)

  1. … 4 more files in changeset.
YARN-10200. Add number of containers to RMAppManager summary

(cherry picked from commit 2de0572cdc1c6fdbfaab108b169b2d5b0c077e86)

(cherry picked from commit 5d3fb0ebe9d3f3395320b82a76194ba6fad01e00)

(cherry picked from commit 9c6dd8c83a29183d70cd4a69a8317a9303954cc1)

  1. … 4 more files in changeset.
HDFS-15113. Addendum: Missing IBR when NameNode restart if open processCommand async feature. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HADOOP-14918. Remove the Local Dynamo DB test option (branch-2.10) (#1864). Contributed by Jonathan Hung and Gabor Bota.

ABFS Streams to update FileSystem.Statistics counters on IO.

Contributed by Mehakmeet Singh

YARN-10198. Remove Validation of Queue Exist under Managed Parent Queue

Contributed by Peter Bacsko. Reviewed by Manikandan R.

HDFS-15227. NPE if the last block changes from COMMITTED to COMPLETE during FSCK. Contributed by Ayush Saxena.

HDFS-15214. WebHDFS: Add snapshot counts to Content Summary. Contributed by hemanthboyina.

HADOOP-16818. ABFS: Combine append+flush calls for blockblob & appendblob

Contributed by Ishani Ahuja.

YARN-10120. Https Support in Router WebServiceClient.

Contributed by Bilwa S T.

HDFS-15200. Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage. Contributed by Ayush Saxena.

HDFS-15223. FSCK fails if one namenode is not available. Contributed by Ayush Saxena.

HDFS-15223. FSCK fails if one namenode is not available. Contributed by Ayush Saxena.

(cherry picked from commit bb41ddaf1e0c9bf44830b2cf0ac653b7354abf46)

HADOOP-16927. Update hadoop-thirdparty dependency version to 1.0.0 (#1900). Contributed by Vinayakumar B.

YARN-10034. Remove Allocation Tags from released container from Decommission node

Contributed by Kyungwan Nam. Reviewed by Adam Antal.

HDFS-14919. Provide Non DFS Used per DataNode in DataNode UI. Contributed by Lisheng Sun.

HADOOP-16920 ABFS: Make list page size configurable.

Contributed by Bilahari T H.

The page limit is set in "fs.azure.list.max.results"; default value is 500.

There's currently a limit of 5000 in the store -there are no range checks

in the client code so that limit can be changed on the server without

any need to update the abfs connector.

HADOOP-16054. Update Dockerfile to use Bionic.

Contributed by Akira Ajisaka.

HDFS-15208. Suppress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs.

Contributed by Wei-Chiu Chuang.

Change-Id: I7abeaf4b65e2a4758356aa69ab8930f7e993077d

(cherry picked from commit 096533c2dc0afd51367030725d797480a22ba7e2)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/test/resources/log4j.properties

(cherry picked from commit 1d55e1e229d835a6743523b9cf4c1e97b4259128)

HDFS-15208. Suppress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs.

Contributed by Wei-Chiu Chuang.

Change-Id: I7abeaf4b65e2a4758356aa69ab8930f7e993077d

(cherry picked from commit 096533c2dc0afd51367030725d797480a22ba7e2)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/test/resources/log4j.properties

HDFS-15208. Suppress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs.

Contributed by Wei-Chiu Chuang.

Change-Id: I7abeaf4b65e2a4758356aa69ab8930f7e993077d

HADOOP-16858. S3Guard fsck: Add option to remove orphaned entries (#1851). Contributed by Gabor Bota.

Adding a new feature to S3GuardTool's fsck: -fix.

Change-Id: I2cdb6601fea1d859b54370046b827ef06eb1107d

Revert "YARN-2710. RM HA tests failed intermittently on trunk. Contributed by Ahmed"

This reverts commit 85eac8b0dfec30c2ecc7310cc65f6023097b2c26.