hadoop

Clone Tools
  • last updated 17 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HADOOP-16818. ABFS: Combine append+flush calls for blockblob & appendblob

Contributed by Ishani Ahuja.

YARN-10120. Https Support in Router WebServiceClient.

Contributed by Bilwa S T.

HDFS-15200. Delete Corrupt Replica Immediately Irrespective of Replicas On Stale Storage. Contributed by Ayush Saxena.

HDFS-15223. FSCK fails if one namenode is not available. Contributed by Ayush Saxena.

HDFS-15223. FSCK fails if one namenode is not available. Contributed by Ayush Saxena.

(cherry picked from commit bb41ddaf1e0c9bf44830b2cf0ac653b7354abf46)

HADOOP-16927. Update hadoop-thirdparty dependency version to 1.0.0 (#1900). Contributed by Vinayakumar B.

YARN-10034. Remove Allocation Tags from released container from Decommission node

Contributed by Kyungwan Nam. Reviewed by Adam Antal.

HDFS-14919. Provide Non DFS Used per DataNode in DataNode UI. Contributed by Lisheng Sun.

HADOOP-16920 ABFS: Make list page size configurable.

Contributed by Bilahari T H.

The page limit is set in "fs.azure.list.max.results"; default value is 500.

There's currently a limit of 5000 in the store -there are no range checks

in the client code so that limit can be changed on the server without

any need to update the abfs connector.

HADOOP-16054. Update Dockerfile to use Bionic.

Contributed by Akira Ajisaka.

HDFS-15208. Suppress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs.

Contributed by Wei-Chiu Chuang.

Change-Id: I7abeaf4b65e2a4758356aa69ab8930f7e993077d

(cherry picked from commit 096533c2dc0afd51367030725d797480a22ba7e2)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/test/resources/log4j.properties

(cherry picked from commit 1d55e1e229d835a6743523b9cf4c1e97b4259128)

HDFS-15208. Suppress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs.

Contributed by Wei-Chiu Chuang.

Change-Id: I7abeaf4b65e2a4758356aa69ab8930f7e993077d

(cherry picked from commit 096533c2dc0afd51367030725d797480a22ba7e2)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/test/resources/log4j.properties

HDFS-15208. Suppress bogus AbstractWadlGeneratorGrammarGenerator in KMS stderr in hdfs.

Contributed by Wei-Chiu Chuang.

Change-Id: I7abeaf4b65e2a4758356aa69ab8930f7e993077d

HADOOP-16858. S3Guard fsck: Add option to remove orphaned entries (#1851). Contributed by Gabor Bota.

Adding a new feature to S3GuardTool's fsck: -fix.

Change-Id: I2cdb6601fea1d859b54370046b827ef06eb1107d

Revert "YARN-2710. RM HA tests failed intermittently on trunk. Contributed by Ahmed"

This reverts commit 85eac8b0dfec30c2ecc7310cc65f6023097b2c26.

HADOOP-16319. S3A Etag tests fail with default encryption enabled on bucket.

Contributed by Ben Roling.

ETag values are unpredictable with some S3 encryption algorithms.

Skip ITestS3AMiscOperations tests which make assertions about etags

when default encryption on a bucket is enabled.

When testing with an AWS an account which lacks the privilege

for a call to getBucketEncryption(), we don't skip the tests.

In the event of failure, developers get to expand the

permissions of the account or relax default encryption settings.

YARN-2710. RM HA tests failed intermittently on trunk. Contributed by Ahmed Hussein.

YARN-2710. RM HA tests failed intermittently on trunk. Contributed by Ahmed Hussein.

HADOOP-16661. Support TLS 1.3 (#1880)

MAPREDUCE-7237. Supports config the shuffle's path cache related parameters (#1397)

HDFS-15211. EC: File write hangs during close in case of Exception during updatePipeline. Contributed by Ayush Saxena.

HDFS-15211. EC: File write hangs during close in case of Exception during updatePipeline. Contributed by Ayush Saxena.

HDFS-15211. EC: File write hangs during close in case of Exception during updatePipeline. Contributed by Ayush Saxena.

HDFS-15197. [SBN read] Change ObserverRetryOnActiveException log to debug. Contributed by Chen Liang.

HDFS-15197. [SBN read] Change ObserverRetryOnActiveException log to debug. Contributed by Chen Liang.

HDFS-15197. [SBN read] Change ObserverRetryOnActiveException log to debug. Contributed by Chen Liang.

HDFS-15197. [SBN read] Change ObserverRetryOnActiveException log to debug. Contributed by Chen Liang.

HDFS-15159. Prevent adding same DN multiple times in PendingReconstructionBlocks. Contributed by hemanthboyina.

HDFS-14820. The default 8KB buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream is too big. Contributed by Lisheng Sun.

HDFS-15113. Missing IBR when NameNode restart if open processCommand async feature. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Reviewed-by: Brahma Reddy Battula <brahma@apache.org>

Reviewed-by: Inigo Goiri <inigoiri@apache.org>