hadoop

Clone Tools
  • last updated 16 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HADOOP-14385. HttpExceptionUtils#validateResponse swallows exceptions. Contributed by Wei-Chiu Chuang.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HADOOP-14385. HttpExceptionUtils#validateResponse swallows exceptions. Contributed by Wei-Chiu Chuang.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 840d02ca5ba013bddd28d7c1abd242b5bb8cc39f)

HDFS-14465. When the Block expected replications is larger than the number of DataNodes, entering maintenance will never exit. Contributed by Yicong Cai.

HDFS-14465. When the Block expected replications is larger than the number of DataNodes, entering maintenance will never exit. Contributed by Yicong Cai.

(cherry picked from commit f876e82abc83c05957acf6c56b26d94c9dfe9372)

HDDS-1579. Create OMDoubleBuffer metrics. (#871)

HDFS-14581. Appending to EC files crashes NameNode. Contributed by Surendra Singh Lilhore.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDDS-1508. Provide example k8s deployment files for the new CSI server

Closes #905

  1. … 19 more files in changeset.
Backport HDFS-8901 Use ByteBuffer in DFSInputStream#read to branch-2.9 Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org> Signed-off-by: stack <stack@apache.org>

Backport HDFS-8901 Use ByteBuffer in DFSInputStream#read to branch-2.9 Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org> Signed-off-by: stack <stack@apache.org>

HADOOP-15183. S3Guard store becomes inconsistent after partial failure of rename.

Contributed by Steve Loughran.

Change-Id: I825b0bc36be960475d2d259b1cdab45ae1bb78eb

  1. … 56 more files in changeset.
HADOOP-16379: S3AInputStream.unbuffer should merge input stream stats into fs-wide stats

Contributed by Sahil Takiar

Change-Id: I2bcfaaea00d12c633757069402dcd0b91a5f5c05

HDDS-1710. Publish JVM metrics via Hadoop metrics Signed-off-by: Anu Engineer <aengineer@apache.org>

HDDS-1710. Publish JVM metrics via Hadoop metrics Signed-off-by: Anu Engineer <aengineer@apache.org>

(cherry picked from commit c533b79c328a3b0a28028761d8a50942b9758636)

YARN-9631. Added ability to select JavaScript test or skip JavaScript tests for YARN application catalog. Contributed by Eric Yang

(cherry picked from commit 6002b0c5c6994965d3f7231330248c093869dba2)

HDFS-14303. check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu.

HDFS-14103. Review Logging of BlockPlacementPolicyDefault. Contributed by David Mollitor.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HADOOP-16340. ABFS driver continues to retry on IOException responses from REST operations.

Contributed by Robert Levas.

This makes the HttpException constructor protected rather than public, so it is possible

to implement custom subclasses of this exception -exceptions which will not be retried.

Change-Id: Ie8aaa23a707233c2db35948784908b6778ff3a8f

HADOOP-16340. ABFS driver continues to retry on IOException responses from REST operations.

Contributed by Robert Levas.

This makes the HttpException constructor protected rather than public, so it is possible

to implement custom subclasses of this exception -exceptions which will not be retried.

Change-Id: Ie8aaa23a707233c2db35948784908b6778ff3a8f

HDDS-1454. GC other system pause events can trigger pipeline destroy for all the nodes in the cluster. Contributed by Supratim Deka (#852)

Revert "HDFS-13287. TestINodeFile#testGetBlockType results in NPE when run alone. Contributed by Virajith Jalaparti."

This reverts commit 49587e4df3e955466670384de867f690b557fe6e.

Revert "HDFS-13287. TestINodeFile#testGetBlockType results in NPE when run alone. Contributed by Virajith Jalaparti."

This reverts commit 36dc0810bf8032e4741e27a8f2b00e64dbdaef2a.

Revert "HDFS-13287. TestINodeFile#testGetBlockType results in NPE when run alone. Contributed by Virajith Jalaparti."

This reverts commit a1c3868c4f027adcb814b30d842e60d1f94326ea.

HDFS-14537. Journaled Edits Cache is not cleared when formatting the JN. Contributed by Ranith Sardar.

HDFS-14537. Journaled Edits Cache is not cleared when formatting the JN. Contributed by Ranith Sardar.

HDFS-14537. Journaled Edits Cache is not cleared when formatting the JN. Contributed by Ranith Sardar.

HDFS-14537. Journaled Edits Cache is not cleared when formatting the JN. Contributed by Ranith Sardar.

HDFS-14537. Journaled Edits Cache is not cleared when formatting the JN. Contributed by Ranith Sardar.

HDFS-13287. TestINodeFile#testGetBlockType results in NPE when run alone. Contributed by Virajith Jalaparti.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-13287. TestINodeFile#testGetBlockType results in NPE when run alone. Contributed by Virajith Jalaparti.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 333633d9935acd5787ee8688bc9d2d7b7c058def)

(cherry picked from commit 36dc0810bf8032e4741e27a8f2b00e64dbdaef2a)

HDFS-13287. TestINodeFile#testGetBlockType results in NPE when run alone. Contributed by Virajith Jalaparti.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 333633d9935acd5787ee8688bc9d2d7b7c058def)