hadoop

Clone Tools
  • last updated 26 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HDDS-1610. applyTransaction failure should not be lost on restart. Contributed by Shashikant Banerjee.

HADOOP-16496. Apply HDDS-1870 (ConcurrentModification at PrometheusMetricsSink) to Hadoop common.

This closes #1317

Reviewed-by: Bharat Viswanadham <bharat@apache.org>

HDDS-1927. Consolidate add/remove Acl into OzoneAclUtil class. Contributed by Xiaoyu Yao.

Signed-off-by: Anu Engineer <aengineer@apache.org>

  1. … 10 more files in changeset.
HDDS-1927. Consolidate add/remove Acl into OzoneAclUtil class. Contributed by Xiaoyu Yao.

Signed-off-by: Anu Engineer <aengineer@apache.org>

(cherry picked from commit d58eba867234eaac0e229feb990e9dab3912e063)

  1. … 6 more files in changeset.
HDDS-1972. Provide example ha proxy with multiple s3 servers back end. (#1304)

(cherry picked from commit 4f925afa820b607f3479a310b84f351812542833)

    • -0
    • +18
    /hadoop-ozone/dist/src/main/compose/ozones3-haproxy/.env
    • -0
    • +30
    /hadoop-ozone/dist/src/main/compose/ozones3-haproxy/test.sh
HDDS-1972. Provide example ha proxy with multiple s3 servers back end. (#1304)

    • -0
    • +18
    /hadoop-ozone/dist/src/main/compose/ozones3-haproxy/.env
    • -0
    • +30
    /hadoop-ozone/dist/src/main/compose/ozones3-haproxy/test.sh
HDFS-13709. Report bad block to NN when transfer block encounter EIO exception. Contributed by Chen Zhang.

(cherry picked from commit 360a96f342f3c8cb8246f011abb9bcb0b6ef3eaa)

(cherry picked from commit 6d93886231112c93218066008f957984def3b43b)

HDFS-13709. Report bad block to NN when transfer block encounter EIO exception. Contributed by Chen Zhang.

(cherry picked from commit 360a96f342f3c8cb8246f011abb9bcb0b6ef3eaa)

HDFS-13709. Report bad block to NN when transfer block encounter EIO exception. Contributed by Chen Zhang.

HDFS-14746. Trivial test code update after HDFS-14687. Contributed by kevin su.

Reviewed-by: Surendra Singh Lilhore <surendralilhore@apache.org>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit abae6ff2a2760500b7e7d4414a43069ed4a45930)

HDFS-14746. Trivial test code update after HDFS-14687. Contributed by kevin su.

Reviewed-by: Surendra Singh Lilhore <surendralilhore@apache.org>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14746. Trivial test code update after HDFS-14687. Contributed by kevin su.

Reviewed-by: Surendra Singh Lilhore <surendralilhore@apache.org>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit abae6ff2a2760500b7e7d4414a43069ed4a45930)

(cherry picked from commit abda5030408d12ba44c8b6df4137bdae6ee0690b)

HADOOP-14784. [KMS] Improve KeyAuthorizationKeyProvider#toString(). Contributed by Yeliang Cang.

Reviewed-by: Dinesh Chitlangia <dchitlangia@cloudera.com>

HDDS-1105 : Add mechanism in Recon to obtain DB snapshot 'delta' updates from Ozone Manager (#1259)

  1. … 18 more files in changeset.
HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow.

(cherry picked from commit 8b802d6b444b95791ba156c7bb307dd584cc9dba)

HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow.

HDFS-13101. Yet another fsimage corruption related to snapshot. Contributed by Shashikant Banerjee.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit ab7509efe7375949db3b819b53e9461624cd2b1e)

(cherry picked from commit 8a924a81fa4140ab99468eda1452915ea60b6ce0)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFSImageWithSnapshot.java

HDFS-13101. Yet another fsimage corruption related to snapshot. Contributed by Shashikant Banerjee.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-13101. Yet another fsimage corruption related to snapshot. Contributed by Shashikant Banerjee.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit ab7509efe7375949db3b819b53e9461624cd2b1e)

HDFS-13101. Yet another fsimage corruption related to snapshot. Contributed by Shashikant Banerjee.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit ab7509efe7375949db3b819b53e9461624cd2b1e)

HADOOP-16158. DistCp to support checksum validation when copy blocks in parallel (#919)

* DistCp to support checksum validation when copy blocks in parallel

* address review comments

* add checksums comparison test for combine mode

HADOOP-16158. DistCp to support checksum validation when copy blocks in parallel (#919)

* DistCp to support checksum validation when copy blocks in parallel

* address review comments

* add checksums comparison test for combine mode

(cherry picked from commit c765584eb231f8482f5b90b7e8f61f9f7a931d09)

(cherry picked from commit b3c14d4132ed6aa871bb88c4f84f3e3d90da6f93)

Conflicts:

hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/util/TestDistCpUtils.java

HADOOP-16158. DistCp to support checksum validation when copy blocks in parallel (#919)

* DistCp to support checksum validation when copy blocks in parallel

* address review comments

* add checksums comparison test for combine mode

(cherry picked from commit c765584eb231f8482f5b90b7e8f61f9f7a931d09)

HADOOP-15246. SpanReceiverInfo - Prefer ArrayList over LinkedList. Contributed by David Mollitor.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HADOOP-15246. SpanReceiverInfo - Prefer ArrayList over LinkedList. Contributed by David Mollitor.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 901652e26321832ac42ce54daa18ebc1813772b5)

HADOOP-15246. SpanReceiverInfo - Prefer ArrayList over LinkedList. Contributed by David Mollitor.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 901652e26321832ac42ce54daa18ebc1813772b5)

(cherry picked from commit 1b30b3fbe7b5e130778c79465ac7986772a83ab8)

HDDS-1971. Update document for HDDS-1891: Ozone fs shell command should work with default port when port number is not specified (#1306)

(cherry picked from commit 12c7084be3b03be81cdb688c911798d52dcfc160)

HDDS-1971. Update document for HDDS-1891: Ozone fs shell command should work with default port when port number is not specified (#1306)

HDFS-14687. Standby Namenode never come out of safemode when EC files are being written. Contributed by Surendra Singh Lilhore.

Reviewed-by: Siyao Meng <smeng@cloudera.com>

Reviewed-by: Wei-Chiu CHuang <weichiu@apache.org>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14687. Standby Namenode never come out of safemode when EC files are being written. Contributed by Surendra Singh Lilhore.

Reviewed-by: Siyao Meng <smeng@cloudera.com>

Reviewed-by: Wei-Chiu CHuang <weichiu@apache.org>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit b8db5b9a9812023754ed1b3e5b428e161f0add50)

(cherry picked from commit 6b01effd011ab1f88bdbb9f2dbf9bbb0765984e6)