hadoop

Clone Tools
  • last updated 29 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HDFS-13101. Yet another fsimage corruption related to snapshot. Contributed by Shashikant Banerjee.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-13101. Yet another fsimage corruption related to snapshot. Contributed by Shashikant Banerjee.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit ab7509efe7375949db3b819b53e9461624cd2b1e)

HDFS-13101. Yet another fsimage corruption related to snapshot. Contributed by Shashikant Banerjee.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit ab7509efe7375949db3b819b53e9461624cd2b1e)

HADOOP-16158. DistCp to support checksum validation when copy blocks in parallel (#919)

* DistCp to support checksum validation when copy blocks in parallel

* address review comments

* add checksums comparison test for combine mode

HADOOP-16158. DistCp to support checksum validation when copy blocks in parallel (#919)

* DistCp to support checksum validation when copy blocks in parallel

* address review comments

* add checksums comparison test for combine mode

(cherry picked from commit c765584eb231f8482f5b90b7e8f61f9f7a931d09)

(cherry picked from commit b3c14d4132ed6aa871bb88c4f84f3e3d90da6f93)

Conflicts:

hadoop-tools/hadoop-distcp/src/test/java/org/apache/hadoop/tools/util/TestDistCpUtils.java

HADOOP-16158. DistCp to support checksum validation when copy blocks in parallel (#919)

* DistCp to support checksum validation when copy blocks in parallel

* address review comments

* add checksums comparison test for combine mode

(cherry picked from commit c765584eb231f8482f5b90b7e8f61f9f7a931d09)

HADOOP-15246. SpanReceiverInfo - Prefer ArrayList over LinkedList. Contributed by David Mollitor.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HADOOP-15246. SpanReceiverInfo - Prefer ArrayList over LinkedList. Contributed by David Mollitor.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 901652e26321832ac42ce54daa18ebc1813772b5)

HADOOP-15246. SpanReceiverInfo - Prefer ArrayList over LinkedList. Contributed by David Mollitor.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 901652e26321832ac42ce54daa18ebc1813772b5)

(cherry picked from commit 1b30b3fbe7b5e130778c79465ac7986772a83ab8)

HDDS-1971. Update document for HDDS-1891: Ozone fs shell command should work with default port when port number is not specified (#1306)

(cherry picked from commit 12c7084be3b03be81cdb688c911798d52dcfc160)

HDDS-1971. Update document for HDDS-1891: Ozone fs shell command should work with default port when port number is not specified (#1306)

HDFS-14687. Standby Namenode never come out of safemode when EC files are being written. Contributed by Surendra Singh Lilhore.

Reviewed-by: Siyao Meng <smeng@cloudera.com>

Reviewed-by: Wei-Chiu CHuang <weichiu@apache.org>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14687. Standby Namenode never come out of safemode when EC files are being written. Contributed by Surendra Singh Lilhore.

Reviewed-by: Siyao Meng <smeng@cloudera.com>

Reviewed-by: Wei-Chiu CHuang <weichiu@apache.org>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit b8db5b9a9812023754ed1b3e5b428e161f0add50)

(cherry picked from commit 6b01effd011ab1f88bdbb9f2dbf9bbb0765984e6)

HDFS-14687. Standby Namenode never come out of safemode when EC files are being written. Contributed by Surendra Singh Lilhore.

Reviewed-by: Siyao Meng <smeng@cloudera.com>

Reviewed-by: Wei-Chiu CHuang <weichiu@apache.org>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit b8db5b9a9812023754ed1b3e5b428e161f0add50)

HDFS-14687. Standby Namenode never come out of safemode when EC files are being written. Contributed by Surendra Singh Lilhore.

Reviewed-by: Siyao Meng <smeng@cloudera.com>

Reviewed-by: Wei-Chiu CHuang <weichiu@apache.org>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit b8db5b9a9812023754ed1b3e5b428e161f0add50)

(cherry picked from commit 6b01effd011ab1f88bdbb9f2dbf9bbb0765984e6)

HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow.

(cherry picked from commit 8755de108d0e711cbfa784a20bd89e28fe79266b)

(cherry picked from commit 22321f1d3dfae5bf03b8724f5d74d292d551580f)

HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow.

HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow.

(cherry picked from commit 8755de108d0e711cbfa784a20bd89e28fe79266b)

HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow.

HDDS-1903 : Use dynamic ports for SCM in TestSCMClientProtocolServer … (#1303)

HDDS-1974. Implement OM CancelDelegationToken request to use Cache and DoubleBuffer. (#1308)

HDDS-1938. Change omPort parameter type from String to int in BasicOzoneFileSystem#createAdapter (#1305)

HDDS-1979. Fix checkstyle errors (#1312)

HDFS-14127. Add a description about the observer read configuration. Contributed by xiangheng.

HDFS-12012. Fix spelling mistakes in BPServiceActor.java. Contributed by chencan.

HDDS-1959. Decrement purge interval for Ratis logs in datanode (#1301)

YARN-2599. Standby RM should expose jmx endpoint. Contributed by Rohith Sharma K S.

HDFS-14723. Add helper method FSNamesystem#setBlockManagerForTesting() in branch-2. Contributed by Wei-Chiu Chuang.

Reviewed-by: Chao Sun <sunchao@apache.org>

Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>

Reviewed-by: Erik Krogen <xkrogen@apache.org>

HDFS-14723. Add helper method FSNamesystem#setBlockManagerForTesting() in branch-2. Contributed by Wei-Chiu Chuang.

Reviewed-by: Chao Sun <sunchao@apache.org>

Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>

Reviewed-by: Erik Krogen <xkrogen@apache.org>

(cherry picked from commit f27d040ce329894d14ce7caf42a64816df0a9455)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java

HDFS-14725. Backport HDFS-12914 to branch-2 (Block report leases cause missing blocks until next report). Contributed by He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>