Xiaoqiao He

HDFS-15050. Optimize log information when DFSInputStream meet CannotObtainBlockLengthException. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 99af49878cc47f5750b6c0edadc8a4c2fcd7a7c6)

(cherry picked from commit 8ba4e13dcc4ad16e8483d33a31ed52e1b8d4e686)

(cherry picked from commit 974706c5fdd7c875922b38a2efffb6b7bda8cdf5)

HDFS-15050. Optimize log information when DFSInputStream meet CannotObtainBlockLengthException. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 99af49878cc47f5750b6c0edadc8a4c2fcd7a7c6)

(cherry picked from commit 8ba4e13dcc4ad16e8483d33a31ed52e1b8d4e686)

HDFS-15050. Optimize log information when DFSInputStream meet CannotObtainBlockLengthException. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 99af49878cc47f5750b6c0edadc8a4c2fcd7a7c6)

HDFS-15050. Optimize log information when DFSInputStream meet CannotObtainBlockLengthException. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 99af49878cc47f5750b6c0edadc8a4c2fcd7a7c6)

(cherry picked from commit 8ba4e13dcc4ad16e8483d33a31ed52e1b8d4e686)

(cherry picked from commit 974706c5fdd7c875922b38a2efffb6b7bda8cdf5)

(cherry picked from commit 3138b79e561bb5258db1f6a70b7e0ae768784eac)

HDFS-15050. Optimize log information when DFSInputStream meet CannotObtainBlockLengthException. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14952. Skip safemode if blockTotal is 0 in new NN. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Reviewed-by: Mukul Kumar Singh <msingh@apache.org>

(cherry picked from commit 0b50aa29fd5dc114b3e0fc54b5c393bbc9f3102e)

(cherry picked from commit 1d383436f09f8e490171c8f6af4605971ad2f904)

HDFS-14952. Skip safemode if blockTotal is 0 in new NN. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Reviewed-by: Mukul Kumar Singh <msingh@apache.org>

(cherry picked from commit 0b50aa29fd5dc114b3e0fc54b5c393bbc9f3102e)

(cherry picked from commit 1d383436f09f8e490171c8f6af4605971ad2f904)

(cherry picked from commit 7909c5df572a5cbc729ebc6c7c6e59f17803d50f)

HDFS-14952. Skip safemode if blockTotal is 0 in new NN. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Reviewed-by: Mukul Kumar Singh <msingh@apache.org>

(cherry picked from commit 0b50aa29fd5dc114b3e0fc54b5c393bbc9f3102e)

HDFS-14952. Skip safemode if blockTotal is 0 in new NN. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Reviewed-by: Mukul Kumar Singh <msingh@apache.org>

HDFS-14882. Consider DataNode load when #getBlockLocation. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Reviewed-by: Inigo Goiri <inigoiri@apache.org>

Reviewed-by: Istvan Fajth <pifta@cloudera.com>

HDFS-14771. Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index). Contributed by He Xiaoqiao and Stephen O'Donnel.

Reviewed-by: Stephen O'Donnell <sodonnell@cloudera.com>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-11246. FSNameSystem#logAuditEvent should be called outside the read or write locks. Contributed by He Xiaoqiao, Kuhu Shukla.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Co-authored-by: Kuhu Shukla <kshukla@apache.org>

HDFS-14497. Addendum: Write lock held by metasave impact following RPC processing.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit dde9399b37bffb77da17c025f0b9b673d7088bc6)

HDFS-14497. Addendum: Write lock held by metasave impact following RPC processing.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14497. Addendum: Write lock held by metasave impact following RPC processing.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit dde9399b37bffb77da17c025f0b9b673d7088bc6)

(cherry picked from commit e29ae7db1258f08339cf0f53968fce6f98ada3ac)

HDFS-14725. Backport HDFS-12914 to branch-2 (Block report leases cause missing blocks until next report). Contributed by He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14725. Backport HDFS-12914 to branch-2 (Block report leases cause missing blocks until next report). Contributed by He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14725. Backport HDFS-12914 to branch-2 (Block report leases cause missing blocks until next report). Contributed by He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit b020c5ccfd38e295f04e4c26a556c9e523f175e6)

HDFS-13529. Fix default trash policy emptier trigger time correctly. Contributed by He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-13529. Fix default trash policy emptier trigger time correctly. Contributed by He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit f86de6f76a3079c2655df9b242fc968edfb17b9d)

HDFS-13529. Fix default trash policy emptier trigger time correctly. Contributed by He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit f86de6f76a3079c2655df9b242fc968edfb17b9d)

(cherry picked from commit 555b56c0421be84efd09221db2b3f26c8b44ed45)

HDFS-14553. Make queue size of BlockReportProcessingThread configurable. Contributed by He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit bd46bdf9f9244f3f3474d316255ac98717ed5719)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml

HDFS-14553. Make queue size of BlockReportProcessingThread configurable. Contributed by He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14553. Make queue size of BlockReportProcessingThread configurable. Contributed by He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit bd46bdf9f9244f3f3474d316255ac98717ed5719)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/main/resources/hdfs-default.xml

(cherry picked from commit d7560c866ecbfcd533a43890522ccb8b732a5382)

HDFS-14497. Write lock held by metasave impact following RPC processing. Contributed by He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 33c62f8f4e94442825fe286c2b18518925d980e6)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java

(cherry picked from commit 80392e94b6dca16229fc35426d107184be68c908)

HDFS-14497. Write lock held by metasave impact following RPC processing. Contributed by He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 33c62f8f4e94442825fe286c2b18518925d980e6)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java

HDFS-14497. Write lock held by metasave impact following RPC processing. Contributed by He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>