Clone
 

stephen o'donnell <sodonnell@cloudera.com> in hadoop

HDFS-14861. Reset LowRedundancyBlocks Iterator periodically. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14861. Reset LowRedundancyBlocks Iterator periodically. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 900430b9907b590ed2d73a0d68f079c7f4d754b1)

(cherry picked from commit 2377649cdb1307a72a946b95a9a04f316c6483ef)

HDFS-14861. Reset LowRedundancyBlocks Iterator periodically. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 900430b9907b590ed2d73a0d68f079c7f4d754b1)

HDFS-15150. Introduce read write lock to Datanode. Contributed Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-7175. Client-side SocketTimeoutException during Fsck. Contributed by Stephen O'Donnell, Akira Ajisaka.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Co-authored-by: Akira Ajisaka <aajisaka@apache.org>

(cherry picked from commit 1e3a0b0d931676b191cb4813ed1a283ebb24d4eb)

HDFS-7175. Client-side SocketTimeoutException during Fsck. Contributed by Stephen O'Donnell, Akira Ajisaka.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Co-authored-by: Akira Ajisaka <aajisaka@apache.org>

(cherry picked from commit 1e3a0b0d931676b191cb4813ed1a283ebb24d4eb)

(cherry picked from commit e89436b1839aa87b4bedfc7e2d558c7541e73540)

HDFS-7175. Client-side SocketTimeoutException during Fsck. Contributed by Stephen O'Donnell, Akira Ajisaka.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Co-authored-by: Akira Ajisaka <aajisaka@apache.org>

HDFS-14854. Create improved decommission monitor implementation. Contributed by Stephen O'Donnell.

Reviewed-by: Inigo Goiri <inigoiri@apache.org>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14637. Namenode may not replicate blocks to meet the policy after enabling upgradeDomain. Contributed by Stephen O'Donnell.

Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14637. Namenode may not replicate blocks to meet the policy after enabling upgradeDomain. Contributed by Stephen O'Donnell.

Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit c99a12167ff9566012ef32104a3964887d62c899)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlocksWithNotEnoughRacks.java

hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/BlockPlacementPolicyAlwaysSatisfied.java

HDFS-14637. Namenode may not replicate blocks to meet the policy after enabling upgradeDomain. Contributed by Stephen O'Donnell.

Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit c99a12167ff9566012ef32104a3964887d62c899)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlocksWithNotEnoughRacks.java

hadoop-tools/hadoop-dynamometer/hadoop-dynamometer-infra/src/main/java/org/apache/hadoop/tools/dynamometer/BlockPlacementPolicyAlwaysSatisfied.java

(cherry picked from commit 966193153f9cd75e009c8db3502e1b3ba2cdfa25)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlocksWithNotEnoughRacks.java

HDFS-14821. Make HDFS-14617 (fsimage sub-sections) off by default. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 915cbc91c0a12cc7b4d3ef4ea951941defbbcb33)

(cherry picked from commit 2c7f49743fba587e32398c81412db9eac426cf98)

HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 915cbc91c0a12cc7b4d3ef4ea951941defbbcb33)

HDFS-14675. Increase Balancer Defaults Further. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Reviewed-by: Gabor Bota <gabota@apache.org>

HDFS-14459. ClosedChannelException silently ignored in FsVolumeList.addBlockPool(). Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14459. ClosedChannelException silently ignored in FsVolumeList.addBlockPool(). Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit b0799148cf6e92be540f5665bb571418b916d789)

HDFS-14459. ClosedChannelException silently ignored in FsVolumeList.addBlockPool(). Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit b0799148cf6e92be540f5665bb571418b916d789)

(cherry picked from commit a00a3275944bfdfd0849ac50c89e81b1284c8e13)

HDFS-14557. JournalNode error: Can't scan a pre-transactional edit log. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14557. JournalNode error: Can't scan a pre-transactional edit log. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 35e0a01d7bc3149bf8b941fd85d7807d9906d27b)

HDFS-14557. JournalNode error: Can't scan a pre-transactional edit log. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 35e0a01d7bc3149bf8b941fd85d7807d9906d27b)

(cherry picked from commit 8414e6354b4f32f2059d7bb651a7fd16c56bfbfb)

HDFS-14557. JournalNode error: Can't scan a pre-transactional edit log. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-13231. Extend visualization for Decommissioning, Maintenance Mode under Datanode tab in the NameNode UI. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 50de0874d0f14526bfb7052f2a2e64543dc0fcbc)

(cherry picked from commit 71159f9540d5a2aac6fb904649639f75e457e94d)

HDFS-13231. Extend visualization for Decommissioning, Maintenance Mode under Datanode tab in the NameNode UI. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 50de0874d0f14526bfb7052f2a2e64543dc0fcbc)

HDFS-13231. Extend visualization for Decommissioning, Maintenance Mode under Datanode tab in the NameNode UI. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14389. getAclStatus returns incorrect permissions and owner when an iNodeAttributeProvider is configured. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit c528e427aa6745434672b1c1850738795ad1d6d2)

(cherry picked from commit 388f445dde577999b2d81f809adcfca8f0958499)

HDFS-14389. getAclStatus returns incorrect permissions and owner when an iNodeAttributeProvider is configured. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14389. getAclStatus returns incorrect permissions and owner when an iNodeAttributeProvider is configured. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit c528e427aa6745434672b1c1850738795ad1d6d2)

(cherry picked from commit 388f445dde577999b2d81f809adcfca8f0958499)

(cherry picked from commit d9899015ebf8a27e9ac339d8a8b3c9d88bcbacb9)

HDFS-14389. getAclStatus returns incorrect permissions and owner when an iNodeAttributeProvider is configured. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit c528e427aa6745434672b1c1850738795ad1d6d2)