Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HDFS-15160. ReplicaMap, Disk Balancer, Directory Scanner and various FsDatasetImpl methods should use datanode readlock. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

  1. … 7 more files in changeset.
HDFS-15406. Improve the speed of Datanode Block Scan. Contributed by hemanthboyina

(cherry picked from commit 123777823edc98553fcef61f1913ab6e4cd5aa9a)

  1. … 1 more file in changeset.
HDFS-15406. Improve the speed of Datanode Block Scan. Contributed by hemanthboyina

(cherry picked from commit 123777823edc98553fcef61f1913ab6e4cd5aa9a)

  1. … 1 more file in changeset.
HDFS-15406. Improve the speed of Datanode Block Scan. Contributed by hemanthboyina

(cherry picked from commit 123777823edc98553fcef61f1913ab6e4cd5aa9a)

  1. … 1 more file in changeset.
HDFS-15406. Improve the speed of Datanode Block Scan. Contributed by hemanthboyina

  1. … 1 more file in changeset.
HDFS-15386. ReplicaNotFoundException keeps happening in DN after removing multiple DN's data directories (#2054)

Contributed by Toshihiro Suzuki.

  1. … 1 more file in changeset.
Revert "HDFS-13179. TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently. Contributed by Ahmed Hussein."

This reverts commit ed59412434027b133f2774af69228510f09a0264.

  1. … 1 more file in changeset.
HDFS-15386. ReplicaNotFoundException keeps happening in DN after removing multiple DN's data directories (#2052)

Contributed by Toshihiro Suzuki.

(cherry picked from commit 545a0a147c5256c44911ba57b4898e01d786d836)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java

(cherry picked from commit e5a02a7499cb124e166fc2765c082efe3b92fe29)

  1. … 1 more file in changeset.
HDFS-15386. ReplicaNotFoundException keeps happening in DN after removing multiple DN's data directories (#2052)

Contributed by Toshihiro Suzuki.

(cherry picked from commit 545a0a147c5256c44911ba57b4898e01d786d836)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java

(cherry picked from commit e5a02a7499cb124e166fc2765c082efe3b92fe29)

  1. … 1 more file in changeset.
HDFS-15386. ReplicaNotFoundException keeps happening in DN after removing multiple DN's data directories (#2052)

Contributed by Toshihiro Suzuki.

(cherry picked from commit 545a0a147c5256c44911ba57b4898e01d786d836)

  1. … 1 more file in changeset.
HDFS-15386. ReplicaNotFoundException keeps happening in DN after removing multiple DN's data directories (#2052)

Contributed by Toshihiro Suzuki.

(cherry picked from commit 545a0a147c5256c44911ba57b4898e01d786d836)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java

  1. … 1 more file in changeset.
HDFS-15386 ReplicaNotFoundException keeps happening in DN after removing multiple DN's data directories (#2052)

Contributed by Toshihiro Suzuki.

  1. … 1 more file in changeset.
HDFS-11041. Unable to unregister FsDatasetState MBean if DataNode is shutdown twice. Contributed by Wei-Chiu Chuang.

  1. … 1 more file in changeset.
HADOOP-16988. Remove source code from branch-2. (aajisaka via jhung)

This closes #1959

    • -297
    • +0
    ./AvailableSpaceVolumeChoosingPolicy.java
    • -101
    • +0
    ./RoundRobinVolumeChoosingPolicy.java
    • -347
    • +0
    ./impl/FsDatasetAsyncDiskService.java
  1. … 10832 more files in changeset.
Revert "HDFS-14986. ReplicaCachingGetSpaceUsed throws ConcurrentModificationException. Contributed by Aiphago."

This reverts commit 26b51f3e2295b9a85ee1fc9a7f475cb3dc181933.

    • -1
    • +0
    ./impl/ReplicaCachingGetSpaceUsed.java
  1. … 2 more files in changeset.
HDFS-15242. Add metrics for operations hold lock times of FsDatasetImpl. Contributed by Xiaoqiao He.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Reviewed-by: Inigo Goiri <inigoiri@apache.org>

  1. … 3 more files in changeset.
HDFS-15155. writeIoRate of DataNodeVolumeMetrics is never used. Contributed by Haibin Huang.

  1. … 1 more file in changeset.
HDFS-15033. Support to save replica cached files to other place and make expired time configurable. Contributed by Yang Yun.

  1. … 3 more files in changeset.
HDFS-15174. Optimize ReplicaCachingGetSpaceUsed by reducing unnecessary io operations. Contributed by Lisheng Sun.

(cherry picked from commit cb4daeaad95470125c59ccb80b988261ae83d534)

    • -1
    • +1
    ./impl/ReplicaCachingGetSpaceUsed.java
HDFS-15174. Optimize ReplicaCachingGetSpaceUsed by reducing unnecessary io operations. Contributed by Lisheng Sun.

(cherry picked from commit cb4daeaad95470125c59ccb80b988261ae83d534)

(cherry picked from commit f9437b1817e09c5a3ee7b378a0f4faee9b853315)

    • -1
    • +1
    ./impl/ReplicaCachingGetSpaceUsed.java
HDFS-15174. Optimize ReplicaCachingGetSpaceUsed by reducing unnecessary io operations. Contributed by Lisheng Sun.

    • -1
    • +1
    ./impl/ReplicaCachingGetSpaceUsed.java
HDFS-15150. Introduce read write lock to Datanode. Contributed Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

  1. … 11 more files in changeset.
HDFS-15046. Backport HDFS-7060 to branch-2.10. Contributed by Lisheng Sun.

HDFS-13179. TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently. Contributed by Ahmed Hussein.

  1. … 2 more files in changeset.
HDFS-13179. TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently. Contributed by Ahmed Hussein.

(cherry picked from commit 1839c467f60cbb8592d446694ec3d7710cda5142)

  1. … 1 more file in changeset.
HDFS-13179. TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently. Contributed by Ahmed Hussein.

(cherry picked from commit 1839c467f60cbb8592d446694ec3d7710cda5142)

  1. … 1 more file in changeset.
HDFS-13179. TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently. Contributed by Ahmed Hussein.

(cherry picked from commit 1839c467f60cbb8592d446694ec3d7710cda5142)

  1. … 1 more file in changeset.
HDFS-13179. TestLazyPersistReplicaRecovery#testDnRestartWithSavedReplicas fails intermittently. Contributed by Ahmed Hussein.

  1. … 1 more file in changeset.
HDFS-15080. Fix the issue in reading persistent memory cached data with an offset. Contributed by Feilong He.

(cherry picked from commit 7030722e5d9f376245a9ab0a6a883538b6c55f82)

HDFS-15080. Fix the issue in reading persistent memory cached data with an offset. Contributed by Feilong He.

(cherry picked from commit 7030722e5d9f376245a9ab0a6a883538b6c55f82)