Clone Tools
  • last updated 16 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HDFS-14818. Check native pmdk lib by 'hadoop checknative' command. Contributed by Feilong He.

    • -3
    • +12
    ./fsdataset/impl/FsDatasetCache.java
  1. … 6 more files in changeset.
HDFS-14844. Make buffer of BlockReaderRemote#newBlockReader#BufferedOutputStream configurable. Contributed by Lisheng Sun.

  1. … 4 more files in changeset.
HDFS-14836. FileIoProvider should not increase FileIoErrors metric in datanode volume metric. Contributed by Aiphago.

Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>

(cherry picked from commit 5dd859a8a0d038ff04acbb96741a215d6a0e8c29)

HDFS-14836. FileIoProvider should not increase FileIoErrors metric in datanode volume metric. Contributed by Aiphago.

Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>

HDFS-14836. FileIoProvider should not increase FileIoErrors metric in datanode volume metric. Contributed by Aiphago.

Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>

(cherry picked from commit 5dd859a8a0d038ff04acbb96741a215d6a0e8c29)

(cherry picked from commit b906f53b0d0e330d65a36295bfb8fe66d0a3995c)

HDFS-14795. Add Throttler for writing block. Contributed by Lisheng Sun.

  1. … 3 more files in changeset.
HDFS-12904. Add DataTransferThrottler to the Datanode transfers. Contributed by Lisheng Sun.

  1. … 2 more files in changeset.
HDFS-14611. Move handshake secret field from Token to BlockAccessToken. Contributed by Chen Liang

  1. … 10 more files in changeset.
HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

  1. … 4 more files in changeset.
HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 915cbc91c0a12cc7b4d3ef4ea951941defbbcb33)

(cherry picked from commit 2c7f49743fba587e32398c81412db9eac426cf98)

  1. … 4 more files in changeset.
HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 915cbc91c0a12cc7b4d3ef4ea951941defbbcb33)

  1. … 4 more files in changeset.
Make DataNodePeerMetrics#minOutlierDetectionSamples configurable (#1314). Contributed by Lisheng Sun.

Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>

(cherry picked from commit 915271245b9a3f682409db380eb311ffd465b041)

  1. … 4 more files in changeset.
Make DataNodePeerMetrics#minOutlierDetectionSamples configurable (#1314). Contributed by Lisheng Sun.

Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>

  1. … 4 more files in changeset.
Make DataNodePeerMetrics#minOutlierDetectionSamples configurable (#1314). Contributed by Lisheng Sun.

Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>

(cherry picked from commit 915271245b9a3f682409db380eb311ffd465b041)

(cherry picked from commit b516d2ea7b2b96a1af350edd7964d3e082ee4fe7)

  1. … 4 more files in changeset.
Revert "HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow."

This reverts commit dbc7e4d74b3494e049bef6baf16efc88dca30fc3.

Revert "HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow."

This reverts commit 22321f1d3dfae5bf03b8724f5d74d292d551580f.

Revert "HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow."

This reverts commit 8755de108d0e711cbfa784a20bd89e28fe79266b.

Revert "HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow."

This reverts commit e978c6c9ed83301fcf8359c35e74ed68045c1a61.

Revert "HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow."

This reverts commit 8b802d6b444b95791ba156c7bb307dd584cc9dba.

Revert "HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow."

This reverts commit b58a35f374a9a750fddc2fc92e7f7a7ae8a4d3a4.

HDFS-14582. Failed to start DN with ArithmeticException when NULL checksum used. Contributed by Surendra Singh Lilhore.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit f95988113da3f06f6d975f99f1ee51d88a793537)

(cherry picked from commit 03c62c7989f818c49d5afca0ac94c7e72a091066)

  1. … 1 more file in changeset.
HDFS-14582. Failed to start DN with ArithmeticException when NULL checksum used. Contributed by Surendra Singh Lilhore.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

  1. … 1 more file in changeset.
HDFS-14582. Failed to start DN with ArithmeticException when NULL checksum used. Contributed by Surendra Singh Lilhore.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit f95988113da3f06f6d975f99f1ee51d88a793537)

  1. … 1 more file in changeset.
HDFS-14311. Multi-threading conflict at layoutVersion when loading block pool storage. Contributed by Yicong Cai.

HDFS-14311. Multi-threading conflict at layoutVersion when loading block pool storage. Contributed by Yicong Cai.

(cherry picked from commit bdab03cf711f75e88f80c21b3193fd5070cb6364)

(cherry picked from commit 0e7afe054ad67052359ab62757d6241d955b94d5)

HDFS-14311. Multi-threading conflict at layoutVersion when loading block pool storage. Contributed by Yicong Cai.

(cherry picked from commit bdab03cf711f75e88f80c21b3193fd5070cb6364)

HDFS-14311. Multi-threading conflict at layoutVersion when loading block pool storage. Contributed by Yicong Cai.

(cherry picked from commit fbe87eddbc30fe5191c008b496fb83e51ef4ee4a)

(cherry picked from commit f78dcbaae5535e3e05c9f29986b8963ba262baa9)

HDFS-14311. Multi-threading conflict at layoutVersion when loading block pool storage. Contributed by Yicong Cai.

(cherry picked from commit fbe87eddbc30fe5191c008b496fb83e51ef4ee4a)

HDFS-14311. Multi-threading conflict at layoutVersion when loading block pool storage. Contributed by Yicong Cai.

HDFS-13709. Report bad block to NN when transfer block encounter EIO exception. Contributed by Chen Zhang.

(cherry picked from commit 360a96f342f3c8cb8246f011abb9bcb0b6ef3eaa)

(cherry picked from commit 6d93886231112c93218066008f957984def3b43b)

    • -0
    • +39
    ./DiskFileCorruptException.java
  1. … 3 more files in changeset.