hadoop

Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HDFS-14598. Findbugs warning caused by HDFS-12487. Contributed by He Xiaoqiao.

HDDS-1646. Support real persistence in the k8s example files (#945)

* HDDS-1646. Support real persistence in the k8s example files

* ephemeral clusters can be scaled up

  1. … 34 more files in changeset.
HDDS-1597. Remove hdds-server-scm dependency from ozone-common (#969)

* HDDS-1597. Remove hdds-server-scm dependency from ozone-common. Contributed by Elek, Marton.

* checkstyle fixes

* revert the import reorder of HddsUtil

* add javadoc

* switch back to the commons-lang2

* fix typo

* fix metrics core classpath problem (+rebase fix)

    • -6
    • +4
    /hadoop-hdds/container-service/pom.xml
    • -0
    • +9
    /hadoop-ozone/integration-test/pom.xml
HADOOP-16350. Ability to tell HDFS client not to request KMS Information from NameNode. Ccontributed by Greg Senia, Ajay Kumar.

YARN-9374. Improve Timeline service resilience when HBase is unavailable. Contributed by Prabhu Joseph and Szilard Nemeth

YARN-9374. Improve Timeline service resilience when HBase is unavailable. Contributed by Prabhu Joseph and Szilard Nemeth

HDDS-1719 : Increase ratis log segment size to 1MB. (#1005)

* HDDS-1719 : Increase ratis log segment size to 1MB.

* HDDS-1719 : Increase ratis log segment size to 1MB.

HDFS-14339. Inconsistent log level practices in RpcProgramNfs3.java. Contributed by Anuhan Torgonshar.

HDFS-12914. Block report leases cause missing blocks until next report. Contributed by Santosh Marella, He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Co-authored-by: He Xiaoqiao <hexiaoqiao@apache.org>

(cherry picked from commit 026cc2647d4e3c1cffdd154995a5f1f07956c2a0)

HDFS-12914. Block report leases cause missing blocks until next report. Contributed by Santosh Marella, He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Co-authored-by: He Xiaoqiao <hexiaoqiao@apache.org>

HDDS-1706. Replication Manager thread running too frequently. Contributed by Nilotpal Nandi.

HDFS-14074. DataNode runs async disk checks maybe throws NullPointerException, and DataNode failed to register to NameSpace. Contributed by guangyi lu.

(cherry picked from commit 645d67bc4f4e29d10ef810386c89e6a7c8c61862)

HDFS-14074. DataNode runs async disk checks maybe throws NullPointerException, and DataNode failed to register to NameSpace. Contributed by guangyi lu.

HDFS-14074. DataNode runs async disk checks maybe throws NullPointerException, and DataNode failed to register to NameSpace. Contributed by guangyi lu.

(cherry picked from commit 645d67bc4f4e29d10ef810386c89e6a7c8c61862)

(cherry picked from commit d5ecca1d4ca2b567167402bf8745fb2417bbf624)

HDFS-12487. FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers. Contributed by liumi.

(cherry picked from commit 1524e2e6c52aba966cbbf1d8025ba165688ab9bb)

HDFS-12487. FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers. Contributed by liumi.

(cherry picked from commit 1524e2e6c52aba966cbbf1d8025ba165688ab9bb)

(cherry picked from commit 845d7611babac68a2b0caa6e4b8963f0c8332540)

HDFS-12487. FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers. Contributed by liumi.

HADOOP-15989. Synchronized at CompositeService#removeService is not required. Contributed by Prabhu Joseph.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDDS-1690. ContainerController should provide a way to retrieve containers per volume (#986)

HDDS-1715. Update the Intellij runner definitition of SCM to use the new class name

Closes #1000

HDDS-1678. Default image name for kubernetes examples should be ozone and not hadoop

Closes #959

YARN-9209. When nodePartition is not set in Placement Constraints, containers are allocated only in default partition. Contributed by Tarun Parimi.

YARN-9209. When nodePartition is not set in Placement Constraints, containers are allocated only in default partition. Contributed by Tarun Parimi.

(cherry picked from commit 83dcb9d87ec75f2be0acb8972f5f0faefe6ffbcd)

HDDS-1674. Make ScmBlockLocationProtocol message type based.

Closes #984

HDFS-14135. TestWebHdfsTimeouts Fails intermittently in trunk. Contributed by Ayush Saxena.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

(cherry picked from commit 6b8107ad97251267253fa045ba03c4749f95f530)

HDFS-14135. TestWebHdfsTimeouts Fails intermittently in trunk. Contributed by Ayush Saxena.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

HDFS-14135. TestWebHdfsTimeouts Fails intermittently in trunk. Contributed by Ayush Saxena.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

(cherry picked from commit 6b8107ad97251267253fa045ba03c4749f95f530)

HDFS-14135. TestWebHdfsTimeouts Fails intermittently in trunk. Contributed by Ayush Saxena.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

(cherry picked from commit 6b8107ad97251267253fa045ba03c4749f95f530)

HDFS-14303. check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu.

(cherry picked from commit bf63475e7a72ff7346226a7dc8dcb4d6fc534163)

(cherry picked from commit 2ddd9878a03ded8a8c881505a2617a4e63775a5c)

HDFS-14303. check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu.