hadoop

Clone Tools
  • last updated 29 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HDFS-13371. NPE for FsServerDefaults.getKeyProviderUri() for clientProtocol communication between 2.7 and 3.X. Contributed by Sherwood Zheng.

Merge pull request #977 from leosunli/trunk

HDFS-14541. When evictableMmapped or evictable size is zero, do not throw NoSuchElementException.

HDFS-14598. Findbugs warning caused by HDFS-12487. Contributed by He Xiaoqiao.

(cherry picked from commit 041e7a7dee4a17714f31952dc6364c77a65b1b73)

HDFS-14598. Findbugs warning caused by HDFS-12487. Contributed by He Xiaoqiao.

(cherry picked from commit 041e7a7dee4a17714f31952dc6364c77a65b1b73)

(cherry picked from commit e7fce2104f28c48c817822bed9349d44b0694699)

HDFS-14598. Findbugs warning caused by HDFS-12487. Contributed by He Xiaoqiao.

HDDS-1646. Support real persistence in the k8s example files (#945)

* HDDS-1646. Support real persistence in the k8s example files

* ephemeral clusters can be scaled up

  1. … 34 more files in changeset.
HDDS-1597. Remove hdds-server-scm dependency from ozone-common (#969)

* HDDS-1597. Remove hdds-server-scm dependency from ozone-common. Contributed by Elek, Marton.

* checkstyle fixes

* revert the import reorder of HddsUtil

* add javadoc

* switch back to the commons-lang2

* fix typo

* fix metrics core classpath problem (+rebase fix)

    • -6
    • +4
    /hadoop-hdds/container-service/pom.xml
    • -0
    • +9
    /hadoop-ozone/integration-test/pom.xml
HADOOP-16350. Ability to tell HDFS client not to request KMS Information from NameNode. Ccontributed by Greg Senia, Ajay Kumar.

YARN-9374. Improve Timeline service resilience when HBase is unavailable. Contributed by Prabhu Joseph and Szilard Nemeth

YARN-9374. Improve Timeline service resilience when HBase is unavailable. Contributed by Prabhu Joseph and Szilard Nemeth

HDDS-1719 : Increase ratis log segment size to 1MB. (#1005)

* HDDS-1719 : Increase ratis log segment size to 1MB.

* HDDS-1719 : Increase ratis log segment size to 1MB.

HDFS-14339. Inconsistent log level practices in RpcProgramNfs3.java. Contributed by Anuhan Torgonshar.

HDFS-12914. Block report leases cause missing blocks until next report. Contributed by Santosh Marella, He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Co-authored-by: He Xiaoqiao <hexiaoqiao@apache.org>

(cherry picked from commit 026cc2647d4e3c1cffdd154995a5f1f07956c2a0)

HDFS-12914. Block report leases cause missing blocks until next report. Contributed by Santosh Marella, He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Co-authored-by: He Xiaoqiao <hexiaoqiao@apache.org>

HDDS-1706. Replication Manager thread running too frequently. Contributed by Nilotpal Nandi.

HDFS-14074. DataNode runs async disk checks maybe throws NullPointerException, and DataNode failed to register to NameSpace. Contributed by guangyi lu.

(cherry picked from commit 645d67bc4f4e29d10ef810386c89e6a7c8c61862)

HDFS-14074. DataNode runs async disk checks maybe throws NullPointerException, and DataNode failed to register to NameSpace. Contributed by guangyi lu.

HDFS-14074. DataNode runs async disk checks maybe throws NullPointerException, and DataNode failed to register to NameSpace. Contributed by guangyi lu.

(cherry picked from commit 645d67bc4f4e29d10ef810386c89e6a7c8c61862)

(cherry picked from commit d5ecca1d4ca2b567167402bf8745fb2417bbf624)

HDFS-12487. FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers. Contributed by liumi.

(cherry picked from commit 1524e2e6c52aba966cbbf1d8025ba165688ab9bb)

HDFS-12487. FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers. Contributed by liumi.

(cherry picked from commit 1524e2e6c52aba966cbbf1d8025ba165688ab9bb)

(cherry picked from commit 845d7611babac68a2b0caa6e4b8963f0c8332540)

HDFS-12487. FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers. Contributed by liumi.

HADOOP-15989. Synchronized at CompositeService#removeService is not required. Contributed by Prabhu Joseph.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDDS-1690. ContainerController should provide a way to retrieve containers per volume (#986)

HDDS-1715. Update the Intellij runner definitition of SCM to use the new class name

Closes #1000

HDDS-1678. Default image name for kubernetes examples should be ozone and not hadoop

Closes #959

YARN-9209. When nodePartition is not set in Placement Constraints, containers are allocated only in default partition. Contributed by Tarun Parimi.

YARN-9209. When nodePartition is not set in Placement Constraints, containers are allocated only in default partition. Contributed by Tarun Parimi.

(cherry picked from commit 83dcb9d87ec75f2be0acb8972f5f0faefe6ffbcd)

HDDS-1674. Make ScmBlockLocationProtocol message type based.

Closes #984

HDFS-14135. TestWebHdfsTimeouts Fails intermittently in trunk. Contributed by Ayush Saxena.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

(cherry picked from commit 6b8107ad97251267253fa045ba03c4749f95f530)

HDFS-14135. TestWebHdfsTimeouts Fails intermittently in trunk. Contributed by Ayush Saxena.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>