hadoop

Clone Tools
  • last updated 12 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Additional index.md.vm changes prior to 2.10.0 release

    • -1
    • +4
    /hadoop-project/src/site/markdown/index.md.vm
HDFS-14667. Backport [HDFS-14403] "Cost-based FairCallQueue" to branch-2. Contributed by Erik Krogen

HADOOP-16655. Change cipher suite when fetching tomcat tarball for branch-2

Update version to 2.10.0

    • -2
    • +2
    /hadoop-common-project/hadoop-kms/pom.xml
    • -2
    • +2
    /hadoop-common-project/hadoop-nfs/pom.xml
  1. … 69 more files in changeset.
index.md.vm changes prior to 2.10.0 release

    • -30
    • +17
    /hadoop-project/src/site/markdown/index.md.vm
HDFS-14509. DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x. Contributed by Yuxuan Wang and Konstantin Shvachko.

HDFS-14162. [SBN read] Allow Balancer to work with Observer node. Add a new ProxyCombiner allowing for multiple related protocols to be combined. Allow AlignmentContext to be passed in NameNodeProxyFactory. Contributed by Erik Krogen.

HADOOP-16630 : Backport of Hadoop-16548 : Disable Flush() over config

YARN-9760. Support configuring application priorities on a workflow level. Contributed by Varun Saxena

HDFS-14655. [SBN Read] Namenode crashes if one of The JN is down. Contributed by Ayush Saxena.

HDFS-12979. StandbyNode should upload FsImage to ObserverNode after checkpointing. Contributed by Chen Liang.

HADOOP-16588. Update commons-beanutils version to 1.9.4 in branch-2. Contributed by Wei-Chiu Chuang and Jonathan Hung.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

HDFS-14858. [SBN read] Allow configurably enable/disable AlignmentContext on NameNode. Contributed by Chen Liang.

HADOOP-16578 : Avoid FileSystem API calls when FileSystem already exists

YARN-9858. Optimize RMContext getExclusiveEnforcedPartitions. Contributed by Jonathan Hung.

HDFS-14305. Fix serial number calculation in BlockTokenSecretManager to avoid token key ID overlap between NameNodes. Contributed by Konstantin V Shvachko.

HDFS-14853. Addendum: NPE in DFSNetworkTopology#chooseRandomWithStorageType() when the excludedNode is not present. Contributed by Ranith Sardar.

HDFS-14785. [SBN read] Change client logging to be less aggressive. Contributed by Chen Liang.

Addendum to YARN-9730. Support forcing configured partitions to be exclusive based on app node label

(cherry picked from commit d86a1acc866cbda845fb3896dc824baf12217383)

(cherry picked from commit f4f210d2e57e49999579efb7db039cc623798267)

(cherry picked from commit 95ec7050b55490454e1de894da572a7e25374907)

YARN-9730. Support forcing configured partitions to be exclusive based on app node label

(cherry picked from commit 73a044a63822303f792183244e25432528ecfb1e)

(cherry picked from commit dd094d79023f6598e47146166aa8c213e03d41b7)

(cherry picked from commit 10bdcb6f1da3b86146efa479c0bbc8d1da505789)

  1. … 8 more files in changeset.
YARN-9762. Add submission context label to audit logs. Contributed by Manoj Kumar

(cherry picked from commit 3d78b1223d3fdc29d500803cefd2931b54f44928)

(cherry picked from commit a1fa9a8a7f79a1a711cd881b526724b502e03456)

(cherry picked from commit 6a1d2d56bd6b3cd2f535a732cc07a78ea52062f8)

HDFS-14853. NPE in DFSNetworkTopology#chooseRandomWithStorageType() when the excludedNode is not present. Contributed by Ranith Sardar.

HADOOP-16581. Addendum: Remove use of Java 8 functionality. Contributed by Masatake Iwasaki.

HADOOP-16544. update io.netty in branch-2.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

HADOOP-16581. Revise ValueQueue to correctly replenish queues that go below the watermark (#1463)

(cherry picked from dd0834696a694564af65a1355c9d13275f44df51)

(cherry picked from e31594f20ed43670a9ff1463a752d8b8e4b3b6f0)

(cherry picked from b091abc471e4dbeda697732809f0ee3db2622917)

HADOOP-16582. LocalFileSystem's mkdirs() does not work as expected under viewfs. Contributed by Kihwal Lee

(cherry picked from commit d4205dce176287e863f567b333e0d408bf51ae6d)

HDFS-14822. [SBN read] Revisit GlobalStateIdContext locking when getting server state id. Contributed by Chen Liang.

HDFS-13959. TestUpgradeDomainBlockPlacementPolicy is flaky. Contributed by Ayush Saxena.

(cherry picked from commit 1851d06eb3b70f39f3054a7c06f0ad2bc664aaec)

HDFS-14771. Backport HDFS-14617 to branch-2 (Improve fsimage load time by writing sub-sections to the fsimage index). Contributed by He Xiaoqiao and Stephen O'Donnel.

Reviewed-by: Stephen O'Donnell <sodonnell@cloudera.com>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14303. Addendum: check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu.