hadoop

Clone Tools
  • last updated 24 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Revert "YARN-7411. Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee. (Sunil G via wangda)"

Pulling this back into branch-2 prevented nodemanagers from coming up if extended resources are present.

This reverts commit 5e14cddab5164cc2c027323e7dd2ba47aa0b738a.

HADOOP-15097. AbstractContractDeleteTest::testDeleteNonEmptyDirRecursive with misleading path. Contributed by Xieming Li.

(cherry picked from commit 92c28c100ee1aa414948cd510321ad13cb8639bc)

(cherry picked from commit 81060b341371a79ec0c240c66e252e2af88b4301)

HDFS-14884. Add sanity check that zone key equals feinfo key while setting Xattrs. Contributed by Yuval Degani, Mukul Kumar Singh.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

Co-authored-by: Yuval Degani <ydegani@linkedin.com>

(cherry picked from commit 594307fe21bb0a607104da73b5f677d77e45eafb)

HDFS-14979 Allow Balancer to submit getBlocks calls to Observer Nodes when possible. Contributed by Erik Krogen.

(cherry picked from 586defe7113ed246ed0275bb3833882a3d873d70)

(cherry picked from dec765b329d3947f30273c0e7f0c4eb607ec42c9)

(cherry picked from 5cf36aa2b19aad8677e1a7553ff1f05805f772b7)

(cherry picked from 4d46d9b04e5ff4a6459568b33abf21c597c4c5a6)

HDFS-14958. TestBalancerWithNodeGroup is not using NetworkTopologyWithNodeGroup. Contributed by Jim Brennan.

MAPREDUCE-7208. Tuning TaskRuntimeEstimator. (Ahmed Hussein via jeagles)

Signed-off-by: Jonathan Eagles <jeagles@gmail.com>

(cherry picked from commit c59b1b66a5264c3164ac6c9356b51de9b5349c66)

Add 2.10.0 release notes for HDFS-12943

(cherry picked from commit ef9d12df24c0db76fd37a95551db7920d27d740c)

(cherry picked from commit 9ccfc2d6d3f3819da58ea9f0ff056ed03970a6e1)

(cherry picked from commit f29481f0466350d7bba0f8ec421f51a619607dcd)

(cherry picked from commit fab62a145d70dbdf7f5904187790e1b9479aae4f)

YARN-9945. Fix javadoc in FederationProxyProviderUtil in branch-2

(cherry picked from commit ae3f5d66e4fac859f31a66870e079c91ba8993d9)

Make upstream aware of 2.10.0 release

(cherry picked from commit 7663db59c097c82eeed2df7a91168a4d7123c96b)

(cherry picked from commit 5d2ffcc7aac608746946dc2ed5711549a01a2055)

(cherry picked from commit 4d274f60bc4bf2800477800ec58b2b2c6f4f656e)

(cherry picked from commit 915b79535824285992f466e4aba3ecc6e744c090)

    • -0
    • +113
    /hadoop-mapreduce-project/dev-support/jdiff/Apache_Hadoop_MapReduce_Common_2.10.0.xml
    • -0
    • +27739
    /hadoop-mapreduce-project/dev-support/jdiff/Apache_Hadoop_MapReduce_Core_2.10.0.xml
    • -0
    • +16
    /hadoop-mapreduce-project/dev-support/jdiff/Apache_Hadoop_MapReduce_JobClient_2.10.0.xml
    • -0
    • +1422
    /hadoop-yarn-project/hadoop-yarn/dev-support/jdiff/Apache_Hadoop_YARN_Server_Common_2.10.0.xml
YARN-9914. Use separate configs for free disk space checking for full and not-full disks. Contributed by Jim Brennan

(cherry picked from commit eef34f2d87a75e16b2cca870d99a5e1e28c31d9b)

HDFS-13901. INode access time is ignored because of race between open and rename. Contributed by Jinglun.

(cherry picked from commit a805d80ebe3b1683049119d3d19e8b085141e3cf)

HDFS-14667. Backport [HDFS-14403] "Cost-based FairCallQueue" to branch-2. Contributed by Erik Krogen

HDFS-12749. DN may not send block report to NN after NN restart. Contributed by Xiaoqiao He.

(cherry picked from commit c4e27ef7735acd6f91b73d2ecb0227f8dd75a2e4)

HADOOP-16662. Remove unnecessary InnerNode check in NetworkTopology#add(). Contributed by Lisheng Sun.

HADOOP-16655. Change cipher suite when fetching tomcat tarball for branch-2

Preparing for 2.10.1 development

    • -2
    • +2
    /hadoop-common-project/hadoop-kms/pom.xml
    • -2
    • +2
    /hadoop-common-project/hadoop-nfs/pom.xml
  1. … 69 more files in changeset.
HDFS-14509. DN throws InvalidToken due to inequality of password when upgrade NN 2.x to 3.x. Contributed by Yuxuan Wang and Konstantin Shvachko.

HDFS-14162. [SBN read] Allow Balancer to work with Observer node. Add a new ProxyCombiner allowing for multiple related protocols to be combined. Allow AlignmentContext to be passed in NameNodeProxyFactory. Contributed by Erik Krogen.

HADOOP-16630 : Backport of Hadoop-16548 : Disable Flush() over config

YARN-9760. Support configuring application priorities on a workflow level. Contributed by Varun Saxena

HDFS-14655. [SBN Read] Namenode crashes if one of The JN is down. Contributed by Ayush Saxena.

HDFS-12979. StandbyNode should upload FsImage to ObserverNode after checkpointing. Contributed by Chen Liang.

HADOOP-16588. Update commons-beanutils version to 1.9.4 in branch-2. Contributed by Wei-Chiu Chuang and Jonathan Hung.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

HDFS-14858. [SBN read] Allow configurably enable/disable AlignmentContext on NameNode. Contributed by Chen Liang.

HADOOP-16578 : Avoid FileSystem API calls when FileSystem already exists

YARN-9858. Optimize RMContext getExclusiveEnforcedPartitions. Contributed by Jonathan Hung.

HDFS-14305. Fix serial number calculation in BlockTokenSecretManager to avoid token key ID overlap between NameNodes. Contributed by Konstantin V Shvachko.

HDFS-14853. Addendum: NPE in DFSNetworkTopology#chooseRandomWithStorageType() when the excludedNode is not present. Contributed by Ranith Sardar.

HDFS-14785. [SBN read] Change client logging to be less aggressive. Contributed by Chen Liang.

Addendum to YARN-9730. Support forcing configured partitions to be exclusive based on app node label

(cherry picked from commit d86a1acc866cbda845fb3896dc824baf12217383)

(cherry picked from commit f4f210d2e57e49999579efb7db039cc623798267)

(cherry picked from commit 95ec7050b55490454e1de894da572a7e25374907)