hadoop

Clone Tools
  • last updated 28 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HDFS-14303. Addendum: check block directory logic not correct when there is only meta file, print no meaning warn log. Contributed by qiang Liu.

HADOOP-16555. Update commons-compress to 1.19. (#1425) Contributed by YiSheng Lien.

(cherry picked from commit 1843c4688a3040c48f6834d166494cbf68b5e4fd)

Conflicts:

LICENSE-binary

(cherry picked from commit d39ebbfebc9da982cadfbe92f3fb6677e744622d)

(cherry picked from commit 7d7b415409901bbb0095af4e9d56aade158c1438)

YARN-9825. Changes for initializing placement rules with ResourceScheduler in branch-2. Contributed by Jonathan Hung.

YARN-9824. Fall back to configured queue ordering policy class name

(cherry picked from commit f8f8598ea5e86330fa5b553963f5632da286409d)

(cherry picked from commit 1dbf87c9ff33b5e2f6cbb0ce8efd348c4314a0e2)

(cherry picked from commit d75693bd6ed4a9547f4932d41014a21de1398115)

HADOOP-16530. Update xercesImpl in branch-2.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

YARN-9820. RM logs InvalidStateTransitionException when app is submitted. Contributed by Prabhu Joseph

YARN-9764. Print application submission context label in application summary. Contributed by Manoj Kumar

YARN-9763. Print application tags in application summary. Contributed by Manoj Kumar

YARN-9761. Allow overriding application submissions based on server side configs. Contributed by Pralabh Kumar

Revert "HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun."

This reverts commit a524608d1e0a276fd822e9574f0a4a6d51298b13.

YARN-9810. Add queue capacity/maxcapacity percentage metrics. Contributed by Shubham Gupta

(cherry picked from commit 0ccf4b0fe16a8c879a560f2a612a3185eb2df72b)

(cherry picked from commit cb806988d72bde1f9837c9e0fb82a3a6c032542c)

(cherry picked from commit 37d1f8c81eeee79b1ef5ce6316afbcdbc76acd8e)

HDFS-14276. [SBN read] Reduce tailing overhead. Contributed by Wei-Chiu Chuang

HADOOP-16439. Upgrade bundled Tomcat in branch-2.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

    • -1
    • +1
    /hadoop-common-project/hadoop-kms/pom.xml
HDFS-14611. Move handshake secret field from Token to BlockAccessToken. Contributed by Chen Liang

YARN-9806. TestNMSimulator#testNMSimulator fails in branch-2

HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun.

(cherry picked from commit 62d71fbac3789c7d484bc76ced9ec7fa6ff94de1)

HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun.

(cherry picked from commit 62d71fbac3789c7d484bc76ced9ec7fa6ff94de1)

HDFS-14726. Fix JN incompatibility issue in branch-2 due to backport of HDFS-10519. Contributed by Chen Liang.

YARN-9756: Create metric that sums total memory/vcores preempted per round. Contributed by Manikandan R (manirajv06).

(cherry picked from commit d562050cec83a2bc2ffb6d109ed3d64b394b870d)

YARN-9438. launchTime not written to state store for running applications

(cherry picked from commit 9568656cd21d9c02168e18ce35c6726077bbf3a1)

(cherry picked from commit 0c498de6e87c6bdc959afa31deb03d0907e0e1a1)

(cherry picked from commit f73842780e3e5daff2db4d30771a194f3bc47d6d)

YARN-9775. RMWebServices /scheduler-conf GET returns all hadoop configurations for ZKConfigurationStore. Contributed by Prabhu Joseph

(cherry picked from commit 8660e48ca15098e891c560beb3181c22ef3f80ff)

(cherry picked from commit e4249c320257586384035ea3fc286fe54cc699a1)

(cherry picked from commit 6baa0d1e4d78c15833257d98bdd2b38806faed9f)

HDFS-13977. NameNode can kill itself if it tries to send too many txns to a QJM simultaneously. Contributed by Erik Krogen.

Revert "HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow."

This reverts commit 8755de108d0e711cbfa784a20bd89e28fe79266b.

HDFS-14311. Multi-threading conflict at layoutVersion when loading block pool storage. Contributed by Yicong Cai.

HDFS-13101. Yet another fsimage corruption related to snapshot. Contributed by Shashikant Banerjee.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14476. lock too long when fix inconsistent blocks between disk and in-memory. Contributed by Sean Chow.

HDFS-14725. Backport HDFS-12914 to branch-2 (Block report leases cause missing blocks until next report). Contributed by He Xiaoqiao.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

YARN-9442. container working directory has group read permissions. Contributed by Jim Brennan.

(cherry picked from commit 2ac029b949f041da2ee04da441c5f9f85e1f2c64)

Conflicts:

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/test/test-container-executor.c

(cherry picked from commit cec71691be76577718b22f936aea9e2b2cd100ea)

Conflicts:

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/native/container-executor/impl/container-executor.c

(cherry picked from commit db88224e8f9d164ac811fcca9efe4a350cebecd1)

Fix JDK7 compatibility in branch-2.

HDFS-13898 Addendum: add a missing test helper method