hadoop-yarn-project

Clone Tools
  • last updated 23 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
YARN-9915: Fix FindBug issue in QueueMetrics. Contributed by Prabhu Joseph.

(cherry picked from commit 83d148074f9299de02d5c896a3ed4e11292cba73)

YARN-9915: Fix FindBug issue in QueueMetrics. Contributed by Prabhu Joseph.

(cherry picked from commit 83d148074f9299de02d5c896a3ed4e11292cba73)

YARN-9915: Fix FindBug issue in QueueMetrics. Contributed by Prabhu Joseph.

YARN-9922. Fixed YARN javadoc errors from YARN-9699. Contributed by Peter Bacsko

YARN-9875. Improve fair scheduler configuration store on HDFS. Contributed by Prabhu Joseph

YARN-9884. Make container-executor mount logic modular Contributed by Eric Badger

HADOOP-16579. Upgrade to Curator 4.2.0 and ZooKeeper 3.5.5 (#1656). Contributed by Norbert Kalmár, Mate Szalay-Beko

* HADOOP-16579 - Upgrade to Apache Curator 4.2.0 and ZooKeeper 3.5.5

- Add a static initializer for the unit tests using ZooKeeper to enable

the four-letter-words diagnostic telnet commands. (this is an interface

that become disabled by default, so to keep the ZooKeeper 3.4.x behavior

we enabled it for the tests)

- Also fix ZKFailoverController to look for relevant fail-over ActiveAttempt

records. The new ZooKeeper seems to respond quicker during the fail-over

tests than the ZooKeeper, so we made sure to catch all the relevant records

by adding a new parameter to ZKFailoverontroller.waitForActiveAttempt().

Co-authored-by: Norbert Kalmár <nkalmar@cloudera.com>

  1. … 9 more files in changeset.
YARN-9841. Capacity scheduler: add support for combined %user + %primary_group mapping. Contributed by Manikandan R

HADOOP-16152. Upgrade Eclipse Jetty version to 9.4.x. Contributed by Yuming Wang, Siyao Meng.

Co-authored-By: Siyao Meng <smeng@cloudera.com>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

  1. … 9 more files in changeset.
YARN-9909. Offline format of YarnConfigurationStore. Contributed by Prabhu Joseph.

YARN-9773: Add QueueMetrics for Custom Resources. Contributed by Manikandan R.

YARN-9773: Add QueueMetrics for Custom Resources. Contributed by Manikandan R.

(cherry picked from commit a5034c7988b6bf54bb7dab208100a2d205e3929e)

YARN-9773: Add QueueMetrics for Custom Resources. Contributed by Manikandan R.

(cherry picked from commit a5034c7988b6bf54bb7dab208100a2d205e3929e)

YARN-9900. Revert to previous state when Invalid Config is applied and Refresh Support in SchedulerConfig Format. Contributed by Prabhu Joseph.

(cherry picked from commit 090f73a9aaeb4c03032a78c0a837478b527c27e0)

YARN-9900. Revert to previous state when Invalid Config is applied and Refresh Support in SchedulerConfig Format. Contributed by Prabhu Joseph.

Update version to 2.10.0

    • -2
    • +2
    ./hadoop-yarn/hadoop-yarn-client/pom.xml
    • -2
    • +2
    ./hadoop-yarn/hadoop-yarn-common/pom.xml
    • -2
    • +2
    ./hadoop-yarn/hadoop-yarn-registry/pom.xml
  1. … 69 more files in changeset.
Preparing for 2.10.1 development

    • -2
    • +2
    ./hadoop-yarn/hadoop-yarn-client/pom.xml
    • -2
    • +2
    ./hadoop-yarn/hadoop-yarn-common/pom.xml
    • -2
    • +2
    ./hadoop-yarn/hadoop-yarn-registry/pom.xml
  1. … 69 more files in changeset.
Preparing for 2.11.0 development

    • -2
    • +2
    ./hadoop-yarn/hadoop-yarn-client/pom.xml
    • -2
    • +2
    ./hadoop-yarn/hadoop-yarn-common/pom.xml
    • -2
    • +2
    ./hadoop-yarn/hadoop-yarn-registry/pom.xml
  1. … 69 more files in changeset.
YARN-9840. Capacity scheduler: add support for Secondary Group rule mapping. Contributed by Manikandan R

YARN-8453. Additional Unit tests to verify queue limit and max-limit with multiple resource types. Contributed by Adam Antal

YARN-8453. Additional Unit tests to verify queue limit and max-limit with multiple resource types. Contributed by Adam Antal

YARN-9699. Migration tool that help to generate CS config based on FS config [Phase 1]. Contributed by Peter Bacsko

  1. … 20 more files in changeset.
YARN-8453. Additional Unit tests to verify queue limit and max-limit with multiple resource types. Contributed by Adam Antal

YARN-9860. Enable service mode for Docker containers on YARN Contributed by Prabhu Joseph and Shane Kumpf

YARN-7243. Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager. (#1634)

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

(cherry picked from commit e40e2d6ad5cbe782c3a067229270738b501ed27e)

Conflicts:

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/AbstractYarnScheduler.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/volume/csi/VolumeManagerImpl.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/volume/csi/lifecycle/VolumeImpl.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/ApplicationMasterServiceTestBase.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestApplicationMasterLauncher.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestApplicationMasterServiceInterceptor.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestResourceManager.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/TestRMAppTransitions.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairSchedulerConfiguration.java

  1. … 192 more files in changeset.
Revert "YARN-9128. Use SerializationUtils from apache commons to serialize / deserialize ResourceMappings. Contributed by Zoltan Siegl"

This reverts commit 73bc8ef9b86cb9b3ee9bbc1786b49600e0ee600d.

Revert "YARN-9128. Use SerializationUtils from apache commons to serialize / deserialize ResourceMappings. Contributed by Zoltan Siegl"

This reverts commit 42177e8b786efd7fa1365b68617382de022a5146.

YARN-9552. FairScheduler: NODE_UPDATE can cause NoSuchElementException. Contributed by Peter Bacsko.

YARN-9552. FairScheduler: NODE_UPDATE can cause NoSuchElementException. Contributed by Peter Bacsko.

YARN-9128. Use SerializationUtils from apache commons to serialize / deserialize ResourceMappings. Contributed by Zoltan Siegl

(cherry picked from commit 6f1ab9516869dbfdee034f4a17bccc379a39fc31)