Clone Tools
  • last updated 12 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
YARN-9841. Capacity scheduler: add support for combined %user + %primary_group mapping. Contributed by Manikandan R

  1. … 4 more files in changeset.
YARN-9840. Capacity scheduler: add support for Secondary Group rule mapping. Contributed by Manikandan R

    • -0
    • +47
    ./PrimaryGroupMapping.java
  1. … 4 more files in changeset.
YARN-9699. Migration tool that help to generate CS config based on FS config [Phase 1]. Contributed by Peter Bacsko

    • -0
    • +181
    ./converter/FSConfigConverterTestCommons.java
    • -0
    • +379
    ./converter/TestFSConfigToCSConfigArgumentHandler.java
    • -0
    • +460
    ./converter/TestFSConfigToCSConfigConverter.java
    • -0
    • +144
    ./converter/TestFSConfigToCSConfigRuleHandler.java
    • -0
    • +427
    ./converter/TestFSQueueConverter.java
    • -0
    • +141
    ./converter/TestFSYarnSiteConverter.java
  1. … 29 more files in changeset.
YARN-7243. Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager. (#1634)

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

(cherry picked from commit e40e2d6ad5cbe782c3a067229270738b501ed27e)

Conflicts:

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/AbstractYarnScheduler.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/volume/csi/VolumeManagerImpl.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/volume/csi/lifecycle/VolumeImpl.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/ApplicationMasterServiceTestBase.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestApplicationMasterLauncher.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestApplicationMasterServiceInterceptor.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestResourceManager.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/TestRMAppTransitions.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairSchedulerConfiguration.java

    • -4
    • +4
    ./TestApplicationMasterServiceWithFS.java
  1. … 204 more files in changeset.
YARN-9552. FairScheduler: NODE_UPDATE can cause NoSuchElementException. Contributed by Peter Bacsko.

  1. … 2 more files in changeset.
YARN-9552. FairScheduler: NODE_UPDATE can cause NoSuchElementException. Contributed by Peter Bacsko.

  1. … 2 more files in changeset.
YARN-7291. Better input parsing for resource in allocation file. Contributed by Zoltan Siegl

    • -10
    • +95
    ./TestFairSchedulerConfiguration.java
  1. … 1 more file in changeset.
YARN-9552. FairScheduler: NODE_UPDATE can cause NoSuchElementException. Contributed by Peter Bacsko.

  1. … 2 more files in changeset.
YARN-9470. Fix order of actual and expected expression in assert statements

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

  1. … 72 more files in changeset.
YARN-999. In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task. Contributed by Inigo Goiri.

    • -0
    • +46
    ./TestFairSchedulerOvercommit.java
  1. … 14 more files in changeset.
YARN-9431. Fix flaky junit test fair.TestAppRunnability after YARN-8967. Contributed by Wilfred Spiegelenburg.

YARN-8967. Change FairScheduler to use PlacementRule interface. Contributed by Wilfred Spiegelenburg.

    • -62
    • +90
    ./TestAllocationFileLoaderService.java
    • -0
    • +9
    ./TestFairSchedulerWithMultiResourceTypes.java
    • -12
    • +13
    ./TestMaxRunningAppsEnforcer.java
    • -148
    • +367
    ./TestQueuePlacementPolicy.java
  1. … 15 more files in changeset.
YARN-7243. Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager.

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

    • -4
    • +4
    ./TestApplicationMasterServiceWithFS.java
  1. … 208 more files in changeset.
YARN-9323. FSLeafQueue#computeMaxAMResource does not override zero values for custom resources (Contributed by Szilard Nemeth via Daniel Templeton)

Change-Id: Id844ccf09488f367c0c7de0a3b2d4aca1bba31cc

  1. … 4 more files in changeset.
YARN-9322. Store metrics for custom resource types into FSQueueMetrics and query them in FairSchedulerQueueInfo (Contributed by Szilard Nemeth via Daniel Templeton)

Change-Id: I14c12f1265999d62102f2ec5506d90015efeefe8

  1. … 8 more files in changeset.
HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki.

  1. … 333 more files in changeset.
YARN-8833. Avoid potential integer overflow when computing fair shares. Contributed by liyakun.

  1. … 1 more file in changeset.
YARN-8833. Avoid potential integer overflow when computing fair shares. Contributed by liyakun.

(cherry picked from commit c54a689d96d7449a3810178631a08802b33aed79)

  1. … 1 more file in changeset.
YARN-9173. FairShare calculation broken for large values after YARN-8833. Contributed Wilfred Spiegelenburg.

(cherry picked from commit 91e9c9f96eca01bbef7d22b4cff1ced3be1ac5e8)

  1. … 1 more file in changeset.
YARN-9173. FairShare calculation broken for large values after YARN-8833. Contributed Wilfred Spiegelenburg.

  1. … 1 more file in changeset.
YARN-9173. FairShare calculation broken for large values after YARN-8833. Contributed Wilfred Spiegelenburg.

(cherry picked from commit 91e9c9f96eca01bbef7d22b4cff1ced3be1ac5e8)

  1. … 1 more file in changeset.
YARN-9173. FairShare calculation broken for large values after YARN-8833. Contributed by Wilfred Spiegelenburg.

  1. … 1 more file in changeset.
YARN-9173. FairShare calculation broken for large values after YARN-8833. Contributed by Wilfred Spiegelenburg.

(cherry picked from commit 944cf872232d1a8899df0f0bbe90aa29f225cb90)

  1. … 1 more file in changeset.
YARN-9051. Integrate multiple CustomResourceTypesConfigurationProvider implementations into one. (Contributed by Szilard Nemeth)

    • -4
    • +3
    ./TestAllocationFileLoaderService.java
    • -43
    • +15
    ./TestFairSchedulerConfiguration.java
  1. … 13 more files in changeset.
YARN-8738. FairScheduler should not parse negative maxResources or minResources values as positive. (Contributed by Szilard Nemeth)

    • -9
    • +253
    ./TestFairSchedulerConfiguration.java
  1. … 1 more file in changeset.
YARN-9025. TestFairScheduler#testChildMaxResources is flaky. (Contributed by Szilard Nemeth)

YARN-9041. Performance Optimization of method FSPreemptionThread#identifyContainersToPreempt. Contributed by Wanqiang Ji.

    • -52
    • +103
    ./TestFairSchedulerPreemption.java
  1. … 1 more file in changeset.
YARN-8992. Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue. (Contributed by Wilfred Spiegelenburg)

  1. … 4 more files in changeset.
YARN-8833. Avoid potential integer overflow when computing fair shares. Contributed by liyakun.

(cherry picked from commit d027a24f0349b60efa5125c330058f123771748f)

  1. … 1 more file in changeset.
YARN-8833. Avoid potential integer overflow when computing fair shares. Contributed by liyakun.

(cherry picked from commit d027a24f0349b60efa5125c330058f123771748f)

  1. … 1 more file in changeset.