Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
YARN-9879. Allow multiple leaf queues with the same name in CapacityScheduler. Contributed by Gergely Pollak.

    • -1
    • +2
    ./capacity/CapacitySchedulerPreemptionUtils.java
    • -2
    • +4
    ./capacity/FifoIntraQueuePreemptionPlugin.java
    • -4
    • +4
    ./capacity/ProportionalCapacityPreemptionPolicy.java
  1. … 66 more files in changeset.
YARN-8292. Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative. Contributed by Wangda Tan and Eric Payne

    • -9
    • +35
    ./capacity/AbstractPreemptableResourceCalculator.java
    • -7
    • +55
    ./capacity/CapacitySchedulerPreemptionUtils.java
    • -4
    • +4
    ./capacity/FifoCandidatesSelector.java
    • -2
    • +2
    ./capacity/FifoIntraQueuePreemptionPlugin.java
    • -1
    • +1
    ./capacity/IntraQueueCandidatesSelector.java
    • -4
    • +2
    ./capacity/PreemptableResourceCalculator.java
  1. … 8 more files in changeset.
Revert "YARN-7411. Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee. (Sunil G via wangda)"

Pulling this back into branch-2 prevented nodemanagers from coming up if extended resources are present.

This reverts commit 5e14cddab5164cc2c027323e7dd2ba47aa0b738a.

    • -21
    • +3
    ./capacity/AbstractPreemptableResourceCalculator.java
  1. … 7 more files in changeset.
Revert "YARN-7411. Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee. (Sunil G via wangda)"

Pulling this back into branch-2 prevented nodemanagers from coming up if extended resources are present.

This reverts commit ab83765a6c587f8378daed741f7d05598d076188.

    • -21
    • +3
    ./capacity/AbstractPreemptableResourceCalculator.java
  1. … 7 more files in changeset.
YARN-7243. Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager. (#1634)

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

(cherry picked from commit e40e2d6ad5cbe782c3a067229270738b501ed27e)

Conflicts:

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/AbstractYarnScheduler.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/CapacityScheduler.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/LeafQueue.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/volume/csi/VolumeManagerImpl.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/volume/csi/lifecycle/VolumeImpl.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/ApplicationMasterServiceTestBase.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestApplicationMasterLauncher.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestApplicationMasterServiceInterceptor.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestResourceManager.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/rmapp/TestRMAppTransitions.java

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairSchedulerConfiguration.java

    • -4
    • +4
    ./capacity/FifoCandidatesSelector.java
    • -5
    • +5
    ./capacity/FifoIntraQueuePreemptionPlugin.java
    • -4
    • +4
    ./capacity/IntraQueueCandidatesSelector.java
    • -8
    • +5
    ./capacity/PreemptableResourceCalculator.java
    • -4
    • +4
    ./capacity/ProportionalCapacityPreemptionPolicy.java
    • -4
    • +4
    ./capacity/QueuePriorityContainerCandidateSelector.java
    • -4
    • +4
    ./capacity/ReservedContainerCandidatesSelector.java
  1. … 198 more files in changeset.
YARN-9349. Changed logging to use slf4j api. Contributed by Prabhu Joseph

    • -4
    • +2
    ./capacity/FifoCandidatesSelector.java
    • -7
    • +3
    ./capacity/FifoIntraQueuePreemptionPlugin.java
    • -17
    • +9
    ./capacity/IntraQueueCandidatesSelector.java
    • -8
    • +4
    ./capacity/PreemptableResourceCalculator.java
    • -5
    • +3
    ./capacity/ProportionalCapacityPreemptionPolicy.java
    • -18
    • +8
    ./capacity/QueuePriorityContainerCandidateSelector.java
    • -9
    • +6
    ./capacity/ReservedContainerCandidatesSelector.java
  1. … 161 more files in changeset.
YARN-9341. Fixed enentrant lock usage in YARN project. Contributed by Prabhu Joseph

    • -1
    • +1
    ./capacity/FifoCandidatesSelector.java
    • -1
    • +1
    ./capacity/IntraQueueCandidatesSelector.java
    • -3
    • +2
    ./capacity/ProportionalCapacityPreemptionPolicy.java
  1. … 49 more files in changeset.
YARN-7243. Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager.

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

    • -4
    • +4
    ./capacity/FifoCandidatesSelector.java
    • -5
    • +5
    ./capacity/FifoIntraQueuePreemptionPlugin.java
    • -4
    • +4
    ./capacity/IntraQueueCandidatesSelector.java
    • -8
    • +5
    ./capacity/PreemptableResourceCalculator.java
    • -4
    • +4
    ./capacity/ProportionalCapacityPreemptionPolicy.java
    • -4
    • +4
    ./capacity/QueuePriorityContainerCandidateSelector.java
    • -4
    • +4
    ./capacity/ReservedContainerCandidatesSelector.java
  1. … 202 more files in changeset.
YARN-9287. Consecutive StringBuilder append should be reuse. Contributed by Ayush Saxena.

    • -3
    • +3
    ./invariants/MetricsInvariantChecker.java
  1. … 74 more files in changeset.
YARN-9037. [CSI] Ignore volume resource in resource calculators based on tags. Contributed by Sunil Govindan.

    • -1
    • +1
    ./capacity/AbstractPreemptableResourceCalculator.java
  1. … 13 more files in changeset.
YARN-8709: CS preemption monitor always fails since one under-served queue was deleted. Contributed by Tao Yang.

(cherry picked from commit 987d8191ad409298570f7ef981e9bc8fb72ff16c)

    • -0
    • +3
    ./capacity/ProportionalCapacityPreemptionPolicy.java
  1. … 2 more files in changeset.
YARN-8709: CS preemption monitor always fails since one under-served queue was deleted. Contributed by Tao Yang.

    • -0
    • +3
    ./capacity/ProportionalCapacityPreemptionPolicy.java
  1. … 2 more files in changeset.
YARN-8709: CS preemption monitor always fails since one under-served queue was deleted. Contributed by Tao Yang.

(cherry picked from commit 987d8191ad409298570f7ef981e9bc8fb72ff16c)

    • -0
    • +3
    ./capacity/ProportionalCapacityPreemptionPolicy.java
  1. … 2 more files in changeset.
YARN-8709: CS preemption monitor always fails since one under-served queue was deleted. Contributed by Tao Yang.

(cherry picked from commit 987d8191ad409298570f7ef981e9bc8fb72ff16c)

    • -0
    • +3
    ./capacity/ProportionalCapacityPreemptionPolicy.java
  1. … 2 more files in changeset.
YARN-8709: CS preemption monitor always fails since one under-served queue was deleted. Contributed by Tao Yang.

(cherry picked from commit 987d8191ad409298570f7ef981e9bc8fb72ff16c)

    • -0
    • +3
    ./capacity/ProportionalCapacityPreemptionPolicy.java
  1. … 2 more files in changeset.
YARN-8379. Improve balancing resources in already satisfied queues by using Capacity Scheduler preemption. Contributed by Zian Chen.

    • -3
    • +18
    ./capacity/AbstractPreemptableResourceCalculator.java
    • -0
    • +2
    ./capacity/CapacitySchedulerPreemptionContext.java
    • -7
    • +16
    ./capacity/CapacitySchedulerPreemptionUtils.java
    • -15
    • +30
    ./capacity/FifoCandidatesSelector.java
    • -4
    • +5
    ./capacity/IntraQueueCandidatesSelector.java
    • -2
    • +5
    ./capacity/PreemptableResourceCalculator.java
    • -0
    • +11
    ./capacity/PreemptionCandidatesSelector.java
    • -37
    • +92
    ./capacity/ProportionalCapacityPreemptionPolicy.java
    • -10
    • +6
    ./capacity/QueuePriorityContainerCandidateSelector.java
    • -10
    • +6
    ./capacity/ReservedContainerCandidatesSelector.java
  1. … 4 more files in changeset.
YARN-8379. Improve balancing resources in already satisfied queues by using Capacity Scheduler preemption. Contributed by Zian Chen.

(cherry picked from commit 291194302cc1a875d6d94ea93cf1184a3f1fc2cc)

    • -3
    • +18
    ./capacity/AbstractPreemptableResourceCalculator.java
    • -0
    • +2
    ./capacity/CapacitySchedulerPreemptionContext.java
    • -7
    • +16
    ./capacity/CapacitySchedulerPreemptionUtils.java
    • -15
    • +30
    ./capacity/FifoCandidatesSelector.java
    • -4
    • +5
    ./capacity/IntraQueueCandidatesSelector.java
    • -2
    • +5
    ./capacity/PreemptableResourceCalculator.java
    • -0
    • +11
    ./capacity/PreemptionCandidatesSelector.java
    • -37
    • +92
    ./capacity/ProportionalCapacityPreemptionPolicy.java
    • -10
    • +6
    ./capacity/QueuePriorityContainerCandidateSelector.java
    • -10
    • +6
    ./capacity/ReservedContainerCandidatesSelector.java
  1. … 4 more files in changeset.
YARN-8363. Upgrade commons-lang version to 3.7 in hadoop-yarn-project. Contributed by Takanobu Asanuma.

    • -1
    • +1
    ./capacity/ProportionalCapacityPreemptionPolicy.java
  1. … 116 more files in changeset.
YARN-4781. Support intra-queue preemption for fairness ordering policy. Contributed by Eric Payne.

(cherry picked from commit d47a525163808272686f6325451a9281e01978c6)

    • -7
    • +30
    ./capacity/FifoIntraQueuePreemptionPlugin.java
    • -0
    • +40
    ./capacity/IntraQueueCandidatesSelector.java
  1. … 3 more files in changeset.
YARN-4781. Support intra-queue preemption for fairness ordering policy. Contributed by Eric Payne.

(cherry picked from commit d47a525163808272686f6325451a9281e01978c6)

    • -7
    • +30
    ./capacity/FifoIntraQueuePreemptionPlugin.java
    • -0
    • +40
    ./capacity/IntraQueueCandidatesSelector.java
  1. … 3 more files in changeset.
YARN-4781. Support intra-queue preemption for fairness ordering policy. Contributed by Eric Payne.

    • -7
    • +30
    ./capacity/FifoIntraQueuePreemptionPlugin.java
    • -0
    • +40
    ./capacity/IntraQueueCandidatesSelector.java
  1. … 3 more files in changeset.
YARN-8369. Javadoc build failed due to 'bad use of >'. (Takanobu Asanuma via wangda)

Change-Id: I79a42154e8f86ab1c3cc939b3745024b8eebe5f4

(cherry picked from commit 17aa40f669f197d43387d67dc00040d14cd00948)

    • -4
    • +4
    ./capacity/CapacitySchedulerPreemptionUtils.java
  1. … 1 more file in changeset.
YARN-8369. Javadoc build failed due to 'bad use of >'. (Takanobu Asanuma via wangda)

Change-Id: I79a42154e8f86ab1c3cc939b3745024b8eebe5f4

    • -4
    • +4
    ./capacity/CapacitySchedulerPreemptionUtils.java
  1. … 1 more file in changeset.
YARN-4781. Support intra-queue preemption for fairness ordering policy. Contributed by Eric Payne.

(cherry picked from commit 7c343669baf660df3b70d58987d6e68aec54d6fa)

    • -7
    • +30
    ./capacity/FifoIntraQueuePreemptionPlugin.java
    • -0
    • +40
    ./capacity/IntraQueueCandidatesSelector.java
  1. … 3 more files in changeset.
YARN-4781. Support intra-queue preemption for fairness ordering policy. Contributed by Eric Payne.

    • -7
    • +30
    ./capacity/FifoIntraQueuePreemptionPlugin.java
    • -0
    • +40
    ./capacity/IntraQueueCandidatesSelector.java
  1. … 3 more files in changeset.
YARN-4781. Support intra-queue preemption for fairness ordering policy. Contributed by Eric Payne.

(cherry picked from commit 7c343669baf660df3b70d58987d6e68aec54d6fa)

    • -7
    • +30
    ./capacity/FifoIntraQueuePreemptionPlugin.java
    • -0
    • +40
    ./capacity/IntraQueueCandidatesSelector.java
  1. … 3 more files in changeset.
YARN-8292: Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative. Contributed by Wangda Tan.

    • -17
    • +41
    ./capacity/AbstractPreemptableResourceCalculator.java
    • -7
    • +54
    ./capacity/CapacitySchedulerPreemptionUtils.java
    • -4
    • +4
    ./capacity/FifoCandidatesSelector.java
    • -2
    • +2
    ./capacity/FifoIntraQueuePreemptionPlugin.java
    • -1
    • +1
    ./capacity/IntraQueueCandidatesSelector.java
    • -4
    • +2
    ./capacity/PreemptableResourceCalculator.java
  1. … 7 more files in changeset.
YARN-8292: Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative. Contributed by Wangda Tan.

(cherry picked from commit 8d5509c68156faaa6641f4e747fc9ff80adccf88)

    • -17
    • +41
    ./capacity/AbstractPreemptableResourceCalculator.java
    • -7
    • +54
    ./capacity/CapacitySchedulerPreemptionUtils.java
    • -4
    • +4
    ./capacity/FifoCandidatesSelector.java
    • -2
    • +2
    ./capacity/FifoIntraQueuePreemptionPlugin.java
    • -1
    • +1
    ./capacity/IntraQueueCandidatesSelector.java
    • -4
    • +2
    ./capacity/PreemptableResourceCalculator.java
  1. … 7 more files in changeset.
YARN-8179: Preemption does not happen due to natural_termination_factor when DRF is used. Contributed by Kyungwan Nam.

(cherry picked from commit 0b4c44bdeef62945b592d5761666ad026b629c0b)

    • -2
    • +5
    ./capacity/PreemptableResourceCalculator.java
  1. … 1 more file in changeset.
YARN-8179: Preemption does not happen due to natural_termination_factor when DRF is used. Contributed by Kyungwan Nam.

(cherry picked from commit 0b4c44bdeef62945b592d5761666ad026b629c0b)

    • -2
    • +5
    ./capacity/PreemptableResourceCalculator.java
  1. … 1 more file in changeset.