Clone Tools
  • last updated 18 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
SUBMARINE-57. Add more elaborate message if submarine command is not recognized. Contributed by Adam Antal

(cherry picked from commit e5f4cd0fdae7e689789dd74bfbcfa6c52895f037)

SUBMARINE-1. Move code base of submarine from yarn-applications to top directory. Contributed by Wangda Tan.

  1. … 158 more files in changeset.
YARN-9116. Capacity Scheduler: implements queue level maximum-allocation inheritance. Contributed by Aihua Xu.

  1. … 10 more files in changeset.
YARN-8489. Support "dominant" component concept in YARN service. Contributed by Zac Zhou

  1. … 7 more files in changeset.
YARN-9141. [Submarine] JobStatus outputs with system UTC clock, not local clock. (Zac Zhou via wangda)

Change-Id: Ib2b17cf7860ddc9188f06498086de3326bc09519

YARN-9141. [Submarine] JobStatus outputs with system UTC clock, not local clock. (Zac Zhou via wangda)

Change-Id: Ib2b17cf7860ddc9188f06498086de3326bc09519

(cherry picked from commit 8f004fe4e0d479e26d0063427566edc1606bced5)

YARN-9112. [Submarine] Support polling applicationId when it's not ready in cluster. (Zhankun Tang via wangda)

Change-Id: I73d73f3d631b28fb9866faa56571839b13824a97

YARN-9112. [Submarine] Support polling applicationId when it's not ready in cluster. (Zhankun Tang via wangda)

Change-Id: I73d73f3d631b28fb9866faa56571839b13824a97

(cherry picked from commit 9fba6cc2471db8df9ca6da7b9df378e3072dfeb2)

YARN-8714. [Submarine] Support files/tarballs to be localized for a training job. (Zhankun Tang via wangda)

Change-Id: I845131273e52a9d81dbc813ea6d4af06b205e334

(cherry picked from commit c771fe6e10bd3f8533a01026de3c33db2a983cf4)

  1. … 4 more files in changeset.
YARN-8714. [Submarine] Support files/tarballs to be localized for a training job. (Zhankun Tang via wangda)

Change-Id: I845131273e52a9d81dbc813ea6d4af06b205e334

  1. … 4 more files in changeset.
YARN-9078. [Submarine] Clean up the code of CliUtils#parseResourcesString. (Zhankun Tang via wangda)

Change-Id: I21ac5757b6115d55ec3157ba25db1b65bc85a37b

YARN-8975. [Submarine] Use predefined Charset object StandardCharsets.UTF_8 instead of String UTF-8. (Zhankun Tang via wangda)

Change-Id: If6c7904aa17895e543cfca245264249eb7328bdc

YARN-8960. [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment. (Zac Zhou via wangda)

Change-Id: I21b1addc9c32817650ea744a8f2e6b5602f2f4d4

  1. … 1 more file in changeset.
YARN-8960. [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment. (Zac Zhou via wangda)

Change-Id: I21b1addc9c32817650ea744a8f2e6b5602f2f4d4

(cherry picked from commit 8b2381441558cd49b4c940b0760c8accbb2a5567)

  1. … 1 more file in changeset.
YARN-9001. [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs. (Zac Zhou via wangda)

Change-Id: I7e8d1c27ebd37e0907ca570c4f3d56fe7a859635

  1. … 3 more files in changeset.
YARN-9001. [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs. (Zac Zhou via wangda)

Change-Id: Ic3d6c1e439df9cdf74448b345b925343224efe51

  1. … 3 more files in changeset.
YARN-8918. [Submarine] Correct method usage of str.subString in CliUtils. (Zhankun Tang via wangda)

Change-Id: Id1f11dbab3aa838dee3a0ec8b8fd5dc32f5dd946

(cherry picked from commit 076b795b2e82d7f89cc91e0a8513c7081ee8b930)

YARN-8918. [Submarine] Correct method usage of str.subString in CliUtils. (Zhankun Tang via wangda)

Change-Id: Id1f11dbab3aa838dee3a0ec8b8fd5dc32f5dd946

YARN-8997. [Submarine] Small refactors of modifier, condition check and redundant local variables. Contributed by Zhankun Tang.

YARN-8798. [Submarine] Job should not be submitted if --input_path option is missing. (Zhankun Tang via wangda)

Change-Id: I7ae0e44eb5179b04a6ac861ec1c65f3b18c38f0f

(cherry picked from commit 143d74775b2b62884090fdd88874134b9eab2888)

  1. … 1 more file in changeset.
YARN-8798. [Submarine] Job should not be submitted if --input_path option is missing. (Zhankun Tang via wangda)

Change-Id: I7ae0e44eb5179b04a6ac861ec1c65f3b18c38f0f

  1. … 1 more file in changeset.
YARN-8800. Updated documentation of Submarine with latest examples. Contributed by Wangda Tan.

    • -0
    • +69
    ./docker/base/ubuntu-16.04/Dockerfile.cpu.tf_1.8.0
    • -0
    • +67
    ./docker/base/ubuntu-16.04/Dockerfile.gpu.tf_1.8.0
    • -0
    • +32
    ./docker/build-all.sh
    • -0
    • +120
    ./docker/zeppelin-notebook-example/shiro.ini
  1. … 17 more files in changeset.
YARN-8819. Fix findbugs warnings in YarnServiceUtils

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

YARN-8819. Fix findbugs warnings in YarnServiceUtils

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

(cherry picked from commit b85ee0d75d450f1c695cec1bebac627f66a97c98)

YARN-8817. [Submarine] In cases when user doesn't ask HDFS path while submitting job but framework requires user to set HDFS related environments. Contributed by Wangda Tan.

YARN-8769. [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job. Contributed by Wangda Tan.

  1. … 1 more file in changeset.
YARN-8757. [Submarine] Add Tensorboard component when --tensorboard is specified. Contributed by Wangda Tan.

  1. … 2 more files in changeset.
YARN-8698. [Submarine] Failed to reset Hadoop home environment when submitting a submarine job. (Zac Zhou via wangda)

Change-Id: If7fdc11fcc4e49bed2186ded76cd69164f34f502

YARN-8561. [Submarine] Initial implementation: Training job submission and job history retrieval. Contributed by Wangda Tan.

    • -0
    • +106
    ./java/org/apache/hadoop/yarn/submarine/client/cli/Cli.java
    • -0
    • +27
    ./java/org/apache/hadoop/yarn/submarine/common/Envs.java
  1. … 35 more files in changeset.