Clone Tools
  • last updated 27 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
MAPREDUCE-7214. Remove unused pieces related to `mapreduce.job.userlog.retain.hours`

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

    • -2
    • +0
    ./hadoop/mapreduce/util/ConfigUtil.java
  1. … 3 more files in changeset.
MAPREDUCE-6794. Remove unused properties from TTConfig.java

    • -41
    • +0
    ./hadoop/mapreduce/util/ConfigUtil.java
  1. … 3 more files in changeset.
HADOOP-16212. Update guava to 27.0-jre in hadoop-project branch-3.0. Contributed by Gabor Bota.

  1. … 19 more files in changeset.
HADOOP-14524. Make CryptoCodec Closeable so it can be cleaned up proactively.

(cherry picked from commit 2afe9722af2fa4c8e870b0dbf1328e31d1f0fec7)

Conflicts:

hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoOutputStream.java

    • -3
    • +11
    ./hadoop/mapreduce/CryptoUtils.java
  1. … 8 more files in changeset.
HADOOP-16196. Path Parameterize Comparable.

Author: David Mollitor <david.mollitor@cloudera.com>

(cherry picked from commit 246ab77f281614b2206bfb1dae70a8dec62147a7)

  1. … 1 more file in changeset.
HADOOP-16196. Path Parameterize Comparable.

Author: David Mollitor <david.mollitor@cloudera.com>

  1. … 1 more file in changeset.
YARN-9271. Backport YARN-6927 for resource type support in MapReduce

    • -1
    • +67
    ./hadoop/mapreduce/MRJobConfig.java
  1. … 6 more files in changeset.
YARN-9271. Backport YARN-6927 for resource type support in MapReduce

    • -1
    • +67
    ./hadoop/mapreduce/MRJobConfig.java
  1. … 6 more files in changeset.
YARN-9271. Backport YARN-6927 for resource type support in MapReduce

    • -1
    • +67
    ./hadoop/mapreduce/MRJobConfig.java
  1. … 6 more files in changeset.
YARN-9271. Backport YARN-6927 for resource type support in MapReduce

    • -1
    • +67
    ./hadoop/mapreduce/MRJobConfig.java
  1. … 6 more files in changeset.
YARN-9271. Backport YARN-6927 for resource type support in MapReduce

    • -1
    • +67
    ./hadoop/mapreduce/MRJobConfig.java
  1. … 6 more files in changeset.
YARN-9271. Backport YARN-6927 for resource type support in MapReduce

    • -1
    • +67
    ./hadoop/mapreduce/MRJobConfig.java
  1. … 6 more files in changeset.
HADOOP-15229. Add FileSystem builder-based openFile() API to match createFile(); S3A to implement S3 Select through this API.

The new openFile() API is asynchronous, and implemented across FileSystem and FileContext.

The MapReduce V2 inputs are moved to this API, and you can actually set must/may

options to pass in.

This is more useful for setting things like s3a seek policy than for S3 select,

as the existing input format/record readers can't handle S3 select output where

the stream is shorter than the file length, and splitting plain text is suboptimal.

Future work is needed there.

In the meantime, any/all filesystem connectors are now free to add their own filesystem-specific

configuration parameters which can be set in jobs and used to set filesystem input stream

options (seek policy, retry, encryption secrets, etc).

Contributed by Steve Loughran

    • -0
    • +14
    ./hadoop/mapreduce/MRJobConfig.java
  1. … 67 more files in changeset.
HADOOP-14556. S3A to support Delegation Tokens.

Contributed by Steve Loughran and Daryn Sharp.

  1. … 101 more files in changeset.
Revert "HADOOP-14556. S3A to support Delegation Tokens."

This reverts commit d7152332b32a575c3a92e3f4c44b95e58462528d.

  1. … 104 more files in changeset.
HADOOP-14556. S3A to support Delegation Tokens.

Contributed by Steve Loughran.

  1. … 104 more files in changeset.
HADOOP-16210. Update guava to 27.0-jre in hadoop-project trunk. Contributed by Gabor Bota.

  1. … 12 more files in changeset.
MAPREDUCE-7164. FileOutputCommitter does not report progress while merging paths. Contributed by Kuhu Shukla

(cherry picked from commit 4d8de7ab690ef919b392b12d856482a6a1f2bb3d)

  1. … 1 more file in changeset.
MAPREDUCE-7164. FileOutputCommitter does not report progress while merging paths. Contributed by Kuhu Shukla

(cherry picked from commit 4d8de7ab690ef919b392b12d856482a6a1f2bb3d)

  1. … 1 more file in changeset.
MAPREDUCE-7164. FileOutputCommitter does not report progress while merging paths. Contributed by Kuhu Shukla

  1. … 1 more file in changeset.
MAPREDUCE-7164. FileOutputCommitter does not report progress while merging paths. Contributed by Kuhu Shukla

(cherry picked from commit 4d8de7ab690ef919b392b12d856482a6a1f2bb3d)

  1. … 1 more file in changeset.
MAPREDUCE-6190. If a task stucks before its first heartbeat, it never timeouts and the MR job becomes stuck. Contributed by Zhaohui Xin.

  1. … 3 more files in changeset.
MAPREDUCE-7162. TestEvents#testEvents fails. Contributed by Zhaohui Xin.

(cherry picked from commit 1aad99a71813660b83628cacfed393d0b3a123cc)

MAPREDUCE-7162. TestEvents#testEvents fails. Contributed by Zhaohui Xin.

(cherry picked from commit 1aad99a71813660b83628cacfed393d0b3a123cc)

MAPREDUCE-7162. TestEvents#testEvents fails. Contributed by Zhaohui Xin.

MAPREDUCE-7158. Inefficient Flush Logic in JobHistory EventWriter. (Zichen Sun via wangda)

Change-Id: I99ace87980da03bb35a8012cea7218d602a8817a

(cherry picked from commit 762a56cc64bc07d57f94e253920534b8e049f238)

MAPREDUCE-7158. Inefficient Flush Logic in JobHistory EventWriter. (Zichen Sun via wangda)

Change-Id: I99ace87980da03bb35a8012cea7218d602a8817a

(cherry picked from commit 762a56cc64bc07d57f94e253920534b8e049f238)

MAPREDUCE-7158. Inefficient Flush Logic in JobHistory EventWriter. (Zichen Sun via wangda)

Change-Id: I99ace87980da03bb35a8012cea7218d602a8817a

MAPREDUCE-7148. Fast fail jobs when exceeds dfs quota limitation. Contributed by Wang Yan

  1. … 5 more files in changeset.
MAPREDUCE-4669. MRAM web UI does not work with HTTPS. (Contributed by Robert Kanter)

    • -0
    • +22
    ./hadoop/mapreduce/MRJobConfig.java
  1. … 8 more files in changeset.