Clone Tools
  • last updated 13 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
MAPREDUCE-7225: Fix broken current folder expansion during MR job start. Contributed by Peter Bacsko.

HADOOP-16213. Update guava to 27.0-jre. Contributed by Gabor Bota.

  1. … 21 more files in changeset.
HADOOP-16213. Update guava to 27.0-jre. Contributed by Gabor Bota.

  1. … 21 more files in changeset.
MAPREDUCE-7214. Remove unused pieces related to `mapreduce.job.userlog.retain.hours`

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

  1. … 3 more files in changeset.
MAPREDUCE-6794. Remove unused properties from TTConfig.java

  1. … 3 more files in changeset.
HADOOP-16212. Update guava to 27.0-jre in hadoop-project branch-3.0. Contributed by Gabor Bota.

  1. … 19 more files in changeset.
MAPREDUCE-7210. Replace `mapreduce.job.counters.limit` with `mapreduce.job.counters.max` in mapred-default.xml

This closes #878

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

    • -2
    • +2
    ./src/main/resources/mapred-default.xml
HADOOP-16331. Fix ASF License check in pom.xml. Contributed by Akira Ajisaka.

Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>

  1. … 69 more files in changeset.
HADOOP-16331. Fix ASF License check in pom.xml. Contributed by Akira Ajisaka.

Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>

  1. … 79 more files in changeset.
HADOOP-16331. Fix ASF License check in pom.xml. Contributed by Akira Ajisaka.

Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>

  1. … 83 more files in changeset.
HADOOP-16331. Fix ASF License check in pom.xml. Contributed by Akira Ajisaka.

Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>

  1. … 96 more files in changeset.
HADOOP-16331. Fix ASF License check in pom.xml. Contributed by Akira Ajisaka.

Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>

  1. … 97 more files in changeset.
HADOOP-16331. Fix ASF License check in pom.xml

Signed-off-by: Takanobu Asanuma <tasanuma@apache.org>

  1. … 135 more files in changeset.
HADOOP-16323. https everywhere in Maven settings.

  1. … 69 more files in changeset.
HADOOP-16323. https everywhere in Maven settings.

  1. … 79 more files in changeset.
HADOOP-16323. https everywhere in Maven settings.

  1. … 83 more files in changeset.
HADOOP-16323. https everywhere in Maven settings.

  1. … 96 more files in changeset.
HADOOP-16323. https everywhere in Maven settings.

  1. … 97 more files in changeset.
HADOOP-16323. https everywhere in Maven settings.

  1. … 135 more files in changeset.
MAPREDUCE-7198. mapreduce.task.timeout=0 configuration used to disable timeout doesn't work.

    • -0
    • +1
    ./src/main/resources/mapred-default.xml
  1. … 2 more files in changeset.
HADOOP-14524. Make CryptoCodec Closeable so it can be cleaned up proactively.

(cherry picked from commit 2afe9722af2fa4c8e870b0dbf1328e31d1f0fec7)

Conflicts:

hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoOutputStream.java

  1. … 8 more files in changeset.
HADOOP-16196. Path Parameterize Comparable.

Author: David Mollitor <david.mollitor@cloudera.com>

(cherry picked from commit 246ab77f281614b2206bfb1dae70a8dec62147a7)

  1. … 1 more file in changeset.
HADOOP-16196. Path Parameterize Comparable.

Author: David Mollitor <david.mollitor@cloudera.com>

  1. … 1 more file in changeset.
YARN-9271. Backport YARN-6927 for resource type support in MapReduce

  1. … 6 more files in changeset.
YARN-9271. Backport YARN-6927 for resource type support in MapReduce

  1. … 6 more files in changeset.
YARN-9271. Backport YARN-6927 for resource type support in MapReduce

  1. … 6 more files in changeset.
YARN-9271. Backport YARN-6927 for resource type support in MapReduce

  1. … 6 more files in changeset.
YARN-9271. Backport YARN-6927 for resource type support in MapReduce

  1. … 6 more files in changeset.
YARN-9271. Backport YARN-6927 for resource type support in MapReduce

  1. … 6 more files in changeset.
HADOOP-15229. Add FileSystem builder-based openFile() API to match createFile(); S3A to implement S3 Select through this API.

The new openFile() API is asynchronous, and implemented across FileSystem and FileContext.

The MapReduce V2 inputs are moved to this API, and you can actually set must/may

options to pass in.

This is more useful for setting things like s3a seek policy than for S3 select,

as the existing input format/record readers can't handle S3 select output where

the stream is shorter than the file length, and splitting plain text is suboptimal.

Future work is needed there.

In the meantime, any/all filesystem connectors are now free to add their own filesystem-specific

configuration parameters which can be set in jobs and used to set filesystem input stream

options (seek policy, retry, encryption secrets, etc).

Contributed by Steve Loughran

  1. … 67 more files in changeset.