Clone Tools
  • last updated a few minutes ago
Constraints: committers
Constraints: files
Constraints: dates
MAPREDUCE-7241. FileInputFormat listStatus with less memory footprint. Contributed by Zhihua Deng

Preparing for 3.4.0 development

  1. … 110 more files in changeset.
MAPREDUCE-7237. Supports config the shuffle's path cache related parameters (#1397)

    • -0
    • +23
  1. … 1 more file in changeset.
MAPREDUCE-7255. Fix typo in MapReduce documentaion example (#1793)

    • -1
    • +1
MAPREDUCE-7208. Tuning TaskRuntimeEstimator. (Ahmed Hussein via jeagles)

Signed-off-by: Jonathan Eagles <>

  1. … 10 more files in changeset.
HADOOP-16458. LocatedFileStatusFetcher.getFileStatuses failing intermittently with S3

Contributed by Steve Loughran.


-S3A glob scans don't bother trying to resolve symlinks

-stack traces don't get lost in getFileStatuses() when exceptions are wrapped

-debug level logging of what is up in Globber

-Contains HADOOP-13373. Add S3A implementation of FSMainOperationsBaseTest.

-ITestRestrictedReadAccess tests incomplete read access to files.

This adds a builder API for constructing globbers which other stores can use

so that they too can skip symlink resolution when not needed.

Change-Id: I23bcdb2783d6bd77cf168fdc165b1b4b334d91c7

  1. … 8 more files in changeset.
HADOOP-16549. Remove Unsupported SSL/TLS Versions from Docs/Properties. Contributed by Daisuke Kobayashi.

Signed-off-by: Wei-Chiu Chuang <>

Reviewed-by: Akira Ajisaka <>

    • -1
    • +1
  1. … 2 more files in changeset.
MAPREDUCE-7197. Fix order of actual and expected expression in assert statements. Contributed by Adam Antal

  1. … 68 more files in changeset.
MAPREDUCE-7225: Fix broken current folder expansion during MR job start. Contributed by Peter Bacsko.

MAPREDUCE-7214. Remove unused pieces related to `mapreduce.job.userlog.retain.hours`

Signed-off-by: Akira Ajisaka <>

  1. … 3 more files in changeset.
MAPREDUCE-6794. Remove unused properties from

  1. … 3 more files in changeset.
MAPREDUCE-7210. Replace `mapreduce.job.counters.limit` with `mapreduce.job.counters.max` in mapred-default.xml

This closes #878

Signed-off-by: Akira Ajisaka <>

    • -2
    • +2
HADOOP-16331. Fix ASF License check in pom.xml

Signed-off-by: Takanobu Asanuma <>

  1. … 135 more files in changeset.
HADOOP-16323. https everywhere in Maven settings.

  1. … 135 more files in changeset.
MAPREDUCE-7198. mapreduce.task.timeout=0 configuration used to disable timeout doesn't work.

    • -0
    • +1
  1. … 2 more files in changeset.
HADOOP-16196. Path Parameterize Comparable.

Author: David Mollitor <>

  1. … 1 more file in changeset.
HADOOP-15229. Add FileSystem builder-based openFile() API to match createFile(); S3A to implement S3 Select through this API.

The new openFile() API is asynchronous, and implemented across FileSystem and FileContext.

The MapReduce V2 inputs are moved to this API, and you can actually set must/may

options to pass in.

This is more useful for setting things like s3a seek policy than for S3 select,

as the existing input format/record readers can't handle S3 select output where

the stream is shorter than the file length, and splitting plain text is suboptimal.

Future work is needed there.

In the meantime, any/all filesystem connectors are now free to add their own filesystem-specific

configuration parameters which can be set in jobs and used to set filesystem input stream

options (seek policy, retry, encryption secrets, etc).

Contributed by Steve Loughran

  1. … 67 more files in changeset.
HADOOP-14178. Move Mockito up to version 2.23.4. Contributed by Akira Ajisaka and Masatake Iwasaki.

  1. … 325 more files in changeset.
YARN-9221. Added flag to disable dynamic auxiliary service feature. Contributed by Billie Rinaldi

  1. … 7 more files in changeset.
YARN-9146. Added REST API to configure auxiliary service. Contributed by Billie Rinaldi

  1. … 5 more files in changeset.
HADOOP-14556. S3A to support Delegation Tokens.

Contributed by Steve Loughran and Daryn Sharp.

  1. … 101 more files in changeset.
Revert "HADOOP-14556. S3A to support Delegation Tokens."

This reverts commit d7152332b32a575c3a92e3f4c44b95e58462528d.

  1. … 104 more files in changeset.
HADOOP-14556. S3A to support Delegation Tokens.

Contributed by Steve Loughran.

  1. … 104 more files in changeset.
YARN-9131. Updated document usage for dynamic auxiliary service. Contributed by Billie Rinaldi

  1. … 3 more files in changeset.
MAPREDUCE-7170. Doc typo in Contributed by Zhaohui Xin.

HADOOP-16210. Update guava to 27.0-jre in hadoop-project trunk. Contributed by Gabor Bota.

  1. … 12 more files in changeset.
MAPREDUCE-7164. FileOutputCommitter does not report progress while merging paths. Contributed by Kuhu Shukla

MAPREDUCE-6190. If a task stucks before its first heartbeat, it never timeouts and the MR job becomes stuck. Contributed by Zhaohui Xin.

    • -0
    • +9
  1. … 2 more files in changeset.
MAPREDUCE-7162. TestEvents#testEvents fails. Contributed by Zhaohui Xin.

MAPREDUCE-7158. Inefficient Flush Logic in JobHistory EventWriter. (Zichen Sun via wangda)

Change-Id: I99ace87980da03bb35a8012cea7218d602a8817a