hadoop

Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Make upstream aware of 3.1.2 release

Change-Id: I397bc6ef75498726df4763bd07a8bf8fe1c38365

(cherry picked from commit 308f3168fa221a336ef0dbb1a17358b1ad6f9356)

(cherry picked from commit 649da5af04d57ee910dbe7fb0f4a7d9cb4c40eb0)

    • -0
    • +28085
    /hadoop-mapreduce-project/dev-support/jdiff/Apache_Hadoop_MapReduce_Core_3.1.2.xml
    • -0
    • +16
    /hadoop-mapreduce-project/dev-support/jdiff/Apache_Hadoop_MapReduce_JobClient_3.1.2.xml
Make upstream aware of 3.1.2 release

Change-Id: I397bc6ef75498726df4763bd07a8bf8fe1c38365

(cherry picked from commit 308f3168fa221a336ef0dbb1a17358b1ad6f9356)

    • -0
    • +28085
    /hadoop-mapreduce-project/dev-support/jdiff/Apache_Hadoop_MapReduce_Core_3.1.2.xml
    • -0
    • +16
    /hadoop-mapreduce-project/dev-support/jdiff/Apache_Hadoop_MapReduce_JobClient_3.1.2.xml
Make upstream aware of 3.1.2 release

Change-Id: I397bc6ef75498726df4763bd07a8bf8fe1c38365

    • -0
    • +28085
    /hadoop-mapreduce-project/dev-support/jdiff/Apache_Hadoop_MapReduce_Core_3.1.2.xml
    • -0
    • +16
    /hadoop-mapreduce-project/dev-support/jdiff/Apache_Hadoop_MapReduce_JobClient_3.1.2.xml
HADOOP-15549. Upgrade to commons-configuration 2.1 regresses task CPU consumption.

Contributed by Todd Lipcon.

(cherry picked from commit 1f21be2d024de724990a0b5737c0c65c6e59d7f3)

HADOOP-15549. Upgrade to commons-configuration 2.1 regresses task CPU consumption.

Contributed by Todd Lipcon.

HADOOP-15954. ABFS: Enable owner and group conversion for MSI and login user using OAuth.

Contributed by Da Zhou and Junhua Gu.

HDFS-14252. RBF : Exceptions are exposing the actual sub cluster path. Contributed by Ayush Saxena.

HDFS-14252. RBF : Exceptions are exposing the actual sub cluster path. Contributed by Ayush Saxena.

HDFS-14252. RBF : Exceptions are exposing the actual sub cluster path. Contributed by Ayush Saxena.

HDFS-14252. RBF : Exceptions are exposing the actual sub cluster path. Contributed by Ayush Saxena.

YARN-9246 NPE when executing a command yarn node -status or -states without additional arguments. Contributed by Masahiro Tanaka

HDDS-776. Make OM initialization resilient to dns failures. Contributed by Doroszlai, Attila.

HADOOP-16074. WASB: Update container not found error code.

Contributed by Da Zhou.

(cherry picked from commit ba9efe06fadb9631763f3e623d8748bbe59ff748)

HADOOP-16074. WASB: Update container not found error code.

Contributed by Da Zhou.

HADOOP-15229. Add FileSystem builder-based openFile() API to match createFile(); S3A to implement S3 Select through this API.

The new openFile() API is asynchronous, and implemented across FileSystem and FileContext.

The MapReduce V2 inputs are moved to this API, and you can actually set must/may

options to pass in.

This is more useful for setting things like s3a seek policy than for S3 select,

as the existing input format/record readers can't handle S3 select output where

the stream is shorter than the file length, and splitting plain text is suboptimal.

Future work is needed there.

In the meantime, any/all filesystem connectors are now free to add their own filesystem-specific

configuration parameters which can be set in jobs and used to set filesystem input stream

options (seek policy, retry, encryption secrets, etc).

Contributed by Steve Loughran

  1. … 57 more files in changeset.
HDDS-987. MultipartUpload: S3API for list parts of a object. Contributed by Bharat Viswanadham.

YARN-6735. Have a way to turn off container metrics from NMs. Contributed by Abhishek Modi.

YARN-6735. Have a way to turn off container metrics from NMs. Contributed by Abhishek Modi.

YARN-9257. Distributed Shell client throws a NPE for a non-existent queue. Contributed by Charan Hebri.

YARN-9275. Add link to NodeAttributes doc in PlacementConstraints document. Contributed by Masatake Iwasaki.

YARN-9275. Add link to NodeAttributes doc in PlacementConstraints document. Contributed by Masatake Iwasaki.

(cherry picked from commit aa7ce50e557b0257ca7980d1d736a62b1f6ccb5d)

YARN-9149. yarn container -status misses logUrl when integrated with ATSv2. Contributed by Abhishek Modi.

HDFS-14225. RBF : MiniRouterDFSCluster should configure the failover proxy provider for namespace. Contributed by Ranith Sardar.

HDFS-14225. RBF : MiniRouterDFSCluster should configure the failover proxy provider for namespace. Contributed by Ranith Sardar.

HDFS-14225. RBF : MiniRouterDFSCluster should configure the failover proxy provider for namespace. Contributed by Ranith Sardar.

HDFS-14225. RBF : MiniRouterDFSCluster should configure the failover proxy provider for namespace. Contributed by Ranith Sardar.

HDDS-1029. Allow option for force in DeleteContainerCommand. Contributed by Bharat Viswanadham.

HADOOP-15938. [JDK 11] Remove animal-sniffer-maven-plugin to fix build. Contributed by Dinesh Chitlangia.

HDDS-1039. OzoneManager fails to connect with secure SCM. Contributed by Ajay Kumar

HDFS-14125. Use parameterized log format in ECTopologyVerifier. Contributed by Kitti Nanasi.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>