Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HADOOP-16683. Disable retry of FailoverOnNetworkExceptionRetry in case of wrapped AccessControlException. Contributed by Adam Antal

(cherry picked from commit 3d249301f42130de80ab3ecf8c783bb51b0fa8a3)

  1. … 3 more files in changeset.
HADOOP-16580. Disable retry of FailoverOnNetworkExceptionRetry in case of AccessControlException. Contributed by Adam Antal

(cherry picked from commit c79a5f2d9930f58ad95864c59cd0a6164cd53280)

  1. … 3 more files in changeset.
HADOOP-16792: Make S3 client request timeout configurable.

Contributed by Mustafa Iman.

This adds a new configuration option fs.s3a.connection.request.timeout

to declare the time out on HTTP requests to the AWS service;

0 means no timeout.

Measured in seconds; the usual time suffixes are all supported

Important: this is the maximum duration of any AWS service call,

including upload and copy operations. If non-zero, it must be larger

than the time to upload multi-megabyte blocks to S3 from the client,

and to rename many-GB files. Use with care.

Change-Id: I407745341068b702bf8f401fb96450a9f987c51c

  1. … 5 more files in changeset.
HADOOP-16732. S3Guard to support encrypted DynamoDB table (#1752). Contributed by Mingliang Liu.

  1. … 8 more files in changeset.
HADOOP-16759. Filesystem openFile() builder to take a FileStatus param (#1761). Contributed by Steve Loughran

* Enhanced builder + FS spec

* s3a FS to use this to skip HEAD on open

* and to use version/etag when opening the file

works with S3AFileStatus FS and S3ALocatedFileStatus

    • -20
    • +21
    ./java/org/apache/hadoop/fs/FileSystem.java
    • -10
    • +5
    ./java/org/apache/hadoop/fs/FilterFileSystem.java
    • -6
    • +3
    ./java/org/apache/hadoop/fs/FilterFs.java
    • -0
    • +94
    ./java/org/apache/hadoop/fs/impl/OpenFileParameters.java
  1. … 8 more files in changeset.
HADOOP-16346. Stabilize S3A OpenSSL support.

Introduces `openssl` as an option for `fs.s3a.ssl.channel.mode`.

The new option is documented and marked as experimental.

For details on how to use this, consult the peformance document

in the s3a documentation.

This patch is the successor to HADOOP-16050 "S3A SSL connections

should use OpenSSL" -which was reverted because of

incompatibilities between the wildfly OpenSSL client and the AWS

HTTPS servers (HADOOP-16347). With the Wildfly release moved up

to 1.0.7.Final (HADOOP-16405) everything should now work.

Related issues:

* HADOOP-15669. ABFS: Improve HTTPS Performance

* HADOOP-16050: S3A SSL connections should use OpenSSL

* HADOOP-16371: Option to disable GCM for SSL connections when running on Java 8

* HADOOP-16405: Upgrade Wildfly Openssl version to 1.0.7.Final

Contributed by Sahil Takiar

Change-Id: I80a4bc5051519f186b7383b2c1cea140be42444e

  1. … 7 more files in changeset.
HADOOP-16753. Refactor HAAdmin. Contributed by Xieming Li.

    • -172
    • +86
    ./java/org/apache/hadoop/ha/HAAdmin.java
  1. … 3 more files in changeset.
HADOOP-16621. [pb-upgrade] Remove Protobuf classes from signatures of Public APIs. Contributed by Vinayakumar B. (#1803)

    • -0
    • +69
    ./java/org/apache/hadoop/ipc/ProtobufHelper.java
  1. … 3 more files in changeset.
HDFS-13616. Batch listing of multiple directories (#1725)

    • -0
    • +91
    ./java/org/apache/hadoop/fs/PartialListing.java
  1. … 23 more files in changeset.
HADOOP-16790. Add Write Convenience Methods.

Contributed by David Mollitor.

This adds operations in FileUtil to write text to a file via

either a FileSystem or FileContext instance.

Change-Id: I5fe8fcf1bdbdbc734e137f922a75a822f2b88410

    • -0
    • +236
    ./java/org/apache/hadoop/fs/FileUtil.java
  1. … 1 more file in changeset.
HADOOP-16790. Add Write Convenience Methods.

Contributed by David Mollitor.

This adds operations in FileUtil to write text to a file via

either a FileSystem or FileContext instance.

Change-Id: I5fe8fcf1bdbdbc734e137f922a75a822f2b88410

    • -0
    • +236
    ./java/org/apache/hadoop/fs/FileUtil.java
  1. … 1 more file in changeset.
HADOOP-16683. Disable retry of FailoverOnNetworkExceptionRetry in case of wrapped AccessControlException. Contributed by Adam Antal

  1. … 3 more files in changeset.
HADOOP-16683. Disable retry of FailoverOnNetworkExceptionRetry in case of wrapped AccessControlException. Contributed by Adam Antal

  1. … 3 more files in changeset.
HDFS-15099. [SBN Read] checkOperation(WRITE) should throw ObserverRetryOnActiveException for ObserverNode. Contributed by Chen Liang.

(cherry picked from commit 26a969ec734dbdbf1d544f486dfa33f15c291789)

  1. … 2 more files in changeset.
HDFS-15099. [SBN Read] checkOperation(WRITE) should throw ObserverRetryOnActiveException for ObserverNode. Contributed by Chen Liang.

(cherry picked from commit 26a969ec734dbdbf1d544f486dfa33f15c291789)

  1. … 2 more files in changeset.
HDFS-15099. [SBN Read] checkOperation(WRITE) should throw ObserverRetryOnActiveException for ObserverNode. Contributed by Chen Liang.

  1. … 2 more files in changeset.
HDFS-15099. [SBN Read] checkOperation(WRITE) should throw ObserverRetryOnActiveException for ObserverNode. Contributed by Chen Liang.

(cherry picked from commit 26a969ec734dbdbf1d544f486dfa33f15c291789)

  1. … 2 more files in changeset.
HADOOP-16590. Update OS login modules for IBM JDK. Contributed by Nicholas Marion

Close #1484

HADOOP-16749. Configuration parsing of CDATA values are blank

Signed-off-by: Jonathan Eagles <jeagles@gmail.com>

(cherry picked from commit 23a77050e08a8d57581da43fa8d6cd11ad8eaa0e)

    • -0
    • +1
    ./java/org/apache/hadoop/conf/Configuration.java
  1. … 1 more file in changeset.
HADOOP-16749. Configuration parsing of CDATA values are blank

Signed-off-by: Jonathan Eagles <jeagles@gmail.com>

    • -0
    • +1
    ./java/org/apache/hadoop/conf/Configuration.java
  1. … 1 more file in changeset.
HADOOP-16749. Configuration parsing of CDATA values are blank

Signed-off-by: Jonathan Eagles <jeagles@gmail.com>

(cherry picked from commit c4fb43c94259546f2c96b50ceae9cd3adb726166)

    • -0
    • +1
    ./java/org/apache/hadoop/conf/Configuration.java
  1. … 1 more file in changeset.
HADOOP-16749. Configuration parsing of CDATA values are blank

Signed-off-by: Jonathan Eagles <jeagles@gmail.com>

    • -0
    • +1
    ./java/org/apache/hadoop/conf/Configuration.java
  1. … 1 more file in changeset.
HADOOP-16749. Configuration parsing of CDATA values are blank

Signed-off-by: Jonathan Eagles <jeagles@gmail.com>

(cherry picked from commit c4fb43c94259546f2c96b50ceae9cd3adb726166)

    • -0
    • +1
    ./java/org/apache/hadoop/conf/Configuration.java
  1. … 1 more file in changeset.
HADOOP-16751. Followup: move java import. (#1799)

This moves the import of a java module to the preferred place in the import ordering.

Change-Id: I1a594e3d954554a72c2b71c954eda0ae940a8f70

    • -2
    • +2
    ./java/org/apache/hadoop/util/DurationInfo.java
HADOOP-16793. Redefine log level when ipc connection interrupted in Client#handleSaslConnectionFailure().

Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>

(cherry picked from commit d887e49dd4ed2b94bbb53b7608586f5da6cee037)

    • -2
    • +11
    ./java/org/apache/hadoop/ipc/Client.java
Remove WARN log when ipc connection interrupted in Client#handleSaslConnectionFailure()

Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>

    • -2
    • +11
    ./java/org/apache/hadoop/ipc/Client.java
Remove WARN log when ipc connection interrupted in Client#handleSaslConnectionFailure()

Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>

(cherry picked from commit d887e49dd4ed2b94bbb53b7608586f5da6cee037)

    • -2
    • +11
    ./java/org/apache/hadoop/ipc/Client.java
Remove WARN log when ipc connection interrupted in Client#handleSaslConnectionFailure()

Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>

(cherry picked from commit d887e49dd4ed2b94bbb53b7608586f5da6cee037)

    • -2
    • +11
    ./java/org/apache/hadoop/ipc/Client.java
Remove WARN log when ipc connection interrupted in Client#handleSaslConnectionFailure()

Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>

(cherry picked from commit d887e49dd4ed2b94bbb53b7608586f5da6cee037)

    • -2
    • +11
    ./java/org/apache/hadoop/ipc/Client.java
HADOOP-16727. KMS Jetty server does not startup if trust store password is null.

  1. … 4 more files in changeset.