Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HADOOP-16005. NativeAzureFileSystem does not support setXAttr.

Contributed by Clemens Wolff.

    • -12
    • +55
    ./AzureNativeFileSystemStore.java
  1. … 4 more files in changeset.
HADOOP-16785. Improve wasb and abfs resilience on double close() calls.

This hardens the wasb and abfs output streams' resilience to being invoked

in/after close().

wasb:

Explicity raise IOEs on operations invoked after close,

rather than implicitly raise NPEs.

This ensures that invocations which catch and swallow IOEs will perform as

expected.

abfs:

When rethrowing an IOException in the close() call, explicitly wrap it

with a new instance of the same subclass.

This is needed to handle failures in try-with-resources clauses, where

any exception in closed() is added as a suppressed exception to the one

thrown in the try {} clause

*and you cannot attach the same exception to itself*

Contributed by Steve Loughran.

Change-Id: Ic44b494ff5da332b47d6c198ceb67b965d34dd1b

  1. … 5 more files in changeset.
HADOOP-16785. Improve wasb and abfs resilience on double close() calls.

This hardens the wasb and abfs output streams' resilience to being invoked

in/after close().

wasb:

Explicity raise IOEs on operations invoked after close,

rather than implicitly raise NPEs.

This ensures that invocations which catch and swallow IOEs will perform as

expected.

abfs:

When rethrowing an IOException in the close() call, explicitly wrap it

with a new instance of the same subclass.

This is needed to handle failures in try-with-resources clauses, where

any exception in closed() is added as a suppressed exception to the one

thrown in the try {} clause

*and you cannot attach the same exception to itself*

Contributed by Steve Loughran.

Change-Id: Ic44b494ff5da332b47d6c198ceb67b965d34dd1b

  1. … 5 more files in changeset.
HADOOP-16640. WASB: Override getCanonicalServiceName() to return URI

(cherry picked from commit 9a8edb0aeddd7787b2654f6e2a8465c325e048a2)

  1. … 1 more file in changeset.
HADOOP-16640. WASB: Override getCanonicalServiceName() to return URI

  1. … 1 more file in changeset.
HADOOP-16640. WASB: Override getCanonicalServiceName() to return URI

(cherry picked from commit 9a8edb0aeddd7787b2654f6e2a8465c325e048a2)

  1. … 1 more file in changeset.
HADOOP-15691 Add PathCapabilities to FileSystem and FileContext.

Contributed by Steve Loughran.

This complements the StreamCapabilities Interface by allowing applications to probe for a specific path on a specific instance of a FileSystem client

to offer a specific capability.

This is intended to allow applications to determine

* Whether a method is implemented before calling it and dealing with UnsupportedOperationException.

* Whether a specific feature is believed to be available in the remote store.

As well as a common set of capabilities defined in CommonPathCapabilities,

file systems are free to add their own capabilities, prefixed with

fs. + schema + .

The plan is to identify and document more capabilities -and for file systems which add new features, for a declaration of the availability of the feature to always be available.

Note

* The remote store is not expected to be checked for the feature;

It is more a check of client API and the client's configuration/knowledge

of the state of the remote system.

* Permissions are not checked.

Change-Id: I80bfebe94f4a8bdad8f3ac055495735b824968f5

  1. … 39 more files in changeset.
HADOOP-16157. [Clean-up] Remove NULL check before instanceof in AzureNativeFileSystemStore (Contributed by Shweta Yakkali via Daniel Templeton)

Change-Id: I6269ae66378e46eed440a76f847ae1af1fa95450

HADOOP-16157. [Clean-up] Remove NULL check before instanceof in AzureNativeFileSystemStore (Contributed by Shweta Yakkali via Daniel Templeton)

Change-Id: I6269ae66378e46eed440a76f847ae1af1fa95450

(cherry picked from commit bb8ad096e785f7127a5c0de15167255d9b119578)

HADOOP-16105. WASB in secure mode does not set connectingUsingSAS.

Contributed by Steve Loughran.

(cherry picked from commit 9cb2f470b759bbe7609a00e8f8f72779e2daae80)

  1. … 2 more files in changeset.
HADOOP-16105. WASB in secure mode does not set connectingUsingSAS.

Contributed by Steve Loughran.

(cherry picked from commit 9cb2f470b759bbe7609a00e8f8f72779e2daae80)

  1. … 2 more files in changeset.
HADOOP-16105. WASB in secure mode does not set connectingUsingSAS.

Contributed by Steve Loughran.

  1. … 2 more files in changeset.
HADOOP-16074. WASB: Update container not found error code.

Contributed by Da Zhou.

(cherry picked from commit ba9efe06fadb9631763f3e623d8748bbe59ff748)

  1. … 1 more file in changeset.
HADOOP-16074. WASB: Update container not found error code.

Contributed by Da Zhou.

  1. … 1 more file in changeset.
HADOOP-16036. WASB: Disable jetty logging configuration announcement.

Contributed by Da Zhou.

(cherry picked from commit 852701f7935eb94eda6f44b74a2ce060e7c159a7)

HADOOP-16036. WASB: Disable jetty logging configuration announcement.

Contributed by Da Zhou.

HADOOP-15957. WASB: Add asterisk wildcard support for PageBlobDirSet.

Contributed by Da Zhou.

(cherry picked from commit 7ccb640a66bb5bb9f657a2db85bcc8ae0ded4892)

  1. … 2 more files in changeset.
HADOOP-15957. WASB: Add asterisk wildcard support for PageBlobDirSet.

Contributed by Da Zhou.

  1. … 2 more files in changeset.
HADOOP-15677. WASB: Add support for StreamCapabilities. Contributed by Thomas Marquardt.

(cherry picked from commit 1eef0acfe5725d08d3a4eb76c5138076ff1857f1)

  1. … 1 more file in changeset.
HADOOP-15677. WASB: Add support for StreamCapabilities. Contributed by Thomas Marquardt.

  1. … 1 more file in changeset.
HADOOP-15547/ WASB: improve listStatus performance. Contributed by Thomas Marquardt.

    • -88
    • +94
    ./AzureNativeFileSystemStore.java
    • -223
    • +153
    ./NativeAzureFileSystem.java
  1. … 5 more files in changeset.
HADOOP-15703. ABFS - Implement client-side throttling. Contributed by Sneha Varma and Thomas Marquardt.

  1. … 10 more files in changeset.
HADOOP-15703. ABFS - Implement client-side throttling. Contributed by Sneha Varma and Thomas Marquardt.

  1. … 10 more files in changeset.
HADOOP-15547/ WASB: improve listStatus performance. Contributed by Thomas Marquardt.

(cherry picked from commit 749fff577ed9afb4ef8a54b8948f74be083cc620)

    • -88
    • +94
    ./AzureNativeFileSystemStore.java
    • -223
    • +153
    ./NativeAzureFileSystem.java
  1. … 3 more files in changeset.
HADOOP-15547/ WASB: improve listStatus performance. Contributed by Thomas Marquardt.

    • -88
    • +94
    ./AzureNativeFileSystemStore.java
    • -223
    • +153
    ./NativeAzureFileSystem.java
  1. … 3 more files in changeset.
HADOOP-15495. Upgrade commons-lang version to 3.7 in hadoop-common-project and hadoop-tools. Contributed by Takanobu Asanuma.

  1. … 95 more files in changeset.
HADOOP-15550. Avoid static initialization of ObjectMappers

(cherry picked from commit 7a3c6e9c3cd9ffdc71946fd12f5c3d59718c4939)

  1. … 9 more files in changeset.
HADOOP-15550. Avoid static initialization of ObjectMappers

  1. … 9 more files in changeset.
HADOOP-15533. Make WASB listStatus messages consistent. Contributed by Esfandiar Manii

(cherry picked from commit f34744603ee93e082e7ba148df1400af5ac7c30c)

(cherry picked from commit 7e655b642d0ed5b85e0e8c212e004d067318ed4c)

HADOOP-15533. Make WASB listStatus messages consistent. Contributed by Esfandiar Manii

(cherry picked from commit f34744603ee93e082e7ba148df1400af5ac7c30c)