Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Revert "HADOOP-16818. ABFS: Combine append+flush calls for blockblob & appendblob"

This reverts commit 3612317038196ee0cb6d7204056d54b7a7ed8bf7.

Change-Id: Ie0d36f25de0b55a937894f4d9963c495bae0576a

  1. … 7 more files in changeset.
HADOOP-16818. ABFS: Combine append+flush calls for blockblob & appendblob

Contributed by Ishani Ahuja.

  1. … 7 more files in changeset.
HADOOP-16920 ABFS: Make list page size configurable.

Contributed by Bilahari T H.

The page limit is set in "fs.azure.list.max.results"; default value is 500.

There's currently a limit of 5000 in the store -there are no range checks

in the client code so that limit can be changed on the server without

any need to update the abfs connector.

  1. … 3 more files in changeset.
HADOOP-16730: ABFS: Support for Shared Access Signatures (SAS). Contributed by Sneha Vijayarajan.

  1. … 22 more files in changeset.
HADOOP-16734. Backport HADOOP-16455- "ABFS: Implement FileSystem.access() method" to branch-2. Contributed by Bilahari T H.

  1. … 8 more files in changeset.
HADOOP-16455. ABFS: Implement FileSystem.access() method.

Contributed by Bilahari T H.

  1. … 8 more files in changeset.
HADOOP-16455. ABFS: Implement FileSystem.access() method.

Contributed by Bilahari T H.

  1. … 8 more files in changeset.
HADOOP-16612. Track Azure Blob File System client-perceived latency

Contributed by Jeetesh Mangwani.

This add the ability to track the end-to-end performance of ADLS Gen 2 REST APIs by measuring latency in the Hadoop ABFS driver.

The latency information is sent back to the ADLS Gen 2 REST API endpoints in the subsequent requests.

  1. … 15 more files in changeset.
HADOOP-16612. Track Azure Blob File System client-perceived latency

Contributed by Jeetesh Mangwani.

This add the ability to track the end-to-end performance of ADLS Gen 2 REST APIs by measuring latency in the Hadoop ABFS driver.

The latency information is sent back to the ADLS Gen 2 REST API endpoints in the subsequent requests.

  1. … 15 more files in changeset.
HADOOP-16652. Backport of HADOOP-16587: Make ABFS AAD endpoints configurable

    • -0
    • +45
    ./AuthConfigurations.java
  1. … 4 more files in changeset.
HADOOP-16630 : Backport of Hadoop-16548 : Disable Flush() over config

  1. … 5 more files in changeset.
HADOOP-16587. Make ABFS AAD endpoints configurable.

Contributed by Bilahari T H.

This also addresses HADOOP-16498: AzureADAuthenticator cannot authenticate

in China.

Change-Id: I2441dd48b50b59b912b0242f7f5a4418cf94a87c

    • -0
    • +45
    ./AuthConfigurations.java
  1. … 4 more files in changeset.
HADOOP-16587. Make ABFS AAD endpoints configurable.

Contributed by Bilahari T H.

This also addresses HADOOP-16498: AzureADAuthenticator cannot authenticate

in China.

Change-Id: I2441dd48b50b59b912b0242f7f5a4418cf94a87c

    • -0
    • +45
    ./AuthConfigurations.java
  1. … 4 more files in changeset.
HADOOP-16548 : Disable Flush() over config

  1. … 5 more files in changeset.
HADOOP-16548 : Disable Flush() over config

  1. … 5 more files in changeset.
HADOOP-16371: Option to disable GCM for SSL connections when running on Java 8.

Contributed by Sahil Takiar.

This moves the SSLSocketFactoryEx class from hadoop-azure into hadoop-common

as the DelegatingSSLSocketFactory and binds the S3A connector to it so that

it can avoid using those HTTPS algorithms which are underperformant on Java 8.

Change-Id: Ie9e6ac24deac1aa05e136e08899620efa7d22abd

  1. … 15 more files in changeset.
HADOOP-16404. ABFS default blocksize change(256MB from 512MB)

Contributed by: Arun Singh

  1. … 1 more file in changeset.
HADOOP-16404. ABFS default blocksize change(256MB from 512MB)

Contributed by: Arun Singh

  1. … 1 more file in changeset.
HADOOP-16404. ABFS default blocksize change(256MB from 512MB)

Contributed by: Arun Singh

  1. … 1 more file in changeset.
Revert "HADOOP-16050: s3a SSL connections should use OpenSSL"

This reverts commit b067f8acaa79b1230336900a5c62ba465b2adb28.

Change-Id: I584b050a56c0e6f70b11fa3f7db00d5ac46e7dd8

  1. … 14 more files in changeset.
HADOOP-16269. ABFS: add listFileStatus with StartFrom.

Author: Da Zhou

  1. … 5 more files in changeset.
HADOOP-16269. ABFS: add listFileStatus with StartFrom.

Author: Da Zhou

  1. … 5 more files in changeset.
HADOOP-16269. ABFS: add listFileStatus with StartFrom.

Author: Da Zhou

  1. … 5 more files in changeset.
HADOOP-16050: s3a SSL connections should use OpenSSL

(cherry picked from commit aebf229c175dfa19fff3b31e9e67596f6c6124fa)

  1. … 14 more files in changeset.
HADOOP-16182. Update abfs storage back-end with "close" flag when application is done writing to a file.

Contributed by Vishwajeet Dusane.

(cherry picked from commit 1edf1914acb74e45f6717c703f519cb382aae173)

  1. … 2 more files in changeset.
HADOOP-16182. Update abfs storage back-end with "close" flag when application is done writing to a file.

Contributed by Vishwajeet Dusane.

  1. … 2 more files in changeset.
HADOOP-16182. Update abfs storage back-end with "close" flag when application is done writing to a file.

Contributed by Vishwajeet Dusane.

  1. … 2 more files in changeset.
HADOOP-15954. ABFS: Enable owner and group conversion for MSI and login user using OAuth.

Contributed by Da Zhou and Junhua Gu.

(cherry picked from commit 1f1655028eede24197705a594b6ef19e6737db35)

Signed-off-by: Steve Loughran <stevel@apache.org>

  1. … 6 more files in changeset.
HADOOP-16041. Include Hadoop version in User-Agent string for ABFS.

Contributed by Shweta Yakkali.

Signed-off-by: Sean Mackrory <mackrorysd@apache.org>

(cherry picked from commit 02eb91856e7e8477c62e0f8bf1bac6de3e00a8a4)

Signed-off-by: Steve Loughran <stevel@apache.org>

  1. … 1 more file in changeset.
HADOOP-15954. ABFS: Enable owner and group conversion for MSI and login user using OAuth.

Contributed by Da Zhou and Junhua Gu.

  1. … 6 more files in changeset.