Clone Tools
  • last updated 16 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HADOOP-16670. Stripping Submarine code from Hadoop codebase. Contributed by Zhankun Tang.

Reviewed-by: Akira Ajisaka <aajisaka@apache.org>

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

  1. … 228 more files in changeset.
HADOOP-16759. Filesystem openFile() builder to take a FileStatus param (#1761). Contributed by Steve Loughran

* Enhanced builder + FS spec

* s3a FS to use this to skip HEAD on open

* and to use version/etag when opening the file

works with S3AFileStatus FS and S3ALocatedFileStatus

    • -0
    • +41
    ./filesystem/fsdatainputstreambuilder.md
  1. … 16 more files in changeset.
HADOOP-16042. Update the link to HadoopJavaVersion (#1784)

HADOOP-16042. Update the link to HadoopJavaVersion (#1784)

(cherry picked from commit d80d86264d8e4b1a5cfc6fc12eec8f9dfcd76b3f)

HADOOP-16042. Update the link to HadoopJavaVersion (#1784)

(cherry picked from commit d80d86264d8e4b1a5cfc6fc12eec8f9dfcd76b3f)

HADOOP-16755. Fix broken link in single node cluster setup documentation. Contributed by Denes Gerencser.

HADOOP-16764. Rewrite Python example codes using Python3 (#1762)

  1. … 1 more file in changeset.
HDFS-14802. The feature of protect directories should be used in RenameOp (#1669)

  1. … 6 more files in changeset.
Add 2.10.0 release notes for HDFS-12943

(cherry picked from commit ef9d12df24c0db76fd37a95551db7920d27d740c)

(cherry picked from commit 9ccfc2d6d3f3819da58ea9f0ff056ed03970a6e1)

(cherry picked from commit f29481f0466350d7bba0f8ec421f51a619607dcd)

    • -0
    • +13
    ./release/2.10.0/RELEASENOTES.2.10.0.md
Add 2.10.0 release notes for HDFS-12943

(cherry picked from commit ef9d12df24c0db76fd37a95551db7920d27d740c)

(cherry picked from commit 9ccfc2d6d3f3819da58ea9f0ff056ed03970a6e1)

    • -0
    • +13
    ./release/2.10.0/RELEASENOTES.2.10.0.md
Add 2.10.0 release notes for HDFS-12943

    • -0
    • +13
    ./release/2.10.0/RELEASENOTES.2.10.0.md
Add 2.10.0 release notes for HDFS-12943

(cherry picked from commit ef9d12df24c0db76fd37a95551db7920d27d740c)

    • -0
    • +13
    ./release/2.10.0/RELEASENOTES.2.10.0.md
Add 2.10.0 release notes for HDFS-12943

(cherry picked from commit ef9d12df24c0db76fd37a95551db7920d27d740c)

(cherry picked from commit 9ccfc2d6d3f3819da58ea9f0ff056ed03970a6e1)

(cherry picked from commit f29481f0466350d7bba0f8ec421f51a619607dcd)

(cherry picked from commit fab62a145d70dbdf7f5904187790e1b9479aae4f)

    • -0
    • +13
    ./release/2.10.0/RELEASENOTES.2.10.0.md
Make upstream aware of 2.10.0 release

    • -0
    • +788
    ./release/2.10.0/CHANGES.2.10.0.md
    • -1
    • +102
    ./release/2.10.0/RELEASENOTES.2.10.0.md
  1. … 9 more files in changeset.
Make upstream aware of 2.10.0 release

(cherry picked from commit 7663db59c097c82eeed2df7a91168a4d7123c96b)

(cherry picked from commit 5d2ffcc7aac608746946dc2ed5711549a01a2055)

(cherry picked from commit 4d274f60bc4bf2800477800ec58b2b2c6f4f656e)

(cherry picked from commit 915b79535824285992f466e4aba3ecc6e744c090)

    • -0
    • +788
    ./release/2.10.0/CHANGES.2.10.0.md
    • -0
    • +219
    ./release/2.10.0/RELEASENOTES.2.10.0.md
  1. … 9 more files in changeset.
Make upstream aware of 2.10.0 release

(cherry picked from commit 7663db59c097c82eeed2df7a91168a4d7123c96b)

(cherry picked from commit 5d2ffcc7aac608746946dc2ed5711549a01a2055)

(cherry picked from commit 4d274f60bc4bf2800477800ec58b2b2c6f4f656e)

    • -0
    • +788
    ./release/2.10.0/CHANGES.2.10.0.md
    • -0
    • +219
    ./release/2.10.0/RELEASENOTES.2.10.0.md
  1. … 9 more files in changeset.
Make upstream aware of 2.10.0 release

(cherry picked from commit 7663db59c097c82eeed2df7a91168a4d7123c96b)

    • -0
    • +788
    ./release/2.10.0/CHANGES.2.10.0.md
    • -1
    • +105
    ./release/2.10.0/RELEASENOTES.2.10.0.md
  1. … 9 more files in changeset.
Make upstream aware of 2.10.0 release

(cherry picked from commit 7663db59c097c82eeed2df7a91168a4d7123c96b)

(cherry picked from commit 5d2ffcc7aac608746946dc2ed5711549a01a2055)

    • -0
    • +788
    ./release/2.10.0/CHANGES.2.10.0.md
    • -0
    • +219
    ./release/2.10.0/RELEASENOTES.2.10.0.md
  1. … 9 more files in changeset.
HADOOP-16615. Add password check for credential provider,

Contributed by hongdongdong.

Change-Id: Iaac01bc8594860064a80c822a0e47981243ab7e1

  1. … 2 more files in changeset.
Revert "HADOOP-15870. S3AInputStream.remainingInFile should use nextReadPos."

This reverts commit 7a4b3d42c4e36e468c2a46fd48036a6fed547853.

The patch broke TestRouterWebHDFSContractSeek as it turns out that

WebHDFSInputStream.available() is always 0.

  1. … 3 more files in changeset.
HADOOP-15870. S3AInputStream.remainingInFile should use nextReadPos.

Contributed by lqjacklee.

Change-Id: I32bb00a683102e7ff8ff8ce0b8d9c3195ca7381c

  1. … 3 more files in changeset.
Make upstream aware of 3.1.3 release.

    • -0
    • +336
    ./release/3.1.3/CHANGES.3.1.3.md
    • -0
    • +59
    ./release/3.1.3/RELEASENOTES.3.1.3.md
  1. … 2 more files in changeset.
Make upstream aware of 3.1.3 release.

    • -0
    • +336
    ./release/3.1.3/CHANGES.3.1.3.md
    • -0
    • +59
    ./release/3.1.3/RELEASENOTES.3.1.3.md
  1. … 1 more file in changeset.
HADOOP-15691 Add PathCapabilities to FileSystem and FileContext.

Contributed by Steve Loughran.

This complements the StreamCapabilities Interface by allowing applications to probe for a specific path on a specific instance of a FileSystem client

to offer a specific capability.

This is intended to allow applications to determine

* Whether a method is implemented before calling it and dealing with UnsupportedOperationException.

* Whether a specific feature is believed to be available in the remote store.

As well as a common set of capabilities defined in CommonPathCapabilities,

file systems are free to add their own capabilities, prefixed with

fs. + schema + .

The plan is to identify and document more capabilities -and for file systems which add new features, for a declaration of the availability of the feature to always be available.

Note

* The remote store is not expected to be checked for the feature;

It is more a check of client API and the client's configuration/knowledge

of the state of the remote system.

* Permissions are not checked.

Change-Id: I80bfebe94f4a8bdad8f3ac055495735b824968f5

    • -0
    • +158
    ./filesystem/pathcapabilities.md
  1. … 37 more files in changeset.
HDFS-14845. Ignore AuthenticationFilterInitializer for HttpFSServerWebServer and honor hadoop.http.authentication configs.

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

  1. … 3 more files in changeset.
Make upstream aware of 3.2.1 release.

    • -0
    • +553
    ./release/3.2.1/CHANGELOG.3.2.1.md
    • -0
    • +80
    ./release/3.2.1/RELEASENOTES.3.2.1.md
  1. … 2 more files in changeset.
Make upstream aware of 3.2.1 release.

    • -0
    • +553
    ./release/3.2.1/CHANGELOG.3.2.1.md
    • -0
    • +80
    ./release/3.2.1/RELEASENOTES.3.2.1.md
  1. … 2 more files in changeset.
HDFS-14691. Wrong usage hint for hadoop fs command "test".

Contributed by Jianfei Jiang.

Change-Id: I9f5e89721ff210641375fbf42a70043f0d74458e

(cherry picked from commit 71aad60e519da729249d3c06389f2efa8d9ae212)

  1. … 2 more files in changeset.
HDFS-14691. Wrong usage hint for hadoop fs command "test".

Contributed by Jianfei Jiang.

Change-Id: I9f5e89721ff210641375fbf42a70043f0d74458e

  1. … 2 more files in changeset.
HADOOP-16380. S3Guard to determine empty directory status for all non-root directories.

Contributed by Steve Loughran and Gabor Bota.

This

* Asks S3Guard to determine the empty directory status.

* Has S3A's root directory rm("/") command to always return false (as abfs does)

* Documents that object stores MAY do this

* Overloads ContractTestUtils.assertDeleted to let assertions declare that the source directory does not need to exist. This stops inconsistencies in directory listings failing a root test.

It avoids a recent regression (HADOOP-16279) where if there was a tombstone above the first element found in a directory listing, the directory would be considered empty, when in fact there were child entries. That could downgrade an rm(path, recursive) to a no-op, while also confusing rename(src, dest), as dest could be mistaken for an empty directory and so permit the copy above it, rather than reject it "destination path exists and is not empty".

Change-Id: I136a3d1a5a48a67e6155d790a40ff558d0d2c108

  1. … 9 more files in changeset.