Clone
 

steve loughran <stevel@apache.org> in hadoop

HADOOP-15071 S3a troubleshooting docs to add a couple more failure modes. Contributed by Steve Loughran

HADOOP-15042. Azure PageBlobInputStream.skip() can return negative value when numberOfPagesRemaining is 0. Contributed by Rajesh Balamohan

(cherry picked from commit 0ea182d0faa35c726dcb37249d48786bfc8ca04c)

HADOOP-15042. Azure PageBlobInputStream.skip() can return negative value when numberOfPagesRemaining is 0. Contributed by Rajesh Balamohan

(cherry picked from commit 0ea182d0faa35c726dcb37249d48786bfc8ca04c)

HADOOP-15042. Azure PageBlobInputStream.skip() can return negative value when numberOfPagesRemaining is 0. Contributed by Rajesh Balamohan

HADOOP-13786 Add S3A committer for zero-rename commits to S3 endpoints. Contributed by Steve Loughran and Ryan Blue.

  1. … 129 more files in changeset.
HADOOP-15024 Support user agent configuration and include that & Hadoop version information to oss server. Contributed by Sammi Chen.

HADOOP-14553. Add (parallelized) integration tests to hadoop-azure. Contributed by Steve Loughran.

(backport JIRA HADOOP-14870)

    • -0
    • +251
    /hadoop-tools/hadoop-azure/pom.xml
    • -0
    • +576
    /hadoop-tools/hadoop-azure/src/site/markdown/testing_azure.md
  1. … 88 more files in changeset.
MAPREDUCE-6977 Move logging APIs over to slf4j in hadoop-mapreduce-client-common. Contributed by Jinjiang Ling.

HADOOP-14942. DistCp#cleanup() should check whether jobFS is null. Contributed by Andras Bokor.

(cherry picked from commit f36cbc847560d53e7955ced9ce7ce2773c805793)

HADOOP-14942. DistCp#cleanup() should check whether jobFS is null. Contributed by Andras Bokor.

(cherry picked from commit f36cbc847560d53e7955ced9ce7ce2773c805793)

HADOOP-14942. DistCp#cleanup() should check whether jobFS is null. Contributed by Andras Bokor.

HADOOP-14935. Azure: POSIX permissions are taking effect in access() method even when authorization is enabled. Contributed by Santhosh G Nayak

HADOOP-14935. Azure: POSIX permissions are taking effect in access() method even when authorization is enabled. Contributed by Santhosh G Nayak

Cherry-picked from commit 9fcc3a1fc8cab873034f5c308ceb2d5671a954e8

HADOOP-14913. Sticky bit implementation for rename() operation in Azure WASB. Contributed by Varada Hemeswari.

Cherry-picked from commit ref 3de574413c4d5554213d02bd0ad343ba82cf82aa

HADOOP-14913. Sticky bit implementation for rename() operation in Azure WASB. Contributed by Varada Hemeswari.

HADOOP-14899. Restrict Access to setPermission operation when authorization is enabled in WASB Contributed by Kannapiran Srinivasan.

HADOOP-14899. Restrict Access to setPermission operation when authorization is enabled in WASB Contributed by Kannapiran Srinivasan.

HADOOP-14845. Azure wasb: getFileStatus not making any auth check. Final fixup of TestNativeAzureFileSystemAuthorization in branch-2 to match trunk's changes Contributed by Sivaguru Sankaridurg

HADOOP-14845. Azure wasb: getFileStatus not making any auth check. Contributed by Sivaguru Sankaridurg

HADOOP-14220 Enhance S3GuardTool with bucket-info and set-capacity commands, tests. Contributed by Steve Loughran

HADOOP-14768. Honoring sticky bit during Deletion when authorization is enabled in WASB Contributed by Varada Hemeswari

HADOOP-13345 S3Guard: Improved Consistency for S3A. Contributed by: Chris Nauroth, Aaron Fabbri, Mingliang Liu, Lei (Eddy) Xu, Sean Mackrory, Steve Loughran and others.

(cherry-picked from/based on commit 621b43e254afaff708cd6fc4698b29628f6abc33)

    • -0
    • +147
    /hadoop-tools/hadoop-aws/pom.xml
  1. … 83 more files in changeset.
HADOOP-14845. Azure wasb: getFileStatus not making any auth check. Contributed by Sivaguru Sankaridurg

HADOOP-14768. Honoring sticky bit during Deletion when authorization is enabled in WASB Contributed by Varada Hemeswari

HADOOP-14768. Honoring sticky bit during Deletion when authorization is enabled in WASB Contributed by Varada Hemeswari

HADOOP-14890 Move up to AWS SDK 1.11.199. Contributed by Steve Loughran.

Revert "HADOOP-14771. hadoop-client does not include hadoop-yarn-client. (Ajay Kumar via Haibo Chen)" HADOOP-14879 Build failure due to failing hadoop-client-check-invariants This reverts commit 1ee25278c891e95ba2ab142e5b78aebd752ea163.

Revert "HADOOP-14771. hadoop-client does not include hadoop-yarn-client. (Ajay Kumar via Haibo Chen)" HADOOP-14879 Build failure due to failing hadoop-client-check-invariants This reverts commit 1ee25278c891e95ba2ab142e5b78aebd752ea163.

(cherry picked from commit aa6e8d2dff533c3d0c86776567c860548723c21c)

HADOOP-14583. wasb throws an exception if you try to create a file and there's no parent directory. Contributed by Esfandiar Manii.

HADOOP-14553. Add (parallelized) integration tests to hadoop-azure Contributed by Steve Loughran

(cherry picked from commit 2d2d97fa7d4224369b3c13bc4a45e8cc9e29afb1)

    • -0
    • +251
    /hadoop-tools/hadoop-azure/pom.xml
    • -0
    • +576
    /hadoop-tools/hadoop-azure/src/site/markdown/testing_azure.md
  1. … 92 more files in changeset.