Clone
 

steve loughran <stevel@apache.org> in hadoop

HADOOP-14942. DistCp#cleanup() should check whether jobFS is null. Contributed by Andras Bokor.

(cherry picked from commit f36cbc847560d53e7955ced9ce7ce2773c805793)

HADOOP-14942. DistCp#cleanup() should check whether jobFS is null. Contributed by Andras Bokor.

(cherry picked from commit f36cbc847560d53e7955ced9ce7ce2773c805793)

HADOOP-14942. DistCp#cleanup() should check whether jobFS is null. Contributed by Andras Bokor.

HADOOP-14935. Azure: POSIX permissions are taking effect in access() method even when authorization is enabled. Contributed by Santhosh G Nayak

HADOOP-14935. Azure: POSIX permissions are taking effect in access() method even when authorization is enabled. Contributed by Santhosh G Nayak

Cherry-picked from commit 9fcc3a1fc8cab873034f5c308ceb2d5671a954e8

HADOOP-14913. Sticky bit implementation for rename() operation in Azure WASB. Contributed by Varada Hemeswari.

Cherry-picked from commit ref 3de574413c4d5554213d02bd0ad343ba82cf82aa

HADOOP-14913. Sticky bit implementation for rename() operation in Azure WASB. Contributed by Varada Hemeswari.

HADOOP-14899. Restrict Access to setPermission operation when authorization is enabled in WASB Contributed by Kannapiran Srinivasan.

HADOOP-14899. Restrict Access to setPermission operation when authorization is enabled in WASB Contributed by Kannapiran Srinivasan.

HADOOP-14845. Azure wasb: getFileStatus not making any auth check. Final fixup of TestNativeAzureFileSystemAuthorization in branch-2 to match trunk's changes Contributed by Sivaguru Sankaridurg

HADOOP-14845. Azure wasb: getFileStatus not making any auth check. Contributed by Sivaguru Sankaridurg

HADOOP-14220 Enhance S3GuardTool with bucket-info and set-capacity commands, tests. Contributed by Steve Loughran

HADOOP-14768. Honoring sticky bit during Deletion when authorization is enabled in WASB Contributed by Varada Hemeswari

HADOOP-13345 S3Guard: Improved Consistency for S3A. Contributed by: Chris Nauroth, Aaron Fabbri, Mingliang Liu, Lei (Eddy) Xu, Sean Mackrory, Steve Loughran and others.

(cherry-picked from/based on commit 621b43e254afaff708cd6fc4698b29628f6abc33)

    • -0
    • +147
    /hadoop-tools/hadoop-aws/pom.xml
  1. … 83 more files in changeset.
HADOOP-14845. Azure wasb: getFileStatus not making any auth check. Contributed by Sivaguru Sankaridurg

HADOOP-14768. Honoring sticky bit during Deletion when authorization is enabled in WASB Contributed by Varada Hemeswari

HADOOP-14768. Honoring sticky bit during Deletion when authorization is enabled in WASB Contributed by Varada Hemeswari

HADOOP-14890 Move up to AWS SDK 1.11.199. Contributed by Steve Loughran.

Revert "HADOOP-14771. hadoop-client does not include hadoop-yarn-client. (Ajay Kumar via Haibo Chen)" HADOOP-14879 Build failure due to failing hadoop-client-check-invariants This reverts commit 1ee25278c891e95ba2ab142e5b78aebd752ea163.

Revert "HADOOP-14771. hadoop-client does not include hadoop-yarn-client. (Ajay Kumar via Haibo Chen)" HADOOP-14879 Build failure due to failing hadoop-client-check-invariants This reverts commit 1ee25278c891e95ba2ab142e5b78aebd752ea163.

(cherry picked from commit aa6e8d2dff533c3d0c86776567c860548723c21c)

HADOOP-14583. wasb throws an exception if you try to create a file and there's no parent directory. Contributed by Esfandiar Manii.

HADOOP-14553. Add (parallelized) integration tests to hadoop-azure Contributed by Steve Loughran

(cherry picked from commit 2d2d97fa7d4224369b3c13bc4a45e8cc9e29afb1)

    • -0
    • +251
    /hadoop-tools/hadoop-azure/pom.xml
    • -0
    • +576
    /hadoop-tools/hadoop-azure/src/site/markdown/testing_azure.md
  1. … 92 more files in changeset.
HADOOP-14553. Add (parallelized) integration tests to hadoop-azure Contributed by Steve Loughran

    • -0
    • +251
    /hadoop-tools/hadoop-azure/pom.xml
    • -0
    • +576
    /hadoop-tools/hadoop-azure/src/site/markdown/testing_azure.md
  1. … 92 more files in changeset.
MAPREDUCE-6956 FileOutputCommitter to gain abstract superclass PathOutputCommitter. Contributed by Steve Loughran

(cherry picked from commit 11390c2d111910b01d9c4d3e39dee49babae272f)

MAPREDUCE-6956 FileOutputCommitter to gain abstract superclass PathOutputCommitter. Contributed by Steve Loughran

Revert "HADOOP-14654. Update httpclient version to 4.5.3. (rchiang)"

This reverts commit 14bec7043a622a4226b0b267818efae32accd1bf.

Revert "HADOOP-14654. Update httpclient version to 4.5.3. (rchiang)"

This reverts commit 1118ca9b07f8a92821de7d9c9b56272a7eb66183.

HADOOP-14851 LambdaTestUtils.eventually() doesn't spin on Assertion failures. Contributed by Steve Loughran

(cherry picked from commit 180e814b081d3707c95641171d649b547db41a04)

HADOOP-14520. WASB: Block compaction for Azure Block Blobs. Contributed by Georgi Chalakov

HADOOP-13421. Switch to v2 of the S3 List Objects API in S3A. Contributed by Aaron Fabbri

(cherry picked from commit 5bbca80428ffbe776650652de86a3bba885edb31)