hadoop-project

Clone Tools
  • last updated 17 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HADOOP-17179. [JDK 11] Fix javadoc error while detecting Java API link (#2186)

Signed-off-by: Mingliang Liu <liuml07@apache.org>

HADOOP-17091. [JDK11] Fix Javadoc errors (#2098)

  1. … 6 more files in changeset.
HADOOP-16866. Upgrade spotbugs to 4.0.6. (#2146)

Updated the index as per 3.3.0 release

    • -198
    • +39
    ./src/site/markdown/index.md.vm
Preparing for 3.3.0 Release

  1. … 110 more files in changeset.
HDFS-15374. Add documentation for fedbalance tool. Contributed by Jinglun.

  1. … 3 more files in changeset.
HADOOP-17094. vulnerabilities reported in jackson and jackson-databind in branch-2.10. Contributed by Ahmed Hussein.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

HADOOP-17089: WASB: Update azure-storage-java SDK Contributed by Thomas Marquardt

DETAILS: WASB depends on the Azure Storage Java SDK. There is a concurrency

bug in the Azure Storage Java SDK that can cause the results of a list blobs

operation to appear empty. This causes the Filesystem listStatus and similar

APIs to return empty results. This has been seen in Spark work loads when jobs

use more than one executor core.

See Azure/azure-storage-java#546 for details on the bug in the Azure Storage SDK.

TESTS: A new test was added to validate the fix. All tests are passing:

wasb:

mvn -T 1C -Dparallel-tests=wasb -Dscale -DtestsThreadCount=8 clean verify

Tests run: 248, Failures: 0, Errors: 0, Skipped: 11

Tests run: 651, Failures: 0, Errors: 0, Skipped: 65

abfs:

mvn -T 1C -Dparallel-tests=abfs -Dscale -DtestsThreadCount=8 clean verify

Tests run: 64, Failures: 0, Errors: 0, Skipped: 0

Tests run: 437, Failures: 0, Errors: 0, Skipped: 33

Tests run: 206, Failures: 0, Errors: 0, Skipped: 24

  1. … 1 more file in changeset.
HADOOP-17089: WASB: Update azure-storage-java SDK Contributed by Thomas Marquardt

DETAILS: WASB depends on the Azure Storage Java SDK. There is a concurrency

bug in the Azure Storage Java SDK that can cause the results of a list blobs

operation to appear empty. This causes the Filesystem listStatus and similar

APIs to return empty results. This has been seen in Spark work loads when jobs

use more than one executor core.

See Azure/azure-storage-java#546 for details on the bug in the Azure Storage SDK.

TESTS: A new test was added to validate the fix. All tests are passing:

wasb:

mvn -T 1C -Dparallel-tests=wasb -Dscale -DtestsThreadCount=8 clean verify

Tests run: 248, Failures: 0, Errors: 0, Skipped: 11

Tests run: 651, Failures: 0, Errors: 0, Skipped: 65

abfs:

mvn -T 1C -Dparallel-tests=abfs -Dscale -DtestsThreadCount=8 clean verify

Tests run: 64, Failures: 0, Errors: 0, Skipped: 0

Tests run: 437, Failures: 0, Errors: 0, Skipped: 33

Tests run: 206, Failures: 0, Errors: 0, Skipped: 24

  1. … 1 more file in changeset.
HADOOP-17089: WASB: Update azure-storage-java SDK Contributed by Thomas Marquardt

DETAILS: WASB depends on the Azure Storage Java SDK. There is a concurrency

bug in the Azure Storage Java SDK that can cause the results of a list blobs

operation to appear empty. This causes the Filesystem listStatus and similar

APIs to return empty results. This has been seen in Spark work loads when jobs

use more than one executor core.

See Azure/azure-storage-java#546 for details on the bug in the Azure Storage SDK.

TESTS: A new test was added to validate the fix. All tests are passing:

$mvn -T 1C -Dparallel-tests=wasb -Dscale -DtestsThreadCount=8 clean verify

Tests run: 231, Failures: 0, Errors: 0, Skipped: 4

Tests run: 588, Failures: 0, Errors: 0, Skipped: 12

Tests run: 3, Failures: 0, Errors: 0, Skipped: 0

$mvn -T 1C -Dparallel-tests=abfs -Dscale -DtestsThreadCount=8 clean verify

Tests run: 37, Failures: 0, Errors: 0, Skipped: 0

Tests run: 407, Failures: 0, Errors: 0, Skipped: 34

Tests run: 151, Failures: 0, Errors: 0, Skipped: 19

Tests run: 206, Failures: 0, Errors: 0, Skipped: 24

  1. … 1 more file in changeset.
HDFS-15346. FedBalance tool implementation. Contributed by Jinglun.

  1. … 42 more files in changeset.
HDFS-15330. Document the ViewFSOverloadScheme details in ViewFS guide. Contributed by Uma Maheswara Rao G.

(cherry picked from commit 76fa0222f0d2e2d92b4a1eedba8b3e38002e8c23)

(cherry picked from commit 418580446b65be3a0674762e76fc2cb9a1e5629a)

  1. … 4 more files in changeset.
HDFS-15330. Document the ViewFSOverloadScheme details in ViewFS guide. Contributed by Uma Maheswara Rao G.

  1. … 4 more files in changeset.
HDFS-15330. Document the ViewFSOverloadScheme details in ViewFS guide. Contributed by Uma Maheswara Rao G.

(cherry picked from commit 76fa0222f0d2e2d92b4a1eedba8b3e38002e8c23)

(cherry picked from commit 418580446b65be3a0674762e76fc2cb9a1e5629a)

  1. … 4 more files in changeset.
HDFS-15330. Document the ViewFSOverloadScheme details in ViewFS guide. Contributed by Uma Maheswara Rao G.

(cherry picked from commit 76fa0222f0d2e2d92b4a1eedba8b3e38002e8c23)

  1. … 4 more files in changeset.
HADOOP-17049. javax.activation-api and jakarta.activation-api define overlapping classes (#2027)

* Removed javax.activation-api from dependency

(cherry picked from commit 52b21de1d8857151461341fbcf2fdb38c64485b1)

  1. … 3 more files in changeset.
HADOOP-17049. javax.activation-api and jakarta.activation-api define overlapping classes (#2027)

* Removed javax.activation-api from dependency

  1. … 3 more files in changeset.
YARN-10265. Upgrade Netty-all dependency to latest version 4.1.50 to fix ARM support issue. Contributed by liusheng

  1. … 3 more files in changeset.
YARN-10265. Upgrade Netty-all dependency to latest version 4.1.50 to fix ARM support issue. Contributed by liusheng

  1. … 3 more files in changeset.
YARN-10265. Upgrade Netty-all dependency to latest version 4.1.50 to fix ARM support issue. Contributed by liusheng

  1. … 3 more files in changeset.
YARN-9898. Dependency netty-all-4.1.27.Final doesn't support ARM platform. Contributed by liusheng.

  1. … 3 more files in changeset.
YARN-9898. Dependency netty-all-4.1.27.Final doesn't support ARM platform. Contributed by liusheng.

  1. … 3 more files in changeset.
YARN-9898. Dependency netty-all-4.1.27.Final doesn't support ARM platform. Contributed by liusheng.

  1. … 3 more files in changeset.
HADOOP-17033. Update commons-codec from 1.11 to 1.14. (#2000)

Preparing for 3.3.1 development

  1. … 110 more files in changeset.
Preparing for 3.1.4 release

Change-Id: Ibde183eb466eda4210c0e3ee77dcd27672d337cd

  1. … 96 more files in changeset.
Preparing for 3.1.5 development

Change-Id: Iabc64aba7392e3b6f9e4e18109fcaa2cfc01d1f9

  1. … 96 more files in changeset.
HADOOP-17014. Upgrade jackson-databind to 2.9.10.4 (#1981)

(cherry picked from commit 9aef65cdb2a299ba42f1f4a85fcaa4def25462f1)

HADOOP-17014. Upgrade jackson-databind to 2.9.10.4 (#1981)

HADOOP-16959. Resolve hadoop-cos dependency conflict. Contributed by Yang Yu.

(cherry picked from commit 82ff7bc9abc8f3ad549db898953d98ef142ab02d)

  1. … 16 more files in changeset.