Clone Tools
  • last updated 24 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Revert "HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang."

This reverts commit d4ca1c5226521c4f9c609bb8ec9f64a63bd8bef1.

-JsonUtil not reverted. A later commit in httpfs uses the new methods.

-jackson databind was introduced in pom.xml. This is not reverted as

later changes are using it.

  1. … 3 more files in changeset.
HDFS-15066. HttpFS: Implement setErasureCodingPolicy , unsetErasureCodingPolicy , getErasureCodingPolicy. Contributed by hemanthboyina.

  1. … 6 more files in changeset.
HDFS-15063. HttpFS: getFileStatus doesn't return ecPolicy. Contributed by hemanthboyina.

  1. … 4 more files in changeset.
HADOOP-15691 Add PathCapabilities to FileSystem and FileContext.

Contributed by Steve Loughran.

This complements the StreamCapabilities Interface by allowing applications to probe for a specific path on a specific instance of a FileSystem client

to offer a specific capability.

This is intended to allow applications to determine

* Whether a method is implemented before calling it and dealing with UnsupportedOperationException.

* Whether a specific feature is believed to be available in the remote store.

As well as a common set of capabilities defined in CommonPathCapabilities,

file systems are free to add their own capabilities, prefixed with

fs. + schema + .

The plan is to identify and document more capabilities -and for file systems which add new features, for a declaration of the availability of the feature to always be available.

Note

* The remote store is not expected to be checked for the feature;

It is more a check of client API and the client's configuration/knowledge

of the state of the remote system.

* Permissions are not checked.

Change-Id: I80bfebe94f4a8bdad8f3ac055495735b824968f5

  1. … 39 more files in changeset.
HDFS-8631. WebHDFS : Support setQuota. Contributed by Chao Sun.

    • -0
    • +44
    ./resources/NameSpaceQuotaParam.java
    • -0
    • +45
    ./resources/StorageSpaceQuotaParam.java
    • -0
    • +37
    ./resources/StorageTypeParam.java
  1. … 9 more files in changeset.
HDFS-14423. Percent (%) and plus (+) characters no longer work in WebHDFS.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

(cherry picked from commit da0006fe0473e353ee2d489156248a01aa982dfd)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java

(cherry picked from commit d7ca016d63d89e5c8377a035f93485a7c77c3430)

  1. … 5 more files in changeset.
HDFS-14423. Percent (%) and plus (+) characters no longer work in WebHDFS.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

  1. … 5 more files in changeset.
HDFS-14423. Percent (%) and plus (+) characters no longer work in WebHDFS.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

(cherry picked from commit da0006fe0473e353ee2d489156248a01aa982dfd)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java

  1. … 5 more files in changeset.
HDFS-14423. Percent (%) and plus (+) characters no longer work in WebHDFS.

Signed-off-by: Masatake Iwasaki <iwasakims@apache.org>

(cherry picked from commit da0006fe0473e353ee2d489156248a01aa982dfd)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java

(cherry picked from commit d7ca016d63d89e5c8377a035f93485a7c77c3430)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/web/WebHdfsFileSystem.java

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeHttpServer.java

hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/web/resources/NamenodeWebHdfsMethods.java

hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsUrl.java

  1. … 5 more files in changeset.
HDFS-14034. Support getQuotaUsage API in WebHDFS. Contributed by Chao Sun.

  1. … 9 more files in changeset.
HDFS-14462 Ensure WebHDFS client throws the correct exception during writes. Contributed by Simbarashe Dzinamarira.

  1. … 1 more file in changeset.
HDFS-14462 Ensure WebHDFS client throws the correct exception during writes. Contributed by Simbarashe Dzinamarira.

(cherry picked from e7a0b8aa83c1fb933d409c514d2155e986e4e25b)

(cherry picked from ba4ca7d996cafa1b1786249cae2b207f0eaa1070)

  1. … 1 more file in changeset.
HDFS-14462 Ensure WebHDFS client throws the correct exception during writes. Contributed by Simbarashe Dzinamarira.

(cherry picked from e7a0b8aa83c1fb933d409c514d2155e986e4e25b)

(cherry picked from ba4ca7d996cafa1b1786249cae2b207f0eaa1070)

(cherry picked from da548cf263c699932e5a6b60e00893f857713bcf)

(cherry picked from 055f824bcbeb82ee7eb49576ca7b9446dccea401)

  1. … 1 more file in changeset.
HDFS-14462 Ensure WebHDFS client throws the correct exception during writes. Contributed by Simbarashe Dzinamarira.

(cherry picked from e7a0b8aa83c1fb933d409c514d2155e986e4e25b)

  1. … 1 more file in changeset.
HDFS-14462 Ensure WebHDFS client throws the correct exception during writes. Contributed by Simbarashe Dzinamarira.

(cherry picked from e7a0b8aa83c1fb933d409c514d2155e986e4e25b)

(cherry picked from ba4ca7d996cafa1b1786249cae2b207f0eaa1070)

(cherry picked from da548cf263c699932e5a6b60e00893f857713bcf)

  1. … 1 more file in changeset.
HDFS-14686. HttpFS: HttpFSFileSystem#getErasureCodingPolicy always returns null (#1192) Contributed by Siyao Meng.

(cherry picked from commit 17e8cf501b384af93726e4f2e6f5e28c6e3a8f65)

  1. … 3 more files in changeset.
HDFS-14686. HttpFS: HttpFSFileSystem#getErasureCodingPolicy always returns null (#1192) Contributed by Siyao Meng.

(cherry picked from commit 17e8cf501b384af93726e4f2e6f5e28c6e3a8f65)

  1. … 3 more files in changeset.
HDFS-14686. HttpFS: HttpFSFileSystem#getErasureCodingPolicy always returns null (#1192) Contributed by Siyao Meng.

  1. … 3 more files in changeset.
HDFS-14034. Support getQuotaUsage API in WebHDFS. Contributed by Chao Sun.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from 3ae775d74029b6ae82263739f598ceb25c597dcd)

  1. … 9 more files in changeset.
HDFS-14034. Support getQuotaUsage API in WebHDFS. Contributed by Chao Sun.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from 3ae775d74029b6ae82263739f598ceb25c597dcd)

(cherry picked from d38b617baaf10cb35f3a8eba904b930a142a071e)

  1. … 9 more files in changeset.
HDFS-14034. Support getQuotaUsage API in WebHDFS. Contributed by Chao Sun.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from 3ae775d74029b6ae82263739f598ceb25c597dcd)

(cherry picked from d38b617baaf10cb35f3a8eba904b930a142a071e)

(cherry picked from 90447baeb0c82d2602282c7369de2b603e16a93f)

  1. … 9 more files in changeset.
HDFS-14034. Support getQuotaUsage API in WebHDFS. Contributed by Chao Sun.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

  1. … 9 more files in changeset.
HDFS-14434. Ignore user.name query parameter in secure WebHDFS. Contributed by KWON BYUNGCHANG

  1. … 4 more files in changeset.
HDFS-14434. Ignore user.name query parameter in secure WebHDFS. Contributed by KWON BYUNGCHANG

(cherry picked from commit d78854b928bb877f26b11b5b212a100a79941f35)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java

  1. … 4 more files in changeset.
HDFS-14434. Ignore user.name query parameter in secure WebHDFS. Contributed by KWON BYUNGCHANG

(cherry picked from commit d78854b928bb877f26b11b5b212a100a79941f35)

Conflicts:

hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsTokens.java

(cherry picked from commit ba6b3a384863b57bc7eeeb736950f544e6ed8d6d)

  1. … 4 more files in changeset.
HDFS-14323. Distcp fails in Hadoop 3.x when 2.x source webhdfs url has special characters in hdfs file path. Contributed by Srinivasu Majeti.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 3e5e5b028ad7e199d08e524fe7cddeee5db51a6d)

(cherry picked from commit 85f3664bb84f393f8006d3ab781d8ce5ebb1ab62)

HDFS-14323. Distcp fails in Hadoop 3.x when 2.x source webhdfs url has special characters in hdfs file path. Contributed by Srinivasu Majeti.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 3e5e5b028ad7e199d08e524fe7cddeee5db51a6d)

HDFS-14323. Distcp fails in Hadoop 3.x when 2.x source webhdfs url has special characters in hdfs file path. Contributed by Srinivasu Majeti.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HDFS-14037. Fix SSLFactory truststore reloader thread leak in URLConnectionFactory.

(cherry picked from commit 55fb3c32fb48ca26a629d4d5f3f07e2858d09594)

    • -0
    • +72
    ./SSLConnectionConfigurator.java
  1. … 3 more files in changeset.
HDFS-14037. Fix SSLFactory truststore reloader thread leak in URLConnectionFactory.

    • -0
    • +72
    ./SSLConnectionConfigurator.java
  1. … 3 more files in changeset.