Clone
 

kai zheng <kai.zheng@intel.com> in hadoop

HADOOP-14993. AliyunOSS: Override listFiles and listLocatedStatus. Contributed Genmao Yu

HADOOP-14993. AliyunOSS: Override listFiles and listLocatedStatus. Contributed Genmao Yu

HADOOP-14964. AliyunOSS: backport Aliyun OSS module to branch-2. Contributed by Sammi Chen

The consolidated commits in this backport are as follows:

HADOOP-14787. AliyunOSS: Implement the `createNonRecursive` operator.

HADOOP-14649. Update aliyun-sdk-oss version to 2.8.1. (Genmao Yu via rchiang)

HADOOP-14194. Aliyun OSS should not use empty endpoint as default. Contributed by Genmao Yu

HADOOP-14466. Remove useless document from TestAliyunOSSFileSystemContract.java. Contributed by Chen Liang.

HADOOP-14458. Add missing imports to TestAliyunOSSFileSystemContract.java. Contributed by Mingliang Liu.

HADOOP-14192. AliyunOSS FileSystem contract test should implement getTestBaseDir(). Contributed by Mingliang Liu

HADOOP-14072. AliyunOSS: Failed to read from stream when seek beyond the download size. Contributed by Genmao Yu

HADOOP-13769. AliyunOSS: update oss sdk version. Contributed by Genmao Yu

HADOOP-14069. AliyunOSS: listStatus returns wrong file info. Contributed by Fei Hui

HADOOP-13768. AliyunOSS: handle the failure in the batch delete operation `deleteDirs`. Contributed by Genmao Yu

HADOOP-14065. AliyunOSS: oss directory filestatus should use meta time. Contributed by Fei Hui

HADOOP-14045. Aliyun OSS documentation missing from website. Contributed by Yiqun Lin.

HADOOP-13723. AliyunOSSInputStream#read() should update read bytes stat correctly. Contributed by Mingliang Liu

HADOOP-13624. Rename TestAliyunOSSContractDispCp. Contributed by Genmao Yu

HADOOP-13591. Unit test failure in TestOSSContractGetFileStatus and TestOSSContractRootDir. Contributed by Genmao Yu

HADOOP-13481. User documents for Aliyun OSS FileSystem. Contributed by Genmao Yu.

HADOOP-12756. Incorporate Aliyun OSS file system implementation. Contributed by Mingfei Shi and Lin Zhou

    • -0
    • +147
    /hadoop-tools/hadoop-aliyun/pom.xml
  1. … 18 more files in changeset.
HDFS-12448. Make sure user defined erasure coding policy ID will not overflow. Contributed by Huafeng Wang

HDFS-12448. Make sure user defined erasure coding policy ID will not overflow. Contributed by Huafeng Wang

HDFS-12448. Make sure user defined erasure coding policy ID will not overflow. Contributed by Huafeng Wang

HDFS-12635. Unnecessary exception declaration of the CellBuffers constructor. Contributed by Huafeng Wang

HDFS-12635. Unnecessary exception declaration of the CellBuffers constructor. Contributed by Huafeng Wang

HDFS-12479. Some misuses of lock in DFSStripedOutputStream. Contributed by Huafeng Wang

HDFS-12479. Some misuses of lock in DFSStripedOutputStream. Contributed by Huafeng Wang

HDFS-12460. Make addErasureCodingPolicy an idempotent operation. Contributed by Sammi Chen

HDFS-12460. Make addErasureCodingPolicy an idempotent operation. Contributed by Sammi Chen

HADOOP-14869. Upgrade Apache Kerby version to v1.0.1. Contributed by Wei Zhou

HADOOP-14869. Upgrade Apache Kerby version to v1.0.1. Contributed by Wei Zhou

HDFS-12395. Support erasure coding policy operations in namenode edit log. Contributed by Sammi Chen

HDFS-12395. Support erasure coding policy operations in namenode edit log. Contributed by Sammi Chen

HDFS-7859. Erasure Coding: Persist erasure coding policies in NameNode. Contributed by Sammi Chen

HDFS-7859. Erasure Coding: Persist erasure coding policies in NameNode. Contributed by Sammi Chen

HDFS-12438. Rename dfs.datanode.ec.reconstruction.stripedblock.threads.size to dfs.datanode.ec.reconstruction.threads. Contributed by Andrew Wang

HDFS-12438. Rename dfs.datanode.ec.reconstruction.stripedblock.threads.size to dfs.datanode.ec.reconstruction.threads. Contributed by Andrew Wang

HDFS-12414. Ensure to use CLI command to enable/disable erasure coding policy. Contributed by Sammi Chen

  1. … 37 more files in changeset.
HDFS-12402. Refactor ErasureCodingPolicyManager and related codes. Contributed by Sammi Chen

HDFS-12402. Refactor ErasureCodingPolicyManager and related codes. Contributed by Sammi Chen

HDFS-12392. Writing striped file failed due to different cell size. Contributed by Sammi Chen

HDFS-12392. Writing striped file failed due to different cell size. Contributed by Sammi Chen

HDFS-12392. Writing striped file failed due to different cell size. Contributed by Sammi Chen

HDFS-12388. A bad error message in DFSStripedOutputStream. Contributed by Huafeng Wang

(cherry picked from commit 5dba54596a1587e0ba5f9f02f40483e597b0df64)

HDFS-12388. A bad error message in DFSStripedOutputStream. Contributed by Huafeng Wang

HDFS-12388. A bad error message in DFSStripedOutputStream. Contributed by Huafeng Wang

HDFS-11964. Decoding inputs should be correctly prepared in pread. Contributed by Takanobu Asanuma