hadoop

Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
HDDS-1749 : Ozone Client should randomize the list of nodes in pipeline for reads. (#1124)

HDDS-1850. ReplicationManager should consider inflight replication and deletion while picking datanode for re-replication.

Signed-off-by: Anu Engineer <aengineer@apache.org>

(cherry picked from commit 2b1d8aedbb669cf412465bf7a5762c8aeda52faa)

HDDS-1850. ReplicationManager should consider inflight replication and deletion while picking datanode for re-replication.

Signed-off-by: Anu Engineer <aengineer@apache.org>

HDFS-14647. NPE during secure namenode startup. Contributed by Fengnan Li.

HADOOP-16451. Update jackson-databind to 2.9.9.1. Contributed by Siyao Meng.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

HADOOP-16451. Update jackson-databind to 2.9.9.1. Contributed by Siyao Meng.

Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>

(cherry picked from commit 9b8b3acb0a2b87356056c23f3d0f30a97a38cd3d)

Conflicts:

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp/pom.xml

HDFS-14370. Add exponential backoff to the edit log tailer to avoid spinning on empty edit tail requests. Contributed by Erik Krogen.

(cherry picked from 827dbb11e24be294b40088a8aa46086ba8ca4ba8)

(cherry picked from 016aa139406d1a151fbec3fb8912eb08e0f638d7)

HDFS-14370. Add exponential backoff to the edit log tailer to avoid spinning on empty edit tail requests. Contributed by Erik Krogen.

HDFS-14370. Add exponential backoff to the edit log tailer to avoid spinning on empty edit tail requests. Contributed by Erik Krogen.

(cherry picked from 827dbb11e24be294b40088a8aa46086ba8ca4ba8)

(cherry picked from 016aa139406d1a151fbec3fb8912eb08e0f638d7)

(cherry picked from f6ce2f4a50898b16556089fe18a6717a15570d85)

(cherry picked from 5657e45fb2b904bb31a4e3b70a360477ba288c15)

HDFS-14370. Add exponential backoff to the edit log tailer to avoid spinning on empty edit tail requests. Contributed by Erik Krogen.

(cherry picked from 827dbb11e24be294b40088a8aa46086ba8ca4ba8)

(cherry picked from 016aa139406d1a151fbec3fb8912eb08e0f638d7)

(cherry picked from f6ce2f4a50898b16556089fe18a6717a15570d85)

HDFS-14370. Add exponential backoff to the edit log tailer to avoid spinning on empty edit tail requests. Contributed by Erik Krogen.

(cherry picked from 827dbb11e24be294b40088a8aa46086ba8ca4ba8)

HDDS-1819. Implement S3 Commit MPU request to use Cache and DoubleBuffer. (#1140)

HDDS-1817. GetKey fails with IllegalArgumentException.

Signed-off-by: Anu Engineer <aengineer@apache.org>

(cherry picked from commit 2546e6ece240924af2188bb39b3954a4896e4a4f)

HDDS-1817. GetKey fails with IllegalArgumentException.

Signed-off-by: Anu Engineer <aengineer@apache.org>

HDDS-1853. Fix failing blockade test-cases. (#1151)

HDDS-1853. Fix failing blockade test-cases. (#1151)

(cherry picked from commit cb69700ac6b535e108b43f00a61f31712f2cecb2)

HADOOP-16433. S3Guard: Filter expired entries and tombstones when listing with MetadataStore.listChildren().

Contributed by Gabor Bota.

This pulls the tracking of the lastUpdated timestamp of metadata entries up from the DDB metastore into all s3guard stores, and then uses this to filter out expired tombstones from listings.

Change-Id: I80f121236b49c75a024116f65a3ef29d3580b462

HDDS-1848. Fix TestOzoneManagerHA and TestOzoneManagerSnapShotProvider. (#1148)

YARN-9668. UGI conf doesn't read user overridden configurations on RM and NM startup. (Contributed by Jonanthan Hung)

Addendum to fix 3.0 build

HDDS-1845. Fix OMVolumeSetQuota|OwnerRequest#validateAndUpdateCache return response. (#1141)

HADOOP-16380. S3Guard to determine empty directory status for all non-root directories.

Contributed by Steve Loughran and Gabor Bota.

This

* Asks S3Guard to determine the empty directory status.

* Has S3A's root directory rm("/") command to always return false (as abfs does)

* Documents that object stores MAY do this

* Overloads ContractTestUtils.assertDeleted to let assertions declare that the source directory does not need to exist. This stops inconsistencies in directory listings failing a root test.

It avoids a recent regression (HADOOP-16279) where if there was a tombstone above the first element found in a directory listing, the directory would be considered empty, when in fact there were child entries. That could downgrade an rm(path, recursive) to a no-op, while also confusing rename(src, dest), as dest could be mistaken for an empty directory and so permit the copy above it, rather than reject it "destination path exists and is not empty".

Change-Id: I136a3d1a5a48a67e6155d790a40ff558d0d2c108

HDDS-1710. Fix checkstyle errors

Signed-off-by: Anu Engineer <aengineer@apache.org>

(cherry picked from commit 278390f5bf9287dd9e91d0fb9a600618eaecd2b9)

HDDS-1710. Fix checkstyle errors

Signed-off-by: Anu Engineer <aengineer@apache.org>

HDFS-13693. Remove unnecessary search in INodeDirectory.addChild during image loading. Contributed by Lisheng Sun.

(cherry picked from commit 377f95bbe8d2d171b5d7b0bfa7559e67ca4aae46)

(cherry picked from commit e3f54a7babf942efbe879aabef65a5b6df57fb65)

HDFS-13693. Remove unnecessary search in INodeDirectory.addChild during image loading. Contributed by Lisheng Sun.

(cherry picked from commit 377f95bbe8d2d171b5d7b0bfa7559e67ca4aae46)

HDFS-13693. Remove unnecessary search in INodeDirectory.addChild during image loading. Contributed by Lisheng Sun.

HDDS-1846. Default value for checksum bytes is different in ozone-site.xml and code.

Signed-off-by: Anu Engineer <aengineer@apache.org>

HDDS-1846. Default value for checksum bytes is different in ozone-site.xml and code.

Signed-off-by: Anu Engineer <aengineer@apache.org>

(cherry picked from commit fbe2fc65805d60e551b8f4fdfc0d07dc0f026985)

HDDS-1686. Remove check to get from openKeyTable in acl implementatio… (#966)

(cherry picked from commit 2ea71d953b46221f90b38d75a2999056f044471f)

HDDS-1686. Remove check to get from openKeyTable in acl implementatio… (#966)