Clone
 

gabor bota <gabor.bota@cloudera.com> in hadoop

HADOOP-16709. S3Guard: Make authoritative mode exclusive for metadata - don't check for expiry for authoritative paths (#1721). Contributed by Gabor Bota.

HADOOP-16484. S3A to warn or fail if S3Guard is disabled - addendum: silent for S3GuardTool (#1714). Contributed by Gabor Bota.

Change-Id: I63b928ef5da425ef982dd4100a426fc23f64bac1

HADOOP-16484. S3A to warn or fail if S3Guard is disabled (#1661). Contributed by Gabor Bota.

HADOOP-16653. S3Guard DDB overreacts to no tag access (#1660). Contributed by Gabor Bota.

HADOOP-16520. Race condition in DDB table init and waiting threads. (#1576). Contributed by Gabor Bota.

Fixes HADOOP-16349. DynamoDBMetadataStore.getVersionMarkerItem() to log at info/warn on retry

Change-Id: Ia83e92b9039ccb780090c99c41b4f71ef7539d35

HDFS-14874. Fix TestHDFSCLI and TestDFSShell test break because of logging change in mkdir (#1522). Contributed by Gabor Bota.

HADOOP-16138. hadoop fs mkdir / of nonexistent abfs container raises NPE (#1302). Contributed by Gabor Bota.

Change-Id: I2f637865c871e400b95fe7ddaa24bf99fa192023

HADOOP-16565. Region must be provided when requesting session credentials or SdkClientException will be thrown (#1454). Contributed by Gabor Bota.

HADOOP-16566. S3Guard fsck: Use org.apache.hadoop.util.StopWatch instead of com.google.common.base.Stopwatch (#1433). Contributed by Gabor Bota.

Change-Id: Ied43ef1522dfc6a1210d6fc58c38d8208824931b

HADOOP-16423. S3Guard fsck: Check metadata consistency between S3 and metadatastore (log) (#1208). Contributed by Gabor Bota.

Change-Id: I6bbb331b6c0a41c61043e482b95504fda8a50596

HADOOP-16433. S3Guard: Filter expired entries and tombstones when listing with MetadataStore.listChildren().

Contributed by Gabor Bota.

This pulls the tracking of the lastUpdated timestamp of metadata entries up from the DDB metastore into all s3guard stores, and then uses this to filter out expired tombstones from listings.

Change-Id: I80f121236b49c75a024116f65a3ef29d3580b462

HADOOP-16383. Pass ITtlTimeProvider instance in initialize method in MetadataStore interface. Contributed by Gabor Bota. (#1009)

  1. … 4 more files in changeset.
HADOOP-16279. S3Guard: Implement time-based (TTL) expiry for entries (and tombstones).

Contributed by Gabor Bota.

Change-Id: I73a2d2861901dedfe7a0e783b310fbb95e7c1af9

  1. … 7 more files in changeset.
HADOOP-16237. Fix new findbugs issues after updating guava to 27.0-jre.

Author: Gabor Bota <gabor.bota@cloudera.com>

HADOOP-16220. Add findbugs ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project

This closes #665

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

(cherry picked from commit 53a86e2b8ecb83b666d4ed223fc270e1a46642c1)

HADOOP-16220. Add findbugs ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project

This closes #665

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

(cherry picked from commit 53a86e2b8ecb83b666d4ed223fc270e1a46642c1)

HADOOP-16220. Add findbugs ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project

This closes #665

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

HADOOP-16220. Add findbugs ignores for unjustified issues during update to guava to 27.0-jre in hadoop-project

This closes #665

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

(cherry picked from commit 53a86e2b8ecb83b666d4ed223fc270e1a46642c1)

HADOOP-15999. S3Guard: Better support for out-of-band operations.

Author: Gabor Bota

HADOOP-16186. S3Guard: NPE in DynamoDBMetadataStore.lambda$listChildren.

Author: Gabor Bota

HADOOP-16043. NPE in ITestDynamoDBMetadataStore when fs.s3a.s3guard.ddb.table is not set.

Contributed by Gabor Bota.

HADOOP-16000. Remove TLSv1 and SSLv2Hello from the default value of hadoop.ssl.enabled.protocols

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

HADOOP-16210. Update guava to 27.0-jre in hadoop-project trunk. Contributed by Gabor Bota.

HADOOP-15709 Move S3Guard LocalMetadataStore constants to org.apache.hadoop.fs.s3a.Constants (Contributed by Gabor Bota)

HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

(cherry picked from commit c36b4aa31ce25fbe5fa173bce36da2950d74a475)

HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

HADOOP-15236. Fix typo in RequestHedgingProxyProvider and RequestHedgingRMFailoverProxyProvider

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>

(cherry picked from commit c36b4aa31ce25fbe5fa173bce36da2950d74a475)

(cherry picked from commit b8942cb3bf4a458c78654bc166447806523409b5)