Checkout Tools
  • last updated 2 hours ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
OAK-8552: Add data store config to skip exists check on download URI generation

This change adds a new optional configuration parameter for AzureDataStore and S3DataStore. The new parameter, named "presignedHttpDownloadURIVerifyExists", has a default value of true which means the createHttpDownloadURI() method will ensure the requested blob exists in blob storage before creating the signed download URI. If this parameter is set to false, the exists check will be skipped, resulting in higher signed download URI generation performance but potentially returning a URI to a nonexistent blob in some cases (see OAK-7998).

  1. … 7 more files in changeset.
OAK-8335: get rid of junit deprecation warnings
  1. … 44 more files in changeset.
OAK-7807: Fix S3 bucket cleanup in tests.

Two approaches used to accomplish this:

- Backdate the test start date by one minute to account for drift between test system and S3

- Remember all created buckets and verify deletion at the end of the test suite

OAK-7738: Add method to check for existence of metadata in SharedDataStore

- Added a new method to the ShareDataStore and implementations

  1. … 13 more files in changeset.
OAK-7737: Add edge cases checks and tests for metadata related methods S3/FileDataStore

- Added tests for metadata operations

  1. … 5 more files in changeset.
OAK-7569: Direct Binary Access

Blob APIs and S3/Azure implementation for direct binary upload/download. Modified patch from Matt Ryan

    • ?
    ./s3/S3DataRecordAccessProviderIT.java
    • ?
    ./s3/S3DataRecordAccessProviderTest.java
  1. … 25 more files in changeset.
OAK-6841: Revert Changes made in OAK-6575 before 1.7.10 is released

reverting r1811179

    • ?
    ./aws/s3/CloudFrontS3SignedUrlProviderTest.java
  1. … 3 more files in changeset.
OAK-6841: Revert Changes made in OAK-6575 before 1.7.10 is released

reverting r1811183

    • ?
    ./aws/s3/CloudFrontS3SignedUrlProviderTest.java
  1. … 2 more files in changeset.
OAK-6802: Manage 'secret' property internally in S3/AzureDataStore

S3 implementation to manage the secret property internally and remove the need to be configured

  1. … 2 more files in changeset.
OAK-6575: Provide a secure external URL to a DataStore binary

- Moved classes from org.apache.jackrabbit.oak.blob.cloud.aws.s3 to org.apache.jackrabbit.oak.blob.cloud.s3

    • ?
    ./s3/CloudFrontS3SignedUrlProviderTest.java
    • ?
    ./aws/s3/CloudFrontS3SignedUrlProviderTest.java
  1. … 2 more files in changeset.
OAK-6575: Provide a secure external URL to a DataStore binary

Patch from Ian Boston

    • ?
    ./aws/s3/CloudFrontS3SignedUrlProviderTest.java
  1. … 5 more files in changeset.
OAK-6603: [oak-blob-cloud] Remove the older S3 connector relying on JR caching

- Removing unused code and removing references from tests/utils/services etc

  1. … 11 more files in changeset.
OAK-6374: S3Backend masks actual thrown error when problem in filtering properties

- Fixed by not using Maps.fromProperties

- Logging error before filtering also instead of debug

  1. … 3 more files in changeset.
OAK-6242: Add 'container' as an acceptable property name for s3 bucket

- Now s3 bucket can also be specified using the container property

  1. … 3 more files in changeset.
OAK-6230: Minor cleanup for S3 tests

- Changed config param to s3.config to align with azure config

- Fixed closing of the input stream

OAK-6050: Unify used version of osgi-mock

Original patch provided by rombert@apache.org

  1. … 19 more files in changeset.
OAK-5827: Don't use SHA-1 for new DataStore binaries

- Uses SHA-256 for binaries

- Removed references to SHA-1 and fix tests.

- Uses JR2 AbstractDataStore DIGEST property to get the digest algorithm to be used.

  1. … 4 more files in changeset.
OAK-5146: S3 getOrCreateReferenceKey() should provide a default implementation

* Delegating to super.getOrCreateReferenceKey() to use a transient key when secret not configured

* Tests

  1. … 1 more file in changeset.
OAK-5109: [Test] Ignore if config properties file not available

Ignoring and returning empty properties

OAK-4870: removed surplus semicolon causing Eclipse compilation failure (trivial)
OAK-4870: Implement caching for S3DataStore

@trivial Ignoring the right tests

OAK-4870: Implement caching for S3DataStore

* Use fix for getReference() for S3DataStore

* Added test for reference when secret not available.

* Throwing exception when secret not available.

  1. … 2 more files in changeset.
OAK-4870: Implement caching for S3DataStore

S3DataStore implementation using AbstractCachingDataStore

  1. … 8 more files in changeset.
OAK-4848: Improve oak-blob-cloud tests

Fix s3 bucket cleanup

  1. … 1 more file in changeset.
OAK-4848: Improve oak-blob-cloud tests

Made tests parametrized on S3 implementation class

Use the same logic in all test to initialize S3DataStore

Rearranged packages for classes

  1. … 12 more files in changeset.
OAK-4838: Move S3 classes to oak-blob-cloud module

Refactor packages for common classes

  1. … 16 more files in changeset.
OAK-4848: Improve oak-blob-cloud tests

* Inherit tests from base class copied from JR2

* Move initialization and check to S3DataStoreUtils. Can now be used with the same mechanism as already available directly with system properties

* Add standard @Before/@After annotations to setup/tearDown test cases

  1. … 2 more files in changeset.
OAK-4838: Move S3 classes to oak-blob-cloud module

* Module dependency flipped to oak-core -> oak-blob-cloud

* S3 classes moved to oak-blob-cloud

* Moved some S3 tests to oak-it

  1. … 33 more files in changeset.
fix svn:eol-style
  1. … 10 more files in changeset.
OAK-4527: [oak-blob-cloud] Access parameters configured leak out in the exception message

Enabling test and removed extraneous code in test

  1. … 1 more file in changeset.