Checkout Tools
  • last updated 1 hour ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
OAK-8780 - Remove the synchronized block on the FSBackend

Slightly modified patch from Ankita Agarwal

Moved the copy of file to a temp file outside the synchronized block

  1. … 1 more file in changeset.
fix svn:eol-style
  1. … 4 more files in changeset.
OAK-8280: Add support to request ignoring domain override for signed URIs.

This change introduces BlobUploadOptions so options can be requested for

both upload and download URIs, and adds the option for both URI requests

to ignore the domain override if one is set.

    • ?
    ./blob/datastore/directaccess/package-info.java
  1. … 22 more files in changeset.
OAK-8104: Update to Azure SDK v8.6.0 to fix signed URI C-D headers.

The purpose of this commit is to fix Content-Disposition header support for signed download URIs. The filename* portion of the header specification was disabled in OAK-8013 due to a bug in the Azure SDK pre-8.5.0. This commit adds filename* portion support back into Oak, which addresses the following issues:

- OAK-8104 - Fix the Content-Disposition header correctly (required upgrading the Azure SDK version to 8.6.0)

- OAK-8607 - Undo the workarounds implemented in OAK-8013.

  1. … 5 more files in changeset.
OAK-8807: Update FileCache to use non-cache segment blocking method

- Building the cache without the CacheLoader and using the get method with a valueLoader

  1. … 1 more file in changeset.
OAK-8781: Add debug logs before and after cache purge to get the uploadCache size info

- Added size in the logs when logging purge start and finish

OAK-8786: Remove temporary file on upload immediately after a sync upload

- Delete temporary file after sync upload

  1. … 1 more file in changeset.
OAK-8576: Extend instrumentation for data stores - fix svn:eol-style
  1. … 2 more files in changeset.
OAK-8576: Extend instrumentation for data stores.

This commit adds instrumentation for other methods in data stores, including

support for metrics for SharedDataStore implementations and for direct

binary access functions, as well as improving existing instrumentation for

uploads and downloads. It also adds error counts to aid in identifying

and diagnosing failure conditions in production environments.

    • ?
    ./blob/ExtendedBlobStatsCollector.java
  1. … 7 more files in changeset.
OAK-8676: deprecate FileIOUtils.FileLineDifferenceIterator
  1. … 4 more files in changeset.
OAK-8666: deprecate FileIOUtils.BurnOnCloseFileIterator
  1. … 4 more files in changeset.
fix svn:eol-style
OAK-8612: Make the Azure Data Store compatible with Guava 15 and 26
    • ?
    ./blob/SameThreadExecutorService.java
OAK-8578: Introduce API to check whether blob inlined in Id

OAK-8552: Minimize network calls required when creating a direct download URI

Add a new method #isInlined to Blob class to check if the external blob is id inlined

  1. … 9 more files in changeset.
OAK-8578:Reverting commit r1865962
  1. … 14 more files in changeset.
OAK-8552: Minimize network calls required when creating a direct download URI

Add a new method #isInlined to Blob class to check if the external blob is id inlined

  1. … 14 more files in changeset.
OAK-8298: Add tracking of blob ids added via direct upload

OAK-8463: Fix merge in consistency check to allow paths suffixed to blob ids

- Fix merge to ignore paths if present

  1. … 1 more file in changeset.
OAK-8447: Handle all available references in the DataStore when doing consistency check

- Fixed check for SharedDataStore

OAK-8447: Handle all available references in the DataStore when doing consistency check

close (another) FileReader when done

OAK-8447: Handle all available references in the DataStore when doing consistency check

skip handling specific to SharedDataStore when the BlobStore is not a SharedDataStore

OAK-8446: Enable datastore consistency check after completion of garbage collection

close FileReader when done

OAK-8447: Handle all available references in the DataStore when doing consistency check

- Now if available all reference files will be accounted for when doing consistency check

  1. … 1 more file in changeset.
OAK-8446: Enable datastore consistency check after completion of garbage collection

- Enables datastore consistency in a low cost way after GC

  1. … 5 more files in changeset.
OAK-8261 Indexing lane failing but the index is not marked corrupt
  1. … 1 more file in changeset.
OAK-8261 Indexing lane failing but the index is not marked corrupt (formatting changes)
  1. … 1 more file in changeset.
OAK-8314: BlobIds created with direct uploads lack length suffix

Suffixing length to the ids being returned for for directly uploded binaries

  1. … 1 more file in changeset.
OAK-8115: Allow disabling of BlobTracker when not required

- BlobTracker can be disabled by setting config property snapshotIntervalSecs to 0 or below as this prop needs a sensible non-zero value anyways to be effective

  1. … 7 more files in changeset.
OAK-8013: Disable filename* part of Content-Disposition specification for direct binary access.

  1. … 2 more files in changeset.
OAK-7951: Datastore GC stats not updated with failure when "Not all repositories have marked references available"

Based on patch from Wim Symons

- Bubble up exception in case of not able to run sweep because of not all repositories not having references available

- Mark failure in stats which can then be queried

  1. … 2 more files in changeset.