Clone Tools
  • last updated 17 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[ASTERIXDB-2171][STO] Remove Temporary Datasets

- user model changes: no

- storage format changes: no

- interface changes: yes

- Removed all reference to temporary datasets.

Details:

- Remove temporary datasets grammar but reserve

<TEMPORARY> token.

- Remove special callbacks for temp datasets.

- Remove metadata garbage collector thread.

- Remove isTemp flag from datasets.

- Remove special storage path for temp datasets.

- Remove temp datasets test cases.

Change-Id: Ib50ea27e2ec9c114508cd4a109cf646e2f20dcb0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2172

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -52
    • +0
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.1.ddl.aql
    • -31
    • +0
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.2.update.aql
    • -30
    • +0
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.3.ddl.aql
    • -28
    • +0
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.4.update.aql
    • -31
    • +0
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.5.query.aql
    • -52
    • +0
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.1.ddl.aql
    • -33
    • +0
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.2.update.aql
    • -30
    • +0
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.3.query.aql
    • -75
    • +0
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.ddl.aql
    • -25
    • +0
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.2.update.aql
    • -28
    • +0
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.3.query.aql
    • -32
    • +0
    ./drop-index/drop-index.2.update.aql
    • -30
    • +0
    ./drop-index/drop-index.4.query.aql
  1. … 355 more files in changeset.
[ASTERIXDB-1946][STO][IDX] Create BTreeIndex for Correlated Datasets

Implemented create seconary BTree index for datasets using

correlated merge policy. Instead of creating one component

for the new index, this change creates one component for each

component of the primary index to maintain the correlation.

The current implementation assumes when a secondary index is being

created, the dataset is locked with no modifications.

Change-Id: I2a3435e6720f07bd6a5092d4d9ce42e8d4b7894c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1813

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +39
    ./insert-and-scan-dataset-with-correlated-index/insert-and-scan-dataset-with-correlated-index.1.ddl.aql
    • -0
    • +42
    ./insert-and-scan-dataset-with-correlated-index/insert-and-scan-dataset-with-correlated-index.2.update.aql
    • -0
    • +28
    ./insert-and-scan-dataset-with-correlated-index/insert-and-scan-dataset-with-correlated-index.3.ddl.aql
    • -0
    • +30
    ./insert-and-scan-dataset-with-correlated-index/insert-and-scan-dataset-with-correlated-index.4.query.aql
  1. … 117 more files in changeset.
Fix open field CREATE INDEX syntax (AQL and SQLPP).

Our CREATE INDEX syntax for open fields didn't match our semantics.

Our semantics allow to-be-indexed open field(s) to be MISSING.

We don't support (or offer :-)) tighter semantics than that.

Our syntax didn't require creators to say this, but now it does:

Old: CREATE INDEX myIdx on MyDSet(myTime: datetime) ENFORCED;

New: CREATE INDEX myIdx on MyDSet(myTime: datetime?) ENFORCED;

Have now addressed all of Till's comments (I think).

Change-Id: I32bf8bc5ac1c0e6aa6744ca8f91a197311219814

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1106

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -3
    • +3
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.ddl.aql
  1. … 787 more files in changeset.
Hard Tabs++

Eliminate more hard tabs, widen scope of checkstyle rules to prevent regressions.

Relax whitespace expectations in polygon ctor

Change-Id: Ia3f78fc6705bc79a21cfa97fdfcad30998ab1058

Reviewed-on: https://asterix-gerrit.ics.uci.edu/967

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -6
    • +6
    ./insert-and-scan-dataset-with-index/insert-and-scan-dataset-with-index.2.update.aql
    • -4
    • +4
    ./insert-and-scan-dataset/insert-and-scan-dataset.2.update.aql
    • -6
    • +6
    ./scan-insert-persistent-to-temp/scan-insert-persistent-to-temp.4.update.aql
    • -6
    • +6
    ./scan-insert-rtree-secondary-index/scan-insert-rtree-secondary-index.4.update.aql
    • -6
    • +6
    ./scan-insert-temp-to-persistent/scan-insert-temp-to-persistent.4.update.aql
  1. … 451 more files in changeset.
Move merged files

    • -0
    • +67
    ./temp_primary_plus_ngram_flush/temp_primary_plus_ngram_flush.1.ddl.aql
    • -0
    • +46
    ./temp_primary_plus_ngram_flush/temp_primary_plus_ngram_flush.2.update.aql
    • -0
    • +29
    ./temp_primary_plus_ngram_flush/temp_primary_plus_ngram_flush.3.query.aql
  1. … 161 more files in changeset.