Clone Tools
  • last updated 10 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[ASTERIXDB-2171][STO] Remove Temporary Datasets

- user model changes: no

- storage format changes: no

- interface changes: yes

- Removed all reference to temporary datasets.

Details:

- Remove temporary datasets grammar but reserve

<TEMPORARY> token.

- Remove special callbacks for temp datasets.

- Remove metadata garbage collector thread.

- Remove isTemp flag from datasets.

- Remove special storage path for temp datasets.

- Remove temp datasets test cases.

Change-Id: Ib50ea27e2ec9c114508cd4a109cf646e2f20dcb0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2172

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -53
    • +0
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.1.ddl.sqlpp
    • -30
    • +0
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.2.update.sqlpp
    • -33
    • +0
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.3.ddl.sqlpp
    • -30
    • +0
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.4.update.sqlpp
    • -33
    • +0
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.5.query.sqlpp
    • -53
    • +0
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.1.ddl.sqlpp
    • -32
    • +0
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.2.update.sqlpp
    • -32
    • +0
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.3.query.sqlpp
    • -77
    • +0
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.ddl.sqlpp
    • -25
    • +0
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.2.update.sqlpp
    • -29
    • +0
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.3.query.sqlpp
    • -53
    • +0
    ./drop-index/drop-index.1.ddl.sqlpp
    • -30
    • +0
    ./drop-index/drop-index.2.update.sqlpp
    • -37
    • +0
    ./drop-index/drop-index.3.ddl.sqlpp
    • -32
    • +0
    ./drop-index/drop-index.4.query.sqlpp
  1. … 355 more files in changeset.
[ASTERIXDB-2015][IDX] Introduce Secondary Primary Index

- user model changes: yes. CREATE PRIMARY INDEX

- storage format changes: no

- interface changes: no

details:

- enable the creation of secondary primary indexes storing only PKs

- change the grammar to allow the creation of secondary primary index

- introduce a new rule to fix the outputs of the replicate operator

to match its parents in the final plan

- disallow creating an enforced index on a closed-type field

- disallow creating an index with repeating keys

Change-Id: I59725425ba7c5fe438507dc900f83eaab239d296

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1916

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

    • -0
    • +1
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.3.ddl.sqlpp
    • -0
    • +3
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.ddl.sqlpp
    • -0
    • +1
    ./empty-load-with-index/empty-load-with-index.1.ddl.sqlpp
    • -0
    • +2
    ./insert-and-scan-dataset-with-correlated-index/insert-and-scan-dataset-with-correlated-index.3.ddl.sqlpp
    • -0
    • +1
    ./insert-and-scan-dataset-with-index/insert-and-scan-dataset-with-index.1.ddl.sqlpp
  1. … 84 more files in changeset.
[ASTERIXDB-2050][SQL] Enforce a Semicolon After Each SQL++ Statement

- user model changes: a semicolon must be added after

every SQL++ statement.

- storage format changes: no

- interface changes: no

Details:

- Enforce a semicolon after each SQL++ statement.

- Adapt existing SQL++ test cases to new model.

Change-Id: I27e9e8fde5ff867ab569c8d443ba1522738046e3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1954

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -1
    • +1
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.1.ddl.sqlpp
    • -1
    • +1
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.1.ddl.sqlpp
    • -3
    • +3
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.ddl.sqlpp
    • -1
    • +1
    ./empty-load-with-index/empty-load-with-index.1.ddl.sqlpp
    • -1
    • +1
    ./insert-and-scan-dataset-with-correlated-index/insert-and-scan-dataset-with-correlated-index.1.ddl.sqlpp
    • -1
    • +1
    ./insert-and-scan-dataset-with-index/insert-and-scan-dataset-with-index.1.ddl.sqlpp
    • -1
    • +1
    ./insert-and-scan-dataset/insert-and-scan-dataset.1.ddl.sqlpp
    • -1
    • +1
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.1.ddl.sqlpp
    • -1
    • +1
    ./scan-delete-rtree-secondary-index/scan-delete-rtree-secondary-index.1.ddl.sqlpp
    • -2
    • +2
    ./scan-insert-persistent-to-temp/scan-insert-persistent-to-temp.1.ddl.sqlpp
    • -2
    • +2
    ./scan-insert-rtree-secondary-index/scan-insert-rtree-secondary-index.1.ddl.sqlpp
    • -2
    • +2
    ./scan-insert-temp-to-persistent/scan-insert-temp-to-persistent.1.ddl.sqlpp
  1. … 2065 more files in changeset.
[ASTERIXDB-1753][SQL] Disable auto-plural for group-by.

- user model changes: do not perform auto-scalar-to-plural

transition for variables that are defined prior to a group-by

group clause after the group-by clause.

- storage format changes: no

- interface changes: no

details:

- migrated existing test queries that use auto-plural;

- added a negative test query.

Change-Id: I5d6383fc7453fe7537fc291c3483708b59df3871

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1860

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -22
    • +9
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.3.query.sqlpp
  1. … 261 more files in changeset.
[ASTERIXDB-1946][STO][IDX] Create BTreeIndex for Correlated Datasets

Implemented create seconary BTree index for datasets using

correlated merge policy. Instead of creating one component

for the new index, this change creates one component for each

component of the primary index to maintain the correlation.

The current implementation assumes when a secondary index is being

created, the dataset is locked with no modifications.

Change-Id: I2a3435e6720f07bd6a5092d4d9ce42e8d4b7894c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1813

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +42
    ./insert-and-scan-dataset-with-correlated-index/insert-and-scan-dataset-with-correlated-index.1.ddl.sqlpp
    • -0
    • +35
    ./insert-and-scan-dataset-with-correlated-index/insert-and-scan-dataset-with-correlated-index.2.update.sqlpp
    • -0
    • +30
    ./insert-and-scan-dataset-with-correlated-index/insert-and-scan-dataset-with-correlated-index.3.ddl.sqlpp
    • -0
    • +33
    ./insert-and-scan-dataset-with-correlated-index/insert-and-scan-dataset-with-correlated-index.4.query.sqlpp
  1. … 117 more files in changeset.
Renaming SQL++ core aggregation functions:

- array_xxx -> coll_xxx, which considers nulls and missings,

- array_sql_xxx -> array_xxx, which ignores nulls and missings.

Change-Id: Ie58c31af69094b93ba21df54f90f5fad28998a34

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1236

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -8
    • +8
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.3.query.sqlpp
  1. … 384 more files in changeset.
ASTERIXDB-1539: add aliases for several builtin types and builtin functions.

- tinyint for int8;

- smallint for int16;

- integer(or, int) for int32;

- bigint for int64;

- year_month_duration for year-month-duration;

- day_time_duration for day-time-duration;

- timestamp for datetime;

- double precision for double;

int8, int16, int32, int64, year-month-duration and day-time-duration

is going to be deprecated.

In addition, it

- converts underscores to hypens for SQL++ functions;

- uses "array_" prefix for builtin aggregation functions.

Change-Id: I5c4a933f9775e89c2d503d9ea1cb98c5934d1475

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1199

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -5
    • +5
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.1.ddl.sqlpp
    • -5
    • +5
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.1.ddl.sqlpp
    • -1
    • +1
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.ddl.sqlpp
    • -13
    • +13
    ./drop-index/drop-index.1.ddl.sqlpp
    • -4
    • +4
    ./empty-load-with-index/empty-load-with-index.1.ddl.sqlpp
    • -2
    • +2
    ./insert-and-scan-dataset-with-index/insert-and-scan-dataset-with-index.1.ddl.sqlpp
    • -1
    • +1
    ./insert-and-scan-dataset/insert-and-scan-dataset.1.ddl.sqlpp
    • -4
    • +4
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.1.ddl.sqlpp
    • -8
    • +8
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.3.query.sqlpp
    • -1
    • +1
    ./scan-delete-rtree-secondary-index/scan-delete-rtree-secondary-index.1.ddl.sqlpp
    • -2
    • +2
    ./scan-insert-persistent-to-temp/scan-insert-persistent-to-temp.1.ddl.sqlpp
    • -2
    • +2
    ./scan-insert-rtree-secondary-index/scan-insert-rtree-secondary-index.1.ddl.sqlpp
    • -2
    • +2
    ./scan-insert-temp-to-persistent/scan-insert-temp-to-persistent.1.ddl.sqlpp
  1. … 3549 more files in changeset.
Fix open field CREATE INDEX syntax (AQL and SQLPP).

Our CREATE INDEX syntax for open fields didn't match our semantics.

Our semantics allow to-be-indexed open field(s) to be MISSING.

We don't support (or offer :-)) tighter semantics than that.

Our syntax didn't require creators to say this, but now it does:

Old: CREATE INDEX myIdx on MyDSet(myTime: datetime) ENFORCED;

New: CREATE INDEX myIdx on MyDSet(myTime: datetime?) ENFORCED;

Have now addressed all of Till's comments (I think).

Change-Id: I32bf8bc5ac1c0e6aa6744ca8f91a197311219814

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1106

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -3
    • +3
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.ddl.sqlpp
  1. … 787 more files in changeset.
Renaming: "table"->"dataset", "database"->"dataverse".

Change-Id: Ia80193f08651fc99341d9a8cf156d0feb6d0575f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1036

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -3
    • +3
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.1.ddl.sqlpp
    • -1
    • +1
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.2.update.sqlpp
    • -3
    • +3
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.1.ddl.sqlpp
    • -1
    • +1
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.2.update.sqlpp
    • -3
    • +3
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.ddl.sqlpp
    • -1
    • +1
    ./drop-index/drop-index.2.update.sqlpp
    • -3
    • +3
    ./empty-load-with-index/empty-load-with-index.1.ddl.sqlpp
    • -2
    • +2
    ./empty-load-with-index/empty-load-with-index.2.update.sqlpp
    • -3
    • +3
    ./insert-and-scan-dataset-with-index/insert-and-scan-dataset-with-index.1.ddl.sqlpp
    • -1
    • +1
    ./insert-and-scan-dataset-with-index/insert-and-scan-dataset-with-index.2.update.sqlpp
    • -3
    • +3
    ./insert-and-scan-dataset/insert-and-scan-dataset.1.ddl.sqlpp
    • -1
    • +1
    ./insert-and-scan-dataset/insert-and-scan-dataset.2.update.sqlpp
    • -3
    • +3
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.1.ddl.sqlpp
    • -1
    • +1
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.2.update.sqlpp
  1. … 2760 more files in changeset.
Support SQL-compilant delete syntax.

Change-Id: Ifdd4acf3772cac1a21bb56a7eba4be51abbb5068

Reviewed-on: https://asterix-gerrit.ics.uci.edu/978

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -2
    • +2
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.4.update.sqlpp
    • -2
    • +2
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.2.update.sqlpp
    • -2
    • +2
    ./scan-delete-rtree-secondary-index/scan-delete-rtree-secondary-index.4.update.sqlpp
  1. … 48 more files in changeset.
Use backticks instead of double quotes for delimited identifiers in SQL++.

Change-Id: I2db58d68e8e28befa4105504c261b101fa0285af

Reviewed-on: https://asterix-gerrit.ics.uci.edu/909

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -1
    • +1
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.2.update.sqlpp
    • -1
    • +1
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.2.update.sqlpp
    • -1
    • +1
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.3.query.sqlpp
    • -1
    • +1
    ./drop-index/drop-index.2.update.sqlpp
    • -2
    • +2
    ./empty-load-with-index/empty-load-with-index.2.update.sqlpp
    • -2
    • +2
    ./insert-and-scan-dataset-with-index/insert-and-scan-dataset-with-index.2.update.sqlpp
    • -1
    • +1
    ./insert-and-scan-dataset-with-index/insert-and-scan-dataset-with-index.3.query.sqlpp
    • -1
    • +1
    ./insert-and-scan-dataset/insert-and-scan-dataset.2.update.sqlpp
    • -1
    • +1
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.2.update.sqlpp
    • -1
    • +1
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.3.query.sqlpp
    • -1
    • +1
    ./scan-delete-rtree-secondary-index/scan-delete-rtree-secondary-index.2.update.sqlpp
    • -1
    • +1
    ./scan-delete-rtree-secondary-index/scan-delete-rtree-secondary-index.5.query.sqlpp
    • -2
    • +2
    ./scan-insert-persistent-to-temp/scan-insert-persistent-to-temp.2.update.sqlpp
    • -1
    • +1
    ./scan-insert-persistent-to-temp/scan-insert-persistent-to-temp.5.query.sqlpp
    • -2
    • +2
    ./scan-insert-rtree-secondary-index/scan-insert-rtree-secondary-index.2.update.sqlpp
  1. … 2118 more files in changeset.
Merge branch 'master' into hyracks-merge2

    • -8
    • +8
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.3.query.sqlpp
  1. … 484 more files in changeset.