Clone Tools
  • last updated 20 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[ASTERIXDB-2171][STO] Remove Temporary Datasets

- user model changes: no

- storage format changes: no

- interface changes: yes

- Removed all reference to temporary datasets.

Details:

- Remove temporary datasets grammar but reserve

<TEMPORARY> token.

- Remove special callbacks for temp datasets.

- Remove metadata garbage collector thread.

- Remove isTemp flag from datasets.

- Remove special storage path for temp datasets.

- Remove temp datasets test cases.

Change-Id: Ib50ea27e2ec9c114508cd4a109cf646e2f20dcb0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2172

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -22
    • +0
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.1.ast
    • -1
    • +0
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.2.ast
    • -1
    • +0
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.3.ast
    • -1
    • +0
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.4.ast
    • -31
    • +0
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.5.ast
    • -22
    • +0
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.1.ast
    • -1
    • +0
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.2.ast
    • -22
    • +0
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.3.ast
    • -22
    • +0
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.ast
    • -0
    • +0
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.2.ast
    • -29
    • +0
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.3.ast
  1. … 355 more files in changeset.
[NO ISSUE][COMP] Function references cleanup

- user model changes: no

- storage format changes: no

- interface change: no

Details: cleanup function references

- Use function identifiers when referring to built-in functions

- Use OperatorType enum when referring to operators

- Add FunctionSignature constructor that takes FunctionIdentifier

- Use asterix/algebricks namespace when referring to built-in functions

Change-Id: Ibad290182ed0f248f65987df97e6c61aac95b232

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2130

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

    • -1
    • +1
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.5.ast
    • -1
    • +1
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.3.ast
    • -1
    • +1
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.3.ast
    • -1
    • +1
    ./empty-load-with-index/empty-load-with-index.3.ast
    • -1
    • +1
    ./insert-and-scan-dataset-with-index/insert-and-scan-dataset-with-index.3.ast
    • -1
    • +1
    ./insert-and-scan-dataset/insert-and-scan-dataset.3.ast
    • -1
    • +1
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.3.ast
    • -1
    • +1
    ./scan-delete-rtree-secondary-index/scan-delete-rtree-secondary-index.5.ast
    • -1
    • +1
    ./scan-insert-persistent-to-temp/scan-insert-persistent-to-temp.5.ast
    • -1
    • +1
    ./scan-insert-rtree-secondary-index/scan-insert-rtree-secondary-index.5.ast
    • -1
    • +1
    ./scan-insert-temp-to-persistent/scan-insert-temp-to-persistent.5.ast
  1. … 1572 more files in changeset.
[ASTERIXDB-2078][SQL] DISTINCT modifier for aggregate functions

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Adds support for DISTINCT modifier in aggregate functions:

AGG(DISTINCT expr), ARRAY_AGG(DISTINCT expr), COLL_AGG(DISTINCT expr)

where AGG = COUNT | SUM | AVG | MIN | MAX

Change-Id: I52772349cbcbfc68a3a1ff261d610871ca38748d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1987

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -8
    • +8
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.3.ast
  1. … 361 more files in changeset.
[ASTERIXDB-1753][SQL] Disable auto-plural for group-by.

- user model changes: do not perform auto-scalar-to-plural

transition for variables that are defined prior to a group-by

group clause after the group-by clause.

- storage format changes: no

- interface changes: no

details:

- migrated existing test queries that use auto-plural;

- added a negative test query.

Change-Id: I5d6383fc7453fe7537fc291c3483708b59df3871

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1860

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -33
    • +70
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.3.ast
  1. … 261 more files in changeset.
ASTERIXDB-1539: add aliases for several builtin types and builtin functions.

- tinyint for int8;

- smallint for int16;

- integer(or, int) for int32;

- bigint for int64;

- year_month_duration for year-month-duration;

- day_time_duration for day-time-duration;

- timestamp for datetime;

- double precision for double;

int8, int16, int32, int64, year-month-duration and day-time-duration

is going to be deprecated.

In addition, it

- converts underscores to hypens for SQL++ functions;

- uses "array_" prefix for builtin aggregation functions.

Change-Id: I5c4a933f9775e89c2d503d9ea1cb98c5934d1475

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1199

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -5
    • +5
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.1.ast
    • -5
    • +5
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.1.ast
    • -1
    • +1
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.1.ast
    • -4
    • +4
    ./empty-load-with-index/empty-load-with-index.1.ast
    • -2
    • +2
    ./insert-and-scan-dataset-with-index/insert-and-scan-dataset-with-index.1.ast
    • -1
    • +1
    ./insert-and-scan-dataset/insert-and-scan-dataset.1.ast
    • -4
    • +4
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.1.ast
    • -1
    • +1
    ./scan-delete-rtree-secondary-index/scan-delete-rtree-secondary-index.1.ast
    • -2
    • +2
    ./scan-insert-persistent-to-temp/scan-insert-persistent-to-temp.1.ast
    • -2
    • +2
    ./scan-insert-rtree-secondary-index/scan-insert-rtree-secondary-index.1.ast
    • -2
    • +2
    ./scan-insert-temp-to-persistent/scan-insert-temp-to-persistent.1.ast
  1. … 3550 more files in changeset.
Clean up GROUP BY and WITH clause.

- fix ASTERIXDB-971, i.e., the expression to plan translator for FLWOGR without a "for";

- fix the scoping for nested WITH clause;

- fix the scoping for nested GROUP BY clause;

- fix default fields in group variables;

- fix/unify the expression substition AST visitor;

- enhance RemoveUnusedAssignAndAggregateRule to be able to remove unused GROUP BY

decoration varaibles;

- clearly sperate SQL++ aggregate functions and SQL-92 aggregate functions, i.e.,

SQL-92 aggregate sugars cannot apply to SQL++ aggregate functions;

- fix PushAggregateIntoGroupbyRule for nested plan deletions;

- enhance RemoveCartesianProductWithEmptyBranchRule;

- add ExtractGroupByDecorVariablesRule;

- add an aggregate function first-element;

- fix ASTERIXDB-1560, an error message issue.

Change-Id: I62fca7f937aa007d97ed87c75cef19f6aa3e5ade

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1050

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -11
    • +1
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.3.ast
  1. … 235 more files in changeset.
ASTERIXDB-1383: reduce the number of lines for "AS".

Change-Id: Ic655bf25701f33230787d175b78bedc489909cb0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/822

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -2
    • +1
    ./delete-from-loaded-dataset-with-index/delete-from-loaded-dataset-with-index.5.ast
    • -2
    • +1
    ./delete-from-loaded-dataset/delete-from-loaded-dataset.3.ast
    • -2
    • +1
    ./drop-empty-secondary-indexes/drop-empty-secondary-indexes.3.ast
    • -2
    • +1
    ./empty-load-with-index/empty-load-with-index.3.ast
    • -2
    • +1
    ./insert-and-scan-dataset-with-index/insert-and-scan-dataset-with-index.3.ast
    • -2
    • +1
    ./insert-and-scan-dataset/insert-and-scan-dataset.3.ast
    • -22
    • +11
    ./q01_pricing_summary_report_nt/q01_pricing_summary_report_nt.3.ast
    • -2
    • +1
    ./scan-delete-rtree-secondary-index/scan-delete-rtree-secondary-index.5.ast
    • -2
    • +1
    ./scan-insert-persistent-to-temp/scan-insert-persistent-to-temp.5.ast
    • -2
    • +1
    ./scan-insert-rtree-secondary-index/scan-insert-rtree-secondary-index.5.ast
    • -2
    • +1
    ./scan-insert-temp-to-persistent/scan-insert-temp-to-persistent.5.ast
  1. … 1708 more files in changeset.