Clone Tools
  • last updated 19 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE] Interval join tests written in SQL++

Change-Id: I6cd7bcbb1a8dffa037b0f4f63fc6d86d54505adc

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3111

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -0
    • +222
    ./TemporalQueries.xml
    • -0
    • +44
    ./interval_joins/interval_after/interval_after.1.ddl.sqlpp
    • -0
    • +31
    ./interval_joins/interval_after/interval_after.2.update.sqlpp
    • -0
    • +30
    ./interval_joins/interval_after/interval_after.3.query.sqlpp
    • -0
    • +30
    ./interval_joins/interval_after/interval_after.4.query.sqlpp
    • -0
    • +30
    ./interval_joins/interval_after/interval_after.5.query.sqlpp
    • -0
    • +30
    ./interval_joins/interval_after/interval_after.6.query.sqlpp
    • -0
    • +44
    ./interval_joins/interval_before/interval_before.1.ddl.sqlpp
    • -0
    • +31
    ./interval_joins/interval_before/interval_before.2.update.sqlpp
    • -0
    • +30
    ./interval_joins/interval_before/interval_before.3.query.sqlpp
    • -0
    • +30
    ./interval_joins/interval_before/interval_before.4.query.sqlpp
    • -0
    • +30
    ./interval_joins/interval_before/interval_before.5.query.sqlpp
    • -0
    • +30
    ./interval_joins/interval_before/interval_before.6.query.sqlpp
    • -0
    • +44
    ./interval_joins/interval_covered_by/interval_covered_by.1.ddl.sqlpp
    • -0
    • +31
    ./interval_joins/interval_covered_by/interval_covered_by.2.update.sqlpp
  1. … 132 more files in changeset.
[ASTERIXDB-2286][COMP][FUN][HYR] Parallel Sort Optimization

- user model changes: yes

- storage format changes: no

- interface changes: yes

details:

- new plan for sort operation which includes sampling and

replicating the stream of data to be sorted. Sort-merge connector

is removed from the plan. The sorted result now is in multiple partitions.

- new optimization rule to check whether full parallel sort is applicable.

- new Forward operator to read the replicated sort input stream and

to receive the ouput of the sampling.

- new sequential merge connector to merge a globally ordered result residing

in multiple partitions (in addition to the connector's partition computer).

- "asterix-lang-aql/pom.xml" is changed as a result of refactoring

code related to the range map handling.

- new private sampling function to generate the range map object

(local & global functions) & their type computers.

user model changes:

- new compiler property is added to enable and disable parallel sort.

interface changes:

- "ILogicalOperatorVisitor.java" includes Forward Operator.

- "ITuplePartitionComputer.java" includes initialize() to enable partitioner

to do some initialization. FieldRangePartitionComputerFactory uses it to

pick a range map.

- "ITuplePartitionComputerFactory.java". createPartitioner() is changed to

createPartitioner(IHyracksTaskContext hyracksTaskContext). Context is needed

for transferring the range map throught the context.

Change-Id: I73e128029a46f45e6b68c23dfb9310d5de10582f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2393

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

    • -1
    • +1
    ./overlap_bins_gby_0/overlap_bins_gby_0.3.query.sqlpp
  1. … 357 more files in changeset.
[ASTERIXDB-2399][SQL][FUN] Rename COLL_ aggregate functions

Rename to COLL_ functions to use the prefix STRICT_ to reduce the

confusion about which functions implement a strict NULL handling.

Change-Id: I5c103dbe7fa42bf5c4e2bfa53592b2041084aa8f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2691

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

    • -2
    • +2
    ./overlap_bins_gby_1/overlap_bins_gby_1.3.query.sqlpp
    • -2
    • +2
    ./overlap_bins_gby_3/overlap_bins_gby_3.3.query.sqlpp
  1. … 276 more files in changeset.
[ASTERIXDB-2170][SQL] Fix resolution order of implicit field access

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Improved name resolution rules

- Resolve field access to the nearest variable in scope

instead of raising compile-time error

- Do not rely on type information when resolving names

- Cleanup group variable handling in GroupBy clause,

no longer use ‘with’ map for it

- Fix ByNameToByIndexFieldAccessRule to use type environment

of its input operator when analyzing its expression

- Fix ExternalGroupByPOperator to use input schema of its

aggregate function when generating runtime for that function

- Fix invalid free variable computation for GroupBy clause

Change-Id: I50bc823ff53da06507a5454b30f4f500b862d4bf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2207

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

    • -1
    • +1
    ./overlap_bins_gby_1/overlap_bins_gby_1.3.query.sqlpp
  1. … 314 more files in changeset.
[ASTERIXDB-2050][SQL] Enforce a Semicolon After Each SQL++ Statement

- user model changes: a semicolon must be added after

every SQL++ statement.

- storage format changes: no

- interface changes: no

Details:

- Enforce a semicolon after each SQL++ statement.

- Adapt existing SQL++ test cases to new model.

Change-Id: I27e9e8fde5ff867ab569c8d443ba1522738046e3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1954

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -1
    • +1
    ./insert_from_ext_ds/insert_from_ext_ds.1.ddl.sqlpp
    • -1
    • +1
    ./insert_from_ext_ds_2/insert_from_ext_ds_2.1.ddl.sqlpp
    • -1
    • +1
    ./interval_bin_gby_0/interval_bin_gby_0.1.ddl.sqlpp
    • -1
    • +1
    ./interval_bin_gby_1/interval_bin_gby_1.1.ddl.sqlpp
    • -1
    • +1
    ./overlap_bins_gby_0/overlap_bins_gby_0.1.ddl.sqlpp
    • -1
    • +1
    ./overlap_bins_gby_1/overlap_bins_gby_1.1.ddl.sqlpp
    • -1
    • +1
    ./overlap_bins_gby_3/overlap_bins_gby_3.1.ddl.sqlpp
  1. … 2069 more files in changeset.
[ASTERIXDB-1753][SQL] Disable auto-plural for group-by.

- user model changes: do not perform auto-scalar-to-plural

transition for variables that are defined prior to a group-by

group clause after the group-by clause.

- storage format changes: no

- interface changes: no

details:

- migrated existing test queries that use auto-plural;

- added a negative test query.

Change-Id: I5d6383fc7453fe7537fc291c3483708b59df3871

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1860

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -2
    • +3
    ./overlap_bins_gby_0/overlap_bins_gby_0.3.query.sqlpp
    • -5
    • +8
    ./overlap_bins_gby_1/overlap_bins_gby_1.3.query.sqlpp
  1. … 260 more files in changeset.
Renaming SQL++ core aggregation functions:

- array_xxx -> coll_xxx, which considers nulls and missings,

- array_sql_xxx -> array_xxx, which ignores nulls and missings.

Change-Id: Ie58c31af69094b93ba21df54f90f5fad28998a34

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1236

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -1
    • +1
    ./overlap_bins_gby_1/overlap_bins_gby_1.3.query.sqlpp
    • -2
    • +2
    ./overlap_bins_gby_3/overlap_bins_gby_3.3.query.sqlpp
  1. … 381 more files in changeset.
ASTERIXDB-1539: add aliases for several builtin types and builtin functions.

- tinyint for int8;

- smallint for int16;

- integer(or, int) for int32;

- bigint for int64;

- year_month_duration for year-month-duration;

- day_time_duration for day-time-duration;

- timestamp for datetime;

- double precision for double;

int8, int16, int32, int64, year-month-duration and day-time-duration

is going to be deprecated.

In addition, it

- converts underscores to hypens for SQL++ functions;

- uses "array_" prefix for builtin aggregation functions.

Change-Id: I5c4a933f9775e89c2d503d9ea1cb98c5934d1475

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1199

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -1
    • +1
    ./duration_comps/duration_comps.3.query.sqlpp
    • -2
    • +2
    ./insert_from_ext_ds/insert_from_ext_ds.1.ddl.sqlpp
    • -2
    • +2
    ./insert_from_ext_ds_2/insert_from_ext_ds_2.1.ddl.sqlpp
    • -1
    • +1
    ./interval_bin/interval_bin.3.query.sqlpp
    • -1
    • +1
    ./interval_bin_gby_0/interval_bin_gby_0.1.ddl.sqlpp
    • -1
    • +1
    ./interval_bin_gby_0/interval_bin_gby_0.3.query.sqlpp
    • -1
    • +1
    ./interval_bin_gby_1/interval_bin_gby_1.1.ddl.sqlpp
    • -1
    • +1
    ./interval_bin_gby_1/interval_bin_gby_1.3.query.sqlpp
  1. … 3547 more files in changeset.
ASTERIXDB-1635 Fix for overlap-bins start for dates.

The fix involves two code changes and several sonar fixes.

The code changes are the following:

- DurationArithmeticOperations line 75:

When the month was zero, an index out of bound error occured in line 88 or 92.

The month value should be between 1 and 12.

- OverlapBinsDescriptor line 170:

The Gregorian Calendar is expecting a value in ms. When a date value comes in,

AsterixDB represents the value as the number of days from epoc. So the year

for a date basically allways translated to 1970. In lines 121, a condition

was added to check if the interval was a date, if so, convert the date to

ms.

Change-Id: I24122a84ef9edda4b05260af881c430177f1dc86

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1151

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

    • -0
    • +2
    ./datetime_functions/datetime_functions.3.query.sqlpp
    • -1
    • +1
    ./overlap_bins/overlap_bins.3.query.sqlpp
  1. … 10 more files in changeset.
ASTERIXDB-1635 Fix for overlap-bins start for dates.

    • -1
    • +1
    ./overlap_bins/overlap_bins.3.query.sqlpp
  1. … 7 more files in changeset.
Renaming: "table"->"dataset", "database"->"dataverse".

Change-Id: Ia80193f08651fc99341d9a8cf156d0feb6d0575f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1036

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -2
    • +2
    ./accessors_interval/accessors_interval.1.ddl.sqlpp
    • -2
    • +2
    ./accessors_interval_null/accessors_interval_null.1.ddl.sqlpp
    • -2
    • +2
    ./adjust_timezone/adjust_timezone.1.ddl.sqlpp
    • -2
    • +2
    ./calendar_duration/calendar_duration.1.ddl.sqlpp
    • -2
    • +2
    ./date_functions/date_functions.1.ddl.sqlpp
    • -2
    • +2
    ./datetime_functions/datetime_functions.1.ddl.sqlpp
    • -2
    • +2
    ./day_of_week_01/day_of_week_01.1.ddl.sqlpp
    • -2
    • +2
    ./duration_comps/duration_comps.1.ddl.sqlpp
    • -2
    • +2
    ./duration_functions/duration_functions.1.ddl.sqlpp
    • -2
    • +2
    ./insert_from_delimited_ds/insert_from_delimited_ds.1.ddl.sqlpp
    • -1
    • +1
    ./insert_from_delimited_ds/insert_from_delimited_ds.2.update.sqlpp
    • -3
    • +3
    ./insert_from_ext_ds/insert_from_ext_ds.1.ddl.sqlpp
  1. … 2760 more files in changeset.
merge master

    • -29
    • +29
    ./interval_functions/interval_functions.3.query.sqlpp
  1. … 8 more files in changeset.
Adding functions to return unit-time from date, datetime, and time.

Change-Id: I5a71d73680d2ad47e5bb2c2d9ceec2ec0d676d09

Reviewed-on: https://asterix-gerrit.ics.uci.edu/913

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -3
    • +20
    ./date_functions/date_functions.3.query.sqlpp
    • -3
    • +21
    ./datetime_functions/datetime_functions.3.query.sqlpp
    • -3
    • +20
    ./time_functions/time_functions.3.query.sqlpp
  1. … 16 more files in changeset.
Use backticks instead of double quotes for delimited identifiers in SQL++.

Change-Id: I2db58d68e8e28befa4105504c261b101fa0285af

Reviewed-on: https://asterix-gerrit.ics.uci.edu/909

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -6
    • +6
    ./accessors_interval/accessors_interval.3.query.sqlpp
    • -1
    • +1
    ./accessors_interval_null/accessors_interval_null.3.query.sqlpp
    • -1
    • +1
    ./adjust_timezone/adjust_timezone.3.query.sqlpp
    • -2
    • +2
    ./calendar_duration/calendar_duration.3.query.sqlpp
    • -2
    • +2
    ./date_functions/date_functions.3.query.sqlpp
    • -2
    • +2
    ./datetime_functions/datetime_functions.3.query.sqlpp
    • -1
    • +1
    ./day_of_week_01/day_of_week_01.3.query.sqlpp
    • -2
    • +2
    ./duration_comps/duration_comps.3.query.sqlpp
    • -3
    • +3
    ./duration_functions/duration_functions.3.query.sqlpp
    • -6
    • +6
    ./get_overlapping_interval/get_overlapping_interval.3.query.sqlpp
  1. … 2118 more files in changeset.
great merge - asterixdb

    • -0
    • +73
    ./interval_functions/interval_functions.3.query.sqlpp
  1. … 555 more files in changeset.
Merge branch 'master' into hyracks-merge2

    • -1
    • +1
    ./overlap_bins_gby_1/overlap_bins_gby_1.3.query.sqlpp
    • -2
    • +2
    ./overlap_bins_gby_3/overlap_bins_gby_3.3.query.sqlpp
  1. … 481 more files in changeset.