asterix-runtime

Clone Tools
  • last updated 25 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE][COMP][RT] New library deployment model

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Deploy external libraries using Hyracks jobs

- Library manager is no longer available on CC

- Add IServlet.init() which is invoked during web server startup

- External libraries can no longer provide implementations of

IExternalDataSourceFactory because external libraries are

not available on CC

- Added testcase for an external adapter

Change-Id: If64f99f6a15b81b1e426239bde63360f5ef57059

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/6863

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

  1. … 94 more files in changeset.
[ASTERIXDB-2748][RT] CASE fails if default value is TRUE

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fix ArrayIndexOutOfBoundsException in CASE expression

when the default value is TRUE and none of its WHEN

clauses match at runtime

Change-Id: I8d16c200fa4b65008c241aeb8a0ebb86f7b4a6c0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/6823

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

  1. … 3 more files in changeset.
[ASTERIXDB-2732][FUN] Support missing and union type in get_object_field_value

- user model changes: no

- storage format changes: no

- interface changes: no

Change-Id: I2aeacfa2469c8245ce2fd9532434a0a0ecb6eafb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/6104

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 7 more files in changeset.
Merge commit 'bc0f7e0' from branch 'gerrit/mad-hatter'

Change-Id: I629850e0f6ac7e1afae3fb5c6e1f1f859b2ead72

  1. … 19 more files in changeset.
[ASTERIXDB-2713][EXT] CSV & TSV support for external dataset p4

- user model changes: no

- storage format changes: no

- interface changes: yes

- IValueParser

Details:

- added parameter "null" to allow user to specifiy what string represents

a null value. Only nullable fields whose values match this string will

produce NULL. Otherwise, no NULLs will be produced.

- empty fields:

- for string fields, produce empty string "".

- for non-string fields, issue a warning an ignore the record.

- changed IValueParser to return boolean to allow some implementations

to return true or false instread of throwing an exception.

- added parameter "redact-warnings" to allow user to specifiy if parser

warnings should exclude information like file name.

- changed the Integer and Long parsers to consider spaces properly and

also to handle overflow and underflow.

- changed the boolean parser to align with other parsers that ignore

leading and trailing spaces.

- added test cases.

Change-Id: Ib6aed0095a472510b69cc29a3e444e7de5a2c1ae

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/5963

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 74 more files in changeset.
[NO ISSUE][RT] Support negative positions in path expression

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Support negative array index in path expressions:

array[-1] addresses the last element,

array[-2] next to last, and so on

- Add testcase and update documentation

Change-Id: Ib2bdeab42d3bd37c21d860dda583a2762a74e2fb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/5845

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

  1. … 14 more files in changeset.
[NO ISSUE][TYPE] Fix offset handling in serializers-deserializers

Details:

- The non-tagged serializers should not contain any type tag

- Remove the assumption of the input to be tagged in a non-tagged

serializer for Point, Line, Rectangle, Circle, Polygon types

- Fix the offset considering that the serializers return the offset

passing the type tag

Change-Id: I4bb2c4d3c142cd0cb6722fe1972da7346af2cc78

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/5847

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 12 more files in changeset.
[NO ISSUE] Fix log marker of insert

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fix the log marker of the insert operator by ensuring

that the downstream operator is opened after the log

marker callback is set.

Change-Id: I5f131f205465265ecd843b869478f7b48839c609

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/5825

Reviewed-by: Luo Chen <cluo8@uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][COMP] CREATE INDEX with Geometry datatype

Details:

- Support geometry datatype for RTree Index:

CREATE INDEX geomIndex ON geoDataset(geometry) TYPE rtree;

- Enable ST functions for rtree with geometry datatype

- Add testcases

Change-Id: I8f4a82c43b950fc3573cae5aa7c0782b475f962d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/5584

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Mehnaz Tabassum Mahin <mmahi004@ucr.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 47 more files in changeset.
[ASTERIXDB-2697]: Implementing AWS s3 as external data source

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Added an external reader for AWS S3.

- Updated query translator to include the WITH

parameters into the dataset details when creating

an external dataset.

- Added test case for AWS S3 using an S3 mocking server

to avoid using real credentials.

Change-Id: I71d89116c0bb404c9621b16f21a6a31cbf7bb7f6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/5025

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Hussain Towaileb <hussainht@gmail.com>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 52 more files in changeset.
[ASTERIXDB-2689][FUN] Agg Avg: skip and warn for invalid values

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Currently, the aggregate avg function throws an exception

when an invalid (non-numeric but not null or missing) value

is encountered, this patch changes the behavior to skip

the invalid value (treat it as null) and issue a warning.

- Added test cases for serializable aggregate avg (when

using hash group by).

Change-Id: I32037e0f178a84555ac868547eed5762e980f010

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/5183

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Hussain Towaileb <hussainht@gmail.com>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 126 more files in changeset.
[NO ISSUE][RT] Add ability to store sensitive info to coordination service

Change-Id: If63443171139c0153d6b9d71c1991311f2335e14

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4784

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Reviewed-by: Hussain Towaileb <hussainht@gmail.com>

  1. … 1 more file in changeset.
[ASTERIXDB-2690][FUN] Agg Sum: skip and warn for invalid values

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Currently, the aggregate sum function throws an exception

when an invalid (non-numeric but not null or missing) value

is encountered, this patch changes the behavior to skip

the invalid value (treat it as null) and issue a warning.

Change-Id: Ia7cde094302331d8f37670b4e6c6ce894d549154

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4603

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Hussain Towaileb <hussainht@gmail.com>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

  1. … 10 more files in changeset.
[ASTERIXDB-2566][TYPE][FUN] Added complete set of is_* type functions and a generic get_type function.

- user model changes: no

- storage format changes: no

- interface changes: no

details:

- Added a is_binary type function.

- Added spatial types functions: is_point, is_line, is_rectangle, is_circle, is_polygon, is_spatial

- Added temporal type functions: is_date, is_datetime, is_time, is_duration, is_interval, is_temporal

- Added a is_uuid type function.

- Added a is_multiset function.

- Added a get_type function.

Change-Id: Icee5f2de7178e27091d457d37603ee6b4c2e0629

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4303

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Ian Maxon <imaxon@uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

  1. … 54 more files in changeset.
[ASTERIXDB-2689][FUN] Make arithmetic functions return NULL on invalid arguments

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Make arithmetic functions return NULL on invalid arguments:

Functions are for: +, -, *, /, DIV, %, ^

Change-Id: I6a822e59c91d06506505597927fab93e403385d8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4723

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 9 more files in changeset.
[ASTERIXDB-2689][FUN] Make numeric functions return NULL on invalid arguments p2

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Make numeric functions return NULL on invalid arguments.

round(num), round(num, num), trunc(num, num), round-half-to-even(num, num).

- added warning to round() function

- extracted evaluators of trunc() and round-half-to-even() to a common evaluator

- renamed checkWarnOrSetInteger() to setInteger()

Change-Id: I1ccef0740d64cce3ada8b60d3a699748e7ef8776

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4704

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 21 more files in changeset.
[ASTERIXDB-2689][FUN] Make numeric functions return NULL on invalid arguments

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Make numeric functions return NULL on invalid arguments.

Change-Id: Id26229064058c3ecbaa54ece3001d3b8980f8d8b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4583

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 20 more files in changeset.
[NO ISSUE] Address serialVersionUID issues

- add missing serialVersionUIDs where applicable

- add @SuppressWarnings("serial") for serializable types which are never

actually serialized

Change-Id: Ic38d33b8020c3261bda4ebb0b273b26c40fef26f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4523

Reviewed-by: Michael Blow <mblow@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 7 more files in changeset.
[ASTERIXDB-2687][RT] Issue a warning when incomparable types are compared

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Issue a warning when NULL was returned as the result of a comparison

of 2 incomparable types.

- added error/warning code 49

- refactored dot format plans generator

- removed some AQL tests that are already covered in SQL++ tests

Change-Id: Iad3127e4db775315817a7819feea6aa12e4de2ea

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4464

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 37 more files in changeset.
[NO ISSUE][COMP] Refactor locking in the compiler

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Introduce interface IMetadataLockUtil for methods in

MetadataLockUtil

- Make MetadataLockUtil overridable by product extensions

- Refactor dataverse and dataset creation methods in

QueryTranslator for better extensibility

Change-Id: I479be18ae68d9b8d42050e74968816767a454eb3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4424

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

  1. … 9 more files in changeset.
[ASTERIXDB-2667][FUN] Share code base between string functions

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- String functions concat, string_concat and string_join

now share the same code instead of each having a different

evaluator class.

- Added test cases for string_join function.

- Added support to deep missing/null checking in list

items. Now it's possible to give a deeper (list items)

missing value a higher priority over null arguments

outside a list between parameters.

Example:

somefun([1, missing], null);

It's possible to deeply check the list items first,

and hence return a missing, or only do first level check

and output would be null.

Change-Id: I41b644c6841b222d1c6c529b2f9189f42178e28c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4023

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Hussain Towaileb <hussainht@gmail.com>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

  1. … 92 more files in changeset.
[ASTERIXDB-2680][FUN] Add support to regexp_matches() and regexp_split()

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Added support to regexp_matches().

- Added support to regexp_split().

- Added test cases for regexp_matches().

- Added test cases for regexp_split().

- Changed behavior of UTF8CharSequence when

subSequence is called with start = end, originally

it returns a null char[] array which causes an NPE,

now it returns an empty char[].

Change-Id: Iccf5ba14f5c8b8cf4bcd6dd6e412bb515d68dd74

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4243

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Hussain Towaileb <hussainht@gmail.com>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 32 more files in changeset.
[ASTERIXDB-2634][FUN] String functions to return null on data/type errors

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- substring(string, int, int)

- codepoint-to-string([int])

- string-concat([string])

Change-Id: I17905ad9e767b43822d28a46123bc1390a159cc7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4083

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Hussain Towaileb <hussainht@gmail.com>

  1. … 16 more files in changeset.
[NO ISSUE] Support multipart dataverse names

- user model changes: yes

- storage format changes: no

- interface changes: yes

Details:

- Support dataverse names that consist of multiple parts

- Introduce DataverseName class and adopt it throughout the system

- Add testcases for multipart dataverse names

Change-Id: I1313b2dc0e8df6a9b0ded48dea122afc3ba5dbe7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4004

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 283 more files in changeset.
Merge branch 'gerrit/mad-hatter' into 'master'

Change-Id: I02c47bde76edd2c460c8c70e781c7b2926de5ee4

Merge branch 'gerrit/stabilization-f69489' into 'gerrit/mad-hatter'

Change-Id: I831c9c7c37ecf757ebaa707be5c394105302da13

  1. … 10 more files in changeset.
[ASTERIXDB-2671][FUN] Fix handling nullable inputs in OBJECT_*()

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

The input record to OBJECT_*() functions can be nullable/missable

record.

- fixed the type inferrer to take care of that when inferring

the input record type.

Change-Id: Ic7e86598eda03f5aeb3c0e4457127c99bdbed0e4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4123

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 75 more files in changeset.
[NO ISSUE] Update dependencies

Change-Id: I7c668c680057344c7f83c600a2e9adff43a2fefc

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4063

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 12 more files in changeset.
[ASTERIXDB-2658][FUN] Add support for array_except() function

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Added array_except function.

- Added test cases for array_except() function.

Change-Id: I7c1befeffdb0f651afab31a4e814842a67d3a54c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3743

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

  1. … 25 more files in changeset.
Merge branch 'gerrit/mad-hatter' into 'master'

Change-Id: I2059c989bd17c0e1677269ae48af3fd38ccce12b

  1. … 3 more files in changeset.