asterixdb

- user model changes: no

- storage format changes: no

- interface changes: no

details:

- Create the IPartitioningProperty using the orderedPartitionedProperty

instead of creating the list to be used in an unorderedPartitionProperty.

Change-Id: I044e2219fff7564864f68fa0df849d1102b4bb20

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3261

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Change the result of comparing against null and missing.

For arrays, comparing against null or missing item will result in incomparable.

For records, comparing against a null field will result in incomparable.

- modified test cases accordingly

- moved few object factories to the common place.

- modified compareRecords to avoid string construction for field names

- few code clean-ups.

Change-Id: Id93bea76e13658768e08a98fd373c71a901ceec5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3259

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Allow binding HTTP server to specific network address

rather than always defaulting it to all network interfaces.

Change-Id: Ie4b6c66502aacf8e0564cc3c6e2fd20c4efac385

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3260

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fix illegal state exception raised by the compiler when

a variable used by SQL aggregate function is not mapped

by GROUP AS clause

Change-Id: I12bab27ad8e25d0bd55c900e559541eff2141fb9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3257

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fix Illegal State error raised by the compiler

for a query with a quantified expression

Change-Id: I53046ffd104035e36395e8a0fa4c624ccfdedf09

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3253

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

Tested-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

- user model changes: no

- storage format changes: yes[1]

- interface changes: no

Details:

- Change field offset type from integer16 to integer32

- Add recovery test

- Add version to log entries

[1] LogRecord format change with this patch; old LogRecord format can still

be processed, however old instances cannot read new log format

Change-Id: Iaf14b9a73a0239763bfeb0ce2d81cf952e6d72d3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3065

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Add support for hashing record fields.

- Added hashing records in GenericHashFunction.

- Extracted common functionality from comparators and hash functions into

CompareHashUtil.

- Added test cases.

Change-Id: I9d18a17089afdc6e28ff01091d890b375868969c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3249

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Catch all exceptions that could be caused by an interrupt

during request cancellation.

Change-Id: Ib2595ce8a80d8df324e5d97591639d3f9efe1b9d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3250

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- eliminate boxing/unboxing of txnids

- remove redundant hashset contains call

Change-Id: I6e5068c6fe3f6226eabd5403440682c52662421e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3251

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Re-infer all types after introducing aggregate combiners

- AbstractIntroduceGroupByCombinerRule should keep original

operators in nested plans if it did not apply

Change-Id: I404b795452660792166d7e41edcd7dbf9d85f9f8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3248

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Raise error early when an unknown window function is found

Change-Id: I04983a17fc569ff96770a8da06fe98715002fdcb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3246

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Add support for hashing array fields.

- Modified AMurmurHash3BinaryHashFunctionFamily and extracted the hashing function

into a private named hashing function "GenericHashFunction". Added hashing arrays.

- Modified hash join to include generating hash functions for the right branch

since now hash functions are type-dependent and cannot use the same hash functions

generated for the left branch.

- Added test cases.

Change-Id: Ibd0dc7f270730140226f54445705822049f5c863

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3241

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fixes illegal state error when using ratio_to_report()

caused by incorrect identifier resolution for this function

Change-Id: I604ff1ee340fe58250500b2ff459f9b46433a269

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3244

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- random(arg) return type should be nullable

- fix documentation for random(arg) to match implementation

Change-Id: Ifc46ddeaad5bb8999c4a869e7fbc0a5b3c5cde7c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3240

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Currently, it is assumed that private key entries will always

have a blank password. This change changes that by using the

keystore passed password as the private key entry password.

- Ensure trust store password property is set to to allow the

usage of password protected trust stores.

- Fix NCConfig keyStorePath/trustStorePath setter to set the

values for the current node.

- Update test cases private key entries to have password.

Change-Id: I204aa31006c6d3db65909248e55dd901029887fe

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3239

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Avoid generating and embedding maven descriptors in artifact jars

when not preparing a release

Change-Id: I55620e890cdc6f0247d9d3ec292deb334d7d9e63

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3237

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Change-Id: I6534887dd78f97a3f31cb3578253746fcea8e262

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3235

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Add support for physical record deep comparison.

- Added test cases

Change-Id: I186f853e0b16acdb3170f7b51bb8a5707d34f9d8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3234

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Reviewed-by: Till Westmann <tillw@apache.org>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Add support for physical array deep comparison.

- Refactored and renamed AObjectAscBinaryComparatorFactory/AObjectDescBinaryComparatorFactory

- Refactored AGenericDescBinaryComparator and AGenericAscBinaryComparator

- Added test cases

Change-Id: Ib369a4dd22f32bfca4bd2c0cbf987529c0bafa6d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3233

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

- user model changes: no

- storage format changes: no

- interface changes: no

Details: Changes to forward recordType from scalar descriptor to

evaluator descriptor for aggregate functions.

Provided hooks to disable constant folding rules on aggregate functions.

Change-Id: Ic3c19e316e1ebdbab8a38048c1b64b087d95e146

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3218

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- A small optimization to our deadlock-free locking potocol by skipping

the WAIT record. Once the partial frame has been flushed and previous

records are committed, the locks held by the write thread will

eventually be released by the log flusher thread. There is no need to

force the writer thread to wait for the log flusher thread.

Change-Id: I6ef3979d6393d45a6b7b2eb5f09f147299b5cd9f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3232

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Add "compiler.windowmemory" property to the documentation

Change-Id: Ia8d67e156bf08608651b40e1bfd6e771940fe642

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3231

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

This change is to make physical comparators type-aware in order to do

deep comparison of complex types like arrays and records. The IAType

is propagated to the comparators.

- added new methods in IBinaryComparatorFactoryProvider to accept the

type of left and right inputs for operations like hash join where

the join key types come from different dataset sources.

- defaulted some arrays functions to use the old comparator behaviour temporarily

until complex comparison is implemented

- modified AObjectAscBinaryComparatorFactory & AObjectDescBinaryComparatorFactory to

create a comparator with IAType information. Changed the serialization/deserialization

of their instances to take care of the newly added fields since they are not

present in old instances.

Change-Id: I02011e7151398d5f5f9ba9c1e1db6518484b9fe5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3229

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Reviewed-by: Till Westmann <tillw@apache.org>

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Improve memory management for window operators

- Add "compiler.windowmemory" property that specifies memory

budget for each window operator (default is 4MB, min is 160KB)

- Consolidated negative window operator testcases into a single one

Change-Id: I6756e92046883f79db339ef490cca8bc8b7b1fb8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3227

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

This change is to make Asterix types IJsonSerializable.

Change-Id: I26b57494da1c63497b63ceb0d4172b5768d3a614

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3228

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Accept UUID as a parameter in query cancellation API.

- Pass request UUID to CC in cancellation requests to

allow cancellation of requests that do not have

clientContextId.

Change-Id: Ic811b2107b71e50ca9c216db39755467c4320fd1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3225

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Replace anonymous inner class by lambda in

ApplicationMessageWork.

Change-Id: Ia50f5d51401671c1c10453b20ed84d21c49cfe3a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3224

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Add support for record deep comparison.

- modified LogicalComplexBinaryComparator to allow record comparison

- added test cases for record comparison

- modified PointableAllocator to allow freeing record visitable pointables

Change-Id: I3e8bfbb014b86295749e980d123b0d3edf079beb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3222

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>