asterixdb

Clone Tools
  • last updated 17 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Advance version to AsterixDB 0.9.4.2-SNAPSHOT and Hyracks 0.3.4.2-SNAPSHOT

Change-Id:I47827d49e8a589ae885b134bf5c7557fae3b0620

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3209

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Ian Maxon <imaxon@uci.edu>

    • -1
    • +1
    /asterixdb/asterix-client-helper/pom.xml
    • -1
    • +1
    /asterixdb/asterix-external-data/pom.xml
  1. … 87 more files in changeset.
Release Apache AsterixDB 0.9.4.1 and 0.3.4.1

Change-Id:I0af32fba00277c516b2671cc3567d61a2765f526

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3208

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Ian Maxon <imaxon@uci.edu>

    • -1
    • +1
    /asterixdb/asterix-client-helper/pom.xml
    • -1
    • +1
    /asterixdb/asterix-external-data/pom.xml
  1. … 87 more files in changeset.
[NO ISSUE] Fix logging in NCServiceIT

This test had a strange logging setup; the logging

for the actual IT was not configured to log outside

of /tmp, and the NCService processes had no log4j2

configuration set.

Change-Id: I4a5944891adf6b073dee01e8418b2449e1179949

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3189

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE] Make logDir use paths correctly

Change-Id: Ia9b372900c3f840d39577e049c0590f8649e2694

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3185

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE] Swap parameters for DEFAULT_DIR

Change-Id: I60543f95f36133037705fac3cf649e7caa92fe0a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3184

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE] Update notices

Change-Id: I47fae4ec611e7320bde76182cf51fd2026248dc1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3161

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Tested-by: Ian Maxon <imaxon@apache.org>

[NO ISSUE] Fix log directory initialization

Change-Id: I357805659be133929ab1beea33bc0dcdf4dc896c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3154

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE] Remove un-neccessary Jackson printer

During the org.json change we needed this to avoid

changing many test files but it is not really worth

maintaining anymore.

Change-Id: I465d4f0d4352f2bd7eb3ec40062a998de578d8c6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3150

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

[NO ISSUE] Ensure serialVersionUIDs are present

Serializable classes should define a serialVersionUID; define those

where missing. For classes present in 0.9.4.x, initialize the value

to the auto-configured serialVersionUID on those versions of the class

Change-Id: Ia92d0c81f3681dce7ec0f643e2edf77e2ac4dbc5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3141

Tested-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 37 more files in changeset.
[FUN][RT] Objects creation in array functions

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- deallocate caster pointables for array functions using casting

- avoid object creations in:

ArrayIntersectDescriptor, AbstractArrayProcessEval, ArrayPutDescriptor, ArrayStarDescriptor

- avoid iterator creations in:

ArrayIntersectDescriptor, ArrayStarDescriptor, ArraySymDiffEval

- avoid evaluating the lists arguments twice when casting them

- use getOrWriteItem() instead of writeItem() when accessing a serialized list

- fix array_intersect to pick the smallest list as a starting list

Change-Id: Ib6c8c55ed3e0a35e00c5976a46e9ed6e432a6e9f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3129

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

  1. … 3 more files in changeset.
[NO ISSUE][NET] Catch All Network Unexpected Exceptions

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Any case of any unexpected exception during

IPC network operations, close the connection

to allow it to be reestablished.

Change-Id: I57db83faa1d1ecbc4702ca06e64e21fedb186313

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3132

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE] Update tests, revert mockito change

Change-Id: I3f9e77fd090f612ecb206b72676248ffdaa66bc3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3122

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 5 more files in changeset.
[ASTERIXDB-2507][RT] Objects Creation in ARecordSerializerDeserializer

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Reuse UTF8 hash function and comparator from

evaluators when extracting a field's offset.

Change-Id: Icdb47db9e909e49d65ebf1cd667e27e2467e4085

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3109

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][COMP] Disable creating index on meta

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Disable creating an index on meta fields.

Change-Id: Ib7d3b3706f200da0ef023e642b2d807511cb0801

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3103

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[ASTERIXDB-2503][MD] Consider Datasets Alternating ID

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- When initializing the DatasetIdFactory, consider the

alternating id of datasets to avoid reusing ids.

Change-Id: I2a3ee8f3b998c92afef5e793c7b697682fbf1f17

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3099

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE] Update third-party library versions

Change-Id: I752876c0d5144019f228cb5e758892560d2c042d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3090

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

    • -4
    • +2
    /asterixdb/asterix-external-data/pom.xml
    • -1
    • +0
    /asterixdb/asterix-transactions/pom.xml
    • -223
    • +0
    /asterixdb/src/main/licenses/content/raw.githubusercontent.com_netty_netty_netty-4.1.25.Final_NOTICE.txt
  1. … 15 more files in changeset.
[ASTERIXDB-2494][RT] Ensure Dataset Ref Counters Are Thread-safe

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Dataset/Index reference counters are modified concurrently by

multiple threads and should be thread-safe. Thread-safety issues

in these counters could result in leaving a dataset allocated

in memory even though it can be evicted.

Change-Id: I9328df660f463bd45bfc003b1e44c9df2702cc90

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3089

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][IDX][COMP] Creating an open index on non-declared fields

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

This patch is to fix creating an open index on non-declared fields.

When compiling the CREATE INDEX DDL statement, it is assumed

that all nested record fields will be of type ARecordType. However, for

open indexes, any nested non-declared record field will be optional.

In this case, the type will be AUnion(ARecordType) which results

in type casting exceptions for certain situations. An example is:

CREATE INDEX idx ON ds(a.b.c: int, a.b.d: string). Both a and b could

have the type AUnion(ARecordType). This patch takes care of such cases.

Change-Id: I9f09ed73f27090c5be7b1a665f4591b29a8cda12

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3045

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 87 more files in changeset.
[NO ISSUE][OTH] Pass Request Parameters To Extensions

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Pass request parameters to create/drop dataverse

statements to allow extensions to use optional

request parameters.

Change-Id: I284560ea3a7e3d1b36d73a8cfcdc85bf7b5a7f4e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3044

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

[ASTERIXDB-2478][NET] Calculate Buffer Remaining Before Reusing It

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- When recycling a buffer, calculate the buffer remaining before

releasing it for reuse to prevent other threads from changing

its remaining.

- Add test case.

Change-Id: Icca3284feae800dd6c37694bdefec3516cd4c506

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3036

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE] Update Jackson libraries to 2.9.7

Change-Id: I0b8a455ea9759a16422ccb35e858f6fc7e504721

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3013

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

[NO ISSUE][DOC] Documentation improvements

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Add variable.* to SELECT clause

- Add section and example for variable scope in JOIN subclauses

Change-Id: I654fb35f3632cb46fc0ecdce3f12af72c2356091

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2993

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE] Enable Build/Run w/ Java 11

- upgrade hadoop libraries (2.2.0 -> 2.8.5)

Change-Id: I04377b91ea7535bd358c396fbd9fcb019c734814

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2986

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3030

Reviewed-by: Till Westmann <tillw@apache.org>

    • -5
    • +9
    /asterixdb/asterix-external-data/pom.xml
    • -0
    • +8
    /asterixdb/asterix-test-framework/pom.xml
  1. … 3 more files in changeset.
[NO ISSUE][NET] Avoid Sleeping The Network Thread on Failures

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- We currently sleep the networking thread incrementally with

every failure. This sleep was added to avoid CPU spinning

back when failures on pending networking operations were not

handled properly which led to processing the same networking

message that caused the failure over and over. This sleep is

not needed anymore since every failed read/write/send/connect

network operations will not be attempted again.

Change-Id: I9f7ddc088868f8cf4d0a15ec5349021af8ccae36

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2978

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE][REPL] Ensure Valid Component ID is Initialized On Replica Sync

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Currently, the first time a replica is synchronized from master,

the valid component id on each replicated index's initial checkpoint

will be the initial value of a component id (-1). This value is

fixed when the the replica receives a flushed component from

the index. However, if the master fails before any component is

flushed to a replica and that replica is promoted to master, it

will start from an invalid component id. This change ensures that

the initial checkpoint of replicated indexes is initialized to

the maximum component id that appears on master. This will ensure

that if the replica is promoted, it will at least start from

a component that wasn't previously used on master.

- Replace assertion of component ids validation by illegal state.

Change-Id: I85395ad823a630725c4cab4bead1c61546dc61ae

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2973

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE] Don't close Keep-Alive connections on non-200/401

Change-Id: Ia39f8f9030be5a738a71de4c336a98e326ee896f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2972

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][STO] Ensure Files From Failed Bulkload Are Deleted

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- If a bulkload is interrupted at the end-stage (i.e. after all

tuples have been added but before the component is added to

the index's disk components), then the bulkload operation will

fail but the files from the failed operation are not deleted.

This change ensures that if a bulkload fails in such stage,

the files of the generated component are deleted to avoid

file is already mapped exception if the bulkload is attempted

again.

- Ensure disk component is only destroyed once in case of

bulkload cleanup.

- Stop attempting to write a checkpoint early if the failure was

due to the thread being interrupted.

Change-Id: I7f63054ac72a9482e779e49eb4da658a08fe7e9d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2970

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE][OTH] Ensure Stats Refresh is Thread Safe

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Make variables used in determining the need to refresh

stats volatile to ensure refresh won't be called by

multiple thread if not needed.

Change-Id: I07d76e53d193f93e0aaf08715e3f4c82b3b1524e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2969

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[ASTERIXDB-2174] Use ListSet when clone partition property

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Use ListSet instead of HashSet when cloning partitioning properties

to ensure it has the consistent behavior as before.

Change-Id: Ib2b8c1715d75b387a73504f4709524d9ab9ce123

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2968

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

[ASTERIXDB-2174] Fix partitioning improvement of group by

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fix the improvement of partitioning propagation of group by

introduced by https://asterix-gerrit.ics.uci.edu/#/c/2176/.

- The problem is that we cannot modify the partitioning property of the

input operator directly, since that property is owned by the input.

Otherwise, the property of the child operator would be modified even

before the group by operator, and this caused some tests regarding

common sub operator extration to fail (introducing REPLICATE).

Change-Id: I81a74ab1242772c790175414281e3f200537b386

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2966

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>