asterixdb

Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE][LOG] Ensure NC logDir ends with separator

- user model changes: no

- storage format changes: no

- interface changes: no

Change-Id: I492428fdbf84ed6f1c4afd136dce33ac84aea3c0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2982

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

[NO ISSUE] User-defined Function Documentation update

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

1. Updated the UDF documentation to be consisten with current master.

2. Cleaned default UDF package to remove useless UDFs.

3. Added the example in documentation as a test case for IT.

4. Reorganized the documentation to keep up with the new structure.

5. Minor changes to other documentation pages to keep style consistent.

Change-Id: I17b1b4d639ca38689298ce88145257e794eb90e1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2804

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +358
    /asterixdb/asterix-doc/src/main/data_ingestion/feeds.md
  1. … 13 more files in changeset.
[ASTERIXDB-2453] Add Improved Constant Merge Policy

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- The current constant merge policy is unsuable because of its high

merge cost, i.e., O(N*N) where N is the number of flushes. This patch

replaces the previous constant merge policy with a more efficient policy

that still enforces a maximum number of components but greatly lowers

the merge cost.

- Extend AbstractLSMIndex with a method to return the total number of

flushes, based on the file name sequencer. This is required by the new

policy.

Change-Id: Ie5f83a4d5fdd3f036b823c906df1760f5110ae0a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2971

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][NET] Avoid Sleeping The Network Thread on Failures

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- We currently sleep the networking thread incrementally with

every failure. This sleep was added to avoid CPU spinning

back when failures on pending networking operations were not

handled properly which led to processing the same networking

message that caused the failure over and over. This sleep is

not needed anymore since every failed read/write/send/connect

network operations will not be attempted again.

Change-Id: I9f7ddc088868f8cf4d0a15ec5349021af8ccae36

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2978

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[ASTERIXDB-2455][DOC] Deprecate AQL documentations

- user model changes: no

- storage format changes: no

- interface changes: no

details:

- Create [Deprecated] section and move AQL docs to there.

- Move some docs from /aql directory to /sqlpp directory.

Change-Id: I677dd7a8d114197eaa2ae93e0405184526b31a03

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2977

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +147
    /asterixdb/asterix-doc/src/site/markdown/sqlpp/filters.md
    • -0
    • +114
    /asterixdb/asterix-doc/src/site/markdown/sqlpp/fulltext.md
    • -0
    • +227
    /asterixdb/asterix-doc/src/site/markdown/sqlpp/similarity.md
    • -11
    • +11
    /asterixdb/asterix-doc/src/site/site.xml
[NO ISSUE][TEST] Add Test Case For Chunked Http Requests

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Add test case for chunked HTTP requests to ensure

the HTTP server can handle requests from clients

sending chunked requests.

Change-Id: I64ad01ca5ca322fb3efd4e86f053b70eb74e1079

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2975

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[ASTERIXDB-2437][COMP] Ensure the index-only plan on a composite index

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Ensure the proper build of an index-only plan on a composite index

where both fields are used in the SELECT condition and only one field

is returned.

Change-Id: Idcc4cbe08323e0c6edb4a01637b2017128da1ab5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2854

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Merge commit 'bd728afe' from stabilization-f69489

Change-Id: Ic382adcb9e6f0a084a029206a0785d979a45faad

[NO ISSUE][REPL] Ensure Valid Component ID is Initialized On Replica Sync

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Currently, the first time a replica is synchronized from master,

the valid component id on each replicated index's initial checkpoint

will be the initial value of a component id (-1). This value is

fixed when the the replica receives a flushed component from

the index. However, if the master fails before any component is

flushed to a replica and that replica is promoted to master, it

will start from an invalid component id. This change ensures that

the initial checkpoint of replicated indexes is initialized to

the maximum component id that appears on master. This will ensure

that if the replica is promoted, it will at least start from

a component that wasn't previously used on master.

- Replace assertion of component ids validation by illegal state.

Change-Id: I85395ad823a630725c4cab4bead1c61546dc61ae

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2973

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE] Don't close Keep-Alive connections on non-200/401

Change-Id: Ia39f8f9030be5a738a71de4c336a98e326ee896f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2972

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][STO] Ensure Files From Failed Bulkload Are Deleted

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- If a bulkload is interrupted at the end-stage (i.e. after all

tuples have been added but before the component is added to

the index's disk components), then the bulkload operation will

fail but the files from the failed operation are not deleted.

This change ensures that if a bulkload fails in such stage,

the files of the generated component are deleted to avoid

file is already mapped exception if the bulkload is attempted

again.

- Ensure disk component is only destroyed once in case of

bulkload cleanup.

- Stop attempting to write a checkpoint early if the failure was

due to the thread being interrupted.

Change-Id: I7f63054ac72a9482e779e49eb4da658a08fe7e9d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2970

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE][OTH] Ensure Stats Refresh is Thread Safe

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Make variables used in determining the need to refresh

stats volatile to ensure refresh won't be called by

multiple thread if not needed.

Change-Id: I07d76e53d193f93e0aaf08715e3f4c82b3b1524e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2969

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[ASTERIXDB-2174] Use ListSet when clone partition property

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Use ListSet instead of HashSet when cloning partitioning properties

to ensure it has the consistent behavior as before.

Change-Id: Ib2b8c1715d75b387a73504f4709524d9ab9ce123

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2968

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

[ASTERIXDB-2452] Recompute type env after ListifyUnnestingFunctionRule

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

-Recompute type env of the parent operator after firing

ListifyUnnestingFunctionRule. Otherwise the type env of the parent operator

would still point to the old operator, which is not correct.

Change-Id: I97bf721cb7fc9f36ec14214677d5545ae4aa1d2a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2967

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

[ASTERIXDB-2174] Fix partitioning improvement of group by

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fix the improvement of partitioning propagation of group by

introduced by https://asterix-gerrit.ics.uci.edu/#/c/2176/.

- The problem is that we cannot modify the partitioning property of the

input operator directly, since that property is owned by the input.

Otherwise, the property of the child operator would be modified even

before the group by operator, and this caused some tests regarding

common sub operator extration to fail (introducing REPLICATE).

Change-Id: I81a74ab1242772c790175414281e3f200537b386

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2966

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Merge commit '142aad08' from stabilization-f69489

Change-Id: I7ebe1f339fa27fc269f56f4e394622b452310638

[NO ISSUE] Avoid NPE logging shutdown hooks if shutdown already in progress

Change-Id: Id7102a975bd6e2d653198067bb5b5e7573ded7e7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2962

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[ASTERIXDB-2444][STO] Avoid Using System Clock in Checkpoints

- user model changes: no

- storage format changes: yes

- interface changes: yes

Details:

- Replace the usage of system clock timestamps in checkpoints

by a sequencer.

- Update Asterix/Hyracks storage version to reflect the recent

changes in storage.

- This change is expected to break storage backward compatibility.

Change-Id: Idc061e6eaccfb308b29a5a263b77a0a849694d4f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2961

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

[NO ISSUE][TX] Create New Log File Before Deleting Old Files

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Ensure next log file is created after a sharp check

point before deleting old files. This is to prevent

the case if a crash happens right after deleting the

old files but before creating the new one, then the

next time the system starts up, it will start with

log file id 0 which is wrong.

- Log the details of latest index checkpoint when the

low watermark of the new checkpoint is less than the

low watermakr of the latest checkpoint.

Change-Id: I4817f697b43daff55726909ab074ec30a1c224ce

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2959

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][STO] Ensure Index Component Sequence Uniqueness

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Currently, if two or more flushes are scheduled before any

of them create its files on disk, we will end up reusing

the same component sequence since the last used component

sequence is based on the files on disk. This change ensures

that the last use component sequence is only initialized

from the disk files and after that the last used component

sequence is incremented in memory.

Change-Id: I478ca3e2c9a98bab14a9145cc8b23eadbd0eab08

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2958

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][STO] Report batch operation failure before exiting

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- In certain cases, caller of a batch operation call are

interested in failure events.

- In those cases, we used to report failure after exiting

the components but with this change, failure reporting

happens before the exit.

Change-Id: I0c22b6bddfe8f12ef8e3c59dae0b0c585137a126

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2956

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[NO-ISSUE][COMP] Avoid adding redundant var in AbstractIntroduceGroupByCombinerRule

- user model changes: no

- storage format changes: no

- interface changes: no

For live variables added in new Group-by op, they should not be added

again.

Change-Id: Ic1ab9aee31db95d5782385bc3d53777da54f6d83

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2933

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

[NO ISSUE][ING] Fix race between active recovery and rebalance

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- In certain cases, a rebalance active suspend starts before

recovery of an active job starts.

- When that happens, sometimes, the recovery task exists and

the active job is not resumed after rebalance.

Change-Id: I66edb73950bb82baa1a1dfd892cb4b23bb7046be

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2950

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

[NO ISSUE][NET] Ensure CLOSE Is Not Sent After Channel ERROR

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Currently it is possible to send network channel

CLOSE command after a channel ERROR was sent. When this

happens and the channel was recycled to be reused

on the receiver side, the CLOSE command will result

in NPE. There is no need to send a CLOSE command

after an ERROR command because when an ERROR command

is received, it is treated as ERROR + CLOSE on the

receiver side.

- Avoid registering partition requests for failed jobs.

Change-Id: I17a769a46f4d13220adb22dd255e56dc4ccc458d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2954

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

Advance version to AsterixDB 0.9.5-SNAPSHOT and Hyracks 0.3.5-SNAPSHOT

Change-Id:Ied2b685f015e0f35563ebd0510231a5d663494f7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2953

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -1
    • +1
    /asterixdb/asterix-client-helper/pom.xml
    • -1
    • +1
    /asterixdb/asterix-external-data/pom.xml
  1. … 85 more files in changeset.
Release Apache AsterixDB 0.9.4 and 0.3.4

Change-Id:Ib015ae6e13f38eb726512a9c5ddeeda428ad1dff

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2952

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -1
    • +1
    /asterixdb/asterix-client-helper/pom.xml
    • -1
    • +1
    /asterixdb/asterix-external-data/pom.xml
  1. … 86 more files in changeset.
[ASTERIXDB-2446][COMP] Detect duplicate field names in select clause

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Throw compile-time error if select clause has duplicate projection names

Change-Id: Idd97c2edd6b4a627ad1a0225d95c26915d4ad5f7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2951

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Contrib: Till Westmann <tillw@apache.org>

Merge commit '95f508bbb1d07650392c21da2958ba1c53f2a03d' from stabilization-f69489

Change-Id: Ib6a428564681938dceb6ad4a2ba91f15256dc8a2

[NO ISSUE][OTH] Remove Unused Variable

- user model changes: no

- storage format changes: no

- interface changes: no

Change-Id: Ie782fd0bc081f3daa5eb77d2db556a1effb5600e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2949

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE][STO] Ensure First Component ID is Initialized

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Initialize the component id generator from the primary

index checkpoint, if exits, as soon as it is created.

- Ensure the first component id is passed to all indexes.

Change-Id: I246f9373f950e2f9a2c63f86746462e42a3f1c62

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2948

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>