Clone Tools
  • last updated 28 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[ASTERIXDB-1723] Delete managix

- user model changes: yes

- storage format changes: no

- interface changes: yes

Details:

- Delete managix installer method and all dependencies

- Remove xml-based configuration

Change-Id: I5c710b6ec870bedd49dd46b74ed96a3665670e9b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2155

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 1364 more files in changeset.
[ASTERIXDB-2182][SQL] Change merge policy syntax

- user model changes: yes

- change the way a merge policy is specified

- storage format changes: no

- interface changes: no

details:

- previously, merge policies are specified as follows:

<USING> <COMPACTION> <POLICY>

prefix_merge (("number"="123"),("size"="456"));

- After this change, the policies are specified as:

<WITH> {

"merge-policy": {

"name": "prefix",

"parameters": { "number": 123, "size": 456 }

}

};

- compaction and policy are not key words anymore

Change-Id: I040f4c74cfa0170b8888128ad5f975e196658776

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2183

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 76 more files in changeset.
[ASTERIXDB-2171][STO] Remove Temporary Datasets

- user model changes: no

- storage format changes: no

- interface changes: yes

- Removed all reference to temporary datasets.

Details:

- Remove temporary datasets grammar but reserve

<TEMPORARY> token.

- Remove special callbacks for temp datasets.

- Remove metadata garbage collector thread.

- Remove isTemp flag from datasets.

- Remove special storage path for temp datasets.

- Remove temp datasets test cases.

Change-Id: Ib50ea27e2ec9c114508cd4a109cf646e2f20dcb0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2172

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 355 more files in changeset.
[ASTERIXDB-1946][STO][IDX]Create RTree/InvertedIdx for Correlated Datasets

- user model changes: allow creating secondary rtree and inverted index

for datasets using correlated merge policy

- storage format changes: no

- interface changes: no

details:

- Implmeneted create secondary RTree and Inverted Index for datasets

using correlated merge policy.

- Add tests for RTree and Inverted Index creation job

Change-Id: I100fc0b86b8a6fa36a95d77806107bad0307544e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1845

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 154 more files in changeset.
[ASTERIXDB-1952][TX][IDX]Log incoming filter vals

- user model changes: no

- interface changes: yes, for txn context

- storage format changes: yes, to log

details:

- Prior to this patch the filter values were not correct

on recovery. The tuple that was logged came from within

the wrapped indexand contained only the values to be stored.

In filtered scenarios this differs with what is fed to

the LSM wrapper to a respective index. redo plays the log

to the LSM wrapped index, so the input was simply not the

same on redo as it was during live ingestion. Three are other

ways to remedy this but the most straightforward is to simply

log what is given on input, and this is what this patch does.

- There is also a small fix for the way filters are accessed for

2ndary to primary search with an rtree index

Change-Id: I9268fe0b60145545c5933bab698d651c324397d7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1798

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

  1. … 94 more files in changeset.
[ASTERIXDB-1946][STO][IDX] Create BTreeIndex for Correlated Datasets

Implemented create seconary BTree index for datasets using

correlated merge policy. Instead of creating one component

for the new index, this change creates one component for each

component of the primary index to maintain the correlation.

The current implementation assumes when a secondary index is being

created, the dataset is locked with no modifications.

Change-Id: I2a3435e6720f07bd6a5092d4d9ce42e8d4b7894c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1813

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 111 more files in changeset.
AsterixDB Rat Execution Audit & Fixes

Change-Id: I3d771c5b63eaef4b6a0b4da769039ed5bca17736

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1609

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 479 more files in changeset.
ASTERIXDB-1841: Fix Inverted Index Drop Operator

Change-Id: I2c0f52770fd791ab9293c661de810c0b3b9ba8fb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1600

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 13 more files in changeset.
Feed Connection Refactoring

1. The feed subscription network using FeedJoint is removed.

2. FeedConnection metadata dataset is added (pkeys: dataverseName,

feedName, datasetName).

3. Replaced the old intake job + collect job combination with one single

job using SplitOperator.

4. Now one feed can connect to multiple datasets.

5. The disconnect feed job is replaced by ActiveManagerMessage.

6. The new feed life cycle is:

- Create feed

- Connect feed to dataset0, dataset1, dataset2, etc.

- Start feed

- Stop feed

- Disconnect feed

7. New feedEventListner framework by Abdullah

Change-Id: Ic36267eb9a10df21734ce1cc1f38583e23c9e8f0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1259

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 197 more files in changeset.
Disable hash merge exchange.

- Hash merge exchange does not work very well on large clusters.

- Hash merge exchange is used only when a user explicitly enable it.

Change-Id: If82c4e4db1d4340cdd53d17e48a193ab2b7a05e0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1345

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 42 more files in changeset.
ASTERIXDB-1538: fix an issue where LSMRTree index instance is created during the recovery process.

- LSMRTreeWithAntiMatterTuples index instance is properly created during the recovery process.

Change-Id: I701a7ad748ff8982534a132a01f5a1ae77c952fd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1010

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

  1. … 6 more files in changeset.
Hard Tabs++

Eliminate more hard tabs, widen scope of checkstyle rules to prevent regressions.

Relax whitespace expectations in polygon ctor

Change-Id: Ia3f78fc6705bc79a21cfa97fdfcad30998ab1058

Reviewed-on: https://asterix-gerrit.ics.uci.edu/967

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 451 more files in changeset.
ASTERIXDB-1489 Fix Query After Restart Test Case

Since the adapter's produced data type was modified, the type in

the test case had to be updated.

Change-Id: I8735bc049ad5a9380a8f770c5ba35d901f194100

Reviewed-on: https://asterix-gerrit.ics.uci.edu/966

Reviewed-by: Michael Blow <michael.blow@couchbase.com>

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

ASTERIXDB-1474: Cannot query dataset with big obj

Fixes ASTERIXDB-1474: Cannot query a dataset with big object after restart

- large page information managed by buffer cache, outside of page

- size header written out a prefix to pages

Change-Id: I2f47c551a053e193519a4337c338934f3e171afd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/920

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -0
    • +1
    ./query_after_restart/big_object_20M/big_object_20M.1.script.aql
    • -0
    • +36
    ./query_after_restart/big_object_20M/big_object_20M.2.ddl.aql
    • -0
    • +30
    ./query_after_restart/big_object_20M/big_object_20M.3.update.aql
    • -0
    • +1
    ./query_after_restart/big_object_20M/big_object_20M.4.script.aql
    • -0
    • +23
    ./query_after_restart/big_object_20M/big_object_20M.5.query.aql
    • -0
    • +1
    ./query_after_restart/big_object_20M/big_object_20M.6.script.aql
  1. … 49 more files in changeset.
Remove Test Classes From Production Binaries

Change-Id: I1da72566e7d140a1fb965c893dcea6881b99ca26

Reviewed-on: https://asterix-gerrit.ics.uci.edu/901

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 23 more files in changeset.
Move merged files

    • -0
    • +27
    ./query_after_restart/dataset-with-meta-record/dataset-with-meta-record.3.update.aql
    • -0
    • +29
    ./query_after_restart/dataset-with-meta-record/dataset-with-meta-record.5.query.aql
  1. … 158 more files in changeset.
Merge branch 'master' into hyracks-merge2

  1. … 484 more files in changeset.