asterix-installer

Clone Tools
  • last updated 24 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE][HYR][*DB] Dependency/versions cleanup

- Remove removed hyracks modules from dependency management

- Use all-inclusive version ranges for eclipse lifecycle plugin

- Move license plugin version to plugin management

Change-Id: Ib22c5a42977442ef5015f1b04cbd15334e84274c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1952

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 15 more files in changeset.
Advance version to AsterixDB 0.9.3-SNAPSHOT and Hyracks 0.3.3-SNAPSHOT

Change-Id:Id6cf0f514e357efe66c8da4a3cf10cd88e56fcca

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1925

Reviewed-by: Ian Maxon <imaxon@apache.org>

Integration-Tests: Ian Maxon <imaxon@apache.org>

Tested-by: Ian Maxon <imaxon@apache.org>

  1. … 106 more files in changeset.
Release Apache AsterixDB 0.9.2 and 0.3.2

Change-Id:I670467cf58f6432677237bcb2442ced65cd154ac

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1924

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 107 more files in changeset.
[ASTERIXDB-1949][FUN][ING] Function usage check refactoring in feed

- user model changes: no

- storage format changes: no

- interface changes: yes

Removed several interefaces for maintaining reference count.

Added getFunctions and getFeeds method for MetadataNode.

Details:

1. Change the usage check from reference count to scan feed connections

in all dataverses.

2. Add test case for drop dataverse which has function that is being

used in other dataverse. This operation should be blocked.

3. Fix small bug in apply function metadata which the function dataverse

was not recorded properly.

Change-Id: I568f7af18e69216ff2a5fd3b623a1667809b2f95

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1787

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 25 more files in changeset.
[ASTERIXDB-1946][STO][IDX]Create RTree/InvertedIdx for Correlated Datasets

- user model changes: allow creating secondary rtree and inverted index

for datasets using correlated merge policy

- storage format changes: no

- interface changes: no

details:

- Implmeneted create secondary RTree and Inverted Index for datasets

using correlated merge policy.

- Add tests for RTree and Inverted Index creation job

Change-Id: I100fc0b86b8a6fa36a95d77806107bad0307544e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1845

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 154 more files in changeset.
[ASTERIXDB-1952][TX][IDX]Log incoming filter vals

- user model changes: no

- interface changes: yes, for txn context

- storage format changes: yes, to log

details:

- Prior to this patch the filter values were not correct

on recovery. The tuple that was logged came from within

the wrapped indexand contained only the values to be stored.

In filtered scenarios this differs with what is fed to

the LSM wrapper to a respective index. redo plays the log

to the LSM wrapped index, so the input was simply not the

same on redo as it was during live ingestion. Three are other

ways to remedy this but the most straightforward is to simply

log what is given on input, and this is what this patch does.

- There is also a small fix for the way filters are accessed for

2ndary to primary search with an rtree index

Change-Id: I9268fe0b60145545c5933bab698d651c324397d7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1798

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

  1. … 94 more files in changeset.
[ASTERIXDB-1946][STO][IDX] Create BTreeIndex for Correlated Datasets

Implemented create seconary BTree index for datasets using

correlated merge policy. Instead of creating one component

for the new index, this change creates one component for each

component of the primary index to maintain the correlation.

The current implementation assumes when a secondary index is being

created, the dataset is locked with no modifications.

Change-Id: I2a3435e6720f07bd6a5092d4d9ce42e8d4b7894c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1813

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 106 more files in changeset.
Localize asterix-installer failsafe excludes

Ensure no other modules are affected by asterix-installer failsafe

exclusions by locating the exclusions to the asterix-installer module

Change-Id: I44cb8f29d8d8e7c1e9e394be4ec8d9f41e7b8a44

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1841

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 1 more file in changeset.
Enable Adding Nodes to Running *DB Cluster

Also ability to configure unique partition ids without having access to

complete cluster topology

Change-Id: If978442a95687c00ef78c89ed1b4440f5e308b99

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1785

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 17 more files in changeset.
Update Surefire/Failsafe Plugins To 2.20

Change-Id: Ib3a763a01c8dbe4c43c4e5106109a2e01f205590

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1772

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 6 more files in changeset.
Fix function usage check in feed

1. Add reference count field to Function entity.

2. Add reference count check when drop function.

3. Increate reference count when apply function to feed. Decrease the

reference count when disconnect feed.

4. Add test cases for drop function that is being used and drop function

that is no longer in use.

Change-Id: I04bed3836455997269a4cae7088dcc25c745a3df

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1763

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 23 more files in changeset.
Enable HTTP API processing on NCs

- Query/Status/Result are answered by NC nodes

- other HTTP requests are proxied to the CC node

- SessionConfig refactoring – split into config and output (SessionOutput)

- TestExecutor now can send http requests do multiple nodes (round robin)

Change-Id: I19414a23e163fc4deef9805c8f9089609f1ebe07

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1709

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 41 more files in changeset.
Advance version to AsterixDB 0.9.2-SNAPSHOT and Hyracks 0.3.2-SNAPSHOT

Change-Id:I4f05c7ceb1de1ed5c38d7c30e82c2ab7ee4323ca

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1680

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 106 more files in changeset.
Release Apache AsterixDB 0.9.1 and 0.3.1

Change-Id:I8719263e0550b0da1b715e3052e458fefca1ac8f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1679

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 107 more files in changeset.
Adding docker support for writing replication ITs

Change-Id: If7948a25f39e1c155ce96502572c1eef122f04bf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1644

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -0
    • +54
    ./src/test/resources/docker/Dockerfile
    • -0
    • +76
    ./src/test/resources/docker/cluster-config.xml
    • -0
    • +116
    ./src/test/resources/docker/docker-compose.yml
    • -0
    • +27
    ./src/test/resources/docker/id_rsa
    • -0
    • +1
    ./src/test/resources/docker/id_rsa.pub
ASTERIXDB-1881, ASTERIXDB-1882

1. Fix ASTERIXDB-1882, add Kermit license for ICanEatGlass.txt

2. Partial fix for ASTERIXDB-1881:

a. beer sample files removed

b. related tests commented out pending replacement test data

Change-Id: I3597dce962e3c640206671fcca9d4b9f9f5dd791

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1676

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 15 more files in changeset.
Fix Dependency Plugin Non-determinism

When processing the 0.9.1 release, the dependency plugin reported

false-positives when the version number advanced to the next snapshot.

Reworking how the overrides are expressed works around this issue.

Change-Id: I765bf1951d3d830569954b5683d724ed1545b167

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1675

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 1 more file in changeset.
Fix record loss for certain certain feed type

1. Fix blindly replace connector between FeedCollector and

AssignOperator.

2. Wrap AssignOperator into the FeedMetaOperator to make sure the

operators inside (udf, accessor, etc.) can handle messages in the

feed workflow.

3. Revise feed connection job merge function.

4. Test case fix.

Change-Id: I4e1f7dd3621482a11feb675a93b826ae2cb965a7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1652

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 6 more files in changeset.
AsterixDB Rat Execution Audit & Fixes

Change-Id: I3d771c5b63eaef4b6a0b4da769039ed5bca17736

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1609

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -0
    • +0
    ./src/main/resources/scripts/verify.sh
    • -0
    • +18
    ./src/test/resources/clusterts/hosts
  1. … 479 more files in changeset.
ASTERIXDB-1841: Fix Inverted Index Drop Operator

Change-Id: I2c0f52770fd791ab9293c661de810c0b3b9ba8fb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1600

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 9 more files in changeset.
Remove Plan Plotter

Change-Id: Ib6a77070344a40c3ae5bb9ff20b8593506d3c746

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1587

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 14 more files in changeset.
Fix Missing License, Add Tests

- Fix missing license for updated appassembler components

- Add tests to prevent missing licenses

Change-Id: Ic6f4afc3dd9edd311709bf14ac4cbc7438a3716d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1583

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 4 more files in changeset.
Fix transaction logs and optimize upserts

Previously, Transaction logs didn't log previous image

which made it difficult to undo aborted transactions

correctly. This change fixes that by always recording

previous image.

In addition, Upsert was performed as a delete if found

followed by an insert with two logs. This change makes

it a single operation with a single transaction log.

Change-Id: Ice5296267033cd7debe76894c864c6411f761d83

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1554

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -1
    • +0
    ./src/main/assembly/binary-assembly.xml
  1. … 61 more files in changeset.
Remove Usages Of Jps To Enable Running With JRE

Fixes ASTERIXDB-1832 - Cluster scripts shouldn't require JDK

Change-Id: Iddb52d2a2696c8c43af92fda9b6806d9798bf881

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1563

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -1
    • +1
    ./src/main/resources/zookeeper/stop_zk
  1. … 27 more files in changeset.
Configuration Revamp

- Ini section of node / cc details now returns ini param names instead of

managix option names

- Normalized command line -vs- ini file configuration parameter names

- Eliminated unused parameters

- Ini validation

- Migrate *DB parameters out of [app] and into nc / cc sections as

appropriate

- Eliminate [app] section. Cluster-wide configuration lives in [common]

- Sort properties alphabetically when returned by HTTP api

Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1487

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

  1. … 166 more files in changeset.
Exceptions Cleanup for Replication/FaultTolerance Strategies

Change-Id: I8f28b8db42bf7c8537ff2da22cbd2a97e243f32f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1529

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 18 more files in changeset.
ASTERIXDB-1711: Move test infra from test.aql

Change-Id: I5d631a2028fb80c823fbaafb7269f15d07685dc9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1512

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 22 more files in changeset.
Introduce Strategy Based Replication and Fault-Tolerance

This change includes the following:

- Introduce new APIs for Replication and Fault-Tolerance Strategies.

- Add configuration in cluster description file for high-availability.

- Add built-in replication strategies (Metadata_Only, Chained_Declustering)

- Add built-in fault-tolerance strategies (Auto, Metadata_Node)

- Remove none cluster state functionality from ClusterStateManager.

- Add customizable NC startup sequence

Change-Id: I1d1012f5541ce786f127866efefb9f3db434fedd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1405

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 97 more files in changeset.
Feed Connection Refactoring

1. The feed subscription network using FeedJoint is removed.

2. FeedConnection metadata dataset is added (pkeys: dataverseName,

feedName, datasetName).

3. Replaced the old intake job + collect job combination with one single

job using SplitOperator.

4. Now one feed can connect to multiple datasets.

5. The disconnect feed job is replaced by ActiveManagerMessage.

6. The new feed life cycle is:

- Create feed

- Connect feed to dataset0, dataset1, dataset2, etc.

- Start feed

- Stop feed

- Disconnect feed

7. New feedEventListner framework by Abdullah

Change-Id: Ic36267eb9a10df21734ce1cc1f38583e23c9e8f0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1259

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 189 more files in changeset.
Fix async result delivery

- add new result status "started" for async requests

- add support for result status to the test framework

- stabilize result distribution for error in async requests

- add support for "pollget" to test async execution

- add sleep function

- allow inject-failure function to return any first argument

- use URIs instead on Strings in the TestExecutor to ensure that URIs are

correctly escaped

- add a few tests

Change-Id: Iafba65d9c7bd8643c42e5126c8d89164ae328908

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1394

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 84 more files in changeset.