asterix-installer

Clone Tools
  • last updated a few seconds ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[ASTERIXDB-1723] Remove asterix-installer temp pom

This is just to remove the dummy pom that was used before

the main change was merged, to allow all of the tests to

run. Now the jobs have been changed to not require it.

Change-Id: Iaca791e965c095c23ccc5af0f95cba5adcbd9d1e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2228

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 1 more file in changeset.
[ASTERIXDB-1723] Delete managix

- user model changes: yes

- storage format changes: no

- interface changes: yes

Details:

- Delete managix installer method and all dependencies

- Remove xml-based configuration

Change-Id: I5c710b6ec870bedd49dd46b74ed96a3665670e9b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2155

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -147
    • +0
    ./src/main/assembly/binary-assembly.xml
  1. … 1364 more files in changeset.
[NO ISSUE][STO] Introduce Index Checkpoints

- user model changes: no

- storage format changes: yes

- Add index checkpoints.

- Use index checkpoint to determine low watermark

during recovery.

- interface changes: yes

- Introduce IIndexCheckpointManager for managing

indexes checkpoints.

- Introduce IIndexCheckpointProvider for tracking

IIndexCheckpointManager references.

Details:

- Unify LSM flush/merge operations completion order.

- Introduce index checkpoints which contains:

- Index low watermark.

- Latest valid LSM component

- Mapping between master replica and local replica.

- Use index checkpoints instead of LSM component metadata

for identifying low watermark in recovery.

- Use index checkpoints in replication instead of overwriting

LSN byte offset in replica component metadata.

- Replace LSN_MAP used in replication by index checkpoints.

- Replace NIO Files.find by Commons FileUtils.listFiles to

avoid no NoSuchFileException on any file deletion.

Change-Id: Ib22800002bf8ea3660242e599b3f5f20678301a8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2200

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 47 more files in changeset.
[ASTERIXDB-2182][SQL] Change merge policy syntax

- user model changes: yes

- change the way a merge policy is specified

- storage format changes: no

- interface changes: no

details:

- previously, merge policies are specified as follows:

<USING> <COMPACTION> <POLICY>

prefix_merge (("number"="123"),("size"="456"));

- After this change, the policies are specified as:

<WITH> {

"merge-policy": {

"name": "prefix",

"parameters": { "number": 123, "size": 456 }

}

};

- compaction and policy are not key words anymore

Change-Id: I040f4c74cfa0170b8888128ad5f975e196658776

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2183

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 76 more files in changeset.
[NO ISSUE][API] Add NC Storage API

- user model changes: no

- storage format changes: no

- interface changes: yes

Add IStorageSubsystem to track storage partitions

replicas.

Details:

- Add NC API port.

- Add storage API to NCs.

- Add StorageSubsystem to track storage partitions

replicas.

Change-Id: I120d9892bc9fe5a73395cd5a2ddc30b51b73ced2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2190

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +2
    ./src/test/resources/clusterts/cluster.xml
  1. … 18 more files in changeset.
[ASTERIXDB-2171][STO] Remove Temporary Datasets

- user model changes: no

- storage format changes: no

- interface changes: yes

- Removed all reference to temporary datasets.

Details:

- Remove temporary datasets grammar but reserve

<TEMPORARY> token.

- Remove special callbacks for temp datasets.

- Remove metadata garbage collector thread.

- Remove isTemp flag from datasets.

- Remove special storage path for temp datasets.

- Remove temp datasets test cases.

Change-Id: Ib50ea27e2ec9c114508cd4a109cf646e2f20dcb0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2172

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 355 more files in changeset.
Advance version to AsterixDB 0.9.4-SNAPSHOT and Hyracks 0.3.4-SNAPSHOT

Change-Id:I5902012492cb51231a5b78c464a6ac0ab9dfdc06

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2171

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Ian Maxon <imaxon@apache.org>

  1. … 107 more files in changeset.
Release Apache AsterixDB 0.9.3 and 0.3.3

Change-Id:I86e454c944db8a4c960aa89bb0e9c6040181e28c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2170

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Ian Maxon <imaxon@apache.org>

  1. … 107 more files in changeset.
[NO ISSUE] Update plugin versions

Updated / aligned plugin versions as follows:

doxia-maven-plugin -> 1.1.4

git-commit-id-plugin -> 2.2.3

maven-enforcer-plugin -> 3.0.0-M1

maven-javadoc-plugin -> 3.0.0-M1

maven-jaxb2-plugin -> 0.13.2

maven-plugin-plugin -> 3.5

maven-site-plugin -> 3.4

Change-Id: Ifb75f6aa3b2555a981421b50b32cac75f28ef6fc

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2113

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 10 more files in changeset.
[NO ISSUE] Update plugin versions

Updated / aligned plugin versions as follows:

build-helper-maven-plugin -> 3.0.0

maven-antrun-plugin -> 1.8

maven-assembly-plugin -> 3.1.0

maven-clean-plugin -> 3.0.0

maven-compiler-plugin -> 3.7.0

maven-dependency-plugin -> 3.0.2

maven-failsafe-plugin -> 2.20.1

maven-jar-plugin -> 3.0.2

maven-resources-plugin -> 3.0.2

maven-scm-plugin -> 1.9.5

maven-surefire-plugin -> 2.20.1

versions-maven-plugin -> 2.5

Change-Id: I3bdeec1d8ac7c7cefa900a0b1d453cb845f85846

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2108

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -3
    • +3
    ./src/main/assembly/binary-assembly.xml
  1. … 32 more files in changeset.
[NO ISSUE] Refactoring / cleanup

- Use shared ObjectMapper instance where possible for servlets

- Add StringUtil with camel-case conversion utility

- Serialize properties in alphabetical order when using JSONUtil

Change-Id: Idd1b805dfa425dcd87d83e361297a0351c56cc6a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2033

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 22 more files in changeset.
[ASTERIXDB-2107][CLUS] Prevent Invalid UNUSABLE State in Dynamic Topology

- user model changes: no

- storage format changes: no

- interface changes: yes

Renamed IClusterStateManager add/Remove NCConfig methods

to notifyNode join/failure.

Details:

- Mark node as participant when it completes its startup and

not when it joins the cluster.

- Allow partitions to be added with pending activation state.

- Remove the use of static MetadataProperties for reporting number of nodes.

- Add test cases.

Change-Id: I7a0db2d66cf44650dcc673b3f2de537816cb84c7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2029

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 7 more files in changeset.
Merge release 0.9.2, Advance to 0.9.3-SNAPSHOT

Change-Id:Id6cf0f514e357efe66c8da4a3cf10cd88e56fccb

  1. … 18 more files in changeset.
[NO ISSUE][HYR][*DB] Dependency/versions cleanup

- Remove removed hyracks modules from dependency management

- Use all-inclusive version ranges for eclipse lifecycle plugin

- Move license plugin version to plugin management

Change-Id: Ib22c5a42977442ef5015f1b04cbd15334e84274c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1952

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 15 more files in changeset.
Advance version to AsterixDB 0.9.3-SNAPSHOT and Hyracks 0.3.3-SNAPSHOT

Change-Id:Id6cf0f514e357efe66c8da4a3cf10cd88e56fcca

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1925

Reviewed-by: Ian Maxon <imaxon@apache.org>

Integration-Tests: Ian Maxon <imaxon@apache.org>

Tested-by: Ian Maxon <imaxon@apache.org>

  1. … 106 more files in changeset.
Release Apache AsterixDB 0.9.2 and 0.3.2

Change-Id:I670467cf58f6432677237bcb2442ced65cd154ac

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1924

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 107 more files in changeset.
[ASTERIXDB-1949][FUN][ING] Function usage check refactoring in feed

- user model changes: no

- storage format changes: no

- interface changes: yes

Removed several interefaces for maintaining reference count.

Added getFunctions and getFeeds method for MetadataNode.

Details:

1. Change the usage check from reference count to scan feed connections

in all dataverses.

2. Add test case for drop dataverse which has function that is being

used in other dataverse. This operation should be blocked.

3. Fix small bug in apply function metadata which the function dataverse

was not recorded properly.

Change-Id: I568f7af18e69216ff2a5fd3b623a1667809b2f95

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1787

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 25 more files in changeset.
[ASTERIXDB-1946][STO][IDX]Create RTree/InvertedIdx for Correlated Datasets

- user model changes: allow creating secondary rtree and inverted index

for datasets using correlated merge policy

- storage format changes: no

- interface changes: no

details:

- Implmeneted create secondary RTree and Inverted Index for datasets

using correlated merge policy.

- Add tests for RTree and Inverted Index creation job

Change-Id: I100fc0b86b8a6fa36a95d77806107bad0307544e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1845

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 154 more files in changeset.
[ASTERIXDB-1952][TX][IDX]Log incoming filter vals

- user model changes: no

- interface changes: yes, for txn context

- storage format changes: yes, to log

details:

- Prior to this patch the filter values were not correct

on recovery. The tuple that was logged came from within

the wrapped indexand contained only the values to be stored.

In filtered scenarios this differs with what is fed to

the LSM wrapper to a respective index. redo plays the log

to the LSM wrapped index, so the input was simply not the

same on redo as it was during live ingestion. Three are other

ways to remedy this but the most straightforward is to simply

log what is given on input, and this is what this patch does.

- There is also a small fix for the way filters are accessed for

2ndary to primary search with an rtree index

Change-Id: I9268fe0b60145545c5933bab698d651c324397d7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1798

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

  1. … 94 more files in changeset.
[ASTERIXDB-1946][STO][IDX] Create BTreeIndex for Correlated Datasets

Implemented create seconary BTree index for datasets using

correlated merge policy. Instead of creating one component

for the new index, this change creates one component for each

component of the primary index to maintain the correlation.

The current implementation assumes when a secondary index is being

created, the dataset is locked with no modifications.

Change-Id: I2a3435e6720f07bd6a5092d4d9ce42e8d4b7894c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1813

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 106 more files in changeset.
Localize asterix-installer failsafe excludes

Ensure no other modules are affected by asterix-installer failsafe

exclusions by locating the exclusions to the asterix-installer module

Change-Id: I44cb8f29d8d8e7c1e9e394be4ec8d9f41e7b8a44

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1841

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 1 more file in changeset.
Enable Adding Nodes to Running *DB Cluster

Also ability to configure unique partition ids without having access to

complete cluster topology

Change-Id: If978442a95687c00ef78c89ed1b4440f5e308b99

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1785

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 17 more files in changeset.
Update Surefire/Failsafe Plugins To 2.20

Change-Id: Ib3a763a01c8dbe4c43c4e5106109a2e01f205590

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1772

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 6 more files in changeset.
Fix function usage check in feed

1. Add reference count field to Function entity.

2. Add reference count check when drop function.

3. Increate reference count when apply function to feed. Decrease the

reference count when disconnect feed.

4. Add test cases for drop function that is being used and drop function

that is no longer in use.

Change-Id: I04bed3836455997269a4cae7088dcc25c745a3df

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1763

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 23 more files in changeset.
Enable HTTP API processing on NCs

- Query/Status/Result are answered by NC nodes

- other HTTP requests are proxied to the CC node

- SessionConfig refactoring – split into config and output (SessionOutput)

- TestExecutor now can send http requests do multiple nodes (round robin)

Change-Id: I19414a23e163fc4deef9805c8f9089609f1ebe07

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1709

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 41 more files in changeset.
Advance version to AsterixDB 0.9.2-SNAPSHOT and Hyracks 0.3.2-SNAPSHOT

Change-Id:I4f05c7ceb1de1ed5c38d7c30e82c2ab7ee4323ca

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1680

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 106 more files in changeset.
Release Apache AsterixDB 0.9.1 and 0.3.1

Change-Id:I8719263e0550b0da1b715e3052e458fefca1ac8f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1679

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 107 more files in changeset.
Adding docker support for writing replication ITs

Change-Id: If7948a25f39e1c155ce96502572c1eef122f04bf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1644

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -0
    • +54
    ./src/test/resources/docker/Dockerfile
    • -0
    • +76
    ./src/test/resources/docker/cluster-config.xml
    • -0
    • +116
    ./src/test/resources/docker/docker-compose.yml
    • -0
    • +27
    ./src/test/resources/docker/id_rsa
    • -0
    • +1
    ./src/test/resources/docker/id_rsa.pub
ASTERIXDB-1881, ASTERIXDB-1882

1. Fix ASTERIXDB-1882, add Kermit license for ICanEatGlass.txt

2. Partial fix for ASTERIXDB-1881:

a. beer sample files removed

b. related tests commented out pending replacement test data

Change-Id: I3597dce962e3c640206671fcca9d4b9f9f5dd791

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1676

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 15 more files in changeset.
Fix Dependency Plugin Non-determinism

When processing the 0.9.1 release, the dependency plugin reported

false-positives when the version number advanced to the next snapshot.

Reworking how the overrides are expressed works around this issue.

Change-Id: I765bf1951d3d830569954b5683d724ed1545b167

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1675

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 1 more file in changeset.