Clone Tools
  • last updated 14 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[ASTERIXDB-1723] Delete managix

- user model changes: yes

- storage format changes: no

- interface changes: yes

Details:

- Delete managix installer method and all dependencies

- Remove xml-based configuration

Change-Id: I5c710b6ec870bedd49dd46b74ed96a3665670e9b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2155

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -117
    • +0
    ./apache/asterix/installer/test/ReplicationIT.java
  1. … 1365 more files in changeset.
[NO ISSUE][STO] Introduce Index Checkpoints

- user model changes: no

- storage format changes: yes

- Add index checkpoints.

- Use index checkpoint to determine low watermark

during recovery.

- interface changes: yes

- Introduce IIndexCheckpointManager for managing

indexes checkpoints.

- Introduce IIndexCheckpointProvider for tracking

IIndexCheckpointManager references.

Details:

- Unify LSM flush/merge operations completion order.

- Introduce index checkpoints which contains:

- Index low watermark.

- Latest valid LSM component

- Mapping between master replica and local replica.

- Use index checkpoints instead of LSM component metadata

for identifying low watermark in recovery.

- Use index checkpoints in replication instead of overwriting

LSN byte offset in replica component metadata.

- Replace LSN_MAP used in replication by index checkpoints.

- Replace NIO Files.find by Commons FileUtils.listFiles to

avoid no NoSuchFileException on any file deletion.

Change-Id: Ib22800002bf8ea3660242e599b3f5f20678301a8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2200

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 47 more files in changeset.
[NO ISSUE] Refactoring / cleanup

- Use shared ObjectMapper instance where possible for servlets

- Add StringUtil with camel-case conversion utility

- Serialize properties in alphabetical order when using JSONUtil

Change-Id: Idd1b805dfa425dcd87d83e361297a0351c56cc6a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2033

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 26 more files in changeset.
Enable Adding Nodes to Running *DB Cluster

Also ability to configure unique partition ids without having access to

complete cluster topology

Change-Id: If978442a95687c00ef78c89ed1b4440f5e308b99

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1785

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 17 more files in changeset.
Enable HTTP API processing on NCs

- Query/Status/Result are answered by NC nodes

- other HTTP requests are proxied to the CC node

- SessionConfig refactoring – split into config and output (SessionOutput)

- TestExecutor now can send http requests do multiple nodes (round robin)

Change-Id: I19414a23e163fc4deef9805c8f9089609f1ebe07

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1709

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 41 more files in changeset.
AsterixDB Rat Execution Audit & Fixes

Change-Id: I3d771c5b63eaef4b6a0b4da769039ed5bca17736

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1609

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 493 more files in changeset.
Fix Missing License, Add Tests

- Fix missing license for updated appassembler components

- Add tests to prevent missing licenses

Change-Id: Ic6f4afc3dd9edd311709bf14ac4cbc7438a3716d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1583

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +29
    ./apache/asterix/installer/test/InstallerLicensingIT.java
  1. … 5 more files in changeset.
Configuration Revamp

- Ini section of node / cc details now returns ini param names instead of

managix option names

- Normalized command line -vs- ini file configuration parameter names

- Eliminated unused parameters

- Ini validation

- Migrate *DB parameters out of [app] and into nc / cc sections as

appropriate

- Eliminate [app] section. Cluster-wide configuration lives in [common]

- Sort properties alphabetically when returned by HTTP api

Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1487

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

  1. … 169 more files in changeset.
Exceptions Cleanup for Replication/FaultTolerance Strategies

Change-Id: I8f28b8db42bf7c8537ff2da22cbd2a97e243f32f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1529

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 18 more files in changeset.
ASTERIXDB-1711: Move test infra from test.aql

Change-Id: I5d631a2028fb80c823fbaafb7269f15d07685dc9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1512

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 22 more files in changeset.
Introduce Strategy Based Replication and Fault-Tolerance

This change includes the following:

- Introduce new APIs for Replication and Fault-Tolerance Strategies.

- Add configuration in cluster description file for high-availability.

- Add built-in replication strategies (Metadata_Only, Chained_Declustering)

- Add built-in fault-tolerance strategies (Auto, Metadata_Node)

- Remove none cluster state functionality from ClusterStateManager.

- Add customizable NC startup sequence

Change-Id: I1d1012f5541ce786f127866efefb9f3db434fedd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1405

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -0
    • +118
    ./apache/asterix/installer/test/MetadataReplicationIT.java
  1. … 109 more files in changeset.
Fix async result delivery

- add new result status "started" for async requests

- add support for result status to the test framework

- stabilize result distribution for error in async requests

- add support for "pollget" to test async execution

- add sleep function

- allow inject-failure function to return any first argument

- use URIs instead on Strings in the TestExecutor to ensure that URIs are

correctly escaped

- add a few tests

Change-Id: Iafba65d9c7bd8643c42e5126c8d89164ae328908

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1394

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 84 more files in changeset.
Enable Replication Tests on Multi-NC Setup

- Move replication IT from vagrant VMs to multi-NC setup.

- Add 'node' command to kill specific node process.

- Fix file path passing to replication manager.

Change-Id: I542b212e04469e2701690f464f821a5189b97f12

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1364

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -180
    • +39
    ./apache/asterix/installer/test/ReplicationIT.java
  1. … 45 more files in changeset.
Fix Installer tests on Local machines

Change-Id: Idcb10e0e72d6a60d91fe1845567bac1208991f93

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1354

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 5 more files in changeset.
Tests for ASTERIXDB-1725

Just inserts a really big record, stops, and starts again.

This should always work, but for the bug, it'd cause a nullpointer

upon querying the dataset.

Change-Id: I8b241acebbdcd658e734a43d03259a1ea24d8b57

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1344

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 8 more files in changeset.
Tests for ASTERIXDB-1636

This is a test for the scenario described in the Jira issue. The only

thing I have taken liberty with is changing the socket feed to a file

one. The test case fails when I revert AqlMetadataProvider to the

previous version, and should pass now with this parent.

Change-Id: Ic1521f1d53121b67677778ac123e49e731932c85

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1248

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@yahoo.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +102
    ./apache/asterix/installer/test/AsterixRestartIT.java
  1. … 18 more files in changeset.
Add JUnit Rule Implementation To Trace Test Methods

Change-Id: I8ecc73825881714d33c7937a1de4eda32d51a85c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1194

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 4 more files in changeset.
Add Default Dataverse and AnyObject Datatype

This change adds "Default" dataverse and

Metadata.AnyObject type which is the completely

open record type. In addition, this change cleansup between

subsequent test cases lowering the chance that a failed

test causes the following tests to fail. In addition, it

prints out the list of tests which left some leftover.

Change-Id: Ie02c74c8b005dce73888afd4dfe19ede2c60a8e8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1174

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 197 more files in changeset.
Expose Asterix Configuration on Cluster Servlet

Also, a few test executor improvements

Change-Id: I828d6a61afe615f7826079ede4b1d638bbd7ac5d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1153

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 14 more files in changeset.
Retain Server Logs On IT Test Failures

Server logs are saved to target/failsafe-reports/ in case of test failure.

Change-Id: I667111c03e7394f75cb5c4cd24b4db1c944e68b7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/954

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 2 more files in changeset.
More ASTERIXDB-1475

Ensure external-data test jar is on classpath for integration runtime

tests. Also, isolate downstream tests from upstream failures by manually

forcing existing instance to shutdown / delete prior to creating the

server for recovery tests.

Change-Id: I87f8ac08d1c78d0539607efa43f82ec2aba16b1b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/933

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <michael.blow@couchbase.com>

  1. … 4 more files in changeset.
Move maven-failsafe-plugin to asterixdb top level

Also improved logging for AsterixLifecycleIT

Change-Id: I605a9e55a3504dd9942dbdcbc7468ffda90d8a93

Reviewed-on: https://asterix-gerrit.ics.uci.edu/914

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 3 more files in changeset.
Fix Installer Test Regression For Big Object Tests

copy target/data for installer tests

Change-Id: I012ff4968b97cb93cb3f58580f3ae5e288a5645c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/858

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Michael Blow <michael.blow@couchbase.com>