Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[TEST] Add performance test for AsterixDB

1. Fix the issue that external var in ansible is truncked by space.

2. Add performance test comparison code for SparkSQL using small

instances.

Change-Id: Ic9ff8efa0be71bde67190ba6f9fbd647c7799084

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1879

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 41 more files in changeset.
Use JRE for AWS installation.

Change-Id: I25ca959f53c49c7aa1e2841227d27d7c254578be

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1776

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -0
    • +26
    ./yaml/install_jre.yml
Support stopping and restarting for a AWS-based cluster instance.

Change-Id: I77fff4a8a5f6e5d8ebee52eb66d86cc18f32cd12

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1643

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +37
    ./yaml/aws_terminate.yml
    • -0
    • +41
    ./yaml/instance_init.yml
  1. … 4 more files in changeset.
Make aws scripts work with all latest instance types that are equiped with instance-stores.

Change-Id: I16efff22a029e316c7a7dc0402c0131e0c0bdea4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1603

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -0
    • +41
    ./bin/gen_volumes.sh
  1. … 2 more files in changeset.
Minor fix for the aws_start script.

Change-Id: I7446868484a1ffd7ca84c3652276e69db5208498

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1599

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Auto-config SSDs for the AWS installtion.

Change-Id: I584cc0a9e7420b2b9144635fee107494cb3fa487

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1598

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +37
    ./conf/aws_types.yml
Configuration Revamp

- Ini section of node / cc details now returns ini param names instead of

managix option names

- Normalized command line -vs- ini file configuration parameter names

- Eliminated unused parameters

- Ini validation

- Migrate *DB parameters out of [app] and into nc / cc sections as

appropriate

- Eliminate [app] section. Cluster-wide configuration lives in [common]

- Sort properties alphabetically when returned by HTTP api

Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1487

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

  1. … 174 more files in changeset.
Ansible scripts for local cluster installation.

This change includes the following parts:

- Refactored aws scripts and share

the common part with non-aws cluster installation;

- Fixed aws_start.yml and aws_stop.yml to count

based on the user-provided tag.

Change-Id: I310f6f198c9ce41d7d7667dc4fbc21b3e34a77ab

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1525

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +102
    ./yaml/aws_start.yml
    • -0
    • +26
    ./yaml/install_jdk.yml
    • -0
    • +44
    ./yaml/instance_start.yml
  1. … 19 more files in changeset.
Add cluster performance testing scripts.

- Wait SSH instead of sleep in the AWS installation script;

- Remove Java code and generate config files in Ansible;

- TPC-H is one benchmark, and more benchmarks could be added into the framework.

Change-Id: Ie17f20dc87694a865aebc561d8eded064c66f5bb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1504

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 83 more files in changeset.
Change "samples" to "opt" in the distribution package.

This change also does the following things:

- make AWS script more robust: (1) can be run from anywhere,

(2) eliminate the need of customize_deployment.yml.

- cleanup documentation to reflect the directory structure

change.

- fix Managix zip to be able to directories deeper than 2 levels.

Change-Id: Ie7876376d089b9ebebba3d37ac90ac346a741be3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1482

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Ian Maxon <imaxon@apache.org>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +48
    ./ansible/aws_start.yml
    • -0
    • +35
    ./ansible/aws_stop.yml
    • -0
    • +65
    ./ansible/instance_start.yml
    • -0
    • +46
    ./conf/aws_settings.yml
    • -0
    • +45
    ./conf/instance_settings.yml
  1. … 25 more files in changeset.