Clone Tools
  • last updated 27 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Add install/uninstall UDF to Ansible

1. Add udf.sh for handling install/uninstall UDF packages to the cluster.

2. Remove unnecessary path check in TestLibrarian.

Change-Id: If7ea9640a06e2b691c19a8a819307d84b55a679e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1682

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +72
    ./ansible/bin/udf.sh
    • -0
    • +30
    ./ansible/yaml/deploy_udf.yml
    • -0
    • +33
    ./ansible/yaml/destroy_udf.yml
  1. … 2 more files in changeset.
Support stopping and restarting for a AWS-based cluster instance.

Change-Id: I77fff4a8a5f6e5d8ebee52eb66d86cc18f32cd12

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1643

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +28
    ./aws/bin/terminate.sh
    • -0
    • +37
    ./aws/yaml/aws_terminate.yml
    • -0
    • +41
    ./aws/yaml/instance_init.yml
  1. … 1 more file in changeset.
AsterixDB Rat Execution Audit & Fixes

Change-Id: I3d771c5b63eaef4b6a0b4da769039ed5bca17736

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1609

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 492 more files in changeset.
Make aws scripts work with all latest instance types that are equiped with instance-stores.

Change-Id: I16efff22a029e316c7a7dc0402c0131e0c0bdea4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1603

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -0
    • +41
    ./aws/bin/gen_volumes.sh
Remove Extraneous Quotes in Start Sample Batchfile

e.g.

"--------------------------"

"Mon 03/20/2017 19:31:01.81"

"--------------------------"

Change-Id: I24581eb36e193628b93cb5be52903beb206c603d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1605

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Minor fix for the aws_start script.

Change-Id: I7446868484a1ffd7ca84c3652276e69db5208498

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1599

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Auto-config SSDs for the AWS installtion.

Change-Id: I584cc0a9e7420b2b9144635fee107494cb3fa487

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1598

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +37
    ./aws/conf/aws_types.yml
    • -0
    • +28
    ./aws/yaml/mount.yml
Remove Usages Of Jps To Enable Running With JRE

Fixes ASTERIXDB-1832 - Cluster scripts shouldn't require JDK

Change-Id: Iddb52d2a2696c8c43af92fda9b6806d9798bf881

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1563

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 40 more files in changeset.
Fix ERROR When Running Stop Sample Bat On Windows

When running stop-sample-cluster.bat from a non-interactive shell on

Windows, the following error has been observed:

ERROR: Input redirection is not supported, exiting the process immediately

Implemented a sleep function in client helper, to workaround the

limitations of the Windows TIMEOUT command.

Change-Id: Id2a68ec8217690a79b6c49fa670728cf67e81654

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1565

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 3 more files in changeset.
Update [app] to [common] in configs.

Change-Id: Ieb81dbcb9ac592227133f3e80adcc032d7232f25

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1557

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Allow spaces in sample script folder for Windows

Change-Id: I74da9e032ccf9d5f13f6352b6f5d48650b9ab63b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1545

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -13
    • +13
    ./local/bin/start-sample-cluster.bat
Configuration Revamp

- Ini section of node / cc details now returns ini param names instead of

managix option names

- Normalized command line -vs- ini file configuration parameter names

- Eliminated unused parameters

- Ini validation

- Migrate *DB parameters out of [app] and into nc / cc sections as

appropriate

- Eliminate [app] section. Cluster-wide configuration lives in [common]

- Sort properties alphabetically when returned by HTTP api

Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1487

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

  1. … 171 more files in changeset.
Fix log redirection in Ansible start cluster scripts.

Change-Id: Ia62a9f5d313c5d7ad0629af95199c2f7b4538435

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1553

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Fix local cluster stop and erase scripts.

- Use ps to list processes

- Stop the instance first in bin/erase.sh

- Copy cc.conf to {{ binarydir }} so that it can

be erased

Change-Id: Ib62483bfbb08ebd6f3ed97d1b64645541ce19d35

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1549

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Ansible scripts for local cluster installation.

This change includes the following parts:

- Refactored aws scripts and share

the common part with non-aws cluster installation;

- Fixed aws_start.yml and aws_stop.yml to count

based on the user-provided tag.

Change-Id: I310f6f198c9ce41d7d7667dc4fbc21b3e34a77ab

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1525

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +31
    ./ansible/bin/deploy.sh
    • -0
    • +32
    ./ansible/bin/erase.sh
    • -0
    • +31
    ./ansible/bin/start.sh
    • -0
    • +32
    ./ansible/bin/stop.sh
    • -0
    • +24
    ./ansible/conf/cc.conf
    • -0
    • +45
    ./ansible/conf/instance_settings.yml
    • -0
    • +27
    ./ansible/conf/inventory
    • -0
    • +29
    ./ansible/yaml/deploy.yml
    • -0
    • +24
    ./ansible/yaml/deploy_all.yml
    • -0
    • +23
    ./ansible/yaml/erase.yml
    • -0
    • +24
    ./ansible/yaml/erase_all.yml
    • -0
    • +37
    ./ansible/yaml/gen_conf.yml
    • -0
    • +52
    ./ansible/yaml/instance_start.yml
    • -0
    • +46
    ./ansible/yaml/instance_stop.yml
  1. … 15 more files in changeset.
Various fixes for Windows NCService

- Fix RESOURCE_PATH

- Use windows platform in appassembler instead of booter-windows for client-helper

- Fix a few redirection bugs in sample start/stop batch files

Change-Id: If7af80292bddd5191d83bac18f0a518621d7db71

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1518

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Ian Maxon <imaxon@apache.org>

Tested-by: Ian Maxon <imaxon@apache.org>

    • -15
    • +1
    ./local/bin/start-sample-cluster.bat
    • -14
    • +3
    ./local/bin/stop-sample-cluster.bat
  1. … 3 more files in changeset.
Add cluster performance testing scripts.

- Wait SSH instead of sleep in the AWS installation script;

- Remove Java code and generate config files in Ansible;

- TPC-H is one benchmark, and more benchmarks could be added into the framework.

Change-Id: Ie17f20dc87694a865aebc561d8eded064c66f5bb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1504

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 83 more files in changeset.
Change "samples" to "opt" in the distribution package.

This change also does the following things:

- make AWS script more robust: (1) can be run from anywhere,

(2) eliminate the need of customize_deployment.yml.

- cleanup documentation to reflect the directory structure

change.

- fix Managix zip to be able to directories deeper than 2 levels.

Change-Id: Ie7876376d089b9ebebba3d37ac90ac346a741be3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1482

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Ian Maxon <imaxon@apache.org>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +48
    ./aws/ansible/aws_start.yml
    • -0
    • +35
    ./aws/ansible/aws_stop.yml
    • -0
    • +65
    ./aws/ansible/instance_start.yml
    • -0
    • +46
    ./aws/conf/aws_settings.yml
    • -0
    • +45
    ./aws/conf/instance_settings.yml
    • -0
    • +150
    ./local/bin/start-sample-cluster.bat
    • -0
    • +100
    ./local/bin/start-sample-cluster.sh
    • -0
    • +135
    ./local/bin/stop-sample-cluster.bat
    • -0
    • +93
    ./local/bin/stop-sample-cluster.sh
    • -0
    • +19
    ./local/conf/blue.conf
    • -0
    • +38
    ./local/conf/cc.conf
  1. … 19 more files in changeset.