Clone Tools
  • last updated 29 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE] Fix logging for ncservice-based tests

Change-Id: Id264aede0f62558ad6e34355047c623a1d594692

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3311

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

  1. … 35 more files in changeset.
Merge commit '963a544' from 'stabilization-f69489' to 'master'

Change-Id: Iedb57cd217d3115b94d13761d8779e81293003da

  1. … 7 more files in changeset.
[NO ISSUE] Fix serialization of surrogate pairs on non-UTF8 platforms

Change-Id: I17228e7dfdcd220e1c0caf5fcc8207fb8f3a7733

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3300

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 2 more files in changeset.
[NO ISSUE] Fix logging in NCServiceExecutionIT

- remove GC options not supported by OpenJDK

- don't run HDFSCluster by default (not compatible w/ Java 11)

Change-Id: I17ca6ec4605f6d2ceb2c727e9479e56becc29670

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3156

Contrib: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 1 more file in changeset.
[NO ISSUE] Remove instance.name, storage.subdir config properties

Change-Id: Ic530559e96eb4c744499f46a5595e3a4c59f7683

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2585

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Murtadha Hubail <mhubail@apache.org>

Tested-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 14 more files in changeset.
[NO ISSUE][TEST] Retry on file copy, ignore failures after 3 retries

- for NCServiceExecutionIT based tests, print JVM final flags, help ensure

max gc wait time is being configured properly by NCService

Change-Id: I7127ee0dcba6ead1a19a373b62e4d6aa22467909

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2454

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 5 more files in changeset.
[ASTERIXDB-2172] Increase heartbeat max misses

Avoid GC causing intermittent false dead-node detection by increasing

heartbeat duration from 10 to 50s.

Change-Id: I3178e61b13185eea0d74187e882ad1d207702f74

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2318

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 9 more files in changeset.
[ASTERIXDB-2172] collect GC logs to assist in diagnosis

Change-Id: I6841da6ffb756843ba4265c64aa42faff3acfc09

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2297

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

  1. … 1 more file in changeset.
[NO ISSUE] Fix duplicate -Xmx args being passed

The -Xmx override was looking for " -Xmx" instead of "-Xmx".

Added a test to stop regression.

Change-Id: I7e59be72fcc9aea3c315c2cee5339c1c7573ef51

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2206

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

  1. … 4 more files in changeset.
[NO ISSUE][API] Add NC Storage API

- user model changes: no

- storage format changes: no

- interface changes: yes

Add IStorageSubsystem to track storage partitions

replicas.

Details:

- Add NC API port.

- Add storage API to NCs.

- Add StorageSubsystem to track storage partitions

replicas.

Change-Id: I120d9892bc9fe5a73395cd5a2ddc30b51b73ced2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2190

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 25 more files in changeset.
Re-register NC with CC on reestablished IPCHandle

In case of failed NC -> CC IPCHandle due to CC crash/restart, the NC

needs to re-register with the CC in order to rejoin the cluster, as the

CC ignore heartbeats from unregistered nodes.

- Improve toString on IPCHandle

- Add tests for killing & restarting CC / NCs to NCServiceExecutionIT

- Retrigger NCService on detected dead node

- Ensure jobIds are not reused on CC restart

- NCService shouldn't truncate NC log

Change-Id: I6f93ca9ab37e56e02bafcdecd1e2d0cf664faef6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1830

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 23 more files in changeset.
Unify structure of Cluster Controller and Node Controller

Change-Id: Ife3a002371a07ee9cdd32e1ffd50cc775bf1d453

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1514

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 160 more files in changeset.
Configuration Revamp

- Ini section of node / cc details now returns ini param names instead of

managix option names

- Normalized command line -vs- ini file configuration parameter names

- Eliminated unused parameters

- Ini validation

- Migrate *DB parameters out of [app] and into nc / cc sections as

appropriate

- Eliminate [app] section. Cluster-wide configuration lives in [common]

- Sort properties alphabetically when returned by HTTP api

Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1487

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

  1. … 174 more files in changeset.
Fix Issues in 0.9.0 RC1 Release Assemblies

- Unable to build *DB from source assembly due to:

o Git plugin requiring build from within Git clone

o License automation templates referenced hyracks sources (expected

co-location)

- Missing APLv2 license text from head of binary assembly LICENSE files

- Added license text to head of NCService conf files

- Exclude useless DEPENDENCIES from asterixdb source assembly

Change-Id: I1821416abb0387ee05b9add9f9c15798deed25e1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1452

Reviewed-by: Till Westmann <tillw@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 23 more files in changeset.
[asterix] -> [app] for NCService configs

Change-Id: Ie7bcc249b117bffb5671d087cd1760ef6a85110a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1246

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 2 more files in changeset.
ASTERIXDB-1482: Added NCServiceExecutionIT, HyracksVirtualCluster.

NCServiceExecutionIT runs all execution tests against a local cluster

managed by the NCService deployment framework.

HyracksVirtualCluster offers programmatic NCService deployment

control along with improved HyracksNCProcess/HyracksCCProcess.

Further fixes and improvements:

1. Fix handling of iodevices/storagedir (ASTERIXDB-1482)

2. Proper handling of [nc] default section in all cases

3. Ensure asterixnc, etc. scripts are executable

4. Consolidate Ini handling

5. Pruned some dead code, including VirtualClusterDriver

6. A bit of refactoring and extended commenting

Change-Id: If3eb450782a595cf85d04a2c2e9cc732564e65e6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/958

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 21 more files in changeset.