Clone Tools
  • last updated 22 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE] Expose public address / ports for CC services

Change-Id: I61f8988b32f13a1eba029fa7120d6e753aacc151

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2704

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 1 more file in changeset.
[ASTERIXDB-2397][*DB] Enable execution on Java 9/10

(cherry picked from commit 5c28118b5341306f4774d32937770f107f3a015b)

Change-Id: I221dfba1b2d15e33b312feb3fb50e70d536027fd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2700

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -7
    • +11
    ./cc/work/GetNodeDetailsJSONWork.java
  1. … 13 more files in changeset.
[ASTERIXDB-2397][*DB] Enable execution on Java 9/10

Change-Id: I720507856c235443d64b6024b75f931656badc6d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2686

Reviewed-by: Michael Blow <mblow@apache.org>

Contrib: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

    • -7
    • +11
    ./cc/work/GetNodeDetailsJSONWork.java
  1. … 13 more files in changeset.
[ASTERIXDB-2386][CLUS] Allow extension of the global recovery manager

Allow the Asterix GlobalRecoveryManager to be extended

Cleanup some deployed job spec methods

Change-Id: I1213e702a77ededde18ee0b50bc105212f43480d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2640

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

  1. … 11 more files in changeset.
[ASTERIXDB-2373][HYR,CLUS] Allow upsert of JobSpecs for Deployed Jobs

- user model changes: none

- storage format changes: none

- interface changes: new methods added

This change adds the upsertDeployedJobSpec method, enabling

a Deployed Job to update its Job Specification.

Added call in test.

Removed DeployedJobService (moved methods to BAD codebase).

Change-Id: I01fd5d43896d520fe75e1007d7bd39324f6f6e4b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2619

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Xikui Wang <xkkwww@gmail.com>

  1. … 13 more files in changeset.
[NO ISSUE][HYR] Ensure IJobLifecycleListener is notified on cancelled queued jobs

Change-Id: I7e26c9d1015725f895876f5873eccd3f86b17653

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2624

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 1 more file in changeset.
[NO ISSUE][NET] IPC Connections Improvements

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Refactor IPCConnectionManager.

- Halt on IPC message serialization failures.

- Ensure channels and handles are closed on connection

failures.

- Remove IPCHandle unneeded CONNECT_FAILED state.

- Fix RegisterNodeWork failure handling.

- Consistently use NodeControllerRemoteProxy for NC RPC.

Change-Id: I4049b16573c13fcdb1b12c0b6b2a97ee1fcc709e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2617

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 11 more files in changeset.
[NO ISSUE] Incremental cleanup of deprecated exception ctors

Change-Id: I1e7c3655828fc6530cef83ea502a6cfbf41acddf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2533

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 238 more files in changeset.
[NO ISSUE][RT] Add job start timestamp to the joblet context

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- add job start timestamp to the joblet context

- make CommonFunctionMapUtil extensible by products

- enhance DateTimeFormatUtils.parseDateTime() to return

timezone information and not throw exception on invalid data

- add GregorianCalendarSystem.getDayOfYear(), getWeekOfYear()

- change sleep() to sleep first then evaluate the argument

- skip fractional trailing 0s when printing nano-duration

- fix documentation about using column aliases in GroupBy

Change-Id: I190663ec5e709584ef449f8279b1d2a5a0b099dd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2511

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 26 more files in changeset.
[NO ISSUE][RT] Ensure all NC tasks are aborted before joining

- user model changes: no

- storage format changes: no

- interface changes: yes

- Add getApplication() to NodeControllerService

details:

- This change ensures that all previous tasks

of a CC on an NC are completed before completion of

registration.

Change-Id: I0517e5a390d50e8703ffdbecbb84467c22edda85

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2507

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 7 more files in changeset.
[ASTERIXDB-2320][CLUS] Don't delay removing dead node on max heartbeat misses

Once heartbeat miss threshold miss has occurred, we attempt to contact the failed nc

to confirm it is down, and if not, force him to fail and reconnect. This contact

attempt can take some time, ensure we do not delay marking the node as dead due to

this.

Change-Id: I89c0241fbc88fb6c4150201e4bcba07a3548d3f5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2475

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 1 more file in changeset.
[NO ISSUE] Refactor shutdown watchdog to ExitUtil

Change-Id: Id27635f90587c64ee29ab1a4ac2b1a6182042900

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2470

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 7 more files in changeset.
[NO ISSUE][HYR] Add 'getTimer' to IControllerService

Change-Id: I9b33cfbc345d15d95a99ea2c993ad173816bada8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2469

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 2 more files in changeset.
[ASTERIXDB-2229][OTR] Restore Thread Names in Thread Pool

- user model changes: no

- storage format changes: no

- interface changes: no

- Restore thread names to their original names

before returning them to the pool of the NC

app.

- Remove explicit thread name resets.

- Delete unused ThreadExecutor class.

Change-Id: I3bda1b65e7aefd35d2b8cfa814f73369c3bf5a18

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2447

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 9 more files in changeset.
[NO ISSUE] Decouple heartbeat data calculation from transmission

- also, generate native JSON objects instead of POJOs for node config & stats

- fix illegal regex on Windows for node config

Change-Id: Iccb02350b56328ba1adbca97a1cb5efeb9d9ad14

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2439

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 17 more files in changeset.
[NO ISSUE] Set MaxGCPauseMillis to not exceed 1/2 of dead node detection threshold

Help prevent nodes under heavy gc from missing too many heartbeats

Change-Id: I7e51db5ccfbb4771ba1f6e0264abfd69f833e7e7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2426

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[NO ISSUE] Make NodeManager.remove() idempotent

Change-Id: I0e2b14526be49c9817c0d64836fcf57647ac59b2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2414

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 1 more file in changeset.
[NO ISSUE] Add support for NodeGroup upsert, etc.

Also, enable resource id generation when only pending removal nodes are absent

from the cluster

Change-Id: I15cfb74bc345680102cedafa99f7ff4f144860bc

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2389

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Murtadha Hubail <mhubail@apache.org>

Tested-by: Murtadha Hubail <mhubail@apache.org>

  1. … 12 more files in changeset.
[ASTERIXDB-2284][CLUS] Ensure Node Failure on Heartbeat Miss

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Request the node which exceeded its heartbeat misses

to shutdown to ensure its failures.

- Ensure thread safety of lastHeartbeatNanoTime in

NodeControllerState.

Change-Id: I121f85fd858484377a9d888d18c3069c239f00fc

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2390

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[ASTERIXDB-2204][STO] Fix implementations and usages of IIndexCursor

- user model changes: no

- storage format changes: no

- interface changes: yes

- IIndexCursor.close() is now idempotent and can be called on

a closed cursor.

- IIndexCursor.destroy() is now idempotent and can be called

on a destroyed cursor.

- Add IIndexAccessor.destroy() letting the accessor know it is

safe to destroy its reusable cursors and operation contexts.

- Add IIndexOperationContext.destroy() letting the context

know that the user is done with it and allow it to release

resources

details:

- Previously, implementations of the IIndexCursor interface

didn't enforce the interface contract. This change enforces

the contract for all the implementations.

- With the enforcement of the contract, all the users of the

cursors are expected to follow and enforce the expected lifecycle.

- Test cases were added.

Change-Id: I98a7a8b931eb24dbe11bf2bdc61b754ca28ebdf9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2324

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 132 more files in changeset.
[NO ISSUE] More multi-CC support, ConfigManager updates

- add ability for OptionTypes to natively parse JsonNodes

- allow all options to be overridden at the NC level, not just NC options (i.e. common, cc)

- accept controller id from the CC, avoid configuring this on NCs

- update all CCs with metadata bootstrap, not just the primary CC

- remove TxnIdFactory static singleton, management by metadata node

- remove unused build-properties style test configs

- cleanup test iodevices

Change-Id: Iff60887bf71ce3f3ed7201afd9499612bfc83485

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2344

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -4
    • +0
    ./cc/application/CCServiceContext.java
  1. … 65 more files in changeset.
[ASTERIXDB-1554][CONF] Do Not Override Logger Config

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Do not override logger config for hyracks/asterix

roots if they are already configured.

Change-Id: Iff7ed7c094d9044f5959f9e24713302af9774786

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2335

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 8 more files in changeset.
[ASTERIXDB-2256] Reformat sources using code format template

Change-Id: I4faa141c1a8c9700d5e9ac50b839acc9d1eede73

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2310

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -12
    • +12
    ./cc/ClusterControllerService.java
    • -19
    • +17
    ./cc/executor/ActivityClusterPlanner.java
    • -1
    • +2
    ./cc/partitions/PartitionMatchMaker.java
    • -1
    • +2
    ./cc/web/util/JSONOutputRequestUtil.java
    • -2
    • +2
    ./cc/work/AbstractTaskLifecycleWork.java
    • -1
    • +1
    ./cc/work/GetJobSummariesJSONWork.java
  1. … 970 more files in changeset.
[ASTERIXDB-2110] Introduce Cluster Controller Id

Change-Id: Iec1b01444bfbd923e38f5c162c5244e17c4d5f03

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2323

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -34
    • +25
    ./cc/ClusterControllerService.java
    • -5
    • +3
    ./cc/work/WaitForJobCompletionWork.java
  1. … 77 more files in changeset.
[ASTERIXDB-2268][CONF] Add Cores Multiplier

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Add configurable cores multiplier to CC

config and default it to 3. The multiplier

will be used to adjust nodes cores capacity.

- Add test case for adjusted node capacity.

Change-Id: I95dd6e0c1add92e70e667321e8ef5f9b9887cda5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2326

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 2 more files in changeset.
[ASTERIXDB-1706][RT] Use System.nanoTime For Result Timestamp

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Use System.nanoTime for result timestamp to

avoid results being incorrectly swept due to

System.currentTimeMillis system time adjustments.

- Move sweep logic to AbstractDatasetManager.

Change-Id: I388d2a477bcfdc47d11dc6a4873483b82c9fadbf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2315

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -12
    • +6
    ./cc/dataset/DatasetDirectoryService.java
  1. … 6 more files in changeset.
[NO ISSUE] Refactor IPC reconnect logic to be usable by all IPC connections

Change-Id: I2430510b22f936b89879df98322ef51ec87c6da6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2284

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 13 more files in changeset.
[NO ISSUE][RT] Remove Invalid Clear Queued Jobs API

- user model changes: no

- storage format changes: no

- interface changes: yes

- Remove clearJobQueue from IJobManager.

Details:

- The current clearJobQueue API in IJobManager

does not follow the typical job lifecycle.

i.e. job lifecycle listener are not notified

that the jobs were canceled. Since the API

is not used, this change removes it to avoid

any future invalid usage.

Change-Id: I1bff81fe9378f9bbc9dfb04a6a9826ee052f0965

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2237

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[ASTERIXDB-1564][CONF] Consistently Use Log4j2

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Replace java.util.logging by Log4j2.

- Excluded classes due to their tests:

- IoUtil

- Tracer

Change-Id: Ic137571292f45de1f1994c61d328b97185012197

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2226

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -4
    • +5
    ./cc/dataset/DatasetDirectoryService.java
    • -4
    • +4
    ./cc/executor/ActivityClusterPlanner.java
    • -2
    • +3
    ./cc/partitions/PartitionMatchMaker.java
    • -4
    • +5
    ./cc/web/ApplicationInstallationHandler.java
    • -5
    • +6
    ./cc/web/util/JSONOutputRequestHandler.java
  1. … 376 more files in changeset.
[ASTERIXDB-1723] Delete managix

- user model changes: yes

- storage format changes: no

- interface changes: yes

Details:

- Delete managix installer method and all dependencies

- Remove xml-based configuration

Change-Id: I5c710b6ec870bedd49dd46b74ed96a3665670e9b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2155

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -12
    • +16
    ./cc/ClusterControllerService.java
    • -0
    • +54
    ./cc/web/StartNodeApiServlet.java
  1. … 1375 more files in changeset.