Clone Tools
  • last updated 10 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE][OTH] Fix hyracks-api Dependences

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Ensure hyracks-api module depends only on hyracks-util. This way

new APIs can be added to hyracks-api and used on all other modules

without facing cyclic dependency issues.

Change-Id: I7f4329b3dad99c256fb2e10a7863aaca41990ce0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3047

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -1
    • +1
    ./control/cc/ClusterControllerService.java
  1. … 46 more files in changeset.
Merge commit '95f508bbb1d07650392c21da2958ba1c53f2a03d' from stabilization-f69489

Change-Id: Ib6a428564681938dceb6ad4a2ba91f15256dc8a2

    • -1
    • +1
    ./control/cc/ClusterControllerService.java
  1. … 1 more file in changeset.
[NO ISSUE][CLUS] Ensure Active Jobs Capacity is Released Only Once

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Ensure active jobs capacity is released only once.

- Warn if the cluster maximum capacity is exceeded.

Change-Id: Ia53c6918a68f7050bd8af482dbe8e161d1315844

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2938

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 1 more file in changeset.
[NO ISSUE] Allow override of dead node sweeper threshold

Change-Id: I3e534c277e52778ec4551247842acc51960a61b4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2922

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -1
    • +1
    ./control/cc/ClusterControllerService.java
  1. … 2 more files in changeset.
[NO ISSUE] Fix log directory initialization

Change-Id: I1f4e11e030a8ffa387e1fa234ed9ad9e3fe380c5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2906

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Contrib: Michael Blow <mblow@apache.org>

    • -1
    • +0
    ./control/cc/ClusterControllerService.java
  1. … 3 more files in changeset.
[NO ISSUE][OTH] Log directory tweak, minor perf tweaks

Change-Id: I174d4527fb2c00aed26d83a49c92872ad1ddee00

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2910

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -7
    • +8
    ./control/cc/CCLogConfigurationFactory.java
  1. … 3 more files in changeset.
[ASTERIXDB-2017][API] Access logs, log rotation

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Common Log Format (httpd) style logs for each servlet access.

- Log rotation by default in asterix-server package, rather than

console logging with no rotation

Change-Id: I9a8d76bec308b2fdb20c33370fc9e58a154ba968

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1915

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +89
    ./control/cc/CCLogConfigurationFactory.java
  1. … 18 more files in changeset.
[NO ISSUE][OTH] Remove Unused Imports

- user model changes: no

- storage format changes: no

- interface changes: no

Change-Id: Iafff39073d0fedaff74a26ef7e3260008a79ff0c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2893

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

    • -1
    • +0
    ./control/cc/work/GetIpAddressNodeNameMapWork.java
  1. … 67 more files in changeset.
[NO ISSUE][OTH] Cleanup Explicit Type Specification

- user model changes: no

- storage format changes: no

- interface changes: no

Change-Id: I781dfa768cfd4f820445f8d3f3748ced8bc6c591

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2886

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Contrib: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Murtadha Hubail <mhubail@apache.org>

Tested-by: Murtadha Hubail <mhubail@apache.org>

  1. … 3 more files in changeset.
[NO ISSUE][CLUS] ACK Heartbeats from NCs

On HB from NC, respond with an ACK. In the event a heartbeat is

rec'd from an unknown NC, attempt to respond with an exception to

give the chance for the NC to handle. On receipt of an exception

on ACK indicating the node is not known to the CC, force a reconnect.

Change-Id: I7be64fd8c550a697729c7fcf8783beae95043cd7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2881

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -1
    • +2
    ./control/cc/ClusterControllerIPCI.java
    • -5
    • +5
    ./control/cc/work/AbstractHeartbeatWork.java
    • -4
    • +0
    ./control/cc/work/ApplicationMessageWork.java
    • -4
    • +0
    ./control/cc/work/JobletCleanupNotificationWork.java
    • -3
    • +23
    ./control/cc/work/NodeHeartbeatWork.java
    • -4
    • +0
    ./control/cc/work/NotifyDeployBinaryWork.java
    • -12
    • +10
    ./control/cc/work/RegisterNodeWork.java
  1. … 14 more files in changeset.
[NO ISSUE][OTH] Log Level Fixes

- user model changes: no

- storage format changes: no

- interface changes: no

Change-Id: Icbf7a3ee1c358a40918be7badc4bd00ac5d492a4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2879

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -15
    • +12
    ./control/cc/result/ResultDirectoryService.java
  1. … 5 more files in changeset.
[NO ISSUE][FAIL] Use Formatted Exception For Node Not Live

- user model changes: no

- storage format changes: no

- interface changes: no

Change-Id: I06c42a8205c439fd2d320f053c79ed803aaa6b4a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2861

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -1
    • +1
    ./control/cc/executor/JobExecutor.java
[NO ISSUE] Don't log interrupts as WARNings

Change-Id: I0e847b8197fa12f1ce235dde404df24196939a83

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2855

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -7
    • +9
    ./control/cc/result/ResultDirectoryService.java
    • -1
    • +4
    ./control/cc/work/TaskFailureWork.java
  1. … 6 more files in changeset.
[NO ISSUE][OTH] Fix Job + Algebricks Logging Level

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Move job execution + Algebricks trace logs to trace

log level.

Change-Id: I3a94fb251523ff7056fa4ba7db503c8f49bfbfbb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2853

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -34
    • +34
    ./control/cc/executor/JobExecutor.java
  1. … 14 more files in changeset.
[ASTERIXDB-2435][*DB][CLUS] Block unknown nodes

Provide mechanism by which unauthorized nodes can be prevented from

joining hyracks cluster. In *DB, only authorize configured nodes to

join.

Change-Id: I3a45a41f69e8e9968dd65bb2268d3d3a2ced9664

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2851

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -1
    • +1
    ./control/cc/ClusterControllerService.java
    • -8
    • +12
    ./control/cc/cluster/NodeManager.java
  1. … 4 more files in changeset.
[NO ISSUE] Set JobId in thread name waiting for job completion

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- To allow correlation between running tasks and requests waiting

for job completion, we set the job id in the request thread and

we also add it to the name of the parallel threads in Super

Activity Operator Node Pushable.

Change-Id: I003432da0109c253e976f130e91f1f1f5ff628f3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2837

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +2
    ./control/cc/work/WaitForJobCompletionWork.java
  1. … 2 more files in changeset.
[NO ISSUE][OTH] Add CC/NC Ping Function

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Add ping function that can be used to ask a node

to ping the CC.

Change-Id: I676e523dccbf94d1e5af4ea408e026af260c9b06

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2831

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +4
    ./control/cc/ClusterControllerIPCI.java
  1. … 7 more files in changeset.
[NO ISSUE][CONF] Add Configuration For Max Http Request Size

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Add configuration for max http request size and default

it to 50 MB.

- Close client connection if request exceeds max size.

- Add test case for large request.

Change-Id: I11153490fc022d3a94b5b6f7dc3e20204fb105a0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2826

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 14 more files in changeset.
[ASTERIXDB-2314][HYR] Dataset in class names in Hyracks

- user model changes: no

- storage format changes: no

- interface changes: yes

Change-Id: I260add3a2dfb4a722440af5008a1a75f9446579e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2478

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -10
    • +10
    ./control/cc/ClientInterfaceIPCI.java
    • -10
    • +10
    ./control/cc/ClusterControllerService.java
    • -316
    • +0
    ./control/cc/dataset/DatasetDirectoryService.java
    • -50
    • +0
    ./control/cc/dataset/IDatasetDirectoryService.java
    • -0
    • +50
    ./control/cc/result/IResultDirectoryService.java
    • -0
    • +316
    ./control/cc/result/ResultDirectoryService.java
    • -45
    • +0
    ./control/cc/work/GetDatasetDirectoryServiceInfoWork.java
    • -0
    • +45
    ./control/cc/work/GetResultDirectoryAddressWork.java
    • -7
    • +7
    ./control/cc/work/GetResultPartitionLocationsWork.java
    • -3
    • +3
    ./control/cc/work/GetResultStatusWork.java
    • -2
    • +2
    ./control/cc/work/RegisterResultPartitionLocationWork.java
    • -2
    • +2
    ./control/cc/work/ReportResultPartitionWriteCompletionWork.java
    • -1
    • +1
    ./control/cc/work/TaskFailureWork.java
  1. … 107 more files in changeset.
[NO ISSUE][RT] Improve logging in task related works

Change-Id: Ia4e24a95aaac37b1d3d0d9a35266109ae0315293

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2803

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 5 more files in changeset.
[NO ISSUE][HYR] Ignore Job Notifications For Unknown Jobs

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Ignore notifications for unknown jobs.

Change-Id: I743b469f56f6126c2fdd4161fcaa48fc5f4d7218

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2793

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -0
    • +3
    ./control/cc/work/TaskCompleteWork.java
    • -0
    • +3
    ./control/cc/work/TaskFailureWork.java
[NO ISSUE] Use public address/port for client advertisement

Change-Id: Ia88912f144fa3b0e4b79341c245bd45ae0453f80

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2706

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -1
    • +1
    ./control/cc/ClusterControllerService.java
[NO ISSUE] Expose public address / ports for CC services

Change-Id: I61f8988b32f13a1eba029fa7120d6e753aacc151

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2704

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -2
    • +2
    ./control/cc/ClusterControllerService.java
  1. … 1 more file in changeset.
[ASTERIXDB-2397][*DB] Enable execution on Java 9/10

(cherry picked from commit 5c28118b5341306f4774d32937770f107f3a015b)

Change-Id: I221dfba1b2d15e33b312feb3fb50e70d536027fd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2700

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -7
    • +11
    ./control/cc/work/GetNodeDetailsJSONWork.java
  1. … 13 more files in changeset.
[ASTERIXDB-2397][*DB] Enable execution on Java 9/10

Change-Id: I720507856c235443d64b6024b75f931656badc6d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2686

Reviewed-by: Michael Blow <mblow@apache.org>

Contrib: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

    • -7
    • +11
    ./control/cc/work/GetNodeDetailsJSONWork.java
  1. … 13 more files in changeset.
[ASTERIXDB-2386][CLUS] Allow extension of the global recovery manager

Allow the Asterix GlobalRecoveryManager to be extended

Cleanup some deployed job spec methods

Change-Id: I1213e702a77ededde18ee0b50bc105212f43480d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2640

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

    • -3
    • +3
    ./control/cc/work/UndeployJobSpecWork.java
  1. … 11 more files in changeset.
[ASTERIXDB-2373][HYR,CLUS] Allow upsert of JobSpecs for Deployed Jobs

- user model changes: none

- storage format changes: none

- interface changes: new methods added

This change adds the upsertDeployedJobSpec method, enabling

a Deployed Job to update its Job Specification.

Added call in test.

Removed DeployedJobService (moved methods to BAD codebase).

Change-Id: I01fd5d43896d520fe75e1007d7bd39324f6f6e4b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2619

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Xikui Wang <xkkwww@gmail.com>

    • -3
    • +0
    ./control/cc/DeployedJobSpecStore.java
    • -3
    • +7
    ./control/cc/work/DeployJobSpecWork.java
  1. … 13 more files in changeset.
[NO ISSUE][HYR] Ensure IJobLifecycleListener is notified on cancelled queued jobs

Change-Id: I7e26c9d1015725f895876f5873eccd3f86b17653

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2624

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -41
    • +49
    ./control/cc/job/JobManager.java
  1. … 1 more file in changeset.
[NO ISSUE][NET] IPC Connections Improvements

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Refactor IPCConnectionManager.

- Halt on IPC message serialization failures.

- Ensure channels and handles are closed on connection

failures.

- Remove IPCHandle unneeded CONNECT_FAILED state.

- Fix RegisterNodeWork failure handling.

- Consistently use NodeControllerRemoteProxy for NC RPC.

Change-Id: I4049b16573c13fcdb1b12c0b6b2a97ee1fcc709e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2617

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -19
    • +13
    ./control/cc/work/RegisterNodeWork.java
  1. … 11 more files in changeset.
[NO ISSUE] Incremental cleanup of deprecated exception ctors

Change-Id: I1e7c3655828fc6530cef83ea502a6cfbf41acddf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2533

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -1
    • +1
    ./control/cc/ClusterControllerService.java
    • -1
    • +1
    ./control/cc/executor/JobExecutor.java
  1. … 238 more files in changeset.