Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE] Apply / enforce java import order

The process-sources target will now sort imports as well as

format source code; the source-format job will likewise verify

import order in addition to source code format

Change-Id: I55d976c4df10d9919c6a25683be2a3e3304e65d9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3288

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -2
    • +2
    ./RegistrationTasksResponseMessage.java
  1. … 624 more files in changeset.
[NO ISSUE][OTH] Remove Unused Imports

- user model changes: no

- storage format changes: no

- interface changes: no

Change-Id: Iafff39073d0fedaff74a26ef7e3260008a79ff0c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2893

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

  1. … 67 more files in changeset.
[NO ISSUE][OTH] Cleanup Redundant Type Cast

- user model changes: no

- storage format changes: no

- interface changes: no

Change-Id: I9c93ce90ad4aa789ae46284431e172ae4777bf55

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2887

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 30 more files in changeset.
[NO ISSUE][CLUS] Include NC Local Counters in Startup Message

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Include NC local counters in the NC startup tasks

completion completion message.

- Ensure no NC is marked as active without its local

counters reported.

- Remove the need for individual NC local counters

message.

- Clean up ITxnIdFactory and IResourceIdManager APIs.

Change-Id: Ief8b9d43783ea22810c6fdb29947a1284e32daee

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2767

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -1
    • +5
    ./RegistrationTasksResponseMessage.java
  1. … 16 more files in changeset.
[NO ISSUE] Refactor shutdown watchdog to ExitUtil

Change-Id: Id27635f90587c64ee29ab1a4ac2b1a6182042900

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2470

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -2
    • +1
    ./RegistrationTasksResponseMessage.java
  1. … 7 more files in changeset.
[ASTERIXDB-2204][STO] Fix implementations and usages of IIndexCursor

- user model changes: no

- storage format changes: no

- interface changes: yes

- IIndexCursor.close() is now idempotent and can be called on

a closed cursor.

- IIndexCursor.destroy() is now idempotent and can be called

on a destroyed cursor.

- Add IIndexAccessor.destroy() letting the accessor know it is

safe to destroy its reusable cursors and operation contexts.

- Add IIndexOperationContext.destroy() letting the context

know that the user is done with it and allow it to release

resources

details:

- Previously, implementations of the IIndexCursor interface

didn't enforce the interface contract. This change enforces

the contract for all the implementations.

- With the enforcement of the contract, all the users of the

cursors are expected to follow and enforce the expected lifecycle.

- Test cases were added.

Change-Id: I98a7a8b931eb24dbe11bf2bdc61b754ca28ebdf9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2324

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 132 more files in changeset.
[NO ISSUE] Metadata partition bootstrap, replication

- Send metadata partition id as part of metadata bootstrap

- Ignore requests to add replicas to myself

- Avoid hard checkpoint at shutdown

Change-Id: I08c91de570bbc90f5532329f72db21a424993fed

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2369

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Murtadha Hubail <mhubail@apache.org>

Tested-by: Murtadha Hubail <mhubail@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 9 more files in changeset.
[NO ISSUE] More multi-CC support, ConfigManager updates

- add ability for OptionTypes to natively parse JsonNodes

- allow all options to be overridden at the NC level, not just NC options (i.e. common, cc)

- accept controller id from the CC, avoid configuring this on NCs

- update all CCs with metadata bootstrap, not just the primary CC

- remove TxnIdFactory static singleton, management by metadata node

- remove unused build-properties style test configs

- cleanup test iodevices

Change-Id: Iff60887bf71ce3f3ed7201afd9499612bfc83485

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2344

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 67 more files in changeset.
[ASTERIXDB-2256] Reformat sources using code format template

Change-Id: I4faa141c1a8c9700d5e9ac50b839acc9d1eede73

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2310

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -2
    • +2
    ./RegistrationTasksRequestMessage.java
  1. … 984 more files in changeset.
[ASTERIXDB-2110] Introduce Cluster Controller Id

Change-Id: Iec1b01444bfbd923e38f5c162c5244e17c4d5f03

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2323

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -2
    • +3
    ./RegistrationTasksRequestMessage.java
    • -3
    • +5
    ./RegistrationTasksResponseMessage.java
  1. … 78 more files in changeset.
[ASTERIXDB-2228][CLUS] IFaultToleranceStrategy -> INcLifecycleCoordinator

- user model changes: no

- storage format changes: no

- interface changes: yes

- Rename IFaultToleranceStrategy -> INcLifecycleCoordinator

Details:

- Rename IFaultToleranceStrategy since it doesn't provide

fault tolerance anymore but rather coordinates node

lifecycle.

- Make INcLifecycleCoordinator extensible.

- Remove unneeded FaultToleranceStrategyFactory.

Change-Id: I51a2d6f5402630683f709806e6c01f0c7e83914f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2266

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -1
    • +1
    ./RegistrationTasksRequestMessage.java
  1. … 11 more files in changeset.
[ASTERIXDB-2195][REPL] Replace Static Replication

- user model changes: no

- storage format changes: no

- interface changes: yes

- Redesigned all replication interfaces

Details:

- Replace static replication and fault tolerance by

dynamic storage API.

- Remove static based fault tolerance strategies.

- Redesign replication APIs and classes to smaller

maintainable parts.

- Clean up replication properties.

- Unify logic for checkpoints when replication is

enabled.

- Remove static replication test cases.

- Add replication runtime test cases for:

- Bulkload component replication.

- Memory component recovery.

- Flushed component replication.

- Add replication integration test for:

- Resync failed replica.

Change-Id: Ic5c4b0ac199a4530c807e558c8aebb1eb1284048

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2252

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -94
    • +0
    ./CompleteFailbackRequestMessage.java
    • -61
    • +0
    ./CompleteFailbackResponseMessage.java
    • -122
    • +0
    ./PreparePartitionsFailbackRequestMessage.java
    • -58
    • +0
    ./PreparePartitionsFailbackResponseMessage.java
    • -63
    • +0
    ./ReplayPartitionLogsRequestMessage.java
    • -57
    • +0
    ./ReplayPartitionLogsResponseMessage.java
    • -108
    • +0
    ./TakeoverPartitionsRequestMessage.java
    • -66
    • +0
    ./TakeoverPartitionsResponseMessage.java
  1. … 245 more files in changeset.
[ASTERIXDB-1564][CONF] Consistently Use Log4j2

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Replace java.util.logging by Log4j2.

- Excluded classes due to their tests:

- IoUtil

- Tracer

Change-Id: Ic137571292f45de1f1994c61d328b97185012197

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2226

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -5
    • +6
    ./PreparePartitionsFailbackRequestMessage.java
    • -5
    • +5
    ./RegistrationTasksRequestMessage.java
    • -7
    • +8
    ./RegistrationTasksResponseMessage.java
    • -4
    • +5
    ./ReplayPartitionLogsRequestMessage.java
    • -5
    • +6
    ./TakeoverPartitionsRequestMessage.java
  1. … 384 more files in changeset.
[ASTERIXDB-2198][REPL] Introduce Dynamic Replica Placement

- user model changes: no

- storage format changes: no

- interface changes: yes

- Add IReplicationMessage and IReplicaTask.

- Add notifyMetadataNodeChange to IFaultToleranceStrategy.

- Add register to IReplicationManager to allow registering

replicas at runtime.

Details:

- Add cluster APIs for:

- changing partition master node.

- changing metadata node.

- Add NC storage management API for promoting a partition replica

to master replica.

- Implement changing metadata node at runtime in

MetadataNodeFaultToleranceStrategy.

- Allow MetadataNodeFaultToleranceStrategy to have zero replica

at initialization.

- Add a flag to LangExecutionUtil to skip storage distribution

check at the end of each test.

- Add test case for metadata node failover as follows:

1- start with nc1 as metadata node.

2- add replica for metadata partition on nc2 at runtime.

3- performs metadata transactions on nc1.

4- promote metadata partition on nc2.

5- failover metadata node to nc2.

6- ensure the effects of the metadata transactions on (2) exists.

7- performs more metadata transactions on nc2.

8- ensure the effects of the metadata transactions on (7) exists.

Change-Id: I11f82efcad29d2c37324fe9d3c11d872b0348f49

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2215

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +78
    ./MetadataNodeRequestMessage.java
    • -0
    • +60
    ./MetadataNodeResponseMessage.java
    • -69
    • +0
    ./TakeoverMetadataNodeRequestMessage.java
    • -54
    • +0
    ./TakeoverMetadataNodeResponseMessage.java
  1. … 58 more files in changeset.
[NO ISSUE][TX] Ensure TxnIdFactory Value is Initialized

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Report local max txn id after node registration.

- Add node status BOOTING.

- Distinguish between node first time registration and

registration after restarting by using NodeStatus

BOOTING to respond with the proper node post

registration tasks.

- Rename node status ALIVE -> ACTIVE.

- Rename StartupTask* to RegistrationTasks*

Change-Id: I6899c9e7d6e744ca92d0108556e086a23639d78b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2151

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +81
    ./RegistrationTasksRequestMessage.java
    • -0
    • +93
    ./RegistrationTasksResponseMessage.java
  1. … 18 more files in changeset.
[NO ISSUE][RT] Add more startup debug logs

- user model changes: no

- storage format changes: no

- interface changes: no

details:

- Add more logs during startup sequence.

Change-Id: I25e5c6423f3160c4becbfe682edccc49613e371c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2084

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 14 more files in changeset.
[NO ISSUE][HYR][*DB] Exit JVM from independent thread to avoid deadlocks

Change-Id: I21b2090ea3ef85e95ae90de04b08b4a6d22ebe42

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1973

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 8 more files in changeset.
[ASTERIXDB-2042][CLUS] Handle Reporting Startup Completion Failure

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- if the NC fails to report its startup completion message,

to the CC, shut it down so that it can be restarted again

when the CC is back up.

Change-Id: Ia69efb1538e57242a0a69ac1a0158a5be06ab866

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1945

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

[ASTERIXDB-2042][CLUS] Shutdown NC on Startup Completion Failure

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Report runtime exceptions of NC startup completion to CC.

- Shutdown NC after reporting startup completion failure.

Change-Id: I6c2ff0130e5e3e35ccf42a66d6855e568dce1fbe

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1943

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -14
    • +21
    ./StartupTaskResponseMessage.java
  1. … 1 more file in changeset.
[ASTERIXDB-1955][CLUS][RT] Refactor, Keep-Alive

- Add getFaultToleranceStrategy to ICcApplicationContext interface,

eliminate casts to implementation where interface suffices

- Minor refactoring in ResultUtil

- Don't close keep-alive connections in case of Unauthorized (401)

status

Change-Id: Id75dd55861976390b1098a496ff2c0345c991389

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1855

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 7 more files in changeset.
Remove static cc application context instance

Change-Id: Ia2e250405967ec880e7af6387aa981f39b3392c0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1606

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -7
    • +8
    ./CompleteFailbackResponseMessage.java
    • -6
    • +6
    ./PreparePartitionsFailbackRequestMessage.java
    • -7
    • +9
    ./PreparePartitionsFailbackResponseMessage.java
    • -6
    • +5
    ./ReplayPartitionLogsRequestMessage.java
    • -7
    • +8
    ./ReplayPartitionLogsResponseMessage.java
    • -6
    • +5
    ./TakeoverMetadataNodeRequestMessage.java
    • -5
    • +6
    ./TakeoverMetadataNodeResponseMessage.java
    • -6
    • +5
    ./TakeoverPartitionsRequestMessage.java
    • -5
    • +6
    ./TakeoverPartitionsResponseMessage.java
  1. … 169 more files in changeset.
Unify structure of Cluster Controller and Node Controller

Change-Id: Ife3a002371a07ee9cdd32e1ffd50cc775bf1d453

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1514

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -9
    • +6
    ./PreparePartitionsFailbackRequestMessage.java
    • -2
    • +2
    ./ReplayPartitionLogsRequestMessage.java
    • -7
    • +4
    ./TakeoverMetadataNodeRequestMessage.java
    • -4
    • +2
    ./TakeoverPartitionsRequestMessage.java
  1. … 154 more files in changeset.
Cleanup and bug fixes in Feeds pipeline

The bug fix is for the MessagingFrameTupleAppender. It used

to consume one extra byte per frame.

Cleanups are for feeds. These include:

1. Remove the use of feed dataflow marker. Feeds which

need to send progress can and should do that without

a marker thread.

2. Lock the memory component for feed commit to be able

to add information to the memory component's metadata

page safely.

In addition, this change introduces a frame level callback

for index operations.

Change-Id: Ie97b2133ebecb7380cf0ba336e60ed714d06f8ee

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1523

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -3
    • +2
    ./PreparePartitionsFailbackRequestMessage.java
    • -2
    • +1
    ./ReplayPartitionLogsRequestMessage.java
    • -3
    • +2
    ./TakeoverMetadataNodeRequestMessage.java
    • -3
    • +2
    ./TakeoverPartitionsRequestMessage.java
  1. … 66 more files in changeset.
Introduce Strategy Based Replication and Fault-Tolerance

This change includes the following:

- Introduce new APIs for Replication and Fault-Tolerance Strategies.

- Add configuration in cluster description file for high-availability.

- Add built-in replication strategies (Metadata_Only, Chained_Declustering)

- Add built-in fault-tolerance strategies (Auto, Metadata_Node)

- Remove none cluster state functionality from ClusterStateManager.

- Add customizable NC startup sequence

Change-Id: I1d1012f5541ce786f127866efefb9f3db434fedd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1405

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -0
    • +98
    ./CompleteFailbackRequestMessage.java
    • -0
    • +60
    ./CompleteFailbackResponseMessage.java
    • -0
    • +63
    ./NCLifecycleTaskReportMessage.java
    • -0
    • +125
    ./PreparePartitionsFailbackRequestMessage.java
    • -0
    • +56
    ./PreparePartitionsFailbackResponseMessage.java
    • -0
    • +64
    ./ReplayPartitionLogsRequestMessage.java
    • -0
    • +56
    ./ReplayPartitionLogsResponseMessage.java
    • -0
    • +72
    ./StartupTaskRequestMessage.java
    • -0
    • +77
    ./StartupTaskResponseMessage.java
    • -0
    • +74
    ./TakeoverMetadataNodeRequestMessage.java
    • -0
    • +53
    ./TakeoverMetadataNodeResponseMessage.java
    • -0
    • +111
    ./TakeoverPartitionsRequestMessage.java
    • -0
    • +65
    ./TakeoverPartitionsResponseMessage.java
  1. … 99 more files in changeset.