Clone Tools
  • last updated 28 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE][OTH] Make Persisted Classes List Non-Static

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Make the registered classes list in PersistedResourceRegistry

non-static to prevent concurrent modification in environments

where multiple NCs share the same JVM.

- Use the proper NCApplication life cycle to configure the test

PersistedResourceRegistry rather than setting it after the

NCApplication is initialized.

Change-Id: Id89db7e89c90388ac7e5a1cee87be84e2f7d3c17

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3497

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

    • -18
    • +13
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 1 more file in changeset.
[ASTERIXDB-2597] Load UDFs via HTTP

- POST existing UDF format to /admin/udf/$DATAVERSE/$LIBNAME

- DELETE against that URL to remove UDFs

Change-Id: I6be9fef54c010bdb32f5c78af9b973f9843f442f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3386

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

    • -2
    • +1
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 37 more files in changeset.
[NO ISSUE] Increase Result Set TTL to 30 mins

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Some tests (like TPC-DS) take a long time to complete,

this would result in a timeout of the result set and failing

the test. This change increase the TTL for the result set.

Change-Id: I352924a865a2bd93f7254afaa0855e2caa715e39

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3447

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Hussain Towaileb <hussainht@gmail.com>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -1
    • +1
    ./common/AsterixHyracksIntegrationUtil.java
[NO ISSUE] Fix logging for ncservice-based tests

Change-Id: Id264aede0f62558ad6e34355047c623a1d594692

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3311

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

    • -14
    • +4
    ./http/servlet/VersionApiServletTest.java
  1. … 35 more files in changeset.
[NO ISSUE][FUN] Add Completed_Requests Function

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Add completed_requests to get recently completed

requests.

- Use enum for requests state.

- Add new config to specify the requests archive

size.

- Add test case for completed_requests function.

Change-Id: I3f47d523c683c3879ec52ce5bdaf16ce338e8e46

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3301

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 23 more files in changeset.
[NO ISSUE] Apply / enforce java import order

The process-sources target will now sort imports as well as

format source code; the source-format job will likewise verify

import order in addition to source code format

Change-Id: I55d976c4df10d9919c6a25683be2a3e3304e65d9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3288

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 625 more files in changeset.
Merge commit '5543132' from 'stabilization-f69489' into 'master'

Change-Id: Ic0e77df94ecea518e19b55edb90a2fe8157cac21

    • -0
    • +12
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 12 more files in changeset.
[NO ISSUE][OTH] Add API To Ensure Request Requirements

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Refactor IRequestParameters as ICommonRequestParameters

and IRequestParameters to break cyclic dependencies.

- Add new API to ensure request can be scheduled for execution.

Change-Id: Ifb0513e0baf2b473006d4aa23040c86751fbb4fc

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3181

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Murtadha Hubail <mhubail@apache.org>

Tested-by: Murtadha Hubail <mhubail@apache.org>

  1. … 8 more files in changeset.
[ASTERIXDB-2518][RT] Introduce Request Tracker

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Introduce IReceptionist to generate request references.

- Track all requests by uuid.

- Add more information to active_requests response.

- Replace StatementExecutorContext by RequestTracker.

- Deprecate StatementExecutorContext (to be removed)

- Allow extensions to set optional parameters in query service.

- Return forbidden when a cancellation is attempt on a request

that is not cancellable.

Change-Id: If08ecd91c55881743b2ecf40a628fa3d4166c554

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3163

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -8
    • +16
    ./http/servlet/QueryCancellationServletTest.java
  1. … 40 more files in changeset.
[NO ISSUE] Fix log directory initialization

Change-Id: I357805659be133929ab1beea33bc0dcdf4dc896c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3154

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -0
    • +1
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 4 more files in changeset.
[NO ISSUE][OTH] No SSL in AsterixHyracksIntegrationUtil

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Revert AsterixHyracksIntegrationUtil back to no SSL connections.

SslAsterixHyracksIntegrationUtil can be used for SSL connections.

Change-Id: Idbc1214aeac89c08bef4cb762e11e92549b0a25a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3094

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -1
    • +1
    ./common/AsterixHyracksIntegrationUtil.java
[ASTERIXDB-2490][NET] Support Encrypted IPC Connections

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Add CC/NC options to support SSL connections.

- Add APIS to support secured connections.

- Support encrypted connections for CC/NC IPCs.

- Add keys/certificates for testing.

- Add SqlppExecutionTest with SSL connections enabled.

- Sort imports.

Change-Id: I7007a9be25287a94c5936d440355cfedb8e032b9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3052

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -6
    • +13
    ./common/AsterixHyracksIntegrationUtil.java
    • -0
    • +38
    ./common/SslAsterixHyracksIntegrationUtil.java
  1. … 53 more files in changeset.
[NO ISSUE][OTH] Fix hyracks-api Dependences

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Ensure hyracks-api module depends only on hyracks-util. This way

new APIs can be added to hyracks-api and used on all other modules

without facing cyclic dependency issues.

Change-Id: I7f4329b3dad99c256fb2e10a7863aaca41990ce0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3047

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -1
    • +1
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 47 more files in changeset.
[NO ISSUE] Fix log directory initialization

Change-Id: I1f4e11e030a8ffa387e1fa234ed9ad9e3fe380c5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2906

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Contrib: Michael Blow <mblow@apache.org>

    • -0
    • +1
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 4 more files in changeset.
[NO ISSUE][MISC] Introduce IClientRequest

- user model changes: no

- storage format changes: no

- interface changes: yes

+ IClientRequest: used to represent a client request

that can be cancelled.

Details:

- Introduce IClientRequest to allow for multiple types of requests

to be cancellable.

Change-Id: I8f65da1744ea7ecf26ea3f8a576ebaf4472ccd62

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2774

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 15 more files in changeset.
[ASTERIXDB-1130][STO]: JSON serialization for persisted objects

- user model changes: no

- storage format changes:

This change replaces the use of Java serialization for persisted objects

such as dataset/index metadata, checkpoints, ect...

This will break backward compatibly with any existing AsterixDB instance.

However, the change is needed to enable future backward compatibility support

for persisted objects.

- interface changes:

IJsonSerializable: contains API to serialize a class as a JsonNode.

IPersistedResourceRegistry: contains a mapping between an IJsonSerializable

class and a unique type id. An IPersistedResourceRegistry is responsible

for generating the class identifier in the JSON output.

The class identifier will always contain the following attributes:

@type: a unique type id that identifies the object type.

@version: the version of the serialized class.

@class: the serialized class full name.

Any registered class with PersistedResourceRegistry must provide

a static fromJson(IPersistedResourceRegistry, JsonNode) method for

deserialization. This is ensured during the class registration process.

Change-Id: I5b103e06eab6627dbfe9d531caae1a3ac4b296da

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2752

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Murtadha Hubail <mhubail@apache.org>

Tested-by: Murtadha Hubail <mhubail@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -0
    • +24
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 128 more files in changeset.
[NO ISSUE][STO] Misc Storage Fixes and Improvements

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- This change introduces some improvements to storage

operations.

- Local RecoveryManager is now extensible.

- Bulk loaders now call the IO callback similar to

Flushes, making them less special and creating a

unified lifecycle for adding an index component.

- As a result, The IndexCheckpointManager doesn't need

to have a special treatment for components loaded

through the bulk load operation.

- Component Id have been added to the index checkpoint

files.

- Cleanup for the code of local recovery for failed flush

operations.

- Ensure that after local recovery of flushes, primary

and secondary indexes have the same index for mutable

memory component.

- The use of WAIT logs to ensure in-flight flushes

are scheduled didn't work as expected. A new log type

WAIT_FOR_FLUSHES was introduced to acheive the expected

behavior.

- The local test framework was made Extensible to support

more use cases.

- Test cases were added for component ids in checkpoint files.

The following scenarios were covered:

- Primary and secondary both have values when a flush is

shceduled.

- Primary have values but not secondary when a flush is

scheduled.

- Primary is empty and an index is created through bulk

load.

- Primary has a single component and secondary is created

through bulk load.

- Primary has multiple components and secondary is created

through bulk load.

- Each primary opTracker now keeps a list of ongoing flushes.

- FlushDataset now waits only for flushes only and

not all io operations.

- Previously, we had many flushes scheduled on open datasets.

This was not detected but after this change, a failure

is thrown in such cases.

- Flush operations dont need to extend the comparable

interface anymore since they are FIFO per index.

Change-Id: If24c9baaac2b79e7d1acf47fa2601767388ce988

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2632

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -3
    • +7
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 89 more files in changeset.
[ASTERIXDB-232]6[TEST] Increase Result TTL to 5 Mins

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Increase result TTL to 5 mins in AsterixHyracksIntegrationUtil

to avoid intermittent test failures due to long GC pauses in

long running queries.

Change-Id: I6ecf0e4ac3578027ed12ac9d34d8b2b8f04b348b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2526

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

    • -2
    • +4
    ./common/AsterixHyracksIntegrationUtil.java
[ASTERIXDB-2304] Ensure Flush is Finished in FlushRecoveryTest

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Previous in LSMFlushRecoveryTest, it's possible during recovery

we check component ids before the flush is finished (since flush is

asynchronous), and thus causes intermittent failures. This patch fixes

this problem by waiting for active IOs before checking component ids.

- Fix the problem the override config options in TestNodeController not

working.

- Also fix [ASTERIXDB-2309] to ensure only indexes of a given partition

are flushed upon seeing a FLUSH record.

Change-Id: I1704c6606c7c7bef226ae31961c347c6ebb76c2a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2437

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -1
    • +6
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 4 more files in changeset.
[NO ISSUE] Trace AsterixHyracksIntegrationUtil to console; fix NC effective map precedence

Change-Id: Ied091c2ab17f631df84eab40143180b3a9be09ed

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2363

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -3
    • +6
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 2 more files in changeset.
[ASTERIXDB-2256] Reformat sources using code format template

Change-Id: I4faa141c1a8c9700d5e9ac50b839acc9d1eede73

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2310

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -4
    • +4
    ./common/AsterixHyracksIntegrationUtil.java
    • -1
    • +0
    ./http/servlet/VersionApiServletTest.java
  1. … 980 more files in changeset.
[ASTERIXDB-2269][RT] Use Job Locations To Estimate Resources

- user model changes: no

- storage format changes: no

- interface changes: yes

- INodeJobTracker (+) getJobParticipatingNodes

Details:

- Use job locations to calculate the job's required

resources rather than all cluster locations.

- Add test case.

Change-Id: Iecd8e234aa52a9f324e64044e01477fb12dc14e6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2330

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 4 more files in changeset.
[NO ISSUE] Move AsterixHyracksIntegrationUtil from production to test

Change-Id: Id603d0f1ac17b977356e628a89845d240c8aa8b7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2311

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +390
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 2 more files in changeset.
[NO ISSUE][STO] Adapt Storage Structure To Rebalance

- user model changes: no

- storage format changes: no

- interface changes: yes

-- Added IResource#setPath to use for the resource

storage migration.

Details:

- Unify storage structure to support dataset rebalance:

Old format:

./storage/partition_#/dataverse/datasetName_idx_indexName

New format:

./storage/partition_#/dataverse/datasetName/rebalanaceNum/indexName

- Adapt recovery and replication to new storage structure.

- Add old structure -> new structure NC migration task.

- Add CompatibilityUtil to ensure NC can be upgraded during

NC startup.

- Centralize the logic for parsing file path to its components in

ResourceReference/DatasetResourceReference.

- Add storage structure migration test case.

- Add test case for recovery after rebalance.

Change-Id: I0f968b9f493bf5aa2d49f503afe21f0d438bb7f0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2181

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 40 more files in changeset.
[ASTERIXDB-2171][STO] Remove Temporary Datasets

- user model changes: no

- storage format changes: no

- interface changes: yes

- Removed all reference to temporary datasets.

Details:

- Remove temporary datasets grammar but reserve

<TEMPORARY> token.

- Remove special callbacks for temp datasets.

- Remove metadata garbage collector thread.

- Remove isTemp flag from datasets.

- Remove special storage path for temp datasets.

- Remove temp datasets test cases.

Change-Id: Ib50ea27e2ec9c114508cd4a109cf646e2f20dcb0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2172

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 369 more files in changeset.
[ASTERIXDB-2058][HYR] Only Complete job cancellation after cleanup

- user model changes: no

- storage format changes: no

- interface changes: yes

--IJobManager.cancel now takes a callback

details:

- Job cancellation now completes only after the job cleanup work

has completed and not merely when the abort tasks are executed.

- The NCQueryServiceServlet actively cancels requests that passes

5 minutes.

- Cancellation of timedout jobs is not done through the Http API

but through message broker.

- Typically, requests might timeout when the servers are

overloaded. When that is the case, there is a high chance http

requests are to be rejected including requests to cancel

previously submitted queries. This is the reason for using

Message broker for this task.

- ExecuteStatementRequest used to execute the statement in

a different executor thread even though it is itself is being

executed in an executor thread and is not blocking anyone.

This was fixed as well.

Change-Id: I14b4bbd512cc88e489254d8bf82edba0fd3a3db5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1961

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -2
    • +2
    ./http/servlet/VersionApiServletTest.java
  1. … 37 more files in changeset.
[ASTERIXDB-1992][ING] Suspend/Resume active entities

- user model changes: wait for completion only returns

when the entity becomes inactive.

- storage format changes: no

- interface changes:

01) Introduce:

IMetadataLockManager for entity locking.

IActiveNotificationHandler for handling active events.

IRetryPolicy for recovery of failed active jobs.

IActiveEntityController for controlling active entities.

02) IJobLifecycleListener.notifyJobFinish now passes the

JobStatus and Exceptions.

03) IActiveEntityEventsListener.isActive() returns true,

if entity is active, false otherwise.

04) IActiveEntityEventsListener.unregister() removes the

listener upon entity deletion.

05) IActiveEntityEventsListener.getJobFailure() returns

the job failure if the entity is in a failed state.

06) IStatementExecutor.getComponentProvider() returns

the storage component provider.

07) IStatementExecutor.getApplicationContext() returns

the application context.

08) IMetadataManager.upsertEntity to perfrom metadata

entities' upsert operations.

09) IMetadataNode.upsertEntity to perfrom metadata

entities' upsert operations

10) ICcApplicationContext.getMetadataLockManager() returns

the lock manger.

11) ICcApplicationContext.getClusterStateManager() returns

the cluster state manager.

details:

- Starting and stopping of active entities now go through

their listeners rather than having the listener indicating

active entity and not having it indicating inactive entity.

This facilitates suspend/resume operations of long running

active jobs for the sake of DDL operations or topology

changes.

- Unit tests for the vast majority of code paths and

different possible scenarios have been added.

Change-Id: Ifeac8c73e6bad39a13663b84a52121356e3c6b40

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1875

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 140 more files in changeset.
Extensible exception handling in QueryServiceServlet

Change-Id: If8037a97f3d0b0febb8caf68e099f1fd24e0ac49

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1836

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

  1. … 11 more files in changeset.
Make Default Dir a Command Line Option

- Avoid using static field to hold default directory, in favor of

an option.

- Improve output on failed regexadm match (indicate where actual

and expected diverge)

Change-Id: I7855c8f344eea9c9b6a394d85413a062a3ddb609

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1751

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

    • -5
    • +14
    ./http/servlet/VersionApiServletTest.java
  1. … 15 more files in changeset.
Remove static cc application context instance

Change-Id: Ia2e250405967ec880e7af6387aa981f39b3392c0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1606

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -2
    • +2
    ./http/servlet/VersionApiServletTest.java
  1. … 180 more files in changeset.