Clone Tools
  • last updated 22 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Move AsterixDB to Subfolder

    • -52
    • +0
    ./bootstrap/AsterixStateDumpHandler.java
    • -225
    • +0
    ./bootstrap/CCApplicationEntryPoint.java
    • -212
    • +0
    ./bootstrap/ClusterLifecycleListener.java
    • -106
    • +0
    ./bootstrap/ClusterWorkExecutor.java
    • -225
    • +0
    ./bootstrap/GlobalRecoveryManager.java
    • -328
    • +0
    ./bootstrap/NCApplicationEntryPoint.java
  1. … 44152 more files in changeset.
Allow Replication to be Enabled on Virtual Cluster

- Allow replication port assignment per NC.

- Allow replication to be enabled on virtual cluster.

- Wait for JOB_ABORT ACK from remote replicas.

- Fix LSM component mask file name.

- Fix index directory deletion on index drop.

- Eliminate multiple partition takeover requests.

- Free LogFlusher thread from sending replication ACKs.

- Fix possible deadlock between LogFlusher and Logs Replication Thread.

- Remove wait for FLUSH_LOG for replicated LSM components:

This wait is not needed since on node failure, complete remote recovery is done.

Change-Id: I34a38f59c4915a19242adb6a4eaa6ee1c82d2372

Reviewed-on: https://asterix-gerrit.ics.uci.edu/743

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -2
    • +5
    ./bootstrap/NCApplicationEntryPoint.java
  1. … 20 more files in changeset.
Enabled Feed Tests and Added External Library tests

Feed tests had been switched off for a while due to having too many

sporadic failures. Now, we are switching them back on.

In addition, a new set of tests have been added to test that external

library works as expected.

Change-Id: Idd1fccd136fa2645b2707bbf7c04e60991ae8d4a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/625

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -3
    • +4
    ./bootstrap/CCApplicationEntryPoint.java
    • -325
    • +0
    ./bootstrap/ExternalLibraryBootstrap.java
    • -2
    • +2
    ./bootstrap/GlobalRecoveryManager.java
    • -1
    • +2
    ./bootstrap/NCApplicationEntryPoint.java
  1. … 200 more files in changeset.
Asterix NCs Failback Support

- Allow Failed NCs to failback and takeover their partitions.

- New cluster API servlet for cluster state description.

- Remove nodeId from txn logs except remote FLUSH_LOG.

- Add partition id in UPDATE and Entity_COMMIT logs.

- Adapt remote recovery to new logs format.

- Refactor RecoveryManager and split Analysis and Redo phase.

- Spill remote recover logs to temporary file.

- Replicate files to remote replicas for partitions of interest only.

- Introduce NC active/inactive partitions concept.

- Test case for failback.

Change-Id: Id17819542d6b9c4e32647e64737c4a467b630f24

Reviewed-on: https://asterix-gerrit.ics.uci.edu/613

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -28
    • +26
    ./bootstrap/CCApplicationEntryPoint.java
    • -10
    • +7
    ./bootstrap/ClusterLifecycleListener.java
    • -35
    • +35
    ./bootstrap/NCApplicationEntryPoint.java
  1. … 90 more files in changeset.
Add QueryServiceServlet

Adds a new improved HTTP endpoint for queries. Also introduces

initial stats gathering.

Change-Id: Ia494c54f7252445ce38903c0b58fc4e23c324e6e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/597

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -1
    • +4
    ./bootstrap/CCApplicationEntryPoint.java
  1. … 8 more files in changeset.
Asterix NCs Fault Tolerance

This change includes the following:

- Adapt replication to unique partitions storage.

- Implement auto failover for failing NCs.

- Implement auto failover for metadata node.

- Fix for ASTERIXDB-1251 using proper error message.

- Basic replication test cases using vagrant virtual cluster for:

1. LSM bulkload components replication.

2. LSM Memory components replication and recovery.

3. Metadata node takeover.

These test cases will be part of the cluster test profile.

Change-Id: Ice26d980912a315fcb3efdd571d6ce88717cfea4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/573

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -217
    • +0
    ./bootstrap/AsterixGlobalRecoveryManager.java
    • -5
    • +7
    ./bootstrap/CCApplicationEntryPoint.java
    • -12
    • +6
    ./bootstrap/ClusterLifecycleListener.java
    • -0
    • +225
    ./bootstrap/GlobalRecoveryManager.java
    • -32
    • +4
    ./bootstrap/NCApplicationEntryPoint.java
  1. … 67 more files in changeset.
Feed Fixes and Cleanup

1. Introduce filesystem feed data source.

2. Fix the order of closing feed stages on disconnection.

3. Added Twitter feed to the compatibility utility to allow

using it with its alias.

4. First part of the feed log space.

5. Fixed the handling of duplicate key exception.

Change-Id: I4e8db26a810efd1fbaa52ceeb3efd0c8328ab070

Reviewed-on: https://asterix-gerrit.ics.uci.edu/574

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -2
    • +2
    ./bootstrap/AsterixGlobalRecoveryManager.java
    • -3
    • +3
    ./bootstrap/CCApplicationEntryPoint.java
    • -3
    • +4
    ./bootstrap/ExternalLibraryBootstrap.java
    • -20
    • +20
    ./bootstrap/NCApplicationEntryPoint.java
  1. … 413 more files in changeset.
Improve the Testing Framework

This change includes the following improvements to the test framework

1. Checking each expected failure against the failure exception.

2. Checking against multiple causes of failure in case of multiple

expected errors.

3. Check if a test that is expected to fail pass.

4. Make temp datasets use different storage path.

Change-Id: I957ecf19bf7209981e010e0e50fb882442a525dd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/537

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -6
    • +6
    ./bootstrap/NCApplicationEntryPoint.java
  1. … 28 more files in changeset.
First stage of external data cleanup

In this change, different parts of external data were refactored.

The goal was to make it more modular, easier to maintain and allow

higher flexibility for extension in addition to reducing code redundancy.

Change-Id: I04a8c4e494d8d1363992b6fe0bdbe6b2b3b7b767

Reviewed-on: https://asterix-gerrit.ics.uci.edu/566

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -2
    • +2
    ./bootstrap/ExternalLibraryBootstrap.java
  1. … 343 more files in changeset.
Divide Cluster into Unique Partitions

The change includes the following:

- Fix passing NC stores to AsterixConfiguration.

- Unify storage direcotry name in the instance level rather than the node level.

- Divide the cluster into unique storage partitions based on the number of stores.

- Refactored FileSplits and moved out of AqlMetadataProvider.

- Make AsterixHyracksIntegrationUtil use the passed configuration file.

- Make File Splits pass relative index paths of partitions rather than absolute paths.

- Remove unused AqlCompiledMetadataDeclarations class.

Change-Id: I8c7fbca5113dd7ad569a46dfa2591addb5bf8655

Reviewed-on: https://asterix-gerrit.ics.uci.edu/564

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -19
    • +20
    ./bootstrap/NCApplicationEntryPoint.java
  1. … 41 more files in changeset.
Refactored External Data

This change re-arrange asterix module's order. asterix-

external-data is moved in front of asterix-metadata.

Change-Id: I46b60b5e1cc37fd59adc0dd89f374d96502091b2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/559

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -1
    • +1
    ./bootstrap/AsterixGlobalRecoveryManager.java
    • -1
    • +1
    ./bootstrap/ExternalLibraryBootstrap.java
  1. … 92 more files in changeset.
Asterix MessageBroker implementation

This change includes the following:

- Add implementation for CC/NC MessageBroker.

- Implement GlobalResourceIdFactory using MessageBroker.

- Change resource id factory to GlobalResourceIdFactory.

- Refactor metadata indexes fixed properties.

- Use fixed resource ids for metadata indexes.

Change-Id: If4320e2c5a0130d2f86a4be6ae61f5cee43e30af

Reviewed-on: https://asterix-gerrit.ics.uci.edu/486

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +6
    ./bootstrap/CCApplicationEntryPoint.java
    • -3
    • +12
    ./bootstrap/NCApplicationEntryPoint.java
  1. … 25 more files in changeset.
Fix ASTERIXDB-1089

This fixes a case where an NPE is thrown when a substitute node joins but

no substitute nodes are specified in the cluster config

Change-Id: I8977d91ea82cd3a0538a84dc6d727d94fe2ece1d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/508

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Reviewed-by: Keren-Audrey Ouaknine <kereno@gmail.com>

    • -1
    • +12
    ./bootstrap/NCApplicationEntryPoint.java
Clean up compilation warnings.

Change-Id: Idbfcd9c67f91d373c5f7269125778a5681021227

Reviewed-on: https://asterix-gerrit.ics.uci.edu/505

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -16
    • +18
    ./bootstrap/ExternalLibraryBootstrap.java
  1. … 109 more files in changeset.
ASTERIXDB-1175 Ensure Feed Central Manager Starts

This change fixes the connection refused exception that shows

up when asterix is started. The reason for this connection refused

is that the feed central manager was not started and local feed

managers try to connect to it.

Change-Id: Ifeaf7f70864a0efad38f3f2627b97ebdff06a0c1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/502

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +5
    ./bootstrap/CCApplicationEntryPoint.java
ASTERIXDB-1152: Delete storage data of old instances

Change-Id: Ibb6c6949bdf2ed6c3e491fa66a23491ff34fc830

Reviewed-on: https://asterix-gerrit.ics.uci.edu/469

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -5
    • +3
    ./bootstrap/NCApplicationEntryPoint.java
  1. … 6 more files in changeset.
SQL++ support in AsterixDB: 1. implemented SQL++ expression to logical plan translator; 2. refactored REST API to be agnostic of query languages; 3. disabled fuzzy join queries for SQL++ runtime tests; 4. fixed several rewriting rules.

Change-Id: I82919c4527b304325059519d819a2c30cf2902a9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/479

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -8
    • +16
    ./bootstrap/CCApplicationEntryPoint.java
  1. … 1379 more files in changeset.
Introducing Data Replication To AsterixDB

This change includes the following:

- Add data replication properties to cluster properties and Managix validate command.

- Introduce Data Replication components.

- Add data replication required fields to LogRecord.

- Specialized LogManager for data replication.

- Fix for invalid cluster state on nodes failure.

- ASTERIXDB-139: Fix for cleaning workspace files on startup/shutdown.

- Fix for temp datasets storage reclamation.

- Allow MetadataNode rebinding with CC.

- Add flag to checkpoint to identify sharp checkpoints.

- ASTERIXDB-1170: Fix shutdown sequence

Change-Id: I729fdd1144dbc9ff039b4bc414494860d7553810

Reviewed-on: https://asterix-gerrit.ics.uci.edu/338

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

    • -7
    • +13
    ./bootstrap/CCApplicationEntryPoint.java
    • -0
    • +13
    ./bootstrap/ClusterLifecycleListener.java
    • -20
    • +76
    ./bootstrap/NCApplicationEntryPoint.java
  1. … 71 more files in changeset.
This change fixes the sporadic connection refused errors

This can mostly be seen during asterix-installer tests.

The fix basically lets managix wait and listens

through zookeeper for a signal from the cluster controller that

the cluster is up and ready.

Once the cluster controller sends the signal, Managix can proceed.

Change-Id: Ib730f50ab2fb492f3cf973d1cf2f03b34e24e5b3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/366

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -21
    • +21
    ./bootstrap/CCApplicationEntryPoint.java
  1. … 11 more files in changeset.
ASTERIXDB-1153: Determine build information at runtime

Very simple API. Just do a GET against /admin/version and get all of the build-time git info in JSON.

Change-Id: Ie392eb0cdbd25f2f4679fba12aae4c7a496e9637

Reviewed-on: https://asterix-gerrit.ics.uci.edu/468

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -2
    • +9
    ./bootstrap/CCApplicationEntryPoint.java
  1. … 10 more files in changeset.
ASTERIXDB-1053: Allow lazy loading for persistent local resources

- Allow indexes to be accessed by name.

- Allow lazy loading for persistent local resources.

- Caching for local resources.

Change-Id: I48b9260a3280750145f6ddb3783673a299055910

Reviewed-on: https://asterix-gerrit.ics.uci.edu/344

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -5
    • +6
    ./bootstrap/CCApplicationEntryPoint.java
    • -7
    • +1
    ./bootstrap/NCApplicationEntryPoint.java
  1. … 14 more files in changeset.
Change License Headers

Also tweak the NOTICE file with some extras.

Change-Id:I09bc388089e515d7f51fd39c31bfbbc9f00cf84f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/388

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -10
    • +14
    ./bootstrap/AsterixGlobalRecoveryManager.java
    • -10
    • +14
    ./bootstrap/AsterixStateDumpHandler.java
    • -10
    • +14
    ./bootstrap/CCApplicationEntryPoint.java
    • -10
    • +14
    ./bootstrap/ClusterLifecycleListener.java
    • -10
    • +14
    ./bootstrap/ClusterWorkExecutor.java
    • -10
    • +14
    ./bootstrap/ExternalLibraryBootstrap.java
    • -10
    • +14
    ./bootstrap/NCApplicationEntryPoint.java
  1. … 2011 more files in changeset.
Change Java package from edu.uci.ics to org.apache

Change-Id: I2f01d2b5614e9e9c94fda4bf1294a8eba6a26c54

Reviewed-on: https://asterix-gerrit.ics.uci.edu/309

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -23
    • +23
    ./bootstrap/AsterixGlobalRecoveryManager.java
    • -3
    • +3
    ./bootstrap/AsterixStateDumpHandler.java
    • -28
    • +28
    ./bootstrap/CCApplicationEntryPoint.java
    • -14
    • +14
    ./bootstrap/ClusterLifecycleListener.java
    • -24
    • +24
    ./bootstrap/ExternalLibraryBootstrap.java
    • -22
    • +22
    ./bootstrap/NCApplicationEntryPoint.java
  1. … 2597 more files in changeset.
Change folder structure for Java repackage

Change only the folders, not the files, for our package name change.

This will break the build, and needs to be followed by a change to

the package name in all of the source files. However performing

the folder move and file change in two steps lets Git understand

that the files are the same, and lets us track revisions across

those files.

Change-Id: Iefd2a576415ebc1416cba2a3334d2b64f042ba92

Reviewed-on: https://asterix-gerrit.ics.uci.edu/306

Tested-by: Ian Maxon <imaxon@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +213
    ./bootstrap/AsterixGlobalRecoveryManager.java
    • -0
    • +48
    ./bootstrap/AsterixStateDumpHandler.java
    • -0
    • +184
    ./bootstrap/CCApplicationEntryPoint.java
    • -0
    • +204
    ./bootstrap/ClusterLifecycleListener.java
    • -0
    • +102
    ./bootstrap/ClusterWorkExecutor.java
    • -0
    • +318
    ./bootstrap/ExternalLibraryBootstrap.java
    • -0
    • +64
    ./bootstrap/FeedBootstrap.java
    • -0
    • +279
    ./bootstrap/NCApplicationEntryPoint.java
  1. … 3788 more files in changeset.