asterixdb

Clone Tools
  • last updated 16 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Exceptions Cleanup for Replication/FaultTolerance Strategies

Change-Id: I8f28b8db42bf7c8537ff2da22cbd2a97e243f32f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1529

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 4 more files in changeset.
Make Xmx small on 32bit JVM

There can be issues with the default memory parameter settings

if run on a 32Bit JVM, as the maximum RAM can be large due to

PAE or using 32bit JVM on a 64bit OS, therefore leading to an

-Xmx setting that is too large to address.

This makes the maximum 1GB by default on 32bit JVMs, as there

is a related issue on Windows where 32 bit processes are

limited to about 1.5G per process.

Change-Id: I025174fc2ca53e8d15ed53fac31b43bea3ddf281

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1521

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Ansible scripts for local cluster installation.

This change includes the following parts:

- Refactored aws scripts and share

the common part with non-aws cluster installation;

- Fixed aws_start.yml and aws_stop.yml to count

based on the user-provided tag.

Change-Id: I310f6f198c9ce41d7d7667dc4fbc21b3e34a77ab

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1525

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +60
    /asterixdb/asterix-server/src/main/opt/ansible/README
    • -0
    • +31
    /asterixdb/asterix-server/src/main/opt/ansible/bin/deploy.sh
    • -0
    • +32
    /asterixdb/asterix-server/src/main/opt/ansible/bin/erase.sh
    • -0
    • +31
    /asterixdb/asterix-server/src/main/opt/ansible/bin/start.sh
    • -0
    • +24
    /asterixdb/asterix-server/src/main/opt/ansible/conf/cc.conf
    • -0
    • +27
    /asterixdb/asterix-server/src/main/opt/ansible/conf/inventory
    • -0
    • +29
    /asterixdb/asterix-server/src/main/opt/ansible/yaml/deploy.yml
    • -0
    • +23
    /asterixdb/asterix-server/src/main/opt/ansible/yaml/erase.yml
  1. … 15 more files in changeset.
Handle error conditions in the /query/result API

- introduce AbstractQueryApiServlet to factor out common code of

QueryResultApiServlet and QueryStatusApiServlet

- clean up ResultReader interface

- remove org.apache.asterix.api.http.servlet.HyracksProperties

Change-Id: Icb99fccb4b41768fa010c574bf1703ffcd47535e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1532

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Add HTTP server overload test

Change-Id: I3f6e594b2acb4b5a8ad3118c9b492d0767980e61

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1531

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Handle error conditions in the /query/status API

Change-Id: I30176c5c70dcc5f7f6605ad79dd0e41967373d9c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1522

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +98
    /asterixdb/asterix-app/src/test/resources/runtimets/api.xml
Set response status for web interface servlets

Change-Id: Id4b5e153a8c589b666a44ae17bb05c69cfc3c9d9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1528

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Enable Feed Changes to work with BAD project

Extracts the ActiveListener

Enables listeners to survive after job executions

Change-Id: Ib62184b67aff564475ef9b58790ff96409195b77

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1524

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

ASTERIXDB-1786: Remove servlet/jetty dependency

Change-Id: Id72b394fa967dd130c0df7e813812e3c6b985c84

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1527

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 17 more files in changeset.
ASTERIXDB-1791, ASTERIXDB-1796: fix failure handling in runtime operators.

This change includes the following parts:

- Fix the implementation of fail() and close() in several runtime operators

to avoid file handle leak and job hang;

- Add an erase method to RunFileWriter which closes files before deleting

them in order release the holding disk space;

- Call RunFileWriter.close() and RunFileReader.close() in "finally" blocks.

- Fix RunFileReader to not truncate files to be deleted - it is not the root

cause of un-released disk space - open deleted files are the root cuase;

- Check file handle leaks in LangExecutionUtil.tearDown().

Change-Id: I203168171e6dac16b57d2eda960823e3810e22a3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1513

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 39 more files in changeset.
Some more servlet cleanup

Change-Id: I9ba2895f1c3d52e30c90ab3cdbe9b6db17e56aa3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1526

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

ASTERIXDB-1711: Move test infra from test.aql

Change-Id: I5d631a2028fb80c823fbaafb7269f15d07685dc9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1512

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 17 more files in changeset.
ASTERIXDB-1786: Remove Hyracks Servlets.

Change-Id: Ifcd240591d12baab2db4ce3163c635a1dde5c4ba

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1508

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

ASTERIXDB-1804: update AsterixDB servlets

Change-Id: Id48a4753775a19094b28876ef3544bda989f918d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1519

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

update maven-compile-plugin to 3.6.1

- also fix dependencies for asterix-experiments

Change-Id: I744d3e479ce238a9d1e5ae283be2113bd014353c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1520

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -42
    • +19
    /asterixdb/asterix-experiments/pom.xml
Various fixes for Windows NCService

- Fix RESOURCE_PATH

- Use windows platform in appassembler instead of booter-windows for client-helper

- Fix a few redirection bugs in sample start/stop batch files

Change-Id: If7af80292bddd5191d83bac18f0a518621d7db71

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1518

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Ian Maxon <imaxon@apache.org>

Tested-by: Ian Maxon <imaxon@apache.org>

    • -10
    • +1
    /asterixdb/asterix-client-helper/pom.xml
ASTERIXDB-1804: support more HTTP verbs

- add verb-based routing to AbstractServlet.handle (subclasses implement

verb-specific methods like get, post, ...)

- move construction logic for IServletRequests from HttpUtil to request

classes

- remove verb-checking from HttpServerHandler

Change-Id: I2d14ce9c3c34d345fe71a44518b1e95b79c37dab

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1516

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Fix Race Condition in Hyracks/AlgebricksException

Instantiation of message must be synchronized

Change-Id: I2879e293af78ec54b3201a748981c32faa481f1a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1515

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Add integration tests for Hyracks' HTTP APIs

Change-Id: Ib135ead7896a2b66735eb7325babe15b18a29bed

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1498

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Introduce Strategy Based Replication and Fault-Tolerance

This change includes the following:

- Introduce new APIs for Replication and Fault-Tolerance Strategies.

- Add configuration in cluster description file for high-availability.

- Add built-in replication strategies (Metadata_Only, Chained_Declustering)

- Add built-in fault-tolerance strategies (Auto, Metadata_Node)

- Remove none cluster state functionality from ClusterStateManager.

- Add customizable NC startup sequence

Change-Id: I1d1012f5541ce786f127866efefb9f3db434fedd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1405

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 97 more files in changeset.
Feed Connection Refactoring

1. The feed subscription network using FeedJoint is removed.

2. FeedConnection metadata dataset is added (pkeys: dataverseName,

feedName, datasetName).

3. Replaced the old intake job + collect job combination with one single

job using SplitOperator.

4. Now one feed can connect to multiple datasets.

5. The disconnect feed job is replaced by ActiveManagerMessage.

6. The new feed life cycle is:

- Create feed

- Connect feed to dataset0, dataset1, dataset2, etc.

- Start feed

- Stop feed

- Disconnect feed

7. New feedEventListner framework by Abdullah

Change-Id: Ic36267eb9a10df21734ce1cc1f38583e23c9e8f0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1259

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 183 more files in changeset.
Use rsync instead of wget to distribute the benchmark source.

Change-Id: I58d2553eb7866d6cc947f9a8f0443cb82fc654f6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1511

Reviewed-by: Ian Maxon <imaxon@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Ian Maxon <imaxon@apache.org>

Added some info about open and close types to the data model doc. Change-Id: I1262090a2a568d935fd96e00db1da5cd836f25a5 Reviewed-on: https://asterix-gerrit.ics.uci.edu/1510 Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Fix the names of Let to Servlet

Change-Id: Ib2f63f37ee9ef063930478028e3e05ca9dd4742c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1486

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 14 more files in changeset.
ASTERIXDB-1747 Implemented full lifecycle capabilities for pre-distributed jobs

Added distribute and destroy functionality

Removed serialization and bytes when running pred-distributed jobs

Cleaned up methods

Enabled Mockito testing for CCS and NCS

Added Unit Test for Distributed Jobs

Change-Id: I59c3422d5c1ab7756a6a4685ac527dfe50434954

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1377

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 27 more files in changeset.
Add cluster performance testing scripts.

- Wait SSH instead of sleep in the AWS installation script;

- Remove Java code and generate config files in Ansible;

- TPC-H is one benchmark, and more benchmarks could be added into the framework.

Change-Id: Ie17f20dc87694a865aebc561d8eded064c66f5bb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1504

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +51
    /asterixdb/asterix-benchmark/pom.xml
  1. … 74 more files in changeset.
More flexibility for the LangExecutionUtil

Change-Id: Id2632dce25519995798016b5be1ca650f8af9586

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1507

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

NCService documentation improvements

Change-Id: I8a775498e758e900013db1116fef593d292cf8af

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1490

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +33
    /asterixdb/asterix-doc/src/main/ncservice.tex
    • -0
    • +1
    /asterixdb/asterix-doc/src/site/site.xml
Add error message for malformed job ids.

Change-Id: I315e3aa798af791f41535279e8a983e857f2b14e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1495

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Fix asterix-docker

Change-Id: Ifac17caf603f1d4f1c53413996d833869d68a266

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1506

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>