asterixdb

Clone Tools
  • last updated 28 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Auto-config SSDs for the AWS installtion.

Change-Id: I584cc0a9e7420b2b9144635fee107494cb3fa487

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1598

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +37
    /asterixdb/asterix-server/src/main/opt/aws/conf/aws_types.yml
    • -0
    • +28
    /asterixdb/asterix-server/src/main/opt/aws/yaml/mount.yml
Merge back CB doc update.

Change-Id: I7d86343e63dffaf5d976fc85ac9d36f1e509f42f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1595

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Shutdown ActiveManager Before Killing Thread Executors

Avoid race conditions with start / stop of active runtimes by stopping

the ActiveManager & and started runtimes before terminating the thread

executor

Change-Id: I45e83b0378198f80297fd2741969507741914dea

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1594

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Index-only plan step 3: Top-down Select and Join transformation rule

- Converted IntroduceSelectAccessMethodRule and IntroduceJoinAccessMethodRule

from bottom-up approach to top-down approach from the root operator.

- Index-only plan needs to verify the variables that are live in the select or join condition

are the only variables to be used afterwards unless a variable is generated after the select or join operator.

- In order to keep this information, top-down approach needs to be introduced.

Change-Id: I60a2a61eb46851d4c16c8f17447e3ac9b0aca778

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1551

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Add documentation for query parameters.

Change-Id: I80dcd668bea3b2b3fff0c0778548ffad63505d99

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1586

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -6
    • +6
    /asterixdb/asterix-doc/src/site/site.xml
Allow spurious semicolons at the end of statements

Change-Id: Iea49d46ed361a3540c391a681b5ed16d8958cea4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1593

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Better indentation of results.

Change-Id: Iab09135b0b08b43346244269e0bc252a24525f15

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1592

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Add query parameter validation.

- Automatically adjust query parameters such as compiler.joinmemory

compiler.sortmemory, compiler.groupmemory if they're too small;

- Validate if query parameters specified in a query are supported.

Change-Id: Ia9e2df274a0c5cf598da6c37d0241b6b9d35c84d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1584

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Remove Plan Plotter

Change-Id: Ib6a77070344a40c3ae5bb9ff20b8593506d3c746

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1587

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Add Missing Descriptions For Config Options

Also, expose knob for enabling transaction commit profile logs as config

option

Change-Id: I04826591133e7e8283b7288e14324659fd831954

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1589

Tested-by: Michael Blow <mblow@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

Fix async result delivery for compilation errors

- Request submission returns after successful compilation or returns the

compilation error.

Change-Id: Ib594cdceb8ff2801f3e2af37be68c1609bef2a11

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1575

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Format JSON output

1. Added Format JSON output query option.

2. Tweaked front end JS to rerender the JSON result. (Take the HTML

element and rerender it with json-viewer plugin).

3. Added jquery.json-viewer library (MIT License) to front end, with

several customization: a) Several compatibility bug fix (semi-colon,

comment); b) expand logo change.

Change-Id: Ieec8489c0a055b01e754bba5f9827a7c1f175567

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1574

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Minor fix for the Ansible doc.

Change-Id: I839331be2bcda7e8c40e62bc0ad963a5220593eb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1585

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Fix Missing License, Add Tests

- Fix missing license for updated appassembler components

- Add tests to prevent missing licenses

Change-Id: Ic6f4afc3dd9edd311709bf14ac4cbc7438a3716d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1583

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -1
    • +11
    /asterixdb/asterix-client-helper/pom.xml
Fix NPE in DatasetDirectoryService.reportJobFailure

Change-Id: I4c27d2133d199bbb6984f8da14e37b2e511528ac

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1582

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

HttpServer path matching fixes

Change-Id: I1429629210c16fc73d2a9e3d8c01e00d30de0c66

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1581

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Add documentation for Ansible and AWS installation options.

Change-Id: I0036823392ab6dde8bddbce8b141aaf166f4e3ca

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1576

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +137
    /asterixdb/asterix-doc/src/site/markdown/ansible.md
    • -0
    • +170
    /asterixdb/asterix-doc/src/site/markdown/aws.md
    • -23
    • +31
    /asterixdb/asterix-doc/src/site/markdown/index.md
    • -2
    • +4
    /asterixdb/asterix-doc/src/site/site.xml
Options to Skip Managix, Yarn, and Experiments

The properties skipManagix, skipYarn, and skipExperiments added to skip

asterix-managix, asterix-yarn, and asterix-experiments from the build

respectively

e.g. mvn clean -DskipYarn

Change-Id: I22d4c33feb056c8f5f86c7eb22e9d3e59546e3df

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1580

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Add appassembler-maven-plugin to *DB Plugin Mgmt

Fixes following errors seen during build:

e.g.

[WARNING] 'build.plugins.plugin.version' for org.codehaus.mojo:

appassembler-maven-plugin is missing. @ org.apache.asterix:asterix-server

:[unknown-version], .../asterixdb/asterixdb/asterix-server/pom.xml, line

224, column 15

Change-Id: I0c79e481e8a74cdf44552536c997f347e4580b14

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1579

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Eliminate Unnecessary printStackTrace() Calls

Stacktraces flood test logs for expected exceptions. This change

suppresses stacktraces in these instances.

Change-Id: Ie0239010579a495a42b68c1f3cf19e8b03f72eee

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1578

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Fix transaction logs and optimize upserts

Previously, Transaction logs didn't log previous image

which made it difficult to undo aborted transactions

correctly. This change fixes that by always recording

previous image.

In addition, Upsert was performed as a delete if found

followed by an insert with two logs. This change makes

it a single operation with a single transaction log.

Change-Id: Ice5296267033cd7debe76894c864c6411f761d83

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1554

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

  1. … 48 more files in changeset.
Prepare To Split Test Execution

Add profile to skip asterix-app tests, in preparation for splitting +1

Verified tests into two Jenkins jobs

Change-Id: Id424018aca3f633823a082fe9f5b7b4fa249e8a6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1577

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Deferred result delivery improvements

- Change representation for result set handles to not require URL encoding

- Report errors from the QueryStatusApiServlet for failed jobs

- Fix repeated result consumption for async/deferred requests

- Better error handling in QueryResultApiServlet

- Add host + path to RequestParameters to provide URLs as handles

- Fix logging for failed async jobs

- Fix test framework to not share request parameters between tests

- Move more shared code to AbstractQueryApiServlet

- Make DatasetClientContext a static inner class of HyracksDataset

Change-Id: I88fe289fe9109ea012c63d82af0083dce6bde31b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1548

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 61 more files in changeset.
Feed Exception Revise

1. Add compliation exception for missing Twitter4J library. Try to

expose this exception when create feed.

2. Tweaked 'invalid feed parameter exception'. Expose detailed exception

information to front end.

3. Related test cases fix.

Change-Id: Iee65b2a5365067c9ba2aa1615ac23f0ace41b51e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1534

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Detect IO errors before NullPointerException

Change-Id: I808b12590791a17b749084d1e85f34b9c4ac5893

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1572

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Add a REST endpoint for query cancellation.

This change also includes the following parts:

- Fix failure handling and potentially thread leakage in

MaterializingPipelinedPartition;

- Fix failure handling in PartitionDataWriter;

- Add a new test suite: SqlppExecutionWithCancellationTest.

Change-Id: I2936ac83f71bbef533e2695ed0a2b220c23fc483

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1564

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 31 more files in changeset.
ErrorCode Map Initialization Needs To Be Thread Safe

Reworked deferred initialization of error message map to be thread safe

Change-Id: I78c0df172038bb1a97297837ff7c82b2727f8556

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1571

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Read & Write License Files As UTF-8

Change-Id: I167fbcf4cb913dc00ebdb84b406397ee412b4f1e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1570

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Avoid escaping HTML entities in error messages

Change-Id: I385cad8f2fa28a9ae368e0e59b5257fa6325ac42

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1568

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Rename Class Helper and cleanup ICCApplication interface

Change-Id: I2f6deb10ff240e85b26244b52c99776c0d1d3291

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1567

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>