asterixdb

Clone Tools
  • last updated 18 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
remove global metadata lock

Change-Id: Id05ff463fee356b3270b53d0b3137c4b1bc3d830

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/84

Reviewed-by: Sattam Alsubaiee <salsubaiee@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -2
    • +25
    /asterix-aql/src/main/javacc/AQL.jj
Move to hyracks dev 0.2.13-SNAPSHOT

Change-Id: I5c6bdacdb22adc078187a0a8ede150bf8dd388be

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/102

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Ian Maxon <imaxon@uci.edu>

[maven-release-plugin] prepare for next development iteration

  1. … 6 more files in changeset.
[maven-release-plugin] prepare release asterix-0.8.6

  1. … 6 more files in changeset.
Depend on stable hyracks version for release

Change-Id: I385e54c88225c08463d5d9de76f6432e88abae3a

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/101

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Ian Maxon <imaxon@uci.edu>

[maven-release-plugin] prepare for next development iteration

    • -3
    • +3
    /algebricks/algebricks-compiler/pom.xml
    • -1
    • +1
    /algebricks/algebricks-examples/pom.xml
    • -2
    • +2
    /algebricks/algebricks-rewriter/pom.xml
    • -6
    • +6
    /algebricks/algebricks-runtime/pom.xml
    • -3
    • +3
    /hivesterix/hivesterix-optimizer/pom.xml
    • -6
    • +6
    /hivesterix/hivesterix-runtime/pom.xml
  1. … 75 more files in changeset.
[maven-release-plugin] prepare release fullstack-0.2.12

    • -3
    • +3
    /algebricks/algebricks-compiler/pom.xml
    • -1
    • +1
    /algebricks/algebricks-examples/pom.xml
    • -2
    • +2
    /algebricks/algebricks-rewriter/pom.xml
    • -6
    • +6
    /algebricks/algebricks-runtime/pom.xml
    • -3
    • +3
    /hivesterix/hivesterix-optimizer/pom.xml
    • -6
    • +6
    /hivesterix/hivesterix-runtime/pom.xml
  1. … 75 more files in changeset.
Consider opaqueParameters in AbstractFunctionCallExpression equals&hashcode methods to make casting operators with the same argument distinguishable

Change-Id: I7b8bf5979732eb22dff824e48a57fdd1b1da4dda

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/100

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

Reviewed-by: Inci Cetindil <icetindil@gmail.com>

Moving developerConnection in toplevel pom (for asterixdb)

Change-Id: I13add863e85897b1ffcf1e011354c19b744eca88

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/99

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Moving developerConnection in toplevel pom

Change-Id: I53eed5eb418e4f6091aa1e3d392fe77796e4c9f8

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/98

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Several bug fixes in HHJ, NLJ, and tokenizer

- in HHJ handle the case when it spills and skipInMemoryHJ is set to false,

- check for memsize in NLJ and correctly set memsize in HHJ,

- make counthashed-ngram-token() to skip the bits for length & type

Change-Id: I908345f993019b0bfd0ac0bcb3e497a42295b623

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/96

Reviewed-by: Pouria Pirzadeh <pouria.pirzadeh@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

improvements for demo

- add demo cluster

- add example mugshot.com data and queries

- automatic configuration of a cluster

- set MANAGIX_HOME implicitly

- better AQL lexer error reporting

- better eror reporting in ADM parser

- fix and optimize construction of asterix zip for deployment

Change-Id: I9d80402cef72a15271766031b6f06c7220e4ad5a

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/95

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Raman Grover <ramang@uci.edu>

  1. … 22 more files in changeset.
Make the filter field optional in the Dataset dataset of the metadata.

Change-Id: Ibd2ba0edf4c8969ba4974375f5b0e0f6ddfb02ba

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/94

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Added filters to AsterixDB's primary and secondary indexes.

Change-Id: If16b2758bb25392c8dd0405d7d59ae503efad3f0

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/82

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -0
    • +15
    /asterix-app/data/fbm-with-send-time.adm
  1. … 106 more files in changeset.
Added LSM component-level filters for all indexes.

Change-Id: I898cf885c9f88feae85c99799a00fd8ec036efea

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/81

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 116 more files in changeset.
remove unused properties

The properties AsterixWebServerPort and AsterixJSONAPIServerPort were

never read, but written in some places ..

Change-Id: If713cade15c2df2801ced43e8857e7f8ed5d3c36

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/93

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

    • -1
    • +1
    /asterix-app/scripts/asterix/startcc.sh
    • -1
    • +1
    /asterix-app/scripts/idefix/startcc.sh
    • -1
    • +1
    /asterix-app/scripts/rainbow/startcc.sh
Adds a delivery mode called async-deferred

I added a new result delivery mode called async-deferred, this mode returns a handle once the query completed.

context: sync is a blocking call which returns the result once the query completed, whereas async returns a handle immediately to pull the results later.

async-defer is a hybrid of these two as it returns a handle but only once the query completed.

Change-Id: I8480d22ea9b107edf6d340073581c2613b017599

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/77

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

Potential fix for sporadic issues with AsterixClusterLifeCycleIT.tearDown()

I think there was a race between these two adjacent methods in tearDown(), the latter of which looks like it isn't

even doing what I intended it to do at the moment. I haven't been able to observe this sporadic failure after changing

it so the latter one goes after the printing of the output of the former, which blocks and therefore would stop any

issues of this type.

Change-Id: I57ac2117c42a0b798f3249846f0b49927c64d870

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/91

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

Introduce support for JSON as a test result type, including sample test case. Change-Id: If2e0454e30b62f52311e156beed0024f615669ce Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/92 Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Reviewed-by: Till Westmann <westmann@gmail.com>

Add -Dtestre option to run a subset of AQL tests. Any test-case with a compilation-unit whose name matches the regular expression will be run. Change-Id: I2b3943d8d9238ef34c6ec26eab9aff8e60a7b165 Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/89 Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Reviewed-by: Ian Maxon <imaxon@uci.edu>

Output correct JSON strings for object keys; base decision to return text/json from HTTP API on Accepts header rather than Content-type Change-Id: I14a71d7ec4ffd432691bfa795079e5c8a51037bb Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/85 Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Reviewed-by: Zachary Heilbron <zheilbron@gmail.com>

  1. … 3 more files in changeset.
Change for expected results to fix issue 787

nest_aggregate.3.query.aql had its results change when running under Hyracks c6d9386c rather than 396c18bc.

Apparently however the new results look correct, so this changes the result file to reflect that.

This is related to changes for https://code.google.com/p/asterixdb/issues/detail?id=782

Change-Id: I8065c8bb979773943d2d95ebd33651625f32b0b3

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/83

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Add Shutdown via API to Hyracks

This change adds a method to HyracksConnection called stopCluster().

When the CC recieves a message from this, it asks all NC tasks to close

and acknowledge that they have recieved the message and are closing.

If all NCs have closed, or a 10 second timeout elapses, the CC then

exits with a 0 return code if all NCs closed, or a 1 if some did

not acknowledge the shutdown request.

Change-Id: Iaf3d395dc7964e114d4929830f40063f58e0d5da

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/76

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Vinayak Borkar <vinayakb@gmail.com>

  1. … 9 more files in changeset.
1. make limit operator work in nested plan 2. avoid send-side materialize but use receive-side materialize to reduce cc/nc communications.

Change-Id: I1a90c70be0514fcc0b286afa456664618d68910f

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/80

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Pouria Pirzadeh <pouria.pirzadeh@gmail.com>

Fix ADM Parser Bug

This change make sure that each adm parser instance use its own objects for parsing

and not share it with other parser running on the same NC.

Change-Id: Ib54dd2f9f8474ddb8dc2d785f819dd62c7ce7ca3

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/73

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

Support big vertex in Pregelix. --For those vertice beyond page size, we store them on HDFS as immutable files. --Updates on those big vertice will trigger creations of new immutable files.

Change-Id: I6b6f0528b6b5360c96dcdace1fa360d42c517f22

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/72

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Pouria Pirzadeh <pouria.pirzadeh@gmail.com>

    • -0
    • +23
    /pregelix/pregelix-example/data/skew/data.txt
  1. … 3 more files in changeset.
Add external indexes

This change include the following:

1. additional data parser for external data that parse hdfs records using Hive serdes.

2. allow users to create external data. this includes:

a) changes in metadata external dataset details.

b) addition of a new metadata index to store external file's statuses.

c) the pipeline for building the B-Tree and R-Tree indexes.

d) hyracks operators to fetch records with their RIDs using different formats.

e) hyracks operators to lookup and parse external records.

f) test cases for indexing and index access of different hdfs file formats.

g) exposing the secondary indexes over external data to the compiler.

3. adding a new aql command to refresh external datasets. this includes

a) global recovery on system startup.

b) changes in the aql parser.

c) construction of bulk modify pipelines and additional operators to perform local commit and abort operations (using 2PC protocol).

4. Added copyright header to all new files

5. Added additional test cases to test left outer join on external data

Change-Id: I1065a473299f6027eb073aeeba3a56d137f6f98e

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/70

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

    • binary
    /asterix-app/data/hdfs/external-indexing-test.rc
    • binary
    /asterix-app/data/hdfs/external-indexing-test.seq
    • -0
    • +11
    /asterix-app/data/hdfs/external-indexing-test.txt
    • -0
    • +21
    /asterix-app/data/hdfs/spatialData.json
    • -0
    • +250
    /asterix-app/data/hdfs/tw_for_indexleftouterjoin.adm
  1. … 136 more files in changeset.
Adding external indexes

In Hyracks side, this change include the following:

1. The addition of three indexes:

a) external b-tree index

b) external r-tree index

c) external b-tree with buddy b-tree index

2. creating an additional logical operator in algebricks for performing lookup operations over external data and modify the different visitors to work with this operator

3. Added copyright header to all new files

Change-Id: Iecfbd86f06aff3caaf3a9652b63420666745ebb9

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/69

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Zachary Heilbron <zheilbron@gmail.com>

Reviewed-by: Sattam Alsubaiee <salsubaiee@gmail.com>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

  1. … 51 more files in changeset.
1. Add an asterix-specific IntroduceGroupByCombinerRule to deal with null-test in the nested plan in a group-by operator 2. Add a regression test case for issue782, including optimizer test and runtime test

Change-Id: Ia678414451ebddb7367238fef9f22a6753aa6206

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/65

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

    • -0
    • +11
    /asterix-app/data/tpch0.001/selectednation.tbl
1. fix asterixdb issue 782 --- push nested pipeline before a nested group-by operator into the combiner group-by operator in the AbstractIntroduceGroupByCombinerRule --- add a processNullTest abstract method in the AbstractIntroduceGroupByCombinerRule -- fix the join order in a subplan 2. allow user-configurable buffer cache page size (B-tree page size) in Pregelix

commit 4d9a11d0c05281a41bbabe03066478fe851b3a2b

Author: buyingyi <buyingyi@gmail.com>

Change-Id: Ib7761370df8606c55ac34c126554319586e824f0

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/64

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>