asterixdb

Clone Tools
  • last updated 18 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
changed two more stale links

    • -1
    • +1
    /asterix-doc/src/site/markdown/index.md
    • -1
    • +1
    /asterix-doc/src/site/markdown/install.md
fixed absolute link to 0.8.3 and replaced with downloads page link instead

    • -1
    • +1
    /asterix-doc/src/site/markdown/install.md
Merge tag 'asterix-0.8.6' into documentation

[maven-release-plugin] copy for tag asterix-0.8.6

[maven-release-plugin] prepare release asterix-0.8.6

  1. … 6 more files in changeset.
Depend on stable hyracks version for release

Change-Id: I385e54c88225c08463d5d9de76f6432e88abae3a

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/101

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Ian Maxon <imaxon@uci.edu>

Moving developerConnection in toplevel pom (for asterixdb)

Change-Id: I13add863e85897b1ffcf1e011354c19b744eca88

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/99

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

improvements for demo

- add demo cluster

- add example mugshot.com data and queries

- automatic configuration of a cluster

- set MANAGIX_HOME implicitly

- better AQL lexer error reporting

- better eror reporting in ADM parser

- fix and optimize construction of asterix zip for deployment

Change-Id: I9d80402cef72a15271766031b6f06c7220e4ad5a

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/95

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Raman Grover <ramang@uci.edu>

  1. … 22 more files in changeset.
Make the filter field optional in the Dataset dataset of the metadata.

Change-Id: Ibd2ba0edf4c8969ba4974375f5b0e0f6ddfb02ba

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/94

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Added filters to AsterixDB's primary and secondary indexes.

Change-Id: If16b2758bb25392c8dd0405d7d59ae503efad3f0

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/82

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -0
    • +15
    /asterix-app/data/fbm-with-send-time.adm
  1. … 106 more files in changeset.
remove unused properties

The properties AsterixWebServerPort and AsterixJSONAPIServerPort were

never read, but written in some places ..

Change-Id: If713cade15c2df2801ced43e8857e7f8ed5d3c36

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/93

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

    • -1
    • +1
    /asterix-app/scripts/asterix/startcc.sh
    • -1
    • +1
    /asterix-app/scripts/idefix/startcc.sh
    • -1
    • +1
    /asterix-app/scripts/rainbow/startcc.sh
Adds a delivery mode called async-deferred

I added a new result delivery mode called async-deferred, this mode returns a handle once the query completed.

context: sync is a blocking call which returns the result once the query completed, whereas async returns a handle immediately to pull the results later.

async-defer is a hybrid of these two as it returns a handle but only once the query completed.

Change-Id: I8480d22ea9b107edf6d340073581c2613b017599

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/77

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

Potential fix for sporadic issues with AsterixClusterLifeCycleIT.tearDown()

I think there was a race between these two adjacent methods in tearDown(), the latter of which looks like it isn't

even doing what I intended it to do at the moment. I haven't been able to observe this sporadic failure after changing

it so the latter one goes after the printing of the output of the former, which blocks and therefore would stop any

issues of this type.

Change-Id: I57ac2117c42a0b798f3249846f0b49927c64d870

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/91

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

Introduce support for JSON as a test result type, including sample test case. Change-Id: If2e0454e30b62f52311e156beed0024f615669ce Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/92 Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Reviewed-by: Till Westmann <westmann@gmail.com>

Add -Dtestre option to run a subset of AQL tests. Any test-case with a compilation-unit whose name matches the regular expression will be run. Change-Id: I2b3943d8d9238ef34c6ec26eab9aff8e60a7b165 Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/89 Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Reviewed-by: Ian Maxon <imaxon@uci.edu>

Output correct JSON strings for object keys; base decision to return text/json from HTTP API on Accepts header rather than Content-type Change-Id: I14a71d7ec4ffd432691bfa795079e5c8a51037bb Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/85 Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Reviewed-by: Zachary Heilbron <zheilbron@gmail.com>

  1. … 3 more files in changeset.
Change for expected results to fix issue 787

nest_aggregate.3.query.aql had its results change when running under Hyracks c6d9386c rather than 396c18bc.

Apparently however the new results look correct, so this changes the result file to reflect that.

This is related to changes for https://code.google.com/p/asterixdb/issues/detail?id=782

Change-Id: I8065c8bb979773943d2d95ebd33651625f32b0b3

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/83

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Fix ADM Parser Bug

This change make sure that each adm parser instance use its own objects for parsing

and not share it with other parser running on the same NC.

Change-Id: Ib54dd2f9f8474ddb8dc2d785f819dd62c7ce7ca3

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/73

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

Add external indexes

This change include the following:

1. additional data parser for external data that parse hdfs records using Hive serdes.

2. allow users to create external data. this includes:

a) changes in metadata external dataset details.

b) addition of a new metadata index to store external file's statuses.

c) the pipeline for building the B-Tree and R-Tree indexes.

d) hyracks operators to fetch records with their RIDs using different formats.

e) hyracks operators to lookup and parse external records.

f) test cases for indexing and index access of different hdfs file formats.

g) exposing the secondary indexes over external data to the compiler.

3. adding a new aql command to refresh external datasets. this includes

a) global recovery on system startup.

b) changes in the aql parser.

c) construction of bulk modify pipelines and additional operators to perform local commit and abort operations (using 2PC protocol).

4. Added copyright header to all new files

5. Added additional test cases to test left outer join on external data

Change-Id: I1065a473299f6027eb073aeeba3a56d137f6f98e

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/70

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

    • binary
    /asterix-app/data/hdfs/external-indexing-test.rc
    • binary
    /asterix-app/data/hdfs/external-indexing-test.seq
    • -0
    • +11
    /asterix-app/data/hdfs/external-indexing-test.txt
    • -0
    • +21
    /asterix-app/data/hdfs/spatialData.json
    • -0
    • +250
    /asterix-app/data/hdfs/tw_for_indexleftouterjoin.adm
  1. … 136 more files in changeset.
1. Add an asterix-specific IntroduceGroupByCombinerRule to deal with null-test in the nested plan in a group-by operator 2. Add a regression test case for issue782, including optimizer test and runtime test

Change-Id: Ia678414451ebddb7367238fef9f22a6753aa6206

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/65

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

    • -0
    • +11
    /asterix-app/data/tpch0.001/selectednation.tbl
Hyracks issue #137 requires a new IUnnestPositionWriter to be defined. Here it is.

Updated AsterixDB to use the new IUnnestPositionWriter.

Change-Id: I9ad5dbaef7a3b347a61e0f8a5505d4db6dc232c3

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/68

Reviewed-by: Till Westmann <westmann@gmail.com>

Tested-by: Ian Maxon <imaxon@uci.edu>

Support sort-based group-by, add test coverage for out-of-core code paths, and adapt to the new buffer cache interface. -- add the support for sort-based group-by -- add test coverages for disk-based code path, including multi-pass code paths -- populate framesize and group-by buffer size into asterix -- adapt to new interface for buffer cache

Change-Id: I4af9eaa6fa6a8ae76b8ecaa39184785a90b32710

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/36

Tested-by: Ian Maxon <imaxon@uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 25 more files in changeset.
fixed issue 731, 740, and more.

commit 0b46141bea8d503896dc06308f102131df2e4f3d

Author: Young-Seok <kisskys@gmail.com>

Date: Tue May 20 12:52:54 2014 -0700

fixed issues of access method rules that try to use incompatible indexes and similarity functions

commit a0ea4e411503de265f1883aa3837a45be4a8747a

Merge: bb8fe91 b5785a9

Author: Young-Seok <kisskys@gmail.com>

Date: Sun May 18 13:00:33 2014 -0700

merged from master branch to kisskys/left-outer-join-issue branch

commit bb8fe91ffd4fec3d495d32442020447693be8548

Author: Young-Seok <kisskys@gmail.com>

Date: Sun May 18 11:33:54 2014 -0700

another fix for picking available index for leftouterjoin plan

commit 60b057ecec6a157e3e11cb316ef7d38601483741

Merge: a743e44 6cb7fd9

Author: Young-Seok <kisskys@gmail.com>

Date: Sun May 11 22:22:42 2014 -0700

merged master to kisskys/left-outer-join-issue branch

commit a743e4493f0f84f7a71e671478592d487e7510e3

Author: Young-Seok <kisskys@gmail.com>

Date: Sun May 11 20:51:50 2014 -0700

changes for left-outer-join to pick available indexes

Change-Id: I0d89d20c6cc076f40d1fbc5687f0b70e49a91eed

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/33

Reviewed-by: Inci Cetindil <icetindil@gmail.com>

Tested-by: Ian Maxon <imaxon@uci.edu>

  1. … 59 more files in changeset.
Added recordType deep copying to avoid race condition

Change-Id: Ia06e3114ffa3b593eedab0b9537e5f2b14abb8be

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/37

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Fixed issues 698 and 699. Also added JSON printers for UUIDs

The following commits from your working branch will be included:

commit 956ec767c369f4b238ad98b260b8fe83b1b5ea40

Author: zheilbron <zheilbron@gmail.com>

Date: Fri May 16 10:50:15 2014 -0700

fix issue 698

commit 8e0fd4d8ea6779e8ced4ee8001ccff70c7ac97ab

Author: zheilbron <zheilbron@gmail.com>

Date: Fri May 16 10:36:22 2014 -0700

add JSON printers for UUIDs

commit 2b550b3646255c6c9dca95d16cb78d075ec22205

Author: zheilbron <zheilbron@gmail.com>

Date: Fri May 16 10:10:41 2014 -0700

fix issue 699

Change-Id: I096505bdb5d4ab0f0dbbc46d15349a2c5682fe29

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/32

Reviewed-by: Inci Cetindil <icetindil@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

updated the test case

added a tets case, addressed Raman's code review comment

    • -4
    • +1
    /asterix-algebra/src/main/javacc/AQLPlus.jj
Adding support for accessing an item in list using non constant index

    • -14
    • +8
    /asterix-algebra/src/main/javacc/AQLPlus.jj
    • -14
    • +8
    /asterix-aql/src/main/javacc/AQL.jj
Basis for Cluster integration testing

This branch adds cluster testing via Vagrant.

Requires my branch of the vagrant-maven plugin to work,

which can be sourced here:

https://github.com/parshimers/vagrant-maven-plugin

It is enabled with -DclusterTest=true in mvn verify.

A virtualized cluster with 4 nodes is started, and

then Asterix is started via managix on this cluster,

and then stopped.

Change-Id: I7e3cdcd4162ada19ee1e15f532be7447b4f34367

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/31

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Reviewed-by: Zachary Heilbron <zheilbron@gmail.com>

Reviewed-by: Till Westmann <westmann@gmail.com>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -0
    • +52
    /asterix-installer/src/test/resources/clusterts/Vagrantfile
    • -0
    • +45
    /asterix-installer/src/test/resources/clusterts/cluster.xml
    • -0
    • +6
    /asterix-installer/src/test/resources/clusterts/hosts
    • -0
    • +27
    /asterix-installer/src/test/resources/clusterts/id_rsa
    • -0
    • +11
    /asterix-installer/src/test/resources/clusterts/known_hosts
addressed Young-Seok's code review comments

code review updates