asterixdb

Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Doc updates to HTTP API

-Rename "REST" API to HTTP API

-Minor documentation for /aql endpoint

Change-Id: I5c6520495752da312f4db7641fcfd14f7d63c829

Reviewed-on: https://asterix-gerrit.ics.uci.edu/331

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -1
    • +31
    /asterix-doc/src/site/markdown/api.md
Add missing documentation to sidebar, fix typos

Change-Id: Id957eb1321eb7539b951418178b989eb194ed625

Reviewed-on: https://asterix-gerrit.ics.uci.edu/330

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

NKC fix for int64

Change-Id: I60b3ec3f15921093b1fa11ac9fc157b7930f4e4d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/329

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Added the UUID constructor and changed the relevant documentation

Change-Id: I2276bf2b44975b13c99d56f448ae3e9e4a74b04e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/326

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -10
    • +10
    /asterix-app/data/pub-small/dblp-small-id-autogenerated-pk_including_uuid.adm
  1. … 19 more files in changeset.
Introducing data replication API to LSM indexes

Change-Id: I80565fc9d74e30440d2df5917911904ba8f33c25

Reviewed-on: https://asterix-gerrit.ics.uci.edu/322

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 25 more files in changeset.
This change includes the following: 1. allowing short-circuit reads to be used with external data. 2. enhancing behaviour of index access for Text data. 3. updating the external data documentation.

Rebased on current Master.

The following commits from your working branch will be included:

commit 3176d741b8ef187703c7346044c9531a99f2b716

Author: Abdullah Alamoudi <bamousaa@gmail.com>

Date: Wed Feb 4 18:32:24 2015 +0300

added changes from external experiments and reflected external data documentation to include external data indexing

Change-Id: I041c71391d8704cd800c4446a085beef197e7acf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/218

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Raman Grover <ramangrover29@gmail.com>

    • -51
    • +164
    /asterix-doc/src/site/markdown/aql/externaldata.md
Add record type and primary key in the response of connector servlet api.

Change-Id: Ieefe79557cfb3786a6b22371a2e64ac4161ff900

Reviewed-on: https://asterix-gerrit.ics.uci.edu/315

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

New feed fixes: Updated the ExternalFunctionProvider to improve handling "setResult"

Change-Id: I7c026e2f3b927bda2628835c15318d6c96f8b043

Reviewed-on: https://asterix-gerrit.ics.uci.edu/321

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reconcile ASF and Gerrit master branches

Both parents of this merge commit are the same content-wise, excepting the commit message.

We have to make this commit to get both repositories back to a common version of master.

Adding introspection for getting record details.

Change-Id: Iba15acff0f6830cffbc33d9dac3b5f0c417be844

    • -0
    • +4
    /asterix-app/data/classifications/animals.adm
  1. … 182 more files in changeset.
Adding introspection for getting record details.

Change-Id: Iba15acff0f6830cffbc33d9dac3b5f0c417be844

Reviewed-on: https://asterix-gerrit.ics.uci.edu/313

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

  1. … 182 more files in changeset.
Temporarily disable flaky Feeds tests.

Change-Id: I9ddd27484b0b26b79954c17ccabd571d2791ee0e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/312

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

Change Java package from edu.uci.ics to org.apache

Change-Id: I99172d856e88954b00cf7cfb24d33bb400f53994

Reviewed-on: https://asterix-gerrit.ics.uci.edu/308

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -3
    • +3
    /algebricks/algebricks-compiler/pom.xml
  1. … 2019 more files in changeset.
Fix for metadata indexes first LSN

Change-Id: I6ce08ee38e49e0f0f0c2acd27b64415d771bda67

Reviewed-on: https://asterix-gerrit.ics.uci.edu/293

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Add Apache RAT License Auditor plugin, and fix missing licenses

Change-Id: Ic0fa0b7836e8a69d0d8beed83f9c3b41c168afd4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/263

Reviewed-by: Chris Hillery <ceej@lambda.nu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 1530 more files in changeset.
Add Apache RAT License Auditor plugin, and fix missing licenses

Change-Id: I39d92ec6654c73b4e6b8ba76dd66770bb60c7b79

Reviewed-on: https://asterix-gerrit.ics.uci.edu/260

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 18 more files in changeset.
YARN integration for AsterixDB

This is an initial version of YARN integration for AsterixDB.

- Uses static assignment of CC and NC nodes to NM locations

- Stores state locally on each NM, outside of HDFS

- "All or nothing" container allocation. We don't attempt to

move or rellocate containers the RM may kill (yet).

- Retains feature parity with managix.

Change-Id: I49c849179d17fc7faa446b9be57a0695df6836ab

Reviewed-on: https://asterix-gerrit.ics.uci.edu/161

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -0
    • +103
    /asterix-common/src/main/resources/schema/yarn_cluster.xsd
    • -0
    • +236
    /asterix-doc/src/site/markdown/yarn.md
    • binary
    /asterix-doc/src/site/resources/images/asterix_webui.png
    • binary
    /asterix-doc/src/site/resources/images/running_inst.png
    • binary
    /asterix-doc/src/site/resources/images/yarn_clust.png
    • -0
    • +241
    /asterix-yarn/pom.xml
    • -0
    • +101
    /asterix-yarn/src/main/assembly/binary-assembly.xml
  1. … 51 more files in changeset.
Introduces Feeds 2.0

commit c3f577861fc705d848c1641605689cadd6973bae

Merge: ebc4cae fc0c2c0

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Fri Jun 26 13:04:05 2015 -0700

Merge branch 'raman/feeds_2_release' of https://code.google.com/p/asterixdb-sandbox into raman/feeds_2_release

Conflicts:

asterix-app/src/main/java/edu/uci/ics/asterix/api/http/servlet/FeedServlet.java

asterix-external-data/src/main/java/edu/uci/ics/asterix/external/library/java/JObjectAccessors.java

commit ebc4cae21a7302869f953df1ebda601e798d12d2

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:14:45 2015 -0700

Introduces Feeds 2.0

Some of the prominent chnages introduced are as follows

a) Support for building a cascade network of feeds (via secondary feeds feature)

b) Feed Management Console for tracking active feeds and associated metrics

c) Support for elastic runtime for data ingestion

d) Improved fault-tolerance with support for logging of failed records

Documentation has been added at asterix-doc/src/site/markdown/feeds/

commit fc0c2c0549a6ee8b202e57607d2e110478cd57bb

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:14:45 2015 -0700

Introduces Feeds 2.0

Some of the prominent chnages introduced are as follows

a) Support for building a cascade network of feeds (via secondary feeds feature)

b) Feed Management Console for tracking active feeds and associated metrics

c) Support for elastic runtime for data ingestion

d) Improved fault-tolerance with support for logging of failed records

Documentation has been added at asterix-doc/src/site/markdown/feeds/

Change-Id: I498f01c591a229aaf51cec43ab20f3e5c4f072f4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/297

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -0
    • +12
    /asterix-app/data/twitter/obamatweets_duplicate.adm
  1. … 369 more files in changeset.
Changes to support Feeds 2.0 (random partitioning of tuples)

commit 8b5c352d831aa0d7e006457f0b1430ac12b54731

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:16:11 2015 -0700

Changes to support Feeds 2.0 (random partitioning of tuples)

Change-Id: I712c1f019cbc43f66d50620772c3df03c5944394

Reviewed-on: https://asterix-gerrit.ics.uci.edu/296

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

Make managix scripts properly executable

Most of the scripts managix was using were missing the shebang at the beginning of the script.

This can be problematic if one uses a shell besides bash. This patch fixes that.

Change-Id: Ie7722f832d0d25bec049e123a0ed1570d0aeb650

Reviewed-on: https://asterix-gerrit.ics.uci.edu/286

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Raman Grover <ramangrover29@gmail.com>

  1. … 6 more files in changeset.
Remove erroneous casts of list item offsets

The offset of an item in a list is read and written as an int,

but for some reason we were casting it down to a short when

recording the offsets during list building.

Change-Id: Ic058aa219e016d5efd719ddec0d1bb90a23e0c48

Reviewed-on: https://asterix-gerrit.ics.uci.edu/292

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

Fix for issue 872

Change-Id: If8cf621b8b89302cb28bd34f63e23f9c5f684351

Reviewed-on: https://asterix-gerrit.ics.uci.edu/290

Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Add a JSON rest-api for external connector that uses existing AsterixDB datasets.

Change-Id: I674110b26262fbbd93030b252113e153ff4580ef

Reviewed-on: https://asterix-gerrit.ics.uci.edu/288

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

VariableSizeFrame(VSizeFrame) support for Hyracks.

This patch replaced Frame/Accessor/Appender with the new API which

supports BigObject.

The ExternalSorter/TopKSorter/ExternalGroupSorter

have been implemented to support big object.

The Groupby && Join should work with BigObject also. But it will break the

memory budget when it encounter a big object. I will fix the memory

problem later in a separate CR.

The design about the frame allocation is

here:https://docs.google.com/presentation/d/15h9iQf5OYsgGZoQTbGHkj1yS2G9q2fd0s1lDAD1EJq0/edit?usp=sharing

Suggest review order:

Patch 12: It includes all of the sorting operators.

Patch 13: It applys the new IFrame API to all Hyracks codes.

Patch 14: Some bug fixes to pass all Asterix's tests.

Patch 15: Skip it!

Patch 16: Some bug fixes to the Asterix's tests in small frame setting.

Later Patch: address the comments

Change-Id: I2e08692078683f6f2cf17387e39037ad851fc05b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/234

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 205 more files in changeset.
VariableSizeFrame(VSizeFrame) support for Asterix (Runtime Only)

Apply the https://asterix-gerrit.ics.uci.edu/#/c/234/ API changes to

Asterix level.

Change-Id: I5459e877707a1494fc1bebf03d4457a7427e9e0f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/259

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -0
    • +150
    /asterix-app/data/big-object/customer.tbl.big
    • -0
    • +6005
    /asterix-app/data/big-object/lineitem.tbl.big
    • -0
    • +1500
    /asterix-app/data/big-object/order.tbl.big
    • -0
    • +23
    /asterix-app/src/test/resources/runtimets/only.xml
  1. … 29 more files in changeset.
AsterixDB changes for fixing issue873.

For example, in the following query plan, the change lets the optimizer recognize that $12 and $20 are equivalent.

Therefore, HASH_PARTITION_EXCHANGE [$$12] can be replaced by ONE_TO_ONE_EXCHANGE.

-- COMMIT |PARTITIONED|

project ([$$12])

-- STREAM_PROJECT |PARTITIONED|

exchange

-- ONE_TO_ONE_EXCHANGE |PARTITIONED|

delete from TinySocial:TweetMessages from %0->$$4 partitioned by [%0->$$12]

-- INSERT_DELETE |PARTITIONED|

exchange

-- ONE_TO_ONE_EXCHANGE |PARTITIONED|

materialize

-- MATERIALIZE |PARTITIONED|

exchange

-- HASH_PARTITION_EXCHANGE [$$12] |PARTITIONED|

assign [$$12] <- [function-call: asterix:field-access-by-index, Args:[%0->$$4, AInt32: {0}]]

-- ASSIGN |PARTITIONED|

project ([$$4])

-- STREAM_PROJECT |PARTITIONED|

assign [$$4] <- [function-call: asterix:open-record-constructor, Args:[AString: {tweetid}, %0->$$14, AString: {user}, function-call: asterix:field-access-by-index, Args:[%0->$$0, AInt32: {1}], AString: {sender-location}, function-call: asterix:field-access-by-index, Args:[%0->$$0, AInt32: {2}], AString: {send-time}, function-call: asterix:field-access-by-index, Args:[%0->$$0, AInt32: {3}], AString: {referred-topics}, function-call: asterix:field-access-by-index, Args:[%0->$$0, AInt32: {4}], AString: {message-text}, function-call: asterix:field-access-by-index, Args:[%0->$$0, AInt32: {5}]]]

-- ASSIGN |PARTITIONED|

exchange

-- ONE_TO_ONE_EXCHANGE |PARTITIONED|

unnest-map [$$14, $$0] <- function-call: asterix:index-search, Args:[AString: {TweetMessages}, AInt32: {0}, AString: {TinySocial}, AString: {TweetMessages}, ABoolean: {false}, ABoolean: {false}, ABoolean: {false}, AInt32: {1}, %0->$$20, AInt32: {1}, %0->$$21, TRUE, TRUE, TRUE]

-- BTREE_SEARCH |PARTITIONED|

exchange

-- ONE_TO_ONE_EXCHANGE |PARTITIONED|

assign [$$20, $$21] <- [AString: {15}, AString: {15}]

-- ASSIGN |PARTITIONED|

empty-tuple-source

-- EMPTY_TUPLE_SOURCE |PARTITIONED|

Change-Id: Ife8c378a62cdbbcd8c19b521de246162f1f3d6ec

Reviewed-on: https://asterix-gerrit.ics.uci.edu/267

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Wenhai Li <lwhaymail@yahoo.com>

Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com>

Algebricks fix for issue 873.

Change-Id: I78a4a30638d6cc5681b5410046fff6345b515291

Reviewed-on: https://asterix-gerrit.ics.uci.edu/266

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Wenhai Li <lwhaymail@yahoo.com>

Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com>

Fix the HashFunction Bug in OptimizedHybridHashJoinOperatorDescriptor

The following commits from your working branch will be included:

The HashFunction used for InMemoryHashJoin is not update with level when

the OptimizedHybridHashJoin switches to InMemoryHashJoin. As the result,

it becomes the NestedLoopJoin after the 2nd round.

This patch is a fix for it.

Change-Id: Id25c85b7fadbb6bb969d0d94a51c60ac2573938e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/285

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Pouria Pirzadeh <pouria.pirzadeh@gmail.com>

Fix issue 897 (Stale metadata breaks ADM/AQL 101)

This fixes the issue for me, but I think this really needs some careful consideration.

Identical issues could be lurking anywhere the passed object is modified and that info needs to be conveyed to the caller.

I feel like I should not have to read from MetadataNode directly to get this info.

Change-Id: I088d33ad7810d7e1ca5471202cf20fa9a651195c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/283

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com>

website fixes (moving to ASF resources)

- users mailing list

- location of website resources

- whitespace

Change-Id: I802dea3793aaa25887b3cc9be16a4d4be3c2c629

Reviewed-on: https://asterix-gerrit.ics.uci.edu/280

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -1
    • +1
    /asterix-doc/src/site/markdown/install.md
    • -1
    • +1
    /asterix-doc/src/site/markdown/overview.md
    • -0
    • +15
    /asterix-doc/src/site/resources/data/fbm.adm
    • -0
    • +10
    /asterix-doc/src/site/resources/data/fbu.adm
    • -0
    • +6005
    /asterix-doc/src/site/resources/data/lineitem.tbl
    • -0
    • +12
    /asterix-doc/src/site/resources/data/twm.adm
    • -0
    • +4
    /asterix-doc/src/site/resources/data/twu.adm
    • binary
    /asterix-doc/src/site/resources/images/AsterixCluster.png