asterixdb

Clone Tools
  • last updated 21 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Move Pregelix and Hivesterix codebase to new repositories: 1. Move Pregelix codebase to https://github.com/pregelix/pregelix; 2. Move Hivesterix codebase to https://code.google.com/p/hivesterix .

Change-Id: Iede698fcb92a0ad0a7a4918ea69b54886fd64fc7

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/155

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

    • -293
    • +0
    /hivesterix/HyracksCodeFormatProfile.xml
    • -92
    • +0
    /hivesterix/hivesterix-common/pom.xml
  1. … 943 more files in changeset.
Fix issue785 -- using the algebricks fixes for subplans. Fix RemoveRedundantListifyRule -- listify/scan-collection pair within a nested plan can be removed. Fix issue550. Add a regression test for issue638.

Change-Id: Id56539cd5ab7ed0cc05897b468c26aec169102fd

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/150

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Preston Carman <ecarm002@ucr.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 7 more files in changeset.
Issue 705: Installation documentation

Fix errors in installer.md. Reorganize and expand installer.md

slightly. Add check for txn_log_dir to 'managix validate -c'.

Change-Id: Ib3396425c372c4970b86a792678e26f2e37b3630

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/154

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

    • -74
    • +92
    /asterix-doc/src/site/markdown/install.md
This change enable prefix search on Btrees

The following commits from your working branch will be included:

commit 0a1299c3d72b56a0045385cb9476ab99b1fbd7f6

Author: Abdullah Alamoudi <bamousaa@Abdullahs-MacBook-Pro.local>

Date: Thu Oct 23 13:49:34 2014 +0300

Enabled prefix search

Change-Id: Iebefb7c40d6eb7b55d023caaa148cc8512bd6e9e

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/126

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

  1. … 8 more files in changeset.
This change list includes several fixes: 1. Adds a rule to push subplan into group-by 2. Adds a rule to eliminate subplan with input cardinality one 3. Fix the nested running aggregate runtime 4. Adds a wrapper of FrameTupleAppender to internally flush full frames. A TODO item is to cleanup existing usage of FrameTupleAppender to use the wrapper, which makes code simpler.

Change-Id: I647f9bce2f40700b18bdcad1fa64fb8f0a26838b

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/149

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Preston Carman <ecarm002@ucr.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

remove unused parameters and return values

Change-Id: Ibc2cf3d0d1c96abe7de7c0b5bc4262272e52d365

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/132

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Fix the data property inference: 1. Fix order property,a LocalOrderProperty stores an array of OrderColumns instead of one OrderColumn. A delivered order property D satisfies a required order property R if R's sorting columns are a prefix of D's sorting columns. 2. Fix partition proerty inference, a delivered partition property D satisfies a required partition property R if D's partitioning columns are a prefix of R's partitioning columns. 3. Fix the data property progatation, e.g., what data properties are left after passing through a project operator. 4. Fix the data property within a group. For example, order property ($1 ASC, $2 ASC) is delivered to a group-by operator with $1 as the group key, within a particular group, ($2 ASC) is a valid data property.

Change-Id: If812fe7dca9c1714780734af425a1bb363db125f

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/144

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Fix issue 786, issue 601, the prefix search issue reported by Abdullah, and the workaround query for issue 785.

Change-Id: I8bc4f18cd34c3d581f99f1509a4531c093aeec31

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/145

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 8 more files in changeset.
Issue 804: Spell "Adapter" consistently

Change-Id: I3141c1ddd2357ba8dd8ad94d6b98abc78151cd72

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/148

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

  1. … 25 more files in changeset.
Changes to fix issue 803

commit cebd62530711b56f7f4449ed6a98c1e743a07eee

Author: Young-Seok <kisskys@gmail.com>

Date: Mon Sep 29 17:04:02 2014 -0700

Change-Id: I149376a2555612461e0ca27670c904d1c6816cda

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/143

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Changes to fix issue 803

commit b19cde423b858bf4964cba3c8b76b17a1d6b0300

Author: Young-Seok <kisskys@gmail.com>

Date: Mon Sep 29 17:03:20 2014 -0700

Change-Id: Icbb1b71bfa263e67ad52cf61e831c614c630ea4b

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/142

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Initial support for true ADM output (content type application/x-adm).

Elimiate the JSON "results" wrapper from API calls. Rename

DisplayFormat -> OutputFormat, TEXT -> ADM. Cleaned up some output and

added some useful comments. Fixed a few latent bugs in testdriver string

comparison routines. Refactored HTTP error handling in TestsUtils. Had

to update many expected test results.

Change-Id: I2d7ead038512455b2ab7844021cb62222400447b

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/137

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 1076 more files in changeset.
Changes to fix issue 802 commit 2ddbfc584ec2869efb380d7f0e03f450f7f73c0a Author: Young-Seok <kisskys@gmail.com> Date: Thu Sep 25 10:10:10 2014 -0700

Change-Id: I1a36af2712e809588b9d579d81bfeda27eb2b5c2

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/141

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Changes to fix issue 802 commit fa829826d717123e415a994cc69e47c7ec1833f0 Author: Young-Seok <kisskys@gmail.com> Date: Thu Sep 25 10:09:20 2014 -0700

Change-Id: I8f6153e482e2079a0654263802ecd4c396291082

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/140

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Change default Hadoop version to 2.2.0

This change will make the default Hadoop version used throughought AsterixDB v. 2.2.0. It also introduces

dependencyManagement and parameters in the top-level POM (tlp) for easing the management of this dependency

and other dependencies that are similarly pervasive throughout the code, like commons-io and json.

Change-Id: I51e22edb56717d2100d646d5f41a769881c6c86b

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/125

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 3 more files in changeset.
Change default Hadoop version to 2.2.0

This change moves the default version of Hadoop to 2.2.0, as well as introducing some dependencyManagement and

property tags to ease management of this and other similar dependencies. Additionally, in this change Hivesterix

and Pregelix are no longer built by default (as part of moving their codebases to separate repositories).

Change-Id: I7609f192cbb246fdec2d0f301130c389688047a9

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/124

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

    • -2
    • +8
    /hyracks/hyracks-dataflow-hadoop/pom.xml
    • -2
    • +1
    /hyracks/hyracks-hadoop-compat/pom.xml
  1. … 18 more files in changeset.
Change Hyracks+Algebricks dependency to next version

Change-Id: I600cc2bcd46650ccbe118626b58567b9ccf844c1

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/139

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

[maven-release-plugin] prepare for next development iteration

    • -3
    • +3
    /algebricks/algebricks-compiler/pom.xml
    • -1
    • +1
    /algebricks/algebricks-examples/pom.xml
    • -2
    • +2
    /algebricks/algebricks-rewriter/pom.xml
    • -6
    • +6
    /algebricks/algebricks-runtime/pom.xml
    • -3
    • +3
    /hivesterix/hivesterix-optimizer/pom.xml
    • -6
    • +6
    /hivesterix/hivesterix-runtime/pom.xml
  1. … 75 more files in changeset.
[maven-release-plugin] prepare release fullstack-0.2.13

    • -3
    • +3
    /algebricks/algebricks-compiler/pom.xml
    • -1
    • +1
    /algebricks/algebricks-examples/pom.xml
    • -2
    • +2
    /algebricks/algebricks-rewriter/pom.xml
    • -6
    • +6
    /algebricks/algebricks-runtime/pom.xml
    • -3
    • +3
    /hivesterix/hivesterix-optimizer/pom.xml
    • -6
    • +6
    /hivesterix/hivesterix-runtime/pom.xml
  1. … 75 more files in changeset.
Fixed CSV parser to recognize quote and delimiter inside a string

Change-Id: Iaaabc23e86df4f9bbee9f06b7976d7fbdcbb0f3f

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/135

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

    • -0
    • +4
    /asterix-app/data/csv/sample_02.csv
    • -0
    • +5
    /asterix-app/data/csv/sample_03.csv
    • -0
    • +5
    /asterix-app/data/csv/sample_04_quote_error.csv
    • -0
    • +5
    /asterix-app/data/csv/sample_05_space_error_1.csv
    • -0
    • +5
    /asterix-app/data/csv/sample_06_space_error_2.csv
  1. … 61 more files in changeset.
Fixed CSV parser to recognize quote and delimiter inside a string.

Change-Id: Iac102286ff90d2b4cc54b1183fa024dec006c3b3

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/134

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

Implement TokenizeOperator in addition to the changes made by Zachary Heilbron. Now, the compiler builds the bulk-load plan. For other details, please refer to the corresponding Hyracks changes.

Change-Id: I646539d88ea2bdc6da4fbf2b6e9460a6189125ff

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/79

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

    • -0
    • +10
    /asterix-app/data/pub-small/dblp-small-id-autogenerated-pk.adm
    • -0
    • +20
    /asterix-app/data/pub-small/dblp-small-id-autogenerated-pk.csv
    • -0
    • +20
    /asterix-app/data/pub-small/dblp-small-id-autogenerated-pk.txt
    • -0
    • +10
    /asterix-app/data/pub-small/dblp-small-id-autogenerated-pk_including_uuid.adm
    • -0
    • +20
    /asterix-app/data/pub-small/dblp-small-id-autogenerated-pk_including_uuid.csv
  1. … 102 more files in changeset.
- Added Tokenize Operator in addition to the bulkload operator changes that were made by Zachary Heilbron. The tokenize operator is only added to the logical plan when bulk-loading the data. - Each secondary index is now updated in the separate branch by using the replicate operator. - Sink Operator now accepts multiple inputs. - Fixed the bulk-load so that it correctly produces auto-generated PK.

Change-Id: Ifb591754dba5eb4a9207edaa4e658f4cc745893a

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/78

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 40 more files in changeset.
Fix for issue 795

In some cases the time zone array can be sorted in a different order than it is assumed to be. This patch ensures it

sorted in the order that binary search expects.

Change-Id: I9ea38559f3f3a2c771aea69d02ab04d0af552c5c

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/127

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

Fixed framesize resetting issue during bulk-loading - issue 800 -> https://code.google.com/p/asterixdb/issues/detail?id=800 - added an user-friendly exception message

commit 8cc94c2de864b6f2ab2b0cf237b0d942841959c6

Author: Young-Seok <kisskys@gmail.com>

Date: Mon Aug 25 14:13:43 2014 -0700

Change-Id: I2dd9d67fdc150ae8af655baa741d8d3c711b5ca0

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/130

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

763: Omit wrapper "results" JSON object in HTTP API output for JSON results; Wrap JSON output in outer [array]; consolidate output logic into ResultUtils; use UTF-8 explicitly when converting byte[] from Hyracks to Strings

Change-Id: Idbeac3ebbf397b0ef73cc54b7d901a21ac855932

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/123

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Keren-Audrey Ouaknine <kereno@gmail.com>

New test cases for the new replicate operator

- added new execution and optimizer tests for replicate operator

- fixed optimizer test plans after reducing live variables for unnestmap operator

Change-Id: If1341cc712542b0023cebb17bd0d16ee345b359d

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/88

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 55 more files in changeset.
Added replicate operator with materialization

be more aggressive to find shared plans in ExtractCommonOperatorRule

- find all the isomorphic subgraphs instead of just the ones on join build branches

- while expanding candidates handle the operators with multiple inputs

- analyze the DAG to find all the operators that can be co-scheduled, and infer the dependencies between clusters

- based on the dependencies, decide which outputs of a replicate operator needs materialization

- if the shared branch needs materialization, and it consists of only trivial operators (such as assign, unnest, datasource scan), that branch is discarded from the candidates

- modified the replicate operator descriptor to materialize the input if needed, and read from the materialized file for the outputs that requires materialization

- removed redundant decor variables in group-by

- fixed a bug on computing live variables for unnest-map operator: if the operator does not propagate inputs, those input variables should not be live anymore

- fixed a bug in ComplexUnnestToProductRule

Change-Id: If221d1507844f9409bf1163f93b0c04ef5848578

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/86

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 30 more files in changeset.
Select access method Rule fixed. Now, when the optimizer converts a select operator pattern to an index-search, it tries to match the selected access method type and the chosen index type (e.g. BTreeAccessMethod to a BTree index)

Change-Id: I2915f18045002859e167b0c8310d62b677cfca08

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/119

Reviewed-by: Inci Cetindil <icetindil@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

support for JSON escapes in ADM and AQL parser fix https://code.google.com/p/asterixdb/issues/detail?id=752 fix https://code.google.com/p/asterixdb/issues/detail?id=753 introduce PrintTools.writeUTF8StringWithEscapes to replace Hyracks' WriteValueTools.writeUTF8String as this serialization is ADM-specific new method AQLParser.parse for better exception handling more robust extraction of line numbers from error messages

Change-Id: I2e9bea7658d00032a3ac7a1d107eba8f17423eeb

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/75

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -0
    • +5
    /asterix-app/data/escapes01.adm
    • -0
    • +14
    /asterix-app/data/escapes02.adm
  1. … 20 more files in changeset.