asterixdb

Clone Tools
  • last updated 17 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Changes to fix issue 802 commit 2ddbfc584ec2869efb380d7f0e03f450f7f73c0a Author: Young-Seok <kisskys@gmail.com> Date: Thu Sep 25 10:10:10 2014 -0700

Change-Id: I1a36af2712e809588b9d579d81bfeda27eb2b5c2

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/141

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Changes to fix issue 802 commit fa829826d717123e415a994cc69e47c7ec1833f0 Author: Young-Seok <kisskys@gmail.com> Date: Thu Sep 25 10:09:20 2014 -0700

Change-Id: I8f6153e482e2079a0654263802ecd4c396291082

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/140

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Change default Hadoop version to 2.2.0

This change will make the default Hadoop version used throughought AsterixDB v. 2.2.0. It also introduces

dependencyManagement and parameters in the top-level POM (tlp) for easing the management of this dependency

and other dependencies that are similarly pervasive throughout the code, like commons-io and json.

Change-Id: I51e22edb56717d2100d646d5f41a769881c6c86b

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/125

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 3 more files in changeset.
Change default Hadoop version to 2.2.0

This change moves the default version of Hadoop to 2.2.0, as well as introducing some dependencyManagement and

property tags to ease management of this and other similar dependencies. Additionally, in this change Hivesterix

and Pregelix are no longer built by default (as part of moving their codebases to separate repositories).

Change-Id: I7609f192cbb246fdec2d0f301130c389688047a9

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/124

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

    • -2
    • +8
    /hyracks/hyracks-dataflow-hadoop/pom.xml
    • -2
    • +1
    /hyracks/hyracks-hadoop-compat/pom.xml
  1. … 18 more files in changeset.
Change Hyracks+Algebricks dependency to next version

Change-Id: I600cc2bcd46650ccbe118626b58567b9ccf844c1

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/139

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

[maven-release-plugin] prepare for next development iteration

    • -3
    • +3
    /algebricks/algebricks-compiler/pom.xml
    • -1
    • +1
    /algebricks/algebricks-examples/pom.xml
    • -2
    • +2
    /algebricks/algebricks-rewriter/pom.xml
    • -6
    • +6
    /algebricks/algebricks-runtime/pom.xml
    • -3
    • +3
    /hivesterix/hivesterix-optimizer/pom.xml
    • -6
    • +6
    /hivesterix/hivesterix-runtime/pom.xml
  1. … 75 more files in changeset.
[maven-release-plugin] prepare release fullstack-0.2.13

    • -3
    • +3
    /algebricks/algebricks-compiler/pom.xml
    • -1
    • +1
    /algebricks/algebricks-examples/pom.xml
    • -2
    • +2
    /algebricks/algebricks-rewriter/pom.xml
    • -6
    • +6
    /algebricks/algebricks-runtime/pom.xml
    • -3
    • +3
    /hivesterix/hivesterix-optimizer/pom.xml
    • -6
    • +6
    /hivesterix/hivesterix-runtime/pom.xml
  1. … 75 more files in changeset.
Fixed CSV parser to recognize quote and delimiter inside a string

Change-Id: Iaaabc23e86df4f9bbee9f06b7976d7fbdcbb0f3f

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/135

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

    • -0
    • +4
    /asterix-app/data/csv/sample_02.csv
    • -0
    • +5
    /asterix-app/data/csv/sample_03.csv
    • -0
    • +5
    /asterix-app/data/csv/sample_04_quote_error.csv
    • -0
    • +5
    /asterix-app/data/csv/sample_05_space_error_1.csv
    • -0
    • +5
    /asterix-app/data/csv/sample_06_space_error_2.csv
  1. … 61 more files in changeset.
Fixed CSV parser to recognize quote and delimiter inside a string.

Change-Id: Iac102286ff90d2b4cc54b1183fa024dec006c3b3

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/134

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

Implement TokenizeOperator in addition to the changes made by Zachary Heilbron. Now, the compiler builds the bulk-load plan. For other details, please refer to the corresponding Hyracks changes.

Change-Id: I646539d88ea2bdc6da4fbf2b6e9460a6189125ff

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/79

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

    • -0
    • +10
    /asterix-app/data/pub-small/dblp-small-id-autogenerated-pk.adm
    • -0
    • +20
    /asterix-app/data/pub-small/dblp-small-id-autogenerated-pk.csv
    • -0
    • +20
    /asterix-app/data/pub-small/dblp-small-id-autogenerated-pk.txt
    • -0
    • +10
    /asterix-app/data/pub-small/dblp-small-id-autogenerated-pk_including_uuid.adm
    • -0
    • +20
    /asterix-app/data/pub-small/dblp-small-id-autogenerated-pk_including_uuid.csv
  1. … 102 more files in changeset.
- Added Tokenize Operator in addition to the bulkload operator changes that were made by Zachary Heilbron. The tokenize operator is only added to the logical plan when bulk-loading the data. - Each secondary index is now updated in the separate branch by using the replicate operator. - Sink Operator now accepts multiple inputs. - Fixed the bulk-load so that it correctly produces auto-generated PK.

Change-Id: Ifb591754dba5eb4a9207edaa4e658f4cc745893a

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/78

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 40 more files in changeset.
Fix for issue 795

In some cases the time zone array can be sorted in a different order than it is assumed to be. This patch ensures it

sorted in the order that binary search expects.

Change-Id: I9ea38559f3f3a2c771aea69d02ab04d0af552c5c

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/127

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

Fixed framesize resetting issue during bulk-loading - issue 800 -> https://code.google.com/p/asterixdb/issues/detail?id=800 - added an user-friendly exception message

commit 8cc94c2de864b6f2ab2b0cf237b0d942841959c6

Author: Young-Seok <kisskys@gmail.com>

Date: Mon Aug 25 14:13:43 2014 -0700

Change-Id: I2dd9d67fdc150ae8af655baa741d8d3c711b5ca0

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/130

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

763: Omit wrapper "results" JSON object in HTTP API output for JSON results; Wrap JSON output in outer [array]; consolidate output logic into ResultUtils; use UTF-8 explicitly when converting byte[] from Hyracks to Strings

Change-Id: Idbeac3ebbf397b0ef73cc54b7d901a21ac855932

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/123

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Keren-Audrey Ouaknine <kereno@gmail.com>

New test cases for the new replicate operator

- added new execution and optimizer tests for replicate operator

- fixed optimizer test plans after reducing live variables for unnestmap operator

Change-Id: If1341cc712542b0023cebb17bd0d16ee345b359d

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/88

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 55 more files in changeset.
Added replicate operator with materialization

be more aggressive to find shared plans in ExtractCommonOperatorRule

- find all the isomorphic subgraphs instead of just the ones on join build branches

- while expanding candidates handle the operators with multiple inputs

- analyze the DAG to find all the operators that can be co-scheduled, and infer the dependencies between clusters

- based on the dependencies, decide which outputs of a replicate operator needs materialization

- if the shared branch needs materialization, and it consists of only trivial operators (such as assign, unnest, datasource scan), that branch is discarded from the candidates

- modified the replicate operator descriptor to materialize the input if needed, and read from the materialized file for the outputs that requires materialization

- removed redundant decor variables in group-by

- fixed a bug on computing live variables for unnest-map operator: if the operator does not propagate inputs, those input variables should not be live anymore

- fixed a bug in ComplexUnnestToProductRule

Change-Id: If221d1507844f9409bf1163f93b0c04ef5848578

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/86

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 30 more files in changeset.
Select access method Rule fixed. Now, when the optimizer converts a select operator pattern to an index-search, it tries to match the selected access method type and the chosen index type (e.g. BTreeAccessMethod to a BTree index)

Change-Id: I2915f18045002859e167b0c8310d62b677cfca08

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/119

Reviewed-by: Inci Cetindil <icetindil@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

support for JSON escapes in ADM and AQL parser fix https://code.google.com/p/asterixdb/issues/detail?id=752 fix https://code.google.com/p/asterixdb/issues/detail?id=753 introduce PrintTools.writeUTF8StringWithEscapes to replace Hyracks' WriteValueTools.writeUTF8String as this serialization is ADM-specific new method AQLParser.parse for better exception handling more robust extraction of line numbers from error messages

Change-Id: I2e9bea7658d00032a3ac7a1d107eba8f17423eeb

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/75

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -0
    • +5
    /asterix-app/data/escapes01.adm
    • -0
    • +14
    /asterix-app/data/escapes02.adm
  1. … 20 more files in changeset.
fix build warnings

Change-Id: I713a5f117dc660550684338f162582089a5d3403

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/118

Reviewed-by: Inci Cetindil <icetindil@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

cleanup

- refactor getNumberOfIODevices

- remove unused inner class AsterixCluster

- replace NPE with an IllegalStateException with a message

- cleaner log message

Change-Id: Iecad33440bb154b7e438f49755a1d8a2b0c8d677

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/117

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

remove old AQL client

fixes issue 564

Change-Id: If070721a93566777c04acfbf60c6381f19ca131c

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/116

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Pouria Pirzadeh <pouria.pirzadeh@gmail.com>

Fixed a bug when creating an MBR over a circle.

Change-Id: Iff883cbcbcfa759e2dc046fec6d1dbb256649500

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/113

Reviewed-by: Pouria Pirzadeh <pouria.pirzadeh@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Changes to fix issue793

Change-Id: I54281f8cccd2e9322c4a8f93a9aca573aea2c552

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/111

Reviewed-by: Till Westmann <westmann@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

apply code conventions to files containing tabs

Change-Id: I429b02253a5008c50540a79075c257d01bc39a99

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/112

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Fix for Hyracks interface change due to Virtual Pages

Change-Id: Iedf7b1f27e3539563729e76e531bf10ecd5f6143

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/110

Reviewed-by: Sattam Alsubaiee <salsubaiee@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Added a new merge policy, called correlated-prefix.

Change-Id: I8f961eb28b4ea460f6326c8b4acaea02b50819e9

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/108

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 15 more files in changeset.
Changes to allow having the no-merge policy as an option in asterix.

Change-Id: I573b6a09185d51df1ec115edc38a89bd029574d5

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/107

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 7 more files in changeset.
uppercase() function is implemented. - documentation added.

Change-Id: I88f5404009564fb6be00a784484b43e8abd41664

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/109

Reviewed-by: Inci Cetindil <icetindil@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Adding plot of Algebricks plan

Change-Id: I917d92b1ca6f0161d67fbddd0182d5062939b558

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/106

Reviewed-by: Inci Cetindil <icetindil@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Adding plot of Algebricks plan

Change-Id: I0cd40886139dd2ef2731a7e7e965f5b7520faa01

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/105

Reviewed-by: Inci Cetindil <icetindil@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>