Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Implementation of Union Change-Id: I9049c89f7e3cd84cab1b4080af049f6042be9fb1 Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/236 Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com> Reviewed-by: Preston Carman <ecarm002@ucr.edu>

  1. … 7 more files in changeset.
Added support of typed indexes over open fields & indexes over nested fields

Open indexes requires user to provide a type along with a indexed field name.

This type would be enforced for all the indexed records, i.e. index cannot be created if in some records a field with provided name has a different type.

Index-specific rewrite rules match provided type with the inferred types of other arguments in join\select statements and trigger index rewrite.

Nested indexes use the same semantics as the regular indexes, with exception that field could be located arbitrarily deep inside nested structure

Change-Id: I53d00aba243ccf7cf79cf7d775dd305813d24f98

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/97

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

  1. … 1777 more files in changeset.
This change covers three points: 1. move the generation of UUIDs out of parsers 2. fixes a bug in the metadata lock when performing load operations 3. the external data scan operator is again a leaf operator 4. made sure the startup call doesn't return until the servers are ready to receive requests Merged master into branch for the second time.

The following commits from your working branch will be included:

commit da929c990249fe7f0699417fd7f7ea34908355af

Author: Abdullah Alamoudi <bamousaa@gmail.com>

Date: Fri Jan 16 11:51:14 2015 +0300

Moved generation of UUIDs out of parsers

Change-Id: I32437493cf48c79417f4280e9d8a85cfb1559b62

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/205

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

  1. … 57 more files in changeset.
- Fixed Type Casting issue - Reorganized duplicated internal class in the DelimitedDataParser and DelimitedDataParserFactory - Prevented a user from creating an inverted index on a dataset with a variable-length PK - INT64 is now the default type - Issue 852 fixed

Change-Id: I2d71e8a21da4f709c3259a3d3f678c640f9e1160

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/192

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 833 more files in changeset.
Fix issue849.

Change-Id: I4d2933c94c4139a6c8e2cf15e3cd1f6a52335f6b

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/217

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

  1. … 14 more files in changeset.
Fix for issues 838, 841, 527

These fixes help to recognize and rewrite plans that should use index lookups rather than nested loops or outer joins

Change-Id: Icad72c10e7c6afbc46cfb014c6198429d4e338e2

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/215

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 2 more files in changeset.
Tracks the variables coming from the outer branch of loj to later decide whether they are still nullable

Change-Id: I65ef3ec64e231d4ee4b9cb18ac3292f126ee16f8

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/209

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 1 more file in changeset.
Fix issue 562.

Change-Id: If5829d66910294ef5c764c6cba8743effda68b28

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/203

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Pouria Pirzadeh <pouria.pirzadeh@gmail.com>

  1. … 9 more files in changeset.
Issue 548: Doc for CSV

Change-Id: Ia343a7a795876835607be024bb7b8ad3fec33933

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/194

Reviewed-by: Till Westmann <westmann@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 5 more files in changeset.
Fix for issue832 The rewrite rule was previously assuming that the first argument to the function is the one that we are searching the index on. This is not nessassarily the case I changed it to search for the appropriate argument

Change-Id: I68ab853cc74e930605a9a7037be1036f052236b8

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/195

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Issue 548: Initial implementation of CSV output method.

Can be selected via the HTTP interface by setting the Accept: header to

text/csv.

Displays strings, numerics, booleans, and a couple duration types. Detects

situations that cannot be respresented as CSV (list values, nested records)

and throws an exception.

Introduces "outputRecordType" set option to define a fixed RecordType that

all results will be coerced to, to ensure consistent CSV output.

Added test support for CSV output, with one test case for now.

Change-Id: Ib53da6b3c69e38095bdc684b0e8cd53b9f4b1543

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/165

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 71 more files in changeset.
Fix issue827

Change-Id: If21e2a4efc69e46ee452353fc06507b3f890db0d

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/189

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Preston Carman <ecarm002@ucr.edu>

  1. … 11 more files in changeset.
Added flush logs and enabled non-sharp checkpoints

The following commits from your working branch will be included:

commit c11a22cfd916041c806409c6d8e66dd6ea162b7b

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Tue Nov 18 23:12:19 2014 -0800

Defined Startup LSN

commit 95a8752072e53ef62a11c39799f296209a3c622c

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Tue Nov 18 20:22:08 2014 -0800

Revised Checkpoint Logic

commit ea4baa22089ba5d3eaff3d5c787828efcbff8ad9

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Thu Nov 13 10:25:45 2014 -0800

added comments

commit 8991554f840f50d800a619fc2ac327f1c024e838

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Wed Nov 12 23:34:25 2014 -0800

Added a method to the interface

commit a31e36b0b8234fe876b42e0cdc4543e4e73314a1

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Wed Nov 12 22:57:51 2014 -0800

Refactored getMinFirstLSN code

commit 25f62d585b2f279e78711efd2d327c777919f62c

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Tue Nov 11 14:05:34 2014 -0800

Added flush logs

Change-Id: I13fb61c04b6b510b6e8af68d2a0e7e14859f519d

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/182

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

  1. … 32 more files in changeset.
1. Fix for issue 810. 2. Add regression tests for issue 567 and 697.

Change-Id: I1eb4d7ca5d757f317efbe373ba502c6db61d93f4

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/179

Reviewed-by: Preston Carman <ecarm002@ucr.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 30 more files in changeset.
Moving materialize operator and nested subplan to join rule to Hyracks.

Change-Id: I5a18d30a9b097ec890c03a0c0f30ebecfae46b3e

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/169

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 1 more file in changeset.
Fix for issue 813 - enabling prefix btree search with non-matching predicates

Change-Id: I59eb43afa7dbcabd7f43269566d75c9361c55386

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/171

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 91 more files in changeset.
Fix for issue 715 - changed null value serialization policy in lists Fix for issue 760/756 - changed nullable fields type inference in listify Fix for issue 761 - changed type inference for records with multiple lists of non-primitive types

Change-Id: I700f0af27d8b9c2d8bf0c0a2906d2ffe4d0ee900

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/156

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Keren-Audrey Ouaknine <kereno@gmail.com>

  1. … 2 more files in changeset.
Fix issue785 -- using the algebricks fixes for subplans. Fix RemoveRedundantListifyRule -- listify/scan-collection pair within a nested plan can be removed. Fix issue550. Add a regression test for issue638.

Change-Id: Id56539cd5ab7ed0cc05897b468c26aec169102fd

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/150

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Preston Carman <ecarm002@ucr.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 18 more files in changeset.
This change enable prefix search on Btrees

The following commits from your working branch will be included:

commit 0a1299c3d72b56a0045385cb9476ab99b1fbd7f6

Author: Abdullah Alamoudi <bamousaa@Abdullahs-MacBook-Pro.local>

Date: Thu Oct 23 13:49:34 2014 +0300

Enabled prefix search

Change-Id: Iebefb7c40d6eb7b55d023caaa148cc8512bd6e9e

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/126

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

  1. … 20 more files in changeset.
Fix issue 786, issue 601, the prefix search issue reported by Abdullah, and the workaround query for issue 785.

Change-Id: I8bc4f18cd34c3d581f99f1509a4531c093aeec31

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/145

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 22 more files in changeset.
Implement TokenizeOperator in addition to the changes made by Zachary Heilbron. Now, the compiler builds the bulk-load plan. For other details, please refer to the corresponding Hyracks changes.

Change-Id: I646539d88ea2bdc6da4fbf2b6e9460a6189125ff

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/79

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

  1. … 109 more files in changeset.
New test cases for the new replicate operator

- added new execution and optimizer tests for replicate operator

- fixed optimizer test plans after reducing live variables for unnestmap operator

Change-Id: If1341cc712542b0023cebb17bd0d16ee345b359d

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/88

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 67 more files in changeset.
Select access method Rule fixed. Now, when the optimizer converts a select operator pattern to an index-search, it tries to match the selected access method type and the chosen index type (e.g. BTreeAccessMethod to a BTree index)

Change-Id: I2915f18045002859e167b0c8310d62b677cfca08

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/119

Reviewed-by: Inci Cetindil <icetindil@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 5 more files in changeset.
apply code conventions to files containing tabs

Change-Id: I429b02253a5008c50540a79075c257d01bc39a99

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/112

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

  1. … 13 more files in changeset.
remove global metadata lock

Change-Id: Id05ff463fee356b3270b53d0b3137c4b1bc3d830

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/84

Reviewed-by: Sattam Alsubaiee <salsubaiee@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 12 more files in changeset.
Added filters to AsterixDB's primary and secondary indexes.

Change-Id: If16b2758bb25392c8dd0405d7d59ae503efad3f0

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/82

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 113 more files in changeset.
Add external indexes

This change include the following:

1. additional data parser for external data that parse hdfs records using Hive serdes.

2. allow users to create external data. this includes:

a) changes in metadata external dataset details.

b) addition of a new metadata index to store external file's statuses.

c) the pipeline for building the B-Tree and R-Tree indexes.

d) hyracks operators to fetch records with their RIDs using different formats.

e) hyracks operators to lookup and parse external records.

f) test cases for indexing and index access of different hdfs file formats.

g) exposing the secondary indexes over external data to the compiler.

3. adding a new aql command to refresh external datasets. this includes

a) global recovery on system startup.

b) changes in the aql parser.

c) construction of bulk modify pipelines and additional operators to perform local commit and abort operations (using 2PC protocol).

4. Added copyright header to all new files

5. Added additional test cases to test left outer join on external data

Change-Id: I1065a473299f6027eb073aeeba3a56d137f6f98e

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/70

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

  1. … 142 more files in changeset.
1. Add an asterix-specific IntroduceGroupByCombinerRule to deal with null-test in the nested plan in a group-by operator 2. Add a regression test case for issue782, including optimizer test and runtime test

Change-Id: Ia678414451ebddb7367238fef9f22a6753aa6206

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/65

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 12 more files in changeset.
Hyracks issue #137 requires a new IUnnestPositionWriter to be defined. Here it is.

Updated AsterixDB to use the new IUnnestPositionWriter.

Change-Id: I9ad5dbaef7a3b347a61e0f8a5505d4db6dc232c3

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/68

Reviewed-by: Till Westmann <westmann@gmail.com>

Tested-by: Ian Maxon <imaxon@uci.edu>

    • -0
    • +19
    ./java/edu/uci/ics/asterix/translator/AqlPositionWriter.java
Support sort-based group-by, add test coverage for out-of-core code paths, and adapt to the new buffer cache interface. -- add the support for sort-based group-by -- add test coverages for disk-based code path, including multi-pass code paths -- populate framesize and group-by buffer size into asterix -- adapt to new interface for buffer cache

Change-Id: I4af9eaa6fa6a8ae76b8ecaa39184785a90b32710

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/36

Tested-by: Ian Maxon <imaxon@uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 38 more files in changeset.