Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Change folder structure for Java repackage

Change only the folders, not the files, for our package name change.

This will break the build, and needs to be followed by a change to

the package name in all of the source files. However performing

the folder move and file change in two steps lets Git understand

that the files are the same, and lets us track revisions across

those files.

Change-Id: I08aff75e25ac7c6298c32cf3402febbc4a318c2a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/307

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -23
    • +0
    ./algebricks/core/algebra/base/ILogicalPlan.java
  1. … 3879 more files in changeset.
Add Apache RAT License Auditor plugin, and fix missing licenses

Change-Id: I39d92ec6654c73b4e6b8ba76dd66770bb60c7b79

Reviewed-on: https://asterix-gerrit.ics.uci.edu/260

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 27 more files in changeset.
Changes to support Feeds 2.0 (random partitioning of tuples)

commit 8b5c352d831aa0d7e006457f0b1430ac12b54731

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:16:11 2015 -0700

Changes to support Feeds 2.0 (random partitioning of tuples)

Change-Id: I712c1f019cbc43f66d50620772c3df03c5944394

Reviewed-on: https://asterix-gerrit.ics.uci.edu/296

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

  1. … 2 more files in changeset.
Algebricks fix for issue 873.

Change-Id: I78a4a30638d6cc5681b5410046fff6345b515291

Reviewed-on: https://asterix-gerrit.ics.uci.edu/266

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Wenhai Li <lwhaymail@yahoo.com>

Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com>

  1. … 3 more files in changeset.
Add a flag for LSM-based indices to indicate whether force pages to disk devices during flush and merge.

Change-Id: I988716c03cffe30b008e144d3a478ee25e367212

Reviewed-on: https://asterix-gerrit.ics.uci.edu/240

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

  1. … 80 more files in changeset.
allow counter to reset from a start

Change-Id: Ibcc6fdb66bc758450fd75c70960b481692e06bfe

Reviewed-on: https://asterix-gerrit.ics.uci.edu/270

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Range connector update with order by hint.

Change-Id: Iec1fbd79f62bfeef2081858bdfab3ff894f63e03

Reviewed-on: https://asterix-gerrit.ics.uci.edu/253

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com>

    • -168
    • +160
    ./algebricks/core/jobgen/impl/JobGenContext.java
  1. … 7 more files in changeset.
Implementation of Union Change-Id: Ice4d080053d8993236ed27e9acf83fcdd45db74a Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/235 Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com> Reviewed-by: Preston Carman <ecarm002@ucr.edu>

  1. … 1 more file in changeset.
Added abstract class for internal\external dataset scans.

Change-Id: I9c222ab5403a897aa3c8e6b48b6b4ad01891afbb

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/153

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

- Fixed Type Casting issue - Reorganized duplicated internal class in the DelimitedDataParser and DelimitedDataParserFactory - Prevented a user from creating an inverted index on a dataset with a variable-length PK

Change-Id: Ic5606501223b8d860b49a258ff49afacd7d76b9a

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/191

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 66 more files in changeset.
This change allows setting a local ordering property for assign operators. it is needed when variables that are created in the assign operator are sorted

The following commits from your working branch will be included:

commit 9e4abb36e6f50e0f73406f4603cdc79590ca7b06

Author: Abdullah Alamoudi <bamousaa@gmail.com>

Date: Mon Feb 2 16:53:45 2015 +0300

added a TODO for deserialization

commit 78f7ee6fb04358d36156658202fb4478e47059e2

Author: Abdullah Alamoudi <bamousaa@gmail.com>

Date: Mon Feb 2 16:30:56 2015 +0300

fixed NPE in substitue variable visitor

commit 6bb101e072e03aae2732613385589e1ae52b510c

Author: Abdullah Alamoudi <bamousaa@gmail.com>

Date: Mon Feb 2 15:07:14 2015 +0300

Allow assign operator to have explicitly set ordering properties

Change-Id: If995b47aa3c97ce60be952141699268341d31eea

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/214

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

  1. … 1 more file in changeset.
Adding hash join logging comments.

commit 513c3a7899dc64af3c3cdec96fad9093a4ca2c5f

Merge: b27e9b5 82609d9

Author: Eldon Carman <ecarm002@ucr.edu>

Date: Thu Feb 5 12:47:52 2015 -0800

Adding hash join logging comments.

Change-Id: Iade2c53436e5ae82c31305d6f618c780cd72568b

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/219

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Pouria Pirzadeh <pouria.pirzadeh@gmail.com>

  1. … 6 more files in changeset.
1. Tracks the variables coming from the outer branch of loj to later decide whether they are still nullable 2. Deals with variables in nested subplans in OperatorPropertiesUtil

Change-Id: I6438fad75ee308e3f6c2b276f0d6b7c882e5b379

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/121

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Changes in this CL include: 1. fix asterixdb issue 810, 2. allow group-by logical operator to work with multiple nested plans.

Change-Id: I58ad59e7b3e8a9e14c3e14f7655c857a1890da6f

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/178

Reviewed-by: Preston Carman <ecarm002@ucr.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 7 more files in changeset.
Moved MaterializeOperator and NestedSubplanToJoinRule to Hyracks.

Change-Id: I74f62bc26706fc72c1baf05f27ce8cdf219cb778

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/168

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 6 more files in changeset.
This change list includes several fixes: 1. Adds a rule to push subplan into group-by 2. Adds a rule to eliminate subplan with input cardinality one 3. Fix the nested running aggregate runtime 4. Adds a wrapper of FrameTupleAppender to internally flush full frames. A TODO item is to cleanup existing usage of FrameTupleAppender to use the wrapper, which makes code simpler.

Change-Id: I647f9bce2f40700b18bdcad1fa64fb8f0a26838b

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/149

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Preston Carman <ecarm002@ucr.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 11 more files in changeset.
Fix the data property inference: 1. Fix order property,a LocalOrderProperty stores an array of OrderColumns instead of one OrderColumn. A delivered order property D satisfies a required order property R if R's sorting columns are a prefix of D's sorting columns. 2. Fix partition proerty inference, a delivered partition property D satisfies a required partition property R if D's partitioning columns are a prefix of R's partitioning columns. 3. Fix the data property progatation, e.g., what data properties are left after passing through a project operator. 4. Fix the data property within a group. For example, order property ($1 ASC, $2 ASC) is delivered to a group-by operator with $1 as the group key, within a particular group, ($2 ASC) is a valid data property.

Change-Id: If812fe7dca9c1714780734af425a1bb363db125f

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/144

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 1 more file in changeset.
- Added Tokenize Operator in addition to the bulkload operator changes that were made by Zachary Heilbron. The tokenize operator is only added to the logical plan when bulk-loading the data. - Each secondary index is now updated in the separate branch by using the replicate operator. - Sink Operator now accepts multiple inputs. - Fixed the bulk-load so that it correctly produces auto-generated PK.

Change-Id: Ifb591754dba5eb4a9207edaa4e658f4cc745893a

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/78

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +190
    ./algebricks/core/algebra/operators/logical/TokenizeOperator.java
  1. … 40 more files in changeset.
Added replicate operator with materialization

be more aggressive to find shared plans in ExtractCommonOperatorRule

- find all the isomorphic subgraphs instead of just the ones on join build branches

- while expanding candidates handle the operators with multiple inputs

- analyze the DAG to find all the operators that can be co-scheduled, and infer the dependencies between clusters

- based on the dependencies, decide which outputs of a replicate operator needs materialization

- if the shared branch needs materialization, and it consists of only trivial operators (such as assign, unnest, datasource scan), that branch is discarded from the candidates

- modified the replicate operator descriptor to materialize the input if needed, and read from the materialized file for the outputs that requires materialization

- removed redundant decor variables in group-by

- fixed a bug on computing live variables for unnest-map operator: if the operator does not propagate inputs, those input variables should not be live anymore

- fixed a bug in ComplexUnnestToProductRule

Change-Id: If221d1507844f9409bf1163f93b0c04ef5848578

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/86

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 30 more files in changeset.
Adding plot of Algebricks plan

Change-Id: I0cd40886139dd2ef2731a7e7e965f5b7520faa01

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/105

Reviewed-by: Inci Cetindil <icetindil@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +139
    ./algebricks/core/algebra/prettyprint/PlanPlotter.java
Consider opaqueParameters in AbstractFunctionCallExpression equals&hashcode methods to make casting operators with the same argument distinguishable

Change-Id: I7b8bf5979732eb22dff824e48a57fdd1b1da4dda

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/100

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

Reviewed-by: Inci Cetindil <icetindil@gmail.com>

Added LSM component-level filters for all indexes.

Change-Id: I898cf885c9f88feae85c99799a00fd8ec036efea

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/81

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 119 more files in changeset.
Adding external indexes

In Hyracks side, this change include the following:

1. The addition of three indexes:

a) external b-tree index

b) external r-tree index

c) external b-tree with buddy b-tree index

2. creating an additional logical operator in algebricks for performing lookup operations over external data and modify the different visitors to work with this operator

3. Added copyright header to all new files

Change-Id: Iecfbd86f06aff3caaf3a9652b63420666745ebb9

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/69

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Zachary Heilbron <zheilbron@gmail.com>

Reviewed-by: Sattam Alsubaiee <salsubaiee@gmail.com>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

  1. … 53 more files in changeset.
The Hyracks issue #137 shows a hard coded value. The solution was to create a IUnnestPositionWriter to write the position variable in the form the type defined outside Hyracks.

The update attempts to make the fewest number of changes to add the writer.

Change-Id: I6ebab5b3dfabcd36c732067acefe33da22307fc7

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/67

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

Reviewed-by: Preston Carman <ecarm002@ucr.edu>

  1. … 2 more files in changeset.
Several major changes in hyracks: -- reduced CC/NC communications for reporting partition request and availability; partition request/availability are only reported for the case of send-side materialized (without pipelining) policies in case of task re-attempt. -- changed buffer cache to dynamically allocate memory based on needs instead of pre-allocating -- changed each network channel to lazily allocate memory based on needs, and changed materialized connectors to lazily allocate files based on needs -- changed several major CCNCCFunctions to use non-java serde -- added a sort-based group-by operator which pushes group-by aggregations into an external sort -- make external sort a stable sort

1,3,and 4 is to reduce the job overhead.

2 is to reduce the unecessary NC resource consumptions such as memory and files.

5 and 6 are improvements to runtime operators.

One change in algebricks:

-- implemented a rule to push group-by aggregation into sort, i.e., using the sort-based gby operator

Several important changes in pregelix:

-- remove static states in vertex

-- direct check halt bit without deserialization

-- optimize the sort algorithm by packing yet-another 2-byte normalized key into the tPointers array

Change-Id: Id696f9a9f1647b4a025b8b33d20b3a89127c60d6

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/35

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 273 more files in changeset.
fixed issue 731, 740, and more

commit 8911cc529e72e2bb544d9b472d6e10f173d173af

Author: Young-Seok <kisskys@gmail.com>

Date: Sun May 18 11:28:28 2014 -0700

another fix for picking available index for leftouterjoin plan

commit 9bce43087615fee53613467a027833dd53e190f9

Merge: c8e85ac efab69f

Author: Young-Seok <kisskys@gmail.com>

Date: Sun May 11 22:22:10 2014 -0700

merged master to kisskys/left-outer-join-issue branch

commit c8e85aca31545c13b2a02ff6dc259943e2cf66ad

Author: Young-Seok <kisskys@gmail.com>

Date: Sun May 11 20:17:17 2014 -0700

changes for left-outer-join to pick available indexes

Change-Id: Ib0fc186bc9388802f95445edee92c428b3bb69cc

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/34

Reviewed-by: Inci Cetindil <icetindil@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 54 more files in changeset.
fix for issue #732

    • -1
    • +1
    ./algebricks/core/jobgen/impl/PlanCompiler.java
  1. … 15 more files in changeset.
better pretty printing - use prettyprinter from context to print intermediate plans

re-create a constructor for AlgebricksOptimizationContext that takes the "old" parameters

pretty print more expressions get the LogicalOperatorPrettyPrintVisitor from the IOptimizationContext move supporting methods in LogicalOperatorPrettyPrintVisitor to the end

  1. … 1 more file in changeset.