Clone Tools
  • last updated 18 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Change folder structure for Java repackage

Change only the folders, not the files, for our package name change.

This will break the build, and needs to be followed by a change to

the package name in all of the source files. However performing

the folder move and file change in two steps lets Git understand

that the files are the same, and lets us track revisions across

those files.

Change-Id: Iefd2a576415ebc1416cba2a3334d2b64f042ba92

Reviewed-on: https://asterix-gerrit.ics.uci.edu/306

Tested-by: Ian Maxon <imaxon@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 3781 more files in changeset.
Fix for metadata indexes first LSN

Change-Id: I6ce08ee38e49e0f0f0c2acd27b64415d771bda67

Reviewed-on: https://asterix-gerrit.ics.uci.edu/293

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -0
    • +40
    ./asterix/common/dataflow/AsterixLSMIndexUtil.java
    • -16
    • +6
    ./asterix/common/dataflow/AsterixLSMInsertDeleteOperatorNodePushable.java
  1. … 1 more file in changeset.
Add Apache RAT License Auditor plugin, and fix missing licenses

Change-Id: Ic0fa0b7836e8a69d0d8beed83f9c3b41c168afd4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/263

Reviewed-by: Chris Hillery <ceej@lambda.nu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 1530 more files in changeset.
Introduces Feeds 2.0

commit c3f577861fc705d848c1641605689cadd6973bae

Merge: ebc4cae fc0c2c0

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Fri Jun 26 13:04:05 2015 -0700

Merge branch 'raman/feeds_2_release' of https://code.google.com/p/asterixdb-sandbox into raman/feeds_2_release

Conflicts:

asterix-app/src/main/java/edu/uci/ics/asterix/api/http/servlet/FeedServlet.java

asterix-external-data/src/main/java/edu/uci/ics/asterix/external/library/java/JObjectAccessors.java

commit ebc4cae21a7302869f953df1ebda601e798d12d2

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:14:45 2015 -0700

Introduces Feeds 2.0

Some of the prominent chnages introduced are as follows

a) Support for building a cascade network of feeds (via secondary feeds feature)

b) Feed Management Console for tracking active feeds and associated metrics

c) Support for elastic runtime for data ingestion

d) Improved fault-tolerance with support for logging of failed records

Documentation has been added at asterix-doc/src/site/markdown/feeds/

commit fc0c2c0549a6ee8b202e57607d2e110478cd57bb

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:14:45 2015 -0700

Introduces Feeds 2.0

Some of the prominent chnages introduced are as follows

a) Support for building a cascade network of feeds (via secondary feeds feature)

b) Feed Management Console for tracking active feeds and associated metrics

c) Support for elastic runtime for data ingestion

d) Improved fault-tolerance with support for logging of failed records

Documentation has been added at asterix-doc/src/site/markdown/feeds/

Change-Id: I498f01c591a229aaf51cec43ab20f3e5c4f072f4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/297

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -0
    • +47
    ./asterix/common/api/IClusterEventsSubscriber.java
    • -0
    • +34
    ./asterix/common/api/IClusterManagementWork.java
    • -0
    • +27
    ./asterix/common/api/IClusterManagementWorkResponse.java
    • -0
    • +62
    ./asterix/common/config/AsterixFeedProperties.java
    • -0
    • +34
    ./asterix/common/exceptions/FrameDataException.java
    • -0
    • +56
    ./asterix/common/feeds/BasicMonitoredBuffer.java
    • -0
    • +88
    ./asterix/common/feeds/CollectionRuntime.java
    • -0
    • +55
    ./asterix/common/feeds/ComputeSideMonitoredBuffer.java
    • -0
    • +84
    ./asterix/common/feeds/DataBucket.java
    • -0
    • +106
    ./asterix/common/feeds/DataBucketPool.java
    • -0
    • +135
    ./asterix/common/feeds/DistributeFeedFrameWriter.java
    • -0
    • +115
    ./asterix/common/feeds/FeedActivity.java
    • -0
    • +43
    ./asterix/common/feeds/FeedCollectRuntimeInputHandler.java
  1. … 369 more files in changeset.
VariableSizeFrame(VSizeFrame) support for Asterix (Runtime Only)

Apply the https://asterix-gerrit.ics.uci.edu/#/c/234/ API changes to

Asterix level.

Change-Id: I5459e877707a1494fc1bebf03d4457a7427e9e0f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/259

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 43 more files in changeset.
AsterixDB changes for: 1. fix "writerCount!=0" issue 2. protect deactivate/activate call of an index by its opTracker.

Note that this change includes https://asterix-gerrit.ics.uci.edu/#/c/269/.

Change-Id: I4669d49fd1cf9b058f7e0da233ad45c6c78b5797

Reviewed-on: https://asterix-gerrit.ics.uci.edu/279

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Temp dataset support: 1. DDLs for creating a temporary dataset 2. Garbage collection for temporary dataset 3. Reading, inserting, and deleting data from (to) a temporary dataset is locking-free (except metadata locks) and logging-free (except flush/merge/job-commit logs).

Change-Id: Id0960acd1b4dfbfa7685dba227634572ca50b126

Reviewed-on: https://asterix-gerrit.ics.uci.edu/241

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

    • -6
    • +6
    ./asterix/common/config/DatasetConfig.java
  1. … 250 more files in changeset.
Fixing LSMHarness issue.

Change-Id: I8afc0f189f5a64cc56be4a89903999c7c90a65c1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/252

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Added support of typed indexes over open fields & indexes over nested fields

Open indexes requires user to provide a type along with a indexed field name.

This type would be enforced for all the indexed records, i.e. index cannot be created if in some records a field with provided name has a different type.

Index-specific rewrite rules match provided type with the inferred types of other arguments in join\select statements and trigger index rewrite.

Nested indexes use the same semantics as the regular indexes, with exception that field could be located arbitrarily deep inside nested structure

Change-Id: I53d00aba243ccf7cf79cf7d775dd305813d24f98

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/97

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

  1. … 1791 more files in changeset.
Introduce ("header"="true") option for CSV parsing

Change-Id: I473bc7b66d0c0d1355b5fb3e392cb9ece151e50e

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/226

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Chris Hillery <ceej@lambda.nu>

    • -0
    • +2
    ./asterix/common/parse/IParseFileSplitsDecl.java
  1. … 11 more files in changeset.
Modified locking on DatasetLifeCycleManager

Change-Id: Ia5ab435f53879ba1d08b6dee24eb4969c5ad16e3

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/206

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -4
    • +11
    ./asterix/common/context/BaseOperationTracker.java
  1. … 10 more files in changeset.
This change integrates a run statement for running Pregelix jobs into the AQL.

Therefore it also provides a new FlushOperator to flush all memory components of a dataset to disc.

Change-Id: I1f97cfdc79943abf035a7342bb777d59af6518e9

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/193

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

  1. … 22 more files in changeset.
Added flush logs and enabled non-sharp checkpoints

The following commits from your working branch will be included:

commit c11a22cfd916041c806409c6d8e66dd6ea162b7b

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Tue Nov 18 23:12:19 2014 -0800

Defined Startup LSN

commit 95a8752072e53ef62a11c39799f296209a3c622c

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Tue Nov 18 20:22:08 2014 -0800

Revised Checkpoint Logic

commit ea4baa22089ba5d3eaff3d5c787828efcbff8ad9

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Thu Nov 13 10:25:45 2014 -0800

added comments

commit 8991554f840f50d800a619fc2ac327f1c024e838

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Wed Nov 12 23:34:25 2014 -0800

Added a method to the interface

commit a31e36b0b8234fe876b42e0cdc4543e4e73314a1

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Wed Nov 12 22:57:51 2014 -0800

Refactored getMinFirstLSN code

commit 25f62d585b2f279e78711efd2d327c777919f62c

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Tue Nov 11 14:05:34 2014 -0800

Added flush logs

Change-Id: I13fb61c04b6b510b6e8af68d2a0e7e14859f519d

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/182

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

    • -0
    • +46
    ./asterix/common/dataflow/AsterixLSMInsertDeleteOperatorNodePushable.java
    • -0
    • +476
    ./asterix/common/transactions/LogRecord.java
    • -0
    • +50
    ./asterix/common/transactions/LogType.java
  1. … 18 more files in changeset.
Made the correlated-prefix the default policy for filtered-datasets. Documented merge policies and filters.

Change-Id: I6c93d87b9fcee1f69601f5fd05192e56dd288879

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/176

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -0
    • +2
    ./asterix/common/config/GlobalConfig.java
  1. … 4 more files in changeset.
Fixed CSV parser to recognize quote and delimiter inside a string

Change-Id: Iaaabc23e86df4f9bbee9f06b7976d7fbdcbb0f3f

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/135

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

    • -3
    • +5
    ./asterix/common/parse/IParseFileSplitsDecl.java
  1. … 75 more files in changeset.
apply code conventions to files containing tabs

Change-Id: I429b02253a5008c50540a79075c257d01bc39a99

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/112

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

  1. … 14 more files in changeset.
Fix for Hyracks interface change due to Virtual Pages

Change-Id: Iedf7b1f27e3539563729e76e531bf10ecd5f6143

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/110

Reviewed-by: Sattam Alsubaiee <salsubaiee@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Added a new merge policy, called correlated-prefix.

Change-Id: I8f961eb28b4ea460f6326c8b4acaea02b50819e9

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/108

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +125
    ./asterix/common/context/CorrelatedPrefixMergePolicy.java
    • -0
    • +68
    ./asterix/common/context/CorrelatedPrefixMergePolicyFactory.java
  1. … 28 more files in changeset.
Adding plot of Algebricks plan

Change-Id: I917d92b1ca6f0161d67fbddd0182d5062939b558

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/106

Reviewed-by: Inci Cetindil <icetindil@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +9
    ./asterix/common/config/PropertyInterpreters.java
  1. … 3 more files in changeset.
Added filters to AsterixDB's primary and secondary indexes.

Change-Id: If16b2758bb25392c8dd0405d7d59ae503efad3f0

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/82

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -1
    • +1
    ./asterix/common/config/GlobalConfig.java
  1. … 120 more files in changeset.
remove unused properties

The properties AsterixWebServerPort and AsterixJSONAPIServerPort were

never read, but written in some places ..

Change-Id: If713cade15c2df2801ced43e8857e7f8ed5d3c36

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/93

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

    • -6
    • +2
    ./asterix/common/config/GlobalConfig.java
  1. … 8 more files in changeset.
Add external indexes

This change include the following:

1. additional data parser for external data that parse hdfs records using Hive serdes.

2. allow users to create external data. this includes:

a) changes in metadata external dataset details.

b) addition of a new metadata index to store external file's statuses.

c) the pipeline for building the B-Tree and R-Tree indexes.

d) hyracks operators to fetch records with their RIDs using different formats.

e) hyracks operators to lookup and parse external records.

f) test cases for indexing and index access of different hdfs file formats.

g) exposing the secondary indexes over external data to the compiler.

3. adding a new aql command to refresh external datasets. this includes

a) global recovery on system startup.

b) changes in the aql parser.

c) construction of bulk modify pipelines and additional operators to perform local commit and abort operations (using 2PC protocol).

4. Added copyright header to all new files

5. Added additional test cases to test left outer join on external data

Change-Id: I1065a473299f6027eb073aeeba3a56d137f6f98e

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/70

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

    • -0
    • +12
    ./asterix/common/config/DatasetConfig.java
    • -0
    • +55
    ./asterix/common/ioopcallbacks/LSMBTreeWithBuddyIOOperationCallback.java
    • -0
    • +33
    ./asterix/common/ioopcallbacks/LSMBTreeWithBuddyIOOperationCallbackFactory.java
  1. … 147 more files in changeset.
Support sort-based group-by, add test coverage for out-of-core code paths, and adapt to the new buffer cache interface. -- add the support for sort-based group-by -- add test coverages for disk-based code path, including multi-pass code paths -- populate framesize and group-by buffer size into asterix -- adapt to new interface for buffer cache

Change-Id: I4af9eaa6fa6a8ae76b8ecaa39184785a90b32710

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/36

Tested-by: Ian Maxon <imaxon@uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 39 more files in changeset.
added test case for inverted index + minor change to the c'tor (putting indexName as the last arg)

    • -9
    • +9
    ./asterix/common/dataflow/AsterixLSMTreeInsertDeleteOperatorDescriptor.java
  1. … 8 more files in changeset.
Fixed a typo in the merge policy parameters.

    • -1
    • +1
    ./asterix/common/config/GlobalConfig.java
  1. … 13 more files in changeset.
fix for issue 711

    • -1
    • +8
    ./asterix/common/dataflow/AsterixLSMInvertedIndexInsertDeleteOperatorDescriptor.java
    • -5
    • +13
    ./asterix/common/dataflow/AsterixLSMTreeInsertDeleteOperatorDescriptor.java
    • -6
    • +25
    ./asterix/common/feeds/FeedRuntime.java
  1. … 10 more files in changeset.
Fixed a deadlock when stopping the dataset life cycle manager.

reduced log record size by removing old operation/value and generalized undo operation by not using physical delete operation in LSM btree

  1. … 6 more files in changeset.
Moved the skip secondary index search hint closer to the predicates.

    • -0
    • +42
    ./asterix/common/annotations/SkipSecondaryIndexSearchExpressionAnnotation.java
  1. … 22 more files in changeset.
Merge branch 'master' into zheilbron/asterix_msr_demo

Conflicts:

asterix-app/src/main/java/edu/uci/ics/asterix/hyracks/bootstrap/NCApplicationEntryPoint.java

asterix-app/src/test/resources/metadata/results/basic/meta17/meta17.1.adm

asterix-app/src/test/resources/metadata/results/basic/metadata_datatype/metadata_datatype.1.adm

asterix-common/src/main/java/edu/uci/ics/asterix/common/config/AsterixExternalProperties.java

asterix-common/src/main/java/edu/uci/ics/asterix/common/transactions/ILockManager.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/MetadataManager.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/MetadataNode.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/entitytupletranslators/DatasetTupleTranslator.java

  1. … 17 more files in changeset.