Clone Tools
  • last updated 18 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[ASTERIXDB-2454] Remove non-unique AQL tests (pt.1)

Change-Id: I13f676e9322f8b94e8c9686b261e8752c7100724

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3007

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

    • -84
    • +0
    ./big_object_groupby-2/big_object_groupby.1.ddl.aql
    • -25
    • +0
    ./big_object_groupby-2/big_object_groupby.2.update.aql
    • -34
    • +0
    ./big_object_groupby-2/big_object_groupby.3.query.aql
    • -84
    • +0
    ./big_object_groupby/big_object_groupby.1.ddl.aql
    • -25
    • +0
    ./big_object_groupby/big_object_groupby.2.update.aql
    • -33
    • +0
    ./big_object_groupby/big_object_groupby.3.query.aql
    • -84
    • +0
    ./big_object_join/big_object_join.1.ddl.aql
    • -25
    • +0
    ./big_object_join/big_object_join.2.update.aql
    • -39
    • +0
    ./big_object_join/big_object_join.3.query.aql
    • -36
    • +0
    ./big_object_load_20M/big_object_load_20M.1.ddl.aql
    • -33
    • +0
    ./big_object_load_20M/big_object_load_20M.2.update.aql
    • -23
    • +0
    ./big_object_load_20M/big_object_load_20M.3.query.aql
    • -84
    • +0
    ./big_object_sort/big_object_sort.1.ddl.aql
    • -25
    • +0
    ./big_object_sort/big_object_sort.2.update.aql
    • -36
    • +0
    ./big_object_sort/big_object_sort.3.query.aql
  1. … 3328 more files in changeset.
Revert "[ASTERIXDB-2454] Remove non-unique AQL tests"

This reverts commit f372c96ddb3414e7f4f54b13059b065310157d65.

Change-Id: Ie8c4c9b50ed3daf528c75168b6d9c2d675cd04a5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3001

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

    • -0
    • +84
    ./big_object_groupby-2/big_object_groupby.1.ddl.aql
    • -0
    • +25
    ./big_object_groupby-2/big_object_groupby.2.update.aql
    • -0
    • +34
    ./big_object_groupby-2/big_object_groupby.3.query.aql
    • -0
    • +84
    ./big_object_groupby/big_object_groupby.1.ddl.aql
    • -0
    • +25
    ./big_object_groupby/big_object_groupby.2.update.aql
    • -0
    • +33
    ./big_object_groupby/big_object_groupby.3.query.aql
    • -0
    • +84
    ./big_object_join/big_object_join.1.ddl.aql
    • -0
    • +25
    ./big_object_join/big_object_join.2.update.aql
    • -0
    • +39
    ./big_object_join/big_object_join.3.query.aql
    • -0
    • +84
    ./big_object_load/big_object_load.1.ddl.aql
    • -0
    • +25
    ./big_object_load/big_object_load.2.update.aql
    • -0
    • +34
    ./big_object_load/big_object_load.3.query.aql
    • -0
    • +36
    ./big_object_load_20M/big_object_load_20M.1.ddl.aql
    • -0
    • +33
    ./big_object_load_20M/big_object_load_20M.2.update.aql
    • -0
    • +23
    ./big_object_load_20M/big_object_load_20M.3.query.aql
  1. … 4537 more files in changeset.
[ASTERIXDB-2454] Remove non-unique AQL tests

Change-Id: I13f676e9322f8b94e8c9686b261e8752a7100722

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2979

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -84
    • +0
    ./big_object_groupby-2/big_object_groupby.1.ddl.aql
    • -25
    • +0
    ./big_object_groupby-2/big_object_groupby.2.update.aql
    • -34
    • +0
    ./big_object_groupby-2/big_object_groupby.3.query.aql
    • -84
    • +0
    ./big_object_groupby/big_object_groupby.1.ddl.aql
    • -25
    • +0
    ./big_object_groupby/big_object_groupby.2.update.aql
    • -33
    • +0
    ./big_object_groupby/big_object_groupby.3.query.aql
    • -84
    • +0
    ./big_object_join/big_object_join.1.ddl.aql
    • -25
    • +0
    ./big_object_join/big_object_join.2.update.aql
    • -39
    • +0
    ./big_object_join/big_object_join.3.query.aql
    • -84
    • +0
    ./big_object_load/big_object_load.1.ddl.aql
    • -25
    • +0
    ./big_object_load/big_object_load.2.update.aql
    • -34
    • +0
    ./big_object_load/big_object_load.3.query.aql
    • -36
    • +0
    ./big_object_load_20M/big_object_load_20M.1.ddl.aql
    • -33
    • +0
    ./big_object_load_20M/big_object_load_20M.2.update.aql
    • -23
    • +0
    ./big_object_load_20M/big_object_load_20M.3.query.aql
  1. … 4537 more files in changeset.
[ASTERIXDB-2286][COMP][FUN][HYR] Parallel Sort Optimization

- user model changes: yes

- storage format changes: no

- interface changes: yes

details:

- new plan for sort operation which includes sampling and

replicating the stream of data to be sorted. Sort-merge connector

is removed from the plan. The sorted result now is in multiple partitions.

- new optimization rule to check whether full parallel sort is applicable.

- new Forward operator to read the replicated sort input stream and

to receive the ouput of the sampling.

- new sequential merge connector to merge a globally ordered result residing

in multiple partitions (in addition to the connector's partition computer).

- "asterix-lang-aql/pom.xml" is changed as a result of refactoring

code related to the range map handling.

- new private sampling function to generate the range map object

(local & global functions) & their type computers.

user model changes:

- new compiler property is added to enable and disable parallel sort.

interface changes:

- "ILogicalOperatorVisitor.java" includes Forward Operator.

- "ITuplePartitionComputer.java" includes initialize() to enable partitioner

to do some initialization. FieldRangePartitionComputerFactory uses it to

pick a range map.

- "ITuplePartitionComputerFactory.java". createPartitioner() is changed to

createPartitioner(IHyracksTaskContext hyracksTaskContext). Context is needed

for transferring the range map throught the context.

Change-Id: I73e128029a46f45e6b68c23dfb9310d5de10582f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2393

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

    • -1
    • +3
    ./big_object_insert/big_object_insert.3.query.aql
  1. … 357 more files in changeset.
[ASTERIXDB-2182][ING] Use JSON-like syntax for feed configuration

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

To be consistent with the other JSON-like syntax in defining

configurations, CREATE FEED will change to use JSON object instead of

key-value pairs. Also, the <USING> adapter_name syntax is removed. The

adapter name becomes as part of the configuration. After this change,

the feed configuration are specified as:

<CREATE> <FEED> testFeed <WITH> {

"adapter-name" : "localfs",

"path" : "localhost://../../../../../tweets.json",

"format" : "adm",

"type-name" : "typeTweet"

};

This patch also fixes two minor mistakes when drop feed and adapter in

Metadata.

Change-Id: I2dfb0fdf74d28ae0c45dafcf6babb624bd8b2149

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2209

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -6
    • +7
    ./big_object_feed_20M/big_object_feed_20M.1.ddl.aql
  1. … 107 more files in changeset.
[ASTERIXDB-1812][RT] Budget the memory usage for pre-clustered group-by.

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- let pre-clustered group-by consider memory budget.

Change-Id: I670269b0b8f446d06d8dd73202194574aa524e85

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1940

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +2
    ./big_object_groupby/big_object_groupby.3.query.aql
  1. … 27 more files in changeset.
Feed Connection Refactoring

1. The feed subscription network using FeedJoint is removed.

2. FeedConnection metadata dataset is added (pkeys: dataverseName,

feedName, datasetName).

3. Replaced the old intake job + collect job combination with one single

job using SplitOperator.

4. Now one feed can connect to multiple datasets.

5. The disconnect feed job is replaced by ActiveManagerMessage.

6. The new feed life cycle is:

- Create feed

- Connect feed to dataset0, dataset1, dataset2, etc.

- Start feed

- Stop feed

- Disconnect feed

7. New feedEventListner framework by Abdullah

Change-Id: Ic36267eb9a10df21734ce1cc1f38583e23c9e8f0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1259

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -0
    • +2
    ./big_object_feed_20M/big_object_feed_20M.2.update.aql
  1. … 197 more files in changeset.
ASTERIXDB-1760: support per-query customizations for compilation parameters.

Change-Id: I6e18f3f7706e574553a02e15a39daddda3c413b2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1458

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -2
    • +2
    ./big_object_load_20M/big_object_load_20M.2.update.aql
  1. … 9 more files in changeset.
Disable hash merge exchange.

- Hash merge exchange does not work very well on large clusters.

- Hash merge exchange is used only when a user explicitly enable it.

Change-Id: If82c4e4db1d4340cdd53d17e48a193ab2b7a05e0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1345

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -0
    • +3
    ./big_object_load_20M/big_object_load_20M.2.update.aql
    • -0
    • +3
    ./big_object_load_only_20M/big_object_load_only_20M.2.update.aql
  1. … 41 more files in changeset.
ASTERIXDB-1439: Add Feed Big Object Test

Add a 20M object feed ingestion test case

Change-Id: I7fa46ae04e043bb2fd8ff316496318b0ae222baf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/911

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +44
    ./big_object_feed_20M/big_object_feed_20M.1.ddl.aql
    • -0
    • +30
    ./big_object_feed_20M/big_object_feed_20M.2.update.aql
    • -0
    • +23
    ./big_object_feed_20M/big_object_feed_20M.3.query.aql
  1. … 2 more files in changeset.
ASTERIXDB-1439: Add Test Cases For Big Objects

Two cases involving 20MB values, using load mechanism

Change-Id: I26abeba3db348f08de5b936a791fb3e3814519c9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/849

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <michael.blow@couchbase.com>

    • -0
    • +36
    ./big_object_load_20M/big_object_load_20M.1.ddl.aql
    • -0
    • +30
    ./big_object_load_20M/big_object_load_20M.2.update.aql
    • -0
    • +23
    ./big_object_load_20M/big_object_load_20M.3.query.aql
    • -0
    • +36
    ./big_object_load_only_20M/big_object_load_only_20M.1.ddl.aql
    • -0
    • +30
    ./big_object_load_only_20M/big_object_load_only_20M.2.update.aql
    • -0
    • +23
    ./big_object_load_only_20M/big_object_load_only_20M.3.query.aql
  1. … 12 more files in changeset.
ASTERIXDB-1436: Big Object Support For Storage

Preliminary submit for big object storage support (values only).

Enable hyracks frames up to Integer.MAX_VALUE

Change-Id: Ie0a3cb855768dfd0cd1da4a5fc9f62aedebcbc5f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/840

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -0
    • +35
    ./big_object_bulkload/big_object_bulkload.1.ddl.aql
    • -0
    • +119
    ./big_object_bulkload/big_object_bulkload.2.update.aql
    • -0
    • +23
    ./big_object_bulkload/big_object_bulkload.3.query.aql
    • -0
    • +35
    ./big_object_insert/big_object_insert.1.ddl.aql
    • -0
    • +119
    ./big_object_insert/big_object_insert.2.update.aql
    • -0
    • +23
    ./big_object_insert/big_object_insert.3.query.aql
  1. … 93 more files in changeset.