asterixdb

Clone Tools
  • last updated 11 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Add test queries over ingested feeds with meta records.

Change-Id: I7f18282a4c8e79a2d2fcd596a79c8819a951b219

Reviewed-on: https://asterix-gerrit.ics.uci.edu/723

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 16 more files in changeset.
ASTERIXDB-1343: support heterogeneity of computation nodes and storage nodes.

Change-Id: Ic21d8da2cd457aa17cc9861c0b92ac5960978e03

Reviewed-on: https://asterix-gerrit.ics.uci.edu/718

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 41 more files in changeset.
ASTERIXDB-1343: support queries over nodegroup-based datasets.

Fixed operators to have the right NodeDomain.

Added several regerssion tests.

Change-Id: I776b80e5b824c83bcdf43c95fff99bb151506f84

Reviewed-on: https://asterix-gerrit.ics.uci.edu/719

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 22 more files in changeset.
Support Change Feeds and Ingestion of Records with MetaData

This change allows feeds to perform upserts and deletes

in order to perform replication of an external data source.

The change does so by performing the following:

1. The adapter produces [PK][Record]. (Record == null --> delete)

2. The insert is replaced by an upsert operator.

Change-Id: If136a03d424970132dfb09f0dda56e160d4c0078

Reviewed-on: https://asterix-gerrit.ics.uci.edu/621

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 256 more files in changeset.
Support Change Feeds and Ingestion of Records with MetaData

This change allows feeds to perform upserts and deletes

in order to perform replication of an external data source.

The change does so by performing the following:

1. The adapter produces [PK][Record]. (Record == null --> delete)

2. The insert is replaced by an upsert operator.

Change-Id: I3749349e2b9f1b03c8b310eb99d3f44d08be77df

Reviewed-on: https://asterix-gerrit.ics.uci.edu/620

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 13 more files in changeset.
Eliminate Duplicate Hyracks Classes From AsterixDB

The following hyracks classes (package org/apache/hyracks/dataflow/std/

misc) are duplicated in asterixdb repo:

- ConstantTupleSourceOperatorDescriptor

- ConstantTupleSourceOperatorNodePushable

This eliminates the copies in asterixdb repo.

Change-Id: I64bded72def25fa34ea1545d4bf0f01218d04b9f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/722

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

ASTERIXDB-1333 Fix Feed Ingestion for Dataset with Filters

This change fixes a bug in the compilation of feed connection

when the dataset has filters. The bug is caused by not setting

the filter expressions during initial plan generation.

Change-Id: Ic323c9a74504921b984f68790bff2d3a7140b85b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/716

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Coverity Fixes

FeedMessageOperatorNodePushable

- CID 68721 (#1 of 1): Useless call (USELESS_CALL)

FeedLoadManager

- CID 68719 (#1 of 1): Useless call (USELESS_CALL)

RuntimeRecordTypeInfo

- CID 68717 (#1 of 1): Unused value (UNUSED_VALUE)

HelpCommand

- CID 68591 (#1 of 1): Missing break in switch (MISSING_BREAK)

- CID 68716 (#1 of 1): Unused value (UNUSED_VALUE)

SimilarityJaccardEvaluator

- CID 68714 (#1 of 1): Arguments in wrong order (SWAPPED_ARGUMENTS)

DatasetLifecycleManager

- CID 68713 (#1 of 1): Dereference before null check (REVERSE_INULL)

FeedMetaComputeNodePushable

- CID 68712 (#1 of 2): Dereference before null check (REVERSE_INULL)

- CID 68712 (#2 of 2): Dereference before null check (REVERSE_INULL)

FeedRuntimeInputHandler

- CID 68709 (#1 of 1): Dereference before null check (REVERSE_INULL)

DataflowControllerProvider

- CID 68708 (#1 of 1): Resource leak on an exceptional path

(RESOURCE_LEAK)

TokenLoad

- CID 68697 (#1 of 1): Resource leak (RESOURCE_LEAK)

RecordGroupLengthRange

- CID 68696 (#1 of 1): Resource leak (RESOURCE_LEAK)

RecordManagerGeneratorMojo

- CID 68691 (#1 of 1): Resource leak (RESOURCE_LEAK)

APIServlet

- CID 68687 (#1 of 1): Resource leak (RESOURCE_LEAK)

Change-Id: I8927126f505481e83dd5b9e6e5ccd75bb67d8188

Reviewed-on: https://asterix-gerrit.ics.uci.edu/715

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Add the group-only test for ExteralHashGroupby

Change-Id: Ia0b6560e43dc56072a02ff1c105b54669cef0197

Reviewed-on: https://asterix-gerrit.ics.uci.edu/714

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Fix the ExternalGroupby for fuzzy join

Change-Id: I5a3852d08f9a3e2738ea2952f05aa082a2e6dbbb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/713

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

- Reapplied fix for ASTERIXDB-1109 on merged master - Cleaned up runtime testsuite, made it validate against XSD

Change-Id: I8fcf41c009f9faf51bc8bccc0c3c7217b7769121

Reviewed-on: https://asterix-gerrit.ics.uci.edu/712

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 12 more files in changeset.
ASTERIXDB-1337: Dataset Memory Management on Multi-Partition NC

As sugggested in ASTERIXDB-1337, this change is to maintain a per-

partition MultitenantVirtualBufferCache budget, as opposed to sharing

the budget across the dataset.

Change-Id: Ibbf08f532c1210c30be6a51c73570a789174213b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/705

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

  1. … 4 more files in changeset.
ASTERIXDB-1337: Dataset Memory Management on Multi-Partition NC

As sugggested in ASTERIXDB-1337, this change is to maintain a per-

partition MultitenantVirtualBufferCache budget, as opposed to sharing

the budget across the dataset.

Change-Id: Ie554ab6d9b0d01ed149ab0729d20cdac3c969ec1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/711

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

ASTERIXDB-1340: fix node group nodes order

Change-Id: I6e93aedb6cdc57d98f83991ab910476b82bacb15

Reviewed-on: https://asterix-gerrit.ics.uci.edu/708

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

fix indentation in pom.xml

Change-Id: I1ce413e73a0fa2c93814c8bafa2295b297f785d1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/710

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Flush Socket Feed Before Waiting for More Data

Change-Id: Ic37085114592e97b6c5b2d29c5451d816a154aa8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/709

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

ASTERIXDB-1338: Prevent Metadata Datasets Eviction

- Exclude metadata datasets from eviction policy.

- Fix updating used memory when a dataset is closed.

Change-Id: I56734bfe0eb7d166786cacb8d76f12f8d1a21798

Reviewed-on: https://asterix-gerrit.ics.uci.edu/707

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

use localfs instead of the class name of the adapter

Change-Id: If0c8fafbbc52bbe0f7ac3ec8b5f23781a8017390

Reviewed-on: https://asterix-gerrit.ics.uci.edu/706

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 1136 more files in changeset.
ASTERIXDB-1128: add TPC-H queries with secondary indices into build tests.

Change-Id: I4237ca17d5e334959a320ed92fcdccf51cc4856d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/704

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 135 more files in changeset.
ASTERIXDB-1168: use either primary key or generated id for decorrelation.

Change-Id: Ib5e232f3ba99018cd1aedfa4f8bb2f98affa0f55

Reviewed-on: https://asterix-gerrit.ics.uci.edu/696

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Jianfeng Jia <jianfeng.jia@gmail.com>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 17 more files in changeset.
ASTERIXDB-1168: fix queries with duplicates in a subplan's input.

Fixed PushSelectDown to consider stateful functions;

Added a primary key visitor to generate/progate primary key information.

Change-Id: I83907c29699a76540abd1a246776f55576eeced8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/695

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

ASTERIXDB-923: add a regression test.

Change-Id: I5cf9da76e078abba452652cbad204fa53c8bb678

Reviewed-on: https://asterix-gerrit.ics.uci.edu/700

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <michael.blow@couchbase.com>

Reviewed-by: Till Westmann <tillw@apache.org>

Revert "ASTERIXDB-1109: Fixed deletion of records from open secondary index"

This reverts commit a05f71826a4ab2c0e7148009e0b7e269b15e0a2f.

Change-Id: I8fcf41c009f9faf51bc8bccc0c3c7217b7769148

Reviewed-on: https://asterix-gerrit.ics.uci.edu/698

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com>

  1. … 23 more files in changeset.
Added LeftOuterUnnestMap operator.

- Added LeftOuterUnnestMap operator to represent the left-outer-join semantics properly.

Change-Id: I6760319c2d3ff90c8b7d8ddeea3d9dd8f743366b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/637

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 4 more files in changeset.
Added LeftOuterUnnestMap operator.

- Added LeftOuterUnnestMap operator to represent the left-outer-join semantics properly.

Change-Id: I4525899cf8e5e43551aa2ac2a78806ef6cc85e58

Reviewed-on: https://asterix-gerrit.ics.uci.edu/638

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 4 more files in changeset.
ASTERIXDB-1127: fix ExtractCommonOperatorsRule.

Change-Id: I16933a4b72432b5fbd523ca80ce6426f6b6743a9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/691

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Pouria Pirzadeh <pouria.pirzadeh@gmail.com>

Reviewed-by: Till Westmann <tillw@apache.org>

ASTERIXDB-1127: regression tests.

Change-Id: Ie2d14acd87269ed2f8c28350d13f5510c68058ab

Reviewed-on: https://asterix-gerrit.ics.uci.edu/692

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Pouria Pirzadeh <pouria.pirzadeh@gmail.com>

a few formatting issues.

Removed pom info from merge.

interval test was merge correctly.