asterixdb

Clone Tools
  • last updated 19 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Enable Replication Tests on Multi-NC Setup

- Move replication IT from vagrant VMs to multi-NC setup.

- Add 'node' command to kill specific node process.

- Fix file path passing to replication manager.

Change-Id: I542b212e04469e2701690f464f821a5189b97f12

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1364

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 35 more files in changeset.
remove duplicate dependency

Change-Id: Ibc532c40854802275a7b94941afd5c26733158b2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1369

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

ASTERIXDB-1711: root metadata

s/asterix_root_metadata/root_metadata/

s/AsterixConstants/StorageConstants/

Change-Id: I7afc3062a4b98883a7a54bd410e8df558e5ebf3c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1367

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

ASTERIXDB-1711: remove some more Aql-prefixes

Change-Id: I041341fe76e9338b7c568a9eacaf826f8fa0ed46

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1360

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 218 more files in changeset.
remove more useless curly braces

Change-Id: I581d268b12017fcf17b5b29f7183e07deae6e931

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1363

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

ASTERIXDB-1659: remove outdated findbugs-plugin

Change-Id: I40c6d9f4443afe744c4bbddd63bbf206df924155

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1362

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

ASTERIXDB-1608, ASTERIXDB-1617 Match user query for nonpure function calls

This fix makes it so that nonpure functions are called in

the same place and with the same number of executions

as specified by the user in the query. This also means

that indexes cannot be used for queries that compare

with a nonpure call that is made on a per-record basis.

Added optimizer tests

Change-Id: I2dec322b30835625430c06acd7626d902bada137

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1057

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 32 more files in changeset.
remove useless curly braces

Change-Id: If38738222513cfc89bef1b5e2ecb1bb2eda0454a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1361

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Continue Cleaning Up File References and Splits

1. Make FileSplit an abstract class with two subclasses;

Managed and Unmanaged. A Managed FileSplit can be mapped

in a new subclass MappedFileSplit that maps a relative path to an

IO device. UnmanagedFileSplit is for files outside the io devices.

2. Remove all usages of absolute paths in file split in test cases. The

only remaining place is the write statement.

3. Fix some of the hidden issues in the tests that were working because

of our use of the absolute paths.

4. Revert the decision of selecting the IO device to the CC.

Change-Id: I166af8f9b3a2257f94d7b05db94888fb7cb4c79e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1359

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 239 more files in changeset.
Parameter documentation for nc service installtion.

Change-Id: I2e0c4e4dd41e966cc5fcebb423b7ca1be218de9d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1355

Reviewed-by: Till Westmann <tillw@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

ASTERIXDB-1736: Remove Grace Hash Join (not being used)

- Removed Grace Hash Join that is not currently being used

since we always use Optimized Hybrid Hash Join.

Change-Id: I16e9e4c73d7851f18a48c2715a6bc5c903b74eba

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1353

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Cleanup FileSplit and FileReference

This change gives FileSplit and FileReference specific meaning to

avoid confusion of an absolute vs relative, local vs global, inside

an IO device vs outside IO devices.

In addition, it enables better abstraction of global partitions and

delegate the responsibility of choosing which partition goes to which

IO device to the IO Manager through the introduction of FileDeviceComputer

In details:

Previously, the LocalResource in Hyracks had partition (storage partition)

and there is no such thing in Hyracks. This scope leak is bad. In addition

The local resource had a name and a path. they were always the same and so

the name was removed.

The storage partition was instead moved to asterixdb implementation of the

serialized object in the local resource.

With all of these changes, the cluster controller (compiler) only needs to

know about partitions and relative paths. It doesn't need to worry about

heterogenous Node setups and different io device configurations. For File

assignment to IO devices, a new interface (IFileDeviceComputer) was

introduced which can be overriden by applications to have their own

strategy for distributing files among IO devices.

Change-Id: I4fac508bf9af5a3bed41a3cf4464d2cbfecf2f61

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1352

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 273 more files in changeset.
Polish the SQL++ reference doc.

Change-Id: Ifb3cc23ebbf9e390d6eabf9386b15550aa5d6d43

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1358

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

fix dependencies for asterix-common

Change-Id: I699fad60cfac996940d6017e4f0791027b6494c3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1357

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -22
    • +60
    /asterixdb/asterix-common/pom.xml
    • -0
    • +18
    /asterixdb/asterix-external-data/pom.xml
Symbolic constants in lock manager

Change-Id: I774dd40113f5fa4fee94dde72f4ec6a1891c6b6e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/694

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

ASTERIXDB-1711: remove some Aql-prefixes

Change-Id: Ia0b64ffa7c50cd62fc3303fdb44eb769f56c978a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1314

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 70 more files in changeset.
Support LSM-filter on multiple input paths

The IntroduceLSMComponentFilterRule only checked one input path,

which does not work for the multiple-path cases (e.g., intersection case)

This patch fixes this bug.

Change-Id: I390ac11f3a2781f10f726dce917d89ec640dd917

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1356

Reviewed-by: Taewoo Kim <wangsaeu@yahoo.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Fixed issues with Replication tests

- Changed the way the log reader writes the newValue

- Fixed bug with creating recovery plan

- Updated ReplicationIT query files

Change-Id: I204a41311012dc348d4d41ae8bf6ec8554ab3dc3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1334

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Fix Installer tests on Local machines

Change-Id: Idcb10e0e72d6a60d91fe1845567bac1208991f93

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1354

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Fix ASTERIXDB-1609 and OrderedList bug in TweetParser

1. For ASTERIXDB-1609, add UNION type check in writeField, and add one

more case for orderedList.

2. For OrderedList bug, change UnorderedListBuilder to

OrderedListBuilder.

Change-Id: Ia27148cb10206b93dabf7655aed68f3004f96dfd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1339

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Wail Alkowaileet <wael.y.k@gmail.com>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

Disable hash merge exchange.

- Hash merge exchange does not work very well on large clusters.

- Hash merge exchange is used only when a user explicitly enable it.

Change-Id: If82c4e4db1d4340cdd53d17e48a193ab2b7a05e0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1345

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 28 more files in changeset.
ASTERIXDB-1727: Fix an issue with multiple aggregates in one group-by

- Although the hash group-by hint is given, if multiple aggregate operators

exist in the subplan of group-by, the physical operator of the given group-by

should not be set as EXTERNAL_GROUP_BY since we don't support multiple aggregates

in the external group by physical operator.

Change-Id: Ifb5619cc3ece00ab83962d53e004f203684df9ee

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1343

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Wait For NC Processes To Exit Before Sanity Check

Wait for NCService / NCDriver processes to exit (or timeout to exhaust)

before checking for extraneous processes. Otherwise, a false-positive

may be reported.

Change-Id: I35ebad976fa49d308843aee784ceacff5850bd11

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1348

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Optimize PartitionWriter

Change-Id: Ic36c58b143f3fc2d37b180559c11c1566bcc1a86

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1347

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Update Apache Root Pom to Latest

org.apache:apache.........16 -> 18

Change-Id: I30277fa9cf288f3c6a2c0538fa67bde8e48a1e15

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1337

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tests for ASTERIXDB-1725

Just inserts a really big record, stops, and starts again.

This should always work, but for the bug, it'd cause a nullpointer

upon querying the dataset.

Change-Id: I8b241acebbdcd658e734a43d03259a1ea24d8b57

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1344

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

ASTERIXDB-1570: "Unable to find free page in buffer cache after 1000 cycles"

Increase test buffer cache size to reliably accomodate 20M values

Change-Id: I620de9ade875f7f7de26aa7495d9fd873824ac83

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1346

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Ensure LogManager Doesn't Exceed the Size of the Log Page Queues

Change-Id: If6427576a31090a057ee6a3d25e35eef5cdd86f8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1342

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

ASTERIXDB-1719 - Align HTTP Test Requests to $METHOD.http

Change-Id: I60958f77226f1afb2585baf9248682c4867758d8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1341

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 7 more files in changeset.
Support broadcast join.

- The branch for broadcast is always the right branch, i.e., the build branch.

Change-Id: I269d29816206f4f7c21097c99b6e3f19b29be138

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1340

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>