asterixdb

Clone Tools
  • last updated 20 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
ASTERIXDB-1928: Regression test

Change-Id: I3e0c8702e6cdf27c2caed6a77bc182ea3dbbc3fd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1822

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Remove -virtual-nc option

Avoid hidden option '-virtual-nc' to indicate when NCService should not

be used to start the NC, instead use ncservice.port of -1 to indicate

the same

Change-Id: I67a9a88808a3d1352b5fdd45ebd158e98dc72dba

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1820

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Strip query string from servlet localPath

Path should not contain query string; remove it when extracting

localPath from request uri.

Change-Id: I0b4942fb1249807fcee9d3047568dc1749798d85

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1819

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Rename TaskUtil.getInSharedMap(..) -> TaskUtil.get(..).

Change-Id: Ic795c988ca63db7c760a2c8e7638451945cb72aa

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1817

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Miscellaneous minor cleanups.

Change-Id: I08911bc62c573da483174a71b71949162ca229f2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1815

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Clean up exceptions in runtime functions.

Change-Id: Ie08d6de31d9e928e888137680d9c7af5d66b85ae

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1814

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 15 more files in changeset.
Debugging for sporadic <EOF> issue

Change-Id: I0aa2207860b5ab4c779d942c4a4e26d1eded9afd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1812

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

+= skip.surefire.tests

Add option to enable skipping only surefire tests, allowing integration

tests to run

Change-Id: I846bcc66cef115c572c75188f952bacc4b9858aa

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1810

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Fix QueryCancellationServlet use of e.getMessage()

Correct log message to not utilize getMessage() on arbitrary exceptions

Change-Id: I1f5e2172728d3bc4d0cc4a9990518adcd91ae76b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1809

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Change logical plan to apply filter from 2ndary index

- Changes the IntroduceLSMComponentFilterRule to

replace the constant filter value from the query to the value

carried from 2ndary index search.

- Can use 2ndary index filter even the query doens't contain

any filter related condition.

Change-Id: I0e2fe0208662e5dcd49d1a22bfb58f96533e9497

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1727

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -0
    • +5000
    /asterixdb/asterix-app/data/twitter/real.2.adm
    • -0
    • +5000
    /asterixdb/asterix-app/data/twitter/real.adm
  1. … 70 more files in changeset.
Include dead / failed nodes in cluster state json

Change-Id: I01f169088238aa777e2793b8dd4b73f79a0a01b3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1808

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Add internal function for type casting in 'lax' mode

- Add internal function 'cast-lax' which performs type

demotion in 'lax' mode and returns 'missing' if cast fails

- Fixed incorrect boundary check when converting from double to float

Change-Id: Id929f1e66853f0603d033cf0f824349296e83521

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1806

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Fix UUID printing for JSON and CSV

Change-Id: If36a71e81cf7ba53ce50e8728d09a3eb7577a946

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1805

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

Add Disk Component Scan operation for primary LSM index

-Added disk component scan operation for primary LSMBTree index,

which would be used by creating new secondary index

-This operation scans all disk components of the primary index,

and return all tuples. Thus, tuples with the same primary key

in different in components would be returned separately.

-The returned tuple has an extra int field, which indicates

which component this tuple comes from, and a boolean flag,

which indicates whether this tuple is an anti-matter tuple or not.

Change-Id: I31b2c67c58cb0a440c1d2c26400af322e2f1c1e5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1791

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Minor cleanup, no PENDING on cluster state refresh

Change-Id: I34221471f9aafa4ae970b2f44f80577ebb8bbba7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1803

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Fix typo in Index.isEnforcingKeyFields

Change-Id: Ibcc8c171bf9d1ad7ff5ab51a5baf804b9a23ed40

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1801

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Allow insert anti-matter tuples when bulk loading LSM index

Previously, when we bulk load an LSM index, we are not allowed to insert

anti-matter tuples to the disk component. However, creating secondary

index for correlated datasets requires anti-matter tuples to be inserted

as well. Thus, this patch mainly contains the following changes:

- When bulk loading LSM index, allow the user to switch between insert

mode and delete mode

- Extended the LSMDiskComponentBulkLoader with the delete method. For

LSM index with anti-matter tuples, the delete method simply sets the

TupleWriter to delete mode, and inserts the anti-matter tuple. For LSM

index with buddy btree, it simply inserts the deleted tuple into the

buddy btree.

- Since the LSMDiskComponentBulkLoader would have a delete method

anyway, added a new ILSMDiskComponentBulkLoader interface containing the

delete method.

Change-Id: I6665f56a5d2183697197298fa24824eeb827686a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1796

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 6 more files in changeset.
Clean up numeric type conversion code

- Add new conversion methods to ITypeConvertorComputer interface

- Move remaining type conversion code from ATypeHierarchy

to ITypeConvertorComputer implementations

- Add type demotion parameter to chose whether it fails

if input value is out of range for the target type ('strict' mode)

or not ('lax' mode)

- Clean up error messages

Change-Id: I68b78e2dc9ebf78799698a1c90bcd7cb5150137d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1800

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 14 more files in changeset.
Remove default node group.

In this way, CREATE DATASET statement can adjust to dynamic

cluster topology.

When we create a dataset:

- if the node group name is not given, we create a new node group

using all currently available nodes;

- if the node group name is give, we use the given node group for

the dataset.

When we drop a dataset:

- if no other dataset depends on the node group of the dataset to

be dropped, we also drop the node group.

Change-Id: If68dc6a7c1270ab1f5049c9334e3318425fd8287

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1799

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 37 more files in changeset.
Remove unnecessary integer boxing in AInt*

Change-Id: I6ecefc4e8617371de00fb430edfe24fca2b1f92f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1797

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Enable Adding Nodes to Running *DB Cluster

Also ability to configure unique partition ids without having access to

complete cluster topology

Change-Id: If978442a95687c00ef78c89ed1b4440f5e308b99

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1785

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 9 more files in changeset.
Added 'source-format' profile to Hyracks pom to enable code reformatting at build time using AsterixCodeFormatProfile

Change-Id: I9d8a4a82f1152204d24eae5507f4516ac091620c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1795

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +298
    /hyracks-fullstack/AsterixCodeFormatProfile.xml
Add LSMDiskComponentBulkLoader

-Added LSMDiskComponentBulkLoader implementations, which are used to bulk

load an LSMDiskComponent with anti-matters

-Added LSMDiskComponentWithBuddyBTreeBulkLoader implementations,

which are used to bulk load an LSMDiskComponent with deleted-keys btrees

-Refactored LSM flush/merge/index bulk load operations to use

the LSMDiskComponentBulkLoader

Change-Id: I772a6d68761fcbb85982a1c9f72f2d186e1d1ffb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1773

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Implemented Disk Components Alignment Based on IDs

- Added IDs (using LSN) for disk components. When a disk component is

flushed, its initial ID is set as the LSN. When components are merged,

the result ID is the union of all IDs to be merged.

- Changed the correlated merge policy to correlate disk components of

the primary and secondaries using IDs.

Change-Id: I768ee9ac0a8d3c99c631086093a6b778b2e7588e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1761

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Support rebalancing all datasets or a given dataverse.

Change-Id: Iad2740fd53b36bf122fd469beeca759d887e40fb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1793

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 53 more files in changeset.
Change IO directory for integration util to be a directory in target

Change-Id: I3dfb74dd4228725fb624eb1d21f621b7855f3d37

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1789

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

Fixed race condition during ncMap lookup

Change-Id: I1bfbe712c100f48011a516c373ac8994028dc3dd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1792

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Fix potential class cast exception in UnorderedListTypeDefinition

Change-Id: I583d681ffe84bd73eebcb4acd07062f6b4a1460e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1794

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Support rebalancing datasets with indexes.

- Remove type arguments from the methods in IndexUtils

that generate index operation (e.g., create, load, compact)

jobs. Do type extraction inside SecondaryIndexOperationsHelper.

Change-Id: I9c0720382440ae44441a8f8847e75649a3822fa2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1790

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 21 more files in changeset.
Fix uniontype compatibility issue in TweetParser

1. Fix compatibility issue of UnionType in TweetParser.

2. Add unit test for TweetParser, covering missing attribute record

filtering.

Change-Id: Id7e316d20f929236b3fa17618bb8f87d28ac7efc

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1786

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

    • -0
    • +1
    /asterixdb/asterix-external-data/pom.xml