asterixdb

Clone Tools
  • last updated 28 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[ASTERIXDB-2422][STO] Introduce compressed storage

- user model changes: yes

- Add new configuration in the with-caluse to enable compression

- Add new nc configuration in the config file

- storage format changes: yes

- Pages of the primary index can be compressed

- Add a companion file (Look Aside File) with the compressed index

- Allow optional values in the LocalResource

- Add compression information in Metadata.Dataset

- interface changes: yes

- ICCApplicationContext:

- Add getCompressionManager()

- IBufferCache:

- Add getCompressedFileWriter(int fileId)

- ICachedPageInternal:

- Add setCompressedPageOffset(long offset)

- Add getCompressedPageOffset()

- Add setCompressedPageSize(int size)

- Add getCompressedPageSize()

Details:

- Add new integration test for this patch

- Fix ASTERIXDB-2464

- Add ddl-with-clause type validator

Additional details in the design document:

https://cwiki.apache.org/confluence/display/ASTERIXDB/Compression+in+AsterixDB

Change-Id: Idde6f37c810c30c7f1a5ee8bcbc1e3e5f4410031

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2857

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 177 more files in changeset.
[ASTERIXDB-2475][OTH] Reject HTTP Pipelined Requests

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- If a client sends multiple requests on the same connection

before reading the response of each request (i.e. pipelined

requests), the request will be rejected and the connection

will be closed.

- Add test case.

- Fix typo in method name.

Change-Id: I67c370d4d37a3e267b30e13333714605b07b7515

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3021

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Ian Maxon <imaxon@apache.org>

[ASTERIXDB-2460][FUN] Fix sum() overflow bug

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Fixed the sum() overflow problem. Now the sum() function will

return either bigint or double based on the input types.

- Added sum() aggregate local, intermediate and global classes.

Currently, it is using the same class for the three steps and

checking the type using an if statement. Although the three

steps all have a very similar behavior, having them in split

classes makes it cleaner and easier to read and maintain in the

future.

- Added sum() aggregate local, intermediate and global for serialized

classes.

- Added sum() and serial sum() test cases and modified test cases

to cause the reported overflow issue.

- Added sum() and serial sum() test cases that cause a

Long.MAX_VALUE type overflow.

- Valid data type check is now part of the sum calculation to

avoid redundant steps.

Change-Id: I987417770b3bfbda6af29a27acc8c96dc8a99eb8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3012

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 158 more files in changeset.
[ASTERIXDB-2474][COMP] Remove physical optimization static variable

- user model changes: no

- storage format changes: no

- interface changes: no

details:

This patch is to remove the physical optimization config static

variable used in IndexUtil to prevent side effects.

Change-Id: I83f58715e5d643fa5b52f6e0a0d1ad1cb839f895

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3020

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

[NO ISSUE][COMP] fix resolving PK field accesses & rewriting of meta()

- user model changes: no

- storage format changes: no

- interface changes: no

details:

This patch fixes resolving PK field accesses to the primary key

variable (e.g. $ds.getField("id") is turned into $13 where id is a PK).

The fix considers whether the PK is coming from the data record or the

meta record.

The patch also includes fixing rewriting of meta() references and

replacing them with their corresponding meta variables. Now nested plans

are visited also when looking for meta() references to take care of cases

where the data scan producing the meta variable and the meta() references

happen to be inside the nested plans.

MetaFunctionToMetaVariable() is fired also after the rules which eliminate

subplans to allow for rewriting of the meta() if it couldn't be replaced

when the meta() reference was in the subplan but referring to meta variable

outside the nested plan.

ReinferAllTypesRule() is now fired before ByNameToByIndexFieldAccessRule()

to allow the latter rule to get the up-to-date types in the whole plan.

Change-Id: I2d38cbfcc4a0eee51abf753a7d958dafa666aabf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3018

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

    • -0
    • +9
    /asterixdb/asterix-app/data/csv/people.csv
  1. … 24 more files in changeset.
[ASTERIXDB-2472][CONF] More Restrictive Configuration Options

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- To avoid accepting invalid configuration types, more restrictive

configurations types (UNSIGNED_INTEGER) and (POSITIVE_INTERGER)

were introduced.

- Update configuration options that accept INTEGER type to use

the more restrictive INTEGER types.

Change-Id: I7236089d93f90ebdb57a87a8efa0a64cf98df845

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3017

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

Merge "Merge commit 'bd7ba45' from 'stabilization-f69489'"

Merge commit 'bd7ba45' from 'stabilization-f69489'

Change-Id: I13ef45c66cd88c75c2436ebb6a0abb4a5c1a1cc9

[NO ISSUE] Update Jackson libraries to 2.9.7

Change-Id: I0b8a455ea9759a16422ccb35e858f6fc7e504721

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3013

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

[ASTERIXDB-2286][COMP] Parallel sort changes p.2

- user model changes: no

- storage format changes: no

- interface changes: no

details:

This patch is change the way the SequentialMergeExchangePOperator

connector computes its local property instead of blindly

propagating the child's local property.

The patch also includes minor code clean-ups (moved some methods down)

Change-Id: Ie37e03b6fc6e55fc21f8324c0f09a7fa05b51769

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3005

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

[ASTERIXDB-2466][FUN] Implement window functions

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Implement window functions with SQL syntax:

function() OVER ((PARTITION BY expr1, expr2, ...)? ORDER BY exprA, exprB, ...)

- Where supported functions are:

ROW_NUMBER(), RANK(), DENSE_RANK(), PERCENT_RANK(), NTILE()

Change-Id: Ia28af8773cb11049c38d440c51b9c3cd1ed2bab4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3002

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

  1. … 153 more files in changeset.
[NO ISSUE] Fix AsterixServerIntegrationUtil

Add test dependency on LSM test classes used at

runtime in AsterixHyracksIntegrationUtil and added

exception to dependency plugin since these dependencies

can't be found at compile time

Change-Id: I5c92f45343710ca28d7c4d2e655fa0acd68868ba

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3011

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[ASTERIXDB-2469][TEST] Tests Can Result In False Positives For Numericals

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- The test framework doesn’t differentiate between numeric types in

expected results.

- With the current behavior, when comparing numerical cases,

as a last step, we try to convert both numbers to double and

do a comparison (in case the String camparison failed already),

this is good for the cases of having something like: expected 100.0

and acutal 10E1 (for whatever reason), in this case the String comparison

will fail, but the double conversion will produce the correct result.

- With this change, we ensure the above behavior is maintained,

however, we check that the types are compatible first, for example,

if the expected is 100.0 and the actual is 100.0, this should succeed,

but if the expected is 100.0 and the actual is 100, then this will fail,

this way we ensure correctness of both the numerical value as well as

correctness of data type check.

Change-Id: I918b7e5c3c39271f77a7d5a01ff634c2a0221ebc

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3009

Reviewed-by: Till Westmann <tillw@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Merge commit '10233dcd' from 'stabilization-f69489'

Change-Id: I246fbb4e2081e9d58c53bf560540ecd8b7864009

[ASTERIXDB-2454] Remove non-unique AQL tests (pt.1)

Change-Id: I13f676e9322f8b94e8c9686b261e8752c7100724

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3007

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

  1. … 3328 more files in changeset.
[NO ISSUE][OTH] Do Not Close Client Connection After Failure

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Currently, after sending some failure responses (e.g. after

servlet not found), the client connection is closed even if

the connection was supposed to be kept alive. This change

ensures that we do not close the client connection -- if keep

alive is requested -- which allows the client to submit another

request using the same connection.

- Ensure a full http response is sent to the client in case of

a failure and not only the response header.

- Refactor logic to set connection header.

Change-Id: Id0fce2c860eec97f3d368ee42f25dbdfc9dc0ff9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3006

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

[ASTERIXDB-2459][FUN] Add var() and var_pop() aggregate function

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

1. Add variance and variance population aggregation function and test cases

2. Add var() and var_pop() distinct functions

3. Add documentation for var() and var_pop()

4. Removed some empty tests cases from parser tests

Change-Id: If736c94146f1d6ee4dfa46a67737b1abd29c8e2d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3004

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 488 more files in changeset.
[NO ISSUE][ING] Refactor Active Suspend/Resume Logic

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Refactor the logic for checking DDLs on connected datasets.

- Refactor suspend listener API to allow for suspend for a DDL

on a dataset.

- Allow suspended active listeners to be unregistered. This is

done to support removing suspended listeners on active entities

that were dropped.

Change-Id: I38254582e08d97951a949f7327c8c3d7cf2ab51d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2999

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[ASTERIXDB-2467][STO] Fix locking protocol with bad tuples

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- The current locking protocol is not correct when there are bad tuples,

e.g., duplicates. When locking fails, the write must push partial frames

so that the previous acquired locks are released. However, if there are

bad tuples in the frame, after bad tuples are removed from the frame, the

state of pushed partial frames will be completely lost.

Change-Id: I86baa1f21ef7390777c8e2b0ce226095528e7f18

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3003

Reviewed-by: Xikui Wang <xkkwww@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[ASTERIXDB-2459][FUN] Add sttdev_pop() aggregate function

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

1. Add stddev_pop aggregation function and test cases

2. Add stddev and stddev_pop distinct functions

3. Fix some stddev test case comments

4. Add documentation for stddev_pop

Change-Id: I1732d8d70eba26e12a6e68d0e0c621491ed6b3ae

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2997

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 295 more files in changeset.
Revert "[ASTERIXDB-2454] Remove non-unique AQL tests"

This reverts commit f372c96ddb3414e7f4f54b13059b065310157d65.

Change-Id: Ie8c4c9b50ed3daf528c75168b6d9c2d675cd04a5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3001

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

  1. … 4537 more files in changeset.
[ASTERIXDB-2454] Remove non-unique AQL tests

Change-Id: I13f676e9322f8b94e8c9686b261e8752a7100722

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2979

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 4537 more files in changeset.
[ASTERIXDB-2286][COMP][FUN][HYR] Parallel Sort Optimization

- user model changes: yes

- storage format changes: no

- interface changes: yes

details:

- new plan for sort operation which includes sampling and

replicating the stream of data to be sorted. Sort-merge connector

is removed from the plan. The sorted result now is in multiple partitions.

- new optimization rule to check whether full parallel sort is applicable.

- new Forward operator to read the replicated sort input stream and

to receive the ouput of the sampling.

- new sequential merge connector to merge a globally ordered result residing

in multiple partitions (in addition to the connector's partition computer).

- "asterix-lang-aql/pom.xml" is changed as a result of refactoring

code related to the range map handling.

- new private sampling function to generate the range map object

(local & global functions) & their type computers.

user model changes:

- new compiler property is added to enable and disable parallel sort.

interface changes:

- "ILogicalOperatorVisitor.java" includes Forward Operator.

- "ITuplePartitionComputer.java" includes initialize() to enable partitioner

to do some initialization. FieldRangePartitionComputerFactory uses it to

pick a range map.

- "ITuplePartitionComputerFactory.java". createPartitioner() is changed to

createPartitioner(IHyracksTaskContext hyracksTaskContext). Context is needed

for transferring the range map throught the context.

Change-Id: I73e128029a46f45e6b68c23dfb9310d5de10582f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2393

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 343 more files in changeset.
[ASTERIXDB-2461][FUN] Fix LocalAvgTypeComputer

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

1. Changed the type of count from INT32 to INT64 because AVG uses a long

to store count

commit 7cfdaf0b8fb452ead4183a8f24a5b5dd21354fa0

Author: James Fang <jfang003@ucr.edu>

Change-Id: Ic693d027190b43fa3deaaf83ebf73f62c77d5a76

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2996

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

[ASTERIXDB-2459][FUN] Add sttdev() aggregate function

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

1. Added stddev aggregation function and test cases

2. Added stddev to documentation and fixed some typos

3. Added serializable aggregate optimizer test

4. Change IncompatibleTypeException in aggregates to be deterministic

commit 26edb576f55a3d2308996f054a58ad43ab910f9b

Author: James Fang <jfang003@ucr.edu>

Date: Fri Oct 5 15:10:37 2018 -0700

Change-Id: Ia709669a9d20358f11ad28f453ae8ad8551f6334

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2990

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 457 more files in changeset.
[ASTERIXDB-2264][ING] Introduce Http Feed Adapter

- user-model changes: add http_adapter for feed.

- storage format changes: no

- interface changes: no

Details:

1. Added http feed. User may use following syntax to create a http feed:

create feed TweetFeed with {

"adapter-name" : "http_adapter",

"addresses" : "asterix_nc2:10002,asterix_nc1:10001",

"address-type" : "NC",

"type-name" : "TweetMessageType",

"format" : "adm"

};

2. Refactored insert-feed test case to avoid waiting for 10s.

3. Refactored some constants in feeds.

Change-Id: I3c197a3df557ecc01f07f0907688c4ea81379e40

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2994

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +8
    /asterixdb/asterix-external-data/pom.xml
  1. … 8 more files in changeset.
[NO ISSUE][COMP][RT] Enable multiway similarity joins

- Enable the FuzzyJoinRule that transforms

a nested-loop-similarity-join plan to a three-stage-similarity join.

- Modify FuzzyJoinRuleCollections.

- Add the ExtractCommonExpressionRule to extract common expressions

in the star-like multiple similarity join substitutions.

- Add the InlineSubplanInputForNestedTupleSourceRule to translate

the generated subplan from the similarity function-derived

substitution into join in case of nested schemas.

- Use similarity-jaccard-prefix to enable the pp+ join strategy.

- Use the right side to build the heavy hash join on

the prefix tokens from both sides.

- Add RemoveAssign/Variables/AggRules to iteratively remove unused

assign/vars once FuzzyJoinRule is applied in each round.

- Add three new optimization cases for multiway similarity joins.

- link-like multiway similarity joins

- star-like multiway similarity joins

- hybrid multiway similarity joins with the both styles of similarity joins.

- Add a check whether a similarity function is on

a select over an existing similarity join.

- Change the inverted-index-based similarity join to the three-stage-similarity join

due to efficiency considerations.

Change-Id: I8736f104905eeda763d39709e002c2b9629278cc

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1076

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

    • -0
    • +100
    /asterixdb/asterix-app/data/dblp-small/csx-small-multi-id.txt
    • -0
    • +100
    /asterixdb/asterix-app/data/dblp-small/dblp-small-multi-id.txt
    • -0
    • +100
    /asterixdb/asterix-app/data/pub-small/csx-small-multi-id.txt
    • -0
    • +196
    /asterixdb/asterix-app/data/pub-small/csxauthors.adm
    • -0
    • +100
    /asterixdb/asterix-app/data/pub-small/dblp-small-multi-id.txt
    • -0
    • +194
    /asterixdb/asterix-app/data/pub-small/dblpauthors.adm
  1. … 246 more files in changeset.
[NO ISSUE][DOC] Documentation improvements

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Add variable.* to SELECT clause

- Add section and example for variable scope in JOIN subclauses

Change-Id: I654fb35f3632cb46fc0ecdce3f12af72c2356091

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2993

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][TEST] Allow Requests To NC Endpoints By Port

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Currently, the test framework allows sending requests to

NC endpoints that are referenced by name if that name was

added to the list of available NC endpoints. This change

allows a request to be sent to any endpoint by specifying

the endpoint port in the test file.

- Modify a test case to utilize port-based NC endpoints.

Change-Id: If0ad80bed625c45da01aa018e4267409c329be9e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2991

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][COMP] allow optimization rule to inspect other functions + fixes

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

1. allow the optimization rule "InjectTypeCastForSwitchCaseRule"

(renamed to "InjectTypeCastForFunctionArgumentsRule" now) to consider other

functions specified by the user in addition to the ones already considered

by the rule.

2. fix an issue related to ConstantFoldingRule that affects some existing

functions where the rule would have the function compute the value but fail

to deserialize it (read it) back due to differences in compile-time type

and runtime type.

3. fix static casting of a list constructor function which fails to cast

open its items when the item is a function that returns a closed derived

type.

Change-Id: I65679e934a41e00b04bc3fd479ed404af293eb21

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2980

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>