Clone
 

jianfeng jia <jianfeng.jia@gmail.com> in asterixdb

Change logical plan to apply filter from 2ndary index

- Changes the IntroduceLSMComponentFilterRule to

replace the constant filter value from the query to the value

carried from 2ndary index search.

- Can use 2ndary index filter even the query doens't contain

any filter related condition.

Change-Id: I0e2fe0208662e5dcd49d1a22bfb58f96533e9497

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1727

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -0
    • +5000
    /asterixdb/asterix-app/data/twitter/real.2.adm
    • -0
    • +5000
    /asterixdb/asterix-app/data/twitter/real.adm
  1. … 70 more files in changeset.
Carry filter in 2ndary-to-primary index search

Change-Id: I287f1dbd230aa649f1350114abf0a1d47e2bb53c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1720

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Luo Chen <cluo8@uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 42 more files in changeset.
Print filter information in logical plan

Change-Id: I8c3893fc54337695df4837e34ad7f7e89758718e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1673

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Support LSM-filter on multiple input paths

The IntroduceLSMComponentFilterRule only checked one input path,

which does not work for the multiple-path cases (e.g., intersection case)

This patch fixes this bug.

Change-Id: I390ac11f3a2781f10f726dce917d89ec640dd917

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1356

Reviewed-by: Taewoo Kim <wangsaeu@yahoo.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Add tests for ASTERIXDB-1300

The intersection for multiple-secondary indexes will follow the skip-index hint.

Change-Id: I797bdb37fda1c29c9cfc45efb6fbcba4e7b6c29e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1093

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Fix ASTERIXDB-1566 fix UTF8 comparator and hash function.

Change-Id: I187bf1243abf143b3b265fa8098614b9a72c65ad

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1054

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Fix the binary documentation

Change-Id: I509f0d4bc4b228d85226a85fe68d6ae97b52f5bd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/970

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Add the documentation for the `binary` data type

Change-Id: Iea9b29a1a8ff37617fb94cd562a1f885f8867ad3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/934

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Jianfeng Jia <jianfeng.jia@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Remove the not-existing interval-from functions

Change-Id: I9c22aaad20f4ca4ab594160ba69dec913d9956c2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/854

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Preston Carman <prestonc@apache.org>

Fix the ASTERIXDB-1336 and ASTERIXDB-1413

Change-Id: Iffc60490aea144cec9abd38349853764024b0ce0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/830

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Add the group-only test for ExteralHashGroupby

Change-Id: Ia0b6560e43dc56072a02ff1c105b54669cef0197

Reviewed-on: https://asterix-gerrit.ics.uci.edu/714

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Fix the ExternalGroupby for fuzzy join

Change-Id: I5a3852d08f9a3e2738ea2952f05aa082a2e6dbbb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/713

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Add the filesize parameter to estimate a better partition number for ExternalHashGroupby

Change-Id: I3aadec904af64cc2b7b03e6dff399a2288c21a7b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/451

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Implemented the memory-bounded HashGroupby and HashJoin for BigObject

It contains both hash grouby and hash join changes.

The main change is

1. update the ExternalGroupby to Hash-based groupby

2. update the Join operators to use the Buffermanager.

The buffer manager part is moved from the Sort package to upper

level so that it can be shared by all the operators.

Change-Id: I248f3a374fdacad7d57e49cf18d8233745e55460

Reviewed-on: https://asterix-gerrit.ics.uci.edu/398

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 133 more files in changeset.
Fix ASTERIXDB-1292

Change-Id: Iee8e9b87145d9b3511874cd11d61ae87acdc94c7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/636

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Intersect the secondary indexes before primary search

Change-Id: Ie167918fb23e39c8728840e4a90c1b85bf1bde85

Reviewed-on: https://asterix-gerrit.ics.uci.edu/578

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Jianfeng Jia <jianfeng.jia@gmail.com>

  1. … 13 more files in changeset.
Intersect the 2ndary indexes before primary search

The following commits from your working branch will be included:

Change-Id: Ic16c67c529ca19d8b1a5439ddef22760945fd0d7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/577

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 20 more files in changeset.