asterixdb

Clone Tools
  • last updated 15 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE][NET] Split delivery of messages and exceptions

- user model changes: no

- storage format changes: no

- interface changes: yes

Change-Id: I5a97e1eb1e2a3ec207591b3d5b8b7f1949a80fbc

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4025

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[NO ISSUE][COMP] Fix internal error with composite key index

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fixed ArrayIndexOutOfBoundsException in

BTreeAccessMethod.createIndexSearchPlan() when

there's a composite key index and a query predicate

that operates on a subset of its key fields.

E.g.

create index ... on .. (a,b,c);

select ... from ... where a = ... and c = ...

Change-Id: I87deb2537a97789b93a7174f97470b46a0558188

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4003

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

[NO ISSUE][DOC] Fix doc of recovery memory budget

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

Fix the doc of recovery memory budget to clarify that

the memory budget is enforced for each job, not globally

Change-Id: I36650591fc6bbf5abae739f9fb1981ba22549be2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3983

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Merge branch 'gerrit/mad-hatter' into 'master'

Change-Id: I2059c989bd17c0e1677269ae48af3fd38ccce12b

[ASTERIXDB-2665][DOC] fix typo in primer

- user model changes: yes

- storage format changes: no

- interface changes: no

Change-Id: I7b1114c4e61f50881879ecb2ca455a96bd1734a0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3945

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Merge branch 'stabilization-f69489' into 'mad-hatter'

Change-Id: I07cab31b76128dfa5cea9b49620b1c074b385c81

[NO ISSUE][STO] Force Checkpoints/Index Metadata Files to Disk

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Ensure the system checkpoint file is forced to disk.

- Ensure index metadata files and checkpoints are forced

to disk.

Change-Id: I27ab8ed39e23760b514640d77532a1dc24a97992

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3943

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE][COMP] Fix incorrect error with if_*() functions

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fixed incorrect 'Type incompatibility' error raised by

the compiler when arguments of if_null(), if_missing(),

and if_missing_or_null() have different complex types

(array and record)

Change-Id: Idb285a3314604cd19a76d011a4739476fb7c7d7c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3903

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

[ASTERIXDB-2659][API] validate request parameters

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Return 400 BAD request for invalid request parameters.

- Changes in specifying the output format:

HEADER "Accept": application/json;lossless=<BOOLEAN>, text/csv;header=absent/present, application/x-adm

Request parameter "format": csv, json (and above mime types)

- when format is supplied in "Accept", only validate value of attribute if the mime is one of the above

and the attribute name is one of the above (header & lossless).

Change-Id: Ia89fa3179cc36a73fe950f41eab1f0a9d17a541c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3767

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

Reviewed-by: Till Westmann <tillw@apache.org>

Contrib: Till Westmann <tillw@apache.org>

  1. … 66 more files in changeset.
Merge branch 'gerrit/mad-hatter' into 'master'

Change-Id: Ie4f5abbf708915146ca11f2074ba05bfae753626

[ASTERIXDB-2662][FUN] Update string functions documentation

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Update documentation for string functions to include

the following:

- Correct the existing values in documentation.

- Include 1-based functions in documentation.

- Include 0-based and 1-based aliases to documentation.

Change-Id: Ic8ccafe994ac0d30136fb82e0822ae89054ff101

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3844

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Hussain Towaileb <hussainht@gmail.com>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

[NO ISSUE][COMP] Fix wrong result with indexnl outer join

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fix duplicate tuples in the result when indexnl hint

is applied to a standalone left outer join

Change-Id: I0e692d731caa9914438817b299c64569130075b0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3805

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

  1. … 10 more files in changeset.
[NO ISSUE][NET] Exclude Warn Logs When No Buffer Factory is Used

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Do not warn about recycled partial frames when no buffer

factory is set in FullFrameChannelReadInterface as those

are valid cases that use a single frame to perform the

complete operation.

Change-Id: I80251c529eb15ee22d01c320883418ea80272c2c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3824

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][HYR][STO] Remove unnecessary serialization support

Change-Id: I1f3932005cac33fef5096af4a772b401ad0a7fd1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3803

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Merge branch 'gerrit/mad-hatter' into 'master'

Change-Id: I892dfdc0f2f61cb20e17995d797598b420e8c554

[ASTERIXDB-2657][FUN] String 1-based functions + function aliases

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Removed compiler property compiler.stringoffset.

- Add 1-based string function to the following functions:

position, regex_position

- Add aliases to the following functions:

position, substring, regex_contains, regex_like,

regex_position, regex_replace

- Add test cases for the above mentioned functions and

aliases.

Change-Id: I0df799f197e430a9cd7d1b2a45e372a0cd77347e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3643

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Hussain Towaileb <hussainht@gmail.com>

  1. … 411 more files in changeset.
[NO ISSUE][TEST] Do Not Print regexjson Actual Test Result

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Do not print actual test result when comparing the result

using regexjson.

Change-Id: Ia1381aa20d0ed47eb11ab8474c1acad1bd2988fb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3806

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Michael Blow <mblow@apache.org>

[NO ISSUE][STO] Persist Bloom Filter Existence in Index Metadata

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- To clearly identify whether an index has a bloom filter or

not for BTree indexes, persist this information in the index's

metadata stored on each NC.

- For backward compatibility, when reading an index's metadata that

was created before adding the hasBloomFilter field, default its

value based on whether or not the index is a primary key index.

- Remove unused special readObject from LSMBTreeLocalResource.

Change-Id: Icec570d490987de401c036790ee9567238a60301

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3804

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 6 more files in changeset.
[NO ISSUE][RT] Report Disk IO Per Operator

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Do not collect per thread stats when runtime

profiling is disabled.

- Include per operator disk IO in task profile.

- Remove aggregated disk IO count from the query

response metrics.

- Adapt test cases.

Change-Id: Iced174ae5d4fa9ca13f597325cbb66ff80819e71

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3783

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Murtadha Hubail <mhubail@apache.org>

  1. … 4 more files in changeset.
[NO ISSUE][TEST] Default test charsets to UTF-8 only

Change-Id: Ia7278fa522d484a4d686cb6436d7e2f50bd7a170

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3765

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][OTH] Eliminate Object Creation on Thread Stats Lookup

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Use the thread object for thread stats lookup

rather than the thread id to avoid boxed objects

creation on stats lookup.

Change-Id: I5b8b26be9d3439889e21cf097ea86c413e973e1d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3763

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

Merge branch 'gerrit/mad-hatter' into 'master'

Change-Id: I7e921b559f30adfab704143818dd7ee59e194eb4

    • -16
    • +7
    /asterixdb/asterix-lang-aql/src/main/javacc/AQL.jj
[ASTERIXDB-2656] Remove frame constraint in HHJ probe

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

During the probe phase, we should not have the 1-frame

limit for spilled partitions. It wastes the memory and

leads to flushing small objects directly to the disk as

a large object.

Change-Id: I7580ecbe7db36d018348cd82d3864ca6c2ff439d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3703

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

[ASTERIXDB-2648][COMP] Fix dataset order in broadcast hint

- user model changes: yes

- storage format changes: no

- interface changes: no

details:

- Provides hash-bcast hint to replace bcast hint which makes

broadcast join consistent with other types of joins for choosing

the broadcasting dataset based on dataset order in FROM clause.

- Chooses the build dataset to get broadcast based on the order

in the FROM clause not the WHERE clause (which was the case for

bcast hint).

Change-Id: I505fc8e0bc32c760ae0471c6b302bbfd8499be4a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3566

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 37 more files in changeset.
[ASTERIXDB-2655][STO] Default storage compression to enabled

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Use 'snappy' as default 'storage.compression.block' value

- Update tests to reflect the new default

Change-Id: I62428c01ec24bc72bdf3cdf903655b3d0d7acbdd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3683

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Michael Blow <mblow@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

Reviewed-by: Hussain Towaileb <hussainht@gmail.com>

[ASTERIXDB-2651][RT][FUN] Handle matching a literal backslash properly in LIKE

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- fixed an issue in the build() of RegExpMatcher where the "flags" argument gets ignored if the flags

argument does not change in the subsequent evaluation of the regexp_* functions over the tuples of dataset.

- added the missing Java regex meta characters.

- split test case "regexp_replace" into two, "regexp_replace" & "regexp_replace_with_flag".

Change-Id: I4f218f87f0c1736e2d8b5de07221d7efa0f9aef1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3614

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 86 more files in changeset.
[NO ISSUE] Fix type inference for ANY in UDFs

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

When data type is available, we should use defined data type. If not, we

should try to infer the data type from the data.

Change-Id: I6a03749fe041ec6f43de230d3e784122f7664545

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3405

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

[NO ISSUE][NET] Log ChannelReadInterface Stats on Failure

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- When the read buffers of a FullFrameChannelReadInterface

are exceeded, log its stats to help in debugging the issue.

- Warn when a partial frame is being written over a full

frame write channel.

- Rename ThreadSafetyGuaranteedBy -> GuardedBy.

- Annotate networking calls with their synchronization

guards.

Change-Id: I89eed0c06dbf4b0e86747538bff286dc37853957

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3663

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Al Hubail <mhubail@uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE][TEST] Fix extraction of multi-document result in test executor

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Fix extraction/writing within test suite for multiple document result as proper JSON document

Change-Id: I879e045e2ae7f64f662993afb46cad7b29c781b3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3623

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Till Westmann <tillw@apache.org>

Merge branch 'mad-hatter' into 'master'

Change-Id: I24f42dc32931a214a27c2c88fde163f665cc83db