asterixdb

Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[ASTERIXDB-2447][COMP] Parameter rewriting for if_missing, if_null functions

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Introduce cast operation for parameters of if_missing, if_null functions

(as performed for parameters of the switch_case function)

- Fix union type handling in TypeResolverUtil.generalizeTypes()

Change-Id: I768d8236f5b0ccb9a850304ffedd3686d911702d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2935

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][FUN] Add expected result for coalesce function test case

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Add expected result for coalesce function test case

so it does not share one with if_missing_or_null

Change-Id: I7d8135f702d10690823d88d8232d011505ee82f9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2934

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[ASTERIXDB-2444][STO] Avoid Using System Clock in Storage

- user model changes: no

- storage format changes: yes

- interface changes: yes

Details:

- Replace the usage of system clock timestamps in LSM

index components file names by a sequencer. The next

sequence id to use is determined by checking the list

of existing components on disk. Note that due to a

rollback, an index checkpoint file may have last valid

component sequence which is greater than what is on disk.

This should not cause any issues since only components

that have a sequence greater than that appears in the

checkpoint will be deleted.

- Replace the usage of system clock timestamps in LSM

index components ids by a monotonically increasing

sequencer. The sequencer is initialized after restarts

by the last valid component id that appears in the

index checkpoint.

- Refactor the logic to generate flush/merge file names.

- Refactor the logic to check invalid components.

- Adapt test cases to new naming format.

Change-Id: I9dff8ffb38ce8064a199d03b070ed1f5b924b8a4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2927

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 9 more files in changeset.
[ASTERIXDB-2445][COMP] Nullable category handling in TypeComputeUtils.getResultType()

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- TypeComputeUtils.getResultType() currently makes the output type unknownable when

nullable category is passed. It should make it nullable instead

Change-Id: I0bb1e96c5a4f83a3d281811246da183d1a31e0f1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2932

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

[ASTERIXDB-2446][COMP] Improve error raised for a duplicate field name

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Improve error raised in case when there is a duplicate field name

in the SELECT clause. Throw compilation exception instead of

IllegalStateException at runtime

Change-Id: I2f442acd73b3018058909f65626694dfbb49acc6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2930

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][LOG] Include destination IP in thread name on push back

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- In certain cases, we noticed that threads of certain jobs are

waiting on the network boundaries to send tuples.

- In that case and in a big cluster, it is difficult to tell which

node is pushing back.

- To make this easy, we include the IP of the receiving node

in the thread name.

Change-Id: I81b48cb7a79de0a37f2171a1bd3b82141f89b49d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2929

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

(cherry picked from commit 2498d28f0584d6ab002625417622be429f5c8131)

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2942

[NO ISSUE][LOG] Include destination IP in thread name on push back

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- In certain cases, we noticed that threads of certain jobs are

waiting on the network boundaries to send tuples.

- In that case and in a big cluster, it is difficult to tell which

node is pushing back.

- To make this easy, we include the IP of the receiving node

in the thread name.

Change-Id: I81b48cb7a79de0a37f2171a1bd3b82141f89b49d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2929

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][COMP] Fix TypeComputeUtils.getResultType

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fix TypeComputeUtils.getResultType to either return

unknowable or missable type.

Change-Id: Id881f2a5ad8134a3e86b2b08ce1acdc53c4948a2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2928

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

[NO ISSUE][RT] Improve debuggability of runtime functions

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- This change introduce util methods to facilitate debugging

functions runtime. Runtime functions read and write

values from and into byte arrays.

- To allow easier inspection of such values, we provide

a method that takes a pointable and produces an adm

node representing the value pointed to by the pointable.

Change-Id: I33257507e9bdd3be80355218e4bafecd1c71c650

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2926

Reviewed-by: Till Westmann <tillw@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][FAIL] Fix message for over-/underflow

Change-Id: I1d2b071dce8f6ed485d57f131d5c9f8893041678

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2925

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][FUN] Add coalesce() function

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Add coalesce() function which is an alias to if_missing_or_null()

Change-Id: Ic462bc08173f2f2349cc208c687d432a219d62b9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2923

Reviewed-by: Till Westmann <tillw@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE] Allow override of dead node sweeper threshold

Change-Id: I3e534c277e52778ec4551247842acc51960a61b4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2922

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[NO ISSUE][NET] Ensure Thread Safety in FullFrameChannelReadInterface

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Use a blocking deque in FullFrameChannelReadInterface

to ensure thread safety between frame consumer and

the networking thread.

Change-Id: I33f0171e49b0ff972730a678e8b61a2070dc8832

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2921

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

Merge commit '167518f535616bea71d4d54a679c1db1590c48ca' from stabilization-f69489

Change-Id: I13ccae1109d1626db67d0bbf0898f4c745fa3238

[NO ISSUE] Fix log directory initialization

Change-Id: I1f4e11e030a8ffa387e1fa234ed9ad9e3fe380c5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2906

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Contrib: Michael Blow <mblow@apache.org>

[NO ISSUE][LIC] Fix override of both LICENSE and NOTICE for a single GAV

Change-Id: If1ceb510c7de8abdf46690a85368409f99907325

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2918

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][NET] Log Channel Info When Buffers Are Exceeded

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- When the read buffers of a network channel are

exceeded, log the channel information and throw

an illegal state exception.

Change-Id: I5290947f57c91d4a537330eef91cf23d9352f24c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2917

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

[ASTERIXDB-2442][FUN] substring() should return NULL if the operation cannot be performed

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- substring() should return NULL if starting offset is out of bounds

for given string or length is negative

(merge commit '42a739aba768357eb9f80f917f8967879bf44768' from stabilization-f69489)

Change-Id: Iedc34869feb91cd8015db36b61fee7e803e9ec1f

[ASTERIXDB-2442][FUN] substring() should return NULL if the operation cannot be performed

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- substring() should return NULL if starting offset is out of bounds

for given string or length is negative

Change-Id: Ia43a4266a2406ebba65809d527de896ad11fdffa

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2914

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 4 more files in changeset.
[NO ISSUE][NET] Propagate Network Failure Error Codes

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Pass the network error code to the channel

to determine whether the error should be

sent to the receiver or not.

Change-Id: I29cffa916df9fecc9942f449ba6c5ca7c84b43b3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2912

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

[NO ISSUE] Misc Fixes for Point MBR RTree

- user-model changes: no

- storage format changes: no

- interface changes: no

Details:

1. Fix the MBR calculation of Point MBR RTrees when finalizing the

bulkload process.

2. Fix the nullFlagBytes of Point MBR Rtrees.

3. Add unit test cases to cover Point MBR RTrees.

Change-Id: Ice24112152a2d93c7d2316b7506e6d6e81f2df44

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2911

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

[NO ISSUE][OTH] Log directory tweak, minor perf tweaks

Change-Id: I174d4527fb2c00aed26d83a49c92872ad1ddee00

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2910

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[NO ISSUE][TXN] Fix extension datasets tuple translators

Change-Id: Ifb8a8342d0f00468e1561d91eb802c52e66b149d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2908

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[ASTERIXDB-2441][COMP] Improve column alias handling in ORDERBY/LIMIT

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Introduce LET clauses for column alias expressions

instead of inlining them into ORDER BY/LIMIT clauses

- Fix incorrect visitor used in SubstituteGroupbyExpressionWithVariableVisitor

for rewriting LET clauses after GROUP BY

Change-Id: If925cbb803f2ad5fe955ba343ddc62585589b894

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2905

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Contrib: Till Westmann <tillw@apache.org>

  1. … 29 more files in changeset.
Merge commit '722e85d0347e628da99b5e479f3a9a993e549b03' from release-0.9.4-pre-rc

Change-Id: I0d3ac0768bed4271501ad3016d21f66f64ebb5fe

    • -0
    • +23
    /asterixdb/asterix-external-data/pom.xml
[NO ISSUE][EXT] Prevent NPE in close() when using TestTypedAdapter

WARN ...CleanupUtils - Failure closing a closeable resource

java.lang.NullPointerException: null

at org.apache.asterix.external.dataset.adapter.FeedAdapter.close(FeedAdapter.java:63)

Change-Id: If2d62ce00858ff9a9f8033bd21d5da5f1f207c56

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2903

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

[NO ISSUE][OTH] Fix sample cluster version check for latest Java 10

Change-Id: I51b93524d3ea1d342d48851d97ab21a2a9cb6720

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2904

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][OTH] Avoid NPE on response w/o content-length

Change-Id: Ifac2a5098f3c70348b20b2859d5d2fdddb3d8579

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2902

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

[NO ISSUE][HTTP] Fix buffer leak in HttpServer

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Prior to this change, cancelled requests before

they start leak request and response buffers.

- After this change, we distinguish between cancellation

of requests before they start or after and release resources

accordingly.

Change-Id: I9a34142e87158385152fa0a11be39abced307fcc

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2901

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Merge commit 'a6bd8d1ad87a85cf402d019de5f4e01855d99b34' from release-0.9.4-pre-rc

Change-Id: I03b642f9e0ad4bdc034cd8f33b712dbb87a66f5d