asterixdb

Clone Tools
  • last updated 28 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[ASTERIXDB-2375][RT] Evaluate constant experession in SELECT only once

- user model changes: none

- storage format changes: none

- interface changes: new method added to ComparisonHelper to handle

cached value.

Currently, in datascan case, the constant value is evaluated on per

tuple bases. We could cache the value to avoid the deserialization of

the constant value each time.

Change-Id: Iae4e78928da2bd63b2984b3624b88baed9b7cd73

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2621

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 13 more files in changeset.
[ASTERIXDB-2395][COMP] Source location handling cleanup

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Minor cleanup in source location handling

- Created error codes for unknown node group / function / type / index

Change-Id: Ia5e0b67c49f66dd27c67832707f5003892453fc3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2676

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 3 more files in changeset.
Merge commit 'e2a536e986f3966d8dd7598e9f0d8c281e41352e' from release-0.9.4-pre-rc

Change-Id: I130fe8651cd3787b588044b35e8f3473350ecb3b

    • -0
    • +223
    /asterixdb/src/main/licenses/content/raw.githubusercontent.com_netty_netty_netty-4.1.25.Final_NOTICE.txt
    • -214
    • +0
    /asterixdb/src/main/licenses/content/raw.githubusercontent.com_netty_netty_netty-4.1.16.Final_NOTICE.txt
Merge "Merge commit 'b1767b1577b3a794e7d2740c28d0fae955cd0efc' from release-0.9.4-pre-rc"

[ASTERIXDB-2396][LIC] Include netty-all required NOTICEs

Change-Id: I84f1613b16b8babd4df57c0f6fa356cdba322b54

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2678

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +214
    /asterixdb/src/main/licenses/content/raw.githubusercontent.com_netty_netty_netty-4.1.16.Final_NOTICE.txt
Merge commit 'b1767b1577b3a794e7d2740c28d0fae955cd0efc' from release-0.9.4-pre-rc

Change-Id: Id7a5a6cd252867e8ee69fd2bd6157ff64668256f

[NO ISSUE][ING] Allow Readers to add their own stats

- user model changes: no

- storage format changes: no

- interface changes: yes

- Add IRecordReader.getStats()

Details:

- Allow record reader to contribute their own stats.

Change-Id: Ib064bd97b33f2d9da330bac3a49bd4c6831faaca

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2642

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE] Improve readability of cluster capacities

Output memory portion of cluster capacity as human-readable byte values

Change-Id: Ifa9270a3d111540fea6db32cf285c8710ff2aed0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2674

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE] Dashboard build fixes

- Stop use of ~/.npm

- Assure asterix-dashboard jar contains proper resources

- Update node/npm versions to fix OSX build issues

Change-Id: I1c055aa81e79612361e9e685e5bea69cfb9c4c2b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2672

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -76
    • +14
    /asterixdb/asterix-dashboard/pom.xml
[NO ISSUE][STO] Skip deleting unallocated memory component

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- This change fixes the component delete logic

- It first ensures that memory is allocated for the index

- Then it checks whether the memory component is to be deleted

- This is important since there might be cases where primary

index has the memory allocated but not the secondary and

without allocating secondary and deleting it, we could end

up with memory components with different ids.

Change-Id: I0c6c7968830f3c9241bd036c0a330be1400349b4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2668

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[NO ISSUE][STO] Only delete allocated components

Change-Id: I372127a0dec21148efa1a94cf6c976818963d761

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2671

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[NO ISSUE][COMP] Add aliases for type functions

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Add aliases for type functions:

is_atom(), is_bool(), is_num(), is_str(), is_obj(),

to_atom(), to_bool(), to_num(), to_str(), to_obj()

Change-Id: I83508d3a439cd7b707c0ce9f43d7b7482aa162f0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2670

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE] Fix ClassCastExceptions in MXHelper

Change-Id: Ibf79fe10447f0f7e93c421c9b10b6f4cb84a6a60

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2669

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE] Introduce AsterixServerIntegrationUtil

Add integration util flavor with 'asterix-server' classpath, e.g. includes

asterix-dashboard

Change-Id: I5371a6bb03249ca34f4797713ee6b176a8f8f757

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2667

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE] Load asterix-dashboard via service provider

Change-Id: I0a5005cb8cfedf7ce2f59e76636f9dd21a0cc151

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2664

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][STO] Improve logging when failing to schedule a flush

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Log partition info when failing to schedule a flush operation.

- Fix isCurrentMutableComponentEmpty() to consider the

UNREADABLE_UNWRITABLE state.

Change-Id: I9bbc0be36633b896becc16d3eeddeef980db5802

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2662

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[ASTERIXDB-2393][COMP][RT] Add source location to error messages

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Add source locations to compiler and runtime error messages

- Add source location enforcement to the test framework

and enable it for SqlppExecutionTest

Change-Id: Ie279ce345d1edcb5dea8e55cdb0233151c7bfd66

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2659

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 666 more files in changeset.
[ASTERIXDB-2318] Build dashboard in mvn

This patch makes the build of the dashboard run along

with everything else instead of having the production

package checked in as source. The license is also taken

from ng and integrated with the rest of the licenses

instead of being static.

Change-Id: Iccea033d426f5d205658d1c11867f8aaab4d24ca

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2652

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -0
    • +174
    /asterixdb/asterix-dashboard/pom.xml
  1. … 249 more files in changeset.
Remove old GA script from docs

Change-Id: If3cf5747553a56e3c80b6286ee395aa7a7e8afdb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2657

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -9
    • +0
    /asterixdb/asterix-doc/src/site/site.xml
[NO ISSUE][RT] Make start and cancel job uninterruptible

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Previously, a Hyracks data connection that starts

a job might be interrupted before it receives the

job id. This would leak resources since that job

will run even though, no one is going to read its

result.

- Similarly, job cancellation can be interrupted and

so the job which was meant to be cancelled will

continue running.

- To avoid this, a new thread is added to Hyracks

Client Connection which takes care of starting

and cancelling of jobs. The thread submitting these

requests will be un-interruptible until those calls

return.

Change-Id: I27b2aaae902b19829bd2df2ae04c5e704f5ca8e8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2639

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[NO ISSUE] Add variable resolution appendix

- update maven-site-plugin to version 3.7.1

- update maven-fluido-skin to version 1.7

Change-Id: Ibd4abd52f05d652d9436670b59beeb7cb6b846b5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2653

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -5
    • +5
    /asterixdb/asterix-doc/src/site/site.xml
[NO ISSUE][RT] Eliminate HashMap lookup during comparision

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Eliminate the use of hash map to store type tags. Replace it with a

simple TypeTag[] to improve performance.

Change-Id: Ie5b8efdcb226a8818deaf57a6305a18107544feb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2655

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][STO] Improve error handling of writing deleted file

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- When the bulkloader is aborted, the file would be deleted from the

buffer cache but there could still be unflushed pages in the write

queue. Instead of throwing exceptions, simply ignore the case when

writting to non-existing files (as before).

Change-Id: I3f693ef178e0ab68c2a28b0edc6ffeaaeca1c520

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2651

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Merge commit 'f02b43bcff1c859b933f55df9654899d025b1ed3' from release-0.9.4-pre-rc

Change-Id: I2b825e2d8b5defb67fba39f4912cfaa44111233f

[NO ISSUE][OTH] Make Http Channel Initializer Extensible

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Make Http channel initializer extensible.

- Move to latest netty stable release.

Change-Id: I64f737f2da709df75baec1e8a500fd4abdde5a52

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2649

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][STO] Misc Storage Fixes and Improvements

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- This change introduces some improvements to storage

operations.

- Local RecoveryManager is now extensible.

- Bulk loaders now call the IO callback similar to

Flushes, making them less special and creating a

unified lifecycle for adding an index component.

- As a result, The IndexCheckpointManager doesn't need

to have a special treatment for components loaded

through the bulk load operation.

- Component Id have been added to the index checkpoint

files.

- Cleanup for the code of local recovery for failed flush

operations.

- Ensure that after local recovery of flushes, primary

and secondary indexes have the same index for mutable

memory component.

- The use of WAIT logs to ensure in-flight flushes

are scheduled didn't work as expected. A new log type

WAIT_FOR_FLUSHES was introduced to acheive the expected

behavior.

- The local test framework was made Extensible to support

more use cases.

- Test cases were added for component ids in checkpoint files.

The following scenarios were covered:

- Primary and secondary both have values when a flush is

shceduled.

- Primary have values but not secondary when a flush is

scheduled.

- Primary is empty and an index is created through bulk

load.

- Primary has a single component and secondary is created

through bulk load.

- Primary has multiple components and secondary is created

through bulk load.

- Each primary opTracker now keeps a list of ongoing flushes.

- FlushDataset now waits only for flushes only and

not all io operations.

- Previously, we had many flushes scheduled on open datasets.

This was not detected but after this change, a failure

is thrown in such cases.

- Flush operations dont need to extend the comparable

interface anymore since they are FIFO per index.

Change-Id: If24c9baaac2b79e7d1acf47fa2601767388ce988

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2632

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 75 more files in changeset.
[NO ISSUE] Format test query

- user model changes: no

- storage format changes: no

- interface changes: no

Change-Id: I6e8e8cd75f401a085fb93a5d599a3b1ecda50a9e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2647

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[ASTERIXDB-2387][MTD] Prevent Dataset Primary Index Drop

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Ensure a dataset primary index cannot be dropped

without dropping the dataset.

- Add test case.

Change-Id: Ic2256925d088fa5b5ba3b9623a29b6219b5a9b1e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2645

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][STO] Fix concurrency issue in merge operations

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Synchronize on opTracker when entering components for merge

operations.

Change-Id: Ic612afe7bd250dea1a75d6121af437a201636381

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2643

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[ASTERIXDB-2386][CLUS] Allow extension of the global recovery manager

Allow the Asterix GlobalRecoveryManager to be extended

Cleanup some deployed job spec methods

Change-Id: I1213e702a77ededde18ee0b50bc105212f43480d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2640

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>