asterixdb

Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE][TXN] Fix txnid leak (off by one)

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fix leak of one id at start of each allocated block

- Increase block size from 100 -> 512

Change-Id: Ia97d8472f30ef0f68c51830b4cbb4660184d7393

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2465

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][EXT] Java UDF framework refactoring

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

1. Separated the JObjects and its subtypes.

2. Add JBuiltinTypes so we don't have to create an object to get JType.

3. Dead code removal.

4. Memory usage optimization in JRecord Serialization.

5. Several fixes about incomplete type implementations in Java UDF and

getting JObjects in UDF examples.

Change-Id: I3b648191b73fe4aad4f2a6ba1c2066c872fa16a9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2405

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 36 more files in changeset.
[NO ISSUE][TX] Fix WAIT_LOG Reading

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fix WAIT_LOG reading.

- Add test case.

Change-Id: I6a8b75152466f96a4b00cc6f2d25582ba65e6013

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2466

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][ING] Follow the IFrameWriter contract in Feed Pipeline

- user model changes: no

- storage format changes: no

- interface changes: yes

- it removes unneeded ITupleForwarder interface.

Details:

- Previously, if a failure happens at the writer.open

call in the FeedIntake operator, the IFrameWriter

protocol is not followed since we don't fail before

close is called.

- Previously, fail calls can be done as well inside

of the feed adapter.

- This change moves failing the pipeline outside the

adapter and so the adapter's responsibility is

getting records from outside the system while

the operator takes care of opening, failing, and

closing the writer.

Change-Id: Ife679fb9643dc6b39d035e0eecdb915b227503a5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2463

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 8 more files in changeset.
[NO ISSUE][TX][FAIL] Halt on LogFlusher failure

- user model changes: no

- storage format changes: no

- interface changes: no

- cures cancer: no

Change-Id: I69c4bf6c9669601e6613a9435de046d72b0baf6d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2464

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +4
    /asterixdb/asterix-transactions/pom.xml
[ASTERIXDB-1952][TX][IDX] Filter logs pt.2

- user model changes: no

- storage format changes: yes

- interface changes: yes

Details:

- Add a log type specifically for filters

- Only log change when filter actually widens

- Stop logging of index + filter tuple during modification

- Redo index and filter tuples separately via their logs

Change-Id: Ie9e7795d9c8c212e8610dcb9bb5d26ec9fbbee8a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1857

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 32 more files in changeset.
[NO ISSUE][LIC] Incremental progress on dashboard licensing

Change-Id: I85e7cef82d54ff5af1a5942ab368931490b70707

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2462

Tested-by: Michael Blow <mblow@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[ASTERIXDB-1280][TEST] JUnit cleanup

- user model changes: no

- storage format changes: no

- interface changes: no

Change-Id: I2a57643682d45097ae5ac4adc1fe97fbb3111385

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2461

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE][CLUS] Fail Tasks When NC Not Active

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fail StartTasksWork if NC is not in active

state (i.e. hasn't completed startup tasks).

- Set NC state to active only after completing

startup tasks.

- Add test case.

Change-Id: I447d4f1e255211e9026b68eb9d931f25846ed153

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2460

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE] Change the working directory of UDF

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Currently, there are two places for hosting UDFs. One is

"user.home/library", and the other is "app.home/lib/udfs". The former

one was used by Managix and is no longer supported. It also causes

problem for OSX users since it's collided with the system folder. From

now on, all udfs are placed under "app.home/lib/udfs". In the case where

"app.home" is not defined, "user.home/lib/udfs" will be used.

Change-Id: I409039d0ca054069853653b312b9f6187365a73b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2448

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][TEST] Close HTTP requests upon thread interruption

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Ensure Http client in tests closes on interrupt.

Change-Id: I39e43b8136df6b6a7965d033ca8892feda7394d4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2458

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[ASTERIXDB-2313][EXT] JSONDataParser support for non-object roots

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- JSONDataParser API should support parsing documents

with non-objects at the root

Change-Id: I313924d0704f5ac735e592b46ed41e0e2f7cfd06

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2459

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][STO] Stop After First Successful Checkpoint Write

- user model changes: no

- storage format changes: no

- interface changes: no

Change-Id: Idaaa01dd7c6db03f25a496d1ff7a71a1488d5fff

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2457

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

[NO ISSUE][STO] Improve the LSMIOOperationCallback interface.

- user model changes: no

- storage format changes: no

- interface changes: yes

+ ILSMIndexOperationContext.getIoOperationType()

+ ILSMIndexOperationContext.getNewComponent()

* before, after, and finalize

calls of ILSMIOOperationCallback now take

ILSMIndexOperationContext as a parameter

Details:

- Before, some calls to ILSMIOOperationCallback

take just an enum LSMIOOperationType, some of them

take an enum and a component object. These sometimes don't

provide enough information to different implementations of

the callback that might be interested in more than that.

- Having the operation context object passed allow for

better exchange of information between different callers

and callees throughout the IO operation.

Change-Id: Ib7120c40a1a2256ed528dfd2e5853db9dba247c6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2455

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 4 more files in changeset.
[NO ISSUE][TEST] Retry on file copy, ignore failures after 3 retries

- for NCServiceExecutionIT based tests, print JVM final flags, help ensure

max gc wait time is being configured properly by NCService

Change-Id: I7127ee0dcba6ead1a19a373b62e4d6aa22467909

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2454

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

[NO ISSUE][FUN] Add to_number() function

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- add to_number() function

- add testcases and documentation

- fix type inference for to_bigint() and to_double()

to return optional type in cases when NULL can

be produced at runtime

Change-Id: Id370aadcf16447f7c775c30d2bffc33fc6a96927

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2449

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 6 more files in changeset.
[NO ISSUE] Update ASF copyrights to 2018

Change-Id: Ib0d2fcda89b23066154f1fd8a466f3b4bf103d78

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2452

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[ASTERIXDB-2229][OTR] Restore Thread Names in Thread Pool

- user model changes: no

- storage format changes: no

- interface changes: no

- Restore thread names to their original names

before returning them to the pool of the NC

app.

- Remove explicit thread name resets.

- Delete unused ThreadExecutor class.

Change-Id: I3bda1b65e7aefd35d2b8cfa814f73369c3bf5a18

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2447

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[ASTERIXDB-2304] Ensure Flush is Finished in FlushRecoveryTest

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Previous in LSMFlushRecoveryTest, it's possible during recovery

we check component ids before the flush is finished (since flush is

asynchronous), and thus causes intermittent failures. This patch fixes

this problem by waiting for active IOs before checking component ids.

- Fix the problem the override config options in TestNodeController not

working.

- Also fix [ASTERIXDB-2309] to ensure only indexes of a given partition

are flushed upon seeing a FLUSH record.

Change-Id: I1704c6606c7c7bef226ae31961c347c6ebb76c2a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2437

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE] Take defensive copy of array options

Change-Id: I6085e7fc392e8bac960c478bf1500b077528c4ea

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2451

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[NO ISSUE][CONF] Reduced Metadata Datasets Memory Budget

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Reduce memory budget of metadata datasets from

32 to 8 pages.

Change-Id: I01b92778eda67c2ad93babc92ba509765d63fb43

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2450

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][FUN] Add array_length()

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Add array_length() which is an alias for len()

- Add testcases

- Add comment explaining logical plan generation for

EVERY quantified expression

Change-Id: I5bd03717d3cc41567d6b060b25ca3051d9f43b3a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2446

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[ASTERIXDB-2305][FUN] replace() should not accept regular expressions

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- replace() function was equivalent to regexp_replace(),

both were based on regular expressions

- this change makes replace() function operate on plain strings

- regexp_replace() continues to operate on regular expressions

Change-Id: Ic01db334c2ef0cab5834cc161ee4f212cf2cb105

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2440

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 64 more files in changeset.
[NO ISSUE][TEST] Introduce dynamic expected result poll test type

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- This change allows for a new type of tests. The new test can

poll for both expected results and a query and compare the two

values.

- A test case is added.

Change-Id: Ifc132b2d2286eea1d1e119984c33ca5eef9be92a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2438

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

[NO ISSUE][CONF] Make NC Properties Extensible

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Add extensible IPropertiesFactory to allow

extensions to override default properties.

- Make StorageProperties extensible.

- Remove metadata datasets config option.

Change-Id: I2b3cb2f47a286ecca90227d7756a62a102205cfc

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2442

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

[ASTERIXDB-2307][COMP] Incorrect result with quantified expression

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fixed incorrect result with EVERY quantified expression

when its condition returns NULL/MISSING

Change-Id: I9e282071c87a9551829c31af43909970d307e417

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2441

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

[NO ISSUE][RT] Only suppress exception if not the same exception

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Only suppress an exception if not the same as the original

exception to avoid self suppression exceptions.

Change-Id: I2da6918128b4c1935d5092a4e7df36e0b80fde61

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2445

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Michael Blow <mblow@apache.org>

[NO ISSUE][RT] no latching on an inverted list during merge

- user-model changes: no

- storage format changes: no

- interface changes: no

Details:

- Do not conduct a latching on an inverted list during

a disk component merge of an inverted index since

a disk component is immutable.

Change-Id: I266135596bbd5158d5fcf5ce3d1735d407be6f0f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2444

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

[NO ISSUE] Decouple heartbeat data calculation from transmission

- also, generate native JSON objects instead of POJOs for node config & stats

- fix illegal regex on Windows for node config

Change-Id: Iccb02350b56328ba1adbca97a1cb5efeb9d9ad14

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2439

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 6 more files in changeset.
[NO ISSUE][TX] Fix Interrupt Propagation in LogReader

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Re-interrupt and throw when LogReader is waiting

for logs to be flushed.

Change-Id: Ib06118f3afd3993e9d2e2fe69cdb17920b470641

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2443

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>