asterixdb

Clone Tools
  • last updated 23 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE][SQL] SQLPP UDF test cases revisit

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

1. Revisited all SQLPP UDF test cases. Fixed several testcases that were

disabled due to different issues that were no longer exist.

2. Minor fix to SQLPP so we don't need to nest function body into

subquery.

Change-Id: I844883b99dd9ff729ac518c60f6c47941017f24e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2493

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 5 more files in changeset.
[ASTERIXDB-2319][TEST] Split Queries in start-feed Test

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Split queries to multiple files to avoid

job cancellation of the second query after

the result of the first query has been read.

Change-Id: I06978c83bca612a41337944c61027a1cf3849ac0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2491

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[ASTERIXDB-2308][STO] Prevent Race To Allocate Memory Components

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Ensure concurrent threads will not attempt

to allocate memory components twice.

- Synchronize index lifecycle operations.

- Remove unused methods.

Change-Id: Ibd424ba6a2a68939f6ab8a4338c2f6c0c8057ed1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2489

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

[ASTERIXDB-2285][TEST] Increase Poll Time on Test

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Previous runs showed sporadic failures due to

short poll time and slow execution on jenkins

in test flwor/at00.

Change-Id: Icccdb0a4a961116653e367a8434639488916320d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2488

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][NET] Improve Logging in TCPEndpoint

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Include end point local address in IO thread name.

- Log TCPEndpoint/Connection addresses on failures.

- Fix multiple IO Threads initialization.

- Fix synchronization for closed connection notification.

Change-Id: I5e78755150a6424fd22f587c4311da7c60b3b55a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2487

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][API] Add Storage Stats API

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Add a new API on NCs for storage stats.

The API returns the total size of each index

as well as the id and size of each disk component.

Change-Id: Ie0345b00cfd825cbb77664c7617e8301c4f84e6d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2486

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE] Avoid sleep, shutdown log manager on halt

Change-Id: I64749ffd98563099bd68926cd7ca0e697f066baf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2485

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[ASTERIXDB-2317] Intermittent Failure in Kill CC NCServiceExecutionIT

Increase timeouts waiting for cluster state transitions, to accomodate

graceful shutdown

Change-Id: I0392cae1d2e9b6bfd9455ba2795711ecf7f1ebe3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2484

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][OTH] Log open file count on unexpected HttpServer close

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Recently, there has been some cases where the Http server

repeatedly drops its listener. One of the possible causes

for this is a leak in open file descriptor. To determine if

this is the case, we log the open files count when that happens.

Change-Id: Ie43f3392268b3994839d1f98f4de9fe669c7be62

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2483

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[ASTERIXDB-2329][MTD] Remove Invalid Find Dataset

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Remove invalid findDataset from MetadataManager.

- Add test case for dropping and recreating a dataverse

with indexes and data.

Change-Id: I59b084c85279d926aa60fb7bfcd1a9f6e5935f2a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2482

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Luo Chen <cluo8@uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE][TEST] Refactor licensing test support

Change-Id: I11385a73302b22f9aaaf91c426df8320f52ebb72

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2479

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[ASTERIXDB-2330][*DB][RT] Add IFunctionRegistrant for dynamic function registration

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Look for IFunctionRegistrant service instances at runtime, and use these to dynamically

register non-core functions with *DB

- Extract fuzzyjoin functions from core runtime

Change-Id: Ia88590280cbf476e08b905d9e1d62c68667a2569

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2480

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Michael Blow <mblow@apache.org>

    • -12
    • +52
    /asterixdb/asterix-fuzzyjoin/pom.xml
  1. … 63 more files in changeset.
[NO ISSUE] Minor refactoring/cleanup of nc detail servlets

Change-Id: Ib62cd5a6e193e61d52121f45be3ae6067b16f29e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2476

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[ASTERIXDB-2320][CLUS] Don't delay removing dead node on max heartbeat misses

Once heartbeat miss threshold miss has occurred, we attempt to contact the failed nc

to confirm it is down, and if not, force him to fail and reconnect. This contact

attempt can take some time, ensure we do not delay marking the node as dead due to

this.

Change-Id: I89c0241fbc88fb6c4150201e4bcba07a3548d3f5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2475

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[NO ISSUE][TX] Remove Invalid Metadata Locking API

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- All metadata locking is performed by the CC in

MetadataLockManager. Having the locking API in

MetadataNode is only causing confusion.

Change-Id: I9fae8bd32c8312ef69b38016ad00f170fca9a1c5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2474

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE][TX] Ensure Uncommitted Atomic Txns Not Flushed

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Make all metadata indexes modifications as

force modifications.

- Do not decrement ops of atomic transactions

until they fully commit or abort to prevent

flushing partial records.

- Do not schedule flush if a force modification

starts before the flush log is written to disk.

- Unify code path for completing operations

after commit/abort in op tracker.

- Remove unneeded update log commit notification.

- Add test case for failing flush due to force

modification.

Change-Id: If8d5df630f1d9119002ef91da5c282da18901acc

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2456

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][CLUS] Log NC Status on Startup Tasks Request

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Log NC status on startup tasks request.

- Do not respond to startup tasks request if

no tasks need to be performed.

Change-Id: I6e8f2c8a4144cb6f1768d1f78d819b0057f0056b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2473

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE] Refactor shutdown watchdog to ExitUtil

Change-Id: Id27635f90587c64ee29ab1a4ac2b1a6182042900

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2470

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[ASTERIXDB-2213] Guard against concurrent config updates

Change-Id: If7dffb1b502b9331118ad344e6f4ef0d625f4c8f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2467

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

[NO ISSUE][COMP][RT] Rename index-only test case directory

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Rename index-only test case directories to a shorter version

not to cause issues on Windows environment.

Change-Id: I360bd650391586a0101cb2eb639c330534753112

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2472

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 329 more files in changeset.
[ASTERIXDB-2316][STO] Fix Merging Components For Full Merge

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Pass correct merging components in case of

full merge.

- Add full merge test case.

Change-Id: I17890a1f85f569e0d3dc5eba046f61c91571c9c1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2471

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Luo Chen <cluo8@uci.edu>

[NO ISSUE][HYR] Add 'getTimer' to IControllerService

Change-Id: I9b33cfbc345d15d95a99ea2c993ad173816bada8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2469

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][COMP][RT] Rename index-only test case files

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Rename index-only test case files to a shorter version

not to cause issues on Windows environment.

Change-Id: I4a4bb7b045a430bd446aed756f58af7b4c2a6eaa

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2468

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 427 more files in changeset.
[NO ISSUE][TXN] Fix txnid leak (off by one)

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fix leak of one id at start of each allocated block

- Increase block size from 100 -> 512

Change-Id: Ia97d8472f30ef0f68c51830b4cbb4660184d7393

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2465

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][EXT] Java UDF framework refactoring

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

1. Separated the JObjects and its subtypes.

2. Add JBuiltinTypes so we don't have to create an object to get JType.

3. Dead code removal.

4. Memory usage optimization in JRecord Serialization.

5. Several fixes about incomplete type implementations in Java UDF and

getting JObjects in UDF examples.

Change-Id: I3b648191b73fe4aad4f2a6ba1c2066c872fa16a9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2405

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 36 more files in changeset.
[NO ISSUE][TX] Fix WAIT_LOG Reading

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fix WAIT_LOG reading.

- Add test case.

Change-Id: I6a8b75152466f96a4b00cc6f2d25582ba65e6013

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2466

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE][ING] Follow the IFrameWriter contract in Feed Pipeline

- user model changes: no

- storage format changes: no

- interface changes: yes

- it removes unneeded ITupleForwarder interface.

Details:

- Previously, if a failure happens at the writer.open

call in the FeedIntake operator, the IFrameWriter

protocol is not followed since we don't fail before

close is called.

- Previously, fail calls can be done as well inside

of the feed adapter.

- This change moves failing the pipeline outside the

adapter and so the adapter's responsibility is

getting records from outside the system while

the operator takes care of opening, failing, and

closing the writer.

Change-Id: Ife679fb9643dc6b39d035e0eecdb915b227503a5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2463

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 8 more files in changeset.
[NO ISSUE][TX][FAIL] Halt on LogFlusher failure

- user model changes: no

- storage format changes: no

- interface changes: no

- cures cancer: no

Change-Id: I69c4bf6c9669601e6613a9435de046d72b0baf6d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2464

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +4
    /asterixdb/asterix-transactions/pom.xml
[ASTERIXDB-1952][TX][IDX] Filter logs pt.2

- user model changes: no

- storage format changes: yes

- interface changes: yes

Details:

- Add a log type specifically for filters

- Only log change when filter actually widens

- Stop logging of index + filter tuple during modification

- Redo index and filter tuples separately via their logs

Change-Id: Ie9e7795d9c8c212e8610dcb9bb5d26ec9fbbee8a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1857

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 32 more files in changeset.
[NO ISSUE][LIC] Incremental progress on dashboard licensing

Change-Id: I85e7cef82d54ff5af1a5942ab368931490b70707

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2462

Tested-by: Michael Blow <mblow@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>