asterixdb

Clone Tools
  • last updated 14 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE][API] Remove Legacy APIs

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Incremental progress towards removing

all legacy APIs and replacing them by

the query service.

- Use /query/aql to execute AQL tests.

- Adjust AQL test cases results to query/aql

output.

Change-Id: If6bfb06236d2bc480adf22bf16d5cca6a8edc726

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2554

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE][MD] Remove Legacy Metadata Latch

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Remove legacy metadata latch that was used before

the metadata entity locking was introduced.

Change-Id: I5b6b7153c8bc7bb6b489242c5d651879a09b57e0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2556

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE] Increase Default Log Page Size

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- The current log page default size (128KB) is too small for high

throughput disk writes. Increase it to 4MB.

Change-Id: I83595e12abb531293a64eb12a1be3e15bafca463

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2553

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

[NO ISSUE][TEST] Remove AQL Parallelism Tests

- user model changes: no

- storage format changes: no

- interface changes: yes

Change-Id: Ib217c48922b9dd18aab2cc8d27d80af1c3fb5fb9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2555

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

[NO ISSUE][STO] Misc fixes in storage

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Blocking IO callback used to wait for any notification on the

callback before returning. The behaviour was fixed to only return

if the completion flag was set on afterFinalize.

- Reading and writing to and from memory component's didn't do any

locking and so, this could read to concurrency issues.

- Reading metadata values used to rely on pointables which can be

problematic because then the caller will need to latch/pin the

page correctly. To avoid this, readers of metadata pages will

always take a copy of the metadata.

Change-Id: I4bdc4c16a9c126d311378e56651632bbb4a50864

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2548

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[ASTERIXDB-2351][COMP] Allow '+' after exponent indicator in double literals

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Allow '+' sign after exponent indicator when parsing

double literals in scientific notation

Change-Id: I1f27c0db786269cce90ef43463df1a398fd1e5cd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2552

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[ASTERIXDB-2343][FUN] Implement to_array(), to_atomic(), to_object()

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Implement to_array(), to_atomic(), to_object() functions

- Add function aliases: to_bool, to_str

Change-Id: I6391a060ecd86cd397dd0a59f4930c4c55216d3b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2539

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 8 more files in changeset.
[NO ISSUE][REPL] Use String.compareTo To Sort Replicated Files

- user model changes: no

- storage format changes: no

- interface changes: no

- Use String.compareTo to sort replicated files

instead of custom comparator.

Change-Id: I45c106d5cff6e07d16a9a7ce286a2ac563a80338

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2547

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[ASTERIXDB-2348][COMP] Incorrect result with distinct aggregate

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Account for micro group by/distinct by operators in

EnforceStructuralPropertiesRule

Change-Id: I0f440046d6cdb2dc0302c5aa4c01ffacb703ee73

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2544

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][COMP] Check logging level before writing a log message

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Cleanup: Check logging level before writing to the logger

Change-Id: Ib126397c390f0d32436a80a306981106afa2a794

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2543

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[ASTERIXDB-2280][IDX] Fix Index on Optional Nested Field

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Fix the creation of indexes on optional nested field

by handling AUnionType properly.

- Fix the nullability check of primary keys.

Change-Id: If098ff4a45db3c4e8b65d098cbb0940c8b7ab845

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2477

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[ASTERIXDB-2346][COMP] Constant folding should not fail on runtime exceptions

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Constant folding rule should not fail on runtime exceptions

- throw RuntimeDataException instead of java.lang.ArithmeticException

from numeric operators

Change-Id: I286551a98f57df798ce982228a66d6a1e3fc7304

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2542

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[ASTERIXDB-2345][FUN] Fix runtime output type for object_names()

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- object_names() should produce ordered_list<string> instead of ordered_list<any>

Change-Id: I5181680bfe978d4208141a30b2167f78368bcf8d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2540

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Merge commit '6453ecf2f0dff1ec1306c8c5c1e4f81a27755431' from release-0.9.4-pre-rc

Change-Id: I6baed7a75ec38755d6e040f2b7f1ede54c191f0f

[NO ISSUE][REPL] Ignore LSNs of Partially Replicated Indexes

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- When determining low watermark, ignore LSN of replicated

indexes with no checkpoints.

- Guard logs in case of unexpected min LSN read failures.

- Ensure only one replica is synchronized at a time to prevent

possible merge operations from deleting files being synchronized

to another replica concurrently.

- Ensure index metadata files are replicated first to allow

replicas to find any existing files in case of re-synchronization.

- Ensure replication channel is closed on replication failures.

Change-Id: I9ca08da29bdd8fc4406f2df7e6eb32601caf9388

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2534

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

[NO ISSUE][RT] Inherit Closeable in IFrameOperationCallback

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Primary upsert operator uses an IFrameOperationCallback

to perform per frame operations. In this change,

IFrameOperationCallback extends Closeable and allow the

callback to release resources on the close of the pipeline.

Change-Id: Iaacd6538c27d5498868256616a793e0ebcec3729

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2536

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[NO ISSUE] Incremental cleanup of deprecated exception ctors

Change-Id: I1e7c3655828fc6530cef83ea502a6cfbf41acddf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2533

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 226 more files in changeset.
[NO ISSUE] Cleanup query service exception handling

Change-Id: I1f2828481df055d6c96f1ae1869ef37a065bf576

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2524

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

[NO ISSUE][RT] Add job start timestamp to the joblet context

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- add job start timestamp to the joblet context

- make CommonFunctionMapUtil extensible by products

- enhance DateTimeFormatUtils.parseDateTime() to return

timezone information and not throw exception on invalid data

- add GregorianCalendarSystem.getDayOfYear(), getWeekOfYear()

- change sleep() to sleep first then evaluate the argument

- skip fractional trailing 0s when printing nano-duration

- fix documentation about using column aliases in GroupBy

Change-Id: I190663ec5e709584ef449f8279b1d2a5a0b099dd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2511

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 12 more files in changeset.
[ASTERIXDB-2340][FUN] Implement object_length(), object_names()

- user model changes: yes

- storage format changes: no

- interface changes: no

Details:

- Implement object_length(), object_names() functions

- Consolidate type inferers for some object accessor functions

Change-Id: I1108466ffe4f6b002fa7dd25f76dd5e8d537b0be

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2522

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 5 more files in changeset.
[ASTERIXDB-2333][COMP] Allow filters to work alongside autogenerated keys

- user model changes: no

- storage format changes: no

- interface changes: no

Details: Fixes a bug preventing autogenerated keys from working

when there is a filtering field present.

Added test.

Change-Id: I450b4e20175992414955d59116e672450d442f81

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2504

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Xikui Wang <xkkwww@gmail.com>

[ASTERIXDB-2334] Fix Range Predicate for Composite Key Search

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Currently during a primary btree search, we always use the range limit

of the first search key. However, this is incorrect for prefix range

search. This patch fixes this bug by using the correct range limit

during index search.

Change-Id: Ie2c432c78043913a9dcf9b8a2eb31db8c548d8d2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2532

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Merge commit 'd71cb24eb7040875eaf9b70cc5311e87b24f149d' from release-0.9.4-pre-rc

Change-Id: I94cf63ce0207222a22585d2db6b4fe3b104027b5

[ASTERIXDB-2216] Disable flaky test which depends on external site

The feed http://lorem-rss.herokuapp.com/feed seems to be down, disabling

the test which relies on it. Also fixed the assert.

Change-Id: Idcf9acf410aa4b8094a93e40681db284a2156345

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2527

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

[ASTERIXDB-232]6[TEST] Increase Result TTL to 5 Mins

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Increase result TTL to 5 mins in AsterixHyracksIntegrationUtil

to avoid intermittent test failures due to long GC pauses in

long running queries.

Change-Id: I6ecf0e4ac3578027ed12ac9d34d8b2b8f04b348b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2526

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

[NO ISSUE][CLUS] Complete NC Registration When Response is Received

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Mark NC registration as completed when the regisration

reponse is received from CC.

- Send NC startup tasks request to CC after all previous

tasks complete.

Change-Id: I4ff41f86a11b52cae894fe40ffa0353f2fb52138

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2525

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Murtadha Hubail <mhubail@apache.org>

[ASTERIXDB-2339] Add a new inverted index merge cursor

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Implement a new inverted index merge cursor which uses two priority queues,

one for tokens and one for keys. For each token, we merge their inverted

lists using the key queue. After that, we fetch the next token and merge

their lists again. This reduces unnecessary token comparision a lot.

- Along this change, created a fast path for inverted index bulkloader.

Based on how the token+key pair is created, there is no need to copy

bulkloaded tuple and check whether it's a new token during merge.

Change-Id: I57d039cd7e08033884529a204bff9acffd96d9bb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2519

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 7 more files in changeset.
[NO ISSUE][CLUS] Exclude Pending Removal Nodes From Location

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Exclude pending removel nodes from cluster locations

to prevent new jobs from using them as compute locations.

- Add additional logging for dataset rebalance.

Change-Id: I0c9904b229aa086615a3a8bbdfaf44d51f1e1757

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2523

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

[ASTERIXDB-1371][FUN][AQL][SQL] Add standard geometry data type and functions

- A new geometry data type that represents standard OGC objects

- A new set of spatial functions that operate on geometry objects including

spatial analysis, spatial predicates, and spatial aggregate functions

- Parse both Well-Known Text (WKT) and GeoJSON standard formats

- All geometry functions are implemented through the open source library

Esri Geometry API

Change-Id: I9cddeffea42e85469b6fc38f361bd98e64025289

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2056

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 112 more files in changeset.
Merge commit '94b6da6ae33749dfdee35e35f32c165693015e3d' from release-0.9.4-pre-rc

Change-Id: I73edc93888a80687416cc80014ffebc2683c68f6