asterixdb

Clone Tools
  • last updated 21 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
ASTERIXDB-1419: Fix type checking for CollectionType

Change-Id: Ibf11d6c59ae00fe6d21fed8d75f199ee4ac9852c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/886

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

ASTERIXDB-1190, ASTERIXDB-1216, ASTERIXDB-1317: fixes and regression tests.

Change-Id: If21ad96b1bff59fa2da601b920d4a61900cad81f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/885

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 8 more files in changeset.
Let SQL-92 aggregate functions behave the same as SQL-92.

Change-Id: Ia2929d1ca6344508bbf772884ea8ef1f39a0e19f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/857

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 79 more files in changeset.
Fix query plans for constant aggregates.

- Fixes for both global aggregates and group-by aggregates.

- Allow optimizer tests to test sql++ queries.

Change-Id: I8c2b9f4d566e62d56efe155554a317ea333420a6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/876

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

SONAR: Collection, misc fixes

Fixes for issue Inappropriate "Collection" calls should not be made, as well

as some other misc SonarLint suggestions while in these files.

Change-Id: Ie68a269bab4d1b2bdc628a5f09b9afff3882e09e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/881

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

ASTERIXDB-1228: Add MISSING into the data model.

1. MISSING repsents the value of a non-existing field in a record

or an out-of-bound index access of a collection;

2. NULL represents that the value of an optional field in a record

is unknown or the value of existing collection entry is unknown.

3. Unit tests for all missing/null-in-missing/null-out scalar functions.

Change-Id: Ia49ed8474bfc5d6604231819065117468c5b0897

Reviewed-on: https://asterix-gerrit.ics.uci.edu/846

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 537 more files in changeset.
Merge from master

* master:

Improve Messaging Connector and Add Unit Tests

ASTERIXDB-1462: Remove previous LSN from txn log record

Remove Log-Based Remote Recovery

Fix log file EOF during recovery

some finals + exception cleanup

stop application entry point

ASTERIXDB-1460: Fix log level crashing CC on start

Remove PowerMock from asterix-external-data

ASTERIXDB-1425 & ASTERIXDB-1450: Fix LogReader random reads

add toString() to debug the SQL++ compiler

Fix Input Handler Test

Fix Intermittent Hangs In Recovery Tests

Remove Key-Value Adapter

Add Unit Tests for Feed Runtime Input Handler

snapshot my changes for interval index join.

Improve Messaging Connector and Add Unit Tests

Before this change, messaging connector always reserves 100 bytes

for messages which are mostly un-used. With this change, it only

reserves two bytes and sends null messages by default. In case a

new message doesn't fit in the leftover space of a frame, it sends

the frame with a null message, followed by a dedicated frame for

the message.

Change-Id: If4336e9c234e8d282798cfba9f48432b46cccfca

Reviewed-on: https://asterix-gerrit.ics.uci.edu/880

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 9 more files in changeset.
ASTERIXDB-1462: Remove previous LSN from txn log record

Change-Id: I32509ebe476e5993609f6fd73d2227a7d5219558

Reviewed-on: https://asterix-gerrit.ics.uci.edu/879

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Fix log file EOF during recovery

Change-Id: If9adbdaea726dd21d15fc1287362375daf30bf16

Reviewed-on: https://asterix-gerrit.ics.uci.edu/878

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Reviewed-by: Michael Blow <michael.blow@couchbase.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

some finals + exception cleanup

Change-Id: Ie0252fef069ee93db6e32e13a13ebb11df5ce913

Reviewed-on: https://asterix-gerrit.ics.uci.edu/877

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

ASTERIXDB-1460: Fix log level crashing CC on start

The Hyracks CC would nullpoint on startup if the log level was

greater than FINEST. This works around the core issue that's in

ASTERIXDB-1460 since in this instance the way the log level was used

would cause the CC to fail on startup where the log level was

equal to or greater than FINEST.

Change-Id: I720eca41fac312fc6cbdbb880162a5bc8b0357dc

Reviewed-on: https://asterix-gerrit.ics.uci.edu/870

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Remove PowerMock from asterix-external-data

PowerMock prevents jacoco from collecting coverage information.

Hence, it is better not to use it. However, using Mockito is fine.

In addition, this change fixes the BTree frame writer unit test.

Change-Id: I69cff2827b1f2cc57e0fec0316b2b997f806787c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/875

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -12
    • +0
    /asterixdb/asterix-external-data/pom.xml
Fixes and tweaks for running Asterix atop new config-management framework.

Change-Id: Ie3027c8c839f25ea858790bd3340187f4b11f213

Reviewed-on: https://asterix-gerrit.ics.uci.edu/874

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: Michael Blow <michael.blow@couchbase.com>

ASTERIXDB-1425 & ASTERIXDB-1450: Fix LogReader random reads

- Fix random reads for truncated logs (ASTERIXDB-1425).

- Fix log file partition size boundary check (ASTERIXDB-1450).

- Fix deadlock between LogReader and LogFlusher.

- Prevent checkpoints from deleting log files being accessed by rollbacks.

- Make rollbacks start from LSN = max(txnFirstLSN, minMemoryLSN).

- Make default log partition size 256MB instead of 2GB.

Change-Id: I1c75ca4a7c8fe197451126392389d4baecbd7e45

Reviewed-on: https://asterix-gerrit.ics.uci.edu/867

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

stop application entry point

Change-Id: Ia4a8fab765f4878b30b6f7adb430f01ef2757605

Reviewed-on: https://asterix-gerrit.ics.uci.edu/827

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

fewer copies

Change-Id: Ia409bf61140816c8246ab79c11732654613b20bf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/823

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Fix Input Handler Test

The test was checking that the data was fully consumed before it closes

the input handler. The test was fixed to close it before it checks.

Change-Id: I6e0e8f130a8250d9cddeb9077f9c4b79491f6fd9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/872

Reviewed-by: Michael Blow <michael.blow@couchbase.com>

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Remove Log-Based Remote Recovery

This change removes the code that supports log-based remote recovery.

Remote recovery was replaced by the failback process which depends on

copying LSM disk component instead of logs.

Change-Id: I86e3b5832b52207e36c8409a072ccbda564d78b5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/871

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Fix Intermittent Hangs In Recovery Tests

Update recovery script to exact match on target PID

Change-Id: I48d1f1a8c882e6f45d09c37df1c129463f2eaaf4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/869

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Remove Key-Value Adapter

Change-Id: Iaa7d8d70b0869242d1a872f55f0c6928fda94dcb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/868

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <michael.blow@couchbase.com>

Add Unit Tests for Feed Runtime Input Handler

Change-Id: I7088f489a7d53dee8cf6cdbf5baa7cd8d3884f55

Reviewed-on: https://asterix-gerrit.ics.uci.edu/866

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <michael.blow@couchbase.com>

Merge with master.

    • -68
    • +68
    /asterixdb/asterix-runtime/pom.xml
Fix Apache version

The latest org.apache.apache version seems to break the build.

This sets it from LATEST to 16, which it was at not long ago.

Change-Id: I4b5ad96336a85b2295ff6986fc2c99b27a0ddcf7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/863

Reviewed-by: Michael Blow <michael.blow@couchbase.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

ASTERIXDB-1455: Scale CharRecord Buffer Expansions

Reading a 30 MB record requires > 1500 buffer reallocations when increasing by

a fixed amount. Updated to scale up the buffer increases to reduce the number

of reallocations in case of large records.

Change-Id: I4822b2a78e1f411de94d2c717523df6b2b4a381e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/861

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

ASTERIXDB-1287: Fixed Admin Console pages.

From: Pritom Ahmed <pritom.11@gmail.com>:

Previously job details page of the admin console was not working correctly.

Now It is fixed. Also fixed some internal issues like wrong time shown.

Now JSON data in adminconsole for Job Details is shown in tabular form.

Previously, in job details page of admin console, all the data was shown

in raw JSON format. Now using a MIT licensed js library, it is shown in

tabular form.

Added Headers for the data shown in Index page of adminconsole.

Previously in job summary, create time, start time and end time was never

updated. As a result they all were 0. Fixed it.

In adminconsole's Index page, the job create time, start time and end

time all were being assigned with create time. Fixed it. The same

problem was also present in the REST API as well. Also fixed it.

Showing a message in job details page in admin console for jobs that

were deleted because the maximum size of job archive was reached.

Beautified the job details page in adminconsole by adding tabs.

Fixed the job details page in adminconsole. Previously it was broken.

Now it shows the raw JSON data sent to it.

Change-Id: Iefbdd9ab564cff12ab75e00922299fbbcde1c08f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/860

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Fix Maven Warnings

This change eliminates the following Maven warnings in the build:

- [WARNING] 'parent.relativePath' of POM org.apache.hyracks:apache-asterixdb-hyr

acks:0.2.18-SNAPSHOT (/home/jenkins/workspace/asterix-gerrit-notopic/hyracks-f

ullstack/pom.xml) points at org.apache:apache-asterixdb-fullstack instead of o

rg.apache:apache, please verify your project structure @ org.apache.hyracks:ap

ache-asterixdb-hyracks:0.2.18-SNAPSHOT, /home/jenkins/workspace/asterix-gerrit

-notopic/hyracks-fullstack/pom.xml, line 28, column 11

- [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must

be unique: org.apache.hadoop:hadoop-hdfs:jar -> duplicate declaration of versi

on (?) @ org.apache.asterix:asterix-app:[unknown-version], /home/jenkins/works

pace/asterix-gerrit-notopic/asterixdb/asterix-app/pom.xml, line 258, column 17

- [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found

duplicate declaration of plugin org.apache.maven.plugins:maven-jar-plugin @ o

rg.apache.asterix:asterix-app:[unknown-version], /home/jenkins/workspace/aster

ix-gerrit-notopic/asterixdb/asterix-app/pom.xml, line 54, column 15

- [WARNING] 'dependencies.dependency.(groupId:artifactId:type:classifier)' must

be unique: org.apache.asterix:asterix-app:test-jar -> duplicate declaration of

version 0.8.9-SNAPSHOT @ org.apache.asterix:asterix-installer:[unknown-versio

n], /home/jenkins/workspace/asterix-gerrit-notopic/asterixdb/asterix-installer

/pom.xml, line 319, column 17

Change-Id: Ie984b7f0ea50b9688399fafdfc48057fdf46012d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/859

Tested-by: Michael Blow <michael.blow@couchbase.com>

Reviewed-by: Till Westmann <tillw@apache.org>

Fix Installer Test Regression For Big Object Tests

copy target/data for installer tests

Change-Id: I012ff4968b97cb93cb3f58580f3ae5e288a5645c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/858

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Michael Blow <michael.blow@couchbase.com>

remove AsterixRuntimeException

Change-Id: Ica9d828bffceabe3b614f68886bc860e34f593b4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/856

Tested-by: Michael Blow <michael.blow@couchbase.com>

Reviewed-by: Michael Blow <michael.blow@couchbase.com>