asterixdb

Clone Tools
  • last updated 10 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Fix sporadic failures in checkpoint test

Change-Id: Ic32b9221ba3f843e006931556bab52d184ab1d33

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1317

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Detect, Option to Forcibly Terminate AsterixDB Processes

Usability changes for sample local cluster:

1. Before start, check if there are any AsterixDB proceses running. If so,

error out. This can be overridden with -f, which will proceed to start

the cluster anyway. This is useful in case where the other processes

are operating on non-conflicting ports.

2. After stop, check if there are any AsterixDB processes running. If

so, emit a warning, and if -f is supplied to stop, kill any

straggling processes.

Change-Id: Ie09c86fe67f7933574a03574fbe334e8c1be2bbd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1316

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

ASTERIXDB-1710: Redo fails on WAIT log record

Simple fix :)

It would be best to have a test for this (and all other logtypes),

but the LogManager will have to be maniupulated into generating the record

for this specifically because the conditions upon which it happens naturally

are hard to encounter.

Change-Id: I4443b716bc791878fabbbf3b374fc7c7c592668f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1315

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Misc. Dependency Version Updates

Updated org.apache.commons:commons-lang3:jar:3.1 to version 3.5

Updated org.apache.httpcomponents:httpcore:jar:4.4.4 to version 4.4.5

Updated org.apache.maven.plugin-tools:maven-plugin-annotations:jar:3.4 to version 3.5

Updated org.apache.maven:maven-artifact:jar:2.2.1 to version 3.3.9

Updated org.apache.maven:maven-compat:jar:3.2.5 to version 3.3.9

Updated org.apache.maven:maven-core:jar:3.2.5 to version 3.3.9

Updated org.apache.maven:maven-plugin-api:jar:2.2.1 to version 3.3.9

Updated org.apache.maven:maven-plugin-api:jar:3.2.5 to version 3.3.9

Updated org.apache.maven:maven-project:jar:2.0.8 to version 2.2.1

Updated org.json:json:jar:20090211 to version 20160810

Change-Id: Id3943d738e3b1c3692e8bf4fb237175252d188b5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1311

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -1
    • +1
    /asterixdb/asterix-experiments/pom.xml
  1. … 8 more files in changeset.
Add Diagnostics Endpoint

Add an endpoint (http://<host>:19001/admin/diagnostics) to gather common

diagnostics information on the cluster for cc and each ncs:

- threaddump

- config

- stats

Change-Id: I664b713f6614acd5ce4f8bf8ce6f8f71345cab06

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1310

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

ASTERIXDB-1573 Allow Extension of Rewrite Rules

Add IRuleSetFactory which builds rewrite Rule Set

Can be extended by Asterix Extensions

Removed some obsolete extension code

Change-Id: I7f59dea86b0ef4ee9d31b56766a97bd2b34ec02c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1304

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 7 more files in changeset.
Add Checkpoint Test

This change adds a unit test case which validates that

checkpoints do not delete log files that are still required

for recovery, and delete those that are no longer needed.

Change-Id: I4cb4743fe488deb5ad10f65604adc2231948795e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1270

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Fix Upsert Pipeline

Change-Id: I5c19d448f9664ecaeac600668a6dbdcf40673c56

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1308

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Windows 10 Logs Constant Exceptions On CC/NC Death

- Backoff delays on IPC Listener Thread exceptions; use logger instead of

printStackTrace()

Change-Id: Iec7a3ce23ab99d04b0fc0e0f832cce1a461e2df8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1309

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Add user-stream for Twitter Adaptor

1. Add user-stream option for Twitter Adaptor

2. Refactor part of TwitterRecordReaderFactory

3. To create a user-stream feed, using following ddl:

create feed TwitterFeed using twitter_user_stream(

("format"="twitter-status"),

("type-name"="Tweet"),

...

// rest is same as push feed

Change-Id: I99cdd4cb667306d378317616f9811dfce3e6d838

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1272

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

ASTERIXDB-1700: fixed multiple same type of index application error on the same field

- Fixed an issue that multiple same type of indexes can be applied for the same field.

For this situation, applying only one index will be enough.

(e.g., 2-gram and 3-gram index on the same field)

Change-Id: I450f3adb20c777d5b9a8f638e010076b9d817942

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1307

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Jianfeng Jia <jianfeng.jia@gmail.com>

ASTERIXDB-1701: Fix log file boundry check

Change-Id: I538a8b931f3d50a00b092f218887a9731d14e235

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1306

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

Ignore analyze-only plugin on Eclipse

- Let the Eclipse ignore analyze-only plugin since

there is no m2e connector for this.

Change-Id: I3f9a9df0bb67acb207cd0be2724b1e34974a1323

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1305

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Make Lock Manager Statistics at FINE granularity

It seems like in some scenarios the Lock manager can output a large volume

of logs and this can get excessive quickly. Our default level is at INFO

so I thought FINE might be more appropriate.

I also made the Managix Log append rather than clobber the old logs.

Change-Id: Id26ac346a5fa1410e1b74a4fa88ae9f45f791be2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1303

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

ASTERIXDB-1695 Fix Functions in Default Dataverse

Change-Id: I7f08c0acaccdcfaeb4fc9cfb1529214b543d0e86

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1297

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Documentation cleanup.

1. "record"->"object",

2. JSONify sqlpp/3_query.md.

Change-Id: Idcb2be81d1bfa37dd876cd36a7a5bb824bc3ab86

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1295

Reviewed-by: Till Westmann <tillw@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 798 more files in changeset.
Omit Managix [nc|cc].java.opts From HTTP Api, Ini > Env

- Managix options for cc / nc java opts are not used for NC service

clusters, omit these from the cluster HTTP api.

- Ini jvm.args should take precedence over $JAVA_OPTS in environment

when launching NCDriver

Change-Id: If52da9f5cc2a66b7c327f39a6e4ea51d4a8ccf89

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1301

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

fix some log levels

Change-Id: I4810f02e1be0b4a4b5238afa7b929ff547beef06

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1302

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

dead code elimination in asterix-events

Change-Id: I8873652ca6b3add003e7454d09c175b2218ed685

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1300

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 5 more files in changeset.
ASTERIXDB-1696 - Big Object Spanning Log File Boundary

- Big objects spanning log file boundary produces

ArrayIndexOutOfBoundsException. Refactored large log page logic to

correctly handle big objects at log file boundaries.

- Add regression test

Change-Id: Ifd5ac08a8bcf4a1e0804aa05bd7e52169a0cf1bc

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1296

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Deps++, Refactor ClusterManager

- Exclude runtime-scoped junit from appassembler-booter dep

Change-Id: Ic574f51133ed32f3b850640260f7faf598b12219

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1298

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +6
    /asterixdb/asterix-client-helper/pom.xml
leaner .gitignore

Change-Id: I52ba4f1052c7c83b5a4875dd86b3f3a57e0ca9cb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1299

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

merge clean up

merge master

  1. … 12 more files in changeset.
Enhanced Insert AQL

The optional "as Variable" provides a variable binding for the inserted records

The optional "returning Query" allows users to run simple

queries/functions on the records returned by the insert, and can refer

to the variable bound in "as Variable"

Allow commits to be non-sink operators (contnue job pipeline after commit)

Additionally, this change makes small modifications to

the extension code to prepare for the BAD extension

Also made the OptimizerTests able to work for Extensions

Change-Id: I65789d2a861d15232dd29156a6987d0635ec6c94

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1150

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 66 more files in changeset.
reduce xerces dependency

Change-Id: If7401abf4d7c460fd53174198d7ba9147ed83f67

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1293

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

More Dependency Cleanup

Change-Id: I9cd6f1c9829c1a71f8b10994823a5f1fbe09d797

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1294

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Move Twitter Firehose Datasource to Test Source Folder

Change-Id: Iefe2130707012b8ce60f5dfac96635a1a515a076

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1290

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -0
    • +1
    /asterixdb/asterix-experiments/pom.xml
    • -6
    • +4
    /asterixdb/asterix-external-data/pom.xml
  1. … 22 more files in changeset.
some logging cleanup

Change-Id: Ib74d29d88471e6262407ce30181b55d6f157c67c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1291

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Fix Scope of Rometools Dependency

Change-Id: I55d9e768d890ee379c91f615ae6cf4862732a03f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1289

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>