asterixdb

Clone Tools
  • last updated 28 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Improve Error Handling in Local Directory Feeds

This change improves handling of two error types for filesystem

based feeds. The first one is the handling of IO Errors which

causes the input stream to be closed, and the second one is

reacting to missed filesystem events. In both cases, we scan the

directory and compare it with the history we have in order to

resume from where we last left off.

In addition, this change includes some refactoring in external

data. Particularly, we get rid of the stream provider layer and

instead, stream factories create input streams directly. This

is consistent with record reader factories which create readers

directly without reader providers.

Change-Id: I08d89229e33c91532b1038ba9f7a372f7ca1fdb5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/720

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

  1. … 130 more files in changeset.
Provide a Way to Create UTF8 Serde with Reader and Writer

Change-Id: Ia1a0a2f240ab780e21e7170e03767d8e9981899c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/757

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Add "collection" as a synonym to "table" in SQL++.

Change-Id: I95f87a1b6e8365f2148afdfb86f942a5dfef0dc9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/755

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 43 more files in changeset.
ASTERIXDB-1361: Meaningful error when missing output-record-type

Change-Id: Id5ca7d634b2be5164af82ad128ff577c0bdbd457

Reviewed-on: https://asterix-gerrit.ics.uci.edu/741

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

add parameter to QueryServiceServlet to indent JSON

Change-Id: Id197d3ad6aa17c9a36bb3845bd3ca75a695ba6d9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/750

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

ASTERIXDB-1357: installation docs now require JDK8

also

- fixed the indentation of the code blocks in markdown

- removed end of line whitespace

Change-Id: Ie46d38fdf9393cfb2bcda3d879cdbfd25fd8145f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/746

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -452
    • +383
    /asterix-doc/src/site/markdown/install.md
Fixed Feed Connect Statement

This change includes two fixes:

1. Feed connect doesn't return until the connection is complete.

2. When using wait for completion, it waits until all the jobs

complete.

Change-Id: I416bf4917b1f5cea687d1202c435f7183136cf1f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/726

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

  1. … 25 more files in changeset.
Fix Test Results for asterix-yarn

Change-Id: Idfe9e5737ad361d6d777e45886a02d5a2dc55fef

Reviewed-on: https://asterix-gerrit.ics.uci.edu/745

Reviewed-by: Chris Hillery <ceej@lambda.nu>

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Allow Replication to be Enabled on Virtual Cluster

- Allow replication port assignment per NC.

- Allow replication to be enabled on virtual cluster.

- Wait for JOB_ABORT ACK from remote replicas.

- Fix LSM component mask file name.

- Fix index directory deletion on index drop.

- Eliminate multiple partition takeover requests.

- Free LogFlusher thread from sending replication ACKs.

- Fix possible deadlock between LogFlusher and Logs Replication Thread.

- Remove wait for FLUSH_LOG for replicated LSM components:

This wait is not needed since on node failure, complete remote recovery is done.

Change-Id: I34a38f59c4915a19242adb6a4eaa6ee1c82d2372

Reviewed-on: https://asterix-gerrit.ics.uci.edu/743

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -0
    • +49
    /asterix-app/src/main/resources/cluster.xml
  1. … 6 more files in changeset.
ASTERIXDB-1359 Removed Project from IntroduceSecondaryIndex Rule

Change-Id: I912e3d56c0b9c2b5b252630acf8b15c54e0f61a1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/742

Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Fix Asterix Installer Test Cases

Many tests started to fail in installer after being

disabled for a long time. This change fixes the following:

1. asterix-installer: external library tests.

2. asterix-installer: recovery: query-after-restart.

Change-Id: Iefad5ac3ff754693025312f1e2fa01b08832514c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/737

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 20 more files in changeset.
Fixed Bugs Caused by Disabling Installer Tests

Change-Id: Ic77f4ee76a77f4b49cac6835bbb976eb9dc92d3a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/736

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

ASTERIXDB-1233: Fixed the bulk-loading with an inverted index on an open-type field

Change-Id: If58f594c0a7b6f4bca45b13ceaef07b605d2fe22

Reviewed-on: https://asterix-gerrit.ics.uci.edu/740

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com>

ASTERIXDB-1233: Fixed the bulk-loading with an inverted index on an open-type field

Change-Id: I70e90101053d5aa5f5fc2d883135e82c4b7b677a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/739

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com>

ASTERIXDB-1344: Capture Code Coverage Metrics

Collect coverage for integration tests

Change-Id: I9aceb87634f6187ee2522e9ba8a50d39bc811569

Reviewed-on: https://asterix-gerrit.ics.uci.edu/735

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Re-enable and fix test result for ASTERIXDB-1211

Change-Id: I67c6cc748bf49b3de44b2ca84a3a53f9c941170c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/734

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Fix lifecycleMappingMetadata in the pom (for Eclipse).

Change-Id: I77796920b02f98678083e3107ec8ef1ad6e98fa1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/732

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Fix lifecycleMappingMetadata for rat in the pom (for Eclipse).

Change-Id: Ib778e0218dc44e34417346dd9d0e459eddb0d17e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/733

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Merge branch 'release-0.2.17' into master

Change-Id: I8fcf41c009f9faf51bc8bccc0c3c7217b7769147

    • -3
    • +7
    /algebricks/algebricks-compiler/pom.xml
    • -6
    • +10
    /algebricks/algebricks-core/pom.xml
    • -2
    • +5
    /algebricks/algebricks-examples/pom.xml
    • -2
    • +5
    /algebricks/algebricks-rewriter/pom.xml
    • -6
    • +9
    /algebricks/algebricks-runtime/pom.xml
  1. … 46 more files in changeset.
merge code update.

merge code update.

Update for tuple based memory iterator.

  1. … 3 more files in changeset.
Update for tuple based memory iterator.

Add Another Signature to Send Messages to CC

The existing interface to send messages from NC

to CC expects a byte[]. The new method takes

a Serializable and serialize it.

Change-Id: I0ec4e0898c341723f29af32043cec8c042377ed9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/727

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Decode URLs Returned From Class.getResource()

Fix ClassAd tests failing when there is a space in the path, by

properly decoding the URLs with URLDecoder.

Change-Id: Ib7fd5a4e33ba3e16c1b5124179a15ae78d08c18a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/725

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Merge branch 'release-0.8.8' into master

Change-Id: I8fcf41c009f9faf51bc8bccc0c3c7217b7769149

  1. … 22 more files in changeset.
ASTERIXDB-1344: Capture Code Coverage Metrics

Optionally capture code coverage data with Jacoco when 'coverage'

property is set or 'coverage' profile is enabled. Reports are

generated at: coverage/target/coverage-report/html/index.html

Change-Id: Ic428230934a46c64baa60933b75c214f5b138387

Reviewed-on: https://asterix-gerrit.ics.uci.edu/721

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -0
    • +134
    /asterix-coverage/pom.xml
Improve KV Generator

Currently, KV Generator produces the same documents when

running in parallel where the only difference is in the

key of the record. With this change, it produces different

Documents in each partition to produce more diverse set of

records.

Change-Id: Ia337be57f8394d74a98f3c72ebcaa584f277f34b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/724

Reviewed-by: Michael Blow <michael.blow@couchbase.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

ASTERIXDB-865: fix query compilation for if-else expression.

Change-Id: I80e7995e814180fe567818263c79493901af284c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/703

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +9
    /asterix-app/data/page_views.adm
  1. … 7 more files in changeset.
ASTERIXDB-865: fix for if-else expression.

Change-Id: I17978d2f694e2a5082903002b8388c5bd42811a5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/702

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>