Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[ASTERIXDB-2532][RT] per-operator profiling

Enables profiling in queries at the operator-level when the analyze

variable is set in a query.

Change-Id: Ie16f3901ae5b32920d8552d5fd1ec8bb6e2ec8ae

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3226

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -1
    • +1
    ./stats/impl/ClientCounterContext.java
  1. … 59 more files in changeset.
[NO ISSUE][API] Return Async Query Results As JSON

- user model changes: yes

- storage format changes: no

- interface changes: yes

Details:

- Add ResultMetadata that can hold metadata about a job's

result.

- Add required CC functions to get ResultMetadata.

- Add IJobResultCallback that is called when a job's result

is written successfully.

- Calculate a job's processed objects on the job completion.

- Calculate a job's duration on the job completion.

- Use the async query request format when serving the result

from QueryResultApiServlet.

- Return a proper JSON envelop in QueryResultApiServlet

which includes the results as well as metrics fields.

- Add test case for returning JSON response for async

query.

Change-Id: Ic4812a14925099a677f9e77a0040f881d2600724

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3401

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +8
    ./result/ResultDirectoryRemoteProxy.java
  1. … 57 more files in changeset.
[NO ISSUE] Prevent .* imports

Change-Id: I00309aa789d2e10ccc7bbe79cb2c0bdfd6e2925c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3296

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

Tested-by: Michael Blow <mblow@apache.org>

    • -1
    • +6
    ./stats/impl/ClientCounterContext.java
  1. … 9 more files in changeset.
[NO ISSUE] Apply / enforce java import order

The process-sources target will now sort imports as well as

format source code; the source-format job will likewise verify

import order in addition to source code format

Change-Id: I55d976c4df10d9919c6a25683be2a3e3304e65d9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3288

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -1
    • +1
    ./result/ResultDirectoryRemoteProxy.java
    • -3
    • +3
    ./stats/impl/ClientCounterContext.java
  1. … 623 more files in changeset.
[NO ISSUE] Ensure serialVersionUIDs are present

Serializable classes should define a serialVersionUID; define those

where missing. For classes present in 0.9.4.x, initialize the value

to the auto-configured serialVersionUID on those versions of the class

Change-Id: Ia92d0c81f3681dce7ec0f643e2edf77e2ac4dbc5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3141

Tested-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 51 more files in changeset.
[NO ISSUE][HYR] Binary compatibility enhancements

Infrastructure & changes to enable binary compatibility with 0.9.4

Change-Id: I77d4919be4853d9afe9b0137861cff3b1d751e20

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3128

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -1
    • +1
    ./result/ResultDirectoryRemoteProxy.java
  1. … 33 more files in changeset.
[ASTERIXDB-2490][NET] Support Encrypted Multiplexed Connections

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Use SocketChannelFactory in multiplex connections

to support both unencrypted and encrypted sockets.

- Adapt TCPEndpoint to socket channels that require

handshake.

- Adapt test cases to API changes.

Change-Id: I9cbed93c162018bad17923d50d4987011cbba16c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3071

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 16 more files in changeset.
[ASTERIXDB-2490][NET] Support Encrypted IPC Connections

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Add CC/NC options to support SSL connections.

- Add APIS to support secured connections.

- Support encrypted connections for CC/NC IPCs.

- Add keys/certificates for testing.

- Add SqlppExecutionTest with SSL connections enabled.

- Sort imports.

Change-Id: I7007a9be25287a94c5936d440355cfedb8e032b9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3052

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 53 more files in changeset.
[NO ISSUE][OTH] Fix hyracks-api Dependences

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Ensure hyracks-api module depends only on hyracks-util. This way

new APIs can be added to hyracks-api and used on all other modules

without facing cyclic dependency issues.

Change-Id: I7f4329b3dad99c256fb2e10a7863aaca41990ce0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3047

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -3
    • +3
    ./result/ResultDirectoryRemoteProxy.java
  1. … 47 more files in changeset.
[NO ISSUE][OTH] Remove Unused Imports

- user model changes: no

- storage format changes: no

- interface changes: no

Change-Id: Iafff39073d0fedaff74a26ef7e3260008a79ff0c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2893

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

    • -2
    • +1
    ./stats/impl/ClientCounterContext.java
  1. … 67 more files in changeset.
[ASTERIXDB-2314][HYR] Dataset in class names in Hyracks

- user model changes: no

- storage format changes: no

- interface changes: yes

Change-Id: I260add3a2dfb4a722440af5008a1a75f9446579e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2478

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -57
    • +0
    ./dataset/HyracksDatasetDirectoryServiceConnection.java
    • -55
    • +0
    ./dataset/HyracksDatasetDirectoryServiceInterfaceRemoteProxy.java
    • -244
    • +0
    ./dataset/HyracksDatasetReader.java
    • -0
    • +56
    ./result/ResultDirectory.java
    • -0
    • +55
    ./result/ResultDirectoryRemoteProxy.java
    • -0
    • +74
    ./result/ResultSet.java
    • -0
    • +243
    ./result/ResultSetReader.java
  1. … 113 more files in changeset.
[NO ISSUE][RT] Abort tasks on local network failures

- user model changes: no

- storage format changes: no

- interface changes: yes

Add error code to IInputChannelMonitor.notifyFailure

Details:

- Previously, there was an assumption that all failures

reported to an IInputChannelMonitor come from a remote

task.

- This assumption is not always true and could lead

to jobs hanging.

- To fix this, we report an error code indicating whether

the failure is local or remote and if the failure is local

then we fail the local task and report the failure to cc.

Change-Id: I7ea5b9008383faaac7c563671242b03919090b35

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2806

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 14 more files in changeset.
[NO ISSUE] Incremental cleanup of deprecated exception ctors

Change-Id: I1e7c3655828fc6530cef83ea502a6cfbf41acddf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2533

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 240 more files in changeset.
[ASTERIXDB-1706][RT] Ensure All Result Frames Are Read

- user model changes: no

- storage format changes: no

- interface changes: yes

- Removed IDatasetInputChannelMonitor

Details:

- Currently there is a possibility that the EOS

comes in DatasetInputChannelMonitor right after

the check for avaibale frames is performed which

will result in missing some result frames from

being read. When this happens, empty result will

be returned if no frames were read before. This

change ensures that the state between checking

the avaiable frames and the EOS is consistent.

- Clean up HyracksDatasetReader.

- Use error code for result read failure.

Change-Id: I7d5a78fa20fe200cfffd21a215e052481c6d61ca

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2337

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -141
    • +117
    ./dataset/HyracksDatasetReader.java
  1. … 5 more files in changeset.
[ASTERIXDB-2256] Reformat sources using code format template

Change-Id: I4faa141c1a8c9700d5e9ac50b839acc9d1eede73

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2310

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -4
    • +4
    ./dataset/HyracksDatasetDirectoryServiceInterfaceRemoteProxy.java
    • -3
    • +3
    ./stats/impl/ClientCounterContext.java
  1. … 982 more files in changeset.
[NO ISSUE] Refactor IPC reconnect logic to be usable by all IPC connections

Change-Id: I2430510b22f936b89879df98322ef51ec87c6da6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2284

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -1
    • +1
    ./dataset/HyracksDatasetDirectoryServiceConnection.java
  1. … 14 more files in changeset.
[ASTERIXDB-1564][CONF] Consistently Use Log4j2

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Replace java.util.logging by Log4j2.

- Excluded classes due to their tests:

- IoUtil

- Tracer

Change-Id: Ic137571292f45de1f1994c61d328b97185012197

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2226

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 390 more files in changeset.
[NO ISSUE][RT] Abort CC jobs on first time registration

- user model changes: no

- storage format changes: no

- interface changes: yes

- application context is in charge of providing and renewing cc client

connection.

details:

- This change allows revival of cc if it gets killed.

- Jobs that were started by this cc are aborted and cleaned up on all ncs

upon first time registration.

- client connections are repaired on ncs when dead connection

is detected.

Change-Id: If755b7131bdc91790ed28be66f0c61b51f28c2fa

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2026

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 28 more files in changeset.
Separate index build from index access

This change separates index build from index access.

All indexes now have a single dataflow helper which

uses the index path to locate the resource on the nc

to read the resource from memory or disk.

Existing resource metadata and dataflow helpers were

combined into resource builders eliminating lots of

duplicated code.

Change-Id: Ie4ea3aaa63dff8d246fa43ca7c7359729bc8cf47

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1728

Integration-Tests: Ian Maxon <imaxon@apache.org>

Tested-by: Ian Maxon <imaxon@apache.org>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 571 more files in changeset.
Deferred result delivery improvements

- Change representation for result set handles to not require URL encoding

- Report errors from the QueryStatusApiServlet for failed jobs

- Fix repeated result consumption for async/deferred requests

- Better error handling in QueryResultApiServlet

- Add host + path to RequestParameters to provide URLs as handles

- Fix logging for failed async jobs

- Fix test framework to not share request parameters between tests

- Move more shared code to AbstractQueryApiServlet

- Make DatasetClientContext a static inner class of HyracksDataset

Change-Id: I88fe289fe9109ea012c63d82af0083dce6bde31b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1548

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -38
    • +0
    ./dataset/DatasetClientContext.java
  1. … 73 more files in changeset.
Handle error conditions in the /query/result API

- introduce AbstractQueryApiServlet to factor out common code of

QueryResultApiServlet and QueryStatusApiServlet

- clean up ResultReader interface

- remove org.apache.asterix.api.http.servlet.HyracksProperties

Change-Id: Icb99fccb4b41768fa010c574bf1703ffcd47535e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1532

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 16 more files in changeset.
Handle error conditions in the /query/status API

Change-Id: I30176c5c70dcc5f7f6605ad79dd0e41967373d9c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1522

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 15 more files in changeset.
ASTERIXDB-1714: Eliminate dependency on org.json

Change-Id: Ie9c5400fd134ae75d43385255af7794e968b1c7e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1392

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -34
    • +27
    ./stats/impl/ClientCounterContext.java
  1. … 133 more files in changeset.
Introduce MessagingNetworkManager for NC2NC AppMessaging

This change introduces MessagingNetworkManager to NodeControllerService.

The MessagingNetworkManager is used to open channels that are used for NC2NC

application messaging. The read and write interfaces of the messaging channels

are set by a MessagingChannelInterfaceFactory which is set by the application.

Change-Id: I5c0bd7c11c1e78954ebceff49cb274d8073a64bd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/897

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

  1. … 74 more files in changeset.
Move Hyracks to subfolder

    • -0
    • +38
    ./dataset/DatasetClientContext.java
    • -0
    • +60
    ./dataset/HyracksDataset.java
    • -0
    • +57
    ./dataset/HyracksDatasetDirectoryServiceConnection.java
    • -0
    • +55
    ./dataset/HyracksDatasetDirectoryServiceInterfaceRemoteProxy.java
    • -0
    • +262
    ./dataset/HyracksDatasetReader.java
    • -0
    • +60
    ./net/ClientNetworkManager.java
    • -0
    • +62
    ./stats/AggregateCounter.java
    • -0
    • +38
    ./stats/Counters.java
    • -0
    • +29
    ./stats/IClusterCounterContext.java
    • -0
    • +278
    ./stats/impl/ClientCounterContext.java
  1. … 4418 more files in changeset.