Clone Tools
  • last updated 22 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE][STO] Force Checkpoints/Index Metadata Files to Disk

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Ensure the system checkpoint file is forced to disk.

- Ensure index metadata files and checkpoints are forced

to disk.

Change-Id: I27ab8ed39e23760b514640d77532a1dc24a97992

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3943

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 3 more files in changeset.
[NO ISSUE][NET] Log ChannelReadInterface Stats on Failure

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- When the read buffers of a FullFrameChannelReadInterface

are exceeded, log its stats to help in debugging the issue.

- Warn when a partial frame is being written over a full

frame write channel.

- Rename ThreadSafetyGuaranteedBy -> GuardedBy.

- Annotate networking calls with their synchronization

guards.

Change-Id: I89eed0c06dbf4b0e86747538bff286dc37853957

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/3663

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Al Hubail <mhubail@uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -0
    • +36
    ./main/java/org/apache/hyracks/util/annotations/GuardedBy.java
  1. … 11 more files in changeset.
[NO ISSUE][RT] Add Thread-Based Stats Collector

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Add infra to allow collecting thread-based stats during

runtime for any thread that belongs to a task.

- Collect number of pinned pages per thread and report it

in the TaskProfile.

- Aggregate pinned pages counters from all job tasks and

report it as diskIoCount in the metrics field in the json

response. The plan is to move this stats to the profile

field when it is introduced.

- Collecting pinned pages stats is currently enabled by

default for any job with IndexSearchOperatorNodePushable.

The plan is to allow enabling/disabling as part of the

job profiling change.

- Add test case for diskIoCount metric.

- Remove unused IndexSearchOperatorNodePushable constructor.

Change-Id: I44dfcedcadb3d0f48815b521e7d495e473b02e3d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3555

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +34
    ./main/java/org/apache/hyracks/util/IThreadStats.java
    • -0
    • +34
    ./main/java/org/apache/hyracks/util/IThreadStatsCollector.java
    • -0
    • +39
    ./main/java/org/apache/hyracks/util/ThreadStats.java
  1. … 25 more files in changeset.
[NO ISSUE][COMP] Improve warnings for SQL++ hints

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Issue warnings for all hints that were not processed

  by the SQL++ parser. A hint is not processed because

  it is either unknown or unexpected at given location

Change-Id: Iec46335a8db4360e5431b145cd9e98c7075c7fda

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3517

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

  1. … 19 more files in changeset.
[ASTERIXDB-2516][RT] Modifty range map function of parallel sort

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Currently, the range map function of parallel sort passes "null"

to get a comparator to sort the samples and produce the range map.

The comparator provider will enforce providing a type and prevent

passing "null". The range map function needs to be updated to get

the types of the sort fields and use them to get comparators.

- changed the output type of the local sampling function from

list of list of ANY to binary. The old type computer was removed.

- added null writer aggregate function that just produces null as

an aggregate value. this is needed in order to propagate the type

of the sort fields from the local step to the global step so that

the range map function can know the types of the sort fields.

Change-Id: I7edbb10906cc4464210af87a5b1630ba3aecbde0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3333

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

  1. … 13 more files in changeset.
[NO ISSUE] Use RuntimeMXBean.getPid() when available

(reapplies 7cc982e5 which was inadvertantly reverted)

Change-Id: I0f4575affd9689f0044bac9959404ad76e133358

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3320

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

  1. … 2 more files in changeset.
[NO ISSUE] Fix logging for ncservice-based tests

Change-Id: Id264aede0f62558ad6e34355047c623a1d594692

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3311

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

  1. … 33 more files in changeset.
[NO ISSUE] Use RuntimeMXBean.getPid() when available

Change-Id: Ic2371171dfc01423921c2e2d04fbc68a38978f2e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3312

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +31
    ./test/java/org/apache/hyracks/util/PidHelperTest.java
  1. … 2 more files in changeset.
[NO ISSUE] SonarQube fixes

Change-Id: I9f135fa10a0f78c967f2803bb2c3bce83e96a123

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3307

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 1 more file in changeset.
[NO ISSUE] Apply / enforce java import order

The process-sources target will now sort imports as well as

format source code; the source-format job will likewise verify

import order in addition to source code format

Change-Id: I55d976c4df10d9919c6a25683be2a3e3304e65d9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3288

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -1
    • +1
    ./main/java/org/apache/hyracks/util/DiskUtil.java
    • -2
    • +2
    ./test/java/org/apache/hyracks/util/MathTest.java
  1. … 621 more files in changeset.
[ASTERIXDB-2516][COMP] Avoid writing field names & values when comparing records

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

ARecordVisitablePointable writes field names, field tags, and field values

first before giving access to the record information. This is not ideal for

comparison. A different record accessor is needed for comparison. Also, the

field names should be sorted which ARecordVisitablePointable does not provide.

- avoid this writing when a pointable to the name & value can be obtained

(especially when the field value already includes the tag)

- use UTF8Pointable cached values (string length, meta length) to compare

instead of using the string comparator which would recalculate these values

- refactored some common code.

- removed not used methods in ARecordPointable

Change-Id: I19ac95a91749b2983bf06f763e463521a97a261c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3280

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 14 more files in changeset.
[NO ISSUE][OTH] Introduce NC CacheManager

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Introduce NC CacheManager that can be used to cache

values and reevaluate them based on cache policy.

- Add test case for CacheManager.

Change-Id: I8cba7753af11469e8a45cb1d59dfd70c17cd05f6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3277

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -0
    • +55
    ./main/java/org/apache/hyracks/util/cache/CacheManager.java
    • -0
    • +49
    ./main/java/org/apache/hyracks/util/cache/CacheableValue.java
    • -0
    • +46
    ./main/java/org/apache/hyracks/util/cache/ICacheManager.java
    • -0
    • +34
    ./main/java/org/apache/hyracks/util/cache/ICachePolicy.java
    • -0
    • +41
    ./main/java/org/apache/hyracks/util/cache/ICacheableValue.java
  1. … 2 more files in changeset.
[NO ISSUE][HYR] EnsureAllCcTasksCompleted failure handling

Don't halt on interrupt while waiting for aborted cc tasks to complete,

or on interrupt while notifying cc of success of the completion

Change-Id: I02819afcb80a0bcd645c3f79950c3fa12dba0274

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3274

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +1
    ./main/java/org/apache/hyracks/util/ExitUtil.java
  1. … 1 more file in changeset.
[NO ISSUE] Add API to override log level on halt

Change-Id: Ia5574d5f51c23f6972c5f086938f355a0b55d007

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3268

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

    • -2
    • +8
    ./main/java/org/apache/hyracks/util/ExitUtil.java
[NO ISSUE][HTTP] Character encoding fixes

- honor Accept-Charset on response

- honor request encoding on requests

Change-Id: I3c066e2ce190c0f271fa1c421ccff657bedb5a44

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3183

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

  1. … 33 more files in changeset.
[NO ISSUE] Cleanup / refactor upgrade code

Change-Id: Ic81e87e70eecf49b71f9d96b1ac7c7180a314564

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3174

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 4 more files in changeset.
[NO ISSUE][OTH] Add Remote Address to IServletRequest

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Add the remote address to IServletRequest.

- Set remote address in request reference.

Change-Id: Iab4a0b4d26e82a4d1b9ce134c0dab2f1ae94d0c6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3172

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 6 more files in changeset.
[ASTERIXDB-2518][RT] Introduce Request Tracker

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Introduce IReceptionist to generate request references.

- Track all requests by uuid.

- Add more information to active_requests response.

- Replace StatementExecutorContext by RequestTracker.

- Deprecate StatementExecutorContext (to be removed)

- Allow extensions to set optional parameters in query service.

- Return forbidden when a cancellation is attempt on a request

that is not cancellable.

Change-Id: If08ecd91c55881743b2ecf40a628fa3d4166c554

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3163

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +8
    ./main/java/org/apache/hyracks/util/JSONUtil.java
  1. … 40 more files in changeset.
[NO ISSUE] Compatibility improvements

Change-Id: Idde612dace51121f1e5bc91519e9236b7e4f96a4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3149

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 3 more files in changeset.
[NO ISSUE] Compatibility improvements, misc cleanup / refactoring

Change-Id: I1839c585b254e5b4252f456b367b3a5db2dd53c8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3139

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Michael Blow <mblow@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +97
    ./main/java/org/apache/hyracks/util/CompatibilityLevel.java
  1. … 12 more files in changeset.
[NO ISSUE][HYR] Binary compatibility enhancements

Infrastructure & changes to enable binary compatibility with 0.9.4

Change-Id: I77d4919be4853d9afe9b0137861cff3b1d751e20

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3128

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -0
    • +58
    ./main/java/org/apache/hyracks/util/CompatibilityUtil.java
  1. … 33 more files in changeset.
[NO ISSUE][OTH] Support log redaction 2

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Modify ILogRedactor to enable reversing the redaction

- Redact user data in exceptions thrown in the grammar file

Change-Id: If971d0a913e2b7efe521e2d54646568f789937b5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3125

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 2 more files in changeset.
[NO ISSUE][OTH] Support log redaction

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

Support log redaction.

Change-Id: I602c833ba2a055da8fbe8782ec62be683ff4581b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3105

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

    • -0
    • +29
    ./main/java/org/apache/hyracks/util/ILogRedactor.java
    • -0
    • +37
    ./main/java/org/apache/hyracks/util/LogRedactionUtil.java
  1. … 28 more files in changeset.
[NO ISSUE][OTH] Use Log4j2 Application Context

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Instead of using Log4j2's default LoggerContext, use the

application context to avoid using incorrect configuration

for loggers.

Change-Id: Iea86ddc7a505b8f2c816cc4887a6dc46871ae76d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3116

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

[NO ISSUE] Tracer improvements

Log traces to their own log with custom level,

as well as make the emitted log work with the

chrome tracer without modification

Change-Id: I81c158fcd17927d65e7b501345fdbc98001ba86a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3064

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

  1. … 2 more files in changeset.
[ASTERIXDB-2490][NET] Support Encrypted IPC Connections

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Add CC/NC options to support SSL connections.

- Add APIS to support secured connections.

- Support encrypted connections for CC/NC IPCs.

- Add keys/certificates for testing.

- Add SqlppExecutionTest with SSL connections enabled.

- Sort imports.

Change-Id: I7007a9be25287a94c5936d440355cfedb8e032b9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3052

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 54 more files in changeset.
[ASTERIXDB-2479][API] Add Network Diagnostics API

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Add a new API that shows the state of node to node

connections and their logical channels to help diagnose

networking issues.

- Add channel details to the waiting thread name in

NetworkOutputChannel.

- Add test case.

Change-Id: Id6fd5a96c56e7078d1404bebcbab8afe93ba8f64

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3025

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -0
    • +10
    ./main/java/org/apache/hyracks/util/JSONUtil.java
  1. … 14 more files in changeset.
[NO ISSUE] Avoid NPE logging shutdown hooks if shutdown already in progress

Change-Id: Id7102a975bd6e2d653198067bb5b5e7573ded7e7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2962

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -2
    • +5
    ./main/java/org/apache/hyracks/util/ExitUtil.java
[NO ISSUE][RT] Allow getting the value of a span duration

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Enable getting the duration for spans. This is useful for

delay calculations.

Change-Id: Icce0ac0a0d47a26655bf640f3f1a92506d87c30e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2940

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[NO ISSUE][ING] Halt on active suspend or resume failures

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Failures during active handler suspend or resume leaves the

system in an inconsistent state.

- When that happens, we halt and rely on the recovery to go

back to a consistent state.

Change-Id: I00d31f704f2fa22a5e14c711b6771345ca7d000a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2889

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

    • -0
    • +2
    ./main/java/org/apache/hyracks/util/ExitUtil.java
  1. … 1 more file in changeset.