Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE] Remove asterix-yarn

This installer method really isn't as popular as we'd hoped, and it relies

in large part on managix style config, so in lieu of adapting it to INI style

it is being removed.

Change-Id: I480cf780b0a6a1d66b1978df782737479d0fece1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2186

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

    • -116
    • +0
    ./main/assembly/binary-assembly.xml
    • -49
    • +0
    ./main/java/org/apache/asterix/aoya/Deleter.java
    • -494
    • +0
    ./main/java/org/apache/asterix/aoya/Utils.java
    • -103
    • +0
    ./main/resources/scripts/asterix.cmd
  1. … 37 more files in changeset.
[NO ISSUE][HYR] Notify CC of NC shutdown only after shutdown is complete

- close NC IPC manager after sending shutdown notifcation to CC

Change-Id: Idde1f69a0e0a9a948898d9271441ca95485b77f4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2159

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

    • -24
    • +38
    ./main/java/org/apache/asterix/aoya/Utils.java
  1. … 7 more files in changeset.
[ASTERIXDB-2158] Remove AsterixException (step 1)

- user model changes: no

- storage format changes: no

- interface changes: replace AsterixException on signatures

Details:

This change is the first step towards removing AsterixException from

all interfaces.

Change-Id: I3e858576f39f671cbf5eb14adc7a22aab1335faf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2135

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Murtadha Hubail <mhubail@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 49 more files in changeset.
[NO ISSUE] Update plugin versions

Updated / aligned plugin versions as follows:

build-helper-maven-plugin -> 3.0.0

maven-antrun-plugin -> 1.8

maven-assembly-plugin -> 3.1.0

maven-clean-plugin -> 3.0.0

maven-compiler-plugin -> 3.7.0

maven-dependency-plugin -> 3.0.2

maven-failsafe-plugin -> 2.20.1

maven-jar-plugin -> 3.0.2

maven-resources-plugin -> 3.0.2

maven-scm-plugin -> 1.9.5

maven-surefire-plugin -> 2.20.1

versions-maven-plugin -> 2.5

Change-Id: I3bdeec1d8ac7c7cefa900a0b1d453cb845f85846

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2108

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 32 more files in changeset.
[NO ISSUE][HYR][*DB] Minor refactoring / address SonarQube comments

Change-Id: Icf10b6df0fdc006675d8f0da6fd06d50200c6b6a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2098

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 60 more files in changeset.
[ASTERIXDB-1949][FUN][ING] Function usage check refactoring in feed

- user model changes: no

- storage format changes: no

- interface changes: yes

Removed several interefaces for maintaining reference count.

Added getFunctions and getFeeds method for MetadataNode.

Details:

1. Change the usage check from reference count to scan feed connections

in all dataverses.

2. Add test case for drop dataverse which has function that is being

used in other dataverse. This operation should be blocked.

3. Fix small bug in apply function metadata which the function dataverse

was not recorded properly.

Change-Id: I568f7af18e69216ff2a5fd3b623a1667809b2f95

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1787

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 25 more files in changeset.
Fix function usage check in feed

1. Add reference count field to Function entity.

2. Add reference count check when drop function.

3. Increate reference count when apply function to feed. Decrease the

reference count when disconnect feed.

4. Add test cases for drop function that is being used and drop function

that is no longer in use.

Change-Id: I04bed3836455997269a4cae7088dcc25c745a3df

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1763

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 23 more files in changeset.
AsterixDB Rat Execution Audit & Fixes

Change-Id: I3d771c5b63eaef4b6a0b4da769039ed5bca17736

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1609

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 486 more files in changeset.
Remove Plan Plotter

Change-Id: Ib6a77070344a40c3ae5bb9ff20b8593506d3c746

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1587

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 14 more files in changeset.
Unify structure of Cluster Controller and Node Controller

Change-Id: Ife3a002371a07ee9cdd32e1ffd50cc775bf1d453

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1514

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 160 more files in changeset.
Configuration Revamp

- Ini section of node / cc details now returns ini param names instead of

managix option names

- Normalized command line -vs- ini file configuration parameter names

- Eliminated unused parameters

- Ini validation

- Migrate *DB parameters out of [app] and into nc / cc sections as

appropriate

- Eliminate [app] section. Cluster-wide configuration lives in [common]

- Sort properties alphabetically when returned by HTTP api

Change-Id: I95b7e0bd4538ef42817c8826e76412150074b754

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1487

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Michael Blow <mblow@apache.org>

Tested-by: Michael Blow <mblow@apache.org>

  1. … 173 more files in changeset.
ASTERIXDB-1711: Move test infra from test.aql

Change-Id: I5d631a2028fb80c823fbaafb7269f15d07685dc9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1512

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 31 more files in changeset.
Introduce Strategy Based Replication and Fault-Tolerance

This change includes the following:

- Introduce new APIs for Replication and Fault-Tolerance Strategies.

- Add configuration in cluster description file for high-availability.

- Add built-in replication strategies (Metadata_Only, Chained_Declustering)

- Add built-in fault-tolerance strategies (Auto, Metadata_Node)

- Remove none cluster state functionality from ClusterStateManager.

- Add customizable NC startup sequence

Change-Id: I1d1012f5541ce786f127866efefb9f3db434fedd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1405

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 109 more files in changeset.
Feed Connection Refactoring

1. The feed subscription network using FeedJoint is removed.

2. FeedConnection metadata dataset is added (pkeys: dataverseName,

feedName, datasetName).

3. Replaced the old intake job + collect job combination with one single

job using SplitOperator.

4. Now one feed can connect to multiple datasets.

5. The disconnect feed job is replaced by ActiveManagerMessage.

6. The new feed life cycle is:

- Create feed

- Connect feed to dataset0, dataset1, dataset2, etc.

- Start feed

- Stop feed

- Disconnect feed

7. New feedEventListner framework by Abdullah

Change-Id: Ic36267eb9a10df21734ce1cc1f38583e23c9e8f0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1259

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 192 more files in changeset.
Fix Issues With Binary Assembly Licenses, Cleanup

- cleanup / fix supplemental model

- remove unused licenses

- add missing client helper jars, managix, yarn jars to LICENSE

- allow same dependency to be mappped into multiple license

dependencySets

- prune extraneous supplemental model files

Change-Id: I8b9d1f13960bd5cf8782f0cc785eed8f3414b123

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1442

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 19 more files in changeset.
ASTERIXDB-1720 - Generate License / Notice Files

- Includes Maven plugin to analyze dependencies & assemble LICENSE &

NOTICE files using Apache FreeMarker templates, formatting to desired

LICENSE & NOTICE output format.

- LICENSE & NOTICE files for the 'asterix-server', 'asterix-installer',

and 'asterix-yarn' binary assemblies are generated by the build

- Automated LICENSE & NOTICE file generation for source release is not

addressed by this patch

- Fixes ASTERIXDB-1311: Add Rome Apache 2.0 License in the LICENSE/NOTICE

Change-Id: I0963a85cb2be47dbf6bfd8c7f6fec767ef32e7e2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1402

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 56 more files in changeset.
Remove Incubator Disclaimer

Change-Id: Ib68d1c6a925559c1ab369ca26debaeef1e961b99

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1390

Reviewed-by: Till Westmann <tillw@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 20 more files in changeset.
ASTERIXDB-1711: rename asterix_transaction_log

- s/asterix_transaction_log/transaction_log/

- update storage version

- remove some dead code

Change-Id: Ieed464a1993a6bbff798e18e4c94245755a447eb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1368

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 2 more files in changeset.
ASTERIXDB-1711: root metadata

s/asterix_root_metadata/root_metadata/

s/AsterixConstants/StorageConstants/

Change-Id: I7afc3062a4b98883a7a54bd410e8df558e5ebf3c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1367

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 5 more files in changeset.
Added more explanations for two config parameters

- Added more planataions for storage.memorycomponent.numpages and

storage.memorycomponent.globalbudget

Change-Id: Idea269eec4d89f665772267588ce2b019327de04

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1281

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 5 more files in changeset.
Add Default Dataverse and AnyObject Datatype

This change adds "Default" dataverse and

Metadata.AnyObject type which is the completely

open record type. In addition, this change cleansup between

subsequent test cases lowering the chance that a failed

test causes the following tests to fail. In addition, it

prints out the list of tests which left some leftover.

Change-Id: Ie02c74c8b005dce73888afd4dfe19ede2c60a8e8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1174

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 203 more files in changeset.
ASTERIXDB-1569: the config file now supports unit, comma, and decimal.

- This patch fixes an issue that the config file only supports byte

value for the byte required parameters. Now, we can use unit (KB, MB, GB ...),

comma, and decimal.

Change-Id: I763d1b06e93f75775c0294da0d609c2bf3e102c9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1064

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 12 more files in changeset.
Update adm.grammar and printers for double/float

adm.grammar was not accepting suffixed doubles. This was breaking

a lot of round-trip ADM cases. I also changed the default print for

float and double to not have a suffix, because this makes the output

very odd (NaNd, NaNf, -Infinityf). The print mode for integers

has also been changed to omit the suffix, but, similarly the old

format is still accepted.

Change-Id: I6164d74f6c286fa160a30cff9ad47e97a30e0770

Reviewed-on: https://asterix-gerrit.ics.uci.edu/932

Reviewed-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <michael.blow@couchbase.com>

  1. … 498 more files in changeset.
Eliminate Hard Tabs From Java Files

tabs->spaces

Change-Id: I0dfbeaa9b9b24d3da106ead85afd9df02b14ddaa

Reviewed-on: https://asterix-gerrit.ics.uci.edu/921

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -1
    • +1
    ./main/java/org/apache/asterix/aoya/Deleter.java
  1. … 66 more files in changeset.
Normalize XML Whitespace

Normalize whitespace in project XML files (e.g. pom.xml), to two-spaces

per indentation level.

Cleanup rewriter error messages for user-defined functions

Change-Id: Ic06e3ff4431508d878e0cc614fbf957887a3c682

Reviewed-on: https://asterix-gerrit.ics.uci.edu/836

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -102
    • +102
    ./main/assembly/binary-assembly.xml
    • -233
    • +233
    ./main/resources/base-asterix-configuration.xml
    • -25
    • +25
    ./main/resources/configs/local.xml
    • -4
    • +2
    ./test/resources/hadoop/conf/core-site.xml
    • -8
    • +8
    ./test/resources/hadoop/conf/hdfs-site.xml
    • -16
    • +16
    ./test/resources/hadoop/conf/mapred-site.xml
  1. … 160 more files in changeset.