asterixdb

Clone Tools
  • last updated 28 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
ASTERIXDB-1778: Optimize the edit-distance-check function

- Only calculate 2 * (threshold + 1) cells, rather than all cells per row.

- Terminate the calculation steps early when it become obvious that

the possible edit-distance value is greater than the given threshold.

There is no reason to compute all cells in the 2 dimensional array.

- Move the location of IListIterator to Hyracks since we now have

a CharacterIterator in a String. Change the name to ISequenceIterator.

- Add the section for the function in the manual.

- Remove letter counting filtering method since it is only applicable for

the string in ASCII range (0 ~ 127).

Change-Id: Ibc8729c4514bb87c347dd7d50358fd897b769977

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1481

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Jianfeng Jia <jianfeng.jia@gmail.com>

Enable commit runtime extension

Change-Id: I98083ea5e93cb5f45d92c5dfbacfee1020fad57a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1485

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 10 more files in changeset.
ASTERIXDB-1785: Remove servlet dependencies

Change-Id: I12bbd0754755982c95b522a9ade19e9f9690d95a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1484

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -5
    • +0
    /asterixdb/asterix-client-helper/pom.xml
    • -19
    • +13
    /asterixdb/asterix-common/pom.xml
Improve reading from and writing to Metadata pages

This change introduces a new interface IComponentMetadata.

Each LSM component is associated with a metadata object

which can be used to read and write arbitrary data to

the metadata pages of components. When flushing a

component, data in its metadata component is automatically

flushed to the disk component. For merge operations,

the IO Callback is responsible for merging the components'

metadata pages.

Change-Id: Id95ef33c0a0bc1abb3fc3ecdea5611ee4acd6dfa

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1476

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Integration-Tests: Ian Maxon <imaxon@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 138 more files in changeset.
Improve the github README.

Change-Id: I676ec5ee6bcca4f1dc36d6c65f1127c1fddef340

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1480

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Polish the github README.

Change-Id: I93b4eca1ef9a27dc2f14cd4a0e4bb384159731ce

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1479

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

RAT Cleanup, Resulting LICENSE fixes

Also:

- removed unused minimal javascript

- relocated storage test datagen package to hyracks-test-support

- eliminated MiniDFSCluster writes outside of target

- clean up .gitignore

- add line comments to PigletParser (taken from SQLPP.jj grammar)

Change-Id: I029dee65ac6b1d7ab7bddba66257a4857f682caa

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1468

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -13
    • +0
    /hyracks-fullstack/algebricks/pom.xml
  1. … 57 more files in changeset.
Introduce IStorageComponentProvider

Change-Id: If86750cdb2436c713f6598e54d4aaaf23d9f7bbf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1451

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 413 more files in changeset.
Random cleanup

Change-Id: I44e64473f22d8587d6f98e8177287493e0216ecd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1478

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Use Chunked Http Response

Change-Id: I249180f58e92058dd3b264ea17c4196b4baf4348

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1474

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 23 more files in changeset.
Add AWS automation scripts to asterix-server.

- Allows users to customize an AWS-based instance by editing

conf/aws_settings.yml and conf/instance_settings.yml.

- Starts an AWS cluster, install JDK and AsterixDB automatically.

- Let the default value of storage.metadata.memorycomponent.numpages

adjust to the available JVM heap size.

Change-Id: If4061501e3561a649c3a2bb3068dc257f03c092d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1475

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +54
    /asterixdb/asterix-server/src/main/aws/README
    • -0
    • +35
    /asterixdb/asterix-server/src/main/aws/ansible/aws_stop.yml
    • -0
    • +38
    /asterixdb/asterix-server/src/main/aws/bin/start.sh
    • -0
    • +23
    /asterixdb/asterix-server/src/main/aws/bin/stop.sh
Replace Servlets with Netty Based HTTP Servers

Change-Id: I3d552d4eb8c868535ca4c41cbcf7e352217b18ae

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1429

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 53 more files in changeset.
Cache Knowledge of CDDL Source Jars on Central

Avoid downloading source code jars (for CDDL licensed dependendencies)

repeatedly, by persisting the (non-)existence in the local repo.

Change-Id: I961c36d9d64990043598b062bdb542cfb084972a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1472

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Minor cleanups for JobManager and ICCApplicationContext.

Change-Id: Iba7b6fd9b75a141fcc9f589db4b8cdeac570ec2d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1471

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Disable join rewriting for OR predicates for Feeds.

Change-Id: Ief2fafdc9fcc6c905e44ede13439796894213e7a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1467

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

ASTERIXDB-1320, ASTERIXDB-1323: License Fixes

ASTERIXDB-1320:

- LICENSE lists a large number of CDDL licensed bits of software

CDDL is Category B we should provide a link to the source code (see 3.1.

Availability of Source Code in (1)). Previous advice on legal-discuss

was this goes in NOTICE but recent discussions have left this a bit more muddled.

ASTERIXDB-1323:

- Missing normalize.css (MIT) ./asterix-examples/src/main/resources/admaql101-demo

/static/css/bootstrap.min.css

- Missing license for second bottle file (MIT) ./asterix-examples/src/main/

resources/tweetbook-demo/bottle.py

- Bootstrap version bundled is Apache licensed not MIT licensed ./asterix-app/src/

main/resources/webui/static/js/bootstrap.min.js

- It’s also not mentioned for all licenses what each license is (MIT/BSD etc) that

can be helpful. The version of the bundled software is also helpful.

- Should include text of RainbowVis-JS license (or better still a pointer to a copy

of the license file) [5] not a pointer to a URL on github

Also, misc cleanup.

Change-Id: Ie9fe9c18f63624896ccda420e1bf83ae0127021e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1463

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -10
    • +17
    /asterixdb/asterix-server/pom.xml
    • -28
    • +0
    /asterixdb/src/main/licenses/content/raw.githubusercontent.com_codehaus_paranamer-git_master_LICENSE.txt
  1. … 9 more files in changeset.
Implements concurrent query management support.

The following changes are included:

-- factor out JobManager, NodeManager, and ResourceManager from ClusterControllerService;

-- let each application plugin its own IJobCapacityController implementation;

-- let each job specify its required cluster capacity;

-- add a required cluster capacity estimation visitor for optimized query plans;

-- add admission control and queuing for queries, but always executes DDLs and DMLs immediately;

-- add tests for JobManger, NodeManager, ClusterCapacity, ClusterCapacityVisitor, and IJobCapacityController;

-- enlarge the -Xmx setting for ManagixSqlppExecutionTest.

Change-Id: I8fb6fda57efa139114dd234e08cc7de7129468c8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1424

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 105 more files in changeset.
Merge release-0.8.9 branch into master

Change-Id: Id4353716267d45ce21580ac2856e6a751d05d1f8

    • -7
    • +1
    /asterixdb/asterix-client-helper/pom.xml
Update TLP pom version, move Hyracks dep ver.

Change-Id: I0cd4e2910d4055efb6f2e2a6de8b1ef8f67275e2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1461

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Fix the operator precedence of LIKE.

Change-Id: I0cd4e2910d4055efa6f2d2a6de8b1ef8f67275e5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1456

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Replace Java serialization in checkpoints by Json

Change-Id: Id4353716267d45ce21580ac2856b6a552d05d1f7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1457

Reviewed-by: Till Westmann <tillw@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Remove tinyaccessor dependency from production.

Change-Id: Ib2dfb36b59ba4a77884c30c2b11c2a846c4890fa

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1459

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 8 more files in changeset.
ASTERIXDB-1760: support per-query customizations for compilation parameters.

Change-Id: I6e18f3f7706e574553a02e15a39daddda3c413b2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1458

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

[maven-release-plugin] prepare for next development iteration

    • -1
    • +1
    /asterixdb/asterix-client-helper/pom.xml
    • -1
    • +1
    /asterixdb/asterix-experiments/pom.xml
    • -1
    • +1
    /asterixdb/asterix-external-data/pom.xml
  1. … 19 more files in changeset.
[maven-release-plugin] prepare release apache-asterixdb-0.9.0-rc2

    • -1
    • +1
    /asterixdb/asterix-client-helper/pom.xml
    • -1
    • +1
    /asterixdb/asterix-experiments/pom.xml
    • -1
    • +1
    /asterixdb/asterix-external-data/pom.xml
  1. … 19 more files in changeset.
Move AsterixDB to stable Hyracks version

[maven-release-plugin] prepare for next development iteration

  1. … 56 more files in changeset.
[maven-release-plugin] prepare release apache-hyracks-0.3.0-rc2

  1. … 56 more files in changeset.
AQLPlus Refactoring 1: add a new rule controller

- Add a new rule controller that is to be used for FuzzyJoinRuleCollection.

If the first rule is not fired in the first iteration, no additional rules

in the given collection will be checked. If the first rule is fired, then

it behaves like SequentialFixpointRuleController - run rules sequentially

until one iteration over all rules produces no change.

- This rule controller is added to make sure that fuzzy-join framework does

not interfere with non-fuzzy-join queries.

Change-Id: I2742e891339e5aba37a00f77d7f18cb3c09bcfe2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1432

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Check for nonexistant git.properties

Change-Id: I1821416abb0387ee05b9add9f9c15798deed25d2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1453

Reviewed-by: Michael Blow <mblow@apache.org>

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>