asterixdb

Clone Tools
  • last updated 10 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
ASTERIXDB-54: s/IHyracksCommonContext/IHyracksTaskContext/

Change-Id: I5f2daf1d8f933d86e0254be443f3ebcef17ecbcf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/533

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

ASTERIXDB-1229: - Fixed RemoveRedundantListifyRule to consider general expressions

Change-Id: I5e7b6f5ca4ed51e91de371b9d0b4e4dabdd2f2df

Reviewed-on: https://asterix-gerrit.ics.uci.edu/555

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Preston Carman <prestonc@apache.org>

Depend on stable Hyracks version

Here I am depending on the next Hyracks version, by

fetching from the Apache staging repository.

Change-Id: I402cef4206fa0610eaff899cf005875323fb18d3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/562

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Adapt Replication to Append Only LSM Components

This change includes the following:

- Make LSN recording in a single tree in LSM components.

- Pass LSN byte offset with every tree index file being replicated.

- Add LSN to remote recovery logs to check which logs should be replayed.

- Update ILogRecord method names to better describe their operation.

Change-Id: I8bd2656746e1c293b981d5f43e80928314ccbad0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/561

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Refactored External Data

This change re-arrange asterix module's order. asterix-

external-data is moved in front of asterix-metadata.

Change-Id: I46b60b5e1cc37fd59adc0dd89f374d96502091b2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/559

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -177
    • +167
    /asterix-external-data/pom.xml
  1. … 79 more files in changeset.
Add Method to Get LSN Byte Offset in LSM Disk Components

The LSN byte offset is needed to support updating LSNs in remote replicas.

Change-Id: I2eb407e607157fe9c71a9cf22b04accc832be31b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/560

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Asterix MessageBroker implementation

This change includes the following:

- Add implementation for CC/NC MessageBroker.

- Implement GlobalResourceIdFactory using MessageBroker.

- Change resource id factory to GlobalResourceIdFactory.

- Refactor metadata indexes fixed properties.

- Use fixed resource ids for metadata indexes.

Change-Id: If4320e2c5a0130d2f86a4be6ae61f5cee43e30af

Reviewed-on: https://asterix-gerrit.ics.uci.edu/486

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 12 more files in changeset.
Changes required to support MessageBroker implementation

This change includes the following:

- API changes to support MessageBroker implementation.

- IResourceIdFactory interface to support application dependent implementation.

Change-Id: Ib9f49234eebe912c48e7f71980433a9b42595741

Reviewed-on: https://asterix-gerrit.ics.uci.edu/485

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 6 more files in changeset.
patch 2

  1. … 141 more files in changeset.
patch 2

Changed the IFrameWriter Contract

Updated existing operators and added a test case for BTreeSearchOperatorNodePushable.

With this change, calling the open method itself moves it to the open state and

hence, close must be called.

Change-Id: I03da090002f79f4db7b5b31454ce3ac2b9e40c7f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/551

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 27 more files in changeset.
Changed the IFrameWriter Contract

Updated existing operators to conform to the new contract.

These operators are either index operators or Feed operators.

The rest of the operator already follow the new contract.

Change-Id: Ibcebe876340a25be0f561945582a95211c140e10

Reviewed-on: https://asterix-gerrit.ics.uci.edu/552

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Fix ASTERIXDB-1201

The reason the nulls were hitting the bulk loader was because

the filter was always set to null. It seems to work fine when

it is passed in just as it is in IndexInsertDeletePOperator

Change-Id: I0fbfaeb8a98316f4d148285832ad31d991481e4b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/553

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Run ExecutionTest w/integration test framework

I changed the default local.xml to use 2 NCs with

2 partitions each like AsterixHyracksIntegrationUtil

so that the results will match despite using simple

string compare to determine correctness.

There is also one test in particular (big-object-join)

that I had to add an artificial order by clause to

to deal with different results.

Issues outstanding:

- HDFS in ClusterExecutionIT needs to be thought out

Change-Id: I423f2a7c77839b999d466dd5cace302574d956c0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/525

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

  1. … 3852 more files in changeset.
Disable non-JDK 8 build profiles.

We use Java 8 specific features now, so we shouldn't bother

with any profiles for compiler settings older than that.

Change-Id: I97b03f76bd7afa66e9be5a20ff64477383525868

Reviewed-on: https://asterix-gerrit.ics.uci.edu/545

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

patch 1

    • -0
    • +7
    /asterix-app/data/tinycollege/staff.adm
    • -0
    • +7
    /asterix-app/data/tinycollege/students.adm
  1. … 75 more files in changeset.
patch 1

  1. … 45 more files in changeset.
ASTERIXDB-1110 Fix count keeping in primary index opTracker

This change fixes the counter of number of active operations in primary

index opTracker. This is accomplished by sharing of counter between multiple

partitions. Each transaction will have that counter as part of its

context object

Change-Id: I0dc34b9a3aa69d39ac2eda11c17e7ad0ccc1a661

Reviewed-on: https://asterix-gerrit.ics.uci.edu/536

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

ASTERIX-1211: Malformed metadata record for enforced open index - Changed type on the open olist field in index metadata to [ ANY ] - Fixed heterogeneous list deserialization

Change-Id: Ib587a138f59f37c369ba01e627a1ef9dd5a4989e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/532

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Add a test case for Hyracks error reporting.

Change-Id: Ic3ac4c7b0a07eacbc448ce5724085eb8d1e6bc4d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/527

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

ASTERIXDB-1198: make ISerializerDeserializer implementations in AsterixDB stateless.

Change-Id: I808b6583db6b48a0e9000dcf0ac88c03c336c3a5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/522

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Jianfeng Jia <jianfeng.jia@gmail.com>

  1. … 50 more files in changeset.
ASTERIXDB-1206: call initialize()/deinitialize() in parallel for OperatorNodePushables in SuperActivityOperatorNodePushable.

Change-Id: I8700d5258d658ebbf711b4233bb0def1e8cf7c39

Reviewed-on: https://asterix-gerrit.ics.uci.edu/526

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Jianfeng Jia <jianfeng.jia@gmail.com>

ASTERIXDB-1198: make ISerializerDeserializer implementations in Hyracks stateless.

Change-Id: I1ec86d0a93d8f15d88d68fab24dbe858c5ba8842

Reviewed-on: https://asterix-gerrit.ics.uci.edu/521

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Jianfeng Jia <jianfeng.jia@gmail.com>

ASTERIXDB-1105 - LICENSE per submodule

This is a good part of what we need to have a specific set of

dependencies per binary assembly. The main key here is using the

maven remote resources plugin, and supplemental resources to

fill in info from the POM of dependencies where it is lacking.

For things that aren't described in Maven dependencies,

like Javascript files, they are added as LICENSE fragments

that get included in binary assemblies.

Change-Id: I2a6c4fb809b6fcad578007b8f48bf8bce179cd83

Reviewed-on: https://asterix-gerrit.ics.uci.edu/520

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -0
    • +3
    /algebricks/algebricks-compiler/pom.xml
    • -0
    • +3
    /algebricks/algebricks-examples/pom.xml
    • -0
    • +3
    /algebricks/algebricks-rewriter/pom.xml
    • -0
    • +3
    /algebricks/algebricks-runtime/pom.xml
  1. … 60 more files in changeset.
Fix ASTERIXDB-1194,ASTERIXDB-1195,ASTERIXDB-1196,ASTERIXDB-1197.

Change-Id: I7d167b64bf9ec754182b5b2fe44dfc7e5908c686

Reviewed-on: https://asterix-gerrit.ics.uci.edu/325

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 10 more files in changeset.
ASTERIXDB-1105 - LICENSE per submodule

This is a good part of what we need to have a specific set of

dependencies per binary assembly. The main key here is using the

maven remote resources plugin, and supplemental resources to

fill in info from the POM of dependencies where it is lacking.

For things that aren't described in Maven dependencies,

like Javascript files, they are added as LICENSE fragements

that get included in binary assemblies.

Also fix AsterixEventServiceUtil to not die when

the asterix-server bundle has files in the root of

the archive.

Change-Id: I2a6c4fb809b6fcad578007b8f48bf8bce179cd82

Reviewed-on: https://asterix-gerrit.ics.uci.edu/518

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 23 more files in changeset.
Add a constructor for FileSplit: FileSplit(String nodeName, String path, int ioDeviceId).

change-Id: I1c7cc7752dd7b6d5261ff02d591f25d76d442a1c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/324

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Fix ASTERIXDB-1104

This changes the wrapper hyracks-ecosystem POM to a name that makes

more sense for distributing as a source tarball. Nothing depends on

this artifact so changing its name should not be a big deal.

Change-Id: Id3a57fe0a26957e42ced6be4ecb8a39a392f16bf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/516

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Fix ASTERIXDB-1043

The example for the index-drop statement was wrong. It only used a

Qualified name instead of a DoubleQualified

Change-Id: I762eadd60a7b9e09be244d8eaeb673dd03eb2108

Reviewed-on: https://asterix-gerrit.ics.uci.edu/514

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Fix ASTERIXDB-1108

Just adding some missing licenses, for jQuery plugins and text examples in

the Hyracks textserver examples.

Change-Id: I298cf9a5204a25e8556fb00c4577d1f15675ea46

Reviewed-on: https://asterix-gerrit.ics.uci.edu/513

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>