asterixdb

Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[maven-release-plugin] prepare release apache-asterixdb-hyracks-0.2.17-incubating-rc0

    • -3
    • +3
    /algebricks/algebricks-compiler/pom.xml
    • -1
    • +1
    /algebricks/algebricks-examples/pom.xml
    • -2
    • +2
    /algebricks/algebricks-rewriter/pom.xml
    • -6
    • +6
    /algebricks/algebricks-runtime/pom.xml
  1. … 53 more files in changeset.
ASTERIXDB-1273: Get file references from components to be merged

This change includes the following:

- Get file references from components to be merged instead of file map manager.

- Fix an issue with passing inverted index files to replication job.

Change-Id: I7d0f06c002db86a2a34e6393d06c49fb528c22b7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/596

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Asterix NCs Fault Tolerance

This change includes the following:

- Adapt replication to unique partitions storage.

- Implement auto failover for failing NCs.

- Implement auto failover for metadata node.

- Fix for ASTERIXDB-1251 using proper error message.

- Basic replication test cases using vagrant virtual cluster for:

1. LSM bulkload components replication.

2. LSM Memory components replication and recovery.

3. Metadata node takeover.

These test cases will be part of the cluster test profile.

Change-Id: Ice26d980912a315fcb3efdd571d6ce88717cfea4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/573

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 57 more files in changeset.
ASTERIXDB-1261, ASTERIXDB-1274, ASTERIXDB-1275 UUID Fixes UUIDPrinter no longer has a UUID object UUIDComparator is used by AbstractComparisonEValuator Removed UUID_STRING type Added test for uuid comparator

Change-Id: Ie33dc8b02e32b3e85a3cb64ef08cb028a50f4ca0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/587

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 9 more files in changeset.
patch 3

patch 3

  1. … 83 more files in changeset.
Remove errant LICENSE file from asterix-yarn

Change-Id: I402cef4206fa0610eaff899cf005875323fb18d8

Reviewed-on: https://asterix-gerrit.ics.uci.edu/595

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -815
    • +0
    /asterix-yarn/src/main/resources/LICENSE
Add per-binary assembly LICENSE and NOTICE

Change-Id: I2a6c4fb809b6fcad578007b8f48bf8bce179cd82

Reviewed-on: https://asterix-gerrit.ics.uci.edu/590

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

  1. … 6 more files in changeset.
ASTERIXDB-1258, ASTERIXDB-1259: fix test queries.

Change-Id: I6b3a7d26a1931e4ec146e243f2b89d2586996b75

Reviewed-on: https://asterix-gerrit.ics.uci.edu/588

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Fix for ASTERIXDB-1200

Fixes an issue where in the Hyracks integration tests,

if the result size is 0, a NPE is thrown instead of

an assert passing or failing.

Change-Id: Ib519882b9cbca941addcd66232c176a2eaeecc4b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/524

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Feed Fixes and Cleanup

1. Introduce filesystem feed data source.

2. Fix the order of closing feed stages on disconnection.

3. Added Twitter feed to the compatibility utility to allow

using it with its alias.

4. First part of the feed log space.

5. Fixed the handling of duplicate key exception.

Change-Id: I4e8db26a810efd1fbaa52ceeb3efd0c8328ab070

Reviewed-on: https://asterix-gerrit.ics.uci.edu/574

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -1
    • +1
    /asterix-algebra/src/main/javacc/AQLPlus.jj
  1. … 403 more files in changeset.
Enabled Datasets to use Datatypes from foreign Dataverses

Removed broken Metadata Secondary Indexes

Added DatatypeDataverse field to Dataset

Cleaned up Metadata Tests

Added tests for dropping used Datatypes

User-facing changes are:

1) Allow qualified datatype when creating dataset

2) Metadata queries for datasets will now

include the type dataverse

Change-Id: I24dbc04dcb2a4126fc8361ebe3104877a0d1f2bb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/558

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 125 more files in changeset.
Improve the Testing Framework

This change includes the following improvements to the test framework

1. Checking each expected failure against the failure exception.

2. Checking against multiple causes of failure in case of multiple

expected errors.

3. Check if a test that is expected to fail pass.

4. Make temp datasets use different storage path.

Change-Id: I957ecf19bf7209981e010e0e50fb882442a525dd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/537

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 14 more files in changeset.
some cleanup

- remove redundant code around DataSources

- fix typo in constant name

Change-Id: I48602e1acbbc22642d4467ab37f27f337de20c5e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/583

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Fix Error in Aborting Task in Super Activity

When aborting a task, its thread gets interrupted. This creates

a problem when interrupting

Change-Id: I603d3c101e0a4de4816eb5a6a7fd4320df317ce4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/582

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Stop Network Output Channel Sending Extra Bytes

This change re-introduce an optimization to the output channel

which ensures sending of data bytes only. This optimization

was broken when the big object change was introduced.

Change-Id: I896daf80deb23bcae5d5e934565cf5493ed828ba

Reviewed-on: https://asterix-gerrit.ics.uci.edu/581

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

ASTERIXDB-1187, ASTERIXDB-1162 and ASTERIXDB-1252 fixes, plus new internal functions

This change contains the following updates and fixes:

- New deep-equality function which also handles numeric equality,

e.g., [2.0, 2, 1.0] == [2, 2, 1].

- New internal functions for record manipulation, including add and remove fields from records

- Fixes for ASTERIXDB-1187: The RecordMergeDescriptor does not fully support

open record merge. Merging records with open fields results in "NullPointerException".

- Fixes to address issue ASTERIXDB-1162: dealing with closed or partly closed record

added to an open record field.

- Fixes issue ASTERIXDB-1252: Problems with Autogenerated Key

Change-Id: I3621ebdd71c7cd91b50d77a972ad863cea7fcbc2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/298

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 70 more files in changeset.
ASTERIXDB-1256: wait for job completion on SYNC results delivery

Change-Id: Ib8a214ba4ff636d12927720c2311a9a5ca247d9e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/580

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Fix for ASTERIXDB-1247

It seems like the root of this is the testing harness closing the index/deleting the file before it has

had a chance to flush all of its pages. There are also some changes to cover potential

corner cases where confiscated pages could be lost, but this doesn't seem to directly

affect the bug.

Change-Id: Ia580242b3f7753fc2f793f879332de3270ee3fee

Reviewed-on: https://asterix-gerrit.ics.uci.edu/575

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Give names to parameterized JUnit tests

Change-Id: Ifb53be6df9ad0efb1032b03ad8622c1bb7b7afbe

Reviewed-on: https://asterix-gerrit.ics.uci.edu/568

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Change LICENSE creation mode for binary assemblies

Change-Id: I402cef4206fa0610eaff899cf005875323fb18d6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/571

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -0
    • +1761
    /asterix-installer/src/main/licenses/LICENSE
    • -0
    • +403
    /asterix-installer/src/main/licenses/NOTICE
    • -0
    • +1739
    /asterix-server/src/main/licenses/LICENSE
    • -0
    • +403
    /asterix-server/src/main/licenses/NOTICE
    • -0
    • +1785
    /asterix-yarn/src/main/licenses/LICENSE
    • -0
    • +403
    /asterix-yarn/src/main/licenses/NOTICE
    • -0
    • +815
    /asterix-yarn/src/main/resources/LICENSE
Remove deprecated binary assemblies and fix others

Change-Id: I402cef4206fa0610eaff899cf005875323fb18d5

Reviewed-on: https://asterix-gerrit.ics.uci.edu/570

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

Fix licenses in Hyracks binary assemblies

Change-Id: I2a6c4fb809b6fcad578007b8f48bf8bce179cd81

Reviewed-on: https://asterix-gerrit.ics.uci.edu/569

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

ASTERIXDB-1044 Allow Reading large records from HDFS

This change tests reading of HDFS records larger than 8192.

The fix for the issue was merged previously.

Change-Id: I3cf52be4bc0fd8af2555062eeb421d7235088d98

Reviewed-on: https://asterix-gerrit.ics.uci.edu/529

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +11
    /asterix-app/data/hdfs/large-record.txt
Reduce Object Creation in Index Operations

Removed proportioanl object creation in btrees and rtrees during insert and

search operations. Instead, we re-use objects in OpContexts.

Change-Id: I7fab280372951522db02f8c2ff1d7d5b15529cd7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/245

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

  1. … 12 more files in changeset.
First stage of external data cleanup

In this change, different parts of external data were refactored.

The goal was to make it more modular, easier to maintain and allow

higher flexibility for extension in addition to reducing code redundancy.

Change-Id: I04a8c4e494d8d1363992b6fe0bdbe6b2b3b7b767

Reviewed-on: https://asterix-gerrit.ics.uci.edu/566

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

  1. … 329 more files in changeset.
Improvment on Cursor for Delimited Data

This change allows the parser to parse records in addition to streams.

Change-Id: I84ff40db664633c633277e9cc0ffa534cda9f26a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/567

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Divide Cluster into Unique Partitions

The change includes the following:

- Fix passing NC stores to AsterixConfiguration.

- Unify storage direcotry name in the instance level rather than the node level.

- Divide the cluster into unique storage partitions based on the number of stores.

- Refactored FileSplits and moved out of AqlMetadataProvider.

- Make AsterixHyracksIntegrationUtil use the passed configuration file.

- Make File Splits pass relative index paths of partitions rather than absolute paths.

- Remove unused AqlCompiledMetadataDeclarations class.

Change-Id: I8c7fbca5113dd7ad569a46dfa2591addb5bf8655

Reviewed-on: https://asterix-gerrit.ics.uci.edu/564

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 27 more files in changeset.
Make Index Path Relative to NC IO Devices

This change includes the following:

- Store relative index path in persisted local resource as resource name.

- Fetch index absolute path based on FileSplit IO device and index relative path.

This change will enable a node to perform operations on an index that was created

on another node by finding the absolve path based on the node IO deviec and

the index relative path. This is needed in case a node leaves the cluster and

a replica node is assigned to take over and recover the index partitions

that belonged to the failed node.

Change-Id: I09fabd097b8a995ca959fe60286acdb43edfcfa1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/563

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 5 more files in changeset.
Fix for ASTERIXDB-1018, ASTERIXDB-1017, ASTERIXDB-1019, ASTERIXDB-1020, ASTERIXDB-1029, ASTERIXDB-1030, ASTERIXDB-1034

1. Inline SubplanOperator input and hence remove SubplanOperator.

2. Use boolean return from initFromSubTree to confirm that the

result should actually be used in IntroduceJoinAccessMethodRule

Prevent accidental attempted cast of null variable

in AbstractIntroduceAccessMethodrule.

Change-Id: Ifc1f844ac6e06e00da3f1618235b6ce9bfd48e9f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/489

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 22 more files in changeset.