Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Rewrite SQL++ functions.

-Maps SQL function names to internal names.

-Allows SQL++ builtin functions to be case-insensitive.

-Rewrites SQL-92 global aggregates.

-Refactors SQL++ AST visitors.

-Cleans up semantics of COLL_AGG and SQL-92 AGG.

Change-Id: Idb5a7c6780669b27065b0928bec7e4700cfb53a9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/759

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +1
    ./asterix/test/sqlpp/ParserTestExecutor.java
  1. … 451 more files in changeset.
ASTERIXDB-1378 Fix NPE on Feed Connect After Restart

This issue was caused by the way type traits are computed for each

index. since we have duplicate code to create the index dataflow

helper, we had to fix the way type traits are created in all of

these different places. We propably need to do further refactoring

to have common code for creating index dataflow helper instances.

Change-Id: If8f8696d252868a8cce0afdbaeda0dd046f99186

Reviewed-on: https://asterix-gerrit.ics.uci.edu/766

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -4
    • +5
    ./asterix/test/runtime/ExecutionTest.java
  1. … 15 more files in changeset.
Move AsterixDB to Subfolder

    • -76
    • +0
    ./asterix/app/external/TestLibrarian.java
    • -70
    • +0
    ./asterix/test/aql/AQLTestCase.java
    • -59
    • +0
    ./asterix/test/aql/AQLTestSuite.java
    • -34
    • +0
    ./asterix/test/common/TestHelper.java
    • -89
    • +0
    ./asterix/test/metadata/MetadataTest.java
    • -115
    • +0
    ./asterix/test/querygen/AQLToSQLPPConverter.java
    • -106
    • +0
    ./asterix/test/runtime/ExecutionTest.java
    • -112
    • +0
    ./asterix/test/runtime/ExecutionTestUtil.java
    • -135
    • +0
    ./asterix/test/runtime/HDFSCluster.java
    • -111
    • +0
    ./asterix/test/runtime/RepeatedTest.java
  1. … 44144 more files in changeset.
ASTERIXDB-1226: implement SQL++ core group-by semantics and syntatic sugars.

-Implmented SQL++ core group-by semantics;

-Implemented SQL++ group-by syntatic sugars for standard SQL;

-Added test cases;

-Fixed column alias rewriter;

-Fixed the variable scoping for joins.

Change-Id: I6e5477d5bf80114cfff49c8ecb163849ee55eba6

Reviewed-on: https://asterix-gerrit.ics.uci.edu/752

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +1
    ./asterix/test/sqlpp/ParserTestExecutor.java
  1. … 1963 more files in changeset.
Merge branch 'release-0.8.8' into master

Change-Id: I8fcf41c009f9faf51bc8bccc0c3c7217b7769149

    • -0
    • +23
    ./asterix/test/runtime/HDFSCluster.java
  1. … 36 more files in changeset.
Support Change Feeds and Ingestion of Records with MetaData

This change allows feeds to perform upserts and deletes

in order to perform replication of an external data source.

The change does so by performing the following:

1. The adapter produces [PK][Record]. (Record == null --> delete)

2. The insert is replaced by an upsert operator.

Change-Id: If136a03d424970132dfb09f0dda56e160d4c0078

Reviewed-on: https://asterix-gerrit.ics.uci.edu/621

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 270 more files in changeset.
ASTERIXDB-1325, ASTERIXDB-1326: fixed leftouterjoin on an external dataset

- Fixed the issue that optimizer ignores index_nl hint on an index on an external dataset.

- Fixed the issue that index-nested-loop-leftouterjoin on an external dataset returns an empty results.

- Modified OptimizerTest to enable mockup HDFSCluster.

- Added an optimizer test on an external dataset.

Change-Id: I91b2e57f0bd1beaa58dd28a84d8e08d308246b26

Reviewed-on: https://asterix-gerrit.ics.uci.edu/672

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 5 more files in changeset.
ASTERIXDB-1302 ASTERIXDB-1301 Fix Socket Feed Connection

A bug causes a read lock to never be released when a feed is

connected with "wait-for-completion" set to false. The bug

was fixed and a test case was added.

Another bug was causing the socket feed to not receive

connections correctly. The bug was fixed and a test case

was added.

Additionally, this change ensures that adapters have absolute

partitions to ensure consistency with regards to feed log

manager.

Change-Id: I8f6e982440d3577343f2479c3779653a9c3db614

Reviewed-on: https://asterix-gerrit.ics.uci.edu/660

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com>

    • -1
    • +0
    ./asterix/test/runtime/ExecutionTest.java
  1. … 49 more files in changeset.
Enabled Feed Tests and Added External Library tests

Feed tests had been switched off for a while due to having too many

sporadic failures. Now, we are switching them back on.

In addition, a new set of tests have been added to test that external

library works as expected.

Change-Id: Idd1fccd136fa2645b2707bbf7c04e60991ae8d4a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/625

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -0
    • +76
    ./asterix/app/external/TestLibrarian.java
    • -0
    • +6
    ./asterix/test/runtime/ExecutionTest.java
    • -5
    • +7
    ./asterix/test/runtime/RepeatedTest.java
  1. … 201 more files in changeset.
Intersect the secondary indexes before primary search

Change-Id: Ie167918fb23e39c8728840e4a90c1b85bf1bde85

Reviewed-on: https://asterix-gerrit.ics.uci.edu/578

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Jianfeng Jia <jianfeng.jia@gmail.com>

    • -3
    • +1
    ./asterix/test/runtime/ExecutionTest.java
  1. … 26 more files in changeset.
Remove unnecessary deprecation SuppressWarnings

Change-Id: I94eed0d97d9c3137b128a79b7e6e5e8ca00913a3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/618

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 1 more file in changeset.
ASTERIXDB-1280: avoid junit.framework.Assert

Change-Id: I4e2cfc9bc7e78b4807acd4c73e41a204d63f8023

Reviewed-on: https://asterix-gerrit.ics.uci.edu/606

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 1 more file in changeset.
Add Support for Upsert Operation

This change allows users to execute upsert commands which

couples delete if found with insert. It locks the primary

keys before doing the search ensuring consistency.

Change-Id: I8999000331795a5949d621d2dd003903e057a521

Reviewed-on: https://asterix-gerrit.ics.uci.edu/477

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -3
    • +8
    ./asterix/test/runtime/ExecutionTest.java
    • -3
    • +8
    ./asterix/test/runtime/HDFSCluster.java
  1. … 250 more files in changeset.
Feed Fixes and Cleanup

1. Introduce filesystem feed data source.

2. Fix the order of closing feed stages on disconnection.

3. Added Twitter feed to the compatibility utility to allow

using it with its alias.

4. First part of the feed log space.

5. Fixed the handling of duplicate key exception.

Change-Id: I4e8db26a810efd1fbaa52ceeb3efd0c8328ab070

Reviewed-on: https://asterix-gerrit.ics.uci.edu/574

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

  1. … 417 more files in changeset.
Enabled Datasets to use Datatypes from foreign Dataverses

Removed broken Metadata Secondary Indexes

Added DatatypeDataverse field to Dataset

Cleaned up Metadata Tests

Added tests for dropping used Datatypes

User-facing changes are:

1) Allow qualified datatype when creating dataset

2) Metadata queries for datasets will now

include the type dataverse

Change-Id: I24dbc04dcb2a4126fc8361ebe3104877a0d1f2bb

Reviewed-on: https://asterix-gerrit.ics.uci.edu/558

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 139 more files in changeset.
some cleanup

- remove redundant code around DataSources

- fix typo in constant name

Change-Id: I48602e1acbbc22642d4467ab37f27f337de20c5e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/583

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -1
    • +1
    ./asterix/test/runtime/RepeatedTest.java
  1. … 6 more files in changeset.
Give names to parameterized JUnit tests

Change-Id: Ifb53be6df9ad0efb1032b03ad8622c1bb7b7afbe

Reviewed-on: https://asterix-gerrit.ics.uci.edu/568

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -1
    • +1
    ./asterix/test/metadata/MetadataTest.java
    • -1
    • +1
    ./asterix/test/runtime/ExecutionTest.java
    • -1
    • +1
    ./asterix/test/runtime/RepeatedTest.java
    • -1
    • +1
    ./asterix/test/sqlpp/OptimizerParserTest.java
    • -1
    • +1
    ./asterix/test/sqlpp/SmokeParserTest.java
  1. … 1 more file in changeset.
First stage of external data cleanup

In this change, different parts of external data were refactored.

The goal was to make it more modular, easier to maintain and allow

higher flexibility for extension in addition to reducing code redundancy.

Change-Id: I04a8c4e494d8d1363992b6fe0bdbe6b2b3b7b767

Reviewed-on: https://asterix-gerrit.ics.uci.edu/566

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -7
    • +3
    ./asterix/test/runtime/ExecutionTest.java
  1. … 341 more files in changeset.
Divide Cluster into Unique Partitions

The change includes the following:

- Fix passing NC stores to AsterixConfiguration.

- Unify storage direcotry name in the instance level rather than the node level.

- Divide the cluster into unique storage partitions based on the number of stores.

- Refactored FileSplits and moved out of AqlMetadataProvider.

- Make AsterixHyracksIntegrationUtil use the passed configuration file.

- Make File Splits pass relative index paths of partitions rather than absolute paths.

- Remove unused AqlCompiledMetadataDeclarations class.

Change-Id: I8c7fbca5113dd7ad569a46dfa2591addb5bf8655

Reviewed-on: https://asterix-gerrit.ics.uci.edu/564

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -5
    • +0
    ./asterix/test/metadata/MetadataTest.java
    • -4
    • +0
    ./asterix/test/runtime/ExecutionTest.java
  1. … 39 more files in changeset.
Run ExecutionTest w/integration test framework

I changed the default local.xml to use 2 NCs with

2 partitions each like AsterixHyracksIntegrationUtil

so that the results will match despite using simple

string compare to determine correctness.

There is also one test in particular (big-object-join)

that I had to add an artificial order by clause to

to deal with different results.

Issues outstanding:

- HDFS in ClusterExecutionIT needs to be thought out

Change-Id: I423f2a7c77839b999d466dd5cace302574d956c0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/525

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -6
    • +10
    ./asterix/test/runtime/HDFSCluster.java
  1. … 3865 more files in changeset.
ASTERIXDB-1110 Fix count keeping in primary index opTracker

This change fixes the counter of number of active operations in primary

index opTracker. This is accomplished by sharing of counter between multiple

partitions. Each transaction will have that counter as part of its

context object

Change-Id: I0dc34b9a3aa69d39ac2eda11c17e7ad0ccc1a661

Reviewed-on: https://asterix-gerrit.ics.uci.edu/536

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 4 more files in changeset.
Fix ASTERIXDB-1194,ASTERIXDB-1195,ASTERIXDB-1196,ASTERIXDB-1197.

Change-Id: I7d167b64bf9ec754182b5b2fe44dfc7e5908c686

Reviewed-on: https://asterix-gerrit.ics.uci.edu/325

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +112
    ./asterix/aql/translator/QueryTranslatorTest.java
    • -21
    • +2
    ./asterix/test/metadata/MetadataTest.java
  1. … 19 more files in changeset.
Clean up compilation warnings.

Change-Id: Idbfcd9c67f91d373c5f7269125778a5681021227

Reviewed-on: https://asterix-gerrit.ics.uci.edu/505

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -29
    • +1
    ./asterix/test/runtime/HDFSCluster.java
  1. … 109 more files in changeset.
ASTERIXDB-1126 Correct comparators and type traits for external index

In case of external data, the type definition does not contain information

about primary keys and we should get them based on the data input format.

Change-Id: I71d924d7e2b7a7e6c752bc97679e612946afc17c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/504

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -11
    • +10
    ./asterix/test/runtime/HDFSCluster.java
  1. … 15 more files in changeset.
SQL++ support in AsterixDB: 1. implemented SQL++ expression to logical plan translator; 2. refactored REST API to be agnostic of query languages; 3. disabled fuzzy join queries for SQL++ runtime tests; 4. fixed several rewriting rules.

Change-Id: I82919c4527b304325059519d819a2c30cf2902a9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/479

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -73
    • +3
    ./asterix/test/runtime/ExecutionTest.java
    • -0
    • +117
    ./asterix/test/runtime/ExecutionTestUtil.java
    • -0
    • +103
    ./asterix/test/runtime/SqlppExecutionTest.java
    • -16
    • +24
    ./asterix/test/sqlpp/ParserTestExecutor.java
  1. … 1372 more files in changeset.
Verify that BufferCache is clean after tests

Change-Id: I5610e903be3347893e676c915b98316b06073c26

Reviewed-on: https://asterix-gerrit.ics.uci.edu/498

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -3
    • +6
    ./asterix/test/runtime/ExecutionTest.java
  1. … 1 more file in changeset.
SQL++ parser: 1. refactored asterix-aql to become asterix-lang-common and asterix-lang-aql, where the former is the common part for different languages; 2. added asterix-lang-sqlpp on top of asterix-lang-common; 3. ported parser tests, optimizer tests and runtime tests in asterix-app to their sql++ version, and added parser tests for all the queries.

Change-Id: Ie5af4e3b692ca017ec047a1ba3b404a51beb3a2e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/466

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -11
    • +7
    ./asterix/test/aql/AQLTestCase.java
    • -11
    • +11
    ./asterix/test/metadata/MetadataTest.java
    • -0
    • +107
    ./asterix/test/querygen/AQLToSQLPPConverter.java
    • -8
    • +10
    ./asterix/test/runtime/ExecutionTest.java
    • -4
    • +4
    ./asterix/test/runtime/RepeatedTest.java
    • -0
    • +133
    ./asterix/test/sqlpp/OptimizerParserTest.java
    • -0
    • +172
    ./asterix/test/sqlpp/ParserTestExecutor.java
    • -0
    • +94
    ./asterix/test/sqlpp/RuntimeParserTest.java
    • -0
    • +133
    ./asterix/test/sqlpp/SmokeParserTest.java
  1. … 10213 more files in changeset.
ASTERIXDB-1153: Determine build information at runtime

Very simple API. Just do a GET against /admin/version and get all of the build-time git info in JSON.

Change-Id: Ie392eb0cdbd25f2f4679fba12aae4c7a496e9637

Reviewed-on: https://asterix-gerrit.ics.uci.edu/468

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -0
    • +116
    ./asterix/api/http/servlet/VersionAPIServletTest.java
  1. … 10 more files in changeset.
ASTERIXDB-1102: VarSize Encoding to store length of String and ByteArray

This patch is to change the encoding format that stores the length value

of

the variable length type (e.g. String, ByteArray) from fix-size encoding

(2bytes) to variable-size encoding ( 1 to 5bytes)

It will solve the issue 1102 to enable us to store a String that longer

than 64K. Also for the common case of storing the short string ( <=

127), it will save one byte per string.

Some important changes include:

1. The UTF8StringSerDer and ByteArraySerDer is not Singleton instance

any more. I need some state to speedup the serialization and avoid the

object creatation. Luckily, 99% percent of Serializer were used as

factory way. The other 1% has been fixed.

A separate Test support, the ExcutionTest now can produce the only.xml

which stores the previous failed runtime test.xml. It can speedup the

debug process.

Change-Id: I41fff780f5c071742ef10129d83c8f945d5886d7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/450

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Jianfeng Jia <jianfeng.jia@gmail.com>

    • -10
    • +35
    ./asterix/test/runtime/ExecutionTest.java
  1. … 322 more files in changeset.
Change License Headers

Also tweak the NOTICE file with some extras.

Change-Id:I09bc388089e515d7f51fd39c31bfbbc9f00cf84f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/388

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -10
    • +14
    ./asterix/test/aql/AQLTestCase.java
    • -10
    • +14
    ./asterix/test/aql/AQLTestSuite.java
    • -10
    • +14
    ./asterix/test/common/TestHelper.java
    • -10
    • +14
    ./asterix/test/metadata/MetadataTest.java
    • -10
    • +14
    ./asterix/test/runtime/ExecutionTest.java
    • -10
    • +14
    ./asterix/test/runtime/HDFSCluster.java
    • -10
    • +14
    ./asterix/test/runtime/RepeatedTest.java
  1. … 2009 more files in changeset.