Clone Tools
  • last updated 24 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Change folder structure for Java repackage

Change only the folders, not the files, for our package name change.

This will break the build, and needs to be followed by a change to

the package name in all of the source files. However performing

the folder move and file change in two steps lets Git understand

that the files are the same, and lets us track revisions across

those files.

Change-Id: Iefd2a576415ebc1416cba2a3334d2b64f042ba92

Reviewed-on: https://asterix-gerrit.ics.uci.edu/306

Tested-by: Ian Maxon <imaxon@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -3069
    • +0
    ./translator/AqlTranslator.java
  1. … 3795 more files in changeset.
Changed metadata storage format for nullable field types. Moved field name generation to the client out of metadata node code. Changed naming scheme for autogenerated types. Moved GroupName, CompactionPolicy & CompactionPolicyProperties fields up from External\InternalDetails to Dataset record type definition

Change-Id: I223aded8aaf80f0688358899c0e8b0d6988fac93

Reviewed-on: https://asterix-gerrit.ics.uci.edu/323

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 206 more files in changeset.
whitespace fix for commit b361b06

Change-Id: I9b01a2cacb2a8efe0a4c0bb97436a9c59edb8e42

Reviewed-on: https://asterix-gerrit.ics.uci.edu/357

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 3 more files in changeset.
Fix for Issue 929

commit 58317b37a3a7b2546b4780f4427ae1ed21a4ece9

Author: Ubuntu <raman@ramangro.ramangro.d3.internal.cloudapp.net>

Date: Fri Aug 14 10:47:06 2015 +0000

Fix for Issue 929:

a) Added documenation for use of OAuth keys and tokens when using the built-in Twitter adaptor

b) Modified RSS feed adaptor and added documenation

Change-Id: I5521287a4fa1818c78a4f83b1a3cabeea8e6096d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/354

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 7 more files in changeset.
Introduces Feeds 2.0

commit c3f577861fc705d848c1641605689cadd6973bae

Merge: ebc4cae fc0c2c0

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Fri Jun 26 13:04:05 2015 -0700

Merge branch 'raman/feeds_2_release' of https://code.google.com/p/asterixdb-sandbox into raman/feeds_2_release

Conflicts:

asterix-app/src/main/java/edu/uci/ics/asterix/api/http/servlet/FeedServlet.java

asterix-external-data/src/main/java/edu/uci/ics/asterix/external/library/java/JObjectAccessors.java

commit ebc4cae21a7302869f953df1ebda601e798d12d2

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:14:45 2015 -0700

Introduces Feeds 2.0

Some of the prominent chnages introduced are as follows

a) Support for building a cascade network of feeds (via secondary feeds feature)

b) Feed Management Console for tracking active feeds and associated metrics

c) Support for elastic runtime for data ingestion

d) Improved fault-tolerance with support for logging of failed records

Documentation has been added at asterix-doc/src/site/markdown/feeds/

commit fc0c2c0549a6ee8b202e57607d2e110478cd57bb

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:14:45 2015 -0700

Introduces Feeds 2.0

Some of the prominent chnages introduced are as follows

a) Support for building a cascade network of feeds (via secondary feeds feature)

b) Feed Management Console for tracking active feeds and associated metrics

c) Support for elastic runtime for data ingestion

d) Improved fault-tolerance with support for logging of failed records

Documentation has been added at asterix-doc/src/site/markdown/feeds/

Change-Id: I498f01c591a229aaf51cec43ab20f3e5c4f072f4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/297

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -154
    • +462
    ./translator/AqlTranslator.java
  1. … 383 more files in changeset.
Temp dataset support: 1. DDLs for creating a temporary dataset 2. Garbage collection for temporary dataset 3. Reading, inserting, and deleting data from (to) a temporary dataset is locking-free (except metadata locks) and logging-free (except flush/merge/job-commit logs).

Change-Id: Id0960acd1b4dfbfa7685dba227634572ca50b126

Reviewed-on: https://asterix-gerrit.ics.uci.edu/241

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

  1. … 252 more files in changeset.
Range connector update with order by hint.

Change-Id: I1b36f6dea801950c39bf63f27a0ec70d3584c5b7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/254

Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

  1. … 35 more files in changeset.
Added support of typed indexes over open fields & indexes over nested fields

Open indexes requires user to provide a type along with a indexed field name.

This type would be enforced for all the indexed records, i.e. index cannot be created if in some records a field with provided name has a different type.

Index-specific rewrite rules match provided type with the inferred types of other arguments in join\select statements and trigger index rewrite.

Nested indexes use the same semantics as the regular indexes, with exception that field could be located arbitrarily deep inside nested structure

Change-Id: I53d00aba243ccf7cf79cf7d775dd305813d24f98

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/97

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

    • -41
    • +132
    ./translator/AqlTranslator.java
  1. … 1791 more files in changeset.
Several CSV, API, HTTP API, and Web interface improvements.

- APIFramework: internal refactoring to consolidate output PrintWriter,

OutputFormat, and all output flags into SessionConfig

- APIFramework: "HTML" is now a flag, rather than an OutputFormat

- HTTP API: Output format can be select via query parameter in

addition to HTTP Accept header

- CSV: default output is now without header, to improve roundtripping

- CSV: header can be requested via Accept header or "header" query

parameter

- Web interface: Added ability to select output format (JSON, CSV or ADM)

Change-Id: I91398bd30dbd6f3b1f69eb51fbf201010d0e5d93

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/242

Reviewed-by: Chris Hillery <ceej@lambda.nu>

Tested-by: Chris Hillery <ceej@lambda.nu>

  1. … 16 more files in changeset.
This change covers three points: 1. move the generation of UUIDs out of parsers 2. fixes a bug in the metadata lock when performing load operations 3. the external data scan operator is again a leaf operator 4. made sure the startup call doesn't return until the servers are ready to receive requests Merged master into branch for the second time.

The following commits from your working branch will be included:

commit da929c990249fe7f0699417fd7f7ea34908355af

Author: Abdullah Alamoudi <bamousaa@gmail.com>

Date: Fri Jan 16 11:51:14 2015 +0300

Moved generation of UUIDs out of parsers

Change-Id: I32437493cf48c79417f4280e9d8a85cfb1559b62

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/205

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

  1. … 60 more files in changeset.
- Fixed Type Casting issue - Reorganized duplicated internal class in the DelimitedDataParser and DelimitedDataParserFactory - Prevented a user from creating an inverted index on a dataset with a variable-length PK - INT64 is now the default type - Issue 852 fixed

Change-Id: I2d71e8a21da4f709c3259a3d3f678c640f9e1160

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/192

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 847 more files in changeset.
This change integrates a run statement for running Pregelix jobs into the AQL.

Therefore it also provides a new FlushOperator to flush all memory components of a dataset to disc.

Change-Id: I1f97cfdc79943abf035a7342bb777d59af6518e9

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/193

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

  1. … 23 more files in changeset.
Issue 548: Initial implementation of CSV output method.

Can be selected via the HTTP interface by setting the Accept: header to

text/csv.

Displays strings, numerics, booleans, and a couple duration types. Detects

situations that cannot be respresented as CSV (list values, nested records)

and throws an exception.

Introduces "outputRecordType" set option to define a fixed RecordType that

all results will be coerced to, to ensure consistent CSV output.

Added test support for CSV output, with one test case for now.

Change-Id: Ib53da6b3c69e38095bdc684b0e8cd53b9f4b1543

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/165

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 72 more files in changeset.
Made the correlated-prefix the default policy for filtered-datasets. Documented merge policies and filters.

Change-Id: I6c93d87b9fcee1f69601f5fd05192e56dd288879

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/176

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 4 more files in changeset.
remove unused parameters and return values

Change-Id: Ibc2cf3d0d1c96abe7de7c0b5bc4262272e52d365

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/132

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Issue 804: Spell "Adapter" consistently

Change-Id: I3141c1ddd2357ba8dd8ad94d6b98abc78151cd72

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/148

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

  1. … 39 more files in changeset.
Initial support for true ADM output (content type application/x-adm).

Elimiate the JSON "results" wrapper from API calls. Rename

DisplayFormat -> OutputFormat, TEXT -> ADM. Cleaned up some output and

added some useful comments. Fixed a few latent bugs in testdriver string

comparison routines. Refactored HTTP error handling in TestsUtils. Had

to update many expected test results.

Change-Id: I2d7ead038512455b2ab7844021cb62222400447b

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/137

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 1090 more files in changeset.
Implement TokenizeOperator in addition to the changes made by Zachary Heilbron. Now, the compiler builds the bulk-load plan. For other details, please refer to the corresponding Hyracks changes.

Change-Id: I646539d88ea2bdc6da4fbf2b6e9460a6189125ff

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/79

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

  1. … 116 more files in changeset.
Fixed framesize resetting issue during bulk-loading - issue 800 -> https://code.google.com/p/asterixdb/issues/detail?id=800 - added an user-friendly exception message

commit 8cc94c2de864b6f2ab2b0cf237b0d942841959c6

Author: Young-Seok <kisskys@gmail.com>

Date: Mon Aug 25 14:13:43 2014 -0700

Change-Id: I2dd9d67fdc150ae8af655baa741d8d3c711b5ca0

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/130

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 1 more file in changeset.
763: Omit wrapper "results" JSON object in HTTP API output for JSON results; Wrap JSON output in outer [array]; consolidate output logic into ResultUtils; use UTF-8 explicitly when converting byte[] from Hyracks to Strings

Change-Id: Idbeac3ebbf397b0ef73cc54b7d901a21ac855932

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/123

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Keren-Audrey Ouaknine <kereno@gmail.com>

  1. … 5 more files in changeset.
Added a new merge policy, called correlated-prefix.

Change-Id: I8f961eb28b4ea460f6326c8b4acaea02b50819e9

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/108

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 29 more files in changeset.
remove global metadata lock

Change-Id: Id05ff463fee356b3270b53d0b3137c4b1bc3d830

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/84

Reviewed-by: Sattam Alsubaiee <salsubaiee@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -169
    • +181
    ./translator/AqlTranslator.java
  1. … 12 more files in changeset.
Added filters to AsterixDB's primary and secondary indexes.

Change-Id: If16b2758bb25392c8dd0405d7d59ae503efad3f0

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/82

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 120 more files in changeset.
Adds a delivery mode called async-deferred

I added a new result delivery mode called async-deferred, this mode returns a handle once the query completed.

context: sync is a blocking call which returns the result once the query completed, whereas async returns a handle immediately to pull the results later.

async-defer is a hybrid of these two as it returns a handle but only once the query completed.

Change-Id: I8480d22ea9b107edf6d340073581c2613b017599

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/77

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 9 more files in changeset.
Add external indexes

This change include the following:

1. additional data parser for external data that parse hdfs records using Hive serdes.

2. allow users to create external data. this includes:

a) changes in metadata external dataset details.

b) addition of a new metadata index to store external file's statuses.

c) the pipeline for building the B-Tree and R-Tree indexes.

d) hyracks operators to fetch records with their RIDs using different formats.

e) hyracks operators to lookup and parse external records.

f) test cases for indexing and index access of different hdfs file formats.

g) exposing the secondary indexes over external data to the compiler.

3. adding a new aql command to refresh external datasets. this includes

a) global recovery on system startup.

b) changes in the aql parser.

c) construction of bulk modify pipelines and additional operators to perform local commit and abort operations (using 2PC protocol).

4. Added copyright header to all new files

5. Added additional test cases to test left outer join on external data

Change-Id: I1065a473299f6027eb073aeeba3a56d137f6f98e

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/70

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

    • -39
    • +538
    ./translator/AqlTranslator.java
  1. … 150 more files in changeset.
Support sort-based group-by, add test coverage for out-of-core code paths, and adapt to the new buffer cache interface. -- add the support for sort-based group-by -- add test coverages for disk-based code path, including multi-pass code paths -- populate framesize and group-by buffer size into asterix -- adapt to new interface for buffer cache

Change-Id: I4af9eaa6fa6a8ae76b8ecaa39184785a90b32710

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/36

Tested-by: Ian Maxon <imaxon@uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 39 more files in changeset.
Moved the skip secondary index search hint closer to the predicates.

  1. … 22 more files in changeset.
Added a hint to AQL to exclude secondary indexes from the query plan.

  1. … 29 more files in changeset.
reenable feed jobspec alteration + logging to metadata (bug filed)

  1. … 1 more file in changeset.
rename LoadFromFileStatement to LoadStatement

  1. … 15 more files in changeset.