Clone Tools
  • last updated 22 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Change folder structure for Java repackage

Change only the folders, not the files, for our package name change.

This will break the build, and needs to be followed by a change to

the package name in all of the source files. However performing

the folder move and file change in two steps lets Git understand

that the files are the same, and lets us track revisions across

those files.

Change-Id: Iefd2a576415ebc1416cba2a3334d2b64f042ba92

Reviewed-on: https://asterix-gerrit.ics.uci.edu/306

Tested-by: Ian Maxon <imaxon@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -271
    • +0
    ./common/AsterixAppRuntimeContext.java
    • -105
    • +0
    ./common/AsterixAppRuntimeContextProdiverForRecovery.java
    • -155
    • +0
    ./common/AsterixHyracksIntegrationUtil.java
    • -197
    • +0
    ./common/FeedWorkCollection.java
    • -168
    • +0
    ./http/servlet/ConnectorAPIServlet.java
    • -70
    • +0
    ./http/servlet/FeedServletUtil.java
    • -52
    • +0
    ./http/servlet/HyracksProperties.java
  1. … 3781 more files in changeset.
Add record type and primary key in the response of connector servlet api.

Change-Id: Ieefe79557cfb3786a6b22371a2e64ac4161ff900

Reviewed-on: https://asterix-gerrit.ics.uci.edu/315

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -3
    • +19
    ./http/servlet/ConnectorAPIServlet.java
  1. … 9 more files in changeset.
Adding introspection for getting record details.

Change-Id: Iba15acff0f6830cffbc33d9dac3b5f0c417be844

    • -37
    • +49
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 196 more files in changeset.
Adding introspection for getting record details.

Change-Id: Iba15acff0f6830cffbc33d9dac3b5f0c417be844

Reviewed-on: https://asterix-gerrit.ics.uci.edu/313

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

    • -37
    • +49
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 196 more files in changeset.
Add Apache RAT License Auditor plugin, and fix missing licenses

Change-Id: Ic0fa0b7836e8a69d0d8beed83f9c3b41c168afd4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/263

Reviewed-by: Chris Hillery <ceej@lambda.nu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -2
    • +2
    ./common/AsterixAppRuntimeContextProdiverForRecovery.java
    • -0
    • +14
    ./http/servlet/FeedServletUtil.java
    • -2
    • +2
    ./http/servlet/QueryResultAPIServlet.java
    • -2
    • +2
    ./http/servlet/QueryStatusAPIServlet.java
    • -0
    • +14
    ./http/servlet/ShutdownAPIServlet.java
  1. … 1530 more files in changeset.
YARN integration for AsterixDB

This is an initial version of YARN integration for AsterixDB.

- Uses static assignment of CC and NC nodes to NM locations

- Stores state locally on each NM, outside of HDFS

- "All or nothing" container allocation. We don't attempt to

move or rellocate containers the RM may kill (yet).

- Retains feature parity with managix.

Change-Id: I49c849179d17fc7faa446b9be57a0695df6836ab

Reviewed-on: https://asterix-gerrit.ics.uci.edu/161

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -0
    • +65
    ./http/servlet/ShutdownAPIServlet.java
  1. … 65 more files in changeset.
Introduces Feeds 2.0

commit c3f577861fc705d848c1641605689cadd6973bae

Merge: ebc4cae fc0c2c0

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Fri Jun 26 13:04:05 2015 -0700

Merge branch 'raman/feeds_2_release' of https://code.google.com/p/asterixdb-sandbox into raman/feeds_2_release

Conflicts:

asterix-app/src/main/java/edu/uci/ics/asterix/api/http/servlet/FeedServlet.java

asterix-external-data/src/main/java/edu/uci/ics/asterix/external/library/java/JObjectAccessors.java

commit ebc4cae21a7302869f953df1ebda601e798d12d2

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:14:45 2015 -0700

Introduces Feeds 2.0

Some of the prominent chnages introduced are as follows

a) Support for building a cascade network of feeds (via secondary feeds feature)

b) Feed Management Console for tracking active feeds and associated metrics

c) Support for elastic runtime for data ingestion

d) Improved fault-tolerance with support for logging of failed records

Documentation has been added at asterix-doc/src/site/markdown/feeds/

commit fc0c2c0549a6ee8b202e57607d2e110478cd57bb

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:14:45 2015 -0700

Introduces Feeds 2.0

Some of the prominent chnages introduced are as follows

a) Support for building a cascade network of feeds (via secondary feeds feature)

b) Feed Management Console for tracking active feeds and associated metrics

c) Support for elastic runtime for data ingestion

d) Improved fault-tolerance with support for logging of failed records

Documentation has been added at asterix-doc/src/site/markdown/feeds/

Change-Id: I498f01c591a229aaf51cec43ab20f3e5c4f072f4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/297

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -3
    • +13
    ./common/AsterixAppRuntimeContext.java
    • -0
    • +197
    ./common/FeedWorkCollection.java
    • -1
    • +2
    ./http/servlet/ConnectorAPIServlet.java
    • -133
    • +0
    ./http/servlet/FeedDashboardServlet.java
    • -63
    • +107
    ./http/servlet/FeedServlet.java
    • -1
    • +12
    ./http/servlet/FeedServletUtil.java
    • -2
    • +0
    ./http/servlet/QueryResultAPIServlet.java
  1. … 374 more files in changeset.
Fix for issue 872

Change-Id: If8cf621b8b89302cb28bd34f63e23f9c5f684351

Reviewed-on: https://asterix-gerrit.ics.uci.edu/290

Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com>

Reviewed-by: Ian Maxon <imaxon@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 1 more file in changeset.
Add a JSON rest-api for external connector that uses existing AsterixDB datasets.

Change-Id: I674110b26262fbbd93030b252113e153ff4580ef

Reviewed-on: https://asterix-gerrit.ics.uci.edu/288

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

    • -0
    • +151
    ./http/servlet/ConnectorAPIServlet.java
  1. … 4 more files in changeset.
Temp dataset support: 1. DDLs for creating a temporary dataset 2. Garbage collection for temporary dataset 3. Reading, inserting, and deleting data from (to) a temporary dataset is locking-free (except metadata locks) and logging-free (except flush/merge/job-commit logs).

Change-Id: Id0960acd1b4dfbfa7685dba227634572ca50b126

Reviewed-on: https://asterix-gerrit.ics.uci.edu/241

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

  1. … 252 more files in changeset.
Temporal update based on a merge from an old branch.

Includes the following new functions: overlap-bins, get-overlapping-interval, get-interval-start-date, get-interval-start-datetime, get-interval-start-time, get-interval-end-date, get-interval-end-datetime, get-interval-end-time

Change-Id: Ie15ed39ae7de83ce71c63c4e7490f2ebf5911540

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/244

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ildar Absalyamov <ildar.absalyamov@gmail.com>

  1. … 108 more files in changeset.
Added support of typed indexes over open fields & indexes over nested fields

Open indexes requires user to provide a type along with a indexed field name.

This type would be enforced for all the indexed records, i.e. index cannot be created if in some records a field with provided name has a different type.

Index-specific rewrite rules match provided type with the inferred types of other arguments in join\select statements and trigger index rewrite.

Nested indexes use the same semantics as the regular indexes, with exception that field could be located arbitrarily deep inside nested structure

Change-Id: I53d00aba243ccf7cf79cf7d775dd305813d24f98

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/97

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

    • -7
    • +9
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 1791 more files in changeset.
Several CSV, API, HTTP API, and Web interface improvements.

- APIFramework: internal refactoring to consolidate output PrintWriter,

OutputFormat, and all output flags into SessionConfig

- APIFramework: "HTML" is now a flag, rather than an OutputFormat

- HTTP API: Output format can be select via query parameter in

addition to HTTP Accept header

- CSV: default output is now without header, to improve roundtripping

- CSV: header can be requested via Accept header or "header" query

parameter

- Web interface: Added ability to select output format (JSON, CSV or ADM)

Change-Id: I91398bd30dbd6f3b1f69eb51fbf201010d0e5d93

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/242

Reviewed-by: Chris Hillery <ceej@lambda.nu>

Tested-by: Chris Hillery <ceej@lambda.nu>

    • -23
    • +9
    ./http/servlet/QueryResultAPIServlet.java
    • -28
    • +66
    ./http/servlet/RESTAPIServlet.java
  1. … 11 more files in changeset.
Allow hostnames instead of IPs for CC/NC startup (Issue 747)

Change-Id: I5337dbe1892d17962f9f20096af8638c3ca02b25

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/152

Reviewed-by: Chris Hillery <ceej@lambda.nu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -2
    • +2
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 6 more files in changeset.
This change integrates a run statement for running Pregelix jobs into the AQL.

Therefore it also provides a new FlushOperator to flush all memory components of a dataset to disc.

Change-Id: I1f97cfdc79943abf035a7342bb777d59af6518e9

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/193

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

  1. … 23 more files in changeset.
Issue 548: Initial implementation of CSV output method.

Can be selected via the HTTP interface by setting the Accept: header to

text/csv.

Displays strings, numerics, booleans, and a couple duration types. Detects

situations that cannot be respresented as CSV (list values, nested records)

and throws an exception.

Introduces "outputRecordType" set option to define a fixed RecordType that

all results will be coerced to, to ensure consistent CSV output.

Added test support for CSV output, with one test case for now.

Change-Id: Ib53da6b3c69e38095bdc684b0e8cd53b9f4b1543

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/165

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

    • -0
    • +3
    ./http/servlet/QueryResultAPIServlet.java
  1. … 70 more files in changeset.
Added flush logs and enabled non-sharp checkpoints

The following commits from your working branch will be included:

commit c11a22cfd916041c806409c6d8e66dd6ea162b7b

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Tue Nov 18 23:12:19 2014 -0800

Defined Startup LSN

commit 95a8752072e53ef62a11c39799f296209a3c622c

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Tue Nov 18 20:22:08 2014 -0800

Revised Checkpoint Logic

commit ea4baa22089ba5d3eaff3d5c787828efcbff8ad9

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Thu Nov 13 10:25:45 2014 -0800

added comments

commit 8991554f840f50d800a619fc2ac327f1c024e838

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Wed Nov 12 23:34:25 2014 -0800

Added a method to the interface

commit a31e36b0b8234fe876b42e0cdc4543e4e73314a1

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Wed Nov 12 22:57:51 2014 -0800

Refactored getMinFirstLSN code

commit 25f62d585b2f279e78711efd2d327c777919f62c

Author: hubailmor@gmail.com <mhubail@uci.edu>

Date: Tue Nov 11 14:05:34 2014 -0800

Added flush logs

Change-Id: I13fb61c04b6b510b6e8af68d2a0e7e14859f519d

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/182

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

    • -3
    • +7
    ./common/AsterixAppRuntimeContext.java
  1. … 32 more files in changeset.
Initial support for true ADM output (content type application/x-adm).

Elimiate the JSON "results" wrapper from API calls. Rename

DisplayFormat -> OutputFormat, TEXT -> ADM. Cleaned up some output and

added some useful comments. Fixed a few latent bugs in testdriver string

comparison routines. Refactored HTTP error handling in TestsUtils. Had

to update many expected test results.

Change-Id: I2d7ead038512455b2ab7844021cb62222400447b

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/137

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

    • -4
    • +22
    ./http/servlet/QueryResultAPIServlet.java
  1. … 1085 more files in changeset.
Implement TokenizeOperator in addition to the changes made by Zachary Heilbron. Now, the compiler builds the bulk-load plan. For other details, please refer to the corresponding Hyracks changes.

Change-Id: I646539d88ea2bdc6da4fbf2b6e9460a6189125ff

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/79

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

  1. … 116 more files in changeset.
763: Omit wrapper "results" JSON object in HTTP API output for JSON results; Wrap JSON output in outer [array]; consolidate output logic into ResultUtils; use UTF-8 explicitly when converting byte[] from Hyracks to Strings

Change-Id: Idbeac3ebbf397b0ef73cc54b7d901a21ac855932

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/123

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Keren-Audrey Ouaknine <kereno@gmail.com>

    • -11
    • +6
    ./http/servlet/QueryResultAPIServlet.java
  1. … 5 more files in changeset.
support for JSON escapes in ADM and AQL parser fix https://code.google.com/p/asterixdb/issues/detail?id=752 fix https://code.google.com/p/asterixdb/issues/detail?id=753 introduce PrintTools.writeUTF8StringWithEscapes to replace Hyracks' WriteValueTools.writeUTF8String as this serialization is ADM-specific new method AQLParser.parse for better exception handling more robust extraction of line numbers from error messages

Change-Id: I2e9bea7658d00032a3ac7a1d107eba8f17423eeb

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/75

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

  1. … 32 more files in changeset.
Adding plot of Algebricks plan

Change-Id: I917d92b1ca6f0161d67fbddd0182d5062939b558

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/106

Reviewed-by: Inci Cetindil <icetindil@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 5 more files in changeset.
improvements for demo

- add demo cluster

- add example mugshot.com data and queries

- automatic configuration of a cluster

- set MANAGIX_HOME implicitly

- better AQL lexer error reporting

- better eror reporting in ADM parser

- fix and optimize construction of asterix zip for deployment

Change-Id: I9d80402cef72a15271766031b6f06c7220e4ad5a

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/95

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Raman Grover <ramang@uci.edu>

    • -13
    • +11
    ./common/AsterixAppRuntimeContext.java
  1. … 36 more files in changeset.
remove unused properties

The properties AsterixWebServerPort and AsterixJSONAPIServerPort were

never read, but written in some places ..

Change-Id: If713cade15c2df2801ced43e8857e7f8ed5d3c36

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/93

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

    • -9
    • +8
    ./common/AsterixHyracksIntegrationUtil.java
  1. … 8 more files in changeset.
Adds a delivery mode called async-deferred

I added a new result delivery mode called async-deferred, this mode returns a handle once the query completed.

context: sync is a blocking call which returns the result once the query completed, whereas async returns a handle immediately to pull the results later.

async-defer is a hybrid of these two as it returns a handle but only once the query completed.

Change-Id: I8480d22ea9b107edf6d340073581c2613b017599

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/77

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 7 more files in changeset.
Output correct JSON strings for object keys; base decision to return text/json from HTTP API on Accepts header rather than Content-type Change-Id: I14a71d7ec4ffd432691bfa795079e5c8a51037bb Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/85 Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu> Reviewed-by: Zachary Heilbron <zheilbron@gmail.com>

  1. … 17 more files in changeset.
Add external indexes

This change include the following:

1. additional data parser for external data that parse hdfs records using Hive serdes.

2. allow users to create external data. this includes:

a) changes in metadata external dataset details.

b) addition of a new metadata index to store external file's statuses.

c) the pipeline for building the B-Tree and R-Tree indexes.

d) hyracks operators to fetch records with their RIDs using different formats.

e) hyracks operators to lookup and parse external records.

f) test cases for indexing and index access of different hdfs file formats.

g) exposing the secondary indexes over external data to the compiler.

3. adding a new aql command to refresh external datasets. this includes

a) global recovery on system startup.

b) changes in the aql parser.

c) construction of bulk modify pipelines and additional operators to perform local commit and abort operations (using 2PC protocol).

4. Added copyright header to all new files

5. Added additional test cases to test left outer join on external data

Change-Id: I1065a473299f6027eb073aeeba3a56d137f6f98e

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/70

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

  1. … 150 more files in changeset.
Support sort-based group-by, add test coverage for out-of-core code paths, and adapt to the new buffer cache interface. -- add the support for sort-based group-by -- add test coverages for disk-based code path, including multi-pass code paths -- populate framesize and group-by buffer size into asterix -- adapt to new interface for buffer cache

Change-Id: I4af9eaa6fa6a8ae76b8ecaa39184785a90b32710

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/36

Tested-by: Ian Maxon <imaxon@uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

    • -4
    • +4
    ./common/AsterixAppRuntimeContext.java
  1. … 38 more files in changeset.
only stop controllers that have been created

    • -3
    • +3
    ./common/AsterixHyracksIntegrationUtil.java
add main method to AsterixHyracksIntegrationUtil

    • -2
    • +33
    ./common/AsterixHyracksIntegrationUtil.java