Clone Tools
  • last updated 23 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Change folder structure for Java repackage

Change only the folders, not the files, for our package name change.

This will break the build, and needs to be followed by a change to

the package name in all of the source files. However performing

the folder move and file change in two steps lets Git understand

that the files are the same, and lets us track revisions across

those files.

Change-Id: Iefd2a576415ebc1416cba2a3334d2b64f042ba92

Reviewed-on: https://asterix-gerrit.ics.uci.edu/306

Tested-by: Ian Maxon <imaxon@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -268
    • +0
    ./file/AsterixTupleParserFactory.java
    • -154
    • +0
    ./file/CounterTimerTupleForwardPolicy.java
    • -72
    • +0
    ./file/FrameFullTupleForwardPolicy.java
    • -93
    • +0
    ./file/RateContolledParserPolicy.java
    • -84
    • +0
    ./file/RateControlledTupleForwardPolicy.java
    • -89
    • +0
    ./std/FlushDatasetOperatorDescriptor.java
    • -45
    • +0
    ./std/NoTupleSourceRuntimeFactory.java
  1. … 3784 more files in changeset.
Changed metadata storage format for nullable field types. Moved field name generation to the client out of metadata node code. Changed naming scheme for autogenerated types. Moved GroupName, CompactionPolicy & CompactionPolicyProperties fields up from External\InternalDetails to Dataset record type definition

Change-Id: I223aded8aaf80f0688358899c0e8b0d6988fac93

Reviewed-on: https://asterix-gerrit.ics.uci.edu/323

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 205 more files in changeset.
1. Fix the memory bloat issue introduced by https://github.com/apache/incubator-asterixdb/commit/c66d23a5ac65ec5218ee47134aea423fd62a32cc Recycle object pools in ADMDataParser before parsing each top-level ADM record.

2. Avoid using Strings as parameters of object pools because string comparison is slow and several comparisons done for parsing each ADM record.

Change-Id: I31848d8bd42a07f72035aefa2d671fdb2fce037d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/334

Reviewed-by: Pouria Pirzadeh <pouria.pirzadeh@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Preston Carman <prestonc@apache.org>

  1. … 6 more files in changeset.
Added the UUID constructor and changed the relevant documentation

Change-Id: I2276bf2b44975b13c99d56f448ae3e9e4a74b04e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/326

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

  1. … 33 more files in changeset.
Adding introspection for getting record details.

Change-Id: Iba15acff0f6830cffbc33d9dac3b5f0c417be844

  1. … 196 more files in changeset.
Adding introspection for getting record details.

Change-Id: Iba15acff0f6830cffbc33d9dac3b5f0c417be844

Reviewed-on: https://asterix-gerrit.ics.uci.edu/313

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

  1. … 196 more files in changeset.
Add Apache RAT License Auditor plugin, and fix missing licenses

Change-Id: Ic0fa0b7836e8a69d0d8beed83f9c3b41c168afd4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/263

Reviewed-by: Chris Hillery <ceej@lambda.nu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -0
    • +14
    ./file/AsterixTupleParserFactory.java
    • -0
    • +14
    ./file/CounterTimerTupleForwardPolicy.java
    • -0
    • +14
    ./file/FrameFullTupleForwardPolicy.java
    • -0
    • +14
    ./file/RateContolledParserPolicy.java
    • -0
    • +14
    ./file/RateControlledTupleForwardPolicy.java
    • -2
    • +2
    ./std/FlushDatasetOperatorDescriptor.java
    • -2
    • +2
    ./std/NoTupleSourceRuntimeFactory.java
  1. … 1537 more files in changeset.
Introduces Feeds 2.0

commit c3f577861fc705d848c1641605689cadd6973bae

Merge: ebc4cae fc0c2c0

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Fri Jun 26 13:04:05 2015 -0700

Merge branch 'raman/feeds_2_release' of https://code.google.com/p/asterixdb-sandbox into raman/feeds_2_release

Conflicts:

asterix-app/src/main/java/edu/uci/ics/asterix/api/http/servlet/FeedServlet.java

asterix-external-data/src/main/java/edu/uci/ics/asterix/external/library/java/JObjectAccessors.java

commit ebc4cae21a7302869f953df1ebda601e798d12d2

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:14:45 2015 -0700

Introduces Feeds 2.0

Some of the prominent chnages introduced are as follows

a) Support for building a cascade network of feeds (via secondary feeds feature)

b) Feed Management Console for tracking active feeds and associated metrics

c) Support for elastic runtime for data ingestion

d) Improved fault-tolerance with support for logging of failed records

Documentation has been added at asterix-doc/src/site/markdown/feeds/

commit fc0c2c0549a6ee8b202e57607d2e110478cd57bb

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:14:45 2015 -0700

Introduces Feeds 2.0

Some of the prominent chnages introduced are as follows

a) Support for building a cascade network of feeds (via secondary feeds feature)

b) Feed Management Console for tracking active feeds and associated metrics

c) Support for elastic runtime for data ingestion

d) Improved fault-tolerance with support for logging of failed records

Documentation has been added at asterix-doc/src/site/markdown/feeds/

Change-Id: I498f01c591a229aaf51cec43ab20f3e5c4f072f4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/297

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -41
    • +0
    ./file/AdmSchemafullRecordParserFactory.java
    • -0
    • +254
    ./file/AsterixTupleParserFactory.java
    • -0
    • +140
    ./file/CounterTimerTupleForwardPolicy.java
    • -41
    • +0
    ./file/DelimitedDataTupleParser.java
    • -0
    • +58
    ./file/FrameFullTupleForwardPolicy.java
    • -52
    • +0
    ./file/NtDelimitedDataTupleParserFactory.java
    • -0
    • +79
    ./file/RateContolledParserPolicy.java
    • -0
    • +70
    ./file/RateControlledTupleForwardPolicy.java
  1. … 374 more files in changeset.
VariableSizeFrame(VSizeFrame) support for Asterix (Runtime Only)

Apply the https://asterix-gerrit.ics.uci.edu/#/c/234/ API changes to

Asterix level.

Change-Id: I5459e877707a1494fc1bebf03d4457a7427e9e0f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/259

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 43 more files in changeset.
Issue 867: Test cases for CSV with headers and various line separators.

Change-Id: I046aa30824d14cbc894a28719c6c6560f46d0133

Reviewed-on: https://asterix-gerrit.ics.uci.edu/247

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Preston Carman <ecarm002@ucr.edu>

  1. … 19 more files in changeset.
This change covers three points: 1. move the generation of UUIDs out of parsers 2. fixes a bug in the metadata lock when performing load operations 3. the external data scan operator is again a leaf operator 4. made sure the startup call doesn't return until the servers are ready to receive requests Merged master into branch for the second time.

The following commits from your working branch will be included:

commit da929c990249fe7f0699417fd7f7ea34908355af

Author: Abdullah Alamoudi <bamousaa@gmail.com>

Date: Fri Jan 16 11:51:14 2015 +0300

Moved generation of UUIDs out of parsers

Change-Id: I32437493cf48c79417f4280e9d8a85cfb1559b62

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/205

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

    • -12
    • +2
    ./file/AdmSchemafullRecordParserFactory.java
    • -15
    • +2
    ./file/NtDelimitedDataTupleParserFactory.java
  1. … 53 more files in changeset.
- Fixed Type Casting issue - Reorganized duplicated internal class in the DelimitedDataParser and DelimitedDataParserFactory - Prevented a user from creating an inverted index on a dataset with a variable-length PK - INT64 is now the default type - Issue 852 fixed

Change-Id: I2d71e8a21da4f709c3259a3d3f678c640f9e1160

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/192

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

    • -349
    • +15
    ./file/DelimitedDataParser.java
  1. … 846 more files in changeset.
Add test case and documentation for CSV parsing with headers.

Also fix a minor CSV parsing bug with line counting.

Change-Id: Ib875d60aa2465d4a50ee50c5c0e9356185f35c73

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/228

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Taewoo Kim <wangsaeu@gmail.com>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

  1. … 8 more files in changeset.
Introduce ("header"="true") option for CSV parsing

Change-Id: I473bc7b66d0c0d1355b5fb3e392cb9ece151e50e

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/226

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Chris Hillery <ceej@lambda.nu>

    • -10
    • +13
    ./file/NtDelimitedDataTupleParserFactory.java
  1. … 9 more files in changeset.
This change integrates a run statement for running Pregelix jobs into the AQL.

Therefore it also provides a new FlushOperator to flush all memory components of a dataset to disc.

Change-Id: I1f97cfdc79943abf035a7342bb777d59af6518e9

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/193

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

    • -0
    • +89
    ./std/FlushDatasetOperatorDescriptor.java
  1. … 23 more files in changeset.
Add the Binary data type and corresponding helper functions to Asterix.

The binary data type is implemented as a bytearray. Its storage format

follows the String type which has 2 bytes for length and then store the

bytes contents.

Binary data will take hex("") or base64("") as the constructor method to

passing a hex string or base64 string into Asterix. For output we use

hex("") format.

The parse-[hex|base64](string) function will parse the corresponding hex

or base64 string to binary type. The print-[hex|base64](binary)

functions will print the binary to hex or base64 STRING format.

The sub-binary(binary, offset, [length]) function works the same as

substring(string, offset, [length])

The find-binary(srcbinary, targetbinary, [start-offset]) will find the

position of the targetbinary in the srcbinary.

Change-Id: I5ecf0cc115c44070fb5c1fc5b0ec12a95d4243a4

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/175

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 125 more files in changeset.
Fixed CSV parser to recognize quote and delimiter inside a string

Change-Id: Iaaabc23e86df4f9bbee9f06b7976d7fbdcbb0f3f

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/135

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

    • -58
    • +206
    ./file/DelimitedDataParser.java
    • -4
    • +11
    ./file/NtDelimitedDataTupleParserFactory.java
  1. … 73 more files in changeset.
Implement TokenizeOperator in addition to the changes made by Zachary Heilbron. Now, the compiler builds the bulk-load plan. For other details, please refer to the corresponding Hyracks changes.

Change-Id: I646539d88ea2bdc6da4fbf2b6e9460a6189125ff

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/79

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

    • -4
    • +13
    ./file/AdmSchemafullRecordParserFactory.java
    • -4
    • +13
    ./file/NtDelimitedDataTupleParserFactory.java
  1. … 109 more files in changeset.
Fixed framesize resetting issue during bulk-loading - issue 800 -> https://code.google.com/p/asterixdb/issues/detail?id=800 - added an user-friendly exception message

commit 8cc94c2de864b6f2ab2b0cf237b0d942841959c6

Author: Young-Seok <kisskys@gmail.com>

Date: Mon Aug 25 14:13:43 2014 -0700

Change-Id: I2dd9d67fdc150ae8af655baa741d8d3c711b5ca0

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/130

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 1 more file in changeset.
support for JSON escapes in ADM and AQL parser fix https://code.google.com/p/asterixdb/issues/detail?id=752 fix https://code.google.com/p/asterixdb/issues/detail?id=753 introduce PrintTools.writeUTF8StringWithEscapes to replace Hyracks' WriteValueTools.writeUTF8String as this serialization is ADM-specific new method AQLParser.parse for better exception handling more robust extraction of line numbers from error messages

Change-Id: I2e9bea7658d00032a3ac7a1d107eba8f17423eeb

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/75

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

  1. … 34 more files in changeset.
improvements for demo

- add demo cluster

- add example mugshot.com data and queries

- automatic configuration of a cluster

- set MANAGIX_HOME implicitly

- better AQL lexer error reporting

- better eror reporting in ADM parser

- fix and optimize construction of asterix zip for deployment

Change-Id: I9d80402cef72a15271766031b6f06c7220e4ad5a

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/95

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Raman Grover <ramang@uci.edu>

  1. … 33 more files in changeset.
Fix ADM Parser Bug

This change make sure that each adm parser instance use its own objects for parsing

and not share it with other parser running on the same NC.

Change-Id: Ib54dd2f9f8474ddb8dc2d785f819dd62c7ce7ca3

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/73

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

throw exception for unsupported escape sequences

  1. … 6 more files in changeset.
add escapes to ADM parser remove unused parameter from ADMDataParser.checkType

  1. … 8 more files in changeset.
add error locations to exceptions in the ADM parser escape HTML entities in error messages for the WebUI

  1. … 2 more files in changeset.
exception wrapping only in the public methods inline resulting single-line methods

fix promotion for constructor functions add tests for constructor functions implement review comments

  1. … 2 more files in changeset.
fix parsing and promotion of int[8|16|32|64] literals change ITypePromoteComputer.promote to accept a DataOutput instead of an IMutableValueStorage

  1. … 10 more files in changeset.
fix promotion of numeric literals

use the typeheirarchy for type checking in the admdataparser