Clone Tools
  • last updated 10 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Introduces Feeds 2.0

commit c3f577861fc705d848c1641605689cadd6973bae

Merge: ebc4cae fc0c2c0

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Fri Jun 26 13:04:05 2015 -0700

Merge branch 'raman/feeds_2_release' of https://code.google.com/p/asterixdb-sandbox into raman/feeds_2_release

Conflicts:

asterix-app/src/main/java/edu/uci/ics/asterix/api/http/servlet/FeedServlet.java

asterix-external-data/src/main/java/edu/uci/ics/asterix/external/library/java/JObjectAccessors.java

commit ebc4cae21a7302869f953df1ebda601e798d12d2

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:14:45 2015 -0700

Introduces Feeds 2.0

Some of the prominent chnages introduced are as follows

a) Support for building a cascade network of feeds (via secondary feeds feature)

b) Feed Management Console for tracking active feeds and associated metrics

c) Support for elastic runtime for data ingestion

d) Improved fault-tolerance with support for logging of failed records

Documentation has been added at asterix-doc/src/site/markdown/feeds/

commit fc0c2c0549a6ee8b202e57607d2e110478cd57bb

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:14:45 2015 -0700

Introduces Feeds 2.0

Some of the prominent chnages introduced are as follows

a) Support for building a cascade network of feeds (via secondary feeds feature)

b) Feed Management Console for tracking active feeds and associated metrics

c) Support for elastic runtime for data ingestion

d) Improved fault-tolerance with support for logging of failed records

Documentation has been added at asterix-doc/src/site/markdown/feeds/

Change-Id: I498f01c591a229aaf51cec43ab20f3e5c4f072f4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/297

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -82
    • +0
    ./installer/test/AsterixFaultToleranceIT.java
  1. … 383 more files in changeset.
Potential fix for sporadic issues with AsterixClusterLifeCycleIT.tearDown()

I think there was a race between these two adjacent methods in tearDown(), the latter of which looks like it isn't

even doing what I intended it to do at the moment. I haven't been able to observe this sporadic failure after changing

it so the latter one goes after the printing of the output of the former, which blocks and therefore would stop any

issues of this type.

Change-Id: I57ac2117c42a0b798f3249846f0b49927c64d870

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/91

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -1
    • +1
    ./installer/test/AsterixClusterLifeCycleIT.java
Basis for Cluster integration testing

This branch adds cluster testing via Vagrant.

Requires my branch of the vagrant-maven plugin to work,

which can be sourced here:

https://github.com/parshimers/vagrant-maven-plugin

It is enabled with -DclusterTest=true in mvn verify.

A virtualized cluster with 4 nodes is started, and

then Asterix is started via managix on this cluster,

and then stopped.

Change-Id: I7e3cdcd4162ada19ee1e15f532be7447b4f34367

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/31

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Reviewed-by: Zachary Heilbron <zheilbron@gmail.com>

Reviewed-by: Till Westmann <westmann@gmail.com>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -0
    • +187
    ./installer/test/AsterixClusterLifeCycleIT.java
  1. … 7 more files in changeset.
some cleanup

    • -8
    • +0
    ./installer/transaction/RecoveryIT.java
added test cases for comparator issues

    • -7
    • +4
    ./installer/transaction/DmlRecoveryIT.java
    • -6
    • +0
    ./installer/transaction/RecoveryIT.java
  1. … 15 more files in changeset.
DML_RECOVER_ON, DDL_RECOVER_ON flags added

    • -7
    • +12
    ./installer/transaction/DmlRecoveryIT.java
    • -0
    • +6
    ./installer/transaction/RecoveryIT.java
secondary indices in use; comment addressed;

    • -3
    • +0
    ./installer/transaction/DmlRecoveryIT.java
  1. … 8 more files in changeset.
modified test case to use adaptor alias instead of class name

    • -3
    • +1
    ./installer/test/AsterixExternalLibraryIT.java
  1. … 10 more files in changeset.
added test for installation and use of an external adaptor

    • -1
    • +3
    ./installer/test/AsterixExternalLibraryIT.java
  1. … 14 more files in changeset.
dml recovery added

    • -1
    • +1
    ./installer/test/AsterixExternalLibraryIT.java
    • -1
    • +1
    ./installer/test/AsterixFaultToleranceIT.java
    • -1
    • +1
    ./installer/test/AsterixLifecycleIT.java
    • -0
    • +117
    ./installer/transaction/DmlRecoveryIT.java
    • -1
    • +1
    ./installer/transaction/RecoveryIT.java
  1. … 9 more files in changeset.
minor changes to pull based twitter adapter

    • -3
    • +1
    ./installer/test/AsterixExternalLibraryIT.java
  1. … 6 more files in changeset.
added an additional test for feed ingestion

    • -1
    • +3
    ./installer/test/AsterixExternalLibraryIT.java
  1. … 14 more files in changeset.
Merge branch 'master' into zheilbron/asterix_msr_demo

Conflicts:

asterix-app/src/main/java/edu/uci/ics/asterix/hyracks/bootstrap/NCApplicationEntryPoint.java

asterix-app/src/test/resources/metadata/results/basic/meta17/meta17.1.adm

asterix-app/src/test/resources/metadata/results/basic/metadata_datatype/metadata_datatype.1.adm

asterix-common/src/main/java/edu/uci/ics/asterix/common/config/AsterixExternalProperties.java

asterix-common/src/main/java/edu/uci/ics/asterix/common/transactions/ILockManager.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/MetadataManager.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/MetadataNode.java

asterix-metadata/src/main/java/edu/uci/ics/asterix/metadata/entitytupletranslators/DatasetTupleTranslator.java

    • -0
    • +2
    ./installer/transaction/RecoveryIT.java
  1. … 18 more files in changeset.
all refined expect secondary indices

    • -27
    • +4
    ./installer/transaction/RecoveryIT.java
  1. … 41 more files in changeset.
merge from master

    • -0
    • +2
    ./installer/transaction/RecoveryIT.java
  1. … 17 more files in changeset.
copy once

    • -15
    • +5
    ./installer/transaction/RecoveryIT.java
  1. … 11 more files in changeset.
after merge master

    • -1
    • +5
    ./installer/transaction/RecoveryIT.java
  1. … 1 more file in changeset.
revert some modifications

    • -1
    • +1
    ./installer/transaction/RecoveryIT.java
  1. … 2 more files in changeset.
three test cases on indexes

    • -2
    • +15
    ./installer/transaction/RecoveryIT.java
  1. … 43 more files in changeset.
some debugging/logging stuff

    • -1
    • +3
    ./installer/transaction/RecoveryIT.java
  1. … 2 more files in changeset.
cosmetic changes

    • -1
    • +1
    ./installer/test/AsterixFaultToleranceIT.java
    • -194
    • +173
    ./installer/test/AsterixInstallerIntegrationUtil.java
    • -1
    • +1
    ./installer/transaction/RecoveryIT.java
  1. … 212 more files in changeset.
review branch for feeds

    • -0
    • +78
    ./installer/test/AsterixExternalLibraryIT.java
    • -0
    • +82
    ./installer/test/AsterixFaultToleranceIT.java
    • -5
    • +5
    ./installer/test/AsterixLifecycleIT.java
  1. … 8 more files in changeset.
null check when installing adapters contained in an external library

    • -49
    • +42
    ./installer/test/AsterixExternalLibraryIT.java
    • -0
    • +2
    ./installer/test/AsterixInstallerIntegrationUtil.java
  1. … 2 more files in changeset.
added a recovery integration test

    • -1
    • +1
    ./installer/test/AsterixLifecycleIT.java
    • -0
    • +136
    ./installer/transaction/RecoveryIT.java
  1. … 24 more files in changeset.
added basic feeds robustness test; testing behavior upon a cluster restart

    • -1
    • +1
    ./installer/test/AsterixFaultToleranceIT.java
  1. … 24 more files in changeset.
added managix commands for starting/stopping a node

    • -0
    • +82
    ./installer/test/AsterixFaultToleranceIT.java
  1. … 10 more files in changeset.
merged raman/asterix_lsm_stabilization_udfs

    • -0
    • +85
    ./installer/test/AsterixExternalLibraryIT.java
    • -172
    • +192
    ./installer/test/AsterixInstallerIntegrationUtil.java
  1. … 36 more files in changeset.
fixed integration tests for external library/UDFs

    • -172
    • +192
    ./installer/test/AsterixInstallerIntegrationUtil.java
  1. … 10 more files in changeset.
merge from master

    • -1
    • +1
    ./installer/test/AsterixInstallerIntegrationUtil.java
  1. … 48 more files in changeset.
merge from master

    • -1
    • +1
    ./installer/test/AsterixInstallerIntegrationUtil.java
    • -0
    • +21
    ./installer/test/AsterixLifecycleIT.java
  1. … 148 more files in changeset.