Clone
 

ramangrover29 <ramangrover29@gmail.com> in asterixdb

Introduces Feeds 2.0

commit c3f577861fc705d848c1641605689cadd6973bae

Merge: ebc4cae fc0c2c0

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Fri Jun 26 13:04:05 2015 -0700

Merge branch 'raman/feeds_2_release' of https://code.google.com/p/asterixdb-sandbox into raman/feeds_2_release

Conflicts:

asterix-app/src/main/java/edu/uci/ics/asterix/api/http/servlet/FeedServlet.java

asterix-external-data/src/main/java/edu/uci/ics/asterix/external/library/java/JObjectAccessors.java

commit ebc4cae21a7302869f953df1ebda601e798d12d2

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:14:45 2015 -0700

Introduces Feeds 2.0

Some of the prominent chnages introduced are as follows

a) Support for building a cascade network of feeds (via secondary feeds feature)

b) Feed Management Console for tracking active feeds and associated metrics

c) Support for elastic runtime for data ingestion

d) Improved fault-tolerance with support for logging of failed records

Documentation has been added at asterix-doc/src/site/markdown/feeds/

commit fc0c2c0549a6ee8b202e57607d2e110478cd57bb

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:14:45 2015 -0700

Introduces Feeds 2.0

Some of the prominent chnages introduced are as follows

a) Support for building a cascade network of feeds (via secondary feeds feature)

b) Feed Management Console for tracking active feeds and associated metrics

c) Support for elastic runtime for data ingestion

d) Improved fault-tolerance with support for logging of failed records

Documentation has been added at asterix-doc/src/site/markdown/feeds/

Change-Id: I498f01c591a229aaf51cec43ab20f3e5c4f072f4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/297

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

    • -0
    • +12
    /asterix-app/data/twitter/obamatweets_duplicate.adm
  1. … 369 more files in changeset.
Changes to support Feeds 2.0 (random partitioning of tuples)

commit 8b5c352d831aa0d7e006457f0b1430ac12b54731

Author: ramangrover29 <ramangrover29@gmail.com>

Date: Sat Jun 20 17:16:11 2015 -0700

Changes to support Feeds 2.0 (random partitioning of tuples)

Change-Id: I712c1f019cbc43f66d50620772c3df03c5944394

Reviewed-on: https://asterix-gerrit.ics.uci.edu/296

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Steven Jacobs <sjaco002@ucr.edu>

added test case for inverted index + minor change to the c'tor (putting indexName as the last arg)

Merge branch 'master' into raman/master_feeds_711

added test case

fix for issue 712

fix for issue 711

re-enabled test

modified test case to use adaptor alias instead of class name

Merge branch 'master' into raman/master_feeds_adaptor_test

corrected the external adaptor test case to use the right library

1) null check in feed frame writer 2) corrected path in feed ingestion test

    • -12
    • +0
    /asterix-installer/data/twitter/obamatweets.adm
merge from master

removed repetitive comment

minor changes to pull based twitter adapter

Merge branch 'raman/master_feeds' of https://code.google.com/p/hyracks into raman/master_feeds

merge from master

  1. … 3 more files in changeset.
Merge branch 'master' into raman/master_feeds

merged from master

  1. … 4 more files in changeset.
Merge branch 'master' into raman/master/cluster_active_wait

Introduced a waiting window for a cluster to acquire the ACTIVE state (all nodes are available) before a submitted query/statement can be executed

disabling non-determinstic test case that is causing build to fail

review branch for feeds

modified test library descriptor xml to account for schema change

re-orchestrated feeds fault tolerance integration test

merged master, resolved conflicts

  1. … 12 more files in changeset.
Merge branch 'raman/master_feeds_ext' of https://code.google.com/p/asterixdb into raman/master_feeds_ext

1) modified tweet schema to have tweet ids as int64. 2) Added GUID (Long) generator for generating cluster wide unique Ids

checkpoint

modified strategy to choose a substitute node in event of failure