hyracks-integration-tests

Clone Tools
  • last updated 25 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Made communication between Cluster Controller and Node Controller asynchronous

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@1025 123451ca-8445-de46-9d55-352943316053

  1. … 48 more files in changeset.
merge hyracks_dev_next r847:977

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@978 123451ca-8445-de46-9d55-352943316053

  1. … 134 more files in changeset.
Updated the aggregator interfaces to use ArrayTupleBuilder; removed the state length calculator.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@977 123451ca-8445-de46-9d55-352943316053

  1. … 14 more files in changeset.
Major changes: - Based on Yingyi's review comments, the new interface is written to have the frame output logic out of the aggregators. - Added methods for better management of the size of aggregation states. Now aggregator developer can decide the memory size to be used, and the groupers will assign the memory/frame spaces based on these information. - Fixed some bugs in multiple-field aggregator.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@971 123451ca-8445-de46-9d55-352943316053

  1. … 15 more files in changeset.
Removed the initFromPartial() method from the new aggregator interface; added AvgFieldMergeAggregatorFactory for the merge phase of AVG().

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@967 123451ca-8445-de46-9d55-352943316053

  1. … 11 more files in changeset.
Pre-merge cleanup: removed old aggregator interfaces, and updated codes to use the new interface.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@963 123451ca-8445-de46-9d55-352943316053

  1. … 60 more files in changeset.
Fixed bugs on key fields arrangement when partial grouping values are stored; added test cases to benchmark the new interface.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@962 123451ca-8445-de46-9d55-352943316053

  1. … 10 more files in changeset.
Added new IPC mechanism to Hyracks. Migrated all remote communications to use new IPC layer

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@935 123451ca-8445-de46-9d55-352943316053

  1. … 54 more files in changeset.
Addressing Reviewer's comments

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@927 123451ca-8445-de46-9d55-352943316053

  1. … 14 more files in changeset.
Update #52: fixed bugs on external grouper on merging phase; fixed bugs on aggregation integration tests.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@883 123451ca-8445-de46-9d55-352943316053

  1. … 9 more files in changeset.
Added getFieldCount() call to RecordDescriptor

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@881 123451ca-8445-de46-9d55-352943316053

  1. … 13 more files in changeset.
Update issue #52: added initial version of PreCluster grouper operator; added test case for PreCluster grouper.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@880 123451ca-8445-de46-9d55-352943316053

  1. … 3 more files in changeset.
Update issue #52:

- rewrote the aggregator interface to create a state factory;

- added a wrapper interface for aggregation and changed the original aggregators to be field aggregators, and added a multi-field aggregator wrapper;

- rewrote test cases for new interface;

- added count field aggregator.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@879 123451ca-8445-de46-9d55-352943316053

  1. … 19 more files in changeset.
Fixed NC memory leak. Fixed duplicate job cleanup. Cleaned up data treatment in Hyracks

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@865 123451ca-8445-de46-9d55-352943316053

  1. … 120 more files in changeset.
Update issue #52:

Added Min/Max String aggregator using the new interface; added two test cases for both in-mem and external hash group operators.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@863 123451ca-8445-de46-9d55-352943316053

  1. … 1 more file in changeset.
Update issue #52

Added AVG aggregator using new interface; added two integration tests for AVG aggregator.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@862 123451ca-8445-de46-9d55-352943316053

  1. … 3 more files in changeset.
Update issue #52:

Added integration test for new aggregator interface: contains tests for sum aggregation on both in-mem and external group operators.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@861 123451ca-8445-de46-9d55-352943316053

Bug fixes: - external aggregation integration test: fixed the temporal path generator; - utf-8 compiling failure of storage-am-invertedindex-test on mac.

Features improvement:

- tpch-join client: added algorithm selector "-algo"; added parameters for hybrid/grace-hash operators; added a parameter "-has-groupby" to control whether group-by is performed after the join.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@832 123451ca-8445-de46-9d55-352943316053

  1. … 2 more files in changeset.
Refactored all index operators for better sharing with inverted index operators.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_btree_updates_next@826 123451ca-8445-de46-9d55-352943316053

  1. … 60 more files in changeset.
Made Hyracks build more slient.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_btree_updates_next@825 123451ca-8445-de46-9d55-352943316053

  1. … 5 more files in changeset.
New classes added for testing external sort with replacement selection

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@817 123451ca-8445-de46-9d55-352943316053

  1. … 1 more file in changeset.
Merged hyracks_dev_next into this branch.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_btree_updates_next@814 123451ca-8445-de46-9d55-352943316053

  1. … 5 more files in changeset.
Added printing of output files for tests when logging is enabled

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@805 123451ca-8445-de46-9d55-352943316053

Added InvertedIndexSearchOperator and first integration test.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_btree_updates_next@786 123451ca-8445-de46-9d55-352943316053

  1. … 10 more files in changeset.
Minor cleanup of integration tests.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_btree_updates_next@782 123451ca-8445-de46-9d55-352943316053

Polished inverted index. Added integration test for inverted index bulk load.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_btree_updates_next@775 123451ca-8445-de46-9d55-352943316053

  1. … 19 more files in changeset.
TPCH Data Files Added For The Hybrid Hash Join Unit Tests

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@765 123451ca-8445-de46-9d55-352943316053

    • -0
    • +20000
    ./data/tpch0.001/customer3.tbl
    • -0
    • +40000
    ./data/tpch0.001/customer4.tbl
    • -0
    • +100
    ./data/tpch0.001/orders1.tbl
    • -0
    • +40000
    ./data/tpch0.001/orders4.tbl
Addressing Review Comments for the Hybrid Hash Join

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@764 123451ca-8445-de46-9d55-352943316053

  1. … 2 more files in changeset.
Added job logging. Added config for CC root folder. Removed logging.properties file.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@755 123451ca-8445-de46-9d55-352943316053

  1. … 8 more files in changeset.
Build is now far quieter

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@748 123451ca-8445-de46-9d55-352943316053

  1. … 3 more files in changeset.