asterixdb

Clone Tools
  • last updated 22 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Minimal changes to make asterix_stabilization work with fullstack_hyracks_result_distribution.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_rsd_staging@1313 eaa15691-b419-025a-1212-ee371bd00084

Create asterix stabilization staging branch which contains minimal code changes to work with fullstack_hyracks_result_distribution.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_rsd_staging@1311 eaa15691-b419-025a-1212-ee371bd00084

Move print newline back to PrinterBasedWriter because not all writers need this functionality.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3078 123451ca-8445-de46-9d55-352943316053

Implement a method to return valid file references.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3077 123451ca-8445-de46-9d55-352943316053

rename hivesterix-core to hivesterix-dist

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_release_cleanup@3076 123451ca-8445-de46-9d55-352943316053

    • -11
    • +0
    /hivesterix/hivesterix-core/conf/cluster
    • -578
    • +0
    /hivesterix/hivesterix-core/pom.xml
  1. … 586 more files in changeset.
update svn ignore files

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_release_cleanup@3075 123451ca-8445-de46-9d55-352943316053

split hivesterix into serveral modules

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_release_cleanup@3074 123451ca-8445-de46-9d55-352943316053

    • -769
    • +0
    /hivesterix/conf/hive-default.xml
    • -58
    • +0
    /hivesterix/conf/hive-log4j.properties
    • -0
    • +61
    /hivesterix/hivesterix-common/pom.xml
  1. … 892 more files in changeset.
Added -help option for commands. -help is similar to the unix' man command

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_ioc_installer@1309 eaa15691-b419-025a-1212-ee371bd00084

Initial test framework changes to use RESTAPI.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1308 eaa15691-b419-025a-1212-ee371bd00084

update the log4j file for pregelix test

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_release_cleanup@3070 123451ca-8445-de46-9d55-352943316053

reformat hivesterix code

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_release_cleanup@3069 123451ca-8445-de46-9d55-352943316053

  1. … 159 more files in changeset.
taking checkpoint:

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_ioc_installer@1307 eaa15691-b419-025a-1212-ee371bd00084

  1. … 3 more files in changeset.
Provide the dataset IP address to NCConfig in the util.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1306 eaa15691-b419-025a-1212-ee371bd00084

Style fix in result writer operator.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3068 123451ca-8445-de46-9d55-352943316053

Implement a basic memory manager to cache results from jobs and use the writer and reader to store and distribute the results.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3067 123451ca-8445-de46-9d55-352943316053

Implement interfaces for result writing and reading.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3066 123451ca-8445-de46-9d55-352943316053

Add support to provide the result distribution buffer memory budget as command line option to the node controller.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3065 123451ca-8445-de46-9d55-352943316053

Implement a class for storing the state of the results.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3064 123451ca-8445-de46-9d55-352943316053

Supply only frame size to NetworkOutputChannel not the whole context.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3063 123451ca-8445-de46-9d55-352943316053

Change almost all the integration tests to use ResultWriterOperatorDescriptor for result distribution.

The only exceptions are TPCHOptimizedHybridHashJoinTest and SerializationDeserializationTest where there

is no need for result distribution and retain their final print operators.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3062 123451ca-8445-de46-9d55-352943316053

  1. … 6 more files in changeset.
Add the additional datasetIPAddress parameter required for the NCConfig in all the tests and implement the basic infrastructure required to run hyracks integration tests using ResultWriterOperatorDescriptor.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3061 123451ca-8445-de46-9d55-352943316053

Style/Formatting fixes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3060 123451ca-8445-de46-9d55-352943316053

Provide the functionality to set byte array size in the frame output stream and its parent classes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3059 123451ca-8445-de46-9d55-352943316053

Implement a result serializer, its factories and providers for test to serialize the results based on record descriptor instead of printer factory in test framework.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3058 123451ca-8445-de46-9d55-352943316053

Add DistributeResultOperator implementation that was missed.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3057 123451ca-8445-de46-9d55-352943316053

Fix the method calls to result serializer creation and result writer operator construction.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1305 eaa15691-b419-025a-1212-ee371bd00084

Implement a frame tuple accessor class for results which contains just a single serialized string of records without any fields.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3056 123451ca-8445-de46-9d55-352943316053

Use the default result serializer from hyracks instead of the Asterix specific version.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1304 eaa15691-b419-025a-1212-ee371bd00084

ResultWriterOperator should provide the record descriptor of its input buffers at run time to serializer and it shouldn't be statically provided to the factory provider at static query compilation time.

This is because the final output of the results being generated may be different than the

statically known record descriptor in some queries like aggregate queries, so we need

to dynamically provide the record descriptor at runtime.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3055 123451ca-8445-de46-9d55-352943316053