asterixdb

Clone Tools
  • last updated 13 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Implement a method to return valid file references.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3077 123451ca-8445-de46-9d55-352943316053

rename hivesterix-core to hivesterix-dist

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_release_cleanup@3076 123451ca-8445-de46-9d55-352943316053

    • -11
    • +0
    /hivesterix/hivesterix-core/conf/cluster
    • -578
    • +0
    /hivesterix/hivesterix-core/pom.xml
  1. … 586 more files in changeset.
update svn ignore files

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_release_cleanup@3075 123451ca-8445-de46-9d55-352943316053

split hivesterix into serveral modules

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_release_cleanup@3074 123451ca-8445-de46-9d55-352943316053

    • -769
    • +0
    /hivesterix/conf/hive-default.xml
    • -58
    • +0
    /hivesterix/conf/hive-log4j.properties
    • -0
    • +61
    /hivesterix/hivesterix-common/pom.xml
  1. … 892 more files in changeset.
Added -help option for commands. -help is similar to the unix' man command

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_ioc_installer@1309 eaa15691-b419-025a-1212-ee371bd00084

Initial test framework changes to use RESTAPI.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1308 eaa15691-b419-025a-1212-ee371bd00084

update the log4j file for pregelix test

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_release_cleanup@3070 123451ca-8445-de46-9d55-352943316053

reformat hivesterix code

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_release_cleanup@3069 123451ca-8445-de46-9d55-352943316053

  1. … 159 more files in changeset.
taking checkpoint:

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_ioc_installer@1307 eaa15691-b419-025a-1212-ee371bd00084

  1. … 3 more files in changeset.
Provide the dataset IP address to NCConfig in the util.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1306 eaa15691-b419-025a-1212-ee371bd00084

Style fix in result writer operator.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3068 123451ca-8445-de46-9d55-352943316053

Implement a basic memory manager to cache results from jobs and use the writer and reader to store and distribute the results.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3067 123451ca-8445-de46-9d55-352943316053

Implement interfaces for result writing and reading.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3066 123451ca-8445-de46-9d55-352943316053

Add support to provide the result distribution buffer memory budget as command line option to the node controller.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3065 123451ca-8445-de46-9d55-352943316053

Implement a class for storing the state of the results.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3064 123451ca-8445-de46-9d55-352943316053

Supply only frame size to NetworkOutputChannel not the whole context.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3063 123451ca-8445-de46-9d55-352943316053

Change almost all the integration tests to use ResultWriterOperatorDescriptor for result distribution.

The only exceptions are TPCHOptimizedHybridHashJoinTest and SerializationDeserializationTest where there

is no need for result distribution and retain their final print operators.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3062 123451ca-8445-de46-9d55-352943316053

  1. … 6 more files in changeset.
Add the additional datasetIPAddress parameter required for the NCConfig in all the tests and implement the basic infrastructure required to run hyracks integration tests using ResultWriterOperatorDescriptor.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3061 123451ca-8445-de46-9d55-352943316053

Style/Formatting fixes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3060 123451ca-8445-de46-9d55-352943316053

Provide the functionality to set byte array size in the frame output stream and its parent classes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3059 123451ca-8445-de46-9d55-352943316053

Implement a result serializer, its factories and providers for test to serialize the results based on record descriptor instead of printer factory in test framework.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3058 123451ca-8445-de46-9d55-352943316053

Add DistributeResultOperator implementation that was missed.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3057 123451ca-8445-de46-9d55-352943316053

Fix the method calls to result serializer creation and result writer operator construction.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1305 eaa15691-b419-025a-1212-ee371bd00084

Implement a frame tuple accessor class for results which contains just a single serialized string of records without any fields.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3056 123451ca-8445-de46-9d55-352943316053

Use the default result serializer from hyracks instead of the Asterix specific version.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1304 eaa15691-b419-025a-1212-ee371bd00084

ResultWriterOperator should provide the record descriptor of its input buffers at run time to serializer and it shouldn't be statically provided to the factory provider at static query compilation time.

This is because the final output of the results being generated may be different than the

statically known record descriptor in some queries like aggregate queries, so we need

to dynamically provide the record descriptor at runtime.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3055 123451ca-8445-de46-9d55-352943316053

Use the new HyracksDatasetReader infrastructure to reuse the client rpc connection object for different queries that lets creating a new reader for every new job.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1303 eaa15691-b419-025a-1212-ee371bd00084

Separate the result reader out of the client class which sets up connection.

It is sufficient to have only one interface connection to read any number of

results. Creating a new client interface connection every time for RPC creates

new ByteBuffers for network layer communication which leads to memory leak on

the CC there by leading OutOfMemory exception on the CC. Separating the connection

and reader out and making a connection only once and asking it to create the

reader for every job resolves this problem and also the most sensible solution.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3054 123451ca-8445-de46-9d55-352943316053

Implement a method to obtain the default framesize from configuration properties.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1302 eaa15691-b419-025a-1212-ee371bd00084