asterixdb

Clone Tools
  • last updated 18 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Added -help option for commands. -help is similar to the unix' man command

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_ioc_installer@1309 eaa15691-b419-025a-1212-ee371bd00084

Initial test framework changes to use RESTAPI.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1308 eaa15691-b419-025a-1212-ee371bd00084

update the log4j file for pregelix test

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_release_cleanup@3070 123451ca-8445-de46-9d55-352943316053

reformat hivesterix code

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_release_cleanup@3069 123451ca-8445-de46-9d55-352943316053

  1. … 159 more files in changeset.
taking checkpoint:

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_ioc_installer@1307 eaa15691-b419-025a-1212-ee371bd00084

  1. … 3 more files in changeset.
Provide the dataset IP address to NCConfig in the util.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1306 eaa15691-b419-025a-1212-ee371bd00084

Style fix in result writer operator.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3068 123451ca-8445-de46-9d55-352943316053

Implement a basic memory manager to cache results from jobs and use the writer and reader to store and distribute the results.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3067 123451ca-8445-de46-9d55-352943316053

Implement interfaces for result writing and reading.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3066 123451ca-8445-de46-9d55-352943316053

Add support to provide the result distribution buffer memory budget as command line option to the node controller.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3065 123451ca-8445-de46-9d55-352943316053

Implement a class for storing the state of the results.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3064 123451ca-8445-de46-9d55-352943316053

Supply only frame size to NetworkOutputChannel not the whole context.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3063 123451ca-8445-de46-9d55-352943316053

Change almost all the integration tests to use ResultWriterOperatorDescriptor for result distribution.

The only exceptions are TPCHOptimizedHybridHashJoinTest and SerializationDeserializationTest where there

is no need for result distribution and retain their final print operators.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3062 123451ca-8445-de46-9d55-352943316053

  1. … 6 more files in changeset.
Add the additional datasetIPAddress parameter required for the NCConfig in all the tests and implement the basic infrastructure required to run hyracks integration tests using ResultWriterOperatorDescriptor.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3061 123451ca-8445-de46-9d55-352943316053

Style/Formatting fixes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3060 123451ca-8445-de46-9d55-352943316053

Provide the functionality to set byte array size in the frame output stream and its parent classes.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3059 123451ca-8445-de46-9d55-352943316053

Implement a result serializer, its factories and providers for test to serialize the results based on record descriptor instead of printer factory in test framework.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3058 123451ca-8445-de46-9d55-352943316053

Add DistributeResultOperator implementation that was missed.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3057 123451ca-8445-de46-9d55-352943316053

Fix the method calls to result serializer creation and result writer operator construction.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1305 eaa15691-b419-025a-1212-ee371bd00084

Implement a frame tuple accessor class for results which contains just a single serialized string of records without any fields.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3056 123451ca-8445-de46-9d55-352943316053

Use the default result serializer from hyracks instead of the Asterix specific version.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1304 eaa15691-b419-025a-1212-ee371bd00084

ResultWriterOperator should provide the record descriptor of its input buffers at run time to serializer and it shouldn't be statically provided to the factory provider at static query compilation time.

This is because the final output of the results being generated may be different than the

statically known record descriptor in some queries like aggregate queries, so we need

to dynamically provide the record descriptor at runtime.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3055 123451ca-8445-de46-9d55-352943316053

Use the new HyracksDatasetReader infrastructure to reuse the client rpc connection object for different queries that lets creating a new reader for every new job.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1303 eaa15691-b419-025a-1212-ee371bd00084

Separate the result reader out of the client class which sets up connection.

It is sufficient to have only one interface connection to read any number of

results. Creating a new client interface connection every time for RPC creates

new ByteBuffers for network layer communication which leads to memory leak on

the CC there by leading OutOfMemory exception on the CC. Separating the connection

and reader out and making a connection only once and asking it to create the

reader for every job resolves this problem and also the most sensible solution.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3054 123451ca-8445-de46-9d55-352943316053

Implement a method to obtain the default framesize from configuration properties.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1302 eaa15691-b419-025a-1212-ee371bd00084

Supply cache size for storing query results as an argument to node controller.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1301 eaa15691-b419-025a-1212-ee371bd00084

    • -1
    • +1
    /asterix-dist/src/main/scripts/startasterix.sh
Separate out WriteOperator and create a new DistributeResultOperator for result distribution.

We are creating this distinction to make sure that the old write results to a

file operator remains intact for those systems that use Algebricks but have

no need for result distribution like Hivestrix.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3053 123451ca-8445-de46-9d55-352943316053

Remove the classes which now have a default implementation in Hyracks.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1300 eaa15691-b419-025a-1212-ee371bd00084

Use the DistributeResultOperator for result delivery instead of squeezing in the functionality into WriteOperator.

git-svn-id: https://asterixdb.googlecode.com/svn/branches/asterix_stabilization_result_distribution@1299 eaa15691-b419-025a-1212-ee371bd00084

Implement a default result serializer factory provider in Algebricks.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3052 123451ca-8445-de46-9d55-352943316053