Clone Tools
  • last updated 12 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Fixed bugs on key fields arrangement when partial grouping values are stored; added test cases to benchmark the new interface.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@962 123451ca-8445-de46-9d55-352943316053

    • -1
    • +9
    ./aggregations/ExternalGroupOperatorDescriptor.java
    • -1
    • +12
    ./aggregations/GroupingHashTable.java
    • -1
    • +7
    ./aggregations/HashSpillableTableFactory.java
    • -1
    • +1
    ./aggregations/IAggregatorDescriptorFactory.java
    • -1
    • +1
    ./aggregations/PreclusteredGroupOperatorDescriptor.java
    • -0
    • +1
    ./aggregations/PreclusteredGroupWriter.java
    • -8
    • +10
    ./aggregations/aggregators/MultiFieldsAggregatorFactory.java
  1. … 3 more files in changeset.
Added new IPC mechanism to Hyracks. Migrated all remote communications to use new IPC layer

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@935 123451ca-8445-de46-9d55-352943316053

    • -0
    • +1
    ./collectors/NonDeterministicPartitionCollector.java
  1. … 54 more files in changeset.
reverting changes

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@930 123451ca-8445-de46-9d55-352943316053

    • -28
    • +1
    ./misc/PrinterOperatorDescriptor.java
Removing unneccessary class

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@928 123451ca-8445-de46-9d55-352943316053

    • -1
    • +28
    ./misc/PrinterOperatorDescriptor.java
    • -228
    • +0
    ./sort/OptimizedExternalSortRunMerger.java
  1. … 7 more files in changeset.
Addressing Reviewer's comments

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@927 123451ca-8445-de46-9d55-352943316053

    • -1
    • +1
    ./join/OptimizedHybridHashJoinOperatorDescriptor.java
    • -16
    • +188
    ./sort/ExternalSortRunMerger.java
    • -6
    • +3
    ./sort/OptimizedExternalSortOperatorDescriptor.java
    • -14
    • +2
    ./sort/OptimizedExternalSortRunGenerator.java
    • -18
    • +2
    ./sort/OptimizedExternalSortRunGeneratorWithLimit.java
  1. … 1 more file in changeset.
Added Job timeline view

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@897 123451ca-8445-de46-9d55-352943316053

    • -1
    • +0
    ./base/AbstractConnectorDescriptor.java
    • -1
    • +0
    ./base/AbstractOperatorDescriptor.java
  1. … 17 more files in changeset.
Update issue #52: rewrote GroupingHashTable to use aggregator for key fields output; fixed a bug of incorrect initialization in pre-cluster grouper; tested all integration tests for new aggregation interfaces with larger dataset (so external grouper spills).

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@893 123451ca-8445-de46-9d55-352943316053

    • -11
    • +10
    ./aggregations/GroupingHashTable.java
    • -2
    • +3
    ./aggregations/PreclusteredGroupWriter.java
Update #52: fixed bugs on external grouper on merging phase; fixed bugs on aggregation integration tests.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@883 123451ca-8445-de46-9d55-352943316053

    • -13
    • +2
    ./aggregations/ExternalGroupOperatorDescriptor.java
    • -5
    • +13
    ./aggregations/GroupingHashTable.java
    • -2
    • +0
    ./aggregations/HashSpillableTableFactory.java
    • -1
    • +6
    ./aggregations/IAggregateStateFactory.java
    • -0
    • +21
    ./aggregations/IAggregatorDescriptor.java
    • -4
    • +16
    ./aggregations/IFieldAggregateDescriptor.java
    • -15
    • +18
    ./aggregations/aggregators/MinMaxStringFieldAggregatorFactory.java
    • -8
    • +48
    ./aggregations/aggregators/MultiFieldsAggregatorFactory.java
  1. … 1 more file in changeset.
Added getFieldCount() call to RecordDescriptor

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@881 123451ca-8445-de46-9d55-352943316053

    • -1
    • +1
    ./aggregators/MultiAggregatorFactory.java
    • -3
    • +3
    ./file/AbstractDeserializedFileScanOperatorDescriptor.java
    • -3
    • +3
    ./file/PlainFileWriterOperatorDescriptor.java
    • -2
    • +2
    ./group/ExternalGroupOperatorDescriptor.java
  1. … 10 more files in changeset.
Update issue #52: added initial version of PreCluster grouper operator; added test case for PreCluster grouper.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@880 123451ca-8445-de46-9d55-352943316053

    • -0
    • +100
    ./aggregations/PreclusteredGroupOperatorDescriptor.java
    • -0
    • +132
    ./aggregations/PreclusteredGroupWriter.java
  1. … 1 more file in changeset.
Update issue #52:

- rewrote the aggregator interface to create a state factory;

- added a wrapper interface for aggregation and changed the original aggregators to be field aggregators, and added a multi-field aggregator wrapper;

- rewrote test cases for new interface;

- added count field aggregator.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@879 123451ca-8445-de46-9d55-352943316053

    • -105
    • +49
    ./aggregations/ExternalGroupOperatorDescriptor.java
    • -197
    • +177
    ./aggregations/GroupingHashTable.java
    • -4
    • +4
    ./aggregations/HashGroupOperatorDescriptor.java
    • -154
    • +63
    ./aggregations/HashSpillableTableFactory.java
    • -0
    • +32
    ./aggregations/IAggregateStateFactory.java
    • -0
    • +113
    ./aggregations/IAggregatorDescriptor.java
    • -0
    • +32
    ./aggregations/IAggregatorDescriptorFactory.java
    • -6
    • +17
    ./aggregations/IFieldAggregateDescriptor.java
    • -1
    • +1
    ./aggregations/ISpillableTableFactory.java
    • -0
    • +219
    ./aggregations/aggregators/AvgFieldAggregatorFactory.java
    • -173
    • +0
    ./aggregations/aggregators/AvgMergeAggregatorFactory.java
    • -0
    • +166
    ./aggregations/aggregators/CountFieldAggregatorFactory.java
  1. … 5 more files in changeset.
Addressing Review Comments for External Sort with Replacement Selection

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@869 123451ca-8445-de46-9d55-352943316053

    • -184
    • +159
    ./sort/OptimizedExternalSortOperatorDescriptor.java
    • -251
    • +244
    ./sort/OptimizedExternalSortRunGenerator.java
    • -435
    • +415
    ./sort/OptimizedExternalSortRunGeneratorWithLimit.java
    • -181
    • +176
    ./sort/OptimizedExternalSortRunMerger.java
    • -373
    • +398
    ./sort/SortMinMaxHeap.java
Fixed NC memory leak. Fixed duplicate job cleanup. Cleaned up data treatment in Hyracks

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@865 123451ca-8445-de46-9d55-352943316053

    • -4
    • +4
    ./group/HashSpillableGroupingTableFactory.java
  1. … 134 more files in changeset.
Update issue #52:

Replaced the aggregate state interface by using a single aggregate state class.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@864 123451ca-8445-de46-9d55-352943316053

    • -0
    • +45
    ./aggregations/AggregateState.java
    • -1
    • +1
    ./aggregations/ExternalGroupOperatorDescriptor.java
    • -1
    • +1
    ./aggregations/HashSpillableTableFactory.java
    • -46
    • +0
    ./aggregations/IAggregateState.java
    • -6
    • +6
    ./aggregations/IFieldAggregateDescriptor.java
    • -34
    • +8
    ./aggregations/aggregators/MinMaxStringAggregatorFactory.java
Update issue #52:

Added Min/Max String aggregator using the new interface; added two test cases for both in-mem and external hash group operators.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@863 123451ca-8445-de46-9d55-352943316053

    • -0
    • +231
    ./aggregations/aggregators/MinMaxStringAggregatorFactory.java
  1. … 1 more file in changeset.
Update issue #52

Added AVG aggregator using new interface; added two integration tests for AVG aggregator.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@862 123451ca-8445-de46-9d55-352943316053

    • -0
    • +1
    ./group/ExternalGroupOperatorDescriptor.java
    • -4
    • +0
    ./group/HashSpillableGroupingTableFactory.java
  1. … 1 more file in changeset.
Update issue #52:

Added new aggregator interfaces and group operator implementations, in order to merge the old interfaces.

A simple integer sum aggregator is added to show the usage of the new interfaces.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@860 123451ca-8445-de46-9d55-352943316053

    • -0
    • +761
    ./aggregations/ExternalGroupOperatorDescriptor.java
    • -0
    • +233
    ./aggregations/GroupingHashTable.java
    • -0
    • +209
    ./aggregations/HashGroupOperatorDescriptor.java
    • -0
    • +589
    ./aggregations/HashSpillableTableFactory.java
    • -0
    • +46
    ./aggregations/IAggregateState.java
    • -0
    • +110
    ./aggregations/IFieldAggregateDescriptor.java
    • -0
    • +32
    ./aggregations/IFieldAggregateDescriptorFactory.java
    • -0
    • +39
    ./aggregations/ISpillableTable.java
    • -0
    • +31
    ./aggregations/ISpillableTableFactory.java
    • -0
    • +189
    ./aggregations/aggregators/AvgAggregatorFactory.java
    • -0
    • +199
    ./aggregations/aggregators/AvgMergeAggregatorFactory.java
    • -0
    • +180
    ./aggregations/aggregators/IntSumAggregatorFactory.java
Update legacy tuple slot length computation code, regarding to issue #51

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@835 123451ca-8445-de46-9d55-352943316053

    • -19
    • +30
    ./aggregators/SumAggregatorFactory.java
Update legacy codes on computing the field slot length in aggregators are updated. And, the incorrect initialization of the sum aggregator is fixed. Fixes issue 51.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@833 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./aggregators/CountAggregatorFactory.java
    • -20
    • +30
    ./aggregators/FloatSumAggregatorFactory.java
    • -19
    • +30
    ./aggregators/MinMaxAggregatorFactory.java
    • -1
    • +1
    ./aggregators/SumAggregatorFactory.java
Fixed bug in Grace Hash Join

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@823 123451ca-8445-de46-9d55-352943316053

    • -10
    • +9
    ./join/GraceHashJoinOperatorDescriptor.java
Classes for the implementation of External Sorting with Replacement Selection. Contains classes for Sorting (with and wout limit) and memory management

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@818 123451ca-8445-de46-9d55-352943316053

    • -0
    • +797
    ./sort/BSTMemMgr.java
    • -0
    • +277
    ./sort/BSTNodeUtil.java
    • -0
    • +71
    ./sort/IMemoryManager.java
    • -0
    • +19
    ./sort/IRunGenerator.java
    • -0
    • +53
    ./sort/ISelectionTree.java
    • -0
    • +229
    ./sort/OptimizedExternalSortOperatorDescriptor.java
    • -0
    • +313
    ./sort/OptimizedExternalSortRunGenerator.java
    • -0
    • +475
    ./sort/OptimizedExternalSortRunGeneratorWithLimit.java
    • -0
    • +233
    ./sort/OptimizedExternalSortRunMerger.java
    • -0
    • +249
    ./sort/SortMinHeap.java
    • -0
    • +394
    ./sort/SortMinMaxHeap.java
  1. … 1 more file in changeset.
New classes added for testing external sort with replacement selection

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@817 123451ca-8445-de46-9d55-352943316053

    • -0
    • +89
    ./misc/LimitOperatorDescriptor.java
  1. … 1 more file in changeset.
Addressing Review Comments for the Hybrid Hash Join

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@764 123451ca-8445-de46-9d55-352943316053

    • -470
    • +423
    ./join/OptimizedHybridHashJoin.java
    • -407
    • +454
    ./join/OptimizedHybridHashJoinOperatorDescriptor.java
  1. … 1 more file in changeset.
Cleaned up createPushRuntime api

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@729 123451ca-8445-de46-9d55-352943316053

    • -3
    • +2
    ./file/AbstractDeserializedFileScanOperatorDescriptor.java
    • -3
    • +2
    ./file/AbstractFileWriteOperatorDescriptor.java
    • -3
    • +2
    ./file/FileScanOperatorDescriptor.java
    • -3
    • +2
    ./file/FrameFileWriterOperatorDescriptor.java
    • -3
    • +2
    ./file/PlainFileWriterOperatorDescriptor.java
    • -5
    • +4
    ./group/ExternalGroupOperatorDescriptor.java
    • -7
    • +6
    ./group/HashGroupOperatorDescriptor.java
    • -3
    • +2
    ./group/PreclusteredGroupOperatorDescriptor.java
    • -6
    • +5
    ./join/GraceHashJoinOperatorDescriptor.java
    • -5
    • +4
    ./join/HybridHashJoinOperatorDescriptor.java
    • -5
    • +4
    ./join/InMemoryHashJoinOperatorDescriptor.java
    • -5
    • +4
    ./join/NestedLoopJoinOperatorDescriptor.java
    • -3
    • +2
    ./map/DeserializedMapperOperatorDescriptor.java
    • -3
    • +2
    ./misc/ConstantTupleSourceOperatorDescriptor.java
    • -5
    • +4
    ./misc/MaterializingOperatorDescriptor.java
  1. … 27 more files in changeset.
Adding new files to HHJ code

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@666 123451ca-8445-de46-9d55-352943316053

    • -0
    • +41
    ./join/JoinComparator.java
    • -0
    • +26
    ./join/JoinComparatorFactory.java
    • -0
    • +654
    ./join/OptimizedHybridHashJoin.java
    • -0
    • +567
    ./join/OptimizedHybridHashJoinOperatorDescriptor.java
  1. … 16 more files in changeset.
Making HHJ Code Available for review

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@665 123451ca-8445-de46-9d55-352943316053

    • -1
    • +6
    ./join/GraceHashJoinOperatorDescriptor.java
    • -3
    • +6
    ./join/HybridHashJoinOperatorDescriptor.java
    • -1
    • +4
    ./join/InMemoryHashJoinOperatorDescriptor.java
  1. … 1 more file in changeset.
Added a Virtual Cluster Driver

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@582 123451ca-8445-de46-9d55-352943316053

  1. … 9 more files in changeset.
Added ability to register TaskState with the infrastructure

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@565 123451ca-8445-de46-9d55-352943316053

    • -0
    • +48
    ./base/AbstractTaskState.java
    • -49
    • +63
    ./group/ExternalGroupOperatorDescriptor.java
    • -11
    • +43
    ./group/HashGroupOperatorDescriptor.java
    • -26
    • +54
    ./join/GraceHashJoinOperatorDescriptor.java
    • -83
    • +102
    ./join/HybridHashJoinOperatorDescriptor.java
    • -16
    • +49
    ./join/InMemoryHashJoinOperatorDescriptor.java
    • -15
    • +46
    ./join/NestedLoopJoinOperatorDescriptor.java
    • -14
    • +45
    ./misc/MaterializingOperatorDescriptor.java
    • -16
    • +45
    ./misc/SplitVectorOperatorDescriptor.java
    • -15
    • +49
    ./sort/ExternalSortOperatorDescriptor.java
    • -15
    • +45
    ./sort/InMemorySortOperatorDescriptor.java
  1. … 4 more files in changeset.
Fixed protocol to call fail() on writers when source operators encounter an error.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@550 123451ca-8445-de46-9d55-352943316053

    • -0
    • +4
    ./file/FileScanOperatorDescriptor.java
    • -0
    • +3
    ./group/ExternalGroupOperatorDescriptor.java
    • -2
    • +8
    ./group/HashGroupOperatorDescriptor.java
    • -33
    • +40
    ./join/GraceHashJoinOperatorDescriptor.java
    • -2
    • +8
    ./misc/ConstantTupleSourceOperatorNodePushable.java
    • -7
    • +13
    ./misc/MaterializingOperatorDescriptor.java
    • -3
    • +9
    ./sort/InMemorySortOperatorDescriptor.java
  1. … 4 more files in changeset.
Added fail() call to IFrameWriter

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@549 123451ca-8445-de46-9d55-352943316053

    • -0
    • +16
    ./collectors/NonDeterministicPartitionCollector.java
    • -2
    • +14
    ./collectors/SortMergePartitionCollector.java
    • -6
    • +6
    ./connectors/MToNReplicatingConnectorDescriptor.java
    • -16
    • +24
    ./file/AbstractDeserializedFileScanOperatorDescriptor.java
    • -0
    • +4
    ./file/AbstractFileWriteOperatorDescriptor.java
    • -6
    • +1
    ./file/FrameFileWriterOperatorDescriptor.java
    • -6
    • +1
    ./file/PlainFileWriterOperatorDescriptor.java
    • -0
    • +5
    ./group/DeserializedPreclusteredGroupOperator.java
    • -1
    • +1
    ./group/ExternalGroupOperatorDescriptor.java
    • -1
    • +1
    ./group/HashGroupOperatorDescriptor.java
    • -2
    • +2
    ./group/PreclusteredGroupOperatorDescriptor.java
    • -1
    • +1
    ./join/GraceHashJoinOperatorDescriptor.java
    • -6
    • +6
    ./join/HybridHashJoinOperatorDescriptor.java
  1. … 39 more files in changeset.