Clone Tools
  • last updated 14 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Added the ability for connectors to indicate source partitions that make it to a given target

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@1212 123451ca-8445-de46-9d55-352943316053

    • -0
    • +7
    ./std/base/AbstractMToNConnectorDescriptor.java
  1. … 1 more file in changeset.
Added map-based connector.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@1148 123451ca-8445-de46-9d55-352943316053

    • -0
    • +50
    ./std/connectors/GlobalHashingLocalityMap.java
    • -0
    • +72
    ./std/connectors/HashtableLocalityMap.java
    • -0
    • +27
    ./std/connectors/ILocalityMap.java
    • -0
    • +82
    ./std/connectors/LocalityAwareMToNPartitioningConnectorDescriptor.java
    • -0
    • +125
    ./std/connectors/LocalityAwarePartitionDataWriter.java
Added support code for JobDetails page in admin console

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@1140 123451ca-8445-de46-9d55-352943316053

    • -1
    • +1
    ./std/base/AbstractConnectorDescriptor.java
    • -1
    • +1
    ./std/base/AbstractOperatorDescriptor.java
  1. … 5 more files in changeset.
fix a memory recycle issue in sorter's memory manager

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@1135 123451ca-8445-de46-9d55-352943316053

    • -0
    • +1
    ./std/sort/OptimizedExternalSortRunGenerator.java
    • -0
    • +1
    ./std/sort/OptimizedExternalSortRunGeneratorWithLimit.java
fix the memory recycle issue in FrameSorter

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@1131 123451ca-8445-de46-9d55-352943316053

    • -1
    • +2
    ./std/sort/ExternalSortOperatorDescriptor.java
    • -29
    • +32
    ./std/sort/ExternalSortRunMerger.java
    • -29
    • +21
    ./std/sort/OptimizedExternalSortRunGenerator.java
  1. … 8 more files in changeset.
Fixed a bug on the merging phase of the external grouper; added a float sum aggregator (with test cases).

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@1087 123451ca-8445-de46-9d55-352943316053

    • -13
    • +13
    ./std/group/ExternalGroupOperatorDescriptor.java
    • -0
    • +158
    ./std/group/aggregators/FloatSumFieldAggregatorFactory.java
  1. … 1 more file in changeset.
Optimized thread usage in CC. Reduced sizes of critical sections in PartitionCollector

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@1067 123451ca-8445-de46-9d55-352943316053

    • -18
    • +16
    ./std/collectors/NonDeterministicPartitionCollector.java
  1. … 5 more files in changeset.
merge hyracks_dev_next r978:1064

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@1065 123451ca-8445-de46-9d55-352943316053

    • -0
    • +4
    ./std/group/ExternalGroupOperatorDescriptor.java
  1. … 2 more files in changeset.
Added get/set display name to Operators and Connectors

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@1053 123451ca-8445-de46-9d55-352943316053

    • -0
    • +12
    ./std/base/AbstractConnectorDescriptor.java
    • -0
    • +12
    ./std/base/AbstractOperatorDescriptor.java
  1. … 2 more files in changeset.
Added more logging

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@1029 123451ca-8445-de46-9d55-352943316053

    • -0
    • +16
    ./std/collectors/NonDeterministicPartitionCollector.java
  1. … 1 more file in changeset.
Fixed bugs for key maintanance codes in groupers (after being moved out of the aggregators).

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@1024 123451ca-8445-de46-9d55-352943316053

    • -0
    • +4
    ./std/group/HashSpillableTableFactory.java
    • -3
    • +3
    ./std/group/PreclusteredGroupWriter.java
implementing writing keys to output in group-by operator rather than aggregators

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@983 123451ca-8445-de46-9d55-352943316053

    • -0
    • +4
    ./std/group/ExternalGroupOperatorDescriptor.java
    • -0
    • +6
    ./std/group/HashSpillableTableFactory.java
  1. … 1 more file in changeset.
add explicit system.gc() call at the beginning of merge phase

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@982 123451ca-8445-de46-9d55-352943316053

    • -1
    • +6
    ./std/group/ExternalGroupOperatorDescriptor.java
reformat the source code

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@981 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./std/file/AbstractFileWriteOperatorDescriptor.java
    • -5
    • +1
    ./std/file/DelimitedDataTupleParserFactory.java
    • -2
    • +2
    ./std/file/FileScanOperatorDescriptor.java
    • -2
    • +2
    ./std/file/FrameFileWriterOperatorDescriptor.java
    • -2
    • +9
    ./std/file/PlainFileWriterOperatorDescriptor.java
    • -4
    • +7
    ./std/file/RecordFileScanOperatorDescriptor.java
    • -1
    • +1
    ./std/group/DeserializedPreclusteredGroupOperator.java
    • -158
    • +84
    ./std/group/ExternalGroupOperatorDescriptor.java
    • -42
    • +28
    ./std/group/FrameToolsForGroupers.java
    • -238
    • +214
    ./std/group/GroupingHashTable.java
    • -34
    • +18
    ./std/group/HashGroupOperatorDescriptor.java
    • -395
    • +332
    ./std/group/HashSpillableTableFactory.java
    • -11
    • +8
    ./std/group/IAggregatorDescriptor.java
    • -4
    • +4
    ./std/group/IAggregatorDescriptorFactory.java
  1. … 17 more files in changeset.
merge hyracks_dev_next r847:977

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@978 123451ca-8445-de46-9d55-352943316053

    • -1
    • +0
    ./std/base/AbstractConnectorDescriptor.java
    • -1
    • +0
    ./std/base/AbstractOperatorDescriptor.java
    • -3
    • +3
    ./std/file/AbstractDeserializedFileScanOperatorDescriptor.java
    • -3
    • +3
    ./std/file/PlainFileWriterOperatorDescriptor.java
    • -219
    • +238
    ./std/group/GroupingHashTable.java
    • -322
    • +322
    ./std/group/HashSpillableTableFactory.java
    • -141
    • +153
    ./std/group/PreclusteredGroupWriter.java
  1. … 141 more files in changeset.
Updated the aggregator interfaces to use ArrayTupleBuilder; removed the state length calculator.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@977 123451ca-8445-de46-9d55-352943316053

    • -63
    • +55
    ./std/group/ExternalGroupOperatorDescriptor.java
    • -46
    • +43
    ./std/group/GroupingHashTable.java
    • -103
    • +91
    ./std/group/HashSpillableTableFactory.java
    • -17
    • +4
    ./std/group/IAggregatorDescriptor.java
    • -9
    • +0
    ./std/group/IFieldAggregateDescriptor.java
    • -1
    • +1
    ./std/group/PreclusteredGroupOperatorDescriptor.java
    • -19
    • +22
    ./std/group/PreclusteredGroupWriter.java
  1. … 2 more files in changeset.
Removed getter and setter from AggregateState

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@972 123451ca-8445-de46-9d55-352943316053

Major changes: - Based on Yingyi's review comments, the new interface is written to have the frame output logic out of the aggregators. - Added methods for better management of the size of aggregation states. Now aggregator developer can decide the memory size to be used, and the groupers will assign the memory/frame spaces based on these information. - Fixed some bugs in multiple-field aggregator.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@971 123451ca-8445-de46-9d55-352943316053

    • -34
    • +75
    ./std/group/ExternalGroupOperatorDescriptor.java
    • -0
    • +107
    ./std/group/FrameToolsForGroupers.java
    • -37
    • +65
    ./std/group/GroupingHashTable.java
    • -63
    • +135
    ./std/group/HashSpillableTableFactory.java
    • -37
    • +0
    ./std/group/IAggregateStateFactory.java
    • -8
    • +13
    ./std/group/IAggregatorDescriptor.java
    • -12
    • +29
    ./std/group/IFieldAggregateDescriptor.java
    • -31
    • +65
    ./std/group/PreclusteredGroupWriter.java
  1. … 1 more file in changeset.
Removed the initFromPartial() method from the new aggregator interface; added AvgFieldMergeAggregatorFactory for the merge phase of AVG().

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@967 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./std/group/ExternalGroupOperatorDescriptor.java
    • -16
    • +0
    ./std/group/IAggregatorDescriptor.java
    • -19
    • +0
    ./std/group/IFieldAggregateDescriptor.java
    • -0
    • +190
    ./std/group/aggregators/AvgFieldGroupAggregatorFactory.java
    • -0
    • +195
    ./std/group/aggregators/AvgFieldMergeAggregatorFactory.java
  1. … 2 more files in changeset.
Adding Optimization for the merge step in external sort

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@965 123451ca-8445-de46-9d55-352943316053

    • -8
    • +13
    ./std/sort/ExternalSortRunMerger.java
    • -2
    • +3
    ./std/sort/OptimizedExternalSortOperatorDescriptor.java
Pre-merge cleanup: removed old aggregator interfaces, and updated codes to use the new interface.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@963 123451ca-8445-de46-9d55-352943316053

    • -45
    • +0
    ./std/aggregations/AggregateState.java
    • -231
    • +0
    ./std/aggregations/GroupingHashTable.java
    • -39
    • +0
    ./std/aggregations/ISpillableTable.java
    • -100
    • +0
    ./std/aggregations/PreclusteredGroupOperatorDescriptor.java
  1. … 48 more files in changeset.
Fixed bugs on key fields arrangement when partial grouping values are stored; added test cases to benchmark the new interface.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@962 123451ca-8445-de46-9d55-352943316053

    • -0
    • +4
    ./std/aggregations/AggregateState.java
    • -1
    • +12
    ./std/aggregations/GroupingHashTable.java
  1. … 3 more files in changeset.
Added new IPC mechanism to Hyracks. Migrated all remote communications to use new IPC layer

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@935 123451ca-8445-de46-9d55-352943316053

  1. … 54 more files in changeset.
reverting changes

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@930 123451ca-8445-de46-9d55-352943316053

    • -28
    • +1
    ./std/misc/PrinterOperatorDescriptor.java
Removing unneccessary class

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@928 123451ca-8445-de46-9d55-352943316053

    • -1
    • +28
    ./std/misc/PrinterOperatorDescriptor.java
    • -228
    • +0
    ./std/sort/OptimizedExternalSortRunMerger.java
  1. … 7 more files in changeset.
Addressing Reviewer's comments

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_sort_join_opts@927 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./std/join/OptimizedHybridHashJoin.java
    • -1
    • +1
    ./std/join/OptimizedHybridHashJoinOperatorDescriptor.java
    • -16
    • +188
    ./std/sort/ExternalSortRunMerger.java
    • -6
    • +3
    ./std/sort/OptimizedExternalSortOperatorDescriptor.java
    • -14
    • +2
    ./std/sort/OptimizedExternalSortRunGenerator.java
    • -18
    • +2
    ./std/sort/OptimizedExternalSortRunGeneratorWithLimit.java
  1. … 1 more file in changeset.
Added Job timeline view

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@897 123451ca-8445-de46-9d55-352943316053

    • -1
    • +0
    ./std/base/AbstractConnectorDescriptor.java
    • -1
    • +0
    ./std/base/AbstractOperatorDescriptor.java
  1. … 17 more files in changeset.
Update issue #52: rewrote GroupingHashTable to use aggregator for key fields output; fixed a bug of incorrect initialization in pre-cluster grouper; tested all integration tests for new aggregation interfaces with larger dataset (so external grouper spills).

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@893 123451ca-8445-de46-9d55-352943316053

    • -11
    • +10
    ./std/aggregations/GroupingHashTable.java
Update #52: fixed bugs on external grouper on merging phase; fixed bugs on aggregation integration tests.

git-svn-id: https://hyracks.googlecode.com/svn/branches/aggregators_dev_next@883 123451ca-8445-de46-9d55-352943316053

    • -5
    • +13
    ./std/aggregations/GroupingHashTable.java
  1. … 1 more file in changeset.
Added getFieldCount() call to RecordDescriptor

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_dev_next@881 123451ca-8445-de46-9d55-352943316053

    • -3
    • +3
    ./std/file/AbstractDeserializedFileScanOperatorDescriptor.java
    • -3
    • +3
    ./std/file/PlainFileWriterOperatorDescriptor.java
    • -2
    • +2
    ./std/group/ExternalGroupOperatorDescriptor.java
  1. … 10 more files in changeset.