Clone Tools
  • last updated 12 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Merged r455:456 from hyracks_scheduling

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@457 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./join/NestedLoopJoinOperatorDescriptor.java
Removed a println. Changed code to use FrameUtils.makeReadable() instead of ByteBuffer.flip()

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@456 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./join/NestedLoopJoinOperatorDescriptor.java
Fixed bug in SortMergePartitionCollector. Fixed over-synchronization in collectors.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@452 123451ca-8445-de46-9d55-352943316053

    • -5
    • +14
    ./collectors/NonDeterministicPartitionCollector.java
    • -12
    • +15
    ./collectors/SortMergePartitionCollector.java
  1. … 1 more file in changeset.
Merged r432 from trunk

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@433 123451ca-8445-de46-9d55-352943316053

    • -1
    • +3
    ./base/AbstractConnectorDescriptor.java
    • -1
    • +3
    ./base/AbstractOperatorDescriptor.java
    • -1
    • +3
    ./connectors/OneToOneConnectorDescriptor.java
    • -28
    • +58
    ./join/GraceHashJoinOperatorDescriptor.java
    • -64
    • +104
    ./join/HybridHashJoinOperatorDescriptor.java
    • -3
    • +32
    ./join/InMemoryHashJoinOperatorDescriptor.java
    • -0
    • +153
    ./join/NestedLoopJoinOperatorDescriptor.java
    • -0
    • +65
    ./misc/SplitOperatorDescriptor.java
    • -0
    • +119
    ./union/UnionAllOperatorDescriptor.java
  1. … 25 more files in changeset.
Added more connector policies. Cleaned up Activity API.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@431 123451ca-8445-de46-9d55-352943316053

    • -17
    • +8
    ./base/AbstractSingleActivityOperatorDescriptor.java
    • -25
    • +14
    ./group/ExternalHashGroupOperatorDescriptor.java
    • -16
    • +14
    ./group/HashGroupOperatorDescriptor.java
    • -20
    • +17
    ./join/GraceHashJoinOperatorDescriptor.java
    • -21
    • +10
    ./join/HybridHashJoinOperatorDescriptor.java
    • -16
    • +14
    ./join/InMemoryHashJoinOperatorDescriptor.java
    • -16
    • +14
    ./misc/MaterializingOperatorDescriptor.java
    • -15
    • +12
    ./misc/SplitVectorOperatorDescriptor.java
    • -12
    • +10
    ./sort/ExternalSortOperatorDescriptor.java
    • -12
    • +10
    ./sort/InMemorySortOperatorDescriptor.java
  1. … 40 more files in changeset.
update the source files to follow hyracks code style

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_aqua_changes@420 123451ca-8445-de46-9d55-352943316053

    • -140
    • +147
    ./join/NestedLoopJoin.java
    • -0
    • +15
    ./join/NestedLoopJoinOperatorDescriptor.java
  1. … 2 more files in changeset.
Added ability to get ipAddress -> nodeName map while contributing scheduling constraints

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_aqua_changes@419 123451ca-8445-de46-9d55-352943316053

    • -1
    • +3
    ./base/AbstractConnectorDescriptor.java
    • -1
    • +3
    ./base/AbstractOperatorDescriptor.java
    • -1
    • +3
    ./connectors/OneToOneConnectorDescriptor.java
  1. … 10 more files in changeset.
Added UnionAll Operator and test

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_aqua_changes@418 123451ca-8445-de46-9d55-352943316053

    • -0
    • +124
    ./union/UnionAllOperatorDescriptor.java
  1. … 3 more files in changeset.
1. after one join, need to copy the frame 2. extract the memory reload as method

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_aqua_changes@415 123451ca-8445-de46-9d55-352943316053

    • -123
    • +140
    ./join/NestedLoopJoin.java
1. Ray's fix on TPCH hash outer join test 2. Add block_nest_loop_join runtime operators, and the interface ITuplePairComparator and ITuplePairComparatorFactory 3. Add TPCH tests for block_nested_loop_join

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_aqua_changes@414 123451ca-8445-de46-9d55-352943316053

    • -0
    • +142
    ./join/NestedLoopJoin.java
    • -0
    • +142
    ./join/NestedLoopJoinOperatorDescriptor.java
  1. … 4 more files in changeset.
Merged in all changes from Aqua/Asterix

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_aqua_changes@405 123451ca-8445-de46-9d55-352943316053

    • -32
    • +64
    ./join/GraceHashJoinOperatorDescriptor.java
    • -64
    • +104
    ./join/HybridHashJoinOperatorDescriptor.java
    • -3
    • +32
    ./join/InMemoryHashJoinOperatorDescriptor.java
    • -0
    • +65
    ./misc/SplitOperatorDescriptor.java
  1. … 6 more files in changeset.
Merged -r 356:400 from trunk

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@401 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./aggregators/CountAggregatorFactory.java
    • -2
    • +2
    ./aggregators/FloatSumAggregatorFactory.java
    • -2
    • +2
    ./aggregators/MinMaxAggregatorFactory.java
    • -2
    • +2
    ./aggregators/SumAggregatorFactory.java
  1. … 4 more files in changeset.
Merged in 32 bit tuple fields offset patch from Rares

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@400 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./aggregators/CountAggregatorFactory.java
    • -2
    • +2
    ./aggregators/FloatSumAggregatorFactory.java
    • -2
    • +2
    ./aggregators/MinMaxAggregatorFactory.java
    • -2
    • +2
    ./aggregators/SumAggregatorFactory.java
  1. … 4 more files in changeset.
Fixed task cluster build issue. Fixed closing of Task context

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@390 123451ca-8445-de46-9d55-352943316053

    • -3
    • +0
    ./join/InMemoryHashJoinOperatorDescriptor.java
  1. … 4 more files in changeset.
Added sort-merge collector. tests pass

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@389 123451ca-8445-de46-9d55-352943316053

    • -0
    • +50
    ./collectors/AbstractPartitionCollector.java
    • -0
    • +188
    ./collectors/NonDeterministicPartitionCollector.java
    • -0
    • +260
    ./collectors/SortMergePartitionCollector.java
    • -2
    • +3
    ./connectors/MToNPartitioningConnectorDescriptor.java
    • -2
    • +9
    ./connectors/MToNPartitioningMergingConnectorDescriptor.java
    • -2
    • +3
    ./connectors/MToNReplicatingConnectorDescriptor.java
    • -2
    • +3
    ./connectors/OneToOneConnectorDescriptor.java
    • -0
    • +3
    ./join/InMemoryHashJoinOperatorDescriptor.java
    • -0
    • +1
    ./misc/ConstantTupleSourceOperatorNodePushable.java
    • -3
    • +8
    ./sort/ExternalSortOperatorDescriptor.java
    • -130
    • +20
    ./sort/ExternalSortRunMerger.java
    • -0
    • +177
    ./sort/RunMergingFrameReader.java
  1. … 58 more files in changeset.
Partial commit. Code compiles, but not complete

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@383 123451ca-8445-de46-9d55-352943316053

    • -3
    • +3
    ./aggregators/MultiAggregatorFactory.java
    • -3
    • +3
    ./base/AbstractConnectorDescriptor.java
    • -0
    • +34
    ./base/AbstractMToNConnectorDescriptor.java
    • -3
    • +3
    ./base/AbstractOperatorDescriptor.java
    • -110
    • +0
    ./connectors/HashDataWriter.java
    • -53
    • +0
    ./connectors/MToNHashPartitioningConnectorDescriptor.java
    • -65
    • +0
    ./connectors/MToNHashPartitioningMergingConnectorDescriptor.java
    • -0
    • +55
    ./connectors/MToNPartitioningConnectorDescriptor.java
    • -0
    • +64
    ./connectors/MToNPartitioningMergingConnectorDescriptor.java
    • -144
    • +0
    ./connectors/MToNRangePartitioningConnectorDescriptor.java
    • -13
    • +14
    ./connectors/MToNReplicatingConnectorDescriptor.java
    • -18
    • +26
    ./connectors/OneToOneConnectorDescriptor.java
    • -0
    • +109
    ./connectors/PartitionDataWriter.java
    • -2
    • +2
    ./file/AbstractDeserializedFileScanOperatorDescriptor.java
    • -2
    • +2
    ./file/AbstractFileWriteOperatorDescriptor.java
  1. … 197 more files in changeset.
Refactored code for scheduling changes

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@354 123451ca-8445-de46-9d55-352943316053

    • -1
    • +1
    ./connectors/MToNHashPartitioningConnectorDescriptor.java
    • -1
    • +1
    ./connectors/MToNHashPartitioningMergingConnectorDescriptor.java
    • -1
    • +1
    ./connectors/MToNRangePartitioningConnectorDescriptor.java
    • -1
    • +1
    ./connectors/MToNReplicatingConnectorDescriptor.java
    • -1
    • +1
    ./connectors/OneToOneConnectorDescriptor.java
  1. … 59 more files in changeset.
Merged in trunk@304:314

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@317 123451ca-8445-de46-9d55-352943316053

    • -0
    • +46
    ./aggregators/CountAggregatorFactory.java
    • -0
    • +135
    ./aggregators/FloatSumAggregatorFactory.java
    • -0
    • +2
    ./aggregators/IFieldValueResultingAggregatorFactory.java
    • -0
    • +48
    ./aggregators/ISpillableFieldValueResultingAggregator.java
    • -0
    • +137
    ./aggregators/MinMaxAggregatorFactory.java
    • -5
    • +95
    ./aggregators/MultiAggregatorFactory.java
    • -0
    • +134
    ./aggregators/SumAggregatorFactory.java
    • -0
    • +136
    ./file/PlainFileWriterOperatorDescriptor.java
    • -0
    • +692
    ./group/ExternalHashGroupOperatorDescriptor.java
    • -0
    • +3
    ./group/IAccumulatingAggregatorFactory.java
    • -0
    • +40
    ./group/ISpillableAccumulatingAggregator.java
    • -0
    • +569
    ./group/SpillableGroupingHashTable.java
  1. … 3 more files in changeset.
Fixed the code format based on the Hyracks code format profile.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_spilling_groupby@309 123451ca-8445-de46-9d55-352943316053

    • -34
    • +38
    ./aggregators/CountAggregatorFactory.java
    • -114
    • +102
    ./aggregators/FloatSumAggregatorFactory.java
    • -1
    • +1
    ./aggregators/IFieldValueResultingAggregatorFactory.java
    • -24
    • +21
    ./aggregators/ISpillableFieldValueResultingAggregator.java
    • -118
    • +106
    ./aggregators/MinMaxAggregatorFactory.java
    • -166
    • +145
    ./aggregators/MultiAggregatorFactory.java
    • -112
    • +100
    ./aggregators/SumAggregatorFactory.java
    • -96
    • +89
    ./file/PlainFileWriterOperatorDescriptor.java
    • -708
    • +632
    ./group/ExternalHashGroupOperatorDescriptor.java
    • -6
    • +4
    ./group/IAccumulatingAggregatorFactory.java
    • -15
    • +11
    ./group/ISpillableAccumulatingAggregator.java
    • -543
    • +528
    ./group/SpillableGroupingHashTable.java
  1. … 2 more files in changeset.
Added external hash group operator. Main changes include: - added external hash group operator and its helper hash table class, and test cases; - modified aggregator factories to support external group operator; - added some aggregators (min/max, sum); - added a plain file writer to output plain text onto disk.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_spilling_groupby@301 123451ca-8445-de46-9d55-352943316053

    • -0
    • +42
    ./aggregators/CountAggregatorFactory.java
    • -0
    • +147
    ./aggregators/FloatSumAggregatorFactory.java
    • -0
    • +2
    ./aggregators/IFieldValueResultingAggregatorFactory.java
    • -0
    • +51
    ./aggregators/ISpillableFieldValueResultingAggregator.java
    • -0
    • +149
    ./aggregators/MinMaxAggregatorFactory.java
    • -56
    • +167
    ./aggregators/MultiAggregatorFactory.java
    • -0
    • +146
    ./aggregators/SumAggregatorFactory.java
    • -0
    • +143
    ./file/PlainFileWriterOperatorDescriptor.java
    • -0
    • +768
    ./group/ExternalHashGroupOperatorDescriptor.java
    • -2
    • +7
    ./group/IAccumulatingAggregatorFactory.java
    • -0
    • +44
    ./group/ISpillableAccumulatingAggregator.java
    • -0
    • +584
    ./group/SpillableGroupingHashTable.java
  1. … 3 more files in changeset.
Added new scheduler. Temporarily disabled build of compat layer pending some changes

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@299 123451ca-8445-de46-9d55-352943316053

    • -0
    • +7
    ./base/AbstractConnectorDescriptor.java
    • -13
    • +6
    ./base/AbstractOperatorDescriptor.java
    • -0
    • +16
    ./connectors/OneToOneConnectorDescriptor.java
  1. … 123 more files in changeset.
Merged r289:290 from the hyracks_io_management branch

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@291 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./aggregators/MultiAggregatorFactory.java
    • -3
    • +3
    ./connectors/MToNHashPartitioningConnectorDescriptor.java
    • -3
    • +3
    ./connectors/MToNHashPartitioningMergingConnectorDescriptor.java
    • -7
    • +7
    ./connectors/MToNRangePartitioningConnectorDescriptor.java
    • -3
    • +3
    ./connectors/MToNReplicatingConnectorDescriptor.java
    • -3
    • +3
    ./connectors/OneToOneConnectorDescriptor.java
    • -3
    • +3
    ./file/AbstractDeserializedFileScanOperatorDescriptor.java
    • -4
    • +2
    ./file/AbstractFileWriteOperatorDescriptor.java
    • -4
    • +4
    ./file/DelimitedDataTupleParserFactory.java
    • -3
    • +3
    ./file/FileScanOperatorDescriptor.java
    • -3
    • +3
    ./file/FrameFileWriterOperatorDescriptor.java
    • -32
    • +21
    ./file/LineFileWriteOperatorDescriptor.java
  1. … 174 more files in changeset.
Merged 249:266 from trunk

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_storage_cleanup@267 123451ca-8445-de46-9d55-352943316053

  1. … 3 more files in changeset.
Minor change in comparison loop

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@256 123451ca-8445-de46-9d55-352943316053

Merged 229:231 from hyracks_online_aggregation branch

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@233 123451ca-8445-de46-9d55-352943316053

    • -68
    • +8
    ./group/PreclusteredGroupOperatorDescriptor.java
    • -0
    • +130
    ./group/PreclusteredGroupWriter.java
  1. … 6 more files in changeset.
Fixed bug when sorting empty input

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@227 123451ca-8445-de46-9d55-352943316053

Merged online_aggregation @186:220

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@221 123451ca-8445-de46-9d55-352943316053

    • -326
    • +14
    ./sort/ExternalSortOperatorDescriptor.java
    • -0
    • +100
    ./sort/ExternalSortRunGenerator.java
    • -0
    • +236
    ./sort/ExternalSortRunMerger.java
    • -0
    • +59
    ./sort/RunFileReader.java
    • -0
    • +77
    ./sort/RunFileWriter.java
  1. … 30 more files in changeset.
Currently FileSplit stores java.io.file as a field and the host housing the file as a string. This is appropriate for a local file system but not for HDFS. The path contained inside the file type is incorrectly normalized. FileSplit should be constructed just from the node and the file path. Added field path (String) to FileSplit.

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@183 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./file/AbstractFileWriteOperatorDescriptor.java
    • -2
    • +2
    ./file/LineFileWriteOperatorDescriptor.java
Fixed dropped tuples bug in HHJ

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@179 123451ca-8445-de46-9d55-352943316053

    • -13
    • +9
    ./join/HybridHashJoinOperatorDescriptor.java
checking in bug fix in PreClustered Group operator. The close on aggregate was not being called that prevented reducer from closing

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@178 123451ca-8445-de46-9d55-352943316053

    • -87
    • +94
    ./group/DeserializedPreclusteredGroupOperator.java