Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
1. after one join, need to copy the frame 2. extract the memory reload as method

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_aqua_changes@415 123451ca-8445-de46-9d55-352943316053

    • -123
    • +140
    ./join/NestedLoopJoin.java
1. Ray's fix on TPCH hash outer join test 2. Add block_nest_loop_join runtime operators, and the interface ITuplePairComparator and ITuplePairComparatorFactory 3. Add TPCH tests for block_nested_loop_join

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_aqua_changes@414 123451ca-8445-de46-9d55-352943316053

    • -0
    • +142
    ./join/NestedLoopJoin.java
    • -0
    • +142
    ./join/NestedLoopJoinOperatorDescriptor.java
  1. … 4 more files in changeset.
Merged in all changes from Aqua/Asterix

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_aqua_changes@405 123451ca-8445-de46-9d55-352943316053

    • -32
    • +64
    ./join/GraceHashJoinOperatorDescriptor.java
    • -64
    • +104
    ./join/HybridHashJoinOperatorDescriptor.java
    • -3
    • +32
    ./join/InMemoryHashJoinOperatorDescriptor.java
    • -0
    • +65
    ./misc/SplitOperatorDescriptor.java
  1. … 6 more files in changeset.
Merged -r 356:400 from trunk

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@401 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./aggregators/CountAggregatorFactory.java
    • -2
    • +2
    ./aggregators/FloatSumAggregatorFactory.java
    • -2
    • +2
    ./aggregators/MinMaxAggregatorFactory.java
    • -2
    • +2
    ./aggregators/SumAggregatorFactory.java
  1. … 4 more files in changeset.
Merged in 32 bit tuple fields offset patch from Rares

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@400 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./aggregators/CountAggregatorFactory.java
    • -2
    • +2
    ./aggregators/FloatSumAggregatorFactory.java
    • -2
    • +2
    ./aggregators/MinMaxAggregatorFactory.java
    • -2
    • +2
    ./aggregators/SumAggregatorFactory.java
  1. … 4 more files in changeset.
Fixed task cluster build issue. Fixed closing of Task context

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@390 123451ca-8445-de46-9d55-352943316053

    • -3
    • +0
    ./join/InMemoryHashJoinOperatorDescriptor.java
  1. … 4 more files in changeset.
Added sort-merge collector. tests pass

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@389 123451ca-8445-de46-9d55-352943316053

    • -0
    • +50
    ./collectors/AbstractPartitionCollector.java
    • -0
    • +188
    ./collectors/NonDeterministicPartitionCollector.java
    • -0
    • +260
    ./collectors/SortMergePartitionCollector.java
    • -2
    • +3
    ./connectors/MToNPartitioningConnectorDescriptor.java
    • -2
    • +9
    ./connectors/MToNPartitioningMergingConnectorDescriptor.java
    • -2
    • +3
    ./connectors/MToNReplicatingConnectorDescriptor.java
    • -2
    • +3
    ./connectors/OneToOneConnectorDescriptor.java
    • -0
    • +3
    ./join/InMemoryHashJoinOperatorDescriptor.java
    • -0
    • +1
    ./misc/ConstantTupleSourceOperatorNodePushable.java
    • -3
    • +8
    ./sort/ExternalSortOperatorDescriptor.java
    • -130
    • +20
    ./sort/ExternalSortRunMerger.java
    • -0
    • +177
    ./sort/RunMergingFrameReader.java
  1. … 58 more files in changeset.
Partial commit. Code compiles, but not complete

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@383 123451ca-8445-de46-9d55-352943316053

    • -3
    • +3
    ./aggregators/MultiAggregatorFactory.java
    • -3
    • +3
    ./base/AbstractConnectorDescriptor.java
    • -0
    • +34
    ./base/AbstractMToNConnectorDescriptor.java
    • -3
    • +3
    ./base/AbstractOperatorDescriptor.java
    • -110
    • +0
    ./connectors/HashDataWriter.java
    • -53
    • +0
    ./connectors/MToNHashPartitioningConnectorDescriptor.java
    • -65
    • +0
    ./connectors/MToNHashPartitioningMergingConnectorDescriptor.java
    • -0
    • +55
    ./connectors/MToNPartitioningConnectorDescriptor.java
    • -0
    • +64
    ./connectors/MToNPartitioningMergingConnectorDescriptor.java
    • -144
    • +0
    ./connectors/MToNRangePartitioningConnectorDescriptor.java
    • -13
    • +14
    ./connectors/MToNReplicatingConnectorDescriptor.java
    • -18
    • +26
    ./connectors/OneToOneConnectorDescriptor.java
    • -0
    • +109
    ./connectors/PartitionDataWriter.java
    • -2
    • +2
    ./file/AbstractDeserializedFileScanOperatorDescriptor.java
    • -2
    • +2
    ./file/AbstractFileWriteOperatorDescriptor.java
  1. … 197 more files in changeset.
Refactored code for scheduling changes

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@354 123451ca-8445-de46-9d55-352943316053

    • -1
    • +1
    ./connectors/MToNHashPartitioningConnectorDescriptor.java
    • -1
    • +1
    ./connectors/MToNHashPartitioningMergingConnectorDescriptor.java
    • -1
    • +1
    ./connectors/MToNRangePartitioningConnectorDescriptor.java
    • -1
    • +1
    ./connectors/MToNReplicatingConnectorDescriptor.java
    • -1
    • +1
    ./connectors/OneToOneConnectorDescriptor.java
  1. … 59 more files in changeset.
Merged in trunk@304:314

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@317 123451ca-8445-de46-9d55-352943316053

    • -0
    • +46
    ./aggregators/CountAggregatorFactory.java
    • -0
    • +135
    ./aggregators/FloatSumAggregatorFactory.java
    • -0
    • +2
    ./aggregators/IFieldValueResultingAggregatorFactory.java
    • -0
    • +48
    ./aggregators/ISpillableFieldValueResultingAggregator.java
    • -0
    • +137
    ./aggregators/MinMaxAggregatorFactory.java
    • -5
    • +95
    ./aggregators/MultiAggregatorFactory.java
    • -0
    • +134
    ./aggregators/SumAggregatorFactory.java
    • -0
    • +136
    ./file/PlainFileWriterOperatorDescriptor.java
    • -0
    • +692
    ./group/ExternalHashGroupOperatorDescriptor.java
    • -0
    • +3
    ./group/IAccumulatingAggregatorFactory.java
    • -0
    • +40
    ./group/ISpillableAccumulatingAggregator.java
    • -0
    • +569
    ./group/SpillableGroupingHashTable.java
  1. … 3 more files in changeset.
Fixed the code format based on the Hyracks code format profile.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_spilling_groupby@309 123451ca-8445-de46-9d55-352943316053

    • -34
    • +38
    ./aggregators/CountAggregatorFactory.java
    • -114
    • +102
    ./aggregators/FloatSumAggregatorFactory.java
    • -1
    • +1
    ./aggregators/IFieldValueResultingAggregatorFactory.java
    • -24
    • +21
    ./aggregators/ISpillableFieldValueResultingAggregator.java
    • -118
    • +106
    ./aggregators/MinMaxAggregatorFactory.java
    • -166
    • +145
    ./aggregators/MultiAggregatorFactory.java
    • -112
    • +100
    ./aggregators/SumAggregatorFactory.java
    • -96
    • +89
    ./file/PlainFileWriterOperatorDescriptor.java
    • -708
    • +632
    ./group/ExternalHashGroupOperatorDescriptor.java
    • -6
    • +4
    ./group/IAccumulatingAggregatorFactory.java
    • -15
    • +11
    ./group/ISpillableAccumulatingAggregator.java
    • -543
    • +528
    ./group/SpillableGroupingHashTable.java
  1. … 2 more files in changeset.
Added external hash group operator. Main changes include: - added external hash group operator and its helper hash table class, and test cases; - modified aggregator factories to support external group operator; - added some aggregators (min/max, sum); - added a plain file writer to output plain text onto disk.

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_spilling_groupby@301 123451ca-8445-de46-9d55-352943316053

    • -0
    • +42
    ./aggregators/CountAggregatorFactory.java
    • -0
    • +147
    ./aggregators/FloatSumAggregatorFactory.java
    • -0
    • +2
    ./aggregators/IFieldValueResultingAggregatorFactory.java
    • -0
    • +51
    ./aggregators/ISpillableFieldValueResultingAggregator.java
    • -0
    • +149
    ./aggregators/MinMaxAggregatorFactory.java
    • -56
    • +167
    ./aggregators/MultiAggregatorFactory.java
    • -0
    • +146
    ./aggregators/SumAggregatorFactory.java
    • -0
    • +143
    ./file/PlainFileWriterOperatorDescriptor.java
    • -0
    • +768
    ./group/ExternalHashGroupOperatorDescriptor.java
    • -2
    • +7
    ./group/IAccumulatingAggregatorFactory.java
    • -0
    • +44
    ./group/ISpillableAccumulatingAggregator.java
    • -0
    • +584
    ./group/SpillableGroupingHashTable.java
  1. … 3 more files in changeset.
Added new scheduler. Temporarily disabled build of compat layer pending some changes

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_scheduling@299 123451ca-8445-de46-9d55-352943316053

    • -0
    • +7
    ./base/AbstractConnectorDescriptor.java
    • -13
    • +6
    ./base/AbstractOperatorDescriptor.java
    • -0
    • +16
    ./connectors/OneToOneConnectorDescriptor.java
  1. … 123 more files in changeset.
Merged r289:290 from the hyracks_io_management branch

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@291 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./aggregators/MultiAggregatorFactory.java
    • -3
    • +3
    ./connectors/MToNHashPartitioningConnectorDescriptor.java
    • -3
    • +3
    ./connectors/MToNHashPartitioningMergingConnectorDescriptor.java
    • -7
    • +7
    ./connectors/MToNRangePartitioningConnectorDescriptor.java
    • -3
    • +3
    ./connectors/MToNReplicatingConnectorDescriptor.java
    • -3
    • +3
    ./connectors/OneToOneConnectorDescriptor.java
    • -3
    • +3
    ./file/AbstractDeserializedFileScanOperatorDescriptor.java
    • -4
    • +2
    ./file/AbstractFileWriteOperatorDescriptor.java
    • -4
    • +4
    ./file/DelimitedDataTupleParserFactory.java
    • -3
    • +3
    ./file/FileScanOperatorDescriptor.java
    • -3
    • +3
    ./file/FrameFileWriterOperatorDescriptor.java
    • -32
    • +21
    ./file/LineFileWriteOperatorDescriptor.java
  1. … 174 more files in changeset.
Merged 249:266 from trunk

git-svn-id: https://hyracks.googlecode.com/svn/branches/hyracks_storage_cleanup@267 123451ca-8445-de46-9d55-352943316053

  1. … 3 more files in changeset.
Minor change in comparison loop

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@256 123451ca-8445-de46-9d55-352943316053

Merged 229:231 from hyracks_online_aggregation branch

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@233 123451ca-8445-de46-9d55-352943316053

    • -68
    • +8
    ./group/PreclusteredGroupOperatorDescriptor.java
    • -0
    • +130
    ./group/PreclusteredGroupWriter.java
  1. … 6 more files in changeset.
Fixed bug when sorting empty input

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@227 123451ca-8445-de46-9d55-352943316053

Merged online_aggregation @186:220

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@221 123451ca-8445-de46-9d55-352943316053

    • -326
    • +14
    ./sort/ExternalSortOperatorDescriptor.java
    • -0
    • +100
    ./sort/ExternalSortRunGenerator.java
    • -0
    • +236
    ./sort/ExternalSortRunMerger.java
    • -0
    • +59
    ./sort/RunFileReader.java
    • -0
    • +77
    ./sort/RunFileWriter.java
  1. … 30 more files in changeset.
Currently FileSplit stores java.io.file as a field and the host housing the file as a string. This is appropriate for a local file system but not for HDFS. The path contained inside the file type is incorrectly normalized. FileSplit should be constructed just from the node and the file path. Added field path (String) to FileSplit.

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@183 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./file/AbstractFileWriteOperatorDescriptor.java
    • -2
    • +2
    ./file/LineFileWriteOperatorDescriptor.java
Fixed dropped tuples bug in HHJ

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@179 123451ca-8445-de46-9d55-352943316053

    • -13
    • +9
    ./join/HybridHashJoinOperatorDescriptor.java
checking in bug fix in PreClustered Group operator. The close on aggregate was not being called that prevented reducer from closing

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@178 123451ca-8445-de46-9d55-352943316053

    • -87
    • +94
    ./group/DeserializedPreclusteredGroupOperator.java
Added missing abstract class

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@166 123451ca-8445-de46-9d55-352943316053

    • -0
    • +10
    ./base/AbstractOperatorNodePushable.java
Added more descriptive information to operator start/finish logs

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@164 123451ca-8445-de46-9d55-352943316053

    • -2
    • +2
    ./base/AbstractUnaryInputOperatorNodePushable.java
    • -2
    • +1
    ./base/AbstractUnaryOutputOperatorNodePushable.java
    • -0
    • +5
    ./util/DeserializedOperatorNodePushable.java
  1. … 4 more files in changeset.
Fixed ExternalSortOperatorDescriptor to work correctly on empty input

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@158 123451ca-8445-de46-9d55-352943316053

    • -1
    • +3
    ./sort/ExternalSortOperatorDescriptor.java
Fixed external sort flush/reset sequence. Fixed FrameSorter buffer length. Added normalized key to external sort in Word count example

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@149 123451ca-8445-de46-9d55-352943316053

    • -1
    • +1
    ./sort/ExternalSortOperatorDescriptor.java
  1. … 1 more file in changeset.
Optimized in-memory sorting. Added Eclipse project files

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@148 123451ca-8445-de46-9d55-352943316053

    • -192
    • +40
    ./sort/ExternalSortOperatorDescriptor.java
    • -0
    • +257
    ./sort/FrameSorter.java
    • -153
    • +19
    ./sort/InMemorySortOperatorDescriptor.java
    • -0
    • +107
    ./util/SelectionTree.java
  1. … 32 more files in changeset.
createAggregator() throws HyracksDataException.

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@147 123451ca-8445-de46-9d55-352943316053

    • -1
    • +2
    ./group/IAccumulatingAggregatorFactory.java
    • -1
    • +1
    ./group/PreclusteredGroupOperatorDescriptor.java
Added Nick's patch that provides IHyracksContext to createAggregator().

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@146 123451ca-8445-de46-9d55-352943316053

    • -1
    • +2
    ./aggregators/MultiAggregatorFactory.java
    • -1
    • +3
    ./group/IAccumulatingAggregatorFactory.java
    • -1
    • +1
    ./group/PreclusteredGroupOperatorDescriptor.java
Fixed file handle leaks

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@141 123451ca-8445-de46-9d55-352943316053

    • -46
    • +57
    ./sort/ExternalSortOperatorDescriptor.java