Clone Tools
  • last updated 10 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Fixed problem with closing writer

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@143 123451ca-8445-de46-9d55-352943316053

Fixed final flush problem

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@142 123451ca-8445-de46-9d55-352943316053

Fixed Split instantiation

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@140 123451ca-8445-de46-9d55-352943316053

Optimized Hadoop File Reader

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@136 123451ca-8445-de46-9d55-352943316053

    • -0
    • +53
    ./uci/ics/hyracks/dataflow/hadoop/util/InputSplitsProxy.java
  1. … 1 more file in changeset.
1) Writing Splits: Splits are written to a split file, eventually persisted in HDFS. Splits are re-initialized from the split file at the server side. This protocol is being adapted as custom implementations of input formats work with custom record readers and custom input split implementations. Hence to be generic and satisfying all custom implementations, we choose to serialize the splits metadata.

2) HadoopReadOperatorDescriptor has been revised to remove any dependency over the base class. The base class is now redundant.

3) DatatypeHelper : slight modification to use Map instead of HashMap in the method hashMap2jobConf().

4) HDFSWriteOperatorDescriptor : revised with simpler constructors that do not require client to configure output splits.

/home/raman/research/work/hyracks-trunk/hyracks/hyracks/hyracks-dataflow-hadoop

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@135 123451ca-8445-de46-9d55-352943316053

    • -0
    • +224
    ./uci/ics/hyracks/dataflow/hadoop/util/InputSplitHandler.java
Fixed erroneous retrieval of input record descriptor

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@134 123451ca-8445-de46-9d55-352943316053

Added Binary Preclustered Group Operator. Preclustered and Hash based group operators now use the same aggregator interface. Added a Frame Writing Operator.

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@132 123451ca-8445-de46-9d55-352943316053

  1. … 52 more files in changeset.
Renamed Map* to DeserializedMap*

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@73 123451ca-8445-de46-9d55-352943316053

  1. … 10 more files in changeset.
Removed getRegistry() calls from CC

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@67 123451ca-8445-de46-9d55-352943316053

  1. … 4 more files in changeset.
Refactored hadoop operators out of dataflow-std

git-svn-id: https://hyracks.googlecode.com/svn/trunk/hyracks@59 123451ca-8445-de46-9d55-352943316053

    • -0
    • +117
    ./uci/ics/hyracks/dataflow/hadoop/util/DatatypeHelper.java
  1. … 32 more files in changeset.