Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Move Pregelix and Hivesterix codebase to new repositories: 1. Move Pregelix codebase to https://github.com/pregelix/pregelix; 2. Move Hivesterix codebase to https://code.google.com/p/hivesterix .

Change-Id: Iede698fcb92a0ad0a7a4918ea69b54886fd64fc7

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/155

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@uci.edu>

    • -47
    • +0
    ./RawNormalizedKeyComputerFactory.java
    • -46
    • +0
    ./WritableComparingBinaryComparatorFactory.java
    • -47
    • +0
    ./WritableRecordDescriptorFactory.java
  1. … 954 more files in changeset.
Several major changes in hyracks: -- reduced CC/NC communications for reporting partition request and availability; partition request/availability are only reported for the case of send-side materialized (without pipelining) policies in case of task re-attempt. -- changed buffer cache to dynamically allocate memory based on needs instead of pre-allocating -- changed each network channel to lazily allocate memory based on needs, and changed materialized connectors to lazily allocate files based on needs -- changed several major CCNCCFunctions to use non-java serde -- added a sort-based group-by operator which pushes group-by aggregations into an external sort -- make external sort a stable sort

1,3,and 4 is to reduce the job overhead.

2 is to reduce the unecessary NC resource consumptions such as memory and files.

5 and 6 are improvements to runtime operators.

One change in algebricks:

-- implemented a rule to push group-by aggregation into sort, i.e., using the sort-based gby operator

Several important changes in pregelix:

-- remove static states in vertex

-- direct check halt bit without deserialization

-- optimize the sort algorithm by packing yet-another 2-byte normalized key into the tPointers array

Change-Id: Id696f9a9f1647b4a025b8b33d20b3a89127c60d6

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/35

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

    • -0
    • +3
    ./WritableComparingBinaryComparatorFactory.java
    • -3
    • +2
    ./WritableRecordDescriptorFactory.java
  1. … 274 more files in changeset.
fix file write race condition

    • -2
    • +9
    ./WritableRecordDescriptorFactory.java
  1. … 23 more files in changeset.
fix raw binary comparator

    • -0
    • +46
    ./RawBinaryComparatorFactory.java
    • -12
    • +6
    ./RawNormalizedKeyComputerFactory.java
  1. … 6 more files in changeset.
fix raw normalized key computer

    • -3
    • +14
    ./RawNormalizedKeyComputerFactory.java
use raw binary comparator internally for pregelix

    • -0
    • +42
    ./RawNormalizedKeyComputerFactory.java
  1. … 7 more files in changeset.
add/update license headers

    • -1
    • +1
    ./WritableComparingBinaryComparatorFactory.java
    • -3
    • +3
    ./WritableRecordDescriptorFactory.java
  1. … 2286 more files in changeset.
reintegrate fullstack_dynamic_deployment

    • -2
    • +3
    ./WritableRecordDescriptorFactory.java
  1. … 203 more files in changeset.
update copyright header for pregelix source code

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_staging@1993 123451ca-8445-de46-9d55-352943316053

    • -0
    • +15
    ./WritableComparingBinaryComparatorFactory.java
  1. … 54 more files in changeset.
remove dependencies on hadoop-compat

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_staging@1988 123451ca-8445-de46-9d55-352943316053

    • -0
    • +28
    ./WritableComparingBinaryComparatorFactory.java
  1. … 14 more files in changeset.
add Pregelix codebase

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_staging@1960 123451ca-8445-de46-9d55-352943316053

    • -0
    • +40
    ./WritableRecordDescriptorFactory.java
  1. … 195 more files in changeset.