Clone Tools
  • last updated 15 mins ago
Constraints: committers
Constraints: files
Constraints: dates
Add Apache RAT License Auditor plugin, and fix missing licenses

Change-Id: I39d92ec6654c73b4e6b8ba76dd66770bb60c7b79


Tested-by: Jenkins <>

Reviewed-by: Chris Hillery <>

Reviewed-by: Till Westmann <>

  1. … 26 more files in changeset.
Adding hash join logging comments.

commit 513c3a7899dc64af3c3cdec96fad9093a4ca2c5f

Merge: b27e9b5 82609d9

Author: Eldon Carman <>

Date: Thu Feb 5 12:47:52 2015 -0800

Adding hash join logging comments.

Change-Id: Iade2c53436e5ae82c31305d6f618c780cd72568b


Reviewed-by: Ian Maxon <>

Tested-by: Jenkins <>

Reviewed-by: Pouria Pirzadeh <>

  1. … 6 more files in changeset.
Add ability to configure network ports for NCs and CC.

This includes the ability to specify different "public" ports, for situations

when a node is behind a NAT firewall.

Also eliminate IP check for data and dataset network addresses, which

should allow DNS names to be used as well.

Some internal cleanup regarding handling network addresses.

Change-Id: I9947fe3cec59daef3458cdc14d33c9353449da27


Reviewed-by: Ian Maxon <>

Tested-by: Ian Maxon <>

  1. … 24 more files in changeset.
Add Shutdown via API to Hyracks

This change adds a method to HyracksConnection called stopCluster().

When the CC recieves a message from this, it asks all NC tasks to close

and acknowledge that they have recieved the message and are closing.

If all NCs have closed, or a 10 second timeout elapses, the CC then

exits with a 0 return code if all NCs closed, or a 1 if some did

not acknowledge the shutdown request.

Change-Id: Iaf3d395dc7964e114d4929830f40063f58e0d5da


Tested-by: Jenkins <>

Reviewed-by: Vinayak Borkar <>

  1. … 21 more files in changeset.
Several major changes in hyracks: -- reduced CC/NC communications for reporting partition request and availability; partition request/availability are only reported for the case of send-side materialized (without pipelining) policies in case of task re-attempt. -- changed buffer cache to dynamically allocate memory based on needs instead of pre-allocating -- changed each network channel to lazily allocate memory based on needs, and changed materialized connectors to lazily allocate files based on needs -- changed several major CCNCCFunctions to use non-java serde -- added a sort-based group-by operator which pushes group-by aggregations into an external sort -- make external sort a stable sort

1,3,and 4 is to reduce the job overhead.

2 is to reduce the unecessary NC resource consumptions such as memory and files.

5 and 6 are improvements to runtime operators.

One change in algebricks:

-- implemented a rule to push group-by aggregation into sort, i.e., using the sort-based gby operator

Several important changes in pregelix:

-- remove static states in vertex

-- direct check halt bit without deserialization

-- optimize the sort algorithm by packing yet-another 2-byte normalized key into the tPointers array

Change-Id: Id696f9a9f1647b4a025b8b33d20b3a89127c60d6


Tested-by: Jenkins <>

Reviewed-by: Till Westmann <>

  1. … 273 more files in changeset.
reduced communication during result distribution - when reporting the location of results, the NCs also report if the result partition is empty - the client does not try to read empty partitions better toString() for subclasses of AbstractWork

Change-Id: Ia39f657e689ea305d49d55bd27c9a512e1ff970f


Tested-by: Jenkins <>

Reviewed-by: Yingyi Bu <>

  1. … 12 more files in changeset.
start WorkQueue at the end of CC startup - should avoid issues like

Change-Id: I209217ac1e923e7d2a22b6944c873236c62ef13b


Reviewed-by: Zachary Heilbron <>

Tested-by: Jenkins <>

Reviewed-by: Raman Grover <>

  1. … 1 more file in changeset.
Merge branch 'master' into zheilbron/hyracks_msr_demo


  1. … 3 more files in changeset.
removed unnecessary fields in JobInfo

  1. … 1 more file in changeset.
add I/O counter

  1. … 7 more files in changeset.
added ability to trigger an application state dump through the rest api

  1. … 17 more files in changeset.
changes to tracked locations assigned to an operator for each partition

  1. … 1 more file in changeset.
minor fix for heartbeat state population

Merge remote-tracking branch 'origin/raman/master_feeds' into zheilbron/hyracks_msr_demo




  1. … 3 more files in changeset.
merge from master

address Vinayak's code review comments

  1. … 8 more files in changeset.

fix fault-tolerance and error reporting to handle disk failures

  1. … 30 more files in changeset.
notifyHeartbeat in some non-heartbeat events

  1. … 1 more file in changeset.
1. simply activity cluster planner for all-producers-to-all-consumers kind of connectors; 2. lower the NC task threads' priority

  1. … 7 more files in changeset.
1. fix the node failure scenario in job scheduler; 2. add fault-tolerance support and tests in pregelix

  1. … 19 more files in changeset.
Instead of adding stop commands to the running thread, this patch changes the thread to be a daemon thread.

  1. … 2 more files in changeset.
Merge branch 'master' into dev/hyracks_msr










  1. … 4 more files in changeset.
cleanup client error message propagation

  1. … 7 more files in changeset.
merge from zheilbron/hyracks_msr

  1. … 289 more files in changeset.
fix adminconsole index page

Add support for stopping the ResultStateSweeper thread in to the classes that create it.

  1. … 2 more files in changeset.
fix hyracks REST error printing

merge from master

  1. … 10 more files in changeset.