Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Move Hyracks to subfolder

    • -403
    • +0
    ./org/apache/hyracks/control/cc/job/JobRun.java
  1. … 4413 more files in changeset.
Misc. Coverity Issues

Clean up a few issues encountered in Coverity scan

Change-Id: Ie90a91682ae0ee2443fce1677fca0e00fa45c5f0

Reviewed-on: https://asterix-gerrit.ics.uci.edu/686

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 6 more files in changeset.
Remove Trailing White Spaces

This change removes all trailing white spaces in

java files in hyracks

Change-Id: I1c2ea4ff1190a965a857c0c3760cbebdf21860b3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/645

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <michael.blow@couchbase.com>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

  1. … 643 more files in changeset.
Fixed a Bug in the Register Node Work

When registering a node, in order to allow multiple nodes to

share an ip address, we store them in a map <ipaddress,List<nodeNames>>

However, the way we check for the existence of an entry had a bug in it

which causes the entry to never be found.

Change-Id: I39273c2d72cee0f85187febc9a2b1a6086181e66

Reviewed-on: https://asterix-gerrit.ics.uci.edu/624

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Ian Maxon <imaxon@apache.org>

remove end-of-line whitespace

Change-Id: If3542874d7f3a536a6fe524aba2fffaf6447a614

Reviewed-on: https://asterix-gerrit.ics.uci.edu/600

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 252 more files in changeset.
Changes required to support MessageBroker implementation

This change includes the following:

- API changes to support MessageBroker implementation.

- IResourceIdFactory interface to support application dependent implementation.

Change-Id: Ib9f49234eebe912c48e7f71980433a9b42595741

Reviewed-on: https://asterix-gerrit.ics.uci.edu/485

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 18 more files in changeset.
Make LSM bulkload append-only and write-once.

Allows for usage of LSM indexes with underlying storage that is append-only.

This also results in a small improvement for LSM component bulk load speed.

- Tree metadata (filters, etc) now lie at the back of the tree file in

append-only mode.

-- Note that you should *not* ever give the append-only flag on bulk-load,

if the tree is ever to be modified in place.

- Append-only operations bypass the buffer cache for writes, but utilize

the buffer cache for memory allocation and reads.

- Addresses ASTERIXDB-1059

Change-Id: I80fb891b5310252143854a336b591bf3f8cd4ba7

Reviewed-on: https://asterix-gerrit.ics.uci.edu/255

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Young-Seok Kim <kisskys@gmail.com>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

  1. … 97 more files in changeset.
This change fixes the sporadic connection refused errors after managix starts up an Asterix instance. This can mostly be seen during asterix-installer tests. The fix basically lets managix wait and listens through zookeeper for a signal from the cluster controller. Once the cluster controller sends the signal, Managix can proceed.

Change-Id: I0975308e1dc2650d8c2e50d58ff2c696b22eaaa4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/365

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 1 more file in changeset.
Set the priority of the following threads to be Thread.MAX_PRIORITY: 1. heartbeat thread at NC 2. IPC network thread 3. work queue thread in CC

Change-Id: I4e53a85e21a6bdee48a3ca8d004569700f911fbd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/389

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 5 more files in changeset.
Change license headers

Change-Id: I98b18f24a20dcd8dc75e828e47fb0ab88179a5be

Reviewed-on: https://asterix-gerrit.ics.uci.edu/386

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -12
    • +16
    ./org/apache/hyracks/control/cc/CCDriver.java
    • -12
    • +16
    ./org/apache/hyracks/control/cc/job/ActivityPlan.java
    • -12
    • +16
    ./org/apache/hyracks/control/cc/job/JobRun.java
  1. … 2055 more files in changeset.
Change folder structure for Java repackage

Change only the folders, not the files, for our package name change.

This will break the build, and needs to be followed by a change to

the package name in all of the source files. However performing

the folder move and file change in two steps lets Git understand

that the files are the same, and lets us track revisions across

those files.

Change-Id: I08aff75e25ac7c6298c32cf3402febbc4a318c2a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/307

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -399
    • +0
    ./edu/uci/ics/hyracks/control/cc/job/JobRun.java
  1. … 3879 more files in changeset.
Change Java package from edu.uci.ics to org.apache

Change-Id: I99172d856e88954b00cf7cfb24d33bb400f53994

Reviewed-on: https://asterix-gerrit.ics.uci.edu/308

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -22
    • +22
    ./org/apache/hyracks/control/cc/job/JobRun.java
  1. … 2019 more files in changeset.
Add Apache RAT License Auditor plugin, and fix missing licenses

Change-Id: I39d92ec6654c73b4e6b8ba76dd66770bb60c7b79

Reviewed-on: https://asterix-gerrit.ics.uci.edu/260

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

Reviewed-by: Till Westmann <tillw@apache.org>

  1. … 30 more files in changeset.
Adding hash join logging comments.

commit 513c3a7899dc64af3c3cdec96fad9093a4ca2c5f

Merge: b27e9b5 82609d9

Author: Eldon Carman <ecarm002@ucr.edu>

Date: Thu Feb 5 12:47:52 2015 -0800

Adding hash join logging comments.

Change-Id: Iade2c53436e5ae82c31305d6f618c780cd72568b

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/219

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Pouria Pirzadeh <pouria.pirzadeh@gmail.com>

  1. … 6 more files in changeset.
Add ability to configure network ports for NCs and CC.

This includes the ability to specify different "public" ports, for situations

when a node is behind a NAT firewall.

Also eliminate IP check for data and dataset network addresses, which

should allow DNS names to be used as well.

Some internal cleanup regarding handling network addresses.

Change-Id: I9947fe3cec59daef3458cdc14d33c9353449da27

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/204

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Ian Maxon <imaxon@uci.edu>

  1. … 24 more files in changeset.
Add Shutdown via API to Hyracks

This change adds a method to HyracksConnection called stopCluster().

When the CC recieves a message from this, it asks all NC tasks to close

and acknowledge that they have recieved the message and are closing.

If all NCs have closed, or a 10 second timeout elapses, the CC then

exits with a 0 return code if all NCs closed, or a 1 if some did

not acknowledge the shutdown request.

Change-Id: Iaf3d395dc7964e114d4929830f40063f58e0d5da

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/76

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Vinayak Borkar <vinayakb@gmail.com>

    • -0
    • +102
    ./edu/uci/ics/hyracks/control/cc/work/ClusterShutdownWork.java
    • -0
    • +47
    ./edu/uci/ics/hyracks/control/cc/work/NotifyShutdownWork.java
  1. … 21 more files in changeset.
Several major changes in hyracks: -- reduced CC/NC communications for reporting partition request and availability; partition request/availability are only reported for the case of send-side materialized (without pipelining) policies in case of task re-attempt. -- changed buffer cache to dynamically allocate memory based on needs instead of pre-allocating -- changed each network channel to lazily allocate memory based on needs, and changed materialized connectors to lazily allocate files based on needs -- changed several major CCNCCFunctions to use non-java serde -- added a sort-based group-by operator which pushes group-by aggregations into an external sort -- make external sort a stable sort

1,3,and 4 is to reduce the job overhead.

2 is to reduce the unecessary NC resource consumptions such as memory and files.

5 and 6 are improvements to runtime operators.

One change in algebricks:

-- implemented a rule to push group-by aggregation into sort, i.e., using the sort-based gby operator

Several important changes in pregelix:

-- remove static states in vertex

-- direct check halt bit without deserialization

-- optimize the sort algorithm by packing yet-another 2-byte normalized key into the tPointers array

Change-Id: Id696f9a9f1647b4a025b8b33d20b3a89127c60d6

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/35

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 273 more files in changeset.
reduced communication during result distribution - when reporting the location of results, the NCs also report if the result partition is empty - the client does not try to read empty partitions better toString() for subclasses of AbstractWork

Change-Id: Ia39f657e689ea305d49d55bd27c9a512e1ff970f

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/39

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 12 more files in changeset.
start WorkQueue at the end of CC startup - should avoid issues like https://code.google.com/p/asterixdb/issues/detail?id=758

Change-Id: I209217ac1e923e7d2a22b6944c873236c62ef13b

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/38

Reviewed-by: Zachary Heilbron <zheilbron@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Raman Grover <ramang@uci.edu>

  1. … 1 more file in changeset.
Merge branch 'master' into zheilbron/hyracks_msr_demo

formatting

  1. … 3 more files in changeset.
removed unnecessary fields in JobInfo

  1. … 1 more file in changeset.
add I/O counter

  1. … 7 more files in changeset.
added ability to trigger an application state dump through the rest api

    • -0
    • +33
    ./edu/uci/ics/hyracks/control/cc/web/StateDumpRESTAPIFunction.java
    • -0
    • +84
    ./edu/uci/ics/hyracks/control/cc/work/GatherStateDumpsWork.java
    • -0
    • +27
    ./edu/uci/ics/hyracks/control/cc/work/NotifyStateDumpResponse.java
  1. … 17 more files in changeset.
changes to tracked locations assigned to an operator for each partition

  1. … 1 more file in changeset.
minor fix for heartbeat state population

Merge remote-tracking branch 'origin/raman/master_feeds' into zheilbron/hyracks_msr_demo

Conflicts:

hyracks/hyracks-control/hyracks-control-cc/src/main/java/edu/uci/ics/hyracks/control/cc/job/JobRun.java

hyracks/hyracks-storage-am-common/src/main/java/edu/uci/ics/hyracks/storage/am/common/impls/AbstractTreeIndex.java

  1. … 3 more files in changeset.
merge from master

    • -2
    • +11
    ./edu/uci/ics/hyracks/control/cc/job/JobRun.java
address Vinayak's code review comments

  1. … 8 more files in changeset.
reformat NodeControllerState.java