Clone Tools
  • last updated 20 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Change folder structure for Java repackage

Change only the folders, not the files, for our package name change.

This will break the build, and needs to be followed by a change to

the package name in all of the source files. However performing

the folder move and file change in two steps lets Git understand

that the files are the same, and lets us track revisions across

those files.

Change-Id: I08aff75e25ac7c6298c32cf3402febbc4a318c2a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/307

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -153
    • +0
    ./ClusterControllerRemoteProxy.java
  1. … 3891 more files in changeset.
Add ability to configure network ports for NCs and CC.

This includes the ability to specify different "public" ports, for situations

when a node is behind a NAT firewall.

Also eliminate IP check for data and dataset network addresses, which

should allow DNS names to be used as well.

Some internal cleanup regarding handling network addresses.

Change-Id: I9947fe3cec59daef3458cdc14d33c9353449da27

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/204

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Ian Maxon <imaxon@uci.edu>

  1. … 26 more files in changeset.
Add Shutdown via API to Hyracks

This change adds a method to HyracksConnection called stopCluster().

When the CC recieves a message from this, it asks all NC tasks to close

and acknowledge that they have recieved the message and are closing.

If all NCs have closed, or a 10 second timeout elapses, the CC then

exits with a 0 return code if all NCs closed, or a 1 if some did

not acknowledge the shutdown request.

Change-Id: Iaf3d395dc7964e114d4929830f40063f58e0d5da

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/76

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Vinayak Borkar <vinayakb@gmail.com>

  1. … 21 more files in changeset.
Several major changes in hyracks: -- reduced CC/NC communications for reporting partition request and availability; partition request/availability are only reported for the case of send-side materialized (without pipelining) policies in case of task re-attempt. -- changed buffer cache to dynamically allocate memory based on needs instead of pre-allocating -- changed each network channel to lazily allocate memory based on needs, and changed materialized connectors to lazily allocate files based on needs -- changed several major CCNCCFunctions to use non-java serde -- added a sort-based group-by operator which pushes group-by aggregations into an external sort -- make external sort a stable sort

1,3,and 4 is to reduce the job overhead.

2 is to reduce the unecessary NC resource consumptions such as memory and files.

5 and 6 are improvements to runtime operators.

One change in algebricks:

-- implemented a rule to push group-by aggregation into sort, i.e., using the sort-based gby operator

Several important changes in pregelix:

-- remove static states in vertex

-- direct check halt bit without deserialization

-- optimize the sort algorithm by packing yet-another 2-byte normalized key into the tPointers array

Change-Id: Id696f9a9f1647b4a025b8b33d20b3a89127c60d6

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/35

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <westmann@gmail.com>

  1. … 276 more files in changeset.
reduced communication during result distribution - when reporting the location of results, the NCs also report if the result partition is empty - the client does not try to read empty partitions better toString() for subclasses of AbstractWork

Change-Id: Ia39f657e689ea305d49d55bd27c9a512e1ff970f

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/39

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 23 more files in changeset.
added ability to trigger an application state dump through the rest api

  1. … 19 more files in changeset.
add/update license headers

  1. … 2285 more files in changeset.
Merge master to madhusudancs/error-reporting.

    • -5
    • +16
    ./ClusterControllerRemoteProxy.java
  1. … 7 more files in changeset.
Changed error reporting to return exceptions that were responsible for Job termination

  1. … 11 more files in changeset.
reintegrate fullstack_dynamic_deployment

    • -2
    • +13
    ./ClusterControllerRemoteProxy.java
  1. … 201 more files in changeset.
Propagate the actual exceptions thrown in the NCs to the CC and to the client via the API or WebUI.

  1. … 11 more files in changeset.
Merged fullstack_lsm_staging upto r3336

git-svn-id: https://hyracks.googlecode.com/svn/trunk/fullstack@3339 123451ca-8445-de46-9d55-352943316053

    • -15
    • +5
    ./ClusterControllerRemoteProxy.java
  1. … 896 more files in changeset.
cross merge fullstack_release_candidate into trunk

git-svn-id: https://hyracks.googlecode.com/svn/trunk/fullstack@3208 123451ca-8445-de46-9d55-352943316053

    • -0
    • +24
    ./ClusterControllerRemoteProxy.java
  1. … 901 more files in changeset.
Merge fullstack_asterix_stabilization with fullstack_hyracks_result_distribution.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3170 123451ca-8445-de46-9d55-352943316053

    • -15
    • +5
    ./ClusterControllerRemoteProxy.java
  1. … 188 more files in changeset.
Merged fullstack_asterix_stabilization -r 2933:3157

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_ioc@3164 123451ca-8445-de46-9d55-352943316053

    • -0
    • +23
    ./ClusterControllerRemoteProxy.java
  1. … 1166 more files in changeset.
Reverting the merge of fullstack_hyracks_result_distribution branch until all the tests pass.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_asterix_stabilization@3033 123451ca-8445-de46-9d55-352943316053

    • -24
    • +0
    ./ClusterControllerRemoteProxy.java
  1. … 136 more files in changeset.
Fix the tests and code to support server side serialization.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@2982 123451ca-8445-de46-9d55-352943316053

  1. … 2 more files in changeset.
Remove the usage of serialized descriptor.

We do not have the necessity to pass the serialized record descriptor to

clients, so there is no need to pass it to DatasetDirectoryService to

store it in the record since we serialize all the results in the Hyracks

operator before sending the results now.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@2978 123451ca-8445-de46-9d55-352943316053

  1. … 16 more files in changeset.
Implement support for determining and reporting job status.

The job status can be one of RUNNING, FAILED, SUCCESS and they are

determined and reported appropriately.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@2841 123451ca-8445-de46-9d55-352943316053

    • -0
    • +14
    ./ClusterControllerRemoteProxy.java
  1. … 9 more files in changeset.
Pass the serialized record descriptor all the way upto dataset directory service in the RPC chain.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@2829 123451ca-8445-de46-9d55-352943316053

  1. … 3 more files in changeset.
Add a parameter for the ResultWriterOperatorDescriptor to support ordered result distribution.

Let this parameter percolate throughout the layers of indirection and the

network until it hits the dataset directory service.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@2547 123451ca-8445-de46-9d55-352943316053

  1. … 8 more files in changeset.
Add support for registering the result set id with the ResultWriterOperatorDescriptor.

Along with that pass the result set id information all through the stack to

register the partition address along with this result set id in the dataset

directory service.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@2533 123451ca-8445-de46-9d55-352943316053

  1. … 8 more files in changeset.
Connect the whole register result generating partition path from the NodeController through the ClusterController by implementing the necessary RPC interfaces.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@2476 123451ca-8445-de46-9d55-352943316053

  1. … 2 more files in changeset.
Eliminated Application deployment code. Eliminated hyracks-cli. Fixed hyracks examples to work with the new application model

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_ioc@2433 123451ca-8445-de46-9d55-352943316053

    • -11
    • +2
    ./ClusterControllerRemoteProxy.java
  1. … 107 more files in changeset.
Truncated old project trunks

git-svn-id: https://hyracks.googlecode.com/svn/trunk@2424 123451ca-8445-de46-9d55-352943316053

    • -109
    • +0
    ./ClusterControllerRemoteProxy.java
  1. … 1471 more files in changeset.
Merged hyracks_asterix_vldb_demo -r 1860:1862

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_staging@1971 123451ca-8445-de46-9d55-352943316053

  1. … 7 more files in changeset.
Copied hyracks trunk into fullstack

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_staging@1958 123451ca-8445-de46-9d55-352943316053

    • -0
    • +109
    ./ClusterControllerRemoteProxy.java
  1. … 1458 more files in changeset.
Merged hyracks_asterix_stabilization upto rev 1913

git-svn-id: https://hyracks.googlecode.com/svn/trunk@1924 123451ca-8445-de46-9d55-352943316053

    • -12
    • +14
    ./ClusterControllerRemoteProxy.java
  1. … 900 more files in changeset.
Merged hyracks_dev_next -r 1287 into trunk

git-svn-id: https://hyracks.googlecode.com/svn/trunk@1288 123451ca-8445-de46-9d55-352943316053

    • -0
    • +792
    ./CCNCFunctions.java
    • -0
    • +107
    ./ClusterControllerRemoteProxy.java
    • -0
    • +78
    ./NodeControllerRemoteProxy.java
  1. … 1442 more files in changeset.