Clone Tools
  • last updated 11 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Change folder structure for Java repackage

Change only the folders, not the files, for our package name change.

This will break the build, and needs to be followed by a change to

the package name in all of the source files. However performing

the folder move and file change in two steps lets Git understand

that the files are the same, and lets us track revisions across

those files.

Change-Id: I08aff75e25ac7c6298c32cf3402febbc4a318c2a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/307

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -53
    • +0
    ./HyracksDatasetDirectoryServiceConnection.java
    • -51
    • +0
    ./HyracksDatasetDirectoryServiceInterfaceRemoteProxy.java
  1. … 3889 more files in changeset.
VariableSizeFrame(VSizeFrame) support for Hyracks.

This patch replaced Frame/Accessor/Appender with the new API which

supports BigObject.

The ExternalSorter/TopKSorter/ExternalGroupSorter

have been implemented to support big object.

The Groupby && Join should work with BigObject also. But it will break the

memory budget when it encounter a big object. I will fix the memory

problem later in a separate CR.

The design about the frame allocation is

here:https://docs.google.com/presentation/d/15h9iQf5OYsgGZoQTbGHkj1yS2G9q2fd0s1lDAD1EJq0/edit?usp=sharing

Suggest review order:

Patch 12: It includes all of the sorting operators.

Patch 13: It applys the new IFrame API to all Hyracks codes.

Patch 14: Some bug fixes to pass all Asterix's tests.

Patch 15: Skip it!

Patch 16: Some bug fixes to the Asterix's tests in small frame setting.

Later Patch: address the comments

Change-Id: I2e08692078683f6f2cf17387e39037ad851fc05b

Reviewed-on: https://asterix-gerrit.ics.uci.edu/234

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 218 more files in changeset.
Add ability to configure network ports for NCs and CC.

This includes the ability to specify different "public" ports, for situations

when a node is behind a NAT firewall.

Also eliminate IP check for data and dataset network addresses, which

should allow DNS names to be used as well.

Some internal cleanup regarding handling network addresses.

Change-Id: I9947fe3cec59daef3458cdc14d33c9353449da27

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/204

Reviewed-by: Ian Maxon <imaxon@uci.edu>

Tested-by: Ian Maxon <imaxon@uci.edu>

  1. … 25 more files in changeset.
reduced communication during result distribution - when reporting the location of results, the NCs also report if the result partition is empty - the client does not try to read empty partitions better toString() for subclasses of AbstractWork

Change-Id: Ia39f657e689ea305d49d55bd27c9a512e1ff970f

Reviewed-on: http://fulliautomatix.ics.uci.edu:8443/39

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 24 more files in changeset.
Merge branch 'master' into pouria/fix-memory

Conflicts:

hyracks/hyracks-api/src/main/java/edu/uci/ics/hyracks/api/context/IHyracksCommonContext.java

hyracks/hyracks-client/src/main/java/edu/uci/ics/hyracks/client/dataset/DatasetClientContext.java

hyracks/hyracks-storage-am-lsm-invertedindex/src/main/java/edu/uci/ics/hyracks/storage/am/lsm/invertedindex/ondisk/OnDiskInvertedIndex.java

hyracks/hyracks-test-support/src/main/java/edu/uci/ics/hyracks/test/support/TestTaskContext.java

  1. … 3 more files in changeset.
Fixing Methods signature

  1. … 3 more files in changeset.
changes for memory management

  1. … 5 more files in changeset.
try to fix memory leak issue

  1. … 7 more files in changeset.
merge from zheilbron/hyracks_msr

  1. … 291 more files in changeset.
Swap the order of monitor registration with the TCP channel.

Monitor should be registered before the channel is opened because

channel can start recieving data as soon as it is opened. So not

having a monitor when the channel is opened is disastrous.

add/update license headers

    • -1
    • +1
    ./HyracksDatasetDirectoryServiceConnection.java
    • -1
    • +1
    ./HyracksDatasetDirectoryServiceInterfaceRemoteProxy.java
  1. … 2283 more files in changeset.
Merge master to madhusudancs/error-reporting.

  1. … 7 more files in changeset.
Read results for each result set id.

  1. … 5 more files in changeset.
When the job fails, give up fetching result locations.

Propagate the actual exceptions thrown in the NCs to the CC and to the client via the API or WebUI.

  1. … 12 more files in changeset.
Propagate the exception that is thrown while trying to read the result location, the job might have failed.

Fix the job result status to use the job level status enum type.

    • -1
    • +1
    ./HyracksDatasetDirectoryServiceConnection.java
    • -1
    • +1
    ./HyracksDatasetDirectoryServiceInterfaceRemoteProxy.java
  1. … 3 more files in changeset.
Merged fullstack_lsm_staging upto r3336

git-svn-id: https://hyracks.googlecode.com/svn/trunk/fullstack@3339 123451ca-8445-de46-9d55-352943316053

  1. … 898 more files in changeset.
Add additional checks to make sure we do not bail out of reading when frames are still available but socket EOS has been reached.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_rsd_fixes@3310 123451ca-8445-de46-9d55-352943316053

  1. … 1 more file in changeset.
cross merge fullstack_release_candidate into trunk

git-svn-id: https://hyracks.googlecode.com/svn/trunk/fullstack@3208 123451ca-8445-de46-9d55-352943316053

    • -0
    • +53
    ./HyracksDatasetDirectoryServiceConnection.java
    • -0
    • +51
    ./HyracksDatasetDirectoryServiceInterfaceRemoteProxy.java
  1. … 898 more files in changeset.
Merged fullstack_asterix_stabilization -r 2933:3157

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_ioc@3164 123451ca-8445-de46-9d55-352943316053

    • -0
    • +53
    ./HyracksDatasetDirectoryServiceConnection.java
    • -0
    • +51
    ./HyracksDatasetDirectoryServiceInterfaceRemoteProxy.java
  1. … 1163 more files in changeset.
Separate the result reader out of the client class which sets up connection.

It is sufficient to have only one interface connection to read any number of

results. Creating a new client interface connection every time for RPC creates

new ByteBuffers for network layer communication which leads to memory leak on

the CC there by leading OutOfMemory exception on the CC. Separating the connection

and reader out and making a connection only once and asking it to create the

reader for every job resolves this problem and also the most sensible solution.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@3054 123451ca-8445-de46-9d55-352943316053

    • -0
    • +255
    ./HyracksDatasetReader.java
  1. … 2 more files in changeset.
Reverting the merge of fullstack_hyracks_result_distribution branch until all the tests pass.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_asterix_stabilization@3033 123451ca-8445-de46-9d55-352943316053

    • -53
    • +0
    ./HyracksDatasetDirectoryServiceConnection.java
    • -51
    • +0
    ./HyracksDatasetDirectoryServiceInterfaceRemoteProxy.java
  1. … 134 more files in changeset.
Decrement the number of available frames after each read and check for the available frames count each time.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@2983 123451ca-8445-de46-9d55-352943316053

  1. … 1 more file in changeset.
Remove the usage of serialized descriptor.

We do not have the necessity to pass the serialized record descriptor to

clients, so there is no need to pass it to DatasetDirectoryService to

store it in the record since we serialize all the results in the Hyracks

operator before sending the results now.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@2978 123451ca-8445-de46-9d55-352943316053

    • -5
    • +0
    ./HyracksDatasetDirectoryServiceConnection.java
    • -7
    • +0
    ./HyracksDatasetDirectoryServiceInterfaceRemoteProxy.java
  1. … 14 more files in changeset.
Remove unnecessary suffix "Function" from the method a couple of get method names.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@2843 123451ca-8445-de46-9d55-352943316053

    • -3
    • +3
    ./HyracksDatasetDirectoryServiceConnection.java
    • -2
    • +9
    ./HyracksDatasetDirectoryServiceInterfaceRemoteProxy.java
  1. … 2 more files in changeset.
Implement the client side of the RPC chain to fetch the job status from the client.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@2842 123451ca-8445-de46-9d55-352943316053

    • -0
    • +6
    ./HyracksDatasetDirectoryServiceConnection.java
    • -0
    • +1
    ./HyracksDatasetDirectoryServiceInterfaceRemoteProxy.java
  1. … 8 more files in changeset.
Remove the unnecessary wait for getting the monitors since the client architecture has changed.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@2839 123451ca-8445-de46-9d55-352943316053

Completely rewrite the HyracksDataset client API class to use the new serializer and fetch the records buffer by before.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@2835 123451ca-8445-de46-9d55-352943316053

  1. … 1 more file in changeset.
Implement the client side of RPCs to give the clients the ability to retrieve serialized record descriptor.

git-svn-id: https://hyracks.googlecode.com/svn/branches/fullstack_hyracks_result_distribution@2831 123451ca-8445-de46-9d55-352943316053

    • -0
    • +5
    ./HyracksDatasetDirectoryServiceConnection.java
    • -0
    • +7
    ./HyracksDatasetDirectoryServiceInterfaceRemoteProxy.java
  1. … 6 more files in changeset.