Clone Tools
  • last updated a few minutes ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Add Compatibility for FileRemoveOperatorDescriptor

Change-Id: Ic08ba645db6936df3c4c59be0e104dbb18088370

Reviewed-on: https://asterix-gerrit.ics.uci.edu/784

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Enable Remove Quietly for Remove Directory Jobs

Change-Id: I00a60bf4ac6d64295224c2cebc28fb22f92e77fd

Reviewed-on: https://asterix-gerrit.ics.uci.edu/775

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -5
    • +12
    ./FileRemoveOperatorDescriptor.java
Move Hyracks to subfolder

    • -123
    • +0
    ./AbstractDeserializedFileScanOperatorDescriptor.java
    • -105
    • +0
    ./AbstractFileWriteOperatorDescriptor.java
    • -99
    • +0
    ./DelimitedDataTupleParserFactory.java
    • -373
    • +0
    ./FieldCursorForDelimitedDataParser.java
    • -88
    • +0
    ./FileRemoveOperatorDescriptor.java
    • -84
    • +0
    ./FrameFileWriterOperatorDescriptor.java
    • -64
    • +0
    ./LineFileWriteOperatorDescriptor.java
  1. … 4413 more files in changeset.
Support Change Feeds and Ingestion of Records with MetaData

This change allows feeds to perform upserts and deletes

in order to perform replication of an external data source.

The change does so by performing the following:

1. The adapter produces [PK][Record]. (Record == null --> delete)

2. The insert is replaced by an upsert operator.

Change-Id: I3749349e2b9f1b03c8b310eb99d3f44d08be77df

Reviewed-on: https://asterix-gerrit.ics.uci.edu/620

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 27 more files in changeset.
Fix Remove File Operator

The operator didn't get the correct path of the folder to be

deleted. After the fix, the operator gets the correct path

from the IO manager.

Change-Id: I5910409d79e9c1f8e7192a1050b2be0f823e912f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/659

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Fixes for Coverity Issues

(https://scan.coverity.com/projects/hyracks)

- CID 68257 (#1 of 1): Resource leak (RESOURCE_LEAK)

5. leaked_resource: Variable outputStream going out of scope leaks the

resource it refers to.

- CID 68260 (#1 of 1): Useless call (USELESS_CALL)

side_effect_free: Calling equivalentVars.get(0) is only useful for its

return value, which is ignored.

- CID 68261 (#1 of 1): BC: Bad casts of object references

(FB.BC_EQUALS_METHOD_SHOULD_WORK_FOR_ALL_OBJECTS)

1. defect: Equals method for org.apache.hyracks.algebricks.core.

algebra.properties.LocalOrderProperty assumes the argument is of type

LocalOrderProperty.

- CID 68262 (#1 of 1): BC: Bad casts of object references

(FB.BC_EQUALS_METHOD_SHOULD_WORK_FOR_ALL_OBJECTS)

1. defect: Equals method for org.apache.hyracks.storage.am.rtree.

RTreeCheckTuple assumes the argument is of type RTreeCheckTuple.

Change-Id: I8ba6e578f173b1081a8f55b228704744f08588df

Reviewed-on: https://asterix-gerrit.ics.uci.edu/658

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 3 more files in changeset.
Remove Trailing White Spaces

This change removes all trailing white spaces in

java files in hyracks

Change-Id: I1c2ea4ff1190a965a857c0c3760cbebdf21860b3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/645

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <michael.blow@couchbase.com>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -1
    • +1
    ./AbstractDeserializedFileScanOperatorDescriptor.java
    • -1
    • +1
    ./AbstractFileWriteOperatorDescriptor.java
    • -1
    • +1
    ./FieldCursorForDelimitedDataParser.java
    • -1
    • +1
    ./FrameFileWriterOperatorDescriptor.java
    • -1
    • +1
    ./LineFileWriteOperatorDescriptor.java
    • -1
    • +1
    ./RecordFileScanOperatorDescriptor.java
  1. … 647 more files in changeset.
Support Sending Messages Alongside Frame Data

This change support sending messages with records. The tuple Appender

reserves 100 bytes for a message. Before sending the frame, it appends

The message in the last tuple position. The message is read from the

task context as the shared object between different operators in the

pipeline. The first use of this feature will be within feeds to request

acks for at least once semantics.

Change-Id: I56ae8124052c13a52ca42965b8d00e18ecf35a28

Reviewed-on: https://asterix-gerrit.ics.uci.edu/604

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <michael.blow@couchbase.com>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -2
    • +2
    ./DelimitedDataTupleParserFactory.java
  1. … 17 more files in changeset.
remove end-of-line whitespace

Change-Id: If3542874d7f3a536a6fe524aba2fffaf6447a614

Reviewed-on: https://asterix-gerrit.ics.uci.edu/600

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

    • -1
    • +1
    ./PlainFileWriterOperatorDescriptor.java
  1. … 255 more files in changeset.
Add flush() to IFrameWriter

This change introduces flush() method in frame writers. It is

intended to be used for long running jobs (Feeds) to flush contents

of frames all the way to storage.

Change-Id: I85424bab7965b71aac709280af066e1655457aa3

Reviewed-on: https://asterix-gerrit.ics.uci.edu/584

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -0
    • +5
    ./AbstractDeserializedFileScanOperatorDescriptor.java
    • -0
    • +5
    ./AbstractFileWriteOperatorDescriptor.java
    • -1
    • +1
    ./DelimitedDataTupleParserFactory.java
  1. … 84 more files in changeset.
Improvment on Cursor for Delimited Data

This change allows the parser to parse records in addition to streams.

Change-Id: I84ff40db664633c633277e9cc0ffa534cda9f26a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/567

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -35
    • +43
    ./FieldCursorForDelimitedDataParser.java
  1. … 3 more files in changeset.
Make Index Path Relative to NC IO Devices

This change includes the following:

- Store relative index path in persisted local resource as resource name.

- Fetch index absolute path based on FileSplit IO device and index relative path.

This change will enable a node to perform operations on an index that was created

on another node by finding the absolve path based on the node IO deviec and

the index relative path. This is needed in case a node leaves the cluster and

a replica node is assigned to take over and recover the index partitions

that belonged to the failed node.

Change-Id: I09fabd097b8a995ca959fe60286acdb43edfcfa1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/563

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 19 more files in changeset.
ASTERIXDB-54: s/IHyracksCommonContext/IHyracksTaskContext/

Change-Id: I5f2daf1d8f933d86e0254be443f3ebcef17ecbcf

Reviewed-on: https://asterix-gerrit.ics.uci.edu/533

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

    • -2
    • +2
    ./DelimitedDataTupleParserFactory.java
  1. … 1 more file in changeset.
Changed the IFrameWriter Contract

Updated existing operators and added a test case for BTreeSearchOperatorNodePushable.

With this change, calling the open method itself moves it to the open state and

hence, close must be called.

Change-Id: I03da090002f79f4db7b5b31454ce3ac2b9e40c7f

Reviewed-on: https://asterix-gerrit.ics.uci.edu/551

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

  1. … 41 more files in changeset.
Add a constructor for FileSplit: FileSplit(String nodeName, String path, int ioDeviceId).

change-Id: I1c7cc7752dd7b6d5261ff02d591f25d76d442a1c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/324

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Change license headers

Change-Id: I98b18f24a20dcd8dc75e828e47fb0ab88179a5be

Reviewed-on: https://asterix-gerrit.ics.uci.edu/386

Reviewed-by: Till Westmann <tillw@apache.org>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

    • -12
    • +16
    ./AbstractDeserializedFileScanOperatorDescriptor.java
    • -12
    • +16
    ./AbstractFileWriteOperatorDescriptor.java
    • -12
    • +16
    ./ConstantFileSplitProvider.java
    • -10
    • +14
    ./DelimitedDataTupleParserFactory.java
    • -10
    • +14
    ./FieldCursorForDelimitedDataParser.java
    • -12
    • +16
    ./FileRemoveOperatorDescriptor.java
    • -12
    • +16
    ./FileScanOperatorDescriptor.java
    • -12
    • +16
    ./FrameFileWriterOperatorDescriptor.java
    • -12
    • +16
    ./LineFileWriteOperatorDescriptor.java
  1. … 2055 more files in changeset.
Change folder structure for Java repackage

Change only the folders, not the files, for our package name change.

This will break the build, and needs to be followed by a change to

the package name in all of the source files. However performing

the folder move and file change in two steps lets Git understand

that the files are the same, and lets us track revisions across

those files.

Change-Id: I08aff75e25ac7c6298c32cf3402febbc4a318c2a

Reviewed-on: https://asterix-gerrit.ics.uci.edu/307

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Chris Hillery <ceej@lambda.nu>

    • -0
    • +114
    ./AbstractDeserializedFileScanOperatorDescriptor.java
    • -0
    • +96
    ./AbstractFileWriteOperatorDescriptor.java
    • -0
    • +29
    ./ConstantFileSplitProvider.java
    • -0
    • +95
    ./DelimitedDataTupleParserFactory.java
    • -0
    • +361
    ./FieldCursorForDelimitedDataParser.java
    • -0
    • +81
    ./FileRemoveOperatorDescriptor.java
    • -0
    • +74
    ./FileScanOperatorDescriptor.java
    • -0
    • +80
    ./FrameFileWriterOperatorDescriptor.java
    • -0
    • +21
    ./IFileSplitProvider.java
    • -0
    • +23
    ./IRecordReader.java
    • -0
    • +25
    ./IRecordWriter.java
    • -0
    • +24
    ./ITupleParserFactory.java
    • -0
    • +60
    ./LineFileWriteOperatorDescriptor.java
  1. … 3879 more files in changeset.
Change Java package from edu.uci.ics to org.apache

Change-Id: I99172d856e88954b00cf7cfb24d33bb400f53994

Reviewed-on: https://asterix-gerrit.ics.uci.edu/308

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Till Westmann <tillw@apache.org>

    • -11
    • +11
    ./AbstractDeserializedFileScanOperatorDescriptor.java
    • -10
    • +10
    ./AbstractFileWriteOperatorDescriptor.java
    • -11
    • +11
    ./DelimitedDataTupleParserFactory.java
    • -1
    • +1
    ./FieldCursorForDelimitedDataParser.java
    • -10
    • +10
    ./FileRemoveOperatorDescriptor.java
    • -8
    • +8
    ./FrameFileWriterOperatorDescriptor.java
    • -2
    • +2
    ./LineFileWriteOperatorDescriptor.java
  1. … 2019 more files in changeset.