Clone Tools
  • last updated 27 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[ASTERIXDB-2176] Python UDFs

- user model changes: yes

- storage format changes: no

- interface changes: yes

Details:

- Allow UDFs to be shiv-packaged python modules with their

dependencies

- Use pyro for python RPC

- Maven build for pyro package into server

- Remove JObject spatial types

- Simpler conversion from java primitive/standard types and

collections

to JObject equivalents

Change-Id: Ibea23a2e9308132f343d80eff04ede9a235aa021

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/5526

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 108 more files in changeset.
[NO ISSUE] Fix UDF Metadata Transactions

- Move UDF Metadata Transactions to be initiated from the CC

directly

- Remove old UDF initialization code

- Make DROP DATAVERSE remove libraries

- Make NCs properly read libraries on init with multipart dataverse

names

Change-Id: Ibda23a2e8308937f343d80eff04ede9a235da0d2

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/4923

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

  1. … 45 more files in changeset.
[NO ISSUE] HTTP Basic Auth servlet wrapper

- Basic auth servlet that checks a /etc/passwd style file on the CC

- Only enabled for UDF API servlet for now

- Associated code in client helper for adding file to CC path

- Config variable to manually set path if desired

Change-Id: Ibea23a2e8308937f343d80eff04ede9a235aa0d1

Reviewed-on: https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/5204

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

    • -0
    • +102
    ./ExternalUDFLibrarian.java
    • -0
    • +31
    ./IExternalUDFLibrarian.java
  1. … 61 more files in changeset.
[NO ISSUE][*DB] Enable loading external UDF for AsterixHyracksIntegrationUtil

- user model changes: no

- storage format changes: no

- interface changes: no

Add external UDF support for AsterixHyracksIntegrationUtil. Developer

may use following system properties to install external UDF for local

environment.

"external.lib" : udf package path.

"external.lib.dataverse": dataverse name (default: test).

"external.lib.libname": library name (default: testlib).

Change-Id: I333238b944b1c6d48a2b80b87a25f600522e0cc4

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2078

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 8 more files in changeset.
[ASTERIXDB-2098][TEST] Adding UDF execution tests for SQLPP

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

1. Added test cases for UDFs to SQLPP.

2. Added SqlppExecutionIT to test UDFs in SQLPP.

Change-Id: I3dae4300589f1b16ea5abbf13d81b686a2283add

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2009

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Michael Blow <mblow@apache.org>

  1. … 19 more files in changeset.
Add install/uninstall UDF to Ansible

1. Add udf.sh for handling install/uninstall UDF packages to the cluster.

2. Remove unnecessary path check in TestLibrarian.

Change-Id: If7ea9640a06e2b691c19a8a819307d84b55a679e

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1682

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Yingyi Bu <buyingyi@gmail.com>

BAD: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 4 more files in changeset.
ASTERIXDB-1711: Move test infra from test.aql

Change-Id: I5d631a2028fb80c823fbaafb7269f15d07685dc9

Reviewed-on: https://asterix-gerrit.ics.uci.edu/1512

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

  1. … 31 more files in changeset.
ASTERIXDB-1494: refactor ExternalLibraryManager and make it non-static.

Change-Id: I5c287a35ff90c3aea639d3069d5a842e28c5e508

Reviewed-on: https://asterix-gerrit.ics.uci.edu/980

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 31 more files in changeset.
Remove Installed Libraries before Unit Tests

Change-Id: I9dea8c8fc46a717acd0b86ac7b07e0276bb5e95c

Reviewed-on: https://asterix-gerrit.ics.uci.edu/797

Reviewed-by: Murtadha Hubail <hubailmor@gmail.com>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

  1. … 3 more files in changeset.