Clone Tools
  • last updated a few minutes ago
Constraints: committers
Constraints: files
Constraints: dates
[ASTERIXDB-2194][COMP] Introduce datasource functions

- user model changes: yes

Some functions can be datasources

- storage format changes: no

- interface changes: yes

- Add IDatasourceFunction: A function that is also a datasource

- Add IFunctionToDataSourceTransformer: transform an unnest

function into a datascan during compilation


- Currently, functions are location agnostic and are run on

parameters that are either passed through them during compile

time or runtime.

- An exception to this is the dataset function which has

an associated location constraints running on the nodes

which host the dataset.

- In this change, we introduce a general framework that allows

creation of new functions similar to the dataset function.

- Such functions are called datasource Functions.

- A datasource function takes constant parameters and run on

a set of partitions similar to the dataset function.

- The first example of such functions is the DatasetResources


- The DatasetResources function takes two parameters, a dataverse

and a dataset. It is then run on all nodes and returns a set

of dataset resources.

- Test cases are added for this function.

Change-Id: Ibcf807ac713a21e8f4d59868525467386e801303


Sonar-Qube: Jenkins <>

Integration-Tests: Jenkins <>

Reviewed-by: abdullah alamoudi <>

Tested-by: abdullah alamoudi <>

    • -0
    • +1
  1. … 41 more files in changeset.