Clone Tools
  • last updated 13 mins ago
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[NO ISSUE][COMP] Reduce memory requirements for monitoring functions

- user model changes: no

- storage format changes: no

- interface changes: no

Details:

- Queries that only invoke monitoring/metadata datasource functions

should run with minimal memory requirements

- The functions are: active_requests(), completed_requests(),

dataset_resources(), storage_components(), jobs(), and ping()

Change-Id: If7de53a5b476c8ce0d3fe485bf526a5d425e4c37

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3548

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Dmitry Lychagin <dmitry.lychagin@couchbase.com>

Reviewed-by: Ali Alsuliman <ali.al.solaiman@gmail.com>

    • -0
    • +32
    ./dataset-resources.6.plans.sqlpp
    • -0
    • +32
    ./dataset-resources.7.plans.sqlpp
  1. … 26 more files in changeset.
[ASTERIXDB-2194][COMP] Introduce datasource functions

- user model changes: yes

Some functions can be datasources

- storage format changes: no

- interface changes: yes

- Add IDatasourceFunction: A function that is also a datasource

- Add IFunctionToDataSourceTransformer: transform an unnest

function into a datascan during compilation

Details:

- Currently, functions are location agnostic and are run on

parameters that are either passed through them during compile

time or runtime.

- An exception to this is the dataset function which has

an associated location constraints running on the nodes

which host the dataset.

- In this change, we introduce a general framework that allows

creation of new functions similar to the dataset function.

- Such functions are called datasource Functions.

- A datasource function takes constant parameters and run on

a set of partitions similar to the dataset function.

- The first example of such functions is the DatasetResources

function.

- The DatasetResources function takes two parameters, a dataverse

and a dataset. It is then run on all nodes and returns a set

of dataset resources.

- Test cases are added for this function.

Change-Id: Ibcf807ac713a21e8f4d59868525467386e801303

Reviewed-on: https://asterix-gerrit.ics.uci.edu/2216

Sonar-Qube: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: abdullah alamoudi <bamousaa@gmail.com>

Tested-by: abdullah alamoudi <bamousaa@gmail.com>

    • -0
    • +50
    ./dataset-resources.1.ddl.sqlpp
    • -0
    • +24
    ./dataset-resources.2.update.sqlpp
    • -0
    • +20
    ./dataset-resources.3.query.sqlpp
    • -0
    • +20
    ./dataset-resources.4.query.sqlpp
    • -0
    • +21
    ./dataset-resources.5.query.sqlpp
  1. … 37 more files in changeset.