Clone
Murtadha Makki Al Hubail
committed
on 10 Sep 19
[NO ISSUE][RT] Add Thread-Based Stats Collector
- user model changes: no
- storage format changes: no
- interface changes: yes

Details:
- A… Show more
[NO ISSUE][RT] Add Thread-Based Stats Collector

- user model changes: no

- storage format changes: no

- interface changes: yes

Details:

- Add infra to allow collecting thread-based stats during

 runtime for any thread that belongs to a task.

- Collect number of pinned pages per thread and report it

 in the TaskProfile.

- Aggregate pinned pages counters from all job tasks and

 report it as diskIoCount in the metrics field in the json

 response. The plan is to move this stats to the profile

 field when it is introduced.

- Collecting pinned pages stats is currently enabled by

 default for any job with IndexSearchOperatorNodePushable.

 The plan is to allow enabling/disabling as part of the

 job profiling change.

- Add test case for diskIoCount metric.

- Remove unused IndexSearchOperatorNodePushable constructor.

Change-Id: I44dfcedcadb3d0f48815b521e7d495e473b02e3d

Reviewed-on: https://asterix-gerrit.ics.uci.edu/3555

Contrib: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Integration-Tests: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Tested-by: Jenkins <jenkins@fulliautomatix.ics.uci.edu>

Reviewed-by: Murtadha Hubail <mhubail@apache.org>

Reviewed-by: Till Westmann <tillw@apache.org>

Show less