[TRAFODION-2420] RMS enhancements Improved BMO operation accounting. Two new counters are added a) scratchIOSize - Size in KB of the scratch IO b) scratchIOMaxTime - Time in microseconds taken by any long pole ESP instance to do scratch IO operations
The ScrBufSize, ScrBufRead and ScrBufWritten are no longer displayed in the formatted get statistics command outputs.
Reduced the default value of CQD HBASE_NUM_CACHE_ROWS_MAX to 1024 from 10000 to reduce stress on the client JVM memory.
Disabled the memory pressure triggering in the BMO operators by increasing the threshold GEN_MEM_PRESSURE_THRESHOLD to 10000 from 100. The memory pressure detection code was inadvertently enabled when the cap to limit memory pressure constant to 100 was removed.
Memory pressure triggers in BMO operators will be enabled later when we understand the memory pressure detection better.
[TRAFODION-2420] RMS enhancements Introduced 2 new counters HeapWM: - "SQL Heap WM" - Tracks the high water mark of the used memory including space buffer and bmo operator memory. It is enough to monitor this counter alone to track the memory utilization of the query. scrIOTime: "Scr. IO Time" - Tracks the IO time taken to read/write to the scratch files at BMO operator level
Introduced a 'Single line Format' option to display BMO stats and SE stats in a single line format to enable exporting the output to Excel easily.
GET STATISTICS FOR QID CURRENT PROGRESS, OPTIONS 'SL'
Removed and cleaned up the code further
Also fixed memory corruption issues seen with GET STATISTICS command.