Trafodion

Clone Tools
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Add max I/O time to Hbase runtime stats

Collect and display the maximum Hbase operator I/O time. In a parallel

plan, this is chosen from the biggest Hbase I/O elapsed time among all

the same Hbase tcb instances at the runtime stats merge stage. For

serial plan the value equals to the Hbase I/O elapsed time.

In addition, the displayed Hbase I/O is changed from byte to MB.

Change-Id: Icb4cbcbee5eeaf7143762444d48288f7bf6f5784

    • -8
    • +15
    /sql/executor/ExExeUtilGetStats.cpp
    • -13
    • +13
    /sql/executor/HBaseClient_JNI.cpp
Merge "Revert "Fix read conf from hbase-site""

Merge "Log reading TMUDF, phase 3"

Merge "fix 1361754: missing sort for fastTrafInsert"

Merge "fix LP1383581:serial plan generated for salt table"

Merge "Remove duplicate table names from commit records"

Revert "Fix read conf from hbase-site"

This reverts commit 62446d334e92961ced14116978b8a76fa2d985b0.

Change-Id: I6dfdd07f7752f429fd4a9ceb29ef379cd4009913

Merge "Fixes repeated node down/up on same node."

SQL syntax to cancel executing query, phase 3

This change fixes some problems with subset DELETE and

UPDATE statements which prevented them from responding

to CANCEL. It addresses an identical potential issue in

SELECT statements with predicates that reject large

numbers of rows.

The change also allows an envvar, SQL_NO_REGISTER_CANCEL,

which if set to 1, prevents queries from registering with

the cancel broker. It can be used to debug performance

regressions.

The change also adds test cases to the regression test

for UPDATE, DELETE, INSERT and UPSERT WITH LOAD.

Change-Id: I86977c3985db4f56f2d4a0e89051970cec2c9411

Implements: blueprint sql-query-cancel

    • -196
    • +854
    /sql/regress/executor/EXPECTED106
Merge "ANSI Schema changes"

Fix to ReceiveSock/SendSock to retry IO on EINTR

Change-Id: Ib6e48ad3f3f88d2e90f519b62320dfbf014b33d5

Merge "Automated collection of necessary statistics"

Remove duplicate table names from commit records

Change-Id: I3ff5f2d7ded04db137ab8d1c9304979b0ccc5c48

Log reading TMUDF, phase 3

blueprint cmp-tmudf-compile-time-interface

- Addressed review comments from phase 2. See

https://review.trafodion.org/#/c/824

- Added a "parse_status" column to the TMUDF, see

updated syntax below

- Added versioning info to new DLL libudr_predef.so

- EVENT_LOG_READER TMUDF now should choose the correct

degree of parallelism without the need for CQDs

- Brought back the REPLICATE PARTITION keyword, which

is used in the TMUDF syntax. This should fix the failure

in regression test udf/TEST108.

- Some remaining issues:

- Newlines in the error message are not handled well,

at best the additional lines are lost, at worst

they will cause parse errors

- log_file_node output column is always 0

- Code is not yet integrated with changes to event

logging

- Not yet tested on clusters

Updated syntax for the log reader TMUDF:

SQL Syntax to invoke this function:

select * from udf(event_log_reader( [options] ));

The optional [options] argument is a character constant. The

following options are supported:

f: add file name output columns (see below)

t: turn on tracing

d: loop in the runtime code, to be able to attach a debugger

(debug build only)

p: force parallel execution on workstation environment with

virtual nodes (debug build only)

Returned columns:

log_ts timestamp(6),

severity char(10 bytes) character set utf8,

component char(24 bytes) character set utf8,

node_number integer,

cpu integer,

pin integer,

process_name char(12 bytes) character set utf8,

sql_code integer,

query_id varchar(200 bytes) character set utf8,

message varchar(4000 bytes) character set utf8

if option "f" was specified, we have four more columns:

log_file_node integer not null,

log_file_name varchar(200 bytes) character set utf8 not null,

log_file_line integer not null,

parse_status char(2 bytes) character set utf8 not null

(log_file_node, log_file_name, log_file_line) form a unique key

in the result table. parse_status indicates whether there were

any errors reading the information:

' ' (two blanks): no errors

'E' (as first or second character): parse error

'T' (as first or second character): truncation or over/underflow

occurred

'C' (as first or second character): character conversion error

Change-Id: Iee3fc8383d4125f0f9b6c6035aa90bb82ceee92e

    • -127
    • +153
    /sql/sqludr/PredefUdrReadfile.cpp
    • -0
    • +25
    /sql/sqludr/vers_libudr_predef.cpp
fix 1361754: missing sort for fastTrafInsert

Change-Id: Ib7d768cba5b89ad44f5423cd9dd499fd537eaf66

Set the property in dcs config to disable stats collection in mxosrvr

Change-Id: I59e8b159e8ff347ed5f997d78ae99a4113ecc5ce

Adding check for HDP 2.2/CDH 5.2 and Java Version

Adding Java Version check from sqenvcom.sh into the installer.

Adding check to error out of user tries to install Trafodion

with Hortonworks 2.2 or Cloudera 5.2 installer on their system.

Edit 1: Add check that HBase is installed on all nodes. Also, print

large error if trafodion_setup fails.

Edit 2: Changed Java version needed from 1.7.0_67 to 1.7.0_65.

Change-Id: If4e1659c7e95759ba5fc6019584fc2322243892a

Merge "Fix read conf from hbase-site"

Fixes repeated node down/up on same node.

Change-Id: I5d65364ebece1e901f6a05f95ee5fbfdf5829185

Merge "Fix install_local_hadoop to find maven, run phoenix T2"

Merge "Fix Bug #1380734 Batch upsert into salted table"

More fixes to make SQL thread safe

Fix for bug 1403334 – T2 multithread tests core dump in SQLCLI_DropContext

NAMemory was not threadsafe in derived memory management. The calls

registerMemory, unRegisterMemory was not threadSafe when the heap is marked

as threadsafe heap. Also, the mutex is now dropped as part of NAHeap

destructor.

Fix for bug 1403410 - With 128 threads thru T2 driver, MTTrans and YCSB tests

crash and generate this core

The context list was being manipulated without acquiring a mutex in some places

These obsolete codes are now removed.

Some of the globals were wrongly declared as thread globals.

Other Fixes

SQL_EXEC_GetDiagnosticsCondInfo2 CLI call is now protected by mutexes

like any other CLI call.

Also removed some of the obsolete codes in the cli layer.

Currently commented out the code to close all the open cursors in all

the contexts when a change in transaction id is detected. We need to detect

the change in transaction at context level and close cursors belonging to

that context only.

Change-Id: I0edb7b7f0a844c8c49995af4c130dd319472a783

Merge "SQL syntax to cancel executing query, phase 2"

Fix read conf from hbase-site

Change-Id: I572494b8b8adce162cd3929fc42a0e656fbcfa0c

Fix Bug #1380734 Batch upsert into salted table

Change-Id: I08a0296a8af41a13272676b99b1bf7a50a763d5e

Fix for Mdam access causes large number of rows to be accessed.

A fix by Dave Birdsall and Anoop Sharma on a problem where mdam probe was

causing large number of rows to be accessed. The issue was that the scan cache

was being set to 10000 based on cardinality estimates, but the mdam probe

is being to retrieve only one row at most. Additinal changes to improve

debugging with mdam predicate network.

Dummy delta change to get check tests to run again.

Change-Id: I5b570c42712d4c38157181c3b76bf9a3ab6e2ed9

fix LP1383581:serial plan generated for salt table

Change-Id: I36cbf70119218dcce1826a2cf87306e66ded1d64

Enhanced endpoint coprocessor tracing for row key display

Change-Id: Ib4262702df9603390fe939b15df7fbdca8f18e07

Fix Bug #1343678 JDBC Sample CallableStatementSample

Change-Id: I3a95fd21fd0e8a49f9d5dca8b1b5920f438a05ff

    • -0
    • +41
    /conn/jdbc_type4/samples/build.xml
ANSI Schema changes

ANSI Schema

Implements the changes to support ANSI schemas. For more information

see the blueprint at:

https://blueprints.launchpad.net/trafodion/+spec/security-ansi-schemas

The syntax changes for REGISTER USER and CREATE ROLE were not

implemented in this delivery.

NOTE: This code was reviewed internally prior to merging with the

main branch.

Change-Id: I1c7937dbcd067e792dcacb65f12c43e4f84a25ad

Change-Id: I98395eeef1e8bde424d9e83f96928358f0b1991b

    • -0
    • +116
    /sql/parser/ElemDDLAuthSchema.h
  1. … 61 more files in changeset.