arkcmp

Clone Tools
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
1. JULIANTIMESTAMP now uses clock_gettime with CLOCK_REALTIME by default. It can be switched to earlier implementaion via setting env variable USE_LINUX_JULIANTIMESTAMP=0 2. Remove unwanted CQDs set by mxosrvr. GENERATE_EXPLAIN is not turned ON by mxosrvr.

  1. … 12 more files in changeset.
[TRAFODION-2626] Make logs directory location configurable

Makes path to log directory independent of TRAF_HOME. The default location

is still $TRAF_HOME/logs. The DCS and REST log directories are now

sub-directories of the main TRAF_LOG directory.

  1. … 72 more files in changeset.
TRAFODION-3121 Enhance 'initialize trafodion' to return progress status

-- init traf will now return status during various steps.

'Started' indication will be returned when that step starts.

'Completed' will be returned when it completes successfully.

'Failed' will be returned if that step fails.

Elapsed time for each step will be shown in {ET hh:mm:ss} format.

-- method CmpSeabaseDDL::initSeabaseMD is rewritten and moved from

file CmpSeabaseDDLcommon.cpp to new file CmpSeabaseDDLinitraf.cpp.

-- priv mgr tables are now always created during init traf.

-- a 'no return status' option has been added if status is not to be

returned during init traf. This is used when init traf is called

internally, for ex, during upgrade.

It is not an externalized option.

-- Output of init traf is shown below.

Note: output is not a printf/cout to stdout.

It is returned as selected rows to the caller.

Apache Trafodion Conversational Interface 2.3.0

Copyright (c) 2015-2017 Apache Software Foundation

>>initialize trafodion;

Initialize Trafodion: Started

Verify User: Started

Verify User: Completed {ET: 00:00:00}

Version Check: Started

Version Check: Completed {ET: 00:00:00}

Create Metadata Tables: Started

Create Metadata Tables: Completed {ET: 00:00:49}

Update Metadata Tables: Started

Update Metadata Tables: Completed {ET: 00:00:06}

Create Schema Objects: Started

Create Schema Objects: Completed {ET: 00:00:20}

Create Metadata Views: Started

Create Metadata Views: Completed {ET: 00:00:05}

Create Repository Tables: Started

Create Repository Tables: Completed {ET: 00:00:16}

Create PrivMgr Tables: Started

Create PrivMgr Tables: Completed {ET: 00:00:29}

Create Library Manager: Started

Create Library Manager: Completed {ET: 00:00:51}

Initialize Trafodion: Completed {ET: 00:03:09}

--- SQL operation complete.

  1. … 35 more files in changeset.
TRAFODION-3086 Further enhancements to 'DDL on Hive objects'

-- Hive CTAS enhancements

-- CTAS will do create through Hive and insert...select in Traf

-- a cqd can be set if CTAS need to be passed in completely to Hive

-- CTAS 'no load' option can be used to create a Hive

table LIKE a traf table.

Older 'create hive like traf' is removed.

-- explain for CTAS to show ddl, insert...select, upd...stats stmts

-- Truncate enhancements.

-- traf: purgedata, truncate, truncate table

-- Hive: truncate, truncate table

-- 'if exists' option has been added

-- Hive truncate is through new exeutil operator

-- older operator uses LOB interface to clear data.

Maintained as Legacy operator, will be removed.

-- new operator uses Hive to truncate tables

-- explain for truncate to show trunc query that will be sent

-- removed obsolete parallel label op

-- removed obsolete purgedata (fast delete) op

  1. … 29 more files in changeset.
[TRAFODION-3009] Streamline error handling in Executor utility commands

ComDiagsArea is now allocated only when there are warnings or error in

all the utility commands except load. In case of load, the ComDiagsArea

is allocated in advance to report error rows count.

This requires all the executor utility commands to use a new version of

ExRaiseSqlError to populate diagnostics area.

[TRAFODION-3017] Simplify the hive client access in Trafodion

Hive Client functions are now moved to a new file HiveClient_JNI.h and

HiveClient_JNI.cpp. Most of the HiveClient functions are static functions

allowing to use HiveClient in Trafodion with ease.

  1. … 32 more files in changeset.
[TRAFODION-2821] Trafodion core code base needs to be thread safe

Java exceptions thrown while calling the java methods from JNI in

Trafodion are stored in the current context. However in a multi-threaded

ESP environment, these exceptions should be stored in thread specific

variable to enable error handling to be thread safe. Otherwise, the JNI

errors could be overwritten by the JNI errors from another thread.

Also streamlined JNI error handling by extending the getExceptionDetails()

methods to log the errors also.

Incorporated error handling in SequenceFileReader JNI methods.

  1. … 22 more files in changeset.
[TRAFODION-2853] memory leak of ComDiagsArea in CmpContext heap of mxosrvr

Fixes for the regression failures seen with b97982c4494e078c5de2d883442d86265f24dadc

This includes the change to report the error at the time of compilation

for invoke, showddl commands. Earlier errors were ignored during

prepare time and reported only at the time of execute for these commands

  1. … 15 more files in changeset.
[TRAFODION-2853] memory leak of ComDiagsArea in CmpContext heap of mxosrvr

The ComDiagsArea is allocated in many places and from different heaps in Trafodion, making it difficult to

detect the source of the leak. Hence, a different approach is taken to fix this issue.

Currently, ComDiagsArea is allocated in many places unconditionally even when SQL statement completes

execution without any error or warnings. Then it is deallocated. Changed this strategy and

allocate ComDiagsArea only when there is an error or warning while compiling or executing the SQL statement.

This should help the product in two ways

1) To reduce the pathlength. The smaller query execution would benefit the most by chopping of few more microseconds.

2) Reduce the memory growth due to leaked ComDiagsArea

  1. … 22 more files in changeset.
[TRAFODION-2727] Memory leak in the compiler part of the code in Trafodion

It was found that CmpMessageReplyCode was not getting deleted at all times.

But, the handling of CmpMessageDescribe messages in the compiler code has some

mysterious issue that corrupts the memory causing unpredictable behavior when

CmpMessageReplyCode is deleted. To circumvent this problem, the CmpStatement heap

is used for embedded compiler to allocate CmpMessageReplyCode and the Context heap

is used in case of standalone compiler. The handling of CmpMessageDescribe will

continue to leak memory in standalone compiler.

  1. … 1 more file in changeset.
fix the bufoverrun Critical error checked by TScanCode

Merge PR 1389 [TRAFOFION-2731] CodeCleanup: Removed the obsolete code in NAMemory and CliGlobals classes

Merge [TRAFODION-2879] Core dump ...plus four more fixes, see below PR-1384

  1. … 1 more file in changeset.
fix the bufoverrun Critical error checked by TScanCode

  1. … 20 more files in changeset.
[TRAFOFION-2731] CodeCleanup: Removed the obsolete code in NAMemory and CliGlobals classes

  1. … 7 more files in changeset.
[TRAFODION-2879] Core dump due to reference to deallocated memory for EstLogProp object

In the optimizer, we often use a define to refer to an "empty input

logical properties" object. The problem was that this object was

allocated on the statement heap but it was owned by the CmpContext

object, which lives longer than the statement heap. During debugging,

we have seen cases where this led to references of deleted memory.

The fix is to move the empty logical properties to the CmpStatement

object.

  1. … 2 more files in changeset.
[TRAFODION-2888] Streamline setjmp/longjmp concepts in Trafodion

First set of changes to streamline setjmp/longjmp.

a) Removed the setjmp in heap management within Trafodion.

b) Removed obsolete code related to No-wait operation concepts in SQL

  1. … 29 more files in changeset.
TRAFODION-2731 CodeCleanup: Phase 4. Remove legacy/obsolete pragmas

  1. … 379 more files in changeset.
[TRAFODION-2754] Changing Trafodion code to use sprintf instead of str_sprintf

Fixed the buffer overrun problem with compilerId at many places. This prevented

embedded compiler to be used when the pid of the process is more than 4 digits.

  1. … 5 more files in changeset.
[TRAFODION-2754] Get statistics cores sqlci or mxosrvr at str_sprintf()

Switched str_sprinf to use the standard sprintf function to ensure

that the format specification and the passed in parameters are consistent

  1. … 65 more files in changeset.
lcov: commit #1

  1. … 333 more files in changeset.
TRAFODION-2731 CodeCleanup: Phase 2: Remove obsolete code

This phase handles the following:

-- removed files:

cli/rtdu.h, rtdu2.h, rtdu.cpp, rtdu.cpp

executor/dmeasql.h

executor/ExMeas.h, ExMeas.cpp

executor/tempfile.h, .cpp

executor/rcb.h

executor/stubs.cpp, stubs2.cpp

exp/srlversion.cpp

exp/exp_space.h

cli/VicKeyValuePair.h

cli/CliDll.cpp

cli/CliStubsStaticBuild.cpp

cli/globalsrlversion.cpp

cli/globalstubs.cpp

cli/sqlciSRLStubs.cpp

cli/test.cpp

cli/privsrlversion.cpp

common/SqlExpDllDefines.h

common/SqlExportDllDefines.h

sqlcat/enum.h

sqlcat/ReadTableDef.h, cpp

sqlcat/readRealArk.h, cpp

sqlshare/catapirequest.*

-- removed defines and code referencing them:

-- NA_STD_NAMESPACE

-- NA_NO_CMPCONTEXT

-- NA_CATMAN_SIM, NA_CATMAN_SIM_FS

-- common/purify.h

-- DONT_USE_MATH_H

-- NT_PORT

-- NA_MSVC

-- NA_NO_FRIENDS_WITH_TEMPLATE_REFS

-- NA_FLEXBUILD

-- removed multiple obsolete sqlci features and syntax:

(report writer, MACL, Help, Simulators, Utils, MXCS mode, Help,

and few others).

-- removed following files in sqlci dir:

CSInterface.h

CharSetConstants.cpp

CharSetConstants.h

MsgCat.cpp

MsgCat.h

MxciEHCallBack.cpp

MxciEHCallBack.h

RWInterface.cpp

RWInterface.h

SqlciCSCmd.cpp

SqlciCSCmd.h

SqlciCSSimulator.cpp

SqlciHelp.cpp

SqlciRWCmd.cpp

SqlciRWCmd.h

SqlciRWSimulator.cpp

SqlciUsage.cpp

SqlciUtil.cpp

SqlciUtil.h

UtilInt.cpp

UtilInt.h

UtilMsg.cpp

UtilMsg.h

immudefs.cpp

immudefs.h

  1. … 83 more files in changeset.
code cleanup, commit #1

  1. … 128 more files in changeset.
TRAFODION-2731 CodeCleanup: Remove obsolete, legacy and unused code

This phase handles the following:

-- removal of code that dealt with:

-- mpalias, NSK, MP, mploc, resource fork, rfork

-- ARLIB, DISK, VOLUME, PFS, compiler version info

-- interpretasrow/IAR, AuditImage, ExtractColumns functions

-- ARKCMP_SINGLE_PROCESS and oneProcess()

-- recompControl, remoteDefaults, rtdu, module

-- latebind thru nsk defines, guardian names, nametype nsk

-- SHADOW implementation

-- MEASURE

-- older sqlcat ReadTableDef

-- DP2_MEMORY, DP2_SPACE, HGB_DP2_MEMORY_LIMIT

-- internal cli methods no longer used by any caller

Code within the following defines is removed if it is obsolete

or the define itself is removed if that feature is always on:

-- removed NA_EIDPROC

-- removed SQLEXP_LIB_FUNC

-- removed NA_CMPDLL

-- removed SQ_PHANDLE_VERIFIER

-- removed SQ_NEW_PHANDLE

-- removed __EID

-- removed ARKFS_OPEN

-- removed STAND_ALONE

-- removed __TANDEM

-- removed NA_C89

-- removed NA_NSK

-- removed SQLEXPORT_LIB_FUNC

-- removed SQLCLI_LIB_FUNC

-- removed CLI_PRIV_SRL

-- removed PRIV_SRL

-- removed NA_LINUX

-- removed NA_HSC_LINUX

-- removed NA_UNIX

-- removed NA_WINNT

-- removed HAVE_MMAP

-- removed NA_NO_C_RUNTIME

-- removed NA_DEBUG_C_RUNTIME(replaced with _DEBUG)

-- removed NA_64BIT usage except in sqlcli.h

-- removed dg64

-- removed SQLEXPORT_LIB

-- removed NA_ARKFS

-- removed NA_IEEE_FLOAT

-- removed NA_GUARDIAN_MSG

-- removed NA_HSC

-- removed NA_TMFNOTYETSUPPORTED

-- removed ERROR

-- removed ERROR_STATE

-- removed SQLERRORS_LIB_FUNC

Contents of these files have been removed.

Next checkin fill remove the files itself from git:

executor/dmeasql.h

executor/ExMeas.h, ExMeas.cpp

executor/tempfile.h, .cpp

executor/rcb.h

executor/stubs.cpp, stubs2.cpp

exp/srlversion.cpp

cli/rtdu.h, rtdu2.h, rtdu.cpp, rtdu.cpp

cli/VicKeyValuePair.h

cli/CliDll.cpp

cli/CliStubsStaticBuild.cpp

cli/globalsrlversion.cpp

cli/globalstubs.cpp

cli/sqlciSRLStubs.cpp

cli/test.cpp

cli/privsrlversion.cpp

common/SqlExpDllDefines.h

common/SqlExportDllDefines.h

sqlcat/enum.h

sqlcat/ReadTableDef.h, cpp

sqlcat/readRealArk.h, cpp

  1. … 452 more files in changeset.
TRAFODION-2722 Change purgedata to use HBase truncate api

Traf now uses HBase truncate api to delete all rows from

a table and indexes, instead of dropping/recreating underlying HBase

objects.

A second change has also been added to fix a bug where compiler cache

was being cleared whenever a DDL statement was issued.

This change was added a while back before Query Invalidation(QI) feature

was available and was not removed when QI was added.

It has now been removed.

  1. … 4 more files in changeset.
[TRAFODION-2655] Fix two MDAM optimizer bugs. Update optimizer simulator.

  1. … 17 more files in changeset.
[TRAFODION-2605] Rework of fix for TRAFODION-2294

  1. … 4 more files in changeset.
[TRAFODION-2294] Fix permissions hole in Explain

  1. … 12 more files in changeset.
[TRAFODION-2315] Heuristic decision for common subexpressions

This includes various fixes in addition to the heuristic decision,

mainly an improvement on how to navigate between parent and child

common subexpressions.

  1. … 28 more files in changeset.
[TRAFODION-2433] Capture and log call trace upon internal assert failure.

This closes #909

  1. … 7 more files in changeset.
convert all MY_SQROOT to TRAF_HOME

  1. … 294 more files in changeset.