QRLogger.cpp

Clone Tools
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Merge remote branch 'origin/pr/1503/head' into merge_1503

  1. … 8 more files in changeset.
Performance changes for LOB and increasing limit for larger varchars/bobs to use with batch input.

  1. … 17 more files in changeset.
Merge PR 1417 [TRAFODION-2917] Refactor Trafodion implementation of hdfs scan for text formatted hive tables

  1. … 9 more files in changeset.
Reworks in response to concerns from Hans

  1. … 3 more files in changeset.
[TRAFODION-2927] Refactor and improve UPDATE STATISTICS logging

  1. … 13 more files in changeset.
[TRAFODION-2917] Refactor Trafodion implementation of hdfs scan for text formatted hive tables

Part-2 changes

Introduced a new CQD USE_LIBHDFS_SCAN 'OFF' to switch to the new implementation

The new implementation details are at executor/ExHdfsScan.h

Fixed a bug that was causing unexpected errors in JVM when the JNI object corresponding

to java class is not initialized correctly

  1. … 27 more files in changeset.
lcov: commit #1

  1. … 333 more files in changeset.
[TRAFODION-2596] Improve the log4j and log4cxx infrastructure in Trafodion

Removed setting the root logger to be the appender logger in most of

the configuration files. This would allow T2 driver applications

to have control over the logging in their layer to its preferred way.

But, the logging in SQL engine layer will be controlled by the Trafodion

engine itself.

Changed the code so that the logging location and the file name is

picked up from the config file.

  1. … 8 more files in changeset.
[TRAFODION-2596] Improve the log4j and log4cxx infrastructure in Trafodion

The following changes are made in the way Trafodion logs the messages:

Writes to a log file based on a component or set of components.

C++ part of the code base:

Component Default log file Configuration File

TM tm_<nid>.log log4cxx.trafodion.tm.config

SSCP sscp_<nid>.log log4cxx.trafodion.sscp.config

SSMP ssmp_<nid>.log log4cxx.trafodion.ssmp.config

All SQL processes trafodion.sql_<nid>.log log4cxx.trafodion.sql.config

mxosrvr

sqlci

tdm_arkesp

tdm_arkcmp

tdm_udrserv

Java part of the code base

TM trafodion.dtm.log log4j.dtm.config

SQL trafodion.sql.java.log log4j.sql.config

By default, the log level is set to INFO for most of the cases. When a message

dominates the log file and if doesn't add value in the current level, it will be

changed to the higher level in the hierarchy. This should help to improve the

usefulness of the log file at the default INFO level.

The existence of an environment variable TRAF_MULTIPLE_SQL_LOG_FILE will revert back

to the old way of logging into multiple files. Then, the configuration file

log4cxx.trafodion.masterexe.config will be used.

Currently, RollingFileAppender appender is used for both modes. Different config files

are used to change this appender when the need arises.

log4cxx.trafodion.udr.config and log4cxx.trafodion.lob.config are removed.

log4j.hdfs.config used as the config file for SQL is renamed to log4j.sql.config

Foundation components logging will be revamped later.

This closes #1070

  1. … 19 more files in changeset.
Merge remote branch 'origin/master' into TRAFODION-2001

Conflicts:

core/sqf/monitor/linux/config.cxx

core/sqf/monitor/linux/pnodeconfig.cxx

core/sqf/monitor/linux/pnodeconfig.h

core/sqf/monitor/linux/reqqueue.cxx

core/sqf/monitor/linux/shell.cxx

core/sqf/sql/scripts/gensq.pl

core/sqf/sql/scripts/sqconfig

core/sqf/sql/scripts/sqconfig.sample

core/sqf/sql/scripts/sqgen

core/sqf/sql/scripts/sqnodestatus

  1. … 28 more files in changeset.
[TRAFODION-2422] populateSortCols was flagged as major perf offender during profiling the reason being an unbound iterative string search on huge string. Added a minor fix: When not setting category in log conf file, extra code is executed, potentially impacting performance

  1. … 1 more file in changeset.
Merge remote branch 'origin/master' into TRAFODION-2001

Conflicts:

install/installer/addNode_step2

  1. … 8 more files in changeset.
[TRAFODION-2296] Consistent error reporting in abort, commit transaction. Changes to wait for all RS to respond when there is an exception in abort and commit transaction requests.

When there is an error returned from commit or rollback transaction, the details of the error can be obtained in the following log files

a) $MY_SQROOT/logs/tm_.log in the node that issued this request contains the error message as seen by the TM process in the JNI side. This event may not have transaction id.

b) $MY_SQROOT/logs/trafodion.dtm.log contains more info about this error with the transaction id. These events are logged from java side of TM.

c) In the region server logs of all the regions that participated in the transaction.

These exceptions are visible as error code on the client side. To get the details about the exception, the above logs need to be browsed.

Fixes to avoid tm core upon double delete of incoming messages to it

This closes #768

  1. … 7 more files in changeset.
Merge remote branch 'origin/master' into TRAFODION-2001

  1. … 3 more files in changeset.
[TRAFODION-2262] Mxosrvr or java core with the stack trace pointing to log4Cxx functions

The Logger repository needs to be initialized. The method QRLogger::initLog4cxx

initialized the commonLogger infrastructure also.

PR #745 merged to fix this issue exposed a problem in SSMP. This

caused SSMP to dump core when a node is brought down.

SSMP should have create the connection to SSCP on that node.

  1. … 3 more files in changeset.
[TRAFODION-2261] Mxosrvr or java core with starting from Java_org_trafodion_jdbc_t2_SQLMXConnection_close [TRAFODION-2262] Mxosrvr or Java core with the stack trace pointing to log4Cxx functions

IpcServerClass was not getting destructed correctly. When the CLI context is deleted, the ESP

server class object an IpcServerClass instance that manages the ESP server started

in the CLI context are also destroyed. Fixed the IpcServerClass and IpcServer destructors

so that there is no memory corruption.

Log4Cxx infrastructure in SQL was recursively attempting to log the messages when there is an

issue with it. This was causing stack corruption.

Also added a code to initialize the log4cxx infrastructure if it is not done already upon

the first CLI call.

  1. … 9 more files in changeset.
Fix to sqlci abort on added node.

Most of the Trafodion Java source files are built through Maven, using projects DCS, REST, HBase-trx and SQL. A few files remain in the core/sql/executor and core/sql/ustat directories that are built through javac commands in the Makefile and helper files. Also, these files don't conform to common naming standards and therefore are a bit harder to debug with tools like Eclipse.

I would like to do the following:

1. Move these remaining Java source files under core/sql/src,

where the UDR-related files already are.

2. Include the class files in trafodion-sql-1.2.0.jar, the

deliverable of the core/sql Maven project.

3. Change the package name to org.trafodion.sql for all these files.

4. Remove the trafodion-HBaseAccess-1.2.0.jar file (content

will be included in trafodion-sql-1.2.0.jar). This jar file

used to be built with a Makefile.

5. Make some source code changes to reflect the new package names

and to avoid calling private method of class

org.apache.hadoop.hive.ql.io.orc.OrcStruct.

6. Remove Makefile rules for compiling Java files.

Also, this change includes a change of the component name for the

event logger. We use SQL.COMP now, to make analyzing log messages

for Trafodion easier. Venkat asked for this change.

  1. … 44 more files in changeset.
JIRA TRAFODION-1488

Fixed several issues related to logging:

log4cxx.trafodion.masterexe.config changes:

- The timestamp was not being reported in the log4cxx files

- Messages were being displayed twice

- Turned on debug logging for privilege manager events

SQL logging mechanism:

- Messages were not being displayed when expected

Regression test logging:

- changed TEST009 to log hive requests to a rundir log. This test is

failing during daily runs and this change will help isolate the issue.

  1. … 8 more files in changeset.
Changes for JIRA TRAFODION-353, 1200, 1214, and 12

1. JIRA Trafodion-353 (Launchpad 1324716):

.traf_authentication_config syntax errors on blank

corrected

2. JIRA Trafodion-1200 (Launchpad 1447336):

DB__ROOTROLE now equivalent to DB__ROOT (completed

in this delivery).

3. JIRA Trafodion-1214 (Launchpad 1450122):

LDAPSSL (level 1) now uses TLS_CACERTFILE.

4. JIRA Trafodion-12 - grant revoke enhancements including:

Six new component-level privileges: DML_DELETE, DML_INSERT,

DML_REFERENCES, DML_SELECT, DML_UPDATE, and DML_USAGE.

Authorization IDs granted a DML privilege at the system

(SQL_OPERATIONS component-level) have the privilege

on all objects in the Trafodion database.

Users who have the MANAGE_PRIVILEGE component-level privilege

can also grant "WITH GRANT OPTION" any privilege they have.

In addition, they implicitly grant on behalf of the owner when

the GRANTED BY clause is omitted. (Mimics DB__ROOT behavior.)

Tracing had been added (but not yet enabled) to better debug

grant and revoke problems

Column level privilege enforcement has been added and column

level privileges support is enabled.

  1. … 25 more files in changeset.
Part 2 of changes to update license text in Trafodion source

This check-in updates license text in all source files in the

core/sql directory. Remaining directories will be done in

later check-ins.

  1. … 3147 more files in changeset.
remove OSIM logger

  1. … 2 more files in changeset.
Rework OSIM logging

OSIM messages are outputted to console and master_exec

  1. … 5 more files in changeset.
Merge remote branch 'log4cxx/temp-merge' into migrate_log4cpp_to_log4cxx

Conflicts:

core/log4cpp/.gitignore

core/log4cpp/log4cpp-1.1.1/COPYING

core/log4cpp/log4cpp-1.1.1/ChangeLog

core/log4cpp/log4cpp-1.1.1/include/.cvsignore

core/log4cpp/log4cpp-1.1.1/include/Makefile.am

core/log4cpp/log4cpp-1.1.1/include/Makefile.in

core/log4cpp/log4cpp-1.1.1/include/config.h.in

core/log4cpp/log4cpp-1.1.1/include/log4cpp/.cvsignore

core/log4cpp/log4cpp-1.1.1/include/log4cpp/AbortAppender.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/Appender.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/AppenderSkeleton.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/AppendersFactory.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/BasicConfigurator.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/BasicLayout.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/BufferingAppender.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/Category.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/CategoryStream.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/Configurator.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/Export.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/FactoryParams.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/FileAppender.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/Filter.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/FixedContextCategory.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/HierarchyMaintainer.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/IdsaAppender.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/Layout.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/LayoutAppender.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/LayoutsFactory.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/LevelEvaluator.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/LoggingEvent.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/Makefile.am

core/log4cpp/log4cpp-1.1.1/include/log4cpp/Makefile.in

core/log4cpp/log4cpp-1.1.1/include/log4cpp/Manipulator.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/NDC.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/NTEventLogAppender.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/OstreamAppender.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/PassThroughLayout.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/PatternLayout.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/Portability.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/Priority.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/PropertyConfigurator.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/RemoteSyslogAppender.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/RollingFileAppender.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/SimpleConfigurator.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/SimpleLayout.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/SmtpAppender.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/StringQueueAppender.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/SyslogAppender.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/TimeStamp.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/TriggeringEventEvaluator.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/TriggeringEventEvaluatorFactory.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/Win32DebugAppender.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/config-MinGW32.h

core/log4cpp/log4cpp-1.1.1/include/log4cpp/config-openvms.h

core/log4cpp/log4cpp-1.1.1/include/log4cpp/config-win32-stlport-boost.h

core/log4cpp/log4cpp-1.1.1/include/log4cpp/config.h

core/log4cpp/log4cpp-1.1.1/include/log4cpp/convenience.h

core/log4cpp/log4cpp-1.1.1/include/log4cpp/threading/BoostThreads.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/threading/DummyThreads.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/threading/MSThreads.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/threading/Makefile.am

core/log4cpp/log4cpp-1.1.1/include/log4cpp/threading/Makefile.in

core/log4cpp/log4cpp-1.1.1/include/log4cpp/threading/OmniThreads.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/threading/PThreads.hh

core/log4cpp/log4cpp-1.1.1/include/log4cpp/threading/Threading.hh

core/log4cpp/log4cpp-1.1.1/src/.cvsignore

core/log4cpp/log4cpp-1.1.1/src/AbortAppender.cpp

core/log4cpp/log4cpp-1.1.1/src/Appender.cpp

core/log4cpp/log4cpp-1.1.1/src/AppenderSkeleton.cpp

core/log4cpp/log4cpp-1.1.1/src/AppendersFactory.cpp

core/log4cpp/log4cpp-1.1.1/src/BasicConfigurator.cpp

core/log4cpp/log4cpp-1.1.1/src/BasicLayout.cpp

core/log4cpp/log4cpp-1.1.1/src/BufferingAppender.cpp

core/log4cpp/log4cpp-1.1.1/src/Category.cpp

core/log4cpp/log4cpp-1.1.1/src/CategoryStream.cpp

core/log4cpp/log4cpp-1.1.1/src/Configurator.cpp

core/log4cpp/log4cpp-1.1.1/src/DllMain.cpp

core/log4cpp/log4cpp-1.1.1/src/DummyThreads.cpp

core/log4cpp/log4cpp-1.1.1/src/FactoryParams.cpp

core/log4cpp/log4cpp-1.1.1/src/FileAppender.cpp

core/log4cpp/log4cpp-1.1.1/src/Filter.cpp

core/log4cpp/log4cpp-1.1.1/src/FixedContextCategory.cpp

core/log4cpp/log4cpp-1.1.1/src/HierarchyMaintainer.cpp

core/log4cpp/log4cpp-1.1.1/src/IdsaAppender.cpp

core/log4cpp/log4cpp-1.1.1/src/LayoutAppender.cpp

core/log4cpp/log4cpp-1.1.1/src/LayoutsFactory.cpp

core/log4cpp/log4cpp-1.1.1/src/LevelEvaluator.cpp

core/log4cpp/log4cpp-1.1.1/src/Localtime.cpp

core/log4cpp/log4cpp-1.1.1/src/Localtime.hh

core/log4cpp/log4cpp-1.1.1/src/LoggingEvent.cpp

core/log4cpp/log4cpp-1.1.1/src/MSThreads.cpp

core/log4cpp/log4cpp-1.1.1/src/Makefile

core/log4cpp/log4cpp-1.1.1/src/Makefile.am

core/log4cpp/log4cpp-1.1.1/src/Makefile.in

core/log4cpp/log4cpp-1.1.1/src/Manipulator.cpp

core/log4cpp/log4cpp-1.1.1/src/NDC.cpp

core/log4cpp/log4cpp-1.1.1/src/NTEventLogAppender.cpp

core/log4cpp/log4cpp-1.1.1/src/OmniThreads.cpp

core/log4cpp/log4cpp-1.1.1/src/OstreamAppender.cpp

core/log4cpp/log4cpp-1.1.1/src/PThreads.cpp

core/log4cpp/log4cpp-1.1.1/src/PassThroughLayout.cpp

core/log4cpp/log4cpp-1.1.1/src/PatternLayout.cpp

core/log4cpp/log4cpp-1.1.1/src/PortabilityImpl.cpp

core/log4cpp/log4cpp-1.1.1/src/PortabilityImpl.hh

core/log4cpp/log4cpp-1.1.1/src/Priority.cpp

core/log4cpp/log4cpp-1.1.1/src/Properties.cpp

core/log4cpp/log4cpp-1.1.1/src/Properties.hh

core/log4cpp/log4cpp-1.1.1/src/PropertyConfigurator.cpp

core/log4cpp/log4cpp-1.1.1/src/PropertyConfiguratorImpl.cpp

core/log4cpp/log4cpp-1.1.1/src/PropertyConfiguratorImpl.hh

core/log4cpp/log4cpp-1.1.1/src/RemoteSyslogAppender.cpp

core/log4cpp/log4cpp-1.1.1/src/RollingFileAppender.cpp

core/log4cpp/log4cpp-1.1.1/src/SimpleConfigurator.cpp

core/log4cpp/log4cpp-1.1.1/src/SimpleLayout.cpp

core/log4cpp/log4cpp-1.1.1/src/SmtpAppender.cpp

core/log4cpp/log4cpp-1.1.1/src/StringQueueAppender.cpp

core/log4cpp/log4cpp-1.1.1/src/StringUtil.cpp

core/log4cpp/log4cpp-1.1.1/src/StringUtil.hh

core/log4cpp/log4cpp-1.1.1/src/SyslogAppender.cpp

core/log4cpp/log4cpp-1.1.1/src/TimeStamp.cpp

core/log4cpp/log4cpp-1.1.1/src/TriggeringEventEvaluatorFactory.cpp

core/log4cpp/log4cpp-1.1.1/src/Win32DebugAppender.cpp

core/log4cpp/log4cpp-1.1.1/src/macros.gmk

core/log4cpp/log4cpp-1.1.1/src/snprintf.c

core/log4cpp/log4cpp-1.1.1/src/verslib.h

core/log4cpp/log4cpp-1.1.1/src/verslog4cpplib.cpp

core/sqf/conf/log4cpp.monitor.mon.config

core/sqf/conf/log4cpp.monitor.mon.snmp.config

core/sqf/conf/log4cpp.monitor.psd.config

core/sqf/conf/log4cpp.monitor.wdg.config

core/sqf/conf/log4cpp.monitor.wdg.snmp.config

core/sqf/conf/log4cpp.trafodion.lob.config

core/sqf/conf/log4cpp.trafodion.masterexe.config

core/sqf/conf/log4cpp.trafodion.sscp.config

core/sqf/conf/log4cpp.trafodion.ssmp.config

core/sqf/conf/log4cpp.trafodion.tm.config

core/sqf/conf/log4cpp.trafodion.udr.config

core/sql/bin/vers_log4cpp.cpp

sql/bin/vers_log4cpp.cpp

sql/bin/vers_log4cxx.cpp

  1. … 220 more files in changeset.
Move core into subdir to combine repos

  1. … 10768 more files in changeset.
Move core into subdir to combine repos

  1. … 10622 more files in changeset.
Move core into subdir to combine repos

Use: git log --follow -- <file>

to view file history thru renames.

  1. … 10837 more files in changeset.