Trafodion

Clone Tools
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Enable SQL memory overflow check for debug tests

This testware changes will turn on the SQL memory overflow checking for

NAMemory allocation while running debug regression tests. For some

regression test suites, this could increase the run time to nearly 20%

while the increased time should be less for rest of test suites.

Plus a note added in the comment section for using the memory allocation

tracing feature.

Change-Id: I2e7e5f6b29fb2f0cee8f3a2928ac67b52c914ad5

    • -6
    • +1
    /sql/regress/tools/runregr_executor.ksh
More memory leak Changes

Changes to delete more elements in NATable. LIST or collection type

elements in NATable that collect references are now deleted.

Also removed some defensive code in RMS because it is not valid.

Added code to delete the internal statements when the row

is not found

PatchSet 3 contains the fix for T4 Phoenix test failures

Change-Id: Ib43da75582dd56d2562cb753738abed0ea5842d3

added new DCS Serverna

fixed reported issues:

1. copyright 2015

2. changed tabs to spaces

3. versioning in T2Driver

4. Added detailed description

fixed reported issues.

changed the name of Dcs Serverna to new name Dcs Servermt

changed System.out.println to LOG.debug

changed serverna to servermt in jamon

added property dcs.server.handlers.threads.max. This

property limits number of threads created by Dcs Server.

Default value is 10.

Fixed error in dcs

fixed description of the property

cleanup the code

changed system.out.println to LOG

Change-Id: Ib5b47a5c09171ddd1b1f062fe8e7b26bf31779bd

    • -0
    • +248
    /src/main/java/org/trafodion/dcs/servermt/DcsServer.java
    • -0
    • +70
    /src/main/java/org/trafodion/dcs/servermt/Metrics.java
    • -0
    • +349
    /src/main/java/org/trafodion/dcs/servermt/ServerConstants.java
    • -0
    • +328
    /src/main/java/org/trafodion/dcs/servermt/ServerManager.java
    • -0
    • +456
    /src/main/java/org/trafodion/dcs/servermt/ServerUtils.java
  1. … 45 more files in changeset.
Merge "Fix for more leaks in NATable"

Merge "Change to avoid placing large scan results in RegionServer cache"

TEST checkin-wait for verify-NDCS build fix part-2.

Change-Id: Ieecdb399fc67c9efeb3d59590d28cf79c23b0042

    • -0
    • +23
    /conn/jdbc_type2/native/Vproc.cpp
    • -0
    • +31
    /conn/jdbc_type2/native/Vproc.h
branch-info in SCMBuildStr.h.

Change-Id: I7e7ab87686bf6c55e8fc1d752de578b9e45980fb

Merge "Splitting install_local_hadoop into two scripts."

Merge "Fix for SPJ performance:" into stable/1.0

Merge "Added option to disable SQL plan collection for user queries" into stable/1.0

Splitting install_local_hadoop into two scripts.

This makes it possible to call the part that sets up a Hive TPC-DS

database from the Jenkins regression test environment.

Change-Id: If776fb5fb79d62450b7377be1e8a3ee1f23becbd

    • -0
    • +415
    /sqf/sql/scripts/install_hadoop_regr_test_env
    • -311
    • +10
    /sqf/sql/scripts/install_local_hadoop
Fix for SPJ performance:

Added code in langman to enable connection pooling for T2 when UDRServer

uses T2.

Change-Id: I038be48925965ae8c1483b71f1bb7104a2868468

Merge "The following Launchpad bugs are fixed in this change:"

    • -35
    • +265
    /sql/sqlcomp/CmpSeabaseDDLcommon.cpp
    • -3
    • +31
    /sql/sqlcomp/CmpSeabaseDDLtable.cpp
Merge "Remove code and cqds related to Thrift interface"

memory leak and salted partitions set up fix

change ported from master branch. LP 1418685

Change-Id: I540c6ecda4d44f4ee6112c05cc144061cb50a66e

Merge "T2Driver - more minor fixes"

Fix LP bug 1323865 -ODBC api test fails with Unknown PCode instruction

During PCODE generation, we were attempting to generate a PCODE

instruction to compare two operands for equality. The two operands

had a data type of REC_BYTE_V_ASCII_LONG which is used only by

ODBC. PCIT::getMemoryAddressingMode() does not currently know how

to handle that datatype so it returned AM_NONE for the operand

type. That resulted in a failure later.

Fix was to detect the operand(s) of that datatype and call

ex_clause::pCodeGenerate(...) rather than doing PCODE generation

of the current expression.

Note: Also found a line saying

return ex_clause::pCodeGenerate(space, f);

which has been missing for a long time. We got away with it

because the preceding 'if' was always false for Trafodion.

Files changed:

.../exp/ExpPCodeClauseGen.cpp

Change-Id: I441f5b57fb1b5a67f4e4872d308efe0af5d320db

Fix stubs build.

Change-Id: Ie63538c6a422454408ea584dcc4529460dbf5659

Remove code and cqds related to Thrift interface

ExpHbaseInterface_Thrift class was removed a few months ago. Completing

that cleanup work. exp/Hbase_types.{cpp,h} still remain. These are Thrift

generated files but we use the structs/classes generated for JNI access.

Change-Id: I7bc2ead6cc8d6025fb38f86fbdf7ed452807c445

  1. … 5 more files in changeset.
Change to avoid placing large scan results in RegionServer cache

By default the result of every Scan and Get request to HBase is placed in

the RegionServer cache. When a scan returns a lot of rows this can lead to

cache thrashing, causing results which are being shared by other queries

to be flushed out. This change uses cardinality estimates and hbase row size

estimates along with the configured size of region server cache size to

determine when such thrashing may occur. Heap size for region server is

specified through a cqd HBASE_REGION_SERVER_MAX_HEAP_SIZE. The units are in MB.

The fraction of this heap allocated to block cache is read from the config

file once per session through a lightweight (no disk access) JNI call. The

hueristic used is approximate as it does not consider total number of region

servers or that sometimes a scan may be concentrated in one or a few region

servers. We simply do not place rows in RS cache, if the memory used by all

rows in a scan will exceed the cache in a single RS. Change can be overridden

with cqd HBASE_CACHE_BLOCKS 'ON'. The default is now SYSTEM. Change applies

to both count(*) coproc plans and regular scans.

Change-Id: I0afc8da44df981c1dffa3a77fb3efe2f806c3af1

  1. … 6 more files in changeset.
Merge "Added option to disable SQL plan collection for user queries"

T2Driver - more minor fixes

Change-Id: I6f9ea31172e428a18be77ee87df6da8212847b56

    • -1
    • +1
    /conn/jdbc_type2/native/SQLMXCommonFunctions.cpp
LP and other fixes.

-- LP 1414074. Added 'cleanup obsolete volatile tables' command

-- Added support for 'get all volatile tables' command

-- LP 1411864. Alter Sequence now correctly returns an error if value

specified exceeds the max value

-- LP 1413743. Error indicating sequence number max is reached is now

being returned instead of a numeric overflow error ff max largeint value

is reached while generating sequence numbers.

-- LP 1418685. Partition information is now being set up correctly for

delimited salted tables.

-- changed copyright message

Change-Id: Ic9e532204890a68ea0616b99a3170a0cc735ad53

Signed-off-by: Anoop Sharma <anoop.sharma@hp.com>

    • -386
    • +51
    /sql/executor/ExExeUtilVolTab.cpp
Merge "Changes in T2 driver to support new NA server."

Fix for hang encountered during hive tests.

Added proper copyright.

Added comment to make it clear to readers of the code.

Hive tests have been hanging for quite a while on the official slave

machines.

The cause for this particular hang was that the main thread was

destroying the cursor (ExLobCursor) object . The worker thread was kind

of slow and it continues to access the cursor after the main thread had

destroyed it. pthread calls exhibit undefined behavior when

uninitialized mutex or condition variables are accessed. Added code to

prevent this timing issue in the worker threads.

Added trace utlitlty to diagnose hangs and execution issues.

The trace messages look like this and get logged into trace file on the

local directory named trace_threads.<pid>. It is controlled by an

environment variable TRACE_HDFS_THREAD_ACTIONS.The envvar is checked

only ones and the file handle is checked each time the trace needs to be

done. If file handle is NULL, no message is logged.

Change-Id: I95519b61d71339c719e37500bccae111ce070a15

Fix for more leaks in NATable

Added code to delete more elements in NATable destructor. This

fixes leaks when NATable is destroyed.

Changed the NATable Cache Management to use allocated size rather

than the total size.

This also enables seabase/TEST020 to pass in debug mode.

Change-Id: Ifebc20e602c0149f73f9cefcd11b37c69d9eec74

Merge "Fix memory leak when ComDiagsArea is not deleted" into stable/1.0

Merge "HBaseClient now logs correctly. Updated copyright"

Merge "Added new property to disable sqlplan for user queries"

Disable seabase/TEST024

Change-Id: Ife00eedd8b09aae17ada84959930847bdf5684a0

    • -2
    • +2
    /sql/regress/tools/runregr_seabase.ksh