Trafodion

Clone Tools
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Merge "Remove some dead code"

Merge "Security fixes for 144553, 1414125, and 1393529"

Enabled commitId deadcode check and additional trace fixes

Change-Id: I492503077eb7057ba7fe9fa68ea14fb91b7a5ded

Fixed shell script for making mpi files

The zfix shell script had only one name for a temp file, "/tmp/zxx". This did

not allow two builds on the same machine to run the script at the same time.

This is a possible cause of build failures, such as the corrupted mpi.h seen

today in https://jenkins02.trafodion.org/job/build-product-release/141

which had this error:

... /sqf/export/include/mpi.h:837:1: error: unterminated #ifndef ##(MPI)

The temp file name is now "/tmp/zxx.$$" which adds a pid to the end of the name.

Change-Id: I20e6549342fe792fba30524cbc5fe14cca833a1d

Cleanup of comments in log4cpp

Copyright notices in log4cpp files needed some minor changes to make them 100%

correct, since the rules for their copyrights are not the same as elsewhere in

Trafodion. This is preparatory work before adding the source files for log4cpp

to the packaged core product. Those files have small differences from the

files downloaded from http://sourceforge.net/projects/log4cpp version 1.1.1,

and so they should be provided to the end user.

Added the Changelog file which records the differences made by different

people at http://sourceforge.net/projects/log4cpp. The changes for Trafodion

are now listed at the front of this Changelog.

The file include/log4cpp/RemoteSyslogAppender.hh does not have a new copyright

because the change merely corrects a typo. This trivial change does not meet

the threshold for needing a copyright.

In some lines, trailing spaces were restored to reduce the differences from the

original files.

Change-Id: If57d5d394abd664674b7859860ab1ae7ad3d3f1f

    • -0
    • +3825
    /log4cpp/log4cpp-1.1.1/ChangeLog
    • -7
    • +7
    /log4cpp/log4cpp-1.1.1/src/FileAppender.cpp
    • -14
    • +14
    /log4cpp/log4cpp-1.1.1/src/PatternLayout.cpp
    • -6
    • +6
    /log4cpp/log4cpp-1.1.1/src/StringUtil.cpp
  1. … 3 more files in changeset.
Merge "Fix LP bug 1446402 - LIKE patterns longer than 127 chars don't work well"

Remove some dead code

Remove dead code concerned with constraint and schema labels.

This is an anachronism from pre-open-source versions of the code.

Most of the code removed is in the compiler, with a small amount

of cli and executor code removed.

Change-Id: Ic8a833bb15d1ca9a0e2e2683f2d4644b44c4f96b

Security fixes for 144553, 1414125, and 1393529

1445583: showstats command performance slow with security enabled

Several changes were made to improve performance:

Performance optimization:

NATable.cpp: NATable::setupPrivs

- If the current user is the object owner, then default the privilege bitmap

to object Owner values - no need to call PrivMgr to get privileges

Caching optimization:

We are now caching privmgr metadata tables in compiler cache when the compiler

context is instantiated. This avoids a metadata lookup for these tables.

- Added new methods that return if the table is part of the PrivMgr schema

- Adjusted CmpSeabaseDDL::createMDdescs to include privmgr metadata in the

cached entries

- Adjusted CmpSeabaseDDL::getMDtableInfo to check for privmgr metadata tables

from the cached entries

- Removed obsolete code CmpSeabaseDDL::alterSeabaseDropColumn

- changed CmpSeabaseDDL::getSeabaseTableDesc to check for both system and

privmgr metadata from compiler cache

- added new method CmpSeabaseDDL::getPKeyInfoForTable that returns the

primary key name and UID for a table. This is needed when dropping privmgr

metadata tables

Removed extraneous recompilations of HISTOGRAM structures:

Today, update statistics and showstats are reloading NATable entries

for HISTOGRAM tables on every access. This is because the parserflag

ALLOW_SPECIALTABLETYPE is turned on. When this flag is turned, the compiler

always reloads the cache entries - see code from CmpMain::sqlcomp:

//if using special tables e.g. using index as base table

//select * from table (index_table T018ibc);

//then refresh metadata cache

if(Get_SqlParser_Flags(ALLOW_SPECIALTABLETYPE) &&

CmpCommon::context()->schemaDB_->getNATableDB()->cachingMetaData())

CmpCommon::context()->schemaDB_->getNATableDB()->refreshCacheInThisStatement();

Changed code to not set ALLOW_SPECIALTABLETYPE and ALLOW_PHONYCHARACTERS

parserflags by default. Individual statements are setting these flags as needed.

1414125: User without priv can view data in metadata tables

The problem is that a user with priv cannot view data in metadata tables.

Even when a user had SELECT privilege on a system or privmgr metadata table,

the request failed.

The problem is that parameter 2 sent to CmpDescribeIsAuthorized in

hs_globals.cpp is NULL so SELECT priv is not checked. If the user has SHOW

component privilege, it works. A call was added to getPrivileges for metadata

tables before calling CmpDescribeIsAuthorized.

1393529: Core dump accessing MD table descriptors

When "UPDATE STATISTICS LOG [ON, OFF, CLEAR]" is specified by a non DB__ROOT

user, a core dump occurred. This happens because the isAuthorized check is

performed expecting a NATable structure. This command does not need any

special security checks.

Updated traf_authentication_setup script to support a new installation option

Change-Id: If7dbf3ec66e5beb7d88bda61ef32611401dd97b9

    • -83
    • +275
    /sql/sqlcomp/CmpSeabaseDDLcommon.cpp
    • -32
    • +145
    /sql/sqlcomp/CmpSeabaseDDLtable.cpp
Merge "Added versioning for maven-assembly-plugin"

some MT Servers do not return back to AVAILABLE

Fixed synchronization between Listener and Worker Threads

Change-Id: I9929a2713b262a265556c8e1d2930642ba22bebd

Merge "Adding a configurable region split delay limit"

Merge "Fix for bug 1443561"

Merge "Update release version to 1.2 - core"

Adding a configurable region split delay limit

Configuration property that can be set in hbase-site.xml is:

hbase.transaction.split.delay.limit

Default will be 360, which is a 6 hour delay max.

When the delay limit is surpassed, the HBase splits will

no longer be blocked from the TM perspective. HBase may

still have delays due to GC or other operations.

Change-Id: I327e62921a2429f0357a4e3b9ac51d49b0eb58a0

Added versioning for maven-assembly-plugin

Intermittent build errors, see below, on Jenkins machines cannot be reliably

reproduced. We're not seeing this on workstations. Since DCS is

using very old version 2.2-beta-5 we'll experiment with newer

version 2.5.3

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:2.2-beta-5:single (tarball) on project dcs: Failed to create assembly: Error creating assembly archive all: Problem creating TAR: entry closed at '356337' before the '356339' bytes specified in the header were written -> [Help 1]

[ERROR]

[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.

[ERROR] Re-run Maven using the -X switch to enable full debug logging.

[ERROR]

[ERROR] For more information about the errors and possible solutions, please read the following articles:

[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException

Change-Id: Id0837ba28f6d1bc7e574d914da8657a943cf13ca

Transactional DDL - Salted Tables functionality

Added salted table functionality to transactional DDL create

It currently works with large numbers of table partitions and large

key lengths.

Change-Id: Ia5d9113678d697fdcd9f60021fc2dd3eb18fda0f

    • -1
    • +1
    /sqf/export/include/dtm/tmtransaction.h
    • -3
    • +48
    /sqf/src/seatrans/tm/hbasetmlib2/hbasetm.cpp
    • -1
    • +7
    /sqf/src/seatrans/tm/hbasetmlib2/hbasetm.h
  1. … 8 more files in changeset.
Merge "Fix for bug 1446802"

Merge "Adding break out of preSplit() loop on exception"

Fix for bug 1446802

This is a fix on ODBC driver side specifically

against MXOSRVR recent change by bug 1438775

Change-Id: Id1dff8f45a9e121149781ba2a84c983f9265b90f

Fix for bug 1446802

This is a fix on ODBC driver side specifically

against MXOSRVR recent change by bug 1438775

Change-Id: Id1dff8f45a9e121149781ba2a84c983f9265b90f

(cherry picked from commit ca56ccb5b3c054a6ceb042b1d43faacb9564052b)

LP 1446802: ODBC SQLFetch fails when column size is bigger than 64K

Change-Id: Iaa125e18c40bc5953f646740d12ba3b9bbf1c5fb

LP 1446802: ODBC SQLFetch fails when column size is bigger than 64K

Change-Id: Iaa125e18c40bc5953f646740d12ba3b9bbf1c5fb

Merge "Fix for bug 1446043"

Changes to enable Rowset select - Fix for bug 1423327

HBase always returns an empty result set when the row is not found. Trafodion

is changed to exploit this concept to project no data in a rowset select.

Now optimizer has been enabled to choose a plan involving Rowset Select

where ever possible. This can result in plan changes for the queries -

nested join plan instead of hash join,

vsbb delete instead of delete,

vsbb insert instead of regular insert.

A new CQD HBASE_ROWSET_VSBB_SIZE is now added to control the hbase rowset size.

The default values is 1000

Change-Id: Id76c2e6abe01f2d1a7b6387f917825cac2004081

    • -59
    • +158
    /sql/executor/HBaseClient_JNI.cpp
    • -21
    • +21
    /sql/regress/compGeneral/EXPECTED071
  1. … 5 more files in changeset.
Adding break out of preSplit() loop on exception

Also commenting out log message that is filling up client-side

logs even if there is no activity. The zookeeper message will

still be printed as DEBUG to show if the ZNode is not present.

The break of out preSplit() was needed as on a RS abort, the

preSplit can get stuck in a state where it is keeping the RS

process up and in a while/sleep loop.

Change-Id: Ic93ded73d80ecb61c6ceda94339dc53f52ea1bf1

Set Zookeeper's maxClientCnxns=0 and add Ambari 2.0 support

Added code to modify zookeeper's maxClientCnxns=0 to allow

for unlimited connections in Cloudera because build jobs

were failing due to hitting max connections. This was not

a problem in Hortonworks.

Updated ambari_setup script to use latest Ambari 2.0 version.

Change-Id: I74ec08c5dacfe78dad5934fad8634b3c01f62440

ODB bug fixes by Maurizio

Miscellaneous fixes by Maurizio. Some of the changes are related to the

help screen.

Change-Id: Ifbff89b8d6269a00d9f1e2752813d19ef3d852a3

Allow double msg_init.

Change-Id: Iec27a52ba54de72ebef721088bc459ef19ed5a8b

    • -0
    • +8
    /sqf/src/seatrans/tm/hbasetmlib2/idtm.cpp
Merge "mapTransactionStates is now static in RMInterface"

Merge "Change default review branch for stable/1.1" into stable/1.1