Trafodion

Clone Tools
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Report ports used by install_local_hadoop

Added options -n and -v to install_local_hadoop so it prints the

ports numbers it configures. Also improved the help text which

now is:

install_local_hadoop [ -p {<start port num> | rand | fromDisplay} ]

[ -y ]

[ -n ]

[ -v ]

-p configures non-standard ports, and is one of:

-p <start port num> custom cases

-p rand for shared systems, use a random start port number

between 9000 and 49000 that is divisible by 200

-p fromDisplay if you are running on a VNC session

-y answers interactive questions implicitly with yes

-n takes no action, useful with -v

-v lists the port values used

See script header for use of optional environment variables.

For example:

$ install_local_hadoop -v -n

MY_DCS_MASTER_INFO_PORT=40010

MY_DCS_MASTER_PORT=37800

MY_DCS_SERVER_INFO_PORT=40030

MY_HADOOP_DN_HTTP_PORT_NUM=50075

MY_HADOOP_DN_IPC_PORT_NUM=50020

MY_HADOOP_DN_PORT_NUM=50010

MY_HADOOP_HDFS_PORT_NUM=9000

MY_HADOOP_JOB_TRACKER_HTTP_PORT_NUM=50030

MY_HADOOP_NN_HTTP_PORT_NUM=50070

MY_HADOOP_SECONDARY_NN_PORT_NUM=50090

MY_HADOOP_SHUFFLE_PORT_NUM=8080

MY_HADOOP_TASK_TRACKER_PORT_NUM=50060

MY_HBASE_MASTER_INFO_PORT_NUM=60010

MY_HBASE_MASTER_PORT_NUM=60000

MY_HBASE_REGIONSERVER_INFO_PORT_NUM=60030

MY_HBASE_REGIONSERVER_PORT_NUM=60020

MY_HBASE_REST_PORT_NUM=8080

MY_HBASE_ZOOKEEPER_LEADERPORT_NUM=3888

MY_HBASE_ZOOKEEPER_PEERPORT_NUM=2888

MY_HBASE_ZOOKEEPER_PROPERTY_CLIENTPORT_NUM=2181

MY_REST_SERVER_PORT=4200

MY_REST_SERVER_SECURE_PORT=4201

MY_SQL_PORT_NUM=3346

MY_YARN_ADMIN_PORT_NUM=8033

MY_YARN_HTTP_PORT_NUM=8088

MY_YARN_LOCALIZER_PORT_NUM=8040

MY_YARN_NM_PORT_NUM=8041

MY_YARN_RESMAN_PORT_NUM=8032

MY_YARN_SCHED_PORT_NUM=8030

MY_YARN_TRACKER_PORT_NUM=8031

$

Because more options were added, changed the test of them to a loop instead

of sequential tests.

Removed trailing spaces.

Change-Id: Ia4c7acd89a7556c4f14af7e75b8f28c98abee48c

    • -64
    • +129
    /sqf/sql/scripts/install_local_hadoop
Fixes to copyright check script

1. Changed updateCopyrightCheck.py so that it does not use the

argparse module (removing the dependency on Python 2.7).

2. Deleted some debug code.

3. Fixed some line continuation bugs.

Change-Id: I32a0d80d6cf3a8927ef4537c473cf14891bda483

Merge "Expected file change for failing hive test."

Update release version to 1.2 - dcs

Distinguish master branch from stable/1.1 branch.

If next release is determined to be a major release, this will

be updated again before release. Assuming minor release keeps

options open.

Test depends on version of server, since we are transitioning the

release version, relax the tests to accept 1.1 or 1.2.

Change-Id: I299cffad66dd661f05c711142ab05ffe3271e768

Update release version to 1.2 - core

Distinguish master branch from stable/1.1 branch.

If next release is determined to be a major release, this will

be updated again before release. Assuming minor release keeps

options open.

Need updated JDBC tests that accept either release number.

Depends-On: I299cffad66dd661f05c711142ab05ffe3271e768

Change-Id: I5f2fc71f9e31a5df3fa8d611c224e3ef9d491b3f

Merge "create meta column family for transaction data"

Expected file change for failing hive test.

A previous checkin that enhanced an error message and caused this diff. So

just had to update the expected file.

Change-Id: I1cc5133e7bf971b98fc6e79f7cad05553eed6b46

(cherry picked from commit 233d4ca7bf16d5bb629be069e87a2f06e5956c02)

Expected file change for failing hive test.

A previous checkin that enhanced an error message and caused this diff. So

just had to update the expected file.

Change-Id: I1cc5133e7bf971b98fc6e79f7cad05553eed6b46

Added more exception handling

Change-Id: Ida87f03b4891050de3df31d48dd0b88f89b556c8

    • -153
    • +217
    /src/test/pytests/test_p2.py
Merge "Adding logic to the core Trafodion build to check for copyrights."

Merge "Closes-Bug: 1438340"

Add new tmlib callback to propagate startid.

Change-Id: I42dac4838228c14d445bed2692dceaae2586a36e

    • -1
    • +2
    /sqf/export/include/seabed/int/types.h
    • -16
    • +111
    /sqf/src/seabed/src/msmon.cpp
  1. … 10 more files in changeset.
Delay added to TransactionManager call retries, LP 1439387

Change-Id: Iccaf80cb787661c95648c37fbb31b6e7f4d8badb

Delay added to TransactionManager call retries, LP 1439387

Change-Id: Iccaf80cb787661c95648c37fbb31b6e7f4d8badb

Fix for when REST server is not present in the build

If installing a 1.0 Trafodion build, the REST server is not

present. This fix adds logic to check if the REST server is

in the Trafodion build and handle it appropriately by not trying

to isntall it.

Change-Id: Ied4fb00403422e72926842f274f275675990ec5c

Adding logic to the core Trafodion build to check for copyrights.

The core Makefile now includes a check-copyrights step, which

checks to see if any changed files in your workspace need

copyright updates. If so, the build fails; the script will tell

you what files to update.

If you prefer, you can configure the script so that it will

automatically update the copyrights for you instead of failing

your build. To do that, export the environment variable

UPDATE_COPYRIGHTS=YES before doing your make.

Note that new files will only be checked if you have previously

done a "git add" command for them. Otherwise only changed

existing files are checked.

Change-Id: Ia643be91bea34832fddcd5a9467959f0726d71d9

    • -0
    • +234
    /updateCopyrightCheck.py
Change default review branch for stable/1.1

Change-Id: Ia83ac3e88b185e2b3e9193d4432b587e2c293c01

Merge "Fix for bug 1437102"

Merge "Fix for bug 1438775"

Closes-Bug: 1438340

Fixes 'sqnodeipcrm' errors reported during sqstart.

Change-Id: Ie3172fea38382c1e643e5a6f14e8ec7233cb3c3a

Fix for bug 1437102

Recently we turned off fast path IPC processiong for T2 to fix an other bug. With that we are exectuing non fast path code which was not being used for a long time even in SQ. As some changes were made to IPC layer, changes to this path were missed. So any ESP plan in T2 is hanging in non fast path because we are using BAWAITIOX instead of thread specific BAWAITIOXTS. This was not caught because none of T2 tests have any ESP plan queries.

Change-Id: Ie1e59d108fe6b49656407885bbabca2d1ebc60f6

Fix for bug 1438775

The fetch buffer size calculation did not account for varchar indicator

length for columns greater than 32K. The indicator length in this case is 4 bytes instead of 2. Currently, the buffer length calculation was using 2, which resulted in allocating insufficient memory leading to a corruption.

Fixes bug 1438775

Change-Id: Ib16b6644ca3c7f36d96687a33ea36ad4f0ffe903

Fix for bug 1443688

Explain plan is now collected only for non-unique query types and queries that generate stats.

Also, fixed a bug where explain plan was being collected even though the

statistics feature is disabled.

Fixes bug 1443688

Change-Id: I67433083758044e1da0071241e00c4a09e701dbd

    • -0
    • +11
    /conn/odbc/src/odbc/nsksrvr/SrvrConnect.cpp
Merge "Support for TM not running state - output for REST/HPDSM"

Merge "Fix LP Bug 1382686 - LIKE predicate fails on some UTF8 columns"

Merge "[bug:1440941]T2 Phoenix tests creating cores at CliStatement::doOltExecute"

    • -0
    • +6
    /conn/jdbc_type2/native/SqlInterface.cpp
Support for TM not running state - output for REST/HPDSM

Added a new state for dtmci to handle all error situations when

a response is not received by the TM. So far, these errors are

handled as a NOT RUNNING state for the TM. Display in json format

has been corrected.

Change-Id: Id19c73a47ad4ae49dac231962e1d3d5e8ae96dc0

Merge "Fixes in T2 driver to enable OE performance run"

Fix LP Bug 1382686 - LIKE predicate fails on some UTF8 columns

The description of this LP bug says that the LIKE predicate fails when

the pattern string starts with a '%' and when selecting from a view, but

not when selecting from the underlying table. However, in the supplied

reproducible test case, the view's column had a character set of UTF8

while the underlying table had a character set of UCS2.

As it turns out, the real problem is not related to selecting from a

view. The root cause is a bug in the PCODE implementation for the LIKE

predicate and this problem can occur any time the LIKE predicate is

applied to a column declared as VARCHAR(nnn) CHARACTER SET UTF8 where

128 <= nnn <= 255... and the problem may not be limited to situations

where the LIKE pattern starts with a '%'.

When nnn > 255, the PCODE implmentation is not used, so the problem does

not occur then.

The root cause is a place in the code where the length of the column (in

characters, not bytes) is stored in a single byte and is retrieved as if

that byte contains a *signed* value. When 128 <= nnn <= 255, that

retrieval results in a negative value. The fix is to retrieve the value

as an *unsigned* value.

NOTE: This commit changes 2 lines of code. The second line changed is

the only one necessary to fix the problem. The first line is being

changed as well because it has a similar problem and would prevent the

LIKE predicate from working properly if the LIKE pattern had more than

127 pattern parts.

Change-Id: Ideb063cbd62b9155e9b1f579bcd0edb187e8a1c8

Merge "Updated known diff file for compGeneral/TEST006"