Clone Tools
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Added blank line to test commit permission

Merge [TRAFODION-2626] Make conf directory location configurable

This closes #1129

Squash merge of:

commit c679ffdd235d3f53d6f502931f5ab970d938819d

Author: Steve Varnau <steve.varnau@esgyn.com>

Date: Mon Jun 26 21:00:48 2017 +0000

[TRAFODION-2626] Updated to include recent additions to conf

Updated to modify recently added references to conf dir in jira

TRAFODION-2654.

Author: Steve Varnau <steve.varnau@esgyn.com>

Date: Mon Jun 26 20:51:24 2017 +0000

Merge remote branch 'origin/master' into traf2626_conf

commit b0dcf05aa2b2580700b214dfb12543ff0a1102df

Author: Steve Varnau <steve.varnau@esgyn.com>

Date: Tue Jun 20 16:27:44 2017 +0000

[TRAFODION-2626] Make conf directory location configurable

For user configuration files, use TRAF_CONF variable instead of

TRAF_HOME/conf.

In cases where we want to install config files to an alternate location

(say TRAF_CONF=/etc/trafodion), we would copy all the default files from

TRAF_HOME/conf to TRAF_CONF and make modifications in the TRAF_CONF location.

In development workspace, both locations can be one in the same.

One case where I left the original path is for the install_features file.

This file identifies version features and is not a user-configurable file.

Hence it should be read from the TRAF_HOME/conf location.

  1. … 13 more files in changeset.
[TRAFODION-2654] Change the location of trafodion-site.xml from $TRAF_HOME/etc to config [TRAFODION-2653] Sort operator loops at times

All HBase client connections from Trafodion uses Trafodion configuration

concept. Any client side property can now be set in trafodion-site.xml.

The scratch files are now open in blocking mode. Hence any scratch file

operation shouldn't return EAGAIN.

The internal table TDDL of table is now created without any table

coprocessors attached to it.

  1. … 22 more files in changeset.
This is a large contribution of changes from Esgyn TransactionManager and libraries that are collectively much better tested and hardened than Trafodion, but are too numerous and complex to cherry pick individually.

The changes include:

Dozens of bug fixes

Improved recovery after HBase failures

Better error reporting and tracing, which includes region keys for easier debugging

Reduced UnknownTransactionExceptions resulting from duplicate transaction registration

Better TLOG management including reducing the default number of tables

    • -158
    • +273
    ./dtm/HBaseAuditControlPoint.java
  1. … 19 more files in changeset.
[TRAFODION-2592] Better error message when HBase is down at startup.

This code was written by Narendra Goyal.

    • -0
    • +299
    ./dtm/hbstatus.java
  1. … 2 more files in changeset.
Merge [TRAFODION-2449] PR 1028 Adding dtmci 'status regions' command

[TRAFODION-2449] dtmci - Adding 'status regions' command

Implementing changes from code review

  1. … 4 more files in changeset.
[TRAFODION-2449] dtmci - Adding 'status regions' command

Prints the full region name, hostname:port, and startkey/endkeys in hex format.

  1. … 4 more files in changeset.
fix based on review comments.

[TRAFODION-2468] DDL HA , step 2 changes(please refer jira).

  1. … 1 more file in changeset.
fix feedback comments.

[TRAFODION-2150] and [TRAFODION-2151] TM long prepare and chore thread issues.

  1. … 1 more file in changeset.
[TRAFODION-2414] enhance 8616 commit conflict error message to include tx conflict details.

    • -0
    • +70
    ./dtm/TransactionManagerException.java
  1. … 30 more files in changeset.
convert all MY_SQROOT to TRAF_HOME

  1. … 294 more files in changeset.
[TRAFODION-2325] Reduce path length by avoiding expensive APIs

Avoided calling System.getenv() many times

  1. … 3 more files in changeset.
[TRAFODION-2306] Trafodion customization using its own configuration

    • -0
    • +1
    ./sql/TrafConfiguration.java
  1. … 3 more files in changeset.
[TRAFODION-2306] Trafodion customization using its own configuration file

When sqgen is run, the customization resource file for Trafodion trafodion-site.xml

with pre-defined properties, can be found at $MY_SQROOT/etc.

You can add client side hbase properties with 'trafodion.' prefixed. These properties

become effective in the client Trafodion processes with 'trafodion.' stripped off.

When you modify this file, it needs to be copied to all nodes of Trafodion cluster

and Trafodion restarted.

This closes PR #777

  1. … 8 more files in changeset.
[TRAFODION-2306] Trafodion customization using its own configuration file

See JIRA for details

  1. … 7 more files in changeset.
[TRAFODION-2296] Consistent error reporting in abort, commit transaction. Changes to wait for all RS to respond when there is an exception in abort and commit transaction requests.

When there is an error returned from commit or rollback transaction, the details of the error can be obtained in the following log files

a) $MY_SQROOT/logs/tm_.log in the node that issued this request contains the error message as seen by the TM process in the JNI side. This event may not have transaction id.

b) $MY_SQROOT/logs/trafodion.dtm.log contains more info about this error with the transaction id. These events are logged from java side of TM.

c) In the region server logs of all the regions that participated in the transaction.

These exceptions are visible as error code on the client side. To get the details about the exception, the above logs need to be browsed.

Fixes to avoid tm core upon double delete of incoming messages to it

This closes #768

  1. … 7 more files in changeset.
Fix for TLOG looping in deleteEntriesOlderThanASN JIRA [TRAFODION-2253]

[TRAFODION-2236] Fix to handle bad TM ZK node entries during recovery This is the second fix for JIRA [TRAFODION-2236] [Author: Sean Broeder <sbroeder@edev06.esgyn.local>]

Squashed commit of the following:

commit 66030b519c49b4abe66b8b49b9ddc63a9543d8fc

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Thu Sep 29 18:55:39 2016 +0000

Addressing review comments

commit c1b22cf41eeb56c3002a2ca86d2b204772667b9d

Merge: 6ee98ca a62e76f

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Thu Sep 29 16:14:16 2016 +0000

Merge remote branch 'sbroeder_inctraf/sean_traf' into sean_traf

commit 6ee98cab2a8adf07df365131f431f1ded3e15d3a

Merge: 98a1ec6 b352dd8

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Thu Sep 29 15:14:38 2016 +0000

Merge remote branch 'sbroeder_inctraf/sean_traf' into sean_traf

Conflicts:

core/sqf/src/seatrans/tm/hbasetmlib2/src/main/java/org/trafodion/dtm/HBaseTxClient.java

commit a62e76faf1753a02dd9095aa1061829b537da49f

Merge: 98a1ec6 b352dd8

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Thu Sep 29 15:14:38 2016 +0000

Merge remote branch 'sbroeder_inctraf/sean_traf' into sean_traf

Conflicts:

core/sqf/src/seatrans/tm/hbasetmlib2/src/main/java/org/trafodion/dtm/HBaseTxClient.java

commit 98a1ec6bdf0eb9b69fbb6f4d8c908e657638ba54

Merge: d7232d3 fd4fadf

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Wed Sep 28 23:20:57 2016 +0000

Fix to handle bad TM ZK node entries during recovery

commit b352dd8f1fdab8f73bf2f4dea3b0ac757dd6ad29

Merge: d7232d3 fd4fadf

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Wed Sep 28 23:20:57 2016 +0000

Fix to handle bad TM ZK node entries during recovery

commit d7232d3f816129464a3449cea56a10919794ddd2

Merge: 0ccafa2 1e94882

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Wed Sep 28 23:19:20 2016 +0000

Merge branch 'master' of github.com:apache/incubator-trafodion into sean_traf

commit fd4fadffab1f969dd1e3e735b01a9c62d9bb9766

Author: Sean Broeder <sean.broeder@esgyn.com>

Date: Tue Sep 27 10:22:02 2016 -0700

Update TransactionManager.java

commit 0ccafa240eb1ee225226c18c1396204830bea8ad

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Tue Sep 27 03:13:23 2016 +0000

Fix to handle bad TM ZK node entries during recovery

This is the second fix for JIRA [TRAFODION-2236]

This closes #730

  1. … 5 more files in changeset.
Addressing review comments

  1. … 1 more file in changeset.
Merge remote branch 'sbroeder_inctraf/sean_traf' into sean_traf

Conflicts:

core/sqf/src/seatrans/tm/hbasetmlib2/src/main/java/org/trafodion/dtm/HBaseTxClient.java

  1. … 1 more file in changeset.
Fix to handle bad TM ZK node entries during recovery

  1. … 1 more file in changeset.
Fix to handle bad TM ZK node entries during recovery

Fix to handle bad TM ZK node entries during recovery This is the second fix for JIRA [TRAFODION-2236]

  1. … 5 more files in changeset.
Fix for recovery IOException 2016-08-21 22:05:02,531 ERROR dtm.HBaseTxClient: Caught recovery thread exception for tmid: 0 retries: 0 java.io.IOException: Non-migratable/unknown version=1 at org.apache.hadoop.hbase.HRegionInfo.readFields(HRegionInfo.java:895) at org.trafodion.dtm.HBaseTxClient$RecoveryThread.addRegionToTS(HBaseTxClient.java:967) at org.trafodion.dtm.HBaseTxClient$RecoveryThread.run(HBaseTxClient.java:1094)

[TRAFODION-2129] Trafodion to avoid use of deprecated HBase APIs/Classes

References to the deprecated classes HConnection, HConnectionManager and

HBaseAdmin are reworked to use Connection, ConnectionFactory and Admin classes

respectively.

A connection object is created and it is passed around to ensure that the

same connection object is used within the process. Connection object is thread safe.

Admin object is created and closed after its use immediately.

Creation of admin object is lightweight and the object is not thread safe

Also fixed the random hang at the time of rollback transaction waiting for the response from the TM process.

The TM process hung because it assumed that RS didn't respond back when there is an exception in DDL

rollback or end-point coprocessor call.

    • -11
    • +12
    ./dtm/HBaseAuditControlPoint.java
  1. … 25 more files in changeset.
[TRAFODION-2095] code cleanup for jira 2095

  1. … 1 more file in changeset.
Merging HEAD into sbroeder_2095