Clone Tools
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[TRAFODION-2236] Fix to handle bad TM ZK node entries during recovery This is the second fix for JIRA [TRAFODION-2236] [Author: Sean Broeder <sbroeder@edev06.esgyn.local>]

Squashed commit of the following:

commit 66030b519c49b4abe66b8b49b9ddc63a9543d8fc

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Thu Sep 29 18:55:39 2016 +0000

Addressing review comments

commit c1b22cf41eeb56c3002a2ca86d2b204772667b9d

Merge: 6ee98ca a62e76f

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Thu Sep 29 16:14:16 2016 +0000

Merge remote branch 'sbroeder_inctraf/sean_traf' into sean_traf

commit 6ee98cab2a8adf07df365131f431f1ded3e15d3a

Merge: 98a1ec6 b352dd8

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Thu Sep 29 15:14:38 2016 +0000

Merge remote branch 'sbroeder_inctraf/sean_traf' into sean_traf

Conflicts:

core/sqf/src/seatrans/tm/hbasetmlib2/src/main/java/org/trafodion/dtm/HBaseTxClient.java

commit a62e76faf1753a02dd9095aa1061829b537da49f

Merge: 98a1ec6 b352dd8

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Thu Sep 29 15:14:38 2016 +0000

Merge remote branch 'sbroeder_inctraf/sean_traf' into sean_traf

Conflicts:

core/sqf/src/seatrans/tm/hbasetmlib2/src/main/java/org/trafodion/dtm/HBaseTxClient.java

commit 98a1ec6bdf0eb9b69fbb6f4d8c908e657638ba54

Merge: d7232d3 fd4fadf

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Wed Sep 28 23:20:57 2016 +0000

Fix to handle bad TM ZK node entries during recovery

commit b352dd8f1fdab8f73bf2f4dea3b0ac757dd6ad29

Merge: d7232d3 fd4fadf

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Wed Sep 28 23:20:57 2016 +0000

Fix to handle bad TM ZK node entries during recovery

commit d7232d3f816129464a3449cea56a10919794ddd2

Merge: 0ccafa2 1e94882

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Wed Sep 28 23:19:20 2016 +0000

Merge branch 'master' of github.com:apache/incubator-trafodion into sean_traf

commit fd4fadffab1f969dd1e3e735b01a9c62d9bb9766

Author: Sean Broeder <sean.broeder@esgyn.com>

Date: Tue Sep 27 10:22:02 2016 -0700

Update TransactionManager.java

commit 0ccafa240eb1ee225226c18c1396204830bea8ad

Author: Sean Broeder <sbroeder@edev06.esgyn.local>

Date: Tue Sep 27 03:13:23 2016 +0000

Fix to handle bad TM ZK node entries during recovery

This is the second fix for JIRA [TRAFODION-2236]

This closes #730

    • -30
    • +19
    ./trafodion/dtm/HBaseTxClient.java
  1. … 5 more files in changeset.
Addressing review comments

  1. … 1 more file in changeset.
Merge remote branch 'sbroeder_inctraf/sean_traf' into sean_traf

Conflicts:

core/sqf/src/seatrans/tm/hbasetmlib2/src/main/java/org/trafodion/dtm/HBaseTxClient.java

  1. … 1 more file in changeset.
Fix to handle bad TM ZK node entries during recovery

    • -35
    • +15
    ./trafodion/dtm/HBaseTxClient.java
  1. … 1 more file in changeset.
Fix to handle bad TM ZK node entries during recovery

    • -36
    • +17
    ./trafodion/dtm/HBaseTxClient.java
Fix to handle bad TM ZK node entries during recovery This is the second fix for JIRA [TRAFODION-2236]

  1. … 5 more files in changeset.
Fix for recovery IOException 2016-08-21 22:05:02,531 ERROR dtm.HBaseTxClient: Caught recovery thread exception for tmid: 0 retries: 0 java.io.IOException: Non-migratable/unknown version=1 at org.apache.hadoop.hbase.HRegionInfo.readFields(HRegionInfo.java:895) at org.trafodion.dtm.HBaseTxClient$RecoveryThread.addRegionToTS(HBaseTxClient.java:967) at org.trafodion.dtm.HBaseTxClient$RecoveryThread.run(HBaseTxClient.java:1094)

[TRAFODION-2129] Trafodion to avoid use of deprecated HBase APIs/Classes

References to the deprecated classes HConnection, HConnectionManager and

HBaseAdmin are reworked to use Connection, ConnectionFactory and Admin classes

respectively.

A connection object is created and it is passed around to ensure that the

same connection object is used within the process. Connection object is thread safe.

Admin object is created and closed after its use immediately.

Creation of admin object is lightweight and the object is not thread safe

Also fixed the random hang at the time of rollback transaction waiting for the response from the TM process.

The TM process hung because it assumed that RS didn't respond back when there is an exception in DDL

rollback or end-point coprocessor call.

    • -11
    • +12
    ./trafodion/dtm/HBaseAuditControlPoint.java
    • -16
    • +25
    ./trafodion/dtm/HBaseTxClient.java
    • -34
    • +18
    ./trafodion/dtm/TmAuditTlog.java
  1. … 25 more files in changeset.
[TRAFODION-2095] code cleanup for jira 2095

  1. … 1 more file in changeset.
Merging HEAD into sbroeder_2095

Merge branch 'master' of github.com:apache/incubator-trafodion into sean_2095

Conflicts:

core/sqf/src/seatrans/tm/hbasetmlib2/src/main/java/org/trafodion/dtm/HBaseTxClient.java

    • -292
    • +216
    ./trafodion/dtm/HBaseTxClient.java
  1. … 2 more files in changeset.
Cherry-pick changes for JIRA 2095

  1. … 3 more files in changeset.
[TRAFODION-1988] Better Java exception handling in Trafodion - Part2

Changes as per the review comments

[TRAFODION-1988] Better Java exception handling in Trafodion - Part2

Changes as per the review comments

[TRAFODION-1988] Better Java exception handling in Trafodion - Part2

Fixed as per the review comments

    • -37
    • +46
    ./trafodion/dtm/HBaseTxClient.java
[TRAFODION-1988] Better Java exception handling in Trafodion - Part2

This time the focus is on hbasetmlib2 improvements

    • -110
    • +40
    ./trafodion/dtm/HBaseAuditControlPoint.java
    • -309
    • +192
    ./trafodion/dtm/HBaseTxClient.java
    • -252
    • +66
    ./trafodion/dtm/TmAuditTlog.java
  1. … 6 more files in changeset.
Fix for JIRA [TRAFODION-1996] TLOG uses excessive memory when aging old entries

    • -1
    • +3
    ./trafodion/dtm/HBaseAuditControlPoint.java
    • -53
    • +48
    ./trafodion/dtm/TmAuditTlog.java
  1. … 1 more file in changeset.
[TRAFODION-1988] Better Java exception handling in Trafodion

  1. … 20 more files in changeset.
JIRA TRAFODION-1798 (ddl xns) and few other fixes, details below.

-- support for sql part of ddl xns. Section 1 of JIRA TRAFODION-1798

-- cqd ddl_transactions to enable or disable ddl xns.

Default is currently off. Once it is tested, it will be turned on.

Dev regressions are run with cqd set to ON

-- get stmts run with read committed to get changes in current xns

-- support for where preds with get stmts

-- scan to pass in transid even if running with read uncommitted access.

This enables rows modified in current xn to be returned.

-- cleanup no longer return multiple duplicate error messages if

objects id is not found.

-- cleanup no longer includes internallay created schemas (_HV_ , _HB_)

during cleanup operations.

-- Correct error msg was not getting returned if an invalid index

existed in table and the same index was created again.

-- init traf, drop md views was giving an error if views didnt exist.

That has been fixed.

-- regressions with -diff option now show original file timestamps

instead of the timestamp when the diff command was run.

  1. … 72 more files in changeset.
Fix for JIRA [TRAFODION-1857] Several methods refactored to lo longer create/close connections

    • -13
    • +10
    ./trafodion/dtm/TmAuditTlog.java
Fix for [TRAFODION-1703] Lower overhead in deleting old Tlog entries

    • -51
    • +298
    ./trafodion/dtm/TmAuditTlog.java
  1. … 3 more files in changeset.
Fix for [TRAFODION-1703] Lower overhead in deleting old Tlog entries

    • -51
    • +299
    ./trafodion/dtm/TmAuditTlog.java
  1. … 3 more files in changeset.
TRAFODION-1521 Rework from review comments for PR 118

  1. … 2 more files in changeset.
TRAFODION-1521 Build Trafodion without having HBase installed

Adding a new script, core/sqf/sql/scripts/get_libhdfs_files. The new

script will download Google Protocol Buffers 2.5.0 and a source tar

file for Hadoop and build protobuf-2.5.0 and the Hadoop native

libraries. It will then copy the libraries (libhadoop.so and

libhdfs.so) to $MY_SQROOT/export/lib$ {SQ_MBTYPE}. It will also copy

the include file hdfs.h to $MY_SQROOT/include. Since this step is very

time-consuming, it takes a shortcut if Hadoop is installed

(e.g. with install_local_hadoop), in that case it will copy the

existing native libraries. To address the remaining needs for jar

files during the build, the hbasetmlib2 build is converted to

Maven. We also remove the case in sqenvcom.sh where a

configuration does not have install_local_hadoop, Cloudera,

Hortonworks or MapR installed, but has a TOOLSDIR. Such cases should

use the recently added case for a native Apache Hadoop installation or

the case where no HBase installation is found. That last case will

print out a reminder that can be ignored.

Note: Users will need to do "sqgen" to update their classpath. This is

because we need a new jar in the classpath: trafodion-dtm-1.2.0.jar.

    • -0
    • +416
    ./trafodion/dtm/HBaseAuditControlPoint.java
    • -0
    • +247
    ./trafodion/dtm/HBaseTmZK.java
    • -0
    • +1375
    ./trafodion/dtm/HBaseTxClient.java
    • -0
    • +229
    ./trafodion/dtm/HashMapArray.java
    • -0
    • +1201
    ./trafodion/dtm/TmAuditTlog.java
    • -0
    • +204
    ./trafodion/dtm/TrafInfo.java
  1. … 22 more files in changeset.