Clone Tools
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Addressing review comments

  1. … 1 more file in changeset.
Merge remote branch 'sbroeder_inctraf/sean_traf' into sean_traf

Conflicts:

core/sqf/src/seatrans/tm/hbasetmlib2/src/main/java/org/trafodion/dtm/HBaseTxClient.java

  1. … 1 more file in changeset.
Fix to handle bad TM ZK node entries during recovery

    • -35
    • +15
    ./trafodion/dtm/HBaseTxClient.java
  1. … 1 more file in changeset.
Fix to handle bad TM ZK node entries during recovery

    • -36
    • +17
    ./trafodion/dtm/HBaseTxClient.java
Fix to handle bad TM ZK node entries during recovery This is the second fix for JIRA [TRAFODION-2236]

  1. … 5 more files in changeset.
Fix for recovery IOException 2016-08-21 22:05:02,531 ERROR dtm.HBaseTxClient: Caught recovery thread exception for tmid: 0 retries: 0 java.io.IOException: Non-migratable/unknown version=1 at org.apache.hadoop.hbase.HRegionInfo.readFields(HRegionInfo.java:895) at org.trafodion.dtm.HBaseTxClient$RecoveryThread.addRegionToTS(HBaseTxClient.java:967) at org.trafodion.dtm.HBaseTxClient$RecoveryThread.run(HBaseTxClient.java:1094)

[TRAFODION-2129] Trafodion to avoid use of deprecated HBase APIs/Classes

References to the deprecated classes HConnection, HConnectionManager and

HBaseAdmin are reworked to use Connection, ConnectionFactory and Admin classes

respectively.

A connection object is created and it is passed around to ensure that the

same connection object is used within the process. Connection object is thread safe.

Admin object is created and closed after its use immediately.

Creation of admin object is lightweight and the object is not thread safe

Also fixed the random hang at the time of rollback transaction waiting for the response from the TM process.

The TM process hung because it assumed that RS didn't respond back when there is an exception in DDL

rollback or end-point coprocessor call.

    • -11
    • +12
    ./trafodion/dtm/HBaseAuditControlPoint.java
    • -16
    • +25
    ./trafodion/dtm/HBaseTxClient.java
    • -34
    • +18
    ./trafodion/dtm/TmAuditTlog.java
  1. … 25 more files in changeset.
[TRAFODION-2095] code cleanup for jira 2095

  1. … 1 more file in changeset.
Merging HEAD into sbroeder_2095

Merge branch 'master' of github.com:apache/incubator-trafodion into sean_2095

Conflicts:

core/sqf/src/seatrans/tm/hbasetmlib2/src/main/java/org/trafodion/dtm/HBaseTxClient.java

    • -292
    • +216
    ./trafodion/dtm/HBaseTxClient.java
  1. … 2 more files in changeset.
Cherry-pick changes for JIRA 2095

  1. … 3 more files in changeset.
[TRAFODION-1988] Better Java exception handling in Trafodion - Part2

Changes as per the review comments

[TRAFODION-1988] Better Java exception handling in Trafodion - Part2

Changes as per the review comments

[TRAFODION-1988] Better Java exception handling in Trafodion - Part2

Fixed as per the review comments

    • -37
    • +46
    ./trafodion/dtm/HBaseTxClient.java
[TRAFODION-1988] Better Java exception handling in Trafodion - Part2

This time the focus is on hbasetmlib2 improvements

    • -110
    • +40
    ./trafodion/dtm/HBaseAuditControlPoint.java
    • -309
    • +192
    ./trafodion/dtm/HBaseTxClient.java
    • -252
    • +66
    ./trafodion/dtm/TmAuditTlog.java
  1. … 6 more files in changeset.
Fix for JIRA [TRAFODION-1996] TLOG uses excessive memory when aging old entries

    • -1
    • +3
    ./trafodion/dtm/HBaseAuditControlPoint.java
    • -53
    • +48
    ./trafodion/dtm/TmAuditTlog.java
  1. … 1 more file in changeset.
[TRAFODION-1988] Better Java exception handling in Trafodion

  1. … 20 more files in changeset.
JIRA TRAFODION-1798 (ddl xns) and few other fixes, details below.

-- support for sql part of ddl xns. Section 1 of JIRA TRAFODION-1798

-- cqd ddl_transactions to enable or disable ddl xns.

Default is currently off. Once it is tested, it will be turned on.

Dev regressions are run with cqd set to ON

-- get stmts run with read committed to get changes in current xns

-- support for where preds with get stmts

-- scan to pass in transid even if running with read uncommitted access.

This enables rows modified in current xn to be returned.

-- cleanup no longer return multiple duplicate error messages if

objects id is not found.

-- cleanup no longer includes internallay created schemas (_HV_ , _HB_)

during cleanup operations.

-- Correct error msg was not getting returned if an invalid index

existed in table and the same index was created again.

-- init traf, drop md views was giving an error if views didnt exist.

That has been fixed.

-- regressions with -diff option now show original file timestamps

instead of the timestamp when the diff command was run.

  1. … 72 more files in changeset.
Fix for JIRA [TRAFODION-1857] Several methods refactored to lo longer create/close connections

    • -13
    • +10
    ./trafodion/dtm/TmAuditTlog.java
Fix for [TRAFODION-1703] Lower overhead in deleting old Tlog entries

    • -51
    • +298
    ./trafodion/dtm/TmAuditTlog.java
  1. … 3 more files in changeset.
Fix for [TRAFODION-1703] Lower overhead in deleting old Tlog entries

    • -51
    • +299
    ./trafodion/dtm/TmAuditTlog.java
  1. … 3 more files in changeset.
TRAFODION-1521 Rework from review comments for PR 118

  1. … 2 more files in changeset.
TRAFODION-1521 Build Trafodion without having HBase installed

Adding a new script, core/sqf/sql/scripts/get_libhdfs_files. The new

script will download Google Protocol Buffers 2.5.0 and a source tar

file for Hadoop and build protobuf-2.5.0 and the Hadoop native

libraries. It will then copy the libraries (libhadoop.so and

libhdfs.so) to $MY_SQROOT/export/lib$ {SQ_MBTYPE}. It will also copy

the include file hdfs.h to $MY_SQROOT/include. Since this step is very

time-consuming, it takes a shortcut if Hadoop is installed

(e.g. with install_local_hadoop), in that case it will copy the

existing native libraries. To address the remaining needs for jar

files during the build, the hbasetmlib2 build is converted to

Maven. We also remove the case in sqenvcom.sh where a

configuration does not have install_local_hadoop, Cloudera,

Hortonworks or MapR installed, but has a TOOLSDIR. Such cases should

use the recently added case for a native Apache Hadoop installation or

the case where no HBase installation is found. That last case will

print out a reminder that can be ignored.

Note: Users will need to do "sqgen" to update their classpath. This is

because we need a new jar in the classpath: trafodion-dtm-1.2.0.jar.

    • -0
    • +416
    ./trafodion/dtm/HBaseAuditControlPoint.java
    • -0
    • +247
    ./trafodion/dtm/HBaseTmZK.java
    • -0
    • +1375
    ./trafodion/dtm/HBaseTxClient.java
    • -0
    • +229
    ./trafodion/dtm/HashMapArray.java
    • -0
    • +1201
    ./trafodion/dtm/TmAuditTlog.java
    • -0
    • +204
    ./trafodion/dtm/TrafInfo.java
  1. … 22 more files in changeset.