Trafodion

Clone Tools
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
[TRAFODION-2927] Refactor and improve UPDATE STATISTICS logging

    • -4
    • +4
    /core/sqf/commonLogger/CommonLogger.cpp
    • -11
    • +86
    /core/sql/qmscommon/QRLogger.cpp
    • -24
    • +30
    /core/sql/regress/compGeneral/EXPECTED023
    • -121
    • +140
    /core/sql/ustat/hs_log.cpp
[TRAFODION-2917] Refactor Trafodion implementation of hdfs scan for text formatted hive tables

Part-2 changes

Introduced a new CQD USE_LIBHDFS_SCAN 'OFF' to switch to the new implementation

The new implementation details are at executor/ExHdfsScan.h

Fixed a bug that was causing unexpected errors in JVM when the JNI object corresponding

to java class is not initialized correctly

    • -13
    • +3
    /core/sql/executor/ExExeUtilGet.cpp
    • -2
    • +0
    /core/sql/executor/ExFastTransport.cpp
    • -31
    • +154
    /core/sql/executor/ExHdfsScan.cpp
    • -9
    • +12
    /core/sql/executor/HBaseClient_JNI.cpp
    • -37
    • +161
    /core/sql/executor/HdfsClient_JNI.cpp
    • -11
    • +17
    /core/sql/executor/HdfsClient_JNI.h
    • -15
    • +9
    /core/sql/executor/JavaObjectInterface.h
  1. … 13 more files in changeset.
New syntax to retrieve the LOB HDFS filename for both external and internal LOBs . Also added syntax to return starting offset of a particular LOB handle in the LOB Hdfs data file.

    • -5
    • +80
    /core/sql/executor/ExExeUtilLoad.cpp
    • -0
    • +115
    /core/sql/exp/ExpLOBinterface.cpp
    • -1
    • +11
    /core/sql/generator/GenRelExeUtil.cpp
    • -38
    • +58
    /core/sql/regress/executor/EXPECTED130
Add GET PRIVILEGES for GET Statement

[TRAFODION-2871] Add web references to security mailing list

Merge [TRAFODION-2912] Better handling of non-deterministic scalar UDFs PR-1420

    • -6
    • +13
    /core/sql/optimizer/NormRelExpr.cpp
pyinstaller fix - kerberos related issues while executing hdfs commands

nullpointer error where server return without value

Fix typo.

[TRAFODION-2929] PR 1416 Add REBUILD_INDEXES for LOAD to SQL Reference

[TRAFODION-2912] Better handling of non-deterministic scalar UDFs

Fix some issues found by Andy Yang and others while writing a

non-deterministic scalar UDF (a random generator in this case).

This UDF was transformed into a hash join, which executes the UDF

only once and not once per row. Another problem is the probe cache,

which can also lead to a single execution instead of once per row.

The fix records the non-deterministic UDF attribute in the group

attributes and it adds checks in the normalizer to suppress the

conversion from a TSJ to a non-TSJ when non-deterministic UDFs are

present. The probe cache logic already had this check, so all that was

needed was to set the attribute.

Note that there may be some more complex queries where we still won't

execute the UDF once per row. In general, there is no absolute

guarantee that a non-deterministic scalar UDF is executed once per row

(of the cartesian product of all the tables joined??). However, in

simple cases like the added test we should try to call the UDF for

every row that satisfies the join predicates.

    • -6
    • +13
    /core/sql/optimizer/NormRelExpr.cpp
    • -0
    • +125
    /core/sql/regress/udr/EXPECTED103
Add ROLLUP Function in Aggregate (Set) Function

Incorporate Comments 1

TRAFODION-2932 ConnectionTimeout value for jdbc cannot lager than 32768

Merge [TRAFODION-2928] PR 1415 Add recent articles to Trafodion web site

Merge [TRAFODION-2840] PR 1414 Make [first n} + ORDER BY views non-updatable

    • -0
    • +68
    /core/sql/optimizer/OptPhysRelExpr.cpp
Merge [TRAFODION-2885] PR 1412 Enhance dcs server restart

Merge UPDATE example to SQL Reference Manual PR 1411

[TRAFODION-2917] Refactor Trafodion implementation of hdfs scan for text formatted hive tables

Part-1 changes.

Created a new class org.trafodion.sql.HDFSClient. Any direct HDFS access

will be routed to this class via JNI instead of using libhdfs.

Modified the existing code expect for the following to route the HDFS request via this class

1. LOB access

2. Direct HDFS scan of the table

3. Sample data creation during update stats

Added a new class org.trafodio.sql.HdfsScan for scanning one or many ranges of a Hive

text formatted table. This class will be used for Direct HDFS scan in near future.

    • -22
    • +21
    /core/sql/executor/ExExeUtilLoad.cpp
    • -27
    • +75
    /core/sql/executor/ExFastTransport.cpp
    • -18
    • +22
    /core/sql/executor/ExHbaseAccess.cpp
    • -126
    • +0
    /core/sql/executor/HBaseClient_JNI.cpp
    • -11
    • +0
    /core/sql/executor/HBaseClient_JNI.h
    • -0
    • +452
    /core/sql/executor/HdfsClient_JNI.cpp
    • -0
    • +146
    /core/sql/executor/HdfsClient_JNI.h
    • -298
    • +0
    /core/sql/executor/SequenceFileReader.cpp
    • -30
    • +0
    /core/sql/executor/SequenceFileReader.h
  1. … 7 more files in changeset.
Add Examples of *REBUILD INDEXES*

Add *Rebuild Indexes* for LOAD Statement in *Trafodion SQL Reference Manual*

[TRAFODION-2928] Add recent articles to Trafodion web site

Reworks as suggested by Hans

    • -24
    • +3
    /core/sql/optimizer/OptPhysRelExpr.cpp
[TRAFODION-2840] Make [first n] with ORDER BY views non-updatable

    • -7
    • +28
    /core/sql/optimizer/BindRelExpr.cpp
    • -1
    • +35
    /core/sql/optimizer/NormRelExpr.cpp
    • -0
    • +89
    /core/sql/optimizer/OptPhysRelExpr.cpp
Merge remote branch 'origin/pr/1410/head' into merge_1410

TRAFODION-2885 enhancement

Add an example for *UPSERT Statement* in *Trafodion SQL Reference Manual*

Merge [TRAFODION-2844] PR 1344 Add dcsserver strategy to restart mxosrvr

Merge [TRAFODION-2886] PR-1380 fix the nullpointer error scanned by TScanCode