CmpSeabaseDDLcleanup.cpp

Clone Tools
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
TRAFODION-3121 Enhance 'initialize trafodion' to return progress status

-- init traf will now return status during various steps.

'Started' indication will be returned when that step starts.

'Completed' will be returned when it completes successfully.

'Failed' will be returned if that step fails.

Elapsed time for each step will be shown in {ET hh:mm:ss} format.

-- method CmpSeabaseDDL::initSeabaseMD is rewritten and moved from

file CmpSeabaseDDLcommon.cpp to new file CmpSeabaseDDLinitraf.cpp.

-- priv mgr tables are now always created during init traf.

-- a 'no return status' option has been added if status is not to be

returned during init traf. This is used when init traf is called

internally, for ex, during upgrade.

It is not an externalized option.

-- Output of init traf is shown below.

Note: output is not a printf/cout to stdout.

It is returned as selected rows to the caller.

Apache Trafodion Conversational Interface 2.3.0

Copyright (c) 2015-2017 Apache Software Foundation

>>initialize trafodion;

Initialize Trafodion: Started

Verify User: Started

Verify User: Completed {ET: 00:00:00}

Version Check: Started

Version Check: Completed {ET: 00:00:00}

Create Metadata Tables: Started

Create Metadata Tables: Completed {ET: 00:00:49}

Update Metadata Tables: Started

Update Metadata Tables: Completed {ET: 00:00:06}

Create Schema Objects: Started

Create Schema Objects: Completed {ET: 00:00:20}

Create Metadata Views: Started

Create Metadata Views: Completed {ET: 00:00:05}

Create Repository Tables: Started

Create Repository Tables: Completed {ET: 00:00:16}

Create PrivMgr Tables: Started

Create PrivMgr Tables: Completed {ET: 00:00:29}

Create Library Manager: Started

Create Library Manager: Completed {ET: 00:00:51}

Initialize Trafodion: Completed {ET: 00:03:09}

--- SQL operation complete.

  1. … 36 more files in changeset.
TRAFODION-3086 Traf support for DDL operations on Hive objects

-- Support for TRAFODION-3086. Details in document attached to jira.

Other changes:

-- support for "if not exists", "if exists" clause for create/drop view

-- Support for: truncate T, truncate table T.

-- same as purgedata

-- showddl <tab>, detail

-- unregister hive schema <sch>

-- will unregister all objects in specified schema

-- Support for "if not registered", "if registered" clauss for

register/unregister command.

  1. … 90 more files in changeset.
[TRAFODION-2768] Make Trafodion code base to compile in RH7

  1. … 126 more files in changeset.
[TRAFODION-2754] Get statistics cores sqlci or mxosrvr at str_sprintf()

Switched str_sprinf to use the standard sprintf function to ensure

that the format specification and the passed in parameters are consistent

  1. … 65 more files in changeset.
TRAFODION-2610 Register native HBase tables in traf MD plus couple more

-- support for registering hbase native cell/row format tables in traf MD

Syntax:

register [internal] hbase table [if not exists] <table-name>

unregister [internal] hbase table [if exists] <table-name>

-- support to get info related to registered hbase tables

Syntax: get hbase registered table in catalog trafodion

-- enhancements to HBase mapped tables and bug fixes

-- disabling of creation of external tables on native hbase

tables unless they are mapped tables

-- support for case-insensitive format string in TO_DATE function

(exp/exp_datetime.h)

-- regress/seabase/TEST022 enhanced with additional tests

  1. … 48 more files in changeset.
[TRAFODION-2584] Add support to register hive objects in traf metadata

Syntax:

register hive table/view [if not exists] <object-name> [cascade]

unregister hive table/view [if exists] <object-name> [cascade]

cascade option: register/unregister all underlying objects that are

part of the specified view

update statistics, grant/revoke, traf views or external table creation

on hive objects will automatically and internally register those objects

in trafodion metadata.

invoke/showddl will show if this object is registered and whether

that registration was internal or explicit.

Get command extensions:

get hive registered tables/view/objects in catalog trafodion;

get hive external tables in catalog trafodion;

Cleanup command extensions:

cleanup metadata command will clean up inconsistent hive objects

(underlying hive object is missing but object is registered or

an external table exists)

cleanup [hive table | hive view] on <object-name>;

Existing hive objects that had implicit or explicit external tables

created prior to this checkin will have no change in behavior.

ObjectUID of those external tables will continue to be used for

relevant operations.

One can drop those external tables and explicitly register them,

or a subsequent operation(upd stats, grant, etc) that needs objectUID will

automatically register them.

minor changes based on review comments of previous checkin

get all objects command on hive metadata no longer fails.

get views on objects return 3-part name that could be used to

differentiate between a traf and hive view.

regress/hive/TEST007 has been extended.

TBD: Add register/unregister privileges

  1. … 52 more files in changeset.
Merge remote branch 'origin/master' into empty_lob_work

  1. … 22 more files in changeset.
Changes to support new syntax and implementation empty_blob/empty_clob for insert/updates Changes to support new syntax for updating a lob directly through a lobhandle without scanning the table.This is done via new ExeUtil operator. Changes to add columnname info to LOBMD_ table. This helps in mapping any given lobhandle back to the table and the column. Added new sections to the regression test executor/TEST130 to test these changes

  1. … 40 more files in changeset.
TRAFODION-1586 Add support for external Traf tables mappedd to HBase tables

This is the initial support for HBase mapped tables.

A doc for external manuals will be added later.

regress/seabase/TEST022 contains various testcases.

  1. … 77 more files in changeset.
[TRAFODION-2140] Move IUS feature to open source

  1. … 35 more files in changeset.
[TRAFODION-1955] JNI optimization for the methods used at the time of query compilation Changes as per review comments. Added back ByteArrayList JNI but without any references to it to ensure other branches are not broken. Contributors are advised to modify their code to avoid use of this class.

  1. … 5 more files in changeset.
[TRAFODION-1955] JNI optimization at the time of compilation

Removed ByteArrayList class and used array of byte array instead.

Only one JNI to java transistion is done to getRegionStartKeys

and getRegionEndKeys at the time of query compilation

Also fixed an issue with lib_mgmt Makefile.

  1. … 15 more files in changeset.
Merge remote branch 'origin/master' into lob_get_trace

  1. … 8 more files in changeset.
support for get command for LOB tables. Support for tracing LOB operations.

  1. … 30 more files in changeset.
commit #1

  1. … 25 more files in changeset.
update

  1. … 298 more files in changeset.
Merge remote branch 'origin/master' into lob_gc_work

Conflicts:

core/sql/sqlcomp/CmpSeabaseDDLtable.cpp

  1. … 11 more files in changeset.
Merge remote branch 'origin/master' into deliver2_dt_br

-- resolved merge conflicts

Conflicts:

core/sql/executor/HBaseClient_JNI.h

core/sql/regress/executor/EXPECTED013.SB

core/sql/regress/seabase/EXPECTED011

core/sql/sqlcomp/CmpSeabaseDDL.h

core/sql/sqlcomp/CmpSeabaseDDLcommon.cpp

core/sql/sqlcomp/CmpSeabaseDDLtable.cpp

  1. … 18 more files in changeset.
Merge remote branch 'origin/master' into lob_gc_work

  1. … 13 more files in changeset.
Changes for performing GC. Changes to pass in hdfsServer and port via CQD and remove hardcoding. Changes to pass in lobLocation via CQD and remove hardcoding. Changes to remove all mxlobsrvr process functionality from ExLOBprocess.cpp. Retaining only the infrasturcture so mxlobsrvr process can be used in the future. The executable is still built but the process is not started as part of Trafodion anymore. We may use it in the future.

  1. … 28 more files in changeset.
JIRA TRAFODION-1798 (ddl xns) and few other fixes, details below.

-- support for sql part of ddl xns. Section 1 of JIRA TRAFODION-1798

-- cqd ddl_transactions to enable or disable ddl xns.

Default is currently off. Once it is tested, it will be turned on.

Dev regressions are run with cqd set to ON

-- get stmts run with read committed to get changes in current xns

-- support for where preds with get stmts

-- scan to pass in transid even if running with read uncommitted access.

This enables rows modified in current xn to be returned.

-- cleanup no longer return multiple duplicate error messages if

objects id is not found.

-- cleanup no longer includes internallay created schemas (_HV_ , _HB_)

during cleanup operations.

-- Correct error msg was not getting returned if an invalid index

existed in table and the same index was created again.

-- init traf, drop md views was giving an error if views didnt exist.

That has been fixed.

-- regressions with -diff option now show original file timestamps

instead of the timestamp when the diff command was run.

  1. … 72 more files in changeset.
TRAFODION-1789 & TRAFODION-1812

TRAFODION-1789: Create the histogram metadata tables at schema creation time

Added a list of MDTableInfo structs called allMDHistInfo that describes

histogram tables similar to other metadata tables in CmpSeabaseDDLmd.h.

During schema create, this list is traversed and each histogram table created.

This is performed by calling the static function - createHistogramTables.

Similarily, this list is traversed at drop schema time to drop existing

histogram tables. With this change, you can drop a schema without the

cascade option when only histogram tables remain.

In histogram code (hs_cli.cpp), removed hard coded create statements and

changed code to call the createHistogramTables static function. With this

change, there is only one place where Histogram tables are defined. Today,

histogram tables are defined in ../sqlcomp/CmpSeabaseDDLmd.h and

../ustat/hs_cli.cpp

TRAFODION-1812: cleanup schema causes transaction to hang in aborting state

While testing the fix for TRAFODION-1789, some of the regression tests failed.

There is an issue when trying to cleanup a schema that contains histogram

tables. Changes were made to cleanup histogram tables first and to avoid

deleting histogram entries for the histogram table itself.

Added IF EXISTS syntax to routine drops. Also added IF NOT EXISTS syntax to

routine creates. The DROP IF EXISTS was needed to fix an issue when dropping

routines as part of drop schema code.

  1. … 22 more files in changeset.
[TRAFODION-25] First draft of DELETE costing changes

  1. … 10 more files in changeset.
Merge remote branch 'origin/master' into lob_work_files2

  1. … 25 more files in changeset.
Fixes for extract to files and dealing with issues ith 2 or more lob columns.

  1. … 20 more files in changeset.
Part 1 of updates to licensing info in Trafodion source

Added NOTICE.txt file in root directory per ASF guidelines.

Updated copyright text in one directory (core/sql/sqlcomp)

as a test of a tool to update such text. One or more later

check-ins will take care of the remaining directories.

  1. … 63 more files in changeset.
Merge remote branch 'core/master'

  1. … 108 more files in changeset.
Move core into subdir to combine repos

    • -0
    • +1838
    ./CmpSeabaseDDLcleanup.cpp
  1. … 10768 more files in changeset.
Move core into subdir to combine repos

Use: git log --follow -- <file>

to view file history thru renames.

    • -0
    • +1838
    ./CmpSeabaseDDLcleanup.cpp
  1. … 10837 more files in changeset.