CmpSeabaseDDLmd.h

Clone Tools
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
new COMMENT-ON SQL statement: review change - fix a error in new build-in view

1. fix a error in new build-in view

new COMMENT-ON SQL statement: review change - undo all MD changes

1. undo all MD changes since we have changed to use TEXT table to store

comments

  1. … 4 more files in changeset.
new COMMENT-ON SQL statement: review change - TEXT table modification

1. mv storage of COMMENTs in TEXT table

  1. … 10 more files in changeset.
new COMMENT-ON SQL statement: init

1. new SQL syntax: COMMENT ON

2. new component privilege: SQL_OPERATIONS::COMMENT

3. MD table changes: add new column for tables "_MD_".OBJECTS and

"_MD_".COLUMNS

4. SHOWDDL changes: add COMMENT-ON output for each object

5. new build-in views: "_MD_".OBJECT_COMMENT_VIEW and

"_MD_".COLUMN_COMMENT_VIEW

  1. … 25 more files in changeset.
[TRAFODION-2768] Make Trafodion code base to compile in RH7

  1. … 126 more files in changeset.
TRAFODION-2610 Register native HBase tables in traf MD plus couple more

-- support for registering hbase native cell/row format tables in traf MD

Syntax:

register [internal] hbase table [if not exists] <table-name>

unregister [internal] hbase table [if exists] <table-name>

-- support to get info related to registered hbase tables

Syntax: get hbase registered table in catalog trafodion

-- enhancements to HBase mapped tables and bug fixes

-- disabling of creation of external tables on native hbase

tables unless they are mapped tables

-- support for case-insensitive format string in TO_DATE function

(exp/exp_datetime.h)

-- regress/seabase/TEST022 enhanced with additional tests

  1. … 48 more files in changeset.
[TRAFODION-2584] Add support to register hive objects in traf metadata

Syntax:

register hive table/view [if not exists] <object-name> [cascade]

unregister hive table/view [if exists] <object-name> [cascade]

cascade option: register/unregister all underlying objects that are

part of the specified view

update statistics, grant/revoke, traf views or external table creation

on hive objects will automatically and internally register those objects

in trafodion metadata.

invoke/showddl will show if this object is registered and whether

that registration was internal or explicit.

Get command extensions:

get hive registered tables/view/objects in catalog trafodion;

get hive external tables in catalog trafodion;

Cleanup command extensions:

cleanup metadata command will clean up inconsistent hive objects

(underlying hive object is missing but object is registered or

an external table exists)

cleanup [hive table | hive view] on <object-name>;

Existing hive objects that had implicit or explicit external tables

created prior to this checkin will have no change in behavior.

ObjectUID of those external tables will continue to be used for

relevant operations.

One can drop those external tables and explicitly register them,

or a subsequent operation(upd stats, grant, etc) that needs objectUID will

automatically register them.

minor changes based on review comments of previous checkin

get all objects command on hive metadata no longer fails.

get views on objects return 3-part name that could be used to

differentiate between a traf and hive view.

regress/hive/TEST007 has been extended.

TBD: Add register/unregister privileges

  1. … 52 more files in changeset.
TRAFODION-2492 Support for native hive views, plus few more changes

-- added support for native hive views created externally. These views

can be accessed in a traf sql query.

There are some restrictions as listed below:

-- privileges support has not yet been added. That will be done, as

needed, in the next checkin.

-- usage info for tables contained in a native hive view is not maintained.

-- native hive views cannot be inserted/updated/deleted

-- cannot update stats on a native hive view

-- support for GET statements to retrieve hive data

get tables/views/objects in schema hive.sch;

-- this will return all tables/views in specified schema(hive database)

get tables/views/objects in catalog hive;

-- this will return all tables/views in hive

get schemas in catalog hive;

-- this will return all schemas(databases) that exist in hive

-- GET statements to retrieve hive data now supports optional MATCH clause.

This can be used to filter results.

-- showddl will show if an external table on hive was created implicitly

for internal usage (upd stats, privileges, views) or explicitly by user.

Internal creation of external table now use 'create implicit external table'

syntax and that info is stored in metadata.

-- drop external table will drop that table even if underlying hive table

is missing. Currently it returns an error.

-- at runtime, accessing a missing hive table now returns a better error

message instead of an internal "data mod check failed" message.

-- regress/tools/runallsb has 2 new options:

-basetests (this will run core,compGeneral,executor,seabase,hive)

-othertests (this will run all other tests suites)

-- optimizer/NATable.cpp was incorrectly indented by some checkin from

a few days back. TABs were used instead of spaces which caused code

to become all crooked. That has been fixed.

-- regress/hive/TEST007 has been updated with additional hive view tests

  1. … 26 more files in changeset.
jira TRAFODION-2234 turn aligned format on, phase 1

This is phase 1 of aligned format change.

Dev regressions now run with aligned format tables.

To test both hbase and aligned format, some tests have explicit

specification to create hbase format tables.

Tests that test for features that are currently only available

with hbase format (like pushdown sel expr) create hbase format tables.

Many expected files have been updated to reflect aligned format,

mostly in showddl and explain output.

  1. … 35 more files in changeset.
[TRAFODION-2140] Move IUS feature to open source

  1. … 35 more files in changeset.
metadata access performance improvement for accessing traf objects

Packed version of descriptor structures is now stored in traf TEXT

table during various DDL operations.

During dml, if packed descriptors exist, then they are read and used.

If they dont exist, then descriptors are generated on the fly.

Descriptor classes are defined in file sqlcat/TrafDDLdesc.h and

are based off the older desc structures from desc.h.

These are simplified and class'ified version of the older structures

and are versioned. Changes to these classes should be done carefully

by either using filler bytes or versioning them.

2 new cqds, traf_store_object_descriptor and traf_read_object_descriptor,

are added to control if packed descs should be stored/read.

These are currently set to OFF by default but are enabled during

regressions run. Once this feature is tested, these cqds will be turned

on by default.

In addition, some helper commands have been added to manipulate descrs.

Syntax:

alter table t [check|generate|delete|disable|enable] stored descritors

If authorization is enabled, then auth/priv specific info

is generated on the fly and currently not stored in metadata.

In a later checkin, these will also be stored in metadata.

  1. … 74 more files in changeset.
Upgrade repository code changes

  1. … 4 more files in changeset.
Merge remote branch 'hegdean/wrkbrnch' into Trafodion2037

  1. … 5 more files in changeset.
[TRAFODION-2037] Improve DDL concurrency

  1. … 10 more files in changeset.
JIRA TRAFODION-2072 plus few more

-- long varchars (> 32K) are handled for traf (regular and aligned)

and hive tables

-- showddl for hive tables shows traf and hive definitions

-- traf external tables can optionally take columns attrs that would

overwrite corresponding hive col attrs

-- metadata is updated with info no whether col attrs were specified

-- 'repeat' function can optionally take a max length parameter

-- error is returned if an external table is created for non-hive

-- tests added to regress/seabase/TEST031 and hive/TEST009

  1. … 44 more files in changeset.
TRAFODION-1789 & TRAFODION-1812

TRAFODION-1789: Create the histogram metadata tables at schema creation time

Added a list of MDTableInfo structs called allMDHistInfo that describes

histogram tables similar to other metadata tables in CmpSeabaseDDLmd.h.

During schema create, this list is traversed and each histogram table created.

This is performed by calling the static function - createHistogramTables.

Similarily, this list is traversed at drop schema time to drop existing

histogram tables. With this change, you can drop a schema without the

cascade option when only histogram tables remain.

In histogram code (hs_cli.cpp), removed hard coded create statements and

changed code to call the createHistogramTables static function. With this

change, there is only one place where Histogram tables are defined. Today,

histogram tables are defined in ../sqlcomp/CmpSeabaseDDLmd.h and

../ustat/hs_cli.cpp

TRAFODION-1812: cleanup schema causes transaction to hang in aborting state

While testing the fix for TRAFODION-1789, some of the regression tests failed.

There is an issue when trying to cleanup a schema that contains histogram

tables. Changes were made to cleanup histogram tables first and to avoid

deleting histogram entries for the histogram table itself.

Added IF EXISTS syntax to routine drops. Also added IF NOT EXISTS syntax to

routine creates. The DROP IF EXISTS was needed to fix an issue when dropping

routines as part of drop schema code.

  1. … 22 more files in changeset.
Fixes for Jira's trafodion-19 & trafodion-29

See Jira's for a description.

Also removed obsolete code from the parser

  1. … 46 more files in changeset.
Part 1 of updates to licensing info in Trafodion source

Added NOTICE.txt file in root directory per ASF guidelines.

Updated copyright text in one directory (core/sql/sqlcomp)

as a test of a tool to update such text. One or more later

check-ins will take care of the remaining directories.

  1. … 63 more files in changeset.
Move core into subdir to combine repos

    • -0
    • +1181
    ./CmpSeabaseDDLmd.h
  1. … 10768 more files in changeset.
Move core into subdir to combine repos

    • -0
    • +1171
    ./CmpSeabaseDDLmd.h
  1. … 10622 more files in changeset.
Move core into subdir to combine repos

Use: git log --follow -- <file>

to view file history thru renames.

    • -0
    • +1181
    ./CmpSeabaseDDLmd.h
  1. … 10837 more files in changeset.