Trafodion

Clone Tools
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Merge [TRAFODION-2498] PR-979 Add support to run hive stmts from traf interface

Reverting minor version back to 1

[TRAFODION-2510] pyinstaller - remove DB__ADMIN from installer

[TRAFODION-2510] pyinstaller - remove DB__ADMIN from installer

Merge branch 'TRAFODION-2001' of github.com:zcorrea/incubator-trafodion into TRAFODION-2001

Conflicts:

core/sqf/monitor/linux/clusterconf.cxx

core/sqf/monitor/linux/monlogging.cxx

core/sqf/monitor/linux/pstartd.cxx

    • -1
    • +1
    /core/sqf/monitor/linux/monlogging.cxx
    • -1
    • +56
    /core/sqf/monitor/linux/pnodeconfig.cxx
    • -11
    • +47
    /core/sqf/monitor/linux/shell.cxx
    • -20
    • +90
    /core/sqf/monitor/linux/zclient.cxx
Trafodion configuration API changes - new library files

    • -0
    • +3136
    /core/sqf/monitor/linux/sqliteconfig.cxx
    • -0
    • +133
    /core/sqf/monitor/linux/sqliteconfig.h
    • -0
    • +403
    /core/sqf/monitor/linux/trafconfig.cxx
    • -0
    • +286
    /core/sqf/monitor/linux/trafconfig.h
    • -0
    • +121
    /core/sqf/monitor/linux/trafconfiglog.cxx
    • -0
    • +44
    /core/sqf/monitor/linux/trafconfiglog.h
    • -0
    • +349
    /core/sqf/monitor/linux/trafconfigtrace.cxx
    • -0
    • +103
    /core/sqf/monitor/linux/trafconfigtrace.h
Trafodion configuration API changes

    • -1311
    • +330
    /core/sqf/monitor/linux/clusterconf.cxx
    • -62
    • +52
    /core/sqf/monitor/linux/clusterconf.h
    • -596
    • +205
    /core/sqf/monitor/linux/config.cxx
    • -31
    • +18
    /core/sqf/monitor/linux/lnodeconfig.cxx
    • -21
    • +16
    /core/sqf/monitor/linux/lnodeconfig.h
    • -42
    • +66
    /core/sqf/monitor/linux/makefile
    • -59
    • +15
    /core/sqf/monitor/linux/monlogging.cxx
    • -48
    • +17
    /core/sqf/monitor/linux/persistconfig.cxx
  1. … 12 more files in changeset.
TRAFODION-2498 Add support to run hive stmts from traf interface

Syntax:

process hive statement '<string>';

<string>: hive statement starting with create/drop/alter/truncate.

These are the only stmts currently supported.

Ex:

>>process hive statement 'create database trafsch';

will create hive database 'trafsch'

>>process hive statement 'create table trafsch.t (a int)';

will create hive table 't' in hive schema 'trafsch'.

'process hive statment ..' could be issued from any traf interface

(sqlci/trafci/jdbc...)

    • -8
    • +32
    /core/sql/executor/ExExeUtilGet.cpp
    • -0
    • +125
    /core/sql/executor/ExExeUtilMisc.cpp
    • -1
    • +62
    /core/sql/generator/GenRelExeUtil.cpp
    • -64
    • +68
    /core/sql/regress/hive/EXPECTED005
    • -35
    • +51
    /core/sql/regress/hive/EXPECTED007
  1. … 10 more files in changeset.
Merge remote branch 'origin/master' into TRAFODION-2001

Conflicts:

core/sqf/monitor/linux/config.cxx

core/sqf/monitor/linux/pnodeconfig.cxx

core/sqf/monitor/linux/pnodeconfig.h

core/sqf/monitor/linux/reqqueue.cxx

core/sqf/monitor/linux/shell.cxx

core/sqf/sql/scripts/gensq.pl

core/sqf/sql/scripts/sqconfig

core/sqf/sql/scripts/sqconfig.sample

core/sqf/sql/scripts/sqgen

core/sqf/sql/scripts/sqnodestatus

    • -1
    • +1
    /core/sqf/monitor/linux/clusterconf.cxx
    • -2
    • +2
    /core/sqf/monitor/linux/monlogging.cxx
    • -1
    • +56
    /core/sqf/monitor/linux/pnodeconfig.cxx
    • -10
    • +33
    /core/sqf/monitor/linux/process.cxx
    • -0
    • +14
    /core/sqf/monitor/linux/reqqueue.cxx
    • -11
    • +47
    /core/sqf/monitor/linux/shell.cxx
    • -20
    • +90
    /core/sqf/monitor/linux/zclient.cxx
  1. … 14 more files in changeset.
Merge remote branch 'origin/pr/977/head' into merge_977

review comment #2

    • -4
    • +7
    /core/sql/sqlcomp/CmpSeabaseDDLtable.cpp
[TRAFODION-2482] documentation for python installer

[TRAFODION-2482] documentation for python installer

Merge [TRAFODION-2475] PR-965 Improved error handling for HBASE_OPTIONS clause

Merge branch 'master' of github.com:apache/incubator-trafodion into compress1

Conflicts:

core/sql/regress/seabase/EXPECTED002

    • -3
    • +52
    /core/sql/sqlcomp/CmpSeabaseDDLcommon.cpp
Merge remote branch 'origin/master' into 2.2_work

Conflicts:

core/sql/optimizer/NATable.cpp

    • -2395
    • +2487
    /core/sql/optimizer/NATable.cpp
    • -6
    • +100
    /core/sql/sqlcomp/CmpSeabaseDDLtable.cpp
Fixes from review

    • -1
    • +1
    /core/sql/sqlcomp/CmpSeabaseDDLtable.cpp
Merge [TRAFODION-2492] PR-976 Support for native hive views, plus few more changes

    • -27
    • +176
    /core/sql/executor/ExExeUtilGet.cpp
    • -24
    • +38
    /core/sql/generator/GenRelExeUtil.cpp
Merge [TRAFODION-2441] PR-975 user has only select privilege on a table can do ...

Merge [TRAFODION-2481] PR-974 Improve ambari section of provisioning guide

[TRAFODION-2496] pyinstaller - better handle constants

    • -11
    • +11
    /install/python-installer/db_install.py
    • -7
    • +7
    /install/python-installer/db_uninstall.py
    • -1
    • +2
    /install/python-installer/discovery.py
    • -17
    • +4
    /install/python-installer/scripts/copy_files.py
    • -19
    • +19
    /install/python-installer/scripts/dcs_setup.py
    • -13
    • +13
    /install/python-installer/scripts/traf_ldap.py
  1. … 5 more files in changeset.
[TRAFODION-2496] pyinstaller - better handle constants

    • -11
    • +11
    /install/python-installer/db_install.py
    • -7
    • +7
    /install/python-installer/db_uninstall.py
    • -1
    • +2
    /install/python-installer/discovery.py
    • -0
    • +61
    /install/python-installer/scripts/constants.py
    • -17
    • +4
    /install/python-installer/scripts/copy_files.py
    • -19
    • +19
    /install/python-installer/scripts/dcs_setup.py
    • -13
    • +13
    /install/python-installer/scripts/traf_ldap.py
  1. … 5 more files in changeset.
Fix for a potential stack memory corruption.

    • -1
    • +4
    /core/sql/sqlcomp/CmpSeabaseDDLtable.cpp
Merge [TRAFODION-2235] PR-958 Added monitoring of local monitors znode to detect errors with Zookeeper quorum

TRAFODION-2492 Support for native hive views, plus few more changes

-- added support for native hive views created externally. These views

can be accessed in a traf sql query.

There are some restrictions as listed below:

-- privileges support has not yet been added. That will be done, as

needed, in the next checkin.

-- usage info for tables contained in a native hive view is not maintained.

-- native hive views cannot be inserted/updated/deleted

-- cannot update stats on a native hive view

-- support for GET statements to retrieve hive data

get tables/views/objects in schema hive.sch;

-- this will return all tables/views in specified schema(hive database)

get tables/views/objects in catalog hive;

-- this will return all tables/views in hive

get schemas in catalog hive;

-- this will return all schemas(databases) that exist in hive

-- GET statements to retrieve hive data now supports optional MATCH clause.

This can be used to filter results.

-- showddl will show if an external table on hive was created implicitly

for internal usage (upd stats, privileges, views) or explicitly by user.

Internal creation of external table now use 'create implicit external table'

syntax and that info is stored in metadata.

-- drop external table will drop that table even if underlying hive table

is missing. Currently it returns an error.

-- at runtime, accessing a missing hive table now returns a better error

message instead of an internal "data mod check failed" message.

-- regress/tools/runallsb has 2 new options:

-basetests (this will run core,compGeneral,executor,seabase,hive)

-othertests (this will run all other tests suites)

-- optimizer/NATable.cpp was incorrectly indented by some checkin from

a few days back. TABs were used instead of spaces which caused code

to become all crooked. That has been fixed.

-- regress/hive/TEST007 has been updated with additional hive view tests

    • -27
    • +176
    /core/sql/executor/ExExeUtilGet.cpp
    • -24
    • +38
    /core/sql/generator/GenRelExeUtil.cpp
    • -6
    • +28
    /core/sql/optimizer/BindRelExpr.cpp
    • -2389
    • +2471
    /core/sql/optimizer/NATable.cpp
  1. … 12 more files in changeset.
TRAFODION-2441 user has only select privilege on a table can do ...

This is the second delivery that updates "get" commands so users can only view

information where they have been granted privileges. This delivery handles:

get components;

get privileges on component;

get privileges on component for <role>;

get privileges on component for <user> [cascade];

cascade returns privileges for user plus any roles the user has been granted

    • -73
    • +118
    /core/sql/executor/ExExeUtilGet.cpp
[TRAFODION-2481] Add section on initializing meta-data via Ambari

    • binary
    /docs/provisioning_guide/src/images/amb5.PNG
Merge Fix for [TRAFODION-2489] [TRAFODION-2490] fix for pyinstaller

[TRAFODION-2481] Improve ambari section of provisioning guide

Add small screen caps to better illustrate ambari integration.

Fix a couple of typos in project-name macros, thanks to Anuradha's review.

Fix a bug in the ambari integration code, found by exercising steps in

the doc.

    • binary
    /docs/provisioning_guide/src/images/amb1.PNG
    • binary
    /docs/provisioning_guide/src/images/amb2.PNG
    • binary
    /docs/provisioning_guide/src/images/amb3.PNG
    • binary
    /docs/provisioning_guide/src/images/amb4.PNG
Merge Fix for [TRAFODION-2480] monitor should not check hostname strictly