trafodion_install

Clone Tools
Constraints
Constraints: committers
 
Constraints: files
Constraints: dates
Move install into subdir to combine repos

  1. … 66 more files in changeset.
Fixed logging error

traf_start was creating its own trafodion_install<timestamp>.log file.

Now only one file is being created.

Change-Id: Ica4c362224074316a027b939333f7a70d8565686

  1. … 1 more file in changeset.
Added ssh test, fixed tar bug, testing traf user

1. Added ssh test to make sure able to connect

2. Fixed tar bug when running installer from other directory than

/installer/

3. Testing to make sure user is not running trafodion_installer from

the trafodion user id.

4. Added message to make sure user checks their firewall settings

if they can not access Hadoop.

Edit 1: Changed error reporting. Change locatoin of Trafodion user id

check.

Edit 2: Most check outside the for loop. Changed "much" to "must".

Change-Id: I967c94ff23a0f0d55a1ca3a8ec7d51b7fb48307f

  1. … 3 more files in changeset.
Reserving default ports (37800 and 40010) for DCS

Edit 1: Previous code was overwriting all previous reserved ports.

Edit 2: Typo

Edit 3: Typos. Added support for saving previous reserved ports.

Edit 4: Spacing.

Change-Id: I19294116da0aa062129a90a2e2ae83ca19a26237

  1. … 2 more files in changeset.
scanner fixes and improvements, including adjustments to install scripts

************** SPECIAL NOTE **************

With this check-in and going forward, it's necessary to download both the

installer and trafodion tar files in order to run the scanner. In other

words, it's no longer possible to just copy the 2 scanner files,

trafodion_scanner and trafodion_scanner.cfg, onto a cluster and

run the scanner (actually, it's still possible to do this in test

environments, by providing a trafodion configuration file with the

relevant settings via the scanner -t (--trafodion_config_file) option).

Nonetheless, the following scanner use cases are still supported:

1. Scanner is automatically invoked by the installer

2. Scanner is manually invoked

a. Before running the installer

b. After running the installer

************** trafodion_scanner.cfg changes **************

+ added back the HBaseVersion and HBaseJavaVersion checks

--> now the HBaseVersion check takes into account

the CDH_5_3_HDP_2_2_SUPPORT setting from the

the Trafodion configuration file

+ added HadoopDistro check to check for supported Hadoop distribution,

'hortonworks' or 'cloudera'

+ removed RECORD_CONFIG for "Hadoop distribution", because it's no longer

needed

+ fixed Bug 1442258 by adding KernelPidMaxLimit check

+ added RECORD_CONFIG for "Kernel parameters"

************** trafodion_scanner changes **************

+ added logic to read the Trafodion configuration file and set placeholder

variables for use in various checks

--> added -t (--trafodion_config_file) option to specify the

Trafodion configuration filename

(default is /etc/trafodion/trafodion_config)

--> renamed the -c option from --config_file to --scanner_config_file,

for consistency with the new -t (--trafodion_config_file) option

--> removed the -n (--nodes) option, since the node info now comes

from the Trafodion configuration file

--> removed the -x (--execute_local_commands) option for two reasons:

1) it makes less sense now 2) it's increasingly hard to maintain

--> right now the following settings are used from the Trafodion

configuration file: NODE_LIST, CDH_5_3_HDP_2_2_SUPPORT

+ removed the hadoop prerequisite checks because they are no longer needed,

given the following checks in trafodion_scanner.cfg: HadoopDistro,

SameHadoopVersion, HBaseVersion, and SameHBaseVersion

+ changed logger name from "trafodion_scanner_logger" to "trafodion_scanner"

to reduce unnecessary clutter in the log file

+ cleaned up the logging code

+ adjusted the help text

+ fixed a bug in the group_nodes_by_string function

************** trafodion_install changes **************

+ adjusted scanner invocation

--> removed the -n option and added the -t option,

per the changes mentioned above

************** traf_config_setup changes **************

+ fixed how permissions are set for the $TRAF_CONFIG file

Change-Id: I195cb437dece75cca45cc4c221a423c7fc3b8d26

  1. … 3 more files in changeset.
Scanner by default, fixes to trafodion_uninstaller

Scanner running by default.

Fixes to trafodion_uninstaller (removing --instance option).

Edit 1: Changed error message, added echo statements to

trafodion_uninstaller to clarify, fixed HDP version bug.

Change-Id: If6fe0bc88abbcb634eabf4a292a0975aa87f4cc0

  1. … 2 more files in changeset.
Corrected typos in user-visible messages and scripts

Corrected 4 misspellings and about 10 uses of "its" which should be "it is".

Deleted some but not all trailing spaces in the modified files.

Change-Id: I382110a24e325686f2bcf48e88a7a2394d34618b

  1. … 4 more files in changeset.
Support for single node install and --no_scanner

Added support for a single node simple security installation.

Added --no_scanner flag to trafodion_install

Change-Id: Idad55ee075aa080b8dfee2cd7f9bfba8849b8fba

  1. … 2 more files in changeset.
Simple security and scanner by default

The scanner will now be ran by default. The --no_scanner option can be

given to trafodion_install to by pass the scanner.

Simple security has now been automated. Users will be prompted to give

LDAP config information and then traf_authentication_setup will be ran

before sqstart.

Edit 1: Deleted unused variable and changed log directory for the

scanner logs.

Edit 2: Copyright

Edit 3: Changing the scanner to not be ran by default. Due to errors during

testing.

Change-Id: I60f75d11e7be615e475b3ffe4f9b4227ae6e7971

  1. … 5 more files in changeset.
Fix for when REST server is not present in the build

If installing a 1.0 Trafodion build, the REST server is not

present. This fix adds logic to check if the REST server is

in the Trafodion build and handle it appropriately by not trying

to isntall it.

Change-Id: Ied4fb00403422e72926842f274f275675990ec5c

Fixed copy error and JRE error

Added error for when user trys to use a JAVA JRE instead of a JDK.

Fixed installer directory copy error that was preventing new files

from being copied to /usr/lib/trafodion/installer.

Edit 1: Changed order of Java checks.

Change-Id: I7d72b3892767e9d37f700dd2ff1b622c6b99476e

  1. … 1 more file in changeset.
Fix for trafodion.conf bug

Trafodion.conf file was not being copied to all nodes. Needed to change

permissions on copy directory.

Edit 1: Changing permissions on $LOCAL_WORKDIR to allow multiple people

to install on one cluster. Fixed bug when setting $HOME_DIR. Fix to bug

1440229.

Edit 2: Fixed typo and permission on set of files.

Edit 3: Fixed Scanner return error bug. THANKS YVES.

Edit 4: Added case if scanner fails.

Change-Id: I5a237cbae4779b91121a467b1afba65f796be4cc

  1. … 2 more files in changeset.
Fixed Linux limits settings and other bugs

Changed the way Linux system limits are set for trafodion

previously they were set in /etc/security/limits.conf and now

they are set for the trafodion userid in our own file in

/etc/security/limits.d/trafodion.conf in traf_setup

Fixed bug where node list kept getting appended to when user

entered node names on subsequent runs of the installer instead of

resetting the node list in traf_config_setup

Deleted some old code no longer used in traf_add_user

Added a recusive option to a chmod to handle the case when the

directory already existed and had other files in it in

trafodion_install.

Change-Id: I971799c93786b810b878e6434d8aae28c67b4db3

  1. … 3 more files in changeset.
REST server support and several bug fixes.

Added REST Server installation/configuration

Fixed JAVA_HOME not getting set correctly on all nodes

Removed LOCAL_WORKDIR from config file which caused problems

when later installs were ran from a different sudo userid.

Fixed problem where NODE_LIST was getting reversed node order

Fixed traf_*_mods98 scripts that were using $PWD instead of

$LOCAL_WORKDIR which caused hbase-trx jar file to not be

copied to all nodes.

patch 1: Added code to support older Trafodion builds that do

not have the REST build tar file.

Also moved some pdsh commands to after pdsh has been installed.

Change-Id: I3a1c51255ca34899a003257f8e442267dddfbdf1

  1. … 7 more files in changeset.
Removed prompt for scanner

Scanner will now only run if --run_scanner command line option is used.

Edit 1: Fix to get correct Hortonworks repo.

Change-Id: Iac7d6f7a2cb3969ed3ce39bb744aaebd941482fd

  1. … 2 more files in changeset.
Adding Hadoop upgrade support

This code is dependent on a file being added to Trafodion core to work

for Cloudera 5.3 and Hortonworks 2.2. Until that file is added, install

will fail on Cloudera 5.3 and Hortonworks 2.2 but should build fine on

any other version.

Edit 1: Adding check to make nothing greater than Cloudera 5.3.* is

installed or Hortonworks 2.2.* is installed. Adding fix to NFS check.

Edit 2: Copy-paste error.

Edit 3: Changing permissions and type on package name

Edit 4: Error fixing

Change-Id: I065bef3d52651b8cda18deacd0bec6d2343ad1d8

  1. … 4 more files in changeset.
NODE_LIST, removed hostname checks, scanner

Changed how NODE_LIST is created. A list of nodes is entered by the user

and that list is used to ssh to each node given which then the

"hostname" command is used to get hostname which is used to create

NODE_LIST that is used to generate sqconfig. Users can now enter in IP

addresses or node names. All hostname checks are now removed.

The scanner can now be called from trafodion installer.

Edit 1: Removed code used for testing

Edit 2: Corrected TRAF_VERSION (for when a debug build is used) and

added changes to how scanner is called.

Change-Id: I5671be3566c1fc3af0d7441254d9fa52150db2ba

  1. … 2 more files in changeset.
Removing any hard coded "trafodion"

Removed all hard coded "trafodion" and replaced with $TRAF_USER

Change-Id: I78c5df3830b3264be91f98df3b5aa83c1689a2d6

  1. … 3 more files in changeset.
Script name change, Java path and uninstaller bug

Changed name of traf_installer to traf_start to avoid confusion with new

script trafodion_install.

Checking to make sure there is a correct Java path in Java version

check.

Added fix to trafodion_uninstaller to all --instance option to be ran by

root or sudo user.

Change-Id: I263f5d9969f3e53e745dc497ceead0c33ece873c

  1. … 4 more files in changeset.
Adding additional diagnostics to debug jenkins gate problem

Change-Id: I5a4c1b490dbfc27b6de327db378c9227322f1ad8

Merge the private shared single script repo into master.

This is a checkin of the single script project which basically

wraps all the various scripts into one single script that the user

runs. The script now has the logic to determine which Hadoop distro

is installed as well as to determine if it is a full install or only

an upgrade and many other changes.

This was developed and tested in a private shared repo so

a review of the code has already been done. QA has approved this

to be checked in.

edit1: fixed shift problem in parsing parameters

edit2: Fixed problems with user config file

Added more error checking for config file

edit3: Fixed config directory creation

edit4: Fixed copyright and OpenStack VM package installation

edit5: Changed Java version detection

No longer do yum removes if package is there already

edit6: Refixed OpenStack VM package installation that got

overlaid in a merge

Added chown command to handle case where SQ_ROOT was not

a sub-directory of the Trafodion userid's home dir

Change-Id: I37a331c89c311feee430541b69f5f7dfe2177e60

    • -0
    • +579
    ./trafodion_install
  1. … 27 more files in changeset.