standby node installation fail in distributed hana installation

[Former Member]

Hi,

today i tried HANA distributed environment setup in our offic.

i want to introduce 3 servers: 1 master, 1 slace and 1 standby o test.

1. i set up a master hana in server A, and startup it

2. i set up a slave in server B through command ./hdbaddhost, which can succesfully communicate with server A.

     through hana studio, i find out these 2 nodes succesfully set up a distributed environment

3. last step, i want to create standby node in the same way just like that in server B setup. But it fails and display this errror message

Enter SAP HANA system ID [DS9]:

Enter Shared Installation Path [/hanamnt]:

Enter System Administrator (ds9adm) Password:

Options:

  IndexServer role | Description

  -------------------------------------------------------------

  worker           | host is used for database processing

  standby          | host is idle and available for HA failover

Enter IndexServer role [worker]: standby

  add host failed

    AddHost not possible. Start SAP HANA Database on master host and run addHost again.

i have double checked that the nameserver in master actually is running and server B also can communicate with server A

it is very appreciate any comments and tips, thanks

[Former Member]

Try this...

As it is not able to detect the master on the node where  you are running addhost, connect to the database  using hdbsql command.

are you running the command on node 1 or node 2 ?

Thanks!

[Former Member]

hi,

I've the same issue. could you tell any solution ?

my database HANA is running on node 1 (hanatest), i try to add node 2 (hanaslave) from node 1 (hanatest)

Do you want to continue? (y/n): y

Adding additional host to SAP HANA Database...

  Adding additional host...

  Adding host 'hanaslave'...

      Creating a multiple host system failed

        Adding host 'hanaslave' failed!

Addition of hosts to the SAP HANA system failed.

  Error occurred while executing Add Additional Hosts to SAP HANA System.

    Reconfiguring SAP HANA system failed!

      Add hosts:

        Creating a multiple host system failed

          Adding host 'hanaslave' failed!

            Add host failed

              AddHost not possible. Start SAP HANA Database on master host and run addHost again.

on node 1 : hanatest

db0adm@hanatest:/usr/sap/DB0/HDB00> HDB version

HDB version info:

  version:             1.00.102.00.1442292917

  branch:              fa/newdb100_rel

  git hash:            52f6ca2fae0efb72ced88ca2e9327bac37458cca

  git merge time:      2015-09-15 06:55:17

  weekstone:           0000.00.0

  compile date:        2015-09-15 07:06:35

  compile host:        ld7272

  compile type:        rel

USER

PID  PPID %CPU

VSZ   RSS COMMAND

db0adm   12659 12658  0.0 108424  1976 -sh

db0adm   12784 12659  0.0 106200  1532  \_ /bin/sh /usr/sap/DB0/HDB00/HDB info

db0adm   12811 12784  0.0 110200  1048	\_ ps fx -U db0adm -o user,pid,ppid,pcpu,vsz,rss,args
db0adm	9002	1  0.0  22352  1776 sapstart pf=/hana/shared/DB0/profile/DB0_HDB00_hanatest
db0adm	9010  9002  0.0 551052 289536  \_ /usr/sap/DB0/HDB00/hanatest/trace/hdb.sapDB0_HDB00 -d -nw -f /usr/sap/DB0/HDB00/hanatest/daemon.ini pf=/usr/sap/DB0/SYS/prof
db0adm	9028  9010  0.6 4272264 1186732	\_ hdbnameserver
db0adm	9084  9010  2.5 2906444 551672	\_ hdbcompileserver
db0adm	9086  9010  0.4 2790492 413568	\_ hdbpreprocessor
db0adm	9108  9010 10.2 7019176 4000764	\_ hdbindexserver
db0adm	9110  9010  1.2 4158040 1051960	\_ hdbxsengine
db0adm	9341  9010  0.5 3085388 635560	\_ hdbwebdispatcher
db0adm	4286	1  0.0 867580 74412 /usr/sap/DB0/HDB00/exe/sapstartsrv pf=/hana/shared/DB0/profile/DB0_HDB00_hanatest -D -u db0adm

[former_member182307]

Hi,

I guess this very old post was solved by applying this note back then :

1974423 - SAP HANA SPS 07 Database Revision 71

Fixed a programming error that led to the wrong nameserver (the first available nameserver) being pinged as

the master and therefore to an exception in the addhost:

"INFO:   Checking if server is alive

INFO:   NameServer Master is down"

This only happened sporadically, mainly in conjunction with use of the storage connector API and one standby server.

For the time being, what's the HANA version you're using ?

What are you trying to achieve : Scaleout node configuration or HDB replication ?

To add a scaleout node, i used to use the hdblcm command this way :

hdblcm --addhost = hanaslave role=standby

Thanks & Best regards.

[former_member182307]

And, by the way : Hello Gael, it's been a while !!

[Former Member]

Hi steve

first, thanks for your reply

My version HANA is SP10 Revision 102

I try to do a scaleout node configuration (just add a new host in my configuration which is a single host)

When i use this command with root user : ./hdblcm --addhosts=hanaslave:role='standby'

i get this error :

Connect to host 'hanaslave' failed: rc=-8 LIBSSH2_ERROR_KEY_EXCHANGE_FAILURE, Unable to exchange encryption keys

So i use command below and i get a error, i don't understand because the Nameserver is up:

./hdblcm --addhosts=hanaslave:role='standby' --remote_execution=saphostagent

SAP HANA Lifecycle Management - SAP HANA 1.00.102.00.1442292917

***************************************************************

Choose an action to perform

  Index | Action to be performed     | Description

  --------------------------------------------------------------------------------------

  1     | add_hosts                  | Add Additional Hosts to the SAP HANA System

  2     | configure_internal_network | Configure Inter-Service Communication

  3     | configure_sld              | Configure System Landscape Directory Registration

  4     | print_component_list       | Print Component List

  5     | rename_system              | Rename the SAP HANA System

  6     | uninstall                  | Uninstall SAP HANA Components

  7     | unregister_system          | Unregister the SAP HANA System

  8     | update_component_list      | Update Component List

  9     | update_components          | Install or Update Additional Components

  10    | update_host                | Update the SAP HANA Instance Host integration

  11    | exit                       | Exit (do nothing)

Enter selected action index [11]: 1

System Properties:

DB0 /hana/shared/DB0 HDB_ALONE

        HDB00

        version: 1.00.102.00.1442292917

        host: hanatest (Database Worker (worker))

Enter SAP Host Agent User (sapadm) Password:

Collecting information from host 'hanaslave'...

Information collected from host 'hanaslave'.

Enter System Administrator (db0adm) Password:

Enter Certificate Host Name For Host 'hanaslave' [myhost.wdf.sap.corp, O=SAP AG, C=DE]:

Summary before execution:

=========================

Add Additional Hosts to SAP HANA System

   Add Hosts Parameters

      Remote Execution: saphostagent

      Enable the installation or upgrade of the SAP Host Agent: Yes

      Do not start added hosts and do not start SAP HANA System: No

      Certificate Host Names: hanaslave -> myhost.wdf.sap.corp, O=SAP AG, C=DE

   Additional Hosts

      hanaslave

         Role: Database Standby (standby)

         High-Availability Group: default

         Storage Partition: <<assign automatically>>

Do you want to continue? (y/n): y

Adding additional host to SAP HANA Database...

  Adding additional host...

  Adding host 'hanaslave'...

      Creating a multiple host system failed

        Adding host 'hanaslave' failed!

Addition of hosts to the SAP HANA system failed.

  Error occurred while executing Add Additional Hosts to SAP HANA System.

    Reconfiguring SAP HANA system failed!

      Add hosts:

        Creating a multiple host system failed

          Adding host 'hanaslave' failed!

            Add host failed

              AddHost not possible. Start SAP HANA Database on master host and run addHost again.

You can send feedback to SAP with this form: https://hanatest:1129/lmsl/HDBLCM/DB0/feedback/feedback.html

Log file written to '/var/tmp/hdb_DB0_hdblcm_add_hosts_2015-10-15_15.57.43/hdblcm.log' on host 'hanatest'.

thanks again

[former_member182307]

O.K

Then what is in the '/var/tmp/hdb_DB0_hdblcm_add_hosts_2015-10-15_15.57.43/hdblcm.log' file ?

What if you perform it using the hdblcmgui ?

Are you running the HDB on RHEL ? If this is the case then have a look at the Red_Hat_Enterprise_Linux_RHEL_6_x_Configuration_Guide_for_SAP_HANA_en.pdf

Inside there is a section about it :

SAP HANA Multi host install fails with the message "LIBSSH2_ERROR_KEY_EXCHANGE_FAILURE , unable to exchange encryption keys"

And a Redhat note also :

SAP HANA Multi host install fails with the message &amp;quot;LIBSSH2_ERROR_KEY_EXCHANGE_FAILURE , un...

So I guess you'll have to review these parts.

Best regards !

Steve.

[former_member182307]

Can you also try to install the hostagent in advance on you hanaslave host and then retry to scaleout from your hana master host.

The way you do it is correct using the --remote_execution=saphostagent.

Then I'd give a try to install the saphostagent only in advance on the hanaslave server.

One last thing also . Check the information about a bug on scale out in the following note :

2220948 - SAP HANA SPS 10 Database Maintenance Revision 102.01

Scale Out

Fixed an issue in the area of metadata management. When the connection was established at the slave node of a scale out system with Multitenant Database containers enabled, the following error message was seen in indexserver trace: "The index server (for the specified indexes) cannot be determined;Catalog master not found".

Best regards,

Steve.

[Former Member]

Hi Steve.

Thanks you but i have already seen that and it's why i use syntaxe below when i try to add host

--remote_execution=saphostagent.

host agent is already installed in my hana slave host

my question is about this error

"AddHost not possible. Start SAP HANA Database on master host and run addHost again."

when i check my hdbnameserver is up.

FWI : Hana is install in single container mode

[lucas_oliveira]

hi guys,

Let's not revive / highjack old threads. Create a new one and refer to this one if necessary. Please keep up with

Thanks,

Lucas de Oliveira (moderator)

[Former Member]

HI,

i am facing same issues.

can you please let me know how can we over come this?.

Thanks

Ravindar

[Former Member]

Hi,

Did you restart master node and then try again ?

Thanks!

[Former Member]

Hi,

yes, i not only tried restart hana but also tried to restart server.

but it is not useful.

By the way, the Hana verion is V60

[sunny_pahuja2]

As per error message, it looks like that master node is not running. Could you please run command HDB info on master node and paste the output here?

Thanks

Sunny

[Former Member]

Thanks for your quickly response. as my described, i have checked master node and find out each hana instance has been started includng nameserver, index server, etc.

the output from ./HDB info is pasted below for reference

linuxsg:~ # su - ds9adm

linuxsg:/usr/sap/DS9/HDB09> ./HDB

Usage: ./HDB { start|stop|reconf|restart|version|info|proc|admin|kill|kill-<sig>|term }

  kill or kill-9 should never be used in productive environment!

linuxsg:/usr/sap/DS9/HDB09> ./HDB info

USER       PID  PPID %CPU    VSZ   RSS COMMAND

ds9adm    9625  9624  0.0  13860  2764 -sh

ds9adm    9702  9625  0.0  12880  1708  \_ /bin/sh ./HDB info

ds9adm    9725  9702  0.0   4924   844      \_ ps fx -U ds9adm -o user,pid,ppid,pcpu,vsz,rss,args

ds9adm    8482     1  0.0  20036  1468 sapstart pf=/usr/sap/DS9/SYS/profile/DS9_HDB09_linuxsg

ds9adm    8496  8482  1.5 810992 294216  \_ /usr/sap/DS9/HDB09/linuxsg/trace/hdb.sapDS9_HDB09 -d -nw -f /usr/sap/DS9/HDB09/linuxsg/daemon.ini pf=/usr/sap/DS9/SYS/profile/DS9_HDB09_linuxsg

ds9adm    8516  8496  6.6 9713564 1505272      \_ hdbnameserver

ds9adm    8593  8496  1.5 6833160 326752      \_ hdbpreprocessor

ds9adm    8596  8496  1.5 8529432 391304      \_ hdbcompileserver

ds9adm    8622  8496  7.9 8803352 2308168      \_ hdbindexserver

ds9adm    8625  8496  7.0 8449516 1752368      \_ hdbstatisticsserver

ds9adm    8628  8496  6.7 10315760 1628532      \_ hdbxsengine

ds9adm    8881  8496  0.0 203384 66216      \_ sapwebdisp_hdb pf=/usr/sap/DS9/HDB09/linuxsg/wdisp/sapwebdisp.pfl -f /usr/sap/DS9/HDB09/linuxsg/trace/dev_webdisp

ds9adm    7075     1  0.0 224296 89688 /usr/sap/DS9/HDB09/exe/sapstartsrv pf=/usr/sap/DS9/SYS/profile/DS9_HDB09_linuxsg -D -u ds9adm

linuxsg:/usr/sap/DS9/HDB09>

Thanks for your help

[sunny_pahuja2]

Hello,

It looks like stand by node it not able to check status of master node. Could you please check for errors in trace files on master/stand by node?

Thanks

Sunny

[Former Member]

Hello Sunny,

i checked this trace file according to the fail output message

""""

Enter IndexServer role [worker]: standby
  add host failed
    AddHost not possible. Start SAP HANA Database on master host and run addHost again.

Log file written to '/var/tmp/hdb_DS9_addhost_2013-09-19_21.54.30/hdbaddhost.log'.

"""

21:54:31.947 - INFO:   Start Date: 2013-09-19  -  hdbaddhost

120 21:54:31.947 - INFO:   Checking configuration

121 21:54:31.947 - INFO:     Parameter 'hostname' is set with default value = 'linux-gr9k'

122 21:54:31.947 - INFO:     Parameter 'sapmnt' (Target) is not set

123 21:54:31.947 - INFO:     Parameter 'storage_partition' (StoragePartitionNumber) is not set

124 21:54:31.947 - INFO:     Parameter 'role' is not set

125 21:54:31.947 - INFO:     Parameter 'group' (HostGroup) is not set

126 21:54:31.948 - INFO:     Parameter 'nostart' is set with default value = 'No'

127 21:54:31.948 - INFO:     Parameter 'machine_utilization' (MachineUtilization) is not set

128 21:54:42.916 - INFO:     Checking password via sapstartsrv of master host (linuxsg)

129 21:54:34.232 - INFO:   Parameter 'sid' is set by user (confirmed the default value), value = 'DS9'

130 21:54:37.504 - INFO:   Parameter 'sapmnt' (Target) is set by user (confirmed the default value), value = '/hanamnt'

131 21:54:43.003 - INFO:   Parameter 'password' is set by user, value = '***'

132 21:54:49.582 - INFO:   Parameter 'role' is set by user, value = 'standby'

133 21:54:49.582 - INFO:   Checking system requirements

134 21:54:49.583 - INFO:     Performing HANA platform check...

135 21:54:49.583 - INFO:       Starting external program /usr/local/bin/python

136 21:54:49.583 - INFO:         Command line is: /usr/local/bin/python /hanamnt/DS9/exe/linuxx86_64/hdb/python_support/HanaHwCheck.py

137 21:54:49.607 - INFO:         Program terminated with exit code 0

138 21:54:49.778 - INFO:   Checking if server is alive

139 21:54:50.741 - INFO:     NameServer Master is down

140 21:54:50.742 - ERR :   AddHost not possible. Start SAP HANA Database on master host and run addHost again.

141 21:54:50.743 - ERR :   add host failed

142 21:54:50.743 - INFO:   Summary of critical errors

143 21:54:50.743 - ERR :     add host failed

144 21:54:50.742 - ERR :       AddHost not possible. Start SAP HANA Database on master host and run addHost again.

any other place we can find out more useful trace log?

Thnaks for your help

[sunny_pahuja2]

Could you please check if you have established n/w connectivity as mentioned in SAP note 1886462?

Thanks,

Sunny