System Not coming up in EXECUTION phase of Upgrade (MAIN_SWITCH/STARTSAP_TRANS)

[Former Member]

Hi,

  I am working on CRM 7.0 to EHP3 for CRM 7.0 Upgrade and facing an error :-

   System is not coming up in MAIN_SWITCH/STARTSAP_TRANS phase of EXECUTION Roadmap in Upgrade.

Content of dev_ms.new :-

deiap02:r01adm 58> more dev_ms.new

43y0C

---------------------------------------------------

trc file: "dev_ms.new", trc level: 1, release: "721"

---------------------------------------------------

[Thr 01] Sun Jul 13 16:46:09 2014

[Thr 01] ms/http_max_clients = 500 -> 500

[Thr 01] MsSSetTrcLog: trc logging active, max size = 52428800 bytes

systemid   274 (HP (IA-64) with HP-UX)

relno      7210

patchlevel 0

patchno    136

intno      20020600

make       multithreaded, Unicode, 64 bit, optimized

pid        16986

[Thr 01] ***LOG Q01=> MsSInit, MSStart (Msg Server 1 16986) [msxxserv_mt. 2293]

[Thr 01] SigISetDefaultAction : default handling for signal SIGCHLD

[Thr 01] ***LOG Q0I=> NiIBindSocket: bind (226: Address already in use) [nixxi.cpp 3737]

[Thr 01] *** ERROR => NiIBindSocket: SiBind failed for hdl 25/sock 11

    (SI_EPORT_INUSE/226; I4; ST; 0.0.0.0:3910) [nixxi.cpp    3737]

[Thr 01] *** ERROR => MsSCommInit: NiBufListen(3910) (rc=NIESERV_USED) [msxxserv_mt. 12400]

[Thr 01] *** ERROR => MsSInit: MsSCommInit (internal) [msxxserv_mt. 2371]

[Thr 01] *** ERROR => MsSInit failed, see dev_ms.new for details

[msxxserv_mt. 7733]

[Thr 01] ***LOG Q02=> MsSHalt, MSStop (Msg Server 16986) [msxxserv_mt. 7787]

Bdev_ms.new: END@

No dispatcher files generated (Dispatched not coming up when checked using (dpmon pf= profile).

Please help

Regards,

Alok

[Reagan]

lsof -i tcp:3910

If there are processes running then kill it.

Also delete the .sapstream files present at /tmp

Restart SAP

Regards

RB

[Former Member]

Hi Benjamin,

   Now I can not see any error as such but System is still not UP.

I can see below entries in dev_ms file :-

[Thr 01] set HTTPS state to LISTEN

[Thr 01] *** HTTPS port 8120 state LISTEN ***

[Thr 01] *** I listen to port 3610 (3610) ***

43y0CBdev_ms (84%)@43y0C43y0C[Thr 01] *** I listen to internal port 3910 (3910) ***

43y0CBdev_ms (86%)@43y0C43y0C[Thr 01] *** HTTP port 8110 state LISTEN ***

43y0CBdev_ms (88%)@43y0C43y0C[Thr 01] *** HTTPS port 8120 state LISTEN ***

43y0CBdev_ms (90%)@43y0C43y0C[Thr 01] CUSTOMER KEY: >K1232081172<

43y0CBdev_ms (92%)@43y0C43y0C[Thr 01] build version=721.2013.08.20

43y0CBdev_ms (93%)@43y0C43y0C

43y0CBdev_ms (95%)@43y0C43y0C[Thr 01] Sun Jul 13 21:07:29 2014

43y0CBdev_ms (95%)@43y0C43y0C[Thr 01] LOGIN: deiap02_B01_00 [127.0.0.1] (DIA UPD ENQ BTC SPO UP2 ICM )

Now my SID is R01 but last line in this log is deiap02_B01_00 [127.0.0.1] (DIA UPD ENQ BTC SPO UP2 ICM ) . B01 is another instance intalle on same host. Can you suggest why this is seen in dev_ms of R01 ? What can we do here ?

Regards,
Alok

[Reagan]

Based on the above I will not be able to guide you. If the instance doesn't start then I would check the trace files in the central services directory(If there is separate central services). It would be easy if you could upload them. dev_ms,  dev_enq* logs and the latest dev_w0 trace file.

Regarding the profile check the profiles in the profile directory and also the system numbers of all the systems running on the machine.

[former_member182657]

Hi Alok,

After complete restart of system if still issue persists then kindly upgrade the system kernel or apply the patch with considerations of SAP Notes  1782391 - Message server crash

and  1898960 - Message Server fails to bind the port after connection error

Hope this will help you.

Regards,

Gaurav

[Former Member]

Hi Adil,

     Have already read this note.

   Can see below result :-

deiap02:r01adm 51> netstat -nap|grep 3910

netstat: option requires an argument -- p

deiap02:r01adm 52> netstat -na|grep 3910

tcp        0      0  *.3910                 *.*                     LISTEN

e0000004692f3080 stream      0      0 e0000004132fce80                0                0                0 /tmp/.sapstream3910

e0000004135fbd00 stream      0      0                0 e000000469bc5980                0                0 /tmp/.sapstream3910

e00000046433f380 stream      0      0                0 e000000400e6d600                0                0 /tmp/.sapstream3910

deiap02:r01adm 53>

netstat -nap is not working. Do we have any other option to find the pid . ?

Regards,

Alok

[divyanshu_srivastava3]

Hi Alok,

Set rdisp/msserv_internal 39XX in your default profile and restart.

Divyanshu

[former_member182657]

Hi Alok,

Kindly reconfirm for port 3910 under /etc/services it's not being used by any other services.Use command netstat -a to check for the port usage.

Also try to restart the complete system to release the locks and re execute the phase.

Regards,

Gaurav

[divyanshu_srivastava3]

Hi Alok,

Your port already in use..

check with:

netstat -nap | grep 3910 and

lsof -i :3910

Regards,

Divyanshu

[Former Member]

Hi Divyanshu ,

   Thanks for your quick response but these two commands doesnot work . Any other option..? Which process is using this port. i can not see any entry for port 3910 in services file. Is it possible to explicitely maintain this port for some process in SAP APplication in services file ?

Regards,

Alok

[divyanshu_srivastava3]

Hi Alok,

You need to get these packages for testing ports from your OS team.

You don't have to maintain internal ports in services file.

Divyanshu

[Former Member]

Hi Alok,

Please check the below note, hopefully this might help addressing the issues.

1845121 - Address already in use - how to find the process listening on port ...

Thanks

Adil