ICM fails after kernel upgrade(NW 701)

[Former Member]

Hi Friends,

I am facing a very weird problem after I have performed kernel upgrade on my system

My system is a CRM 7.0 system based on kernel version 701.

The current kernel version is 150. The latest available on the market place is a disp+work package number 165.

After I apply this disp+work package, my system fails to come up. When I analyzed the logs(dev_disp,dev_ms,dev_w*), the error seems to be pointing towards ICM, which fails to start post-kernel upgrade.

The details of dev_icm log file is as follows:

[Thr 13622] IcmWatchDogThread: watchdog started

[Thr 1] *** ERROR => CHECK_COM_VERSION: remote: 7000, local: 7001 [icxxext_mt.c 338]

[Thr 1] *** ERROR => IcmMsgProcess: IcmRecMsg (rc=-4,nirc=0) failed for partner: NONE(0), wp_no: 0 [icxxextbnd_m 648]

[Thr 13879] *** WARNING => HttpPlugInInit: Parameter icm/HTTPS/trust_client_with_issuer or icm/HTTPS/trust_client_with_subject not set => do not trust any intermediary

X.509 cert data will be removed from header [http_plg_mt. 730]

[Thr 13879] ISC: created 400 MB disk cache.

[Thr 13879] Wed Oct 26 10:11:10 2011

[Thr 13879] ISC: created 50 MB memory cache.

[Thr 13879] HttpSubHandlerAdd: Added handler HttpCacheHandler(slot=0, flags=12293) for /:0

[Thr 13879] HttpExtractArchive: files from archive /usr/sap/SCR/SYS/exe/run/icmadmin.SAR in directory /usr/sap/SCR/DVEBMGS64/data/icmanroot are up to date

[Thr 13879] HttpSubHandlerAdd: Added handler HttpAdminHandler(slot=1, flags=4101) for /sap/admin:0

[Thr 13879] CsiInit(): Initializing the Content Scan Interface

[Thr 13879] IBM RS/6000 with AIX (mt,unicode,SAP_CHAR/size_t/void* = 16/64/64)

[Thr 13879] CsiInit(): CSA_LIB = "/usr/sap/SCR/SYS/exe/run/libsapcsa.o"

[Thr 13879] HttpSubHandlerAdd: Added handler HttpAuthHandler(slot=2, flags=12293) for /:0

[Thr 13879] HttpSubHandlerAdd: Added handler HttpSAPR3Handler(slot=3, flags=1052677) for /:0

[Thr 13879] Started service 8064 for protocol HTTP on host "upgsap01.fora.se"(on all adapters) (processing timeout=600, keep_alive_timeout=30)

[Thr 1] Started service 25 for protocol SMTP on host: "upgsap01.fora.se"(on all adapters) (processing timeout=600, keep_alive_timeout=30)

[Thr 258] **** SigHandler: signal 20 received

[Thr 13879] IcmNetCheck: network check passed without detecting problems

[Thr 1] *** ERROR => CHECK_COM_VERSION: remote: 7000, local: 7001 [icxxext_mt.c 338]

[Thr 1] *** ERROR => IcmMsgProcess: IcmRecMsg (rc=-4,nirc=0) failed for partner: NONE(0), wp_no: 0 [icxxextbnd_m 648]

[Thr 1] *** ERROR => CHECK_COM_VERSION: remote: 7000, local: 7001 [icxxext_mt.c 338]

[Thr 1] *** ERROR => IcmMsgProcess: IcmRecMsg (rc=-4,nirc=0) failed for partner: NONE(0), wp_no: 0 [icxxextbnd_m 648]

[Thr 1] *** ERROR => CHECK_COM_VERSION: remote: 7000, local: 7001 [icxxext_mt.c 338]

[Thr 1] *** ERROR => IcmMsgProcess: IcmRecMsg (rc=-4,nirc=0) failed for partner: NONE(0), wp_no: 0 [icxxextbnd_m 648]

[Thr 1] *** ERROR => CHECK_COM_VERSION: remote: 7000, local: 7001 [icxxext_mt.c 338]

[Thr 1] *** ERROR => IcmMsgProcess: IcmRecMsg (rc=-4,nirc=0) failed for partner: NONE(0), wp_no: 0 [icxxextbnd_m 648]

[Thr 1] *** ERROR => CHECK_COM_VERSION: remote: 7000, local: 7001 [icxxext_mt.c 338]

Something somewhere seems that the problem is related to version etc.

Has anyone come across this issue before? Please let me know.

Regards,

Santosh

[Former Member]

Hi Santosh

Have you copied the "icmbnd" file exclusively from root users?

I think, you have copied this kernel file with sidadm user.

Please copy this file in exe folder with root user and run root.sh.

Waiting for reply,

Regards

Dbalhara

[markus_doehr2]

> [Thr 13879] IcmNetCheck: network check passed without detecting problems

> [Thr 1] *** ERROR => CHECK_COM_VERSION: remote: 7000, local: 7001 [icxxext_mt.c 338]

Is it possible that not all servers of the system were upgraded at the same time?

Markus

[Former Member]

Hi Markus,

It is just a standalone system and does not have any application servers.

So, the question of being not upgraded at the same time should not arise.

Regards,

Santosh

[vincentlim826]

I think you should firstly check the version of icm related executables in kernel directory.

Regards,

Vincent

[Former Member]

Hi Vincent,

I have checked that already.

currently, when the system is running on kernel 150, if i give the command icman -v, it gives me output as:

scradm> icman -v

Internet Communication Manager Version 7.00, multithreaded, Unicode, 64 BIT

kernel information

-

---

system name =

kernel release = 701

database library =

compiled on = AIX 2 5 00CB5A5B4C00

compile time = Jul 1 2011 23:52:58

update level = 0

patch number = 145

source id = 0.150

When I give the same command after applying the disp+work package 165, the output for icman -v is:

scradm> icman -v

Internet Communication Manager Version 7.01, multithreaded, Unicode, 64 BIT

kernel information

-

---

system name =

kernel release = 701

database library =

compiled on = AIX 2 5 00CB5A5B4C00

compile time = Oct 14 2011 23:41:00

update level = 0

patch number = 161

source id = 0.165

Now there is a SAP note 1605700, which talks about wrong version being getting displayed. Now, I am not sure which kernel is displaying the wrong version!

The note provides the solution as applying kernel number 152, which does not exist on service marketplace and the latest that is available was disp+work package 165, after the kernel number 150.

I just happened to check that a latest disp+work package number 166 has been released by SAP today!

Regards,

Santosh

[Former Member]

Hi Dbalhara,

I tried to do what you suggested when I just now tried to apply the latest disp+work package 166 which has been released just today.

The results are the same. The system does not come up due to the error in ICM version as it says.

Regards,

Santosh

[Former Member]

Hi Santosh

Please share the permission of icmbnd file. It should be -rwsr-x----

Secondly, please run saproot.sh with root user.

If you have the backup of exe folder, please try to start system with older kernel.

Hope you are using cp -R from copying the kernel.

Waiting for reply

Regards

Dbalhara

[Former Member]

Hi,

Permissions if icmbnd file:

scradm> ls -rtl icmbnd*

-rwsr-x--- 1 root sapsys 2078388 Oct 24 00:11 icmbnd

I am able to start the system on the old kernel without any issues.

And ofcourse, I have run saproot.sh with user ID root.

Regards,

Santosh