SMD Agent stabilization issue

[Former Member]

We are noticing the SMD agents are showing offline in the Agent admin page.

We have changed the dispatcher scalability based on the below wiki. We still have the issue.

Diagnostics Agent Troubleshooting - SAP Solution Manager Setup - SCN Wiki

Checked through the logs & found issues with the server application thread.

Please find the error log & screen shots.

----------------------------------------------------------

{0}#1#java.lang.RuntimeException: ExtendedPooledExecutor is blocked : maximum pool size : 30, current pool size :61

{0}#1#java.lang.RuntimeException: ExtendedPooledExecutor is blocked : maximum pool size : 30, current pool size :61

0#1e6c3164288e11e4993800001f3c9d02#SAPEngine_Application_Thread[impl:3]_210##0#0#Error##Plain###java.lang.RuntimeException: ExtendedPooledExecutor is blocked : maximum pool size : 30, current pool size :61#

#1.#E6B57E4AD726010A000498C3006700C400050112D77218CC#1408555319171#com.sap.engine.core.thread.impl3.SingleThread##com.sap.engine.core.thread.impl3.SingleThread.SingleThread.execute().RuntimeException#J2EE_GUEST#0##1E6C3164288E11E4993800001F3C9D02#1e6c3164288e11e4993800001f3c9d02-0#1e6c3164288e11e4993800001f3c9d02#SAPEngine_Application_Thread[impl:3]_210##0#0#Error##Plain###java.lang.RuntimeException: ExtendedPooledExecutor is blocked : maximum pool size : 30, current pool size :61

Kindly Advice.

[divyanshu_srivastava3]

Hi Magesh,

In case of max number of thread are reached connections cannot be created, be it dispatcher node or any other, in general. If they are appearing offline then there can me many reasons. If threads are full for dispatcher, it that case new agent will not be able to connect and dispatcher would hang, preventing other thing to work. If heap if full, you will get OOM logs and dumps.

1st check if maintenance mode is off or not.

If on, then disable it.

2nd. connection for managed system to you solman.

Is that working ? check using ping and telnet for port.

3rd. Check default trace for dispatcher node and std_dispatcher..

See what errors are you getting. Is it because of full GC runs or some other issue.

4th. Take thread dumps of dispatcher node.

And share it.

Regards,

Divyanshu

[Former Member]

Maintenance mode is not returned on.

Connectivity between agent & solman is working fine.

We noticed that the issue gets fixed after restarting the java stack in the past. But after a week or so the agents start showing offline in the admin page.

Do not find anything specific on the default trace.

[divyanshu_srivastava3]

Hi Magesh,

Share the thread dump of dispatcher node.

Regards

Divyanshu