Deployment fails

[Former Member]

Hello.

Can anybody tell about the problem of deployment locks on WebAS Java?

Seems like some processes can not start because of some deployment objects lock them...

Tried to delete enque locks in MMC. Applications are sterting very very slow, NWA is not availble, in the "enque locks" there are many records ($services.deploy). I delete them, restarted AS but still the same error.

Tried note Note 1718890 - Deployment fails with-Cannot lock at least one of the 1 lock , but nothing changed.

[paul_power]

Hello Vasily,

Can you post the errors from teh latest batch of deployment logs?

This should give further clues as to what is causing the issue.

regards,

Paul

[Former Member]

Deployment logs:

1. UndeployException.ASJ.dpl_dc.006507 [ERROR CODE DPL.DC.3201] An error occurred while undeploying the undeployment item [name: [erkc~exportj2ee], vendor: [com.mt], location: [E05_ERKCv2_D], version: [20121102133117], status: [Aborted], description: [The undeployment item could not be undeployed:
2. com.sap.engine.services.dc.gd.DeliveryException: [ERROR CODE DPL.DC.3299] An error occurred during undeployment of [name: [erkc~exportj2ee], vendor: [com.mt], location: [E05_ERKCv2_D], version: [20121102133117], status: [Admitted], description: [Error:

[ERROR CODE DPL.DS.6193] Error while ; nested exception is:

com.sap.engine.services.deploy.exceptions.ServerDeploymentException: [ERROR CODE DPL.DS.5082] Exception while [registering [removeApp] of [com.mt/erkc~exportj2ee].

Reason: com.sap.engine.services.deploy.server.utils.concurrent.LockSetNotAcquiredException: The thread RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:  {

creator:RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:

}

timed out while trying to get the locks for operation [removeApp : com.mt/erkc~exportj2ee]

Has been waiting for exclusive lock for the node [com.mt/erkc~exportj2ee],

which is held exclusively for [startApp : com.mt/erkc~exportj2ee] by Deploy Parallel Start Thread

id:      127

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      127

task:   

subtask: null

Active operations:

startApp : com.mt/erkc~exportj2ee

}

Active threads:

Thread:Deploy Parallel Start Thread

id:      129

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      129

task:   

subtask: null

Active operations:

startApp : sap.com/caf~km~ear

}

owns the following locks:

sap.com/tc~wd~dispwda - shared

sap.com/tc~wd~api - shared

sap.com/caf~km.proxies04s - shared

library:bi~mmr~mmrlib - shared

sap.com/caf~runtime~ear - shared

library:caf~cmf~dao~rt~lib - shared

service:engine.application.facade - shared

library:bi~mmr~api - shared

library:caf~runtime~base~lib - shared

library:orpersistence_client_lib - shared

library:tc~je~webservices~lib - shared

library:tc~bl~logging~api - shared

library:engine.jee5.facade - shared

sap.com/caf~km.proxies - shared

library:com.sap.base.technology.facade - shared

library:tc~ddic~runtime~facade - shared

library:com.sap.km.trex.client - shared

library:engine.j2ee14.facade - shared

library:tc~cmi - shared

service:tc~wd~webdynpro - shared

service:tc~je~webservices~api - shared

library:tc~bl~exception~lib - shared

library:caf~runtime~vf - shared

sap.com/caf~km~ear - exclusive

library:caf~cmf~api~lib - shared

library:caf~runtime~connectivity - shared

service:engine.service.facade - shared

library:caf~runtime~api~lib - shared

library:com.sap.dictionary.runtime - shared

library:tc~je~usermanagement~api - shared

Thread:Deploy Parallel Start Thread

id:      75

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      75

task:   

subtask: null

Active operations:

startApp : sap.com/ClonedRA_ERKC

}

owns the following locks:

sap.com/ClonedRA_ERKC - exclusive

library:tc~com.sap.conn.jco - shared

sap.com/tc~sapjra~temp - shared

library:tc~com.sap.conn.idoc - shared

service:connector - shared

Thread:Deploy Parallel Start Thread

id:      74

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      74

task:   

subtask: null

Active operations:

startApp : sap.com/tc~esi~uddi~content~mdb~ear

}

owns the following locks:

library:engine.j2ee14.facade - shared

sap.com/tc~uddi - shared

sap.com/tc~esi~uddi~content~mdb~ear - exclusive

library:tc~je~webservices~lib - shared

service:tc~esi~uddi~server~core~service - shared

service:engine.service.facade - shared

library:engine.jee5.facade - shared

library:com.sap.base.technology.facade - shared

service:engine.security.facade - shared

library:tc~esi~uddi~server~api~lib - shared

library:com.sap.sapxmltoolkit.facade - shared

service:engine.application.facade - shared

Thread:Deploy Parallel Start Thread

id:      127

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      127

task:   

subtask: null

Active operations:

startApp : com.mt/erkc~exportj2ee

}

owns the following locks:

com.mt/erkc~exportj2ee - exclusive

library:com.mt~erkc~hibernate_j2ee_lib - shared

Thread:Deploy Parallel Start Thread

id:      78

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      78

task:   

subtask: null

Active operations:

startApp : sap.com/tc~sapjra

}

owns the following locks:

sap.com/tc~sapjra - exclusive

library:tc~com.sap.conn.jco - shared

sap.com/tc~sapjra~temp - shared

library:tc~com.sap.conn.idoc - shared

service:connector - shared

Needed locks:

[com.mt/erkc~exportj2ee]

Waiting threads: RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:  {

creator:RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:

}

Call stacks:

Deploy Parallel Start Thread

id:      127

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      127

task:   

subtask: null

Active operations:

startApp : com.mt/erkc~exportj2ee

}

1. com.sap.engine.services.connector.jca15.EndpointActivationImpl.findAdapter(EndpointActivationImpl.java:83)
2. com.sap.engine.services.connector.jca15.EndpointActivationImpl.activateEndpoint(EndpointActivationImpl.java:59)
3. com.sap.engine.services.ejb3.runtime.impl.Actions_MDBEndpointActivation.perform(Actions_MDBEndpointActivation.java:95)
4. com.sap.engine.services.ejb3.container.CompositeAction.perform(CompositeAction.java:81)
5. com.sap.engine.services.ejb3.container.ApplicationStarter.perform(ApplicationStarter.java:59)
6. com.sap.engine.services.ejb3.container.ContainerInterfaceImpl$Actions.perform(ContainerInterfaceImpl.java:902)
7. com.sap.engine.services.ejb3.container.ContainerInterfaceImpl.prepareStart(ContainerInterfaceImpl.java:435)
8. com.sap.engine.services.deploy.server.utils.container.ContainerWrapper.prepareStart(ContainerWrapper.java:363)
9. com.sap.engine.services.deploy.server.application.StartTransaction.prepareCommon(StartTransaction.java:345)
10. com.sap.engine.services.deploy.server.application.StartTransaction.prepareLocal(StartTransaction.java:305)
11. com.sap.engine.services.deploy.server.application.ApplicationTransaction.makeAllPhasesLocal(ApplicationTransaction.java:479)
12. com.sap.engine.services.deploy.server.application.ParallelAdapter.makeAllPhasesLocal(ParallelAdapter.java:302)
13. com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationLocalAndWait(DeployServiceImpl.java:863)
14. com.sap.engine.services.deploy.server.prl.ParallelApplicationStartTraverser.execute(ParallelApplicationStartTraverser.java:175)
15. com.sap.engine.services.deploy.server.prl.ParallelApplicationThread.run(ParallelApplicationThread.java:64)
16. com.sap.engine.frame.core.thread.Task.run(Task.java:73)
17. com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:177)
18. com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:295)

].], dependingOnThis: [com.mt_erkc~cnsi]]].

at com.sap.engine.services.dc.gd.impl.ApplicationDeployer.performUndeployment(ApplicationDeployer.java:157)

at com.sap.engine.services.dc.gd.impl.InitialGenericDeliveryImpl.undeploy(InitialGenericDeliveryImpl.java:106)

at com.sap.engine.services.dc.cm.undeploy.impl.OnlineUndeployPhaseProcessor.doUndeploy(OnlineUndeployPhaseProcessor.java:63)

at com.sap.engine.services.dc.cm.undeploy.impl.OnlineUndeployPhaseProcessor.performUndeploy(OnlineUndeployPhaseProcessor.java:48)

at com.sap.engine.services.dc.cm.undeploy.impl.AbstractUndeployPhaseProcessor.undeploy(AbstractUndeployPhaseProcessor.java:46)

at com.sap.engine.services.dc.cm.undeploy.impl.AbstractUndeploymentProcessor.doUndeploy(AbstractUndeploymentProcessor.java:105)

at com.sap.engine.services.dc.cm.undeploy.impl.UndeployDepUndeploymentProcessor.performUndeploy(UndeployDepUndeploymentProcessor.java:76)

at com.sap.engine.services.dc.cm.undeploy.impl.AbstractUndeploymentProcessor.performUndplPhaseUndeploy(AbstractUndeploymentProcessor.java:155)

at com.sap.engine.services.dc.cm.undeploy.impl.AbstractUndeploymentProcessor.process(AbstractUndeploymentProcessor.java:58)

at com.sap.engine.services.dc.cm.undeploy.impl.UndeployerImpl.undeployInternal(UndeployerImpl.java:217)

at com.sap.engine.services.dc.cm.undeploy.impl.UndeployerImpl.undeploy(UndeployerImpl.java:117)

at com.sap.engine.services.dc.cm.undeploy.impl.UndeployerImplp4_Skel.dispatch(UndeployerImplp4_Skel.java:158)

at com.sap.engine.services.rmi_p4.DispatchImpl._runInternal(DispatchImpl.java:368)

at com.sap.engine.services.rmi_p4.server.ServerDispatchImpl.run(ServerDispatchImpl.java:69)

at com.sap.engine.services.rmi_p4.P4Message.process(P4Message.java:67)

at com.sap.engine.services.rmi_p4.P4Message.execute(P4Message.java:41)

at com.sap.engine.services.cross.fca.FCAConnectorImpl.executeRequest(FCAConnectorImpl.java:977)

at com.sap.engine.services.rmi_p4.P4Message.process(P4Message.java:57)

at com.sap.engine.services.cross.fca.MessageReader.run(MessageReader.java:55)

at com.sap.engine.core.thread.execution.Executable.run(Executable.java:122)

at com.sap.engine.core.thread.execution.Executable.run(Executable.java:101)

at com.sap.engine.core.thread.execution.CentralExecutor$SingleThread.run(CentralExecutor.java:327)

Caused by: com.sap.engine.services.deploy.server.utils.DSRemoteException: [ERROR CODE DPL.DS.6193] Error while ; nested exception is:

com.sap.engine.services.deploy.exceptions.ServerDeploymentException: [ERROR CODE DPL.DS.5082] Exception while [registering [removeApp] of [com.mt/erkc~exportj2ee].

Reason: com.sap.engine.services.deploy.server.utils.concurrent.LockSetNotAcquiredException: The thread RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:  {

creator:RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:

}

timed out while trying to get the locks for operation [removeApp : com.mt/erkc~exportj2ee]

Has been waiting for exclusive lock for the node [com.mt/erkc~exportj2ee],

which is held exclusively for [startApp : com.mt/erkc~exportj2ee] by Deploy Parallel Start Thread

id:      127

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      127

task:   

subtask: null

Active operations:

startApp : com.mt/erkc~exportj2ee

}

Active threads:

Thread:Deploy Parallel Start Thread

id:      129

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      129

task:   

subtask: null

Active operations:

startApp : sap.com/caf~km~ear

}

owns the following locks:

sap.com/tc~wd~dispwda - shared

sap.com/tc~wd~api - shared

sap.com/caf~km.proxies04s - shared

library:bi~mmr~mmrlib - shared

sap.com/caf~runtime~ear - shared

library:caf~cmf~dao~rt~lib - shared

service:engine.application.facade - shared

library:bi~mmr~api - shared

library:caf~runtime~base~lib - shared

library:orpersistence_client_lib - shared

library:tc~je~webservices~lib - shared

library:tc~bl~logging~api - shared

library:engine.jee5.facade - shared

sap.com/caf~km.proxies - shared

library:com.sap.base.technology.facade - shared

library:tc~ddic~runtime~facade - shared

library:com.sap.km.trex.client - shared

library:engine.j2ee14.facade - shared

library:tc~cmi - shared

service:tc~wd~webdynpro - shared

service:tc~je~webservices~api - shared

library:tc~bl~exception~lib - shared

library:caf~runtime~vf - shared

sap.com/caf~km~ear - exclusive

library:caf~cmf~api~lib - shared

library:caf~runtime~connectivity - shared

service:engine.service.facade - shared

library:caf~runtime~api~lib - shared

library:com.sap.dictionary.runtime - shared

library:tc~je~usermanagement~api - shared

Thread:Deploy Parallel Start Thread

id:      75

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      75

task:   

subtask: null

Active operations:

startApp : sap.com/ClonedRA_ERKC

}

owns the following locks:

sap.com/ClonedRA_ERKC - exclusive

library:tc~com.sap.conn.jco - shared

sap.com/tc~sapjra~temp - shared

library:tc~com.sap.conn.idoc - shared

service:connector - shared

Thread:Deploy Parallel Start Thread

id:      74

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      74

task:   

subtask: null

Active operations:

startApp : sap.com/tc~esi~uddi~content~mdb~ear

}

owns the following locks:

library:engine.j2ee14.facade - shared

sap.com/tc~uddi - shared

sap.com/tc~esi~uddi~content~mdb~ear - exclusive

library:tc~je~webservices~lib - shared

service:tc~esi~uddi~server~core~service - shared

service:engine.service.facade - shared

library:engine.jee5.facade - shared

library:com.sap.base.technology.facade - shared

service:engine.security.facade - shared

library:tc~esi~uddi~server~api~lib - shared

library:com.sap.sapxmltoolkit.facade - shared

service:engine.application.facade - shared

Thread:Deploy Parallel Start Thread

id:      127

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      127

task:   

subtask: null

Active operations:

startApp : com.mt/erkc~exportj2ee

}

owns the following locks:

com.mt/erkc~exportj2ee - exclusive

library:com.mt~erkc~hibernate_j2ee_lib - shared

Thread:Deploy Parallel Start Thread

id:      78

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      78

task:   

subtask: null

Active operations:

startApp : sap.com/tc~sapjra

}

owns the following locks:

sap.com/tc~sapjra - exclusive

library:tc~com.sap.conn.jco - shared

sap.com/tc~sapjra~temp - shared

library:tc~com.sap.conn.idoc - shared

service:connector - shared

Needed locks:

[com.mt/erkc~exportj2ee]

Waiting threads: RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:  {

creator:RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:

}

Call stacks:

Deploy Parallel Start Thread

id:      127

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      127

task:   

subtask: null

Active operations:

startApp : com.mt/erkc~exportj2ee

}

1. com.sap.engine.services.connector.jca15.EndpointActivationImpl.findAdapter(EndpointActivationImpl.java:83)
2. com.sap.engine.services.connector.jca15.EndpointActivationImpl.activateEndpoint(EndpointActivationImpl.java:59)
3. com.sap.engine.services.ejb3.runtime.impl.Actions_MDBEndpointActivation.perform(Actions_MDBEndpointActivation.java:95)
4. com.sap.engine.services.ejb3.container.CompositeAction.perform(CompositeAction.java:81)
5. com.sap.engine.services.ejb3.container.ApplicationStarter.perform(ApplicationStarter.java:59)
6. com.sap.engine.services.ejb3.container.ContainerInterfaceImpl$Actions.perform(ContainerInterfaceImpl.java:902)
7. com.sap.engine.services.ejb3.container.ContainerInterfaceImpl.prepareStart(ContainerInterfaceImpl.java:435)
8. com.sap.engine.services.deploy.server.utils.container.ContainerWrapper.prepareStart(ContainerWrapper.java:363)
9. com.sap.engine.services.deploy.server.application.StartTransaction.prepareCommon(StartTransaction.java:345)
10. com.sap.engine.services.deploy.server.application.StartTransaction.prepareLocal(StartTransaction.java:305)
11. com.sap.engine.services.deploy.server.application.ApplicationTransaction.makeAllPhasesLocal(ApplicationTransaction.java:479)
12. com.sap.engine.services.deploy.server.application.ParallelAdapter.makeAllPhasesLocal(ParallelAdapter.java:302)
13. com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationLocalAndWait(DeployServiceImpl.java:863)
14. com.sap.engine.services.deploy.server.prl.ParallelApplicationStartTraverser.execute(ParallelApplicationStartTraverser.java:175)
15. com.sap.engine.services.deploy.server.prl.ParallelApplicationThread.run(ParallelApplicationThread.java:64)
16. com.sap.engine.frame.core.thread.Task.run(Task.java:73)
17. com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:177)
18. com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:295)

].

at com.sap.engine.services.deploy.server.DeployServiceImpl.catchDeploymentExceptionWithDSRem(DeployServiceImpl.java:2289)

at com.sap.engine.services.deploy.server.DeployServiceImpl.remove(DeployServiceImpl.java:462)

at com.sap.engine.services.deploy.server.DeployServiceImpl.remove(DeployServiceImpl.java:2020)

at com.sap.engine.services.dc.gd.impl.ApplicationDeployer.performUndeployment(ApplicationDeployer.java:138)

... 21 more

Caused by: com.sap.engine.services.deploy.exceptions.ServerDeploymentException: [ERROR CODE DPL.DS.5082] Exception while [registering [removeApp] of [com.mt/erkc~exportj2ee].

Reason: com.sap.engine.services.deploy.server.utils.concurrent.LockSetNotAcquiredException: The thread RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:  {

creator:RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:

}

timed out while trying to get the locks for operation [removeApp : com.mt/erkc~exportj2ee]

Has been waiting for exclusive lock for the node [com.mt/erkc~exportj2ee],

which is held exclusively for [startApp : com.mt/erkc~exportj2ee] by Deploy Parallel Start Thread

id:      127

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      127

task:   

subtask: null

Active operations:

startApp : com.mt/erkc~exportj2ee

}

Active threads:

Thread:Deploy Parallel Start Thread

id:      129

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      129

task:   

subtask: null

Active operations:

startApp : sap.com/caf~km~ear

}

owns the following locks:

sap.com/tc~wd~dispwda - shared

sap.com/tc~wd~api - shared

sap.com/caf~km.proxies04s - shared

library:bi~mmr~mmrlib - shared

sap.com/caf~runtime~ear - shared

library:caf~cmf~dao~rt~lib - shared

service:engine.application.facade - shared

library:bi~mmr~api - shared

library:caf~runtime~base~lib - shared

library:orpersistence_client_lib - shared

library:tc~je~webservices~lib - shared

library:tc~bl~logging~api - shared

library:engine.jee5.facade - shared

sap.com/caf~km.proxies - shared

library:com.sap.base.technology.facade - shared

library:tc~ddic~runtime~facade - shared

library:com.sap.km.trex.client - shared

library:engine.j2ee14.facade - shared

library:tc~cmi - shared

service:tc~wd~webdynpro - shared

service:tc~je~webservices~api - shared

library:tc~bl~exception~lib - shared

library:caf~runtime~vf - shared

sap.com/caf~km~ear - exclusive

library:caf~cmf~api~lib - shared

library:caf~runtime~connectivity - shared

service:engine.service.facade - shared

library:caf~runtime~api~lib - shared

library:com.sap.dictionary.runtime - shared

library:tc~je~usermanagement~api - shared

Thread:Deploy Parallel Start Thread

id:      75

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      75

task:   

subtask: null

Active operations:

startApp : sap.com/ClonedRA_ERKC

}

owns the following locks:

sap.com/ClonedRA_ERKC - exclusive

library:tc~com.sap.conn.jco - shared

sap.com/tc~sapjra~temp - shared

library:tc~com.sap.conn.idoc - shared

service:connector - shared

Thread:Deploy Parallel Start Thread

id:      74

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      74

task:   

subtask: null

Active operations:

startApp : sap.com/tc~esi~uddi~content~mdb~ear

}

owns the following locks:

library:engine.j2ee14.facade - shared

sap.com/tc~uddi - shared

sap.com/tc~esi~uddi~content~mdb~ear - exclusive

library:tc~je~webservices~lib - shared

service:tc~esi~uddi~server~core~service - shared

service:engine.service.facade - shared

library:engine.jee5.facade - shared

library:com.sap.base.technology.facade - shared

service:engine.security.facade - shared

library:tc~esi~uddi~server~api~lib - shared

library:com.sap.sapxmltoolkit.facade - shared

service:engine.application.facade - shared

Thread:Deploy Parallel Start Thread

id:      127

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      127

task:   

subtask: null

Active operations:

startApp : com.mt/erkc~exportj2ee

}

owns the following locks:

com.mt/erkc~exportj2ee - exclusive

library:com.mt~erkc~hibernate_j2ee_lib - shared

Thread:Deploy Parallel Start Thread

id:      78

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      78

task:   

subtask: null

Active operations:

startApp : sap.com/tc~sapjra

}

owns the following locks:

sap.com/tc~sapjra - exclusive

library:tc~com.sap.conn.jco - shared

sap.com/tc~sapjra~temp - shared

library:tc~com.sap.conn.idoc - shared

service:connector - shared

Needed locks:

[com.mt/erkc~exportj2ee]

Waiting threads: RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:  {

creator:RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:

}

Call stacks:

Deploy Parallel Start Thread

id:      127

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      127

task:   

subtask: null

Active operations:

startApp : com.mt/erkc~exportj2ee

}

1. com.sap.engine.services.connector.jca15.EndpointActivationImpl.findAdapter(EndpointActivationImpl.java:83)
2. com.sap.engine.services.connector.jca15.EndpointActivationImpl.activateEndpoint(EndpointActivationImpl.java:59)
3. com.sap.engine.services.ejb3.runtime.impl.Actions_MDBEndpointActivation.perform(Actions_MDBEndpointActivation.java:95)
4. com.sap.engine.services.ejb3.container.CompositeAction.perform(CompositeAction.java:81)
5. com.sap.engine.services.ejb3.container.ApplicationStarter.perform(ApplicationStarter.java:59)
6. com.sap.engine.services.ejb3.container.ContainerInterfaceImpl$Actions.perform(ContainerInterfaceImpl.java:902)
7. com.sap.engine.services.ejb3.container.ContainerInterfaceImpl.prepareStart(ContainerInterfaceImpl.java:435)
8. com.sap.engine.services.deploy.server.utils.container.ContainerWrapper.prepareStart(ContainerWrapper.java:363)
9. com.sap.engine.services.deploy.server.application.StartTransaction.prepareCommon(StartTransaction.java:345)
10. com.sap.engine.services.deploy.server.application.StartTransaction.prepareLocal(StartTransaction.java:305)
11. com.sap.engine.services.deploy.server.application.ApplicationTransaction.makeAllPhasesLocal(ApplicationTransaction.java:479)
12. com.sap.engine.services.deploy.server.application.ParallelAdapter.makeAllPhasesLocal(ParallelAdapter.java:302)
13. com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationLocalAndWait(DeployServiceImpl.java:863)
14. com.sap.engine.services.deploy.server.prl.ParallelApplicationStartTraverser.execute(ParallelApplicationStartTraverser.java:175)
15. com.sap.engine.services.deploy.server.prl.ParallelApplicationThread.run(ParallelApplicationThread.java:64)
16. com.sap.engine.frame.core.thread.Task.run(Task.java:73)
17. com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:177)
18. com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:295)

].

at com.sap.engine.services.deploy.server.TransactionManager.lock(TransactionManager.java:113)

at com.sap.engine.services.deploy.server.TransactionManager.registerTransaction(TransactionManager.java:73)

at com.sap.engine.services.deploy.server.DeployServiceImpl.makeGlobalTransaction(DeployServiceImpl.java:1484)

at com.sap.engine.services.deploy.server.DeployServiceImpl.remove(DeployServiceImpl.java:459)

... 23 more

Caused by: com.sap.engine.services.deploy.server.utils.concurrent.LockSetNotAcquiredException: The thread RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:  {

creator:RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:

}

timed out while trying to get the locks for operation [removeApp : com.mt/erkc~exportj2ee]

Has been waiting for exclusive lock for the node [com.mt/erkc~exportj2ee],

which is held exclusively for [startApp : com.mt/erkc~exportj2ee] by Deploy Parallel Start Thread

id:      127

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      127

task:   

subtask: null

Active operations:

startApp : com.mt/erkc~exportj2ee

}

Active threads:

Thread:Deploy Parallel Start Thread

id:      129

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      129

task:   

subtask: null

Active operations:

startApp : sap.com/caf~km~ear

}

owns the following locks:

sap.com/tc~wd~dispwda - shared

sap.com/tc~wd~api - shared

sap.com/caf~km.proxies04s - shared

library:bi~mmr~mmrlib - shared

sap.com/caf~runtime~ear - shared

library:caf~cmf~dao~rt~lib - shared

service:engine.application.facade - shared

library:bi~mmr~api - shared

library:caf~runtime~base~lib - shared

library:orpersistence_client_lib - shared

library:tc~je~webservices~lib - shared

library:tc~bl~logging~api - shared

library:engine.jee5.facade - shared

sap.com/caf~km.proxies - shared

library:com.sap.base.technology.facade - shared

library:tc~ddic~runtime~facade - shared

library:com.sap.km.trex.client - shared

library:engine.j2ee14.facade - shared

library:tc~cmi - shared

service:tc~wd~webdynpro - shared

service:tc~je~webservices~api - shared

library:tc~bl~exception~lib - shared

library:caf~runtime~vf - shared

sap.com/caf~km~ear - exclusive

  library:caf~cmf~api~lib - shared

library:caf~runtime~connectivity - shared

service:engine.service.facade - shared

library:caf~runtime~api~lib - shared

library:com.sap.dictionary.runtime - shared

library:tc~je~usermanagement~api - shared

Thread:Deploy Parallel Start Thread

id:      75

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      75

task:   

subtask: null

Active operations:

startApp : sap.com/ClonedRA_ERKC

}

owns the following locks:

sap.com/ClonedRA_ERKC - exclusive

library:tc~com.sap.conn.jco - shared

sap.com/tc~sapjra~temp - shared

library:tc~com.sap.conn.idoc - shared

service:connector - shared

Thread:Deploy Parallel Start Thread

id:      74

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      74

task:   

subtask: null

Active operations:

startApp : sap.com/tc~esi~uddi~content~mdb~ear

}

owns the following locks:

library:engine.j2ee14.facade - shared

sap.com/tc~uddi - shared

sap.com/tc~esi~uddi~content~mdb~ear - exclusive

library:tc~je~webservices~lib - shared

service:tc~esi~uddi~server~core~service - shared

service:engine.service.facade - shared

library:engine.jee5.facade - shared

library:com.sap.base.technology.facade - shared

service:engine.security.facade - shared

library:tc~esi~uddi~server~api~lib - shared

library:com.sap.sapxmltoolkit.facade - shared

service:engine.application.facade - shared

Thread:Deploy Parallel Start Thread

id:      127

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      127

task:   

subtask: null

Active operations:

startApp : com.mt/erkc~exportj2ee

}

owns the following locks:

com.mt/erkc~exportj2ee - exclusive

library:com.mt~erkc~hibernate_j2ee_lib - shared

Thread:Deploy Parallel Start Thread

id:      78

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      78

task:   

subtask: null

Active operations:

startApp : sap.com/tc~sapjra

}

owns the following locks:

sap.com/tc~sapjra - exclusive

library:tc~com.sap.conn.jco - shared

sap.com/tc~sapjra~temp - shared

library:tc~com.sap.conn.idoc - shared

service:connector - shared

Needed locks:

[com.mt/erkc~exportj2ee]

Waiting threads: RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:  {

creator:RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:

}

Call stacks:

Deploy Parallel Start Thread

id:      127

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      127

task:   

subtask: null

Active operations:

startApp : com.mt/erkc~exportj2ee

}

1. com.sap.engine.services.connector.jca15.EndpointActivationImpl.findAdapter(EndpointActivationImpl.java:83)
2. com.sap.engine.services.connector.jca15.EndpointActivationImpl.activateEndpoint(EndpointActivationImpl.java:59)
3. com.sap.engine.services.ejb3.runtime.impl.Actions_MDBEndpointActivation.perform(Actions_MDBEndpointActivation.java:95)
4. com.sap.engine.services.ejb3.container.CompositeAction.perform(CompositeAction.java:81)
5. com.sap.engine.services.ejb3.container.ApplicationStarter.perform(ApplicationStarter.java:59)
6. com.sap.engine.services.ejb3.container.ContainerInterfaceImpl$Actions.perform(ContainerInterfaceImpl.java:902)
7. com.sap.engine.services.ejb3.container.ContainerInterfaceImpl.prepareStart(ContainerInterfaceImpl.java:435)
8. com.sap.engine.services.deploy.server.utils.container.ContainerWrapper.prepareStart(ContainerWrapper.java:363)
9. com.sap.engine.services.deploy.server.application.StartTransaction.prepareCommon(StartTransaction.java:345)
10. com.sap.engine.services.deploy.server.application.StartTransaction.prepareLocal(StartTransaction.java:305)
11. com.sap.engine.services.deploy.server.application.ApplicationTransaction.makeAllPhasesLocal(ApplicationTransaction.java:479)
12. com.sap.engine.services.deploy.server.application.ParallelAdapter.makeAllPhasesLocal(ParallelAdapter.java:302)
13. com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationLocalAndWait(DeployServiceImpl.java:863)
14. com.sap.engine.services.deploy.server.prl.ParallelApplicationStartTraverser.execute(ParallelApplicationStartTraverser.java:175)
15. com.sap.engine.services.deploy.server.prl.ParallelApplicationThread.run(ParallelApplicationThread.java:64)
16. com.sap.engine.frame.core.thread.Task.run(Task.java:73)
17. com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:177)
18. com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:295)

at com.sap.engine.services.deploy.server.utils.concurrent.impl.LockManagerImpl.lock(LockManagerImpl.java:133)

at com.sap.engine.services.deploy.server.utils.concurrent.impl.LockManagerImpl.lockDependants(LockManagerImpl.java:281)

at com.sap.engine.services.deploy.server.application.RemoveTransaction.lock(RemoveTransaction.java:87)

at com.sap.engine.services.deploy.server.TransactionManager.lock(TransactionManager.java:111)

... 26 more

], dependingOnThis: [com.mt_erkc~cnsi]]]; nested exception is:

com.sap.engine.services.dc.gd.DeliveryException: [ERROR CODE DPL.DC.3299] An error occurred during undeployment of [name: [erkc~exportj2ee], vendor: [com.mt], location: [E05_ERKCv2_D], version: [20121102133117], status: [Admitted], description: [Error:

[ERROR CODE DPL.DS.6193] Error while ; nested exception is:

com.sap.engine.services.deploy.exceptions.ServerDeploymentException: [ERROR CODE DPL.DS.5082] Exception while [registering [removeApp] of [com.mt/erkc~exportj2ee].

Reason: com.sap.engine.services.deploy.server.utils.concurrent.LockSetNotAcquiredException: The thread RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:  {

creator:RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:

}

timed out while trying to get the locks for operation [removeApp : com.mt/erkc~exportj2ee]

Has been waiting for exclusive lock for the node [com.mt/erkc~exportj2ee],

which is held exclusively for [startApp : com.mt/erkc~exportj2ee] by Deploy Parallel Start Thread

id:      127

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      127

task:   

subtask: null

Active operations:

startApp : com.mt/erkc~exportj2ee

}

Active threads:

Thread:Deploy Parallel Start Thread

id:      129

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      129

task:   

subtask: null

Active operations:

startApp : sap.com/caf~km~ear

}

owns the following locks:

sap.com/tc~wd~dispwda - shared

sap.com/tc~wd~api - shared

sap.com/caf~km.proxies04s - shared

library:bi~mmr~mmrlib - shared

sap.com/caf~runtime~ear - shared

library:caf~cmf~dao~rt~lib - shared

service:engine.application.facade - shared

library:bi~mmr~api - shared

library:caf~runtime~base~lib - shared

library:orpersistence_client_lib - shared

library:tc~je~webservices~lib - shared

library:tc~bl~logging~api - shared

library:engine.jee5.facade - shared

sap.com/caf~km.proxies - shared

library:com.sap.base.technology.facade - shared

library:tc~ddic~runtime~facade - shared

library:com.sap.km.trex.client - shared

library:engine.j2ee14.facade - shared

library:tc~cmi - shared

service:tc~wd~webdynpro - shared

service:tc~je~webservices~api - shared

library:tc~bl~exception~lib - shared

library:caf~runtime~vf - shared

sap.com/caf~km~ear - exclusive

library:caf~cmf~api~lib - shared

library:caf~runtime~connectivity - shared

service:engine.service.facade - shared

library:caf~runtime~api~lib - shared

library:com.sap.dictionary.runtime - shared

library:tc~je~usermanagement~api - shared

Thread:Deploy Parallel Start Thread

id:      75

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      75

task:   

subtask: null

Active operations:

startApp : sap.com/ClonedRA_ERKC

}

owns the following locks:

sap.com/ClonedRA_ERKC - exclusive

library:tc~com.sap.conn.jco - shared

sap.com/tc~sapjra~temp - shared

library:tc~com.sap.conn.idoc - shared

service:connector - shared

Thread:Deploy Parallel Start Thread

id:      74

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      74

task:   

subtask: null

Active operations:

startApp : sap.com/tc~esi~uddi~content~mdb~ear

}

owns the following locks:

library:engine.j2ee14.facade - shared

sap.com/tc~uddi - shared

sap.com/tc~esi~uddi~content~mdb~ear - exclusive

library:tc~je~webservices~lib - shared

service:tc~esi~uddi~server~core~service - shared

service:engine.service.facade - shared

library:engine.jee5.facade - shared

library:com.sap.base.technology.facade - shared

service:engine.security.facade - shared

library:tc~esi~uddi~server~api~lib - shared

library:com.sap.sapxmltoolkit.facade - shared

service:engine.application.facade - shared

Thread:Deploy Parallel Start Thread

id:      127

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      127

task:   

subtask: null

Active operations:

startApp : com.mt/erkc~exportj2ee

}

owns the following locks:

com.mt/erkc~exportj2ee - exclusive

library:com.mt~erkc~hibernate_j2ee_lib - shared

Thread:Deploy Parallel Start Thread

id:      78

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      78

task:   

subtask: null

Active operations:

startApp : sap.com/tc~sapjra

}

owns the following locks:

sap.com/tc~sapjra - exclusive

library:tc~com.sap.conn.jco - shared

sap.com/tc~sapjra~temp - shared

library:tc~com.sap.conn.idoc - shared

service:connector - shared

Needed locks:

[com.mt/erkc~exportj2ee]

Waiting threads: RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:  {

creator:RMI/IIOP Worker [0]

id:      79

task:    [Deploy Controller] - performing [undeploy] operation of component [com.mt/erkc~exportj2ee]

subtask:

}

Call stacks:

Deploy Parallel Start Thread

id:      127

task:   

subtask: null {

creator:Deploy Parallel Start Thread

id:      127

task:   

subtask: null

Active operations:

startApp : com.mt/erkc~exportj2ee

}

1. com.sap.engine.services.connector.jca15.EndpointActivationImpl.findAdapter(EndpointActivationImpl.java:83)
2. com.sap.engine.services.connector.jca15.EndpointActivationImpl.activateEndpoint(EndpointActivationImpl.java:59)
3. com.sap.engine.services.ejb3.runtime.impl.Actions_MDBEndpointActivation.perform(Actions_MDBEndpointActivation.java:95)
4. com.sap.engine.services.ejb3.container.CompositeAction.perform(CompositeAction.java:81)
5. com.sap.engine.services.ejb3.container.ApplicationStarter.perform(ApplicationStarter.java:59)
6. com.sap.engine.services.ejb3.container.ContainerInterfaceImpl$Actions.perform(ContainerInterfaceImpl.java:902)
7. com.sap.engine.services.ejb3.container.ContainerInterfaceImpl.prepareStart(ContainerInterfaceImpl.java:435)
8. com.sap.engine.services.deploy.server.utils.container.ContainerWrapper.prepareStart(ContainerWrapper.java:363)
9. com.sap.engine.services.deploy.server.application.StartTransaction.prepareCommon(StartTransaction.java:345)
10. com.sap.engine.services.deploy.server.application.StartTransaction.prepareLocal(StartTransaction.java:305)
11. com.sap.engine.services.deploy.server.application.ApplicationTransaction.makeAllPhasesLocal(ApplicationTransaction.java:479)
12. com.sap.engine.services.deploy.server.application.ParallelAdapter.makeAllPhasesLocal(ParallelAdapter.java:302)
13. com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationLocalAndWait(DeployServiceImpl.java:863)
14. com.sap.engine.services.deploy.server.prl.ParallelApplicationStartTraverser.execute(ParallelApplicationStartTraverser.java:175)
15. com.sap.engine.services.deploy.server.prl.ParallelApplicationThread.run(ParallelApplicationThread.java:64)
16. com.sap.engine.frame.core.thread.Task.run(Task.java:73)
17. com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:177)
18. com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:295)

].], dependingOnThis: [com.mt_erkc~cnsi]]].  [ERROR: 07.11.2012 15:16:26 /userOut/daView_category (eclipse.UserOutLocation) [Thread[Worker-13,5,main]] ]

[Former Member]

Hi,

Have a look on below note. it may help you.

Note 1524628 - Deadlock in Deploy Service

Thanks,

Venkat

[Former Member]

Thank you, we have only one server node and SERVERCORE 7.11 with last patch (10.8).

But perhaps it may help?

How can i extend the set of enqueue locks for the transaction?