Skip to content

Releasing VM failed: maximum number of simultaneous operations (should retry?) #9

@aledsage

Description

@aledsage

When terminating a Brooklyn app that had a VM in vcloud director, it hit the error shown below.

The VM was left running.

A second attempt from Brooklyn to delete the app did not get rid of the VM.

2015-05-08 16:05:02,236 ERROR b.l.jclouds.JcloudsLocation [brooklyn-execmanager-oQ4pWW7O-7259]: Problem releasing machine SshMachineLocation[Acme:129.185.160.13/129.185.160.13:19013@NCqWtuVM] in JcloudsPortforwardingSubnetLocation[Acme:cct-eme
a01-adm@cct-emea01/vcloud-director:https://emea01.acme.com/api/vdc/e931a09d-131f-4aaa-a667-efbe02eba428:https://emea01.acme.com/api@ZjblvbdE], instance id urn:vcloud:vm:487a692b-a24b-4523-81ce-e4d459ea7716; discarding instance and continuing...
org.jclouds.vcloud.director.v1_5.VCloudDirectorException: Operation Limits Exceeded (400) Error: The maximum number of simultaneous operations for user "cct-emea01-adm" on organization "cct-emea01" has been reached.
        at org.jclouds.vcloud.director.v1_5.handlers.VCloudDirectorErrorHandler.handleError(VCloudDirectorErrorHandler.java:58) ~[vcloud-director-1.9.0-rc3.jar:1.9.0-rc3]
        at org.jclouds.http.handlers.DelegatingErrorHandler.handleError(DelegatingErrorHandler.java:65) ~[jclouds-core-1.9.0.jar:1.9.0]
        at org.jclouds.http.internal.BaseHttpCommandExecutorService.shouldContinue(BaseHttpCommandExecutorService.java:132) ~[jclouds-core-1.9.0.jar:1.9.0]
        at org.jclouds.http.internal.BaseHttpCommandExecutorService.invoke(BaseHttpCommandExecutorService.java:101) ~[jclouds-core-1.9.0.jar:1.9.0]
        at org.jclouds.rest.internal.InvokeHttpMethod.invoke(InvokeHttpMethod.java:90) ~[jclouds-core-1.9.0.jar:1.9.0]
        at org.jclouds.rest.internal.InvokeHttpMethod.apply(InvokeHttpMethod.java:73) ~[jclouds-core-1.9.0.jar:1.9.0]
        at org.jclouds.rest.internal.InvokeHttpMethod.apply(InvokeHttpMethod.java:44) ~[jclouds-core-1.9.0.jar:1.9.0]
        at org.jclouds.reflect.FunctionalReflection$FunctionalInvocationHandler.handleInvocation(FunctionalReflection.java:117) ~[jclouds-core-1.9.0.jar:1.9.0]
        at com.google.common.reflect.AbstractInvocationHandler.invoke(AbstractInvocationHandler.java:87) ~[guava-17.0.jar:na]
        at com.sun.proxy.$Proxy154.undeploy(Unknown Source) ~[na:na]
        at org.jclouds.vcloud.director.v1_5.compute.strategy.VCloudDirectorComputeServiceAdapter.destroyNode(VCloudDirectorComputeServiceAdapter.java:407) ~[vcloud-director-1.9.0-rc3.jar:1.9.0-rc3]
        at org.jclouds.compute.strategy.impl.AdaptingComputeServiceStrategies.destroyNode(AdaptingComputeServiceStrategies.java:181) ~[jclouds-compute-1.9.0.jar:1.9.0]
        at org.jclouds.compute.internal.BaseComputeService$2.apply(BaseComputeService.java:291) ~[jclouds-compute-1.9.0.jar:1.9.0]
        at org.jclouds.compute.internal.BaseComputeService$2.apply(BaseComputeService.java:288) ~[jclouds-compute-1.9.0.jar:1.9.0]
        at org.jclouds.util.Predicates2$RetryablePredicate.apply(Predicates2.java:117) ~[jclouds-core-1.9.0.jar:1.9.0]
        at org.jclouds.compute.internal.BaseComputeService.doDestroyNode(BaseComputeService.java:302) ~[jclouds-compute-1.9.0.jar:1.9.0]
        at org.jclouds.compute.internal.BaseComputeService.destroyNode(BaseComputeService.java:243) ~[jclouds-compute-1.9.0.jar:1.9.0]
        at brooklyn.location.jclouds.JcloudsLocation.releaseNode(JcloudsLocation.java:1814) [brooklyn-locations-jclouds-0.7.0-20150507.1059.jar:0.7.0-20150507.1059]
        at brooklyn.location.jclouds.JcloudsLocation.release(JcloudsLocation.java:1776) [brooklyn-locations-jclouds-0.7.0-20150507.1059.jar:0.7.0-20150507.1059]
        at brooklyn.location.jclouds.JcloudsLocation.release(JcloudsLocation.java:180) [brooklyn-locations-jclouds-0.7.0-20150507.1059.jar:0.7.0-20150507.1059]
        at brooklyn.entity.software.MachineLifecycleEffectorTasks.stopAnyProvisionedMachines(MachineLifecycleEffectorTasks.java:751) [brooklyn-software-base-0.7.0-20150507.1059.jar:0.7.0-20150507.1059]
        at brooklyn.entity.software.MachineLifecycleEffectorTasks$15.call(MachineLifecycleEffectorTasks.java:585) [brooklyn-software-base-0.7.0-20150507.1059.jar:0.7.0-20150507.1059]
        at brooklyn.entity.software.MachineLifecycleEffectorTasks$15.call(MachineLifecycleEffectorTasks.java:583) [brooklyn-software-base-0.7.0-20150507.1059.jar:0.7.0-20150507.1059]
        at brooklyn.util.task.DynamicSequentialTask$DstJob.call(DynamicSequentialTask.java:337) [brooklyn-core-0.7.0-20150507.1059.jar:0.7.0-20150507.1059]
        at brooklyn.util.task.BasicExecutionManager$SubmissionCallable.call(BasicExecutionManager.java:469) [brooklyn-core-0.7.0-20150507.1059.jar:0.7.0-20150507.1059]
        at java.util.concurrent.FutureTask.run(FutureTask.java:262) [na:1.7.0_71]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_71]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_71]
        at java.lang.Thread.run(Thread.java:745) [na:1.7.0_71]

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions