IMC switch config backup failing

[milty1017]

At the web interface I can see my devices (switches). I can, using SSH logon to the switch successfully. About a month ago I was able to successfully manually or automatically backup the switch configurition. No new changes have occurred on the switch. Attached is the error detail when the backup fails. 

[mschreiner]

Hi,

the error message is server busy, so ther is nothing wrong with the ssh settings

Are all imcprocesses running ok? (you can check this in the process tab of the iDMA)

How large is the java Heap space? (you can check this in the envioment tab of the iDMA)

[milty1017]

All processes are running. I attached environment tab and process tab - Java heap appears ok. 

Just attempted another backup and it failed. log :

com.h3c.imc.common.ex.CommunicateTimeoutException[50101] Server busy. Please try again later.
at com.h3c.imc.common.ExceptionAdvisor.errorAdvise(ExceptionAdvisor.java:80)
at com.h3c.imc.common.MsgComm.sendSyncMsg(MsgComm.java:321)
at com.h3c.imc.icc.deploy.dao.DeployDaoImpl.createTask(DeployDaoImpl.java:434)
at com.h3c.imc.icc.devconfsoft.func.DevConfSoftMgrImpl.backupConfFile(DevConfSoftMgrImpl.java:299)
at com.h3c.imc.icc.devconfsoft.view.BackupFileResultBean.backupDevConfFile(BackupFileResultBean.java:1156)
at com.h3c.imc.icc.devconfsoft.view.BackupFileResultBean.startBackupConfFile(BackupFileResultBean.java:544)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.apache.el.parser.AstValue.invoke(AstValue.java:279)
at org.apache.el.MethodExpressionImpl.invoke(MethodExpressionImpl.java:273)
at org.apache.myfaces.view.facelets.el.ContextAwareTagMethodExpression.invoke(ContextAwareTagMethodExpression.java:96)
at org.apache.myfaces.application.ActionListenerImpl.processAction(ActionListenerImpl.java:68)
at javax.faces.component.UICommand.broadcast(UICommand.java:120)
at javax.faces.component.UIViewRoot._broadcastAll(UIViewRoot.java:1041)
at javax.faces.component.UIViewRoot.broadcastEvents(UIViewRoot.java:289)
at javax.faces.component.UIViewRoot._process(UIViewRoot.java:1415)
at javax.faces.component.UIViewRoot.processDecodes(UIViewRoot.java:772)
at org.apache.myfaces.lifecycle.ApplyRequestValuesExecutor.execute(ApplyRequestValuesExecutor.java:38)
at org.apache.myfaces.lifecycle.LifecycleImpl.executePhase(LifecycleImpl.java:170)
at org.apache.myfaces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:117)
at javax.faces.webapp.FacesServlet.service(FacesServlet.java:197)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.primefaces.webapp.filter.FileUploadFilter.doFilter(FileUploadFilter.java:79)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at com.h3c.imc.servlet.filters.FileUploadEncodingFilter.doFilter(FileUploadEncodingFilter.java:29)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.catalina.filters.HttpHeaderSecurityFilter.doFilter(HttpHeaderSecurityFilter.java:120)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.catalina.filters.CorsFilter.handleNonCORS(CorsFilter.java:436)
at org.apache.catalina.filters.CorsFilter.doFilter(CorsFilter.java:177)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at com.h3c.imc.filter.ImcBrowserCacheInvalidFilter.doFilter(ImcBrowserCacheInvalidFilter.java:66)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at com.h3c.imc.filter.ImcNoEtagFilter.doFilter(ImcNoEtagFilter.java:47)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at com.h3c.imc.filter.ImcExpiresFilter.doFilter(ImcExpiresFilter.java:830)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at com.h3c.imc.servlet.filters.UrlAccessController.doFilter(UrlAccessController.java:649)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:241)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:218)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:110)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:506)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:169)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:452)
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1087)
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:637)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1760)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1719)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:745)

[mschrein2]

have you tried to restart IMC?

[milty1017]

I restarted IMC as administrator and successfully backed up the configuration on an HP 3800 switch but I am having issues on other switches that I was able to successfully backup a month or so ago. Attached find a screen shot of backup failure detail. 

[racowi]

Are those devices behind a NAT?

Or is the IMC behind a NAT?

[LindsayHill]

Switch to SCP for backups. Don't use TFTP/FTP.

[milty1017]

IMC is not behind a NAT. 

Milty 

[milty1017]

I'm not sure but I may be limited from using SCP due to current software level - again, what is odd is backups were working automatically a month ago - with no changes to network infrastucture that I am aware of. 

...Milty 

[LindsayHill]

It would have to be pretty ancient software to not have SCP. Most likely it
just needs to be enabled.

[milty1017]

I did find it and enabled it but still having trouble with backups. I also tried to add additional switches to the automated backup group and that failed. 

[LindsayHill]

Sounds like your system has bigger problems. Checked your memory usage, increased Xmx if possible?

[milty1017]

I increased the Java Heap size - its at 3096/1048 ma. heap/non-heap mem. Backups still failing.

[LindsayHill]

What errors are in the logs?