Version Control Repository Manager 7.2.2 eats up all memory

[Leo Plewa]

Hello,

after upgrading three sim servers to the latest 7.2.2 also the VCRM was updated to this version.

The SIM servers are virtual machines with 16 GB memory and 4 cpu running on Windows 2008 R2 SP1.

Two are running with a local sql installation because of less clients.

One has a remote sql DB.

Now on all three servers we see extremly memory usage for the VCRM, which was not observed with the older version 7.2.0.

The memory usage goes up to 15 GB memory, in conjunction with the mxdoaminmgr with about 1,8 GB memory absolute slow down of the server.

We are receiving such events:

Log Name:      System

Source:        Microsoft-Windows-Resource-Exhaustion-Detector

Date:          09.12.2013 10:20:20

Event ID:      2004

Task Category: Resource Exhaustion Diagnosis Events

Level:         Warning

Keywords:      Events related to exhaustion of system commit limit (virtual memory).

User:          SYSTEM

Computer:      sim-server

Description:

Windows successfully diagnosed a low virtual memory condition. The following programs consumed the most virtual memory: cpqsrhmo.exe (1228) consumed 15086669824 bytes, mxdomainmgr.exe (3084) consumed 1800044544 bytes, and mxdtf.exe (1500) consumed 219762688 bytes.

Because this behaviour is on three servers since the upgrade i fear we have a bug in the VCRM 7.2.2.

Restarting the VCRM takes also a tremendous time to finish.

What could be the reason for that?

[Jürgen Büchs]

We are running Version 7.3.0 with the same issue.
Environment also VM with 2008R2 SP1, 16 GB memory, 4 CPUs

[DevilRay]

Did anyone found how to fix this issue ?. I also have same issue and running 7.3

[Jürgen Büchs]

I've got the same problem with version 7.3.2 on a machine with 16 GB memory and 4 CPUs running Windows 2008 R2.

[RemiO]

Hello,

I've got the same problem with version 7.3.0, installed patchs 001 to 011, on a machine with 20 GB memory and 4 CPUs, running Windows Server 2008 Standard x64 SP2 (VM).

[Yuanming29]

We are running Version 7.3.4 with the same issue.
Environment is physical server with 2008R2 SP1, 12 GB memory, 4 CPUs

[Andrew_Haak]

Hello,

Do you have the automatic download enabled? How many SPP's do you have loaded? I 've used the VCRM for many years and never had this problem. So perhaps it's that you have a lot of files in the VCRM, i use no more than 3 baselines.

My setup uses about 8 to 9 Gb max on a 12 Gb machine. You could try to disable the autodownload cleanup the directory and only unpack the SPP's you need in the VCRM directory. See how the memory usage evolves.

[Pacool68]

Hi,

I add the same issue with the VCRM (7.3.3) in windows 2012, and install the latest version 7.3.4, (Component: cp023741.exe) which solved the issue immediately.

Accessible on HP site: VCRM: Version:7.3.4.0 (20 Jun 2014) Fixes

Have fun the hunting season is open...

Pascal

[Kostantin Pavlidis]

Sorry, but I cannot agree. We tried with VCRM 7.3.4 on all of our VCRMs (we have tried to split the load per region) and VCRM eats up all memory "just fine" on all of them (all HP Proliant DL360 G7 servers with Win2k8R2 and 8 or 16GB of RAM and 1or 2 Quadcore Intel CPUs)...unacceptable from my perspective.

In the end, we considered that VCRM is causing much more troubles than solving issues, so we decided to disable/ uninstall it. We are changing our policy to not installing any SPP components, unless absolutely necessary.

[Andrew_Haak]

We had the same problem when updating the VCRM the server memory is Eten up. The only thing that helped was reboot of the SIM server. That fixed it for us. If i don't reboot the System Management Homepage service Ests all of my 12 gb of memory.

[Darren-Toll]

Hi All,

It seems from the amount of posts that the system using Windows 2012 doesn't have problems anymore but anything earlier than that does.

I'm using Windows 2008 R2 Enterprise and using Repository version 7.4.0.0, the same thing for me, using all the memory it can.

I was having the same issue with the previous versions of Repository from v 7.2.2 onwards, but before that around v 7.2.0, it didnt do the same thing. I dont want to go backwards to fix this issue.

I noticed Pascal had an issue on Windows 2012 then upgrading fixed this issue, just wondering if anyone else using Windows 2012 is having the same issue or an upgrade fixed it ?

Does anyone have a solution at all ?

Cheers Darren.

[Darren-Toll]

Just to add further details, we have 3 HP SIM Repositories running, 1 of then has HP SIM installed on it and this is the one using all the memory.

Repository 1 - Version 7.4.0.0, HP SIM installed as well version 7.3.0.0, Physical host with Windows 2008 R2 Enterprise, 16 GB memory installed, using 15.6 GB of memory.

Repository 2 - Version 7.3.0.0, doesn't have HP SIM installed, VM with Windows 2012 R2 Standard, 8 GB memory allocated, using 2.1 Gb only.

Repository 3 - Version 7.1.0.910, doesn't have HP SIM installed, VM with Windows 2008 R2 Standard, 4 GB memory allocated, using 1.78 Gb only.

Maybe I should separate the Repository from the SIM application for Repository 1 ?

Darren.

[Andrew_Haak]

I also have a Windows 2008 R2 setup, when SPP'S where added the memory grew untill all memory is eaten up. If I reboot the problem stays resolved untill the next SPP upload, then i have to reboot. Not sure if the SMH or VCRM is the problem.

[RussF]

I found a solution to this.  I'm running HP-SIM 7,3 update 2 on a windows 2008 R2 VM, 2 cores, 8 GB of RAM.  I found by running VCRM under a userid instead of localsystem appears to have resolv/////ed my issue.

[JAVIER DEL PINO]

Hello,

---

@RussF wrote:

I found a solution to this.  I'm running HP-SIM 7,3 update 2 on a windows 2008 R2 VM, 2 cores, 8 GB of RAM.  I found by running VCRM under a userid instead of localsystem appears to have resolv/////ed my issue.

---

I'm running VCRM 7.4.0 with a domain administrator user account in a Windows 2008R2 Enterprise server 8 cores and 64GB ram and cpqsrhmo.exe eats up all memory available as well.

HP SIM 7.4.0 is running in the same server.

It's not posible for us to have less than 3 baselines we can't update software as quick as HP recommend. Our servers are ruunning 24 hours a day and to update firmware and drivers means stop everything several hours and we can't afford that.

If anybody have a solution please send a msg.

Thanks.

[Andrew_Haak]

Hello,

If you restart the server running the VCRM (does not need to be the SIm server) does that solve the memory leak ? That worked for me. Update the baseline reboot and all worked OK !

[JAVIER DEL PINO]

---

@Andrew_Haak wrote:

Hello,

If you restart the server running the VCRM (does not need to be the SIm server) does that solve the memory leak ? That worked for me. Update the baseline reboot and all worked OK !

---

Andrew,

Thanks for your answer, but which baseline do you refer to? 

Best regards,

Javier

[Andrew_Haak]

Hello there,

The baselines are SPPs and PSPs i've uploaded into the VCRM. The indexing seems to keep eating the memory of the server. When the SPPs and PSPs are uploaded i wait till the logging shows it's finished. Then i reboot the server where the VCRM is installed.(can be the SIM, but does not need to be)

[JAVIER DEL PINO]

---

@Andrew_Haak wrote:

Hello there,

The baselines are SPPs and PSPs i've uploaded into the VCRM. The indexing seems to keep eating the memory of the server. When the SPPs and PSPs are uploaded i wait till the logging shows it's finished. Then i reboot the server where the VCRM is installed.(can be the SIM, but does not need to be)

---

Thanks andrew,

But I haven't uploaded any baseline since long ago.

The last SPP uploaded is 2014.09.0 and apparently is OK.

Best regards,

Javier

[Andrew_Haak]

That's strange since i am running the exact same versions exept for the admin rights in the service.

Why do you have admin rights filled in for the service ??

[JAVIER DEL PINO]

Andrew,

I used admin user for the service in a try to get repository properly appear in SIM CMS, without success. But I get the problem with memory with other users for the service.

Thanks,

Javier

[Andrew_Haak]

Do you still have updates enabled for download? I've disabled the update feature and uploaded fhe SPPS by hand. So all options are disabled and SPPS are unpacked in the directory in VCRM directory.

[JAVIER DEL PINO]

Andrew,

Thanks for your answer I'll try to disable the automatic update feature, although is difficult now because VCRM never finishes checking the catalog before eating up all memory, so the repository is not available anymore when this happend, but I'll try it anyway.

Thanks a lot,

Javier

[JAVIER DEL PINO]

Andrew,

Even though I've disabled automatic updates and deleted every file in repository, it is reconstructing itself, probably downloading again from HP. Do you know why is doing this?

Thank you,

Javier

[Andrew_Haak]

Hello again,

i've disabled all options from the point that the VCRM was installed. You could reinstall the software from scratch. I 'll look at my config to see if i can disable the download option after install. Will get back to you tommorow.