topic Re: HP MSA2012i terrible throughput in MSA Storage

HP MSA2012i terrible throughput

sean anderson — Mon, 02 Feb 2009 19:59:57 GMT

I have a backup exec server that mounts a snapshop of various file servers that have volumes on the MSA2012i and the throughput is literally 10-20MB/Min.

The backup exec server is running windows 2008 x64 and I see that people are saying this OS is not supported so the question is if I put a Qlogic HBA in the server will this be supported configuration and if the slowness continues what could the issue be?

Re: HP MSA2012i terrible throughput

Uwe Zessin — Mon, 02 Feb 2009 20:17:04 GMT

It is normal to see low backup throughput on a server with lots of small files. The disk drives need to push their heads to position between data and meta-data during which no data transfer is possible.

Re: HP MSA2012i terrible throughput

sean anderson — Mon, 02 Feb 2009 20:21:56 GMT

I understand backup times are will be slower when dealing with many small files but I dont think literally 1MB/Sec is reasonble. We also run a windows storage server with the falconstore iscsi product as well as an instransa ISCSi solution and they have speeds during backups approaching 80X this speed I see with the MSA2012i.

Any other suggestions with regards to what I may not being doing? I cannot believe this is such a difficult problem to solve.

some information, our backup server is an ML350G5 with 12GB RAM, 1 quad core 2.5Ghz CPU and multiple nics inlcuding NC380T and NC382T. Everything has the latest firmwware and drivers. The SAN network is Procurve 2848 switches and cabling is all cat 6.

Re: HP MSA2012i terrible throughput

Uwe Zessin — Tue, 03 Feb 2009 05:38:11 GMT

I'm sorry, I have missed the "per Minute". That is really slow.

Before buying any hardware, have you tried to backup without snapshots to see if this is limiting the speed? The MSA2012i also allow some I/O monitoring - maybe the snapshots do produce too many addition I/Os. The speed on the file servers is OK during the backup?

I don't have any experience with random I/O on the MSA2012i, but I know it can do sequential quite well. What you could try is load the system with massive large, sequential read or write I/Os and look at the throughputs - maybe there is a problem in the network infrastructure which is visible with seq. I/O as well.

Re: HP MSA2012i terrible throughput

sean anderson — Tue, 03 Feb 2009 13:40:09 GMT

Thank you for the response. I suppose I should use a tool like IO meter to measure the IO's just to be sure I understand what is going on. As best as I can tell the fileserver behaves normally during the backup.

Thanks

Re: HP MSA2012i terrible throughput

Kevin Hand — Mon, 23 Feb 2009 14:37:57 GMT

There seems to be a major issue with performance on the MSA 2012i. I posted a detailed entry onto this forum as I have an outstanding support issue with HP on this very subject.

I have just checked and my posting has disappeares.

There are a number of other posting on this forum regading poor performance and BXOIS errors in the system event log

Re: HP MSA2012i terrible throughput

Bart_Rajchel — Mon, 23 Feb 2009 15:23:06 GMT

I have a similar issue. We are using a HP DP6.0 for backups and have exactly the same problem. I can also say that copying files from the MSA2012i over a gigabit LAN is also 10-18MB/s it's not only backup. I can copy from other storage technologies with much higher speed then from MSA2012i. I was told by a HP storage rep that HP does not deal with performance issues. Funny we only have HP equipment (servers. switches, LTO4 drives HP software). Time to switch vendors.

Re: HP MSA2012i terrible throughput

sean anderson — Mon, 23 Feb 2009 15:51:32 GMT

Bart,

I have noticed the same thing. Transfer speeds are generally quite poor but in our case the backups are dismal. I thought it was related to Windows 2008 iSCSI initiator software so I installed qlogic 4062C HBA's but the problem is still quite unsatisfactory.

Re: HP MSA2012i terrible throughput

Kevin Hand — Mon, 23 Feb 2009 16:16:26 GMT

I have had a support call placed with HP since 11th Feb and have sent email after email requesting assistance and have received very little response from HP at all

Re: HP MSA2012i terrible throughput

Bart_Rajchel — Mon, 23 Feb 2009 16:25:21 GMT

This is extremely upsetting. How can HP do this? O I know. They know about the problems but can't figure it so I guess it's easier to ignore it.

Re: HP MSA2012i terrible throughput

Robert Sumners — Wed, 18 Mar 2009 15:14:15 GMT

Thought I would throw in my two cents. We've been fighting the MSA2012i box for 8 months now. HP support is terrible and unresponsive. We are also having slow backup speeds with it and when backing up, our cluster resources (disks) will go offline. Would never buy an HP SANS again.

Re: HP MSA2012i terrible throughput

Al Lopez — Wed, 18 Mar 2009 15:36:16 GMT

I was curious if you could post more information. I am considering the 2012i bundle and wanted to see how you were configured.

Did you use a VLAN for your iSCSI traffic?
What cluster size are you using for the vdisk?

If this is a systemic issue with the 2012i, I won't order it.

Just curious if more people are dissatisfied than happy with this model.

Thanks!

Re: HP MSA2012i terrible throughput

Bart_Rajchel — Wed, 18 Mar 2009 18:11:01 GMT

Don't look at the MSA line of storage. This storage solution is nothing but problems. We even had CDW and HP design, quote and approve this configuration and now we have about 200lb of modern looking dust collectors.
Here's an idea. I bet we can cluster one hundred of our old RW CD-ROMs sitting in the storage room and have better performance then MSA2012i. I bet Linux community can write some app for that!

Re: HP MSA2012i terrible throughput

ZeroAdmin — Wed, 22 Apr 2009 16:24:40 GMT

Been having issues too. Backup Exec 12.5, Hyper V environment with Windows 2008 (POS) , G5 server with the 2012i and HP 6000 tape library.

Been seeing some chatter about the HP's nic teaming software and iSCSI.

You may want to try them un-teamed to see what happens (if they are).

Regards...

Re: HP MSA2012i terrible throughput

sean anderson — Wed, 22 Apr 2009 16:34:26 GMT

Thanks for the information. I am not teaming adapters under Windows 2008 anymore. The result of no teaming has lead to any performance increase overall.

Strangley, I have discovered that I can do a file level backup via the host instead of through snapshots at 2.5GB/Min. I dont understand how file based backup are faster than block based but since it is effective I have been using it.

I have no confidence that HP will help me anymore. It is a shame when you consider I have been a great advocate of HP for the past 12 years...

I am now looking at eating crow and committing to a much more expensive solution from EMC or NetAPP. I need the performance and it does not seem that anyone offers good performance at the MSA price point.....

Re: HP MSA2012i terrible throughput

Dennes Meeusen — Tue, 05 May 2009 19:41:29 GMT

Did you try loading up the latest (april) firmware in your msa2012? Performance increase in our iSCSI msa2012i was very noticeable when we applied the latest f/w

IMHO the 2012 is a good device, considering it's price and targeted audience. Comparable SAN's from Equallogic/Dell or Netapp cost about twice as much. If you really want high end performance, consider the EVA line

Re: HP MSA2012i terrible throughput

sean anderson — Tue, 05 May 2009 19:57:38 GMT

Dennes,

I dont see an april firmware update. Can you give the URL for this update?

I agree in principle with what you are saying. There are some very rough edges that HP really should smooth out to make it more fully functional for those who purchase the device.

Re: HP MSA2012i terrible throughput

Dennes Meeusen — Tue, 05 May 2009 20:13:25 GMT

This should be it (for the iSCSI version, not the FC)

http://h20000.www2.hp.com/bizsupport/TechSupport/SoftwareDescription.jsp?lang=en&cc=us&prodTypeId=12169&prodSeriesId=3687128&swItem=co-69015-1&prodNameId=3687132&swEnvOID=4025&swLang=13&taskId=135&mode=4&idx=0

Re: HP MSA2012i terrible throughput

Dennes Meeusen — Tue, 05 May 2009 20:16:39 GMT

Btw. When Googling you'll find that there seem to be lots of problems with iSCSI in Windows Server 2008. You might ant to test/check with 2003 and see if throughput is any better.

Re: HP MSA2012i terrible throughput

sean anderson — Thu, 07 May 2009 11:24:07 GMT

Thanks Dennes,

I do have this firmware. It did make a difference in overall performance but I still have major issues with performance.

I have tried testing with Windows 2003 and do some some improvement over 2008. However, the performance is still not acceptable.