StoreVirtual Storage
cancel
Showing results for 
Search instead for 
Did you mean: 

Overall Performance on P4300 SAS Starter

portuer
Occasional Contributor

Overall Performance on P4300 SAS Starter

Hi,

one of our customer have a new Lefthand P4300 G1 installed. We conneted 2x DL380G6 over 2x Procurve 2900 Switches to the Lefthand for redundancy purposes. The new SANIQ SW 8.5 is already installed including the lates patches. We use Sever Virtualization with Microsoft Hyper-V R2 Server (Core). There are (only) 3 VM guests. The latest MPIO Driver is installed.

With the programm HDTUNE (http://www.hdtune.com/) we get reading performance rates from only 30 to 45 MB/s.

Please help!
15 REPLIES
Prokopets
Respected Contributor

Re: Overall Performance on P4300 SAS Starter

Do you use jumbo-frames?
portuer
Occasional Contributor

Re: Overall Performance on P4300 SAS Starter

we don't use jumbo frames.
for now we even do not use flow control.
Steve McGee
Occasional Advisor

Re: Overall Performance on P4300 SAS Starter

Are you sure that application is even suitable for testing your SAN?

IMO I wouldn't trust an application designed for testing local HD performance for testing my SAN's performance.

What are your performance monitor counters reading while you're running this test?

Dave Finch
Advisor

Re: Overall Performance on P4300 SAS Starter

HP / Lefthand recommends using IOMeter for performance testing. Be sure to increase the number of outstanding requests. I believe the recommendation is 1x the number of SATA drives or 2x the number of SAS drives in the cluster.

Re: Overall Performance on P4300 SAS Starter

I'm in agreement with Dave - HDD Tune seems to give poor readings as it's not desgined for external storage.

Give IO Meter a go, I think there's a WhitePaper floating around too somewhere although I cursoru search didn't turn up anything sorry.
Mario Prinz
Occasional Visitor

Re: Overall Performance on P4300 SAS Starter

I was wondering because we got far better results by testing an MSA2000SA G1 or an MSA2000i G1 - with the same programm.
Dave Finch
Advisor

Re: Overall Performance on P4300 SAS Starter

Mario, with IOMETER, the key is to increase the number of outstanding requests above the default which is 1. I didn't see an option like that in hdtune from a cursory look at the web site. Increasing outstanding IO requests will increase the Queue Depth which you can monitor in the CMC performance monitor. If the Queue Depth is low, then you are not getting optimal performance on the SAN. It's counter-intuitive, but a high Queue Depth on the HP P4000 is a good thing.
Mario Prinz
Occasional Visitor

Re: Overall Performance on P4300 SAS Starter

Thanks for your replies!

I've testet with Iometer with the following settings:

- RAW-Disk 5GB
- 1 worker
- 64 outstanding I/Os per target
- 8KB
- 50/50% Random/Sequential
- 50/50% Read/Write
- 100% Access Specification

I got the followed results (4 tests each):

Host 1:
Total I/Os p. Sec: 965
Total MBs p. Sec: 7,45
Av. I/O Response T: 66
Max.I/O Response T: 1619

Host 2:
Total I/Os p. Sec: 1430
Total MBs p. Sec: 11
Av. I/O Response T: 45
Max.I/O Response T: 3640

What do you say? Should I test with anoter values? Where can I find other results for comparison?

Thanks a lot!!
Mario
JacobS_4
Occasional Advisor

Re: Overall Performance on P4300 SAS Starter

We're seeing similar performance on our P4500 5.4TB, 4 node SAS cluster.

The NICS on each node are setup in a ALB configuration and split across two HP Procurve 2910 switches for redundancy. There is a 4 x 1Gb trunk between the two 2910 switches. Jumbo Frames and Flow Control is setup across the board.

The hosts are HP blades with 4 x 1Gb trunks from the blade chassis to each of the 2910 switches. We then have ESX 4 running on the blades and Windows 2008 VMs with Microsoft iSCSI initiators connecting directly to the SAN. Everything works fine, the speed is just poor. We've spoken with Vmware and they've checked our ESX configuration and blessed it. We're not seeing an errors on the switches, but as Portuer noted we also only get about 30 to 45 MB/s. Before we turned on Flow Control and Jumbo Frames we only got 15-23 MB/s. Not quite what we where hoping for based on the investment made.
JasonE
Occasional Visitor

Re: Overall Performance on P4300 SAS Starter

Same problem here. Two P4300 G1's with SATA drives, two Procurve 2900 switches, no errors, just poor performance. This SAN should be able to saturate a 1Gb link easily. Using ALB and jumbo frames. Don't need HDTUNE or IOMETER to tell me what is obvious, that a single sequential file copy is topping out at 40-45MB/s...which is unacceptable. Moved a file and printer server to it, and originally planned to move an Exchange box and an SQL box over to it (Hyper-V), but I'm worried about the lack of bandwidth, even with Exchange 2010, which requires less. Guess I'll contact support (again), and try to get someone that knows something, and just doesn't try to pass the buck. If anyone knows of a P4300 installation that can saturate a 1Gb link properly, please reply. (just so we know it's possible!)
Patrick Terlisten
Honored Contributor

Re: Overall Performance on P4300 SAS Starter

Hello,

when you're getting 965 IOs and every IO is 8 KB, then you will get round about 8 MB/s.

MB/s = IOPS x IO Size

You can fill a 1 GbE Link in two ways: Big IOs and less IOPS, or small IOs and many IOPS. IOPS is limited by the cache and number of disks.

Regards,
Patrick
Best regards,
Patrick
JacobS_4
Occasional Advisor

Re: Overall Performance on P4300 SAS Starter

I understand the math behind IOPS x IO Size = Throughput. I'm not sure how that is 100% relevant to the slow throughput many of us are seeing though. I have 4 SAS nodes in a single cluster. That's 48, 15K RPM disks. Even at a conservative average of 150 IOPS per disk I should be able to get 7200 IOPS. I see an average IO size of 22K in my environment. That meens I should be able to push well over 1 Gbps, or 125 MBps. Obviously there is TCP/UP overhead, but I definitely should be able to get more the 40 MBps. My network and switch ports aren't saturated, I'm not seeing any errors across my network, and my host CPU levels are low. I definitely feel like this is a Lefthand bottleneck and it's very frustrating.
Amana Living
Occasional Advisor

Re: Overall Performance on P4300 SAS Starter

Sorry to revive a dead thread, but we are seeing the same value in performance. 30 - 45 MB/s. I have been tracking down a backup issue. Our backup server is only utilising 25% of 1Gbps.

I've gone through our vsphere config, and our blade Flex10 config and tested network throughputs with iperf and can max out all data links.

I then setup a basic FTP server and copied a 5 gig file between two VM's and can only get 30-45 MB/s transfer rate.

Since I know the data LAN's can support 2.5Gbps so that's not the bottle neck. The storage network is on a 4.8 Gbps NIC's and is part of the same Flex10 domain.

So far it is looking like the Lefthand cluster, I do not want to configure Multipathing at the moment as we will in the future be going to multi site SAN.

Any help is appreciated.
NXS
Valued Contributor

Re: Overall Performance on P4300 SAS Starter

Anyone ideas on how to boost performance? with 6 P4500G2 sas (600 GB 15K) nodes with ESX4.1 ??

K

Re: Overall Performance on P4300 SAS Starter

I already postet this in an other thread but I was not able to set a link, sorry. So again:

We have a two node P4300 cluster (SAN iQ 9) with ALB on redundant HP 2910al switches. Clients are two DL380 G7 with ESXi 4.1.

Attached is a screenshot of a robocopy job and of the HP SAN Performance Monitor. As you can see we are able to reach 122 MByte/s (max. for a 1 Gbit/s link is 125 MByte/s).

Source of the robocopy job is a Win2003 server using the MS iSCSI initiator, target is Win2003 server on VMFS.

All volumes are Network RAID 10 (volumes mirrored).

Flow control, jumbo frames and Rapid Spanning Tree are enabled.

Of course this is no IO test but it shows that a P4300 cluster can operate at the max. throughput limit of a 1 Gbit/s link.

Thomas