Storage Boards Cleanup
To make it easier to find information about HPE Storage products and solutions, we are doing spring cleaning. This includes consolidation of some older boards, and a simpler structure that more accurately reflects how people use HPE Storage.
HPE StoreVirtual Storage / LeftHand
cancel
Showing results for 
Search instead for 
Did you mean: 

P4500 snapshots getting only 4kb/s transfer

Chris Bullock_1
Frequent Advisor

P4500 snapshots getting only 4kb/s transfer

Setup
1 set of P4500 LeftHand boxes living on my Gigabit lan in 2 different buildings.
One is my primary and one is secondary. I am snapshotting from primary to secondary. I am only getting about 8kb/s transfer speed. I have gone in and edited bandwidth until I have hit "max" in the management group.
I haven't even put any data on these boxes yet and it's taking over 20 minutes to copy 1.25mb of data.
14 REPLIES
René Loser
Frequent Advisor

Re: P4500 snapshots getting only 4kb/s transfer

Hello Chris,

How does your network looks like?
You may have a drawing?

regards,
reNe

HP PreSales Switzerland
Olvi_1
Frequent Advisor

Re: P4500 snapshots getting only 4kb/s transfer

If you have edited the bandwidth to "max" I guess you have edited the local bandwidth level. That does nothing when you make remote snapshots.

Check what is your Remote Management Group Bandwidth Level (look attachment). You can edit it to whatever you like it, calculate to optimum or use default speeds depending on your bandwidth

Now that you haw gigabit LAN between buildings is there a good reason why do you want to make config this way? With one node per cluster gives you no fault tolerance. Consider making Multi-site cluster (inside one Management Group) + install Failover Manager and use network RAID. This way one node can go offline without interrupting IO to hosts.
Chris Bullock_1
Frequent Advisor

Re: P4500 snapshots getting only 4kb/s transfer

I have remote bandwidth set to Gigabit ethernet. My switches are running clean and there appears to be no problems on the switch port level.
Olvi_1
Frequent Advisor

Re: P4500 snapshots getting only 4kb/s transfer

Hi!

I noticed you had network problems earlier. Is this issue solved and what was the problem?
http://forums13.itrc.hp.com/service/forums/questionanswer.do?threadId=1411547

Here is some hints for troubleshooting the problem.
- Ping node to a another (gig LAN, time should be next to nothing)
- Try different NIC bondings (ALB recommended)
- Check alert logs on nodes
- Make LUN to Sec. MG and Remote Snapshot to Pri. (any difference)
- Make Remote Snapshot inside Management groups (check for speed rates)
- Bring node from secondary site to primary and connect to same switch(es) (to eliminate possible network problems)
- If possible transfer data between sites on some other devices such as desktops. Any problem there.

If non of those steps give a clue and if there is no performance issues at primary site/node I would start to suspect faulty node.

Chris Bullock_1
Frequent Advisor

Re: P4500 snapshots getting only 4kb/s transfer

What we have noticed this morning is that if we let the system create the remote volume this fixes our problem. We are now getting anywhere from 100-200mb/sec transfers. We originally manually created the Luns and volumes on the remote system as thin provisioned and then mapped to that for the remote copy.
Frank Verstraten
Frequent Advisor

Re: P4500 snapshots getting only 4kb/s transfer

I Am having the same issue with P4500 G2 nodes.
After setteng the bandwith to max values all I get is 300Kbps. I can't get the max speed of 1 Gbps.
Bryan McMullan
Trusted Contributor

Re: P4500 snapshots getting only 4kb/s transfer

Frank, what is your network layout? Are you sure you don't have any network issues between the management groups (Duplex mismatches cause by the link provider have sometimes caused issues like that for me in the past)?
Frank Verstraten
Frequent Advisor

Re: P4500 snapshots getting only 4kb/s transfer

I used different setups. Even if I install all iscsi cables in one switch I still have the same results.
The config is now 2 nodes using netraid 2 in one management group and one remote node in another man group to do the remote copy.
All the nodes are in the same vlan.
The switches used are procurves 2910.The bond settings are ALB on all the LH nodes. SanIQ is 8.5.And the duplex settings are set to auto.
Bryan McMullan
Trusted Contributor

Re: P4500 snapshots getting only 4kb/s transfer

@Frank -

Seems to be a number of issues lately with remote copy. If you have everything connected to one switch and still have an issue with only 300kbps....either the switch is misconfigured somehow or you should open a case with HP/LH support. That is terribly low and indicates that there is something very wrong.
Chris Bullock_1
Frequent Advisor

Re: P4500 snapshots getting only 4kb/s transfer

I know that when I most recently contacted support they claimed to only supported speeds greater than 3GB/s, which makes no sense. They wouldn't even attempt to troubleshoot until I met those requirements.
Bryan McMullan
Trusted Contributor

Re: P4500 snapshots getting only 4kb/s transfer

@Chris

Are you serious? What did they mean by the only support speeds over 3Gbps? (They expect everyone to be running 10G ethernet?)

I would actually request to be escalated at that point to the next support level or ask to speak with the support group manager. Unfortunately, it seems like you can be hit and miss with the support guys.
larry-cgb
Advisor

Re: P4500 snapshots getting only 4kb/s transfer

I have the same issue just send over 100meg - have a thread here. I think the issue is when you create a new volume, do a rebuild, change volume size or other back ground tasks the remote copy goes to the bottom of the list. Pushing the slider to 40 helps me to use more of my 100 meg pipe but still not all. I only have a production SAN so my testing is limited. My rate dropped down to 4k as well. After clearing out the other tasks I got things usable over my 100 meg WAN.

Well I think we have the same issue so I hope this information helps. Latter in the week I plan on opening a support ticket with HP, just want to collect all the results of my testing first.
TBone_2
Occasional Visitor

Re: P4500 snapshots getting only 4kb/s transfer

I just came across this thread, and wanted to add my details.

I have two pairs of LH SANs, each set up in a cluster. They eventually will be located in different offices connected by a DSL WAN. However for the moment, they are all together connected to a Gb switch with the NICs set in ALB mode. There are no connections to the SANs and there is no data access.

I am trying to do a remote snapshot and the maximum bandwidth I was getting was about the same as yours (8,000Kb/sec), I had already turned the remote bandwidth up to 1Gb and it didn't help. However after reading these posts, I changed the Local Bandwidth Priority up to 40, and the transfer rate jumped up to 160,000Kb/sec.

So could anyone comment why changing the local bandwidth would affect the remote copy rate?
Chris Bullock_1
Frequent Advisor

Re: P4500 snapshots getting only 4kb/s transfer

This is just an estimate, but if I copy over a very large chunk of data my speed is really good. It appears that the system is trying to span out the copy until the next copy is scheduled. example, if I'm doing snaps every 30 minutes, it will take about 30 minutes to copy over 10 megs, or 30 minutes to copy over 10 GBs. This may be to conserve bandwidth?? not sure since LeftHand support told me that I needed 3GB dedicated to to these snapshots.