StoreVirtual Storage
1752805 Members
5656 Online
108789 Solutions
New Discussion

StoreVirtual 12.7 - very high latencies on the datastores in vCenter

 
kwiiiq
Occasional Visitor

StoreVirtual 12.7 - very high latencies on the datastores in vCenter

Hello all,

I have recently installed StoreVirtual 12.7 at a customer's site. 

Setup:

2 ESXi hosts

Tiered storage:

-  2x SDD in RAID1

- 6x SAS in RAID 6

 

2 volumes created in StoreVirtual in a Network RAID - 10

 

The customer has been complaining about slowness so I checked the monitoring tools in the CMC + vCenter.

In CMC I can see no read + write latencies ( not on a Cluster, storage system, or even volume level ).

 

In vCenter however I can see huge latency spikes on the Datastores provided by StoreVirtual. Sometimes spikes up to 3000ms. Also, the latencies appear to happen on one ESXi host, so I am beginning to suspect a hardware issue. Maybe the switch port, or the network card where the iSCSI connections are connected in the host. I checked the iLOs of the DL380s but I can see no errors.

 

Anyone with some ideas?

3 REPLIES 3
Steven Clementi
Honored Contributor

Re: StoreVirtual 12.7 - very high latencies on the datastores in vCenter

Are the iSCSI configurations exactly the same on both hosts?

Are the iSCSI connections configured correctly?

Is your multipathing set correctly on both hosts?

Is/are the Network switch(es) configured correctly?

It could be a switch port, or a cable, would not be the first time I seen that.

Steven Clementi
HP Master ASE, Storage, Servers, and Clustering
MCSE (NT 4.0, W2K, W2K3)
VCP (ESX2, Vi3, vSphere4, vSphere5, vSphere 6.x)
RHCE
NPP3 (Nutanix Platform Professional)
kwiiiq
Occasional Visitor

Re: StoreVirtual 12.7 - very high latencies on the datastores in vCenter

Hi Steven, thanks for your quick reply.

Are the iSCSI configurations exactly the same on both hosts?

Are the iSCSI connections configured correctly?

--> I have provided some screenshots of the iSCSI setup in vCenter: 2 vmkernel on each host with teaming on a VMware Standard Switch. These 2 physical NICs are connected to 10Gbit/s ports.

 

Is your multipathing set correctly on both hosts?

--> When checking the paths on both host, I see the following: all paths on both hosts are always pointing to the same VSA IP: 192.168.10.13 ( see screenshot host1_iSCSIpaths and host2_iSCSIpaths ).

The IP the paths are pointing to, is the VSA that is located on the site where the host has no latencies.


 

kwiiiq
Occasional Visitor

Re: StoreVirtual 12.7 - very high latencies on the datastores in vCenter

3 more screenshots