- Community Home
- >
- Storage
- >
- HPE Nimble Storage
- >
- Array Setup and Networking
- >
- 10gig iSCSI latency on MS CSV volumes
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Discussions
Forums
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-18-2019 11:42 AM
тАО03-18-2019 11:42 AM
Hi,
I have 2 questions regarding 10gig iSCSI latency.
1. Each time we upgrade our HF20 array, we are bumbed with email alerts from Veeam ONE reporting too high read latency from the volumes.
Alarm: Cluster shared volume 2012 read latency
Time: 18-03-2019 18:48:58
Details: "Disk/CSV2012: Read Latency" (730.0 Milliseconds) is above a defined threshold (80.0 Milliseconds)
This is from all volumes. The array is connected to a c3750e stach running 10gig and our Hyper V servers is also running 10gig using Intel X520 nics.
None of the interfaces is showing any packet drops during the upgrade process (only sometimes during nightly backup when traffic is hiting 6-7Gbit/s we see a few packet drops). I know the c3750e has very small packet buffers, but as packet drops is none during array firmware upgrade, it cannot be a switch buffer issue. We have verified Microsoft performance monitor is also reporting these high read latencies, so it is not a Veeam ONE issue. All the 2012r2 Hyper V guests are using vhdx disks, so only our hosts are connected to the array with iSCSI using the newest Nimble toolkit.
2. Sometimes during working hours, we also get alerts for high read latency 70-80ms, even when the array is doing nearly nothing and our servers are also very light loaded. We have a CSV iSCSI volume containing only software for OS install and sometimes we also get alerts for this volume even though, it is not being accessed at all.
Any good ideas why we get these periodicly high read latencies from CSV volumes when bandwidth is low, no rx or tx errors, only light usage of our servers and nothing to see in Windows event logs?
Regards
Robert
Solved! Go to Solution.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-19-2019 05:09 PM - edited тАО03-19-2019 05:10 PM
тАО03-19-2019 05:09 PM - edited тАО03-19-2019 05:10 PM
SolutionHey Robert,
Just engage with Nimble Support, they can help perform some diagnostic even out of the array box, e.g. networking or host side......
Thomas Lam - Global Storage Field CTO
I work for HPE

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО05-20-2020 09:15 AM
тАО05-20-2020 09:15 AM
Re: 10gig iSCSI latency on MS CSV volumes
What was the solution in the end?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО05-20-2020 10:34 AM
тАО05-20-2020 10:34 AM
Re: 10gig iSCSI latency on MS CSV volumes
1. When there is a failover, Data service daemon ( service responsible for connections to the hosts) restarts, as the service needs to run from the new active controller. During DSD restart, recovery process re-pins lot of metadata in the cache including heatmap recovery. On a lower core systems such as this HF20, it may take longer to perform the heatmap recovery causing high latency due to high CPU usage.
Other than this we did not come closer to a real solution, but maybe it┬┤s something do to with Hyper-V inter host communication and/or i/o redirection, but we could not prove this.
That┬┤s why we are eager to try to new HPE InfoSight Collector Toolkit when version 5.1.4.200 is released for the HF20 array.
/Robert