- Community Home
- >
- Servers and Operating Systems
- >
- Operating Systems
- >
- Operating System - HP-UX
- >
- Re: iscsi initiator poor performance
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Discussions
Forums
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО05-07-2007 07:07 PM
тАО05-07-2007 07:07 PM
iscsi initiator poor performance
The iscsi stats are attached, however i am not able to interpret them. The only suspicious parameter is I/O underflows.
Any advices
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО05-07-2007 10:24 PM
тАО05-07-2007 10:24 PM
Re: iscsi initiator poor performance
I don't know how much the following article will be useful for you. Just check it:
hxxp://ieeexplore.ieee.org/Xplore/login.jsp?url=/iel5/9687/30571/01410738.pdf
For this you need an userid and password in ieeexplore.
Thanks and Regards
Britto Sidhan
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО05-08-2007 01:04 PM
тАО05-08-2007 01:04 PM
Re: iscsi initiator poor performance
Look for things like retransmissions, and retransmission timeouts and out of order segments.
Do the same thing with lanadmin -g mibstats
Also, what sort of system is this, and what is the per-CPU utilization of each CPU while the transfer is taking place? I'm guessing this is a gigabit/s ethernet, but any idea how many I/Os can be outstanding at one time, and of what size?
What is the TCP window size being used - you want to get a packet trace starting from when the target is first mounted so you can see the window scaling option if it is present.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-17-2008 10:20 AM
тАО01-17-2008 10:20 AM
Re: iscsi initiator poor performance
Can anyone comment on this configuration? Found this HP web site, "The following third-party storage devices have completed independent interoperability validation under the guidance of HP and have been qualified as interoperable in HP-UX environments."
http://www.hp.com/products1/serverconnectivity/mass_storage_devices.html#EMC
But it appears that only HP-UX 11iV3 is listed.
I haven't found anything that discusses integrity servers running HP-UX iSCSI with Auto Port Aggregation. Would aggregating two ethernet ports work well with iSCSI?
Has anyone tried this arrangement, am I doomed to have the same performance issues that Dejan had last year? Will there still be performance issues (or any other issues) if we attempt to use iSCSI even without aggregating ports for data? We'll keep network traffic separate from data traffic.
Thanks
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-18-2008 12:40 AM
тАО01-18-2008 12:40 AM
Re: iscsi initiator poor performance
Since September 2007 with the release of R26 FLARE for EMC cx3 arrays, EMC supports iSCSI connectivity for HP-UX hosts. You could check EMC E-lab navigator for more details.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-18-2008 05:26 AM
тАО01-18-2008 05:26 AM
Re: iscsi initiator poor performance
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-20-2009 06:18 AM
тАО04-20-2009 06:18 AM
Re: iscsi initiator poor performance
a few tips for testing:
check if immediate_report is 1 (see scsictl man page) and raise your queue_depth a lot above the default 8.
Next:
I might sound old and grumpy now, but I think someone should really go ahead and say it aloud.
I've been working with CX storage on HP-UX since 2001 now, and used iSCSI for over 5 years.
CX series arrays and HP-UX don't go well
Hitachi, for example seems to stomp on CX both for availabilty and performance, especially since avoiding all the stupid trespassing issues (ever tuned fcp_max_requests?).
iSCSI appears fast on most platforms because of "aggressive caching", sometimes you got up to 2 minutes of outstanding writes, and I wonder if HP-UX is a bit conservative about those, this might explain the read behaviour mentioned.
Personally I'd suggest you just stay away from iSCSI for anything but lab or home networks, even 1gbit FC beats gigabit iSCSI hands down (and thats stuff so old noone still uses it!). You get better availability and the price difference isn't half as high as iSCSI vendors want to make you believe.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-20-2009 07:07 AM
тАО04-20-2009 07:07 AM
Re: iscsi initiator poor performance
We have actually implemented iscsi on hp-ux 11.31 on an rx2660 to an EMC Clariion CX3-40 C. Using the Navipshere Analyzer software, we see that the response time on the iscsi luns is two to two and a half times longer than on the fibre attached luns. The metric "response time" is defined as: The average time, in milliseconds, required for one request to pass through a system component, including its waiting time.
It isn't in production yet, and we haven't finished testing things like job completion times to see if this will translate into real world problems, but I sure would have liked to have known about this issue before we invested.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-20-2009 07:51 AM
тАО04-20-2009 07:51 AM
Re: iscsi initiator poor performance
I'm using iSCSI on hpux 11.23 and 11.31, on both the performance is approx 20mb/sec. (ultra slow)
My target is a linux ietd. Note that other operating systems get a rate of 60mb plus per second.
Now, pcap logs of the hp-ux iscsi show that the hpux is performing a READ for every WRITE. (although even if you count out the read, 10mb per sec is very slow for gigabit).
Needless to say, other operating systems DO NOT perform this post-write10 read.
The immediate_report is 0, but I'm unable to set it:
See output:
bash-3.2# scsictl -m ir=1 /dev/rdsk/c16t0d0
scsictl: Device ioctl (set immediate_report) error: Invalid argument
Raising the queue_depth did not change anything.
Any ideas?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-20-2009 08:15 AM
тАО04-20-2009 08:15 AM
Re: iscsi initiator poor performance
Anyways, my testing includes sync and, at least on linux, sync waits until the data is fully written to the disk. Doesnt that mean that I achieved 60+mb/sec -including- the actual write?
Anyways, even without the cache... transferring at 20mb/sec is ridiculous..
Further research comparing the pcap logs of hp initiator to linux initiator shows that linux writes at transfer length of 1024 (does it matter?) and hp, no matter what, at 16. That means that linux performs approx 10 writes for 100mb, and hp performs above 10000 scsi write commands over iscsi. This is probably what causes the slow down...
Why does this happen?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО04-27-2009 07:19 AM
тАО04-27-2009 07:19 AM
Re: iscsi initiator poor performance
I'd point my finger at the immediate report setting, lacking anything else to point at.
Maybe some HP guru can shed some light on it?
I am quite sure it wasn't mentioned in the iscsi initiator docs.
A few more ideas to look at:
ndd parameters, and the window size for your transmits - this might help
raw tcp net performance test HP box <-> Linux box(i think i once used something called netperf) - this will make fingerpointing at the iSCSI initiator, as opposed to NIC or HP-UX itself, better.
My fingers are itching to do some tests myself, because I could use my iscsi-fc bridge but I don't have the time for it any time soon :(
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-06-2011 10:24 AM
тАО01-06-2011 10:24 AM
Re: iscsi initiator poor performance
We run into the similar performance issue, where we do have a 10GB uplink (we are using Itanium blade with Netapp as the central storage via 10G pipe) where the space of an iSCSI transfer is around 139MB/s while the same transfer via NFS to the same device is 894MB/s. What make up the different? We are already on the latest HPUX 11.31 with the latest version of iSCSI initiator, and it's on the delicated storage vlan without any traffic.
Bosco
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-06-2011 08:31 PM
тАО01-06-2011 08:31 PM
Re: iscsi initiator poor performance
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-07-2011 02:37 AM
тАО01-07-2011 02:37 AM
Re: iscsi initiator poor performance
Will be possible to share the network diagram of your setup along with configuration details?
Thanks,
GaneshS.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-07-2011 09:26 AM
тАО01-07-2011 09:26 AM
Re: iscsi initiator poor performance
As for the infrastructure configuration diagram...
blade -> 1G -> virtual connect ->10G -> Cisco Nexus 5K -> Netapp
We are seeing lots of out of order (lost packet, varies frame size etc, account for nearly 30% of the packets being captured) when doing packet capture on before and after virtual connect (ie. on the blade and on the 10G port to N5K).
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-18-2011 08:14 PM
тАО01-18-2011 08:14 PM
Re: iscsi initiator poor performance
One more input..can you share the iSCSI operational parameter (on HP-UX>iscsiutil -p -V)
Thanks,
GaneshS.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-19-2011 04:49 AM
тАО01-19-2011 04:49 AM
Re: iscsi initiator poor performance
Operational Target Information
------------------------------
Target # 1
-----------
Target Name : iqn.1992-08.com.netapp:sn.151728088
Target Alias :
No. of Target Addresses : 2
Target Address # 1
-------------------
IP Address : *
iSCSI TCP Port : 3260
iSCSI Portal Group Tag : 2002
User Configured:
----------------
Authenticaton Method :
CHAP Method : CHAP_UNI
Initiator CHAP Name :
CHAP Secret :
Header Digest : None,CRC32C (default)
Data Digest : None,CRC32C (default)
Target Address # 2
-------------------
IP Address : *
iSCSI TCP Port : 3260
iSCSI Portal Group Tag : 2001
User Configured:
----------------
Authenticaton Method :
CHAP Method : CHAP_UNI
Initiator CHAP Name :
CHAP Secret :
Header Digest : None,CRC32C (default)
Data Digest : None,CRC32C (default)
Target # 2
-----------
Target Name : iqn.1992-08.com.netapp:sn.151728129
Target Alias :
No. of Target Addresses : 2
Target Address # 1
-------------------
IP Address : *
iSCSI TCP Port : 3260
iSCSI Portal Group Tag : 2002
User Configured:
----------------
Authenticaton Method :
CHAP Method : CHAP_UNI
Initiator CHAP Name :
CHAP Secret :
Header Digest : None,CRC32C (default)
Data Digest : None,CRC32C (default)
Target Address # 2
-------------------
IP Address : *
iSCSI TCP Port : 3260
iSCSI Portal Group Tag : 2001
User Configured:
----------------
Authenticaton Method :
CHAP Method : CHAP_UNI
Initiator CHAP Name :
CHAP Secret :
Header Digest : None,CRC32C (default)
Data Digest : None,CRC32C (default)
Discovery Target Information
----------------------------
Target # 1
-----------
IP Address : *
iSCSI TCP Port : 3260
iSCSI Portal Group Tag : 1
User Configured:
----------------
Authenticaton Method :
CHAP Method : CHAP_UNI
Initiator CHAP Name :
CHAP Secret :
Header Digest : None,CRC32C (default)
Data Digest : None,CRC32C (default)
Target # 2
-----------
IP Address : *
iSCSI TCP Port : 3260
iSCSI Portal Group Tag : 1
User Configured:
----------------
Authenticaton Method :
CHAP Method : CHAP_UNI
Initiator CHAP Name :
CHAP Secret :
Header Digest : None,CRC32C (default)
Data Digest : None,CRC32C (default)
Session information
-------------------
Session # 1
------------
Session Instance No. : 2
ISID : 0x800000000002
Session State : Online
Target Name : iqn.1992-08.com.netapp:sn.151728088
Target Alias :
No. of Target Addresses : 1
Address # 1
------------
IP Address : *
iSCSI TCP Port : 3260
iSCSI Portal Group Tag : 2001
User Configured:
----------------
Authenticaton Method :
CHAP Method : CHAP_UNI
Initiator CHAP Name :
CHAP Secret :
Header Digest : None,CRC32C (default)
Data Digest : None,CRC32C (default)
Login Keys:
-----------
MaxConnections : 1
AuthMethod Proposed : None
AuthMethod Chosen : None
MaxRecvDataSegmentLength : 16384 bytes
MaxBurstLength : 65536 bytes
FirstBurstLength : 65536 bytes
DefaultTime2Wait : 0 seconds
DefaultTime2Retain : 20 seconds
MaxOutstandingR2T : 1
ErrorRecoveryLevel : 0 (Session failure recovery)
InitialR2T : No
ImmediateData : Yes
DataPDUInOrder : Yes
DataSequenceInOrder : Yes
OFMarker : No
IFMarker : No
OFMarkInt : 0
IFMarkInt : 0
DataDigest Proposed : None,CRC32C
DataDigest Chosen : None
HeaderDigest Proposed : None,CRC32C
HeaderDigest Chosen : None
TargetAddress : *:3260,2001
Session # 2
------------
Session Instance No. : 3
ISID : 0x800000000003
Session State : Online
Target Name : iqn.1992-08.com.netapp:sn.151728088
Target Alias :
No. of Target Addresses : 1
Address # 1
------------
IP Address : *
iSCSI TCP Port : 3260
iSCSI Portal Group Tag : 2002
User Configured:
----------------
Authenticaton Method :
CHAP Method : CHAP_UNI
Initiator CHAP Name :
CHAP Secret :
Header Digest : None,CRC32C (default)
Data Digest : None,CRC32C (default)
Login Keys:
-----------
MaxConnections : 1
AuthMethod Proposed : None
AuthMethod Chosen : None
MaxRecvDataSegmentLength : 16384 bytes
MaxBurstLength : 65536 bytes
FirstBurstLength : 65536 bytes
DefaultTime2Wait : 0 seconds
DefaultTime2Retain : 20 seconds
MaxOutstandingR2T : 1
ErrorRecoveryLevel : 0 (Session failure recovery)
InitialR2T : No
ImmediateData : Yes
DataPDUInOrder : Yes
DataSequenceInOrder : Yes
OFMarker : No
IFMarker : No
OFMarkInt : 0
IFMarkInt : 0
DataDigest Proposed : None,CRC32C
DataDigest Chosen : None
HeaderDigest Proposed : None,CRC32C
HeaderDigest Chosen : None
TargetAddress : *:3260,2002
Session # 3
------------
Session Instance No. : 4
ISID : 0x800000000004
Session State : Online
Target Name : iqn.1992-08.com.netapp:sn.151728129
Target Alias :
No. of Target Addresses : 1
Address # 1
------------
IP Address : *
iSCSI TCP Port : 3260
iSCSI Portal Group Tag : 2001
User Configured:
----------------
Authenticaton Method :
CHAP Method : CHAP_UNI
Initiator CHAP Name :
CHAP Secret :
Header Digest : None,CRC32C (default)
Data Digest : None,CRC32C (default)
Login Keys:
-----------
MaxConnections : 1
AuthMethod Proposed : None
AuthMethod Chosen : None
MaxRecvDataSegmentLength : 16384 bytes
MaxBurstLength : 65536 bytes
FirstBurstLength : 65536 bytes
DefaultTime2Wait : 0 seconds
DefaultTime2Retain : 20 seconds
MaxOutstandingR2T : 1
ErrorRecoveryLevel : 0 (Session failure recovery)
InitialR2T : No
ImmediateData : Yes
DataPDUInOrder : Yes
DataSequenceInOrder : Yes
OFMarker : No
IFMarker : No
OFMarkInt : 0
IFMarkInt : 0
DataDigest Proposed : None,CRC32C
DataDigest Chosen : None
HeaderDigest Proposed : None,CRC32C
HeaderDigest Chosen : None
TargetAddress : *:3260,2001
Session # 4
------------
Session Instance No. : 5
ISID : 0x800000000005
Session State : Online
Target Name : iqn.1992-08.com.netapp:sn.151728129
Target Alias :
No. of Target Addresses : 1
Address # 1
------------
IP Address : *
iSCSI TCP Port : 3260
iSCSI Portal Group Tag : 2002
User Configured:
----------------
Authenticaton Method :
CHAP Method : CHAP_UNI
Initiator CHAP Name :
CHAP Secret :
Header Digest : None,CRC32C (default)
Data Digest : None,CRC32C (default)
Login Keys:
-----------
MaxConnections : 1
AuthMethod Proposed : None
AuthMethod Chosen : None
MaxRecvDataSegmentLength : 16384 bytes
MaxBurstLength : 65536 bytes
FirstBurstLength : 65536 bytes
DefaultTime2Wait : 0 seconds
DefaultTime2Retain : 20 seconds
MaxOutstandingR2T : 1
ErrorRecoveryLevel : 0 (Session failure recovery)
InitialR2T : No
ImmediateData : Yes
DataPDUInOrder : Yes
DataSequenceInOrder : Yes
OFMarker : No
IFMarker : No
OFMarkInt : 0
IFMarkInt : 0
DataDigest Proposed : None,CRC32C
DataDigest Chosen : None
HeaderDigest Proposed : None,CRC32C
HeaderDigest Chosen : None
TargetAddress : *:3260,2002
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО01-19-2011 11:05 AM
тАО01-19-2011 11:05 AM