System Administration
cancel
Showing results for 
Search instead for 
Did you mean: 

HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

SOLVED
Go to solution
David Libby_4
Regular Advisor

HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

Hi,

We're just trying to make an HP-UX 11.31 installation talk correctly with our EMC Clariion CX700. We see the LUNS we presented but unfortunately the performance is horrific (400mb copied from vg00 to a vg on the SAN took 30 mins!!!!).

Does anybody out there have experience with HP-UX 11iv3 (11.31) and EMC Clariions?

Documentation is very sparce on both HP and EMC sites.

Hardware is rp3440...

Regards,
David Libby
20 REPLIES
Steven E. Protter
Exalted Contributor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

Shalom David,

EMC has been known to ship those EMC boxes with incorrect parameters. I'd suggest taking a look at an EMC that performs properly and emulating it s configuration. That might find you an EMC configuration problem.

I'm aware of a business that spent $1,000,000 diganosing a software problem in its product when the actual cause was an EMC tech decided to make a bad configuration combination. I/O was awful.

SEP
Steven E Protter
Owner of ISN Corporation
http://isnamerica.com
http://hpuxconsulting.com
Sponsor: http://hpux.ws
Twitter: http://twitter.com/hpuxlinux
Founder http://newdatacloud.com
melvyn burnard
Honored Contributor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

having seen some basics tests done using HP arrays and the native multipathing, I have to agree with SEP's suggestion, talk to your EMC specialist
My house is the bank's, my money the wife's, But my opinions belong to me, not HP!
David Libby_4
Regular Advisor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

Hmmm.... well thanks for responding in any case.

Considering that that our Clariion has been in production for several years now and has a large number of machines connected to it (including a lot of HP-UX 11iv1 & 11iv2)... I would be disinclined to agree with your proposals.

We currently have support cases open with both vendors.

To EMC's credit... if HP are going to declare that third party "multi-pathing" products such as PowerPath are obsolete with 11iv3(which they have done), then they had better make sure their product works out-of-the-box (not done).

In any case discussions regarding the quality of support HP & EMC provide are best left aside.

If anyone out there actually has any *technical* answers or clues they'd be much appreciated.

Best regards,
David
Duncan Edmonstone
Honored Contributor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

David,

And where exactly did you read that the Clariion CX700 is actually supported with 11iv3?

Personally that would have been the first thing I wanted to check prior to using a brand new OS like 11iv3...

For your information, HP don't and never will offer support for Clariion disk arrays - thats EMC's problem - you'd get the same response from IBM, Sun or any other OS/Server vendor on that. What HP do carry out (or allow a third party to carry out) is 'independent interoperability validation', which means they work with EMC to 'qualify' their storage with HPUX and HP9000/Integrity. You can see the support matrix for that here:

http://www.hp.com/products1/serverconnectivity/mass_storage_devices.html#EMC

Note that 11iv3 is not mentioned.

Now EMC also carry out their own Interoperability tests and publish these on their customer support website (powerlink.emc.com) - I can't post a link to these here (you need a login), but I can tell you that this also doesn't mention support for 11iv3 with Clariion (it does for Symmetrix/DMX though).

So if neither the OS vendor nor the Array vendor list this as supported its not really a surprise that there are problems.

Now on to *why* there are problems:

The EMC Clariion is one of the few arrays on the market that still operates in an 'active passive' configuration - that is for any given LUN, IOs are only accepted on one controller (the EVA used to work like that as well about 3 years ago). What happens when an IO is sent to the non-owning controller (this event is called a trespass) depends on how a certain parameter is set on the Clariion (IIRC its called 'failover mode').

Now I expect that you have your failover mode set such that every time a trespass occurs, the owning controller for a LUN is changed - this operation is *slow* and if you are doing load balancing (which 11iv3 will do by default) almost every IO is going to cause a trespass.

Now you *might* be able to reolve this somewhat by playing with the load balancing options in the new storage stack (if you set load balancing to preferred path and then set the preferred path to the owning controller using the scsimgr command then at least *most* of the IOs would go to the owning controller, but anything that probes the other path is still going to cause a path failover and slow things down) - or I think theres an option to disable the new load balancing algorithms on the legacy DSFs (thats the cXtYdZ DSFs) - you could do that and then just use LVM PVLinks which were ceratinly supported in 11iv1/11iv2 - but that doesn't alter the fact that you are running an unsupported configuration...

I expect EMC are working on a plug-in or a version of PowerPath for 11iv3 which will resolve this, so maybe you can persuade them to give you a beta, otherwise I guess you need to go back to 11iv2 or use another storage array.

HTH

Duncan

HTH

Duncan
Geoff Wild
Honored Contributor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

I'm currently benchmarking a RX6600.

30mins - yes - there is definately something very wrong there...

Now mine isn't on a clariion - it's on a DMX1000 and DMX3

From the output below, frame 65 is the 1000 and 52 is the DMX3.

# prealloc /tmp/bigfile 409600000

# timex cp /tmp/bigfile /v01/

real 11.95
user 0.00
sys 0.18

How did you create your vg?

Can you post the commands I ran below for your env?

I did mine like so:

mkdir /dev/vg11
mknod /dev/vg11/group c 64 0x0b0000

vgcreate -s 32 -p 64 -e 32768 /dev/vg11 /dev/disk/disk23 /dev/disk/disk24 /dev/disk/disk25



# ioscan -m dsf
Persistent DSF Legacy DSF(s)
========================================
/dev/pt/pt1 /dev/rscsi/c1t0d0
/dev/pt/pt3 /dev/rscsi/c3t0d0
/dev/rdisk/disk4 /dev/rdsk/c0t1d0
/dev/rdisk/disk4_p3 /dev/rdsk/c0t1d0s3
/dev/rdisk/disk4_p1 /dev/rdsk/c0t1d0s1
/dev/rdisk/disk4_p2 /dev/rdsk/c0t1d0s2
/dev/pt/pt5 /dev/rscsi/c5t0d0
/dev/rdisk/disk5 /dev/rdsk/c0t0d0
/dev/rdisk/disk5_p1 /dev/rdsk/c0t0d0s1
/dev/rdisk/disk5_p2 /dev/rdsk/c0t0d0s2
/dev/rdisk/disk5_p3 /dev/rdsk/c0t0d0s3
/dev/pt/pt7 /dev/rscsi/c7t0d0
/dev/rdisk/disk7 /dev/rdsk/c2t0d0
/dev/rdisk/disk9 /dev/rdsk/c4t0d0
/dev/rdisk/disk18 /dev/rdsk/c4t9d0
/dev/rdisk/disk19 /dev/rdsk/c4t9d1
/dev/rdisk/disk20 /dev/rdsk/c4t9d2
/dev/rdisk/disk21 /dev/rdsk/c4t9d3
/dev/rdisk/disk22 /dev/rdsk/c2t9d0
/dev/rdisk/disk23 /dev/rdsk/c2t9d1
/dev/rdisk/disk24 /dev/rdsk/c2t9d2
/dev/rdisk/disk25 /dev/rdsk/c2t9d3
/dev/rdisk/disk27 /dev/rdsk/c6t0d0
/dev/rdisk/disk29 /dev/rdsk/c8t0d0
/dev/rdisk/disk38 /dev/rdsk/c8t4d0
/dev/rdisk/disk39 /dev/rdsk/c8t4d2
/dev/rdisk/disk40 /dev/rdsk/c8t3d7
/dev/rdisk/disk41 /dev/rdsk/c8t4d1
/dev/rdisk/disk42 /dev/rdsk/c6t4d0
/dev/rdisk/disk43 /dev/rdsk/c6t3d7
/dev/rdisk/disk44 /dev/rdsk/c6t4d1
/dev/rdisk/disk45 /dev/rdsk/c6t4d2



# inq
Inquiry utility, Version V7.3-771 (Rev 0.0) (SIL Version V6.3.0.0 (Edit Level 771)
Copyright (C) by EMC Corporation, all rights reserved.
For help type inq -h.

............................

-----------------------------------------------------------------------------
DEVICE :VEND :PROD :REV :SER NUM :CAP(kb)
-----------------------------------------------------------------------------
/dev/rdsk/c0t0d0 :HP :DG072ABAB3 :HPD5 :3NP0D3VQ : 71687369
/dev/rdsk/c0t0d0s1 :HP :DG072ABAB3 :HPD5 :3NP0D3VQ : 71687369
/dev/rdsk/c0t0d0s2 :HP :DG072ABAB3 :HPD5 :3NP0D3VQ : 71687369
/dev/rdsk/c0t0d0s3 :HP :DG072ABAB3 :HPD5 :3NP0D3VQ : 71687369
/dev/rdsk/c0t1d0 :HP :DG072ABAB3 :HPD5 :3NP0BTRC : 71687369
/dev/rdsk/c0t1d0s1 :HP :DG072ABAB3 :HPD5 :3NP0BTRC : 71687369
/dev/rdsk/c0t1d0s2 :HP :DG072ABAB3 :HPD5 :3NP0BTRC : 71687369
/dev/rdsk/c0t1d0s3 :HP :DG072ABAB3 :HPD5 :3NP0BTRC : 71687369
/dev/rdsk/c2t9d0 :EMC :SYMMETRIX :5670 :6500780000 : 35354880
/dev/rdsk/c2t9d1 :EMC :SYMMETRIX :5670 :650079c000 : 35354880
/dev/rdsk/c2t9d2 :EMC :SYMMETRIX :5670 :6500774000 : 35354880
/dev/rdsk/c2t9d3 :EMC :SYMMETRIX :5670 :650077c000 : 35354880
/dev/rdsk/c4t9d0 :EMC :SYMMETRIX :5670 :6500780000 : 35354880
/dev/rdsk/c4t9d1 :EMC :SYMMETRIX :5670 :650079c000 : 35354880
/dev/rdsk/c4t9d2 :EMC :SYMMETRIX :5670 :6500774000 : 35354880
/dev/rdsk/c4t9d3 :EMC :SYMMETRIX :5670 :650077c000 : 35354880
/dev/rdsk/c6t0d0 :EMC :SYMMETRIX :5771 :5200022000 : 5760
/dev/rdsk/c6t3d7 :EMC :SYMMETRIX :5771 :52000e3000 : 77760000
/dev/rdsk/c6t4d0 :EMC :SYMMETRIX :5771 :52000e7000 : 77760000
/dev/rdsk/c6t4d1 :EMC :SYMMETRIX :5771 :52000eb000 : 77760000
/dev/rdsk/c6t4d2 :EMC :SYMMETRIX :5771 :52000ef000 : 77760000
/dev/rdsk/c8t0d0 :EMC :SYMMETRIX :5771 :5200022000 : 5760
/dev/rdsk/c8t3d7 :EMC :SYMMETRIX :5771 :52000e3000 : 77760000
/dev/rdsk/c8t4d0 :EMC :SYMMETRIX :5771 :52000e7000 : 77760000
/dev/rdsk/c8t4d1 :EMC :SYMMETRIX :5771 :52000eb000 : 77760000
/dev/rdsk/c8t4d2 :EMC :SYMMETRIX :5771 :52000ef000 : 77760000


# vgdisplay -v vg11
--- Volume groups ---
VG Name /dev/vg11
VG Write Access read/write
VG Status available
Max LV 255
Cur LV 1
Open LV 1
Max PV 64
Cur PV 3
Act PV 3
Max PE per PV 32768
VGDA 6
PE Size (Mbytes) 32
Total PE 3234
Alloc PE 3234
Free PE 0
Total PVG 0
Total Spare PVs 0
Total Spare PVs in use 0

--- Logical volumes ---
LV Name /dev/vg11/lvdata01
LV Status available/syncd
LV Size (Mbytes) 103488
Current LE 3234
Allocated PE 3234
Used PV 3


--- Physical volumes ---
PV Name /dev/disk/disk23
PV Status available
Total PE 1078
Free PE 0
Autoswitch On

PV Name /dev/disk/disk24
PV Status available
Total PE 1078
Free PE 0
Autoswitch On

PV Name /dev/disk/disk25
PV Status available
Total PE 1078
Free PE 0
Autoswitch On


Rgds...Geoff
Proverbs 3:5,6 Trust in the Lord with all your heart and lean not on your own understanding; in all your ways acknowledge him, and he will make all your paths straight.
David Libby_4
Regular Advisor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

Hi Geoff,

We've got 3 VGs configured on that machine... but we only need one for now as they were all setup using the same commands.

The usual mkdir/mknod and vgcreate scenario... nothing special.

Here we go... for vge1
======================================
root@s000311 # ioscan -m dsf
Persistent DSF Legacy DSF(s)
========================================
/dev/pt/pt2 /dev/rscsi/c4t0d0
/dev/rscsi/c6t0d0
/dev/rdisk/disk13 /dev/rdsk/c5t0d0
/dev/rdsk/c7t0d0
/dev/rdisk/disk14 /dev/rdsk/c5t0d1
/dev/rdsk/c7t0d1
/dev/rdisk/disk15 /dev/rdsk/c5t0d2
/dev/rdsk/c7t0d2
/dev/rdisk/disk16 /dev/rdsk/c5t0d3
/dev/rdsk/c7t0d3
/dev/rdisk/disk17 /dev/rdsk/c3t3d0
/dev/rdisk/disk18 /dev/rdsk/c3t2d0
/dev/rdisk/disk19 /dev/rdsk/c3t1d0
/dev/rdisk/disk20 /dev/rdsk/c2t0d0
/dev/rdisk/disk21 /dev/rdsk/c0t0d0
/dev/rdisk/disk24 /dev/rdsk/c5t0d7
/dev/rdsk/c7t0d7
/dev/rdisk/disk26 /dev/rdsk/c2t1d0
root@s000311 # inq
Inquiry utility, Version V7.3-782 (Rev 1.0) (SIL Version V6.3.1.0 (Edit Level 782)
Copyright (C) by EMC Corporation, all rights reserved.
For help type inq -h.

................

---------------------------------------------------------------------------
DEVICE :VEND :PROD :REV :SER NUM :CAP(kb)
---------------------------------------------------------------------------
/dev/rdsk/c0t0d0 :TEAC :DV-28E-N :E.6A : : -----
/dev/rdsk/c2t0d0 :HP 146 G:MAT3147NC :HPC2 :AX009940 : 143374744
/dev/rdsk/c2t1d0 :HP 146 G:MAT3147NC :HPC2 :AX008896 : 143374744
/dev/rdsk/c3t1d0 :HP :DVD-ROM 305 : : : -----
/dev/rdsk/c3t2d0 :HP :DVD-ROM 305 : : : -----
/dev/rdsk/c3t3d0 :HP :DVD-ROM 305 : : : -----
/dev/rdsk/c5t0d0 :DGC :CX700WDR5 :HP03 :Ch2 CONT : 35354880
/dev/rdsk/c5t0d1 :DGC :CX700WDR5 :HP03 :Ch2 CONT : 125829120
/dev/rdsk/c5t0d2 :DGC :CX700WDR5 :HP03 :Ch2 CONT : 157286400
/dev/rdsk/c5t0d3 :DGC :CX700WDR5 :HP03 :Ch2 CONT : 157286400
/dev/rdsk/c5t0d7 :DGC :CX700WDR5 :HP03 :Ch2 CONT : 10485760
/dev/rdsk/c7t0d0 :DGC :CX700WDR5 :HP03 :Ch2 CONT : 35354880
/dev/rdsk/c7t0d1 :DGC :CX700WDR5 :HP03 :Ch2 CONT : 125829120
/dev/rdsk/c7t0d2 :DGC :CX700WDR5 :HP03 :Ch2 CONT : 157286400
/dev/rdsk/c7t0d3 :DGC :CX700WDR5 :HP03 :Ch2 CONT : 157286400
/dev/rdsk/c7t0d7 :DGC :CX700WDR5 :HP03 :Ch2 CONT : 10485760
root@s000311 # vgdisplay -v vge1
--- Volume groups ---
VG Name /dev/vge1
VG Write Access read/write
VG Status available
Max LV 255
Cur LV 2
Open LV 2
Max PV 64
Cur PV 1
Act PV 1
Max PE per PV 20000
VGDA 2
PE Size (Mbytes) 16
Total PE 2156
Alloc PE 1876
Free PE 280
Total PVG 0
Total Spare PVs 0
Total Spare PVs in use 0

--- Logical volumes ---
LV Name /dev/vge1/lv101
LV Status available/syncd
LV Size (Mbytes) 5008
Current LE 313
Allocated PE 313
Used PV 1

LV Name /dev/vge1/lv102
LV Status available/syncd
LV Size (Mbytes) 25008
Current LE 1563
Allocated PE 1563
Used PV 1


--- Physical volumes ---
PV Name /dev/disk/disk13
PV Status available
Total PE 2156
Free PE 280
Autoswitch On


root@s000311 #
=========================================

Regards,
David
Geoff Wild
Honored Contributor
Solution

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

I just spoke with our SAN Admin - he's allocating ne a LUN from our Clariion for testing - one thing he mentioned - make sure you have configured the initiator on the Clariion correctly - IE for DMP.

Rgds...Geoff
Proverbs 3:5,6 Trust in the Lord with all your heart and lean not on your own understanding; in all your ways acknowledge him, and he will make all your paths straight.
David Libby_4
Regular Advisor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

Hi Geoff,

We're just checking the Clariion initiator setting... for DMP if I have understood correctly it seems that it should be "No Auto-Trespass" + "Failover Mode"=2. We're just trying that now... thanks a lot.

Cheers,
David
David Libby_4
Regular Advisor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

Duncan,

Thanks for your amazingly detailed and accurate response! It's equivalent to flapping in a APA network aggregate if I have understood correctly? In any case, regardless of who supports what it looks like we're on our way to finding the right combination of settings... will give feedback tomorrow mornign after more tests and will of course post the exact "unsupported" solution.

Best regards,
David
Santosh Rao
Occasional Advisor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

Duncan has given a very accurate response.

11iv3 native multipathing supports active-active arrays transparently without needing any vendor supplied plug-ins.

Active-passive arrays need to either support ALUA (See Section 5.8 of http://t10.org/ftp/t10/drafts/spc3/spc3r23.pdf) or the active-passive array vendor needs to supply an apsw plug-in for their array. See :
http://h21007.www2.hp.com/portal/download/files/unprot/ddk/APSWWPAPER.pdf

You may want to enquire with your EMC sales rep on when EMC will support either ALUA or will provide the apsw active-passive plug-in for support of HP-UX 11iv3.
David Libby_4
Regular Advisor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

Okay everone, here goes with our home-brewed, unsupported configuration... which works for now.

Config for Clariion-side CX700:
-------------------------------
- We must first configure the two 2 initiators for our server in the following way on the Clariion:

============
Initiator Type: HP No Auto Trespass
Failover Mode: 2
============

Config for Server-side (HP-UX 11.31):
--------------------------------------
In our current configuration, we have 2 HBAs: the first is hooked up to SP-A on the Clariion and the second, SP-B. As already established, it's not possible to perform load-balancing, because the Clariion CX700 fonctions in "Active/Passive" mode. Therefore we have to change the load-balancing policy for each LUN in order to replicate a basic failover mode (hot spare if you like).

To do that we need to use the "preferred_path" argument for scsimgr.

First though we need the hardware adress in hex... ugh!

To get that we run ioscan with the following args.
==================================================================
# ioscan -fnNkCdisk
Class I H/W Path Driver S/W State H/W Type Description
===================================================================
disk 13 64000/0xfa00/0x1 esdisk CLAIMED DEVICE DGC CX700WDR5
/dev/disk/disk13 /dev/rdisk/disk13
disk 14 64000/0xfa00/0x2 esdisk CLAIMED DEVICE DGC CX700WDR5
/dev/disk/disk14 /dev/rdisk/disk14
disk 15 64000/0xfa00/0x3 esdisk CLAIMED DEVICE DGC CX700WDR5
/dev/disk/disk15 /dev/rdisk/disk15
disk 16 64000/0xfa00/0x4 esdisk CLAIMED DEVICE DGC CX700WDR5
/dev/disk/disk16 /dev/rdisk/disk16
disk 20 64000/0xfa00/0x8 esdisk CLAIMED DEVICE HP 146 GMAT3147NC
/dev/disk/disk20 /dev/rdisk/disk20
disk 21 64000/0xfa00/0x9 esdisk CLAIMED DEVICE TEAC DV-28E-N
/dev/disk/disk21 /dev/rdisk/disk21
disk 26 64000/0xfa00/0xc esdisk CLAIMED DEVICE HP 146 GMAT3147NC
/dev/disk/disk26 /dev/rdisk/disk26
disk 24 64000/0xfa00/0xd esdisk CLAIMED DEVICE DGC CX700WDR5
/dev/disk/disk24 /dev/rdisk/disk24
==================================

Then we fix the so called "load-balancing" policy...
==================================
/usr/sbin/scsimgr save_attr -H 64000/0xfa00/0xd -a load_bal_policy="preferred_path"
==================================

To find out the exact hardware path to "fix" as "preferred" you need to use the following command....
==================================
# /usr/sbin/scsimgr lun_map -D /dev/rdisk/disk24

LUN PATH INFORMATION FOR LUN : /dev/rdisk/disk24

Total number of LUN paths = 2
World Wide Identifier(WWID) = 0x60060160ce0b1600a242ce17f917dc11

LUN path : lunpath16
Class = lunpath
Instance = 16
Hardware path = 0/3/1/0/4/0.0x5006016930600f94.0x4007000000000000
SCSI transport protocol = fibre_channel
State = ACTIVE
Last Open or Close state = ACTIVE

LUN path : lunpath15
Class = lunpath
Instance = 15
Hardware path = 0/4/1/0/4/0.0x5006016130600f94.0x4007000000000000
SCSI transport protocol = fibre_channel
State = ACTIVE
Last Open or Close state = ACTIVE
=================================

After activating that policy we now force the path for the LUN to be point to the corresponding SP on the Clariion. Like so:
=================================
/usr/sbin/scsimgr save_attr -D /dev/rdisk/disk24 -a preferred_path=0/3/1/0/4/0.0x5006016930600f94.0x4007000000000000
=================================

We have now tested this with some large file copies and it performs just as well as on other machines connected with a single HBA (was not the case before).

We have also tested the failover of HBAs by forcing a trespass on the Clariion (in both directions)... no adverse effects were perceived.
Geoff Wild
Honored Contributor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

David,

I have this update from our EMC rep:

"HPUX 11.31 will only work with active/active arrays. CLARiiON arrays are active/passive. We already support native MPIO for Sun and Windows. For HP/UX, we can't promise anything since the ball is mostly in HP's court. We hope so but looks like it will be a patch to 11iv3 to enable it.......along with release 26 on the CLARiiON.

Lastly, let me say this. I've been told if you move ahead (ie above) on anything other than R26, you will have data corruption issues. "

Rgds...Geoff


Proverbs 3:5,6 Trust in the Lord with all your heart and lean not on your own understanding; in all your ways acknowledge him, and he will make all your paths straight.
David Libby_4
Regular Advisor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

Thanks Geoff... I'm going to wait for official confirmation from our EMC reps over here and the closure of the support call we have with them regarding it. If that statement is corroborated over here, I suspect there's going to be some serious heat travelling towards EMC/HP from our mgmt. In any case it's all a very interesting excercise... if the risk is confirmed then we will stick with 11.23 or attach the concerned machines to a Symmetrix.
Santosh Rao
Occasional Advisor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

Hi,

EMC rep is only partially correct.

HP-UX 11.31 does support active/passive as well as asymmetric active-active arrays. However, it requires the array vendor to support ALUA or to provide the apsw plug-in. ALUA is already supported by a number of the well known mid-range asymmetric active-active arrays. The reference to upcoming rev 26 should be enabling ALUA and with that, the Clariion will work transparently with HP-UX 11.31.

You should see transparent support for the Clariion once ALUA is out in a couple of months. In the meantime, the use of preferred path as previously described on this thread is a reasonable solution as long as you are using a single host configuration (i.e. not in a SG cluster, not having multiple host OS' connected to the same luns). To use the interim solution with preferred path, you will need to configure the Clariion in Auto Tresspass mode.

Another option is to use the legacy device files only on 11.31, set the leg_mpath_enable attribute to 0 and configure/use pvlinks.

scsimgr get_attr -a leg_mpath_enable
scsimgr set_attr -a leg_mpath_enable=0
scsimgr get_attr -a leg_mpath_enable

Thanks,
Santosh



Otero Tony
Occasional Advisor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

Hi David,

I'm in the same situation with a CX500. I have done what you mentionned (preferred path) and now it seems that the LUN is not trespassing aymore. So, the performances will probably improve.
I will probably keep the machine with that HP-UX version. That machine will be in production in September (1st) and I'm a little affraid about the possible issues I could get. Have you any information about any patch, from HP or EMC to solve this? What are you going to do: are you also going to use HP-UX 11.31 or are you going to the V2 version? I would like to keep that version, but I don't know if that is too risky...

Thanks a lot for openning that topic, because it helped me a lot.
Alzhy
Honored Contributor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

Greetings!

I am in the same boat. HDS9500V series arrays. No official support from HP nor HDS (although internal testing probably shows it is supported but..)

I followed the Libby Recipe and our dual Fibre Connected 9500Vs now work like a charm.

I use VxVM 5.0 on 11.31 which "should" support the 9500V series as an ALUA array but it does not seem to behave properly (very poor performance until the path preferencing trick above).

# vxddladm listsupport libname=libvxhdsalua.sl
ATTR_NAME ATTR_VALUE
=======================================================================
LIBNAME libvxhdsalua.sl
VID HITACHI
PID DF600, DF600-V, DF600F
DF600F-V
ARRAY_TYPE A/A-A-HDS, A/PG, A/P
A/A
ARRAY_NAME HDS9500-ALUA, AMS_WMS

Maybe "FULL" support is coming soon?
Hakuna Matata.
Alzhy
Honored Contributor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

BTW, the ASL library (aka Array Support Library) came bundled with VxVM 5.0.

On 11.11 - (VxvM 3.5) it requires a separate ASL .

Same on 11.23 (VxVM 4.1 and 5.0) -- it requires an ASL too.

What prompted me to think and to search there must be something to tweak MPIO wise was the fact that even under LVM and RAW device usage - performance was horrible -- massive queing and all...

Now we're a go go Good.

The only pain now is to go through each of the hundreds or so Hitachi 9500V LUN on my 11.31 Server (which happens to be our lone 11.31 server -- acting as the NetBackup Master). We use these 9500Vs as mirror pairs for our Tier-1 arrays that are hokked up to 11.11 HP-UX servers.


Danke ITRC once more...!

Hakuna Matata.
Duncan Edmonstone
Honored Contributor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

Nelson,

>> The only pain now is to go through each of the hundreds or so Hitachi 9500V LUN on my 11.31 Server

Ahh now you'll get a chance to see the real "beauty" of the new IO stack to make at least part of this simpler for you

What you need to do is setup a new attribute scope with scsimgr which identifies only LUNs on the HDS9500V:

Identify a suitable DDR name using scsimgr ddr_name against one of the HDS LUNs (any will do) You'll have to decide whether you do this down to just the actual array level, or down to the array and firmware level (I'd suggest just to the array level myself), but anyway compare what you get from

scsimgr ddr_name -D /dev/rdisk/diskNN vid

and

scsimgr ddr_name -D /dev/rdisk/diskNN rev

You should get something like "/escsi/esdisk/0x0/HITACHI /DF600-V /0123"

or something like that (I don't have a HDS box to test against)

Then use one of those to define the scope:

scsimgr ddr_add -N "/escsi/esdisk/0x0/HITACHI /DF600-V /0123"

Now you have a scope which will effect all objects of that type (including new ones when they're added), and you can set attributes across that scope as in:

scsimgr save_attr -N "/escsi/esdisk/0x0/HITACHI /DF600-V /0123" -a load_bal_policy="preferred_path"

However as for setting the preferred path - well do you have an easy way of detrmining programatically which lunpath should be the preferred path (is it something really simple on the HDS array like each odd lun is on one controller an each even lun is on the other???) But all I can think here is that you're going to have to script it in some way (surely doing it by hand isn't an option??)


HTH

Duncan

HTH

Duncan
Alzhy
Honored Contributor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

Duncan,

Thanks for your input man but our 11.31 server hosts 4 9500V arrays. And I did ddr_name vid and rev on a disk from each HDS array but there does not seem to be a distinguishing differentiator to identify which is HDS1 2 3 or 4.

I am still awaiting word whetehr Hitachi has something similar to "xpinfo" or "evainfo" as that would be a great help.

BTW, the 9500V seems to be recognaized as an ALUA under VxVM 5.0 (althugh Symantec does not mention official support but their curent VxVM 5.0 seem to recognize it as an ALUA array and they have libraries, not addon ASL, built in).

# vxddladm listsupport libname=libvxhdsalua.sl
ATTR_NAME ATTR_VALUE
=======================================================================
LIBNAME libvxhdsalua.sl
VID HITACHI
PID DF600, DF600-V, DF600F
DF600F-V
ARRAY_TYPE A/A-A-HDS, A/PG, A/P
A/A
ARRAY_NAME HDS9500-ALUA, AMS_WMS
Hakuna Matata.
Duncan Edmonstone
Honored Contributor

Re: HP-UX 11.31 native multi-pathing and EMC Clariion CX700...

>> Thanks for your input man but our 11.31 server hosts 4 9500V arrays. And I did ddr_name vid and rev on a disk from each HDS array but there does not seem to be a distinguishing differentiator to identify which is HDS1 2 3 or 4.

Why would you want to differentiate between the 4 arrays with respect to scsimgr commands? Are you saying they're at different firmware revs and the ddr_name command isn't picking that up?

Interestingly note that the 9500s aren't listed as supported with 11iv3 on HP's interoperability matrix:

http://www.hp.com/products1/serverconnectivity/mass_storage_devices.html#Hitachi_ds

Do HDS qualify them as supported

HTH

Duncan

PS Why the name change??

HTH

Duncan