Integrity Servers
cancel
Showing results for 
Search instead for 
Did you mean: 

rx6600 SAS devices

 
Fadia Almarei
Super Advisor

rx6600 SAS devices

Dear All
i hvae rx600 server with HP-UX 11.23, the server have the two sas enclosures with 8 pays in each, i have two issues
1- in the first enclosure i have a problem in one of the pays that when i put any disk on it , it not works i can not see it from the system
2- if i put any disk on the secound enclosure on any of the 8 pasys it will not apear
this the output from sasmgr
# sasmgr get_info -D /dev/sasd0 -q phy=all

Sun Apr 12 11:14:29 2009

Info for PHY ID : 0
PHY Health : UP
Port SAS Address : 0x500605b0007a63c0
Attached SAS Address : 0x5000c500082f8e2d
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 1
PHY Health : UP
Port SAS Address : 0x500605b0007a63c1
Attached SAS Address : 0x5000c500082fe741
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 2
PHY Health : UP
Port SAS Address : 0x500605b0007a63c2
Attached SAS Address : 0x5000c500082cfe49
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 3
PHY Health : UP
Port SAS Address : 0x500605b0007a63c3
Attached SAS Address : 0x5000c500082fa651
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 4
PHY Health : UP
Port SAS Address : 0x500605b0007a63c4
Attached SAS Address : 0x5000c5000fc66479
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 5
PHY Health : UP
Port SAS Address : 0x500605b0007a63c5
Attached SAS Address : 0x5000c5000fbea2cd
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 6
PHY Health : UP
Port SAS Address : 0x500605b0007a63c6
Attached SAS Address : 0x5000c5000f60eb4d
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 7
PHY Health : UP
Port SAS Address : 0x500605b0007a63c7
Attached SAS Address : 0x5000c5000f63029d
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps
#

so what is the problem and how to solve it
fadia.marei
21 REPLIES 21
TTr
Honored Contributor

Re: rx6600 SAS devices

For problem #1 you need to use the sasmgr command. Look at http://forums11.itrc.hp.com/service/forums/questionanswer.do?threadId=1304308 or search for sasmgr in this forum. The sas disk have a special procedure for replacing disks.
For problem #2 the second set of 8 internal bays is wired separately than the first and you have to have purchased an additional P400 SAS RAID controller in slot #4 to be able to use disks. Does your server have a second controller? Check with ioscan and look for controllers or SAS adapters.
http://h18000.www1.hp.com/products/quickspecs/12596_div/12596_div.HTML
Fadia Almarei
Super Advisor

Re: rx6600 SAS devices

Dear

for the second casewe do not have the second SAS controller ,
but for the first case it not a replacement for the disk , i can not see the disk at all .
so kindly advice
fadia.marei
TTr
Honored Contributor

Re: rx6600 SAS devices

All disks show up fine on the controller side. What kind of controller is it? If the disk does not show upt on the server side maybe the controller is using it as part of a RAID group or a hot spare.
Check the logical disk status using various "-q" options with the sasmagr. Also look at the "replace_tgt" option.
It may be a bay issue as well, if you have HP support ask them to check it out.
Fadia Almarei
Super Advisor

Re: rx6600 SAS devices

this is ehat i have
the disks that i can not say in slot 5 , i can not see it from ioscan or sam


# sasmgr get_info -D /dev/sasd0 -q phy=all

Tue Apr 14 16:16:30 2009

Info for PHY ID : 0
PHY Health : UP
Port SAS Address : 0x500605b0007a63c0
Attached SAS Address : 0x5000c500082f8e2d
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 1
PHY Health : UP
Port SAS Address : 0x500605b0007a63c1
Attached SAS Address : 0x5000c500082fe741
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 2
PHY Health : UP
Port SAS Address : 0x500605b0007a63c2
Attached SAS Address : 0x5000c500082cfe49
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

...skipping...

Tue Apr 14 16:16:30 2009

Info for PHY ID : 0
PHY Health : UP
Port SAS Address : 0x500605b0007a63c0
Attached SAS Address : 0x5000c500082f8e2d
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 1
PHY Health : UP
Port SAS Address : 0x500605b0007a63c1
Attached SAS Address : 0x5000c500082fe741
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 2
PHY Health : UP
Port SAS Address : 0x500605b0007a63c2
Attached SAS Address : 0x5000c500082cfe49
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 3
PHY Health : UP
Port SAS Address : 0x500605b0007a63c3
Attached SAS Address : 0x5000c500082fa651
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 4
PHY Health : UP
Port SAS Address : 0x500605b0007a63c4
Attached SAS Address : 0x5000c5000fc66479
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 5
PHY Health : UP
Port SAS Address : 0x500605b0007a63c5
Attached SAS Address : 0x5000c5000fbea2cd
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 6
PHY Health : UP
Port SAS Address : 0x500605b0007a63c6
Attached SAS Address : 0x5000c5000f60eb4d
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps

Info for PHY ID : 7
PHY Health : UP
Port SAS Address : 0x500605b0007a63c7
Attached SAS Address : 0x5000c5000f63029d
Current Link Rate : 3 Gbps
Max Link Rate : 3 Gbps
fadia.marei
Torsten.
Acclaimed Contributor

Re: rx6600 SAS devices

Can you please post

# sasmgr get_info -D /dev/sasd0 -q raid=all

# ioscan -fn

Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
Torsten.
Acclaimed Contributor

Re: rx6600 SAS devices

and some more

# saslist get_info ctrl sasd

# saslist get_info lun sasd


Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
Fadia Almarei
Super Advisor

Re: rx6600 SAS devices

i have many devices in the SAN and in the local
this raid controller is applicable only for Raid1 so i have 2 Raid 1 with 4 disks
fadia.marei
Torsten.
Acclaimed Contributor

Re: rx6600 SAS devices

Solved?

Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
Fadia Almarei
Super Advisor

Re: rx6600 SAS devices

# saslist get_info lun sasd
HBA device file: /dev/sasd0
-----------------------------

LUN dsf Hardware Path SAS Address
------------------------------------------------------------------
/dev/rdsk/c1t0d0 0/4/1/0.0.0.0.0 0x850de8ed7e859ae
/dev/rdsk/c1t1d0 0/4/1/0.0.0.1.0 0x4c2926bf459edf3
/dev/rdsk/c1t2d0 0/4/1/0.0.0.2.0 0x5000c5000fbea2cd
/dev/rdsk/c1t3d0 0/4/1/0.0.0.3.0 0x5000c5000fc66479
/dev/rdsk/c1t4d0 0/4/1/0.0.0.4.0 0x5000c5000f60eb4d


# saslist get_info ctrl sasd
H/W Path: 0/4/1/0 HBA DSF: /dev/sasd0
fadia.marei
Fadia Almarei
Super Advisor

Re: rx6600 SAS devices

no nothing solved.
i can not see the disk on slot5
fadia.marei
Torsten.
Acclaimed Contributor

Re: rx6600 SAS devices

>>Can you please post

# sasmgr get_info -D /dev/sasd0 -q raid=all

# ioscan -fn

Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
Fadia Almarei
Super Advisor

Re: rx6600 SAS devices

# sasmgr get_info -D /dev/sasd0 -q raid=all

Tue Apr 14 16:40:46 2009

---------- PHYSICAL DRIVES ----------
LUN dsf SAS Address Enclosure Bay Size(MB)

/dev/rdsk/c1t2d0 0x5000c5000fbea2cd 1 7 140014
/dev/rdsk/c1t3d0 0x5000c5000fc66479 1 8 140014
/dev/rdsk/c1t4d0 0x5000c5000f60eb4d 1 6 140014

---------- LOGICAL DRIVE 3 ----------

Raid Level : RAID 1
Volume sas address : 0x4c2926bf459edf3
Device Special File : /dev/rdsk/c1t1d0
Raid State : OPTIMAL
Raid Status Flag : ENABLED
Raid Size : 139236
Rebuild Rate : 0.00 %
Rebuild Progress : 100.00 %

Participating Physical Drive(s) :

SAS Address Enc Bay Size(MB) Type State
...skipping...

Tue Apr 14 16:40:46 2009

---------- PHYSICAL DRIVES ----------
LUN dsf SAS Address Enclosure Bay Size(MB)

/dev/rdsk/c1t2d0 0x5000c5000fbea2cd 1 7 140014
/dev/rdsk/c1t3d0 0x5000c5000fc66479 1 8 140014
/dev/rdsk/c1t4d0 0x5000c5000f60eb4d 1 6 140014

---------- LOGICAL DRIVE 3 ----------

Raid Level : RAID 1
Volume sas address : 0x4c2926bf459edf3
Device Special File : /dev/rdsk/c1t1d0
Raid State : OPTIMAL
Raid Status Flag : ENABLED
Raid Size : 139236
Rebuild Rate : 0.00 %
Rebuild Progress : 100.00 %

Participating Physical Drive(s) :

SAS Address Enc Bay Size(MB) Type State

0x5000c500082f8e2d 1 4 140014 SECONDARY ONLINE
0x5000c500082fe741 1 3 140014 PRIMARY ONLINE

---------- LOGICAL DRIVE 5 ----------

Raid Level : RAID 1
Volume sas address : 0x850de8ed7e859ae
Device Special File : /dev/rdsk/c1t0d0
Raid State : OPTIMAL
Raid Status Flag : ENABLED
Raid Size : 139898
Rebuild Rate : 0.00 %
Rebuild Progress : 100.00 %

Participating Physical Drive(s) :

SAS Address Enc Bay Size(MB) Type State

0x5000c500082fa651 1 1 140014 PRIMARY ONLINE
0x5000c500082cfe49 1 2 140014 SECONDARY ONLINE

disk 1 0/4/1/0.0.0.0.0 sdisk SCAN DEVICE
HP IR Volume
/dev/dsk/c1t0d0 /dev/rdsk/c1t0d0
/dev/dsk/c1t0d0s1 /dev/rdsk/c1t0d0s1
/dev/dsk/c1t0d0s2 /dev/rdsk/c1t0d0s2
/dev/dsk/c1t0d0s3 /dev/rdsk/c1t0d0s3
disk 73 0/4/1/0.0.0.1.0 sdisk SCAN DEVICE
HP IR Volume
/dev/dsk/c1t1d0 /dev/rdsk/c1t1d0
/dev/dsk/c1t1d0s1 /dev/rdsk/c1t1d0s1
/dev/dsk/c1t1d0s2 /dev/rdsk/c1t1d0s2
/dev/dsk/c1t1d0s3 /dev/rdsk/c1t1d0s3
disk 74 0/4/1/0.0.0.2.0 sdisk SCAN DEVICE
HP DG146BB976
/dev/dsk/c1t2d0 /dev/rdsk/c1t2d0
disk 75 0/4/1/0.0.0.3.0 sdisk SCAN DEVICE
HP DG146BB976
/dev/dsk/c1t3d0 /dev/rdsk/c1t3d0
disk 76 0/4/1/0.0.0.4.0 sdisk SCAN DEVICE
HP DG146BB976
/dev/dsk/c1t4d0 /dev/rdsk/c1t4d0


fadia.marei
Torsten.
Acclaimed Contributor

Re: rx6600 SAS devices

Did you insert the "...skipping..." for LD 3?

What is the output?

Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
Fadia Almarei
Super Advisor

Re: rx6600 SAS devices

what do you meen ?
fadia.marei
TTr
Honored Contributor

Re: rx6600 SAS devices

> what do you meen ?

Your previous output might not be complete.

In any case, the disk in slot 5 ends in SAS-ID a2:cd and it shows up as /dev/dsk/c1t2d0, why do you say it does not show up?

The disk I can not account for is the disk in bay 7 with SAS-ID 02:9d. It does not show up as a stanalone disk and neither it is part of a logical drive.

Did you swap the disks in bay 5 and 7? Post a complete output of "sasmgr get_info -D /dev/sasd0 -q raid=all"

It looks like you have the 8-port default SAS controller where you can only define 2 mirrored pairs and one hot spare (5 disks). The remaining 3 disks are passthrough and as seen by the server as standalone disks.
Fadia Almarei
Super Advisor

Re: rx6600 SAS devices

sorry, this isthe output




Wed Apr 15 11:21:40 2009

---------- PHYSICAL DRIVES ----------
LUN dsf SAS Address Enclosure Bay Size(MB)

/dev/rdsk/c1t2d0 0x5000c5000fbea2cd 1 7 140014
/dev/rdsk/c1t3d0 0x5000c5000fc66479 1 8 140014
/dev/rdsk/c1t4d0 0x5000c5000f60eb4d 1 6 140014

---------- LOGICAL DRIVE 3 ----------

Raid Level : RAID 1
Volume sas address : 0x4c2926bf459edf3
Device Special File : /dev/rdsk/c1t1d0
Raid State : OPTIMAL
Raid Status Flag : ENABLED
Raid Size : 139236
Rebuild Rate : 0.00 %
Rebuild Progress : 100.00 %

Participating Physical Drive(s) :

SAS Address Enc Bay Size(MB) Type State

0x5000c500082f8e2d 1 4 140014 SECONDARY ONLINE
0x5000c500082fe741 1 3 140014 PRIMARY ONLINE

---------- LOGICAL DRIVE 5 ----------

Raid Level : RAID 1
Volume sas address : 0x850de8ed7e859ae
Device Special File : /dev/rdsk/c1t0d0
Raid State : OPTIMAL
Raid Status Flag : ENABLED
Raid Size : 139898
Rebuild Rate : 0.00 %
Rebuild Progress : 100.00 %

Participating Physical Drive(s) :

SAS Address Enc Bay Size(MB) Type State

0x5000c500082fa651 1 1 140014 PRIMARY ONLINE
0x5000c500082cfe49 1 2 140014 SECONDARY ONLINE

#


but for the bays i was mistake, i count the disks from the server side it is found on bay 5 , but in this coomand it start counting from 0 so it will be number 4
fadia.marei
Torsten.
Acclaimed Contributor

Re: rx6600 SAS devices

Maybe you have a bad disk ... ?

Let's try this:

# sasmgr get_info -D Dev/sas0 -q target=all

BTW, any LED activity on all disks?

Hope this helps!
Regards
Torsten.

__________________________________________________
There are only 10 types of people in the world -
those who understand binary, and those who don't.

__________________________________________________
No support by private messages. Please ask the forum!

If you feel this was helpful please click the KUDOS! thumb below!   
Fadia Almarei
Super Advisor

Re: rx6600 SAS devices

no it is not failed, i try to put it on another server and it works, and even in another slot and it also work, the problem that i can not see this device as /dev/dsk/cxtxdx ,so i can not deal of it any way
fadia.marei
Fadia Almarei
Super Advisor

Re: rx6600 SAS devices

this is the output

Wed Apr 15 15:32:23 2009

Target SAS Address : 0x4c2926bf459edf3
Target Health : ONLINE
IPort SAS Address : None
Previous IPort SAS Address : 0x0
Target Type : RAID Device
Target Topology : DIRECT
Protocol Capability of Target : SSP
Target Slot : 0xffff
Target Enclosure ID : 0xfc1e20000000000
Target Enclosure Type : UNKNOWN

Target SAS Address : 0x850de8ed7e859ae
Target Health : ONLINE
IPort SAS Address : None
Previous IPort SAS Address : 0x0
Target Type : RAID Device
Target Topology : DIRECT
Protocol Capability of Target : SSP
Target Slot : 0xffff
Target Enclosure ID : 0xfc1e20000000000
Target Enclosure Type : UNKNOWN

Target SAS Address : 0x5000c5000fbea2cd
Target Health : ONLINE
IPort SAS Address : 0x500605b0007a63c5
Previous IPort SAS Address : 0x0
Target Type : SCSI Device
Target Topology : DIRECT
Protocol Capability of Target : SSP
Target Slot : 0x7
Target Enclosure ID : 0x1
Target Enclosure Type : Direct Attached SGPIO

Target SAS Address : 0x5000c5000fc66479
Target Health : ONLINE
IPort SAS Address : 0x500605b0007a63c4
Previous IPort SAS Address : 0x0
Target Type : SCSI Device
Target Topology : DIRECT
Protocol Capability of Target : SSP
Target Slot : 0x8
Target Enclosure ID : 0x1
Target Enclosure Type : Direct Attached SGPIO

Target SAS Address : 0x5000c5000f60eb4d
Target Health : ONLINE
IPort SAS Address : 0x500605b0007a63c6
Previous IPort SAS Address : 0x0
Target Type : SCSI Device
Target Topology : DIRECT
Protocol Capability of Target : SSP
Target Slot : 0x6
Target Enclosure ID : 0x1
Target Enclosure Type : Direct Attached SGPIO

Target SAS Address : 0x5000c5000f63029d
Target Health : ONLINE
IPort SAS Address : 0x500605b0007a63c7
Previous IPort SAS Address : 0x0
Target Type : SCSI Device
Target Topology : DIRECT
Protocol Capability of Target : SSP
Target Slot : 0x5
Target Enclosure ID : 0x1
Target Enclosure Type : Direct Attached SGPIO

*********************************************************************
***** HBA Specific information *****
*********************************************************************
Information for target (0x4c2926bf459edf3)
Target State : READY

Information for target (0x850de8ed7e859ae)
Target State : READY

Information for target (0x5000c5000fbea2cd)
Target State : READY

Information for target (0x5000c5000fc66479)
Target State : READY

Information for target (0x5000c5000f60eb4d)
Target State : READY

Information for target (0x5000c5000f63029d)
Target State : READY
fadia.marei
TTr
Honored Contributor

Re: rx6600 SAS devices

In your last "sasmgr...-q raid=all" listing the disks are as follows ( I only write the last 4 digits of their "sas address"

a2cd, bay7, standalone
6479, bay8, standalone
eb4d, bay6, standalone

8e2d, bay4, Logicaldrive3
e741, bay3, Logicaldrive3

a651, bay1, Logicaldrive5
fe49, bay2, Logicaldrive5

The missing disk is shown in the last listing (sasmgr...-q target=all)

029d, bay5, missing!

It shows up as "Target Health : ONLINE" and "Target State : READY" so there is nothing wrong with the disk or the enclosure bay.

Did you possibly leave out the "GLOBAL SPARE DRIVES" section from the sasmgr listing above?
Or is it possible your sasmgr version does not show the global spare drives?
As I said before this might be your global spare, you may want to run the following command
sasmgr delete -D /dev/sas0 -q raid -q spare

and then check again with ioscan.
Fadia Almarei
Super Advisor

Re: rx6600 SAS devices

sorry for the delay to answer, that i can not test the server any time, but when i try the command i get the following error

# sasmgr delete -D /dev/sasd0 -q raid -q spare

WARNING: This is a DESTRUCTIVE operation.
This might result in failure of current I/O requests.
Do you want to continue ?(y/n) [n]...
ERROR: Unable to delete the spare drive: Invalid argument
fadia.marei