topic Re: disk info in integrity in Integrity Servers

disk info in integrity

Charles McCary — Thu, 28 Oct 2010 14:03:41 GMT

just receieved new server rx6600 from factory. came with 16 disks, I can only see 8. could this be something to do with a controller not being configured correctly?

Re: disk info in integrity

Torsten. — Thu, 28 Oct 2010 14:39:40 GMT

This depends.

The disks are either connected to the default LSI chip or an optional P400 smartarray controller.

In case of the LSI they could be configured to form some pairs of hardware mirrors or not.

Please post

# ioscan -fn

and we can have a closer look.

Re: disk info in integrity

Charles McCary — Thu, 28 Oct 2010 14:50:27 GMT

more info....right now only one volume group on the server...vg00

# vgdisplay -v /dev/vg00
--- Volume groups ---
VG Name /dev/vg00
VG Write Access read/write
VG Status available
Max LV 255
Cur LV 8
Open LV 8
Max PV 16
Cur PV 1
Act PV 1
Max PE per PV 4466
VGDA 2
PE Size (Mbytes) 64
Total PE 4456
Alloc PE 562
Free PE 3894
Total PVG 0
Total Spare PVs 0
Total Spare PVs in use 0
VG Version 1.0
VG Max Size 4466g
VG Max Extents 71456

--- Logical volumes ---
LV Name /dev/vg00/lvol1
LV Status available/syncd
LV Size (Mbytes) 1792
Current LE 28
Allocated PE 28
Used PV 1

LV Name /dev/vg00/lvol2
LV Status available/syncd
LV Size (Mbytes) 8192
Current LE 128
Allocated PE 128
Used PV 1

LV Name /dev/vg00/lvol3
LV Status available/syncd
LV Size (Mbytes) 1024
Current LE 16
Allocated PE 16
Used PV 1

LV Name /dev/vg00/lvol4
LV Status available/syncd
LV Size (Mbytes) 512
Current LE 8
Allocated PE 8
Used PV 1

LV Name /dev/vg00/lvol5
LV Status available/syncd
LV Size (Mbytes) 128
Current LE 2
Allocated PE 2
Used PV 1

LV Name /dev/vg00/lvol6
LV Status available/syncd
LV Size (Mbytes) 9472
Current LE 148
Allocated PE 148
Used PV 1

LV Name /dev/vg00/lvol7
LV Status available/syncd
LV Size (Mbytes) 6144
Current LE 96
Allocated PE 96
Used PV 1

LV Name /dev/vg00/lvol8
LV Status available/syncd
LV Size (Mbytes) 8704
Current LE 136
Allocated PE 136
Used PV 1

--- Physical volumes ---
PV Name /dev/disk/disk14_p2
PV Status available
Total PE 4456
Free PE 3894
Autoswitch On
Proactive Polling On

Here's the physical drives reported by ioscan

# ioscan -fnC disk
Class I H/W Path Driver S/W State H/W Type Description
=====================================================================
disk 1 0/4/1/0.0.0.0.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t0d0 /dev/rdsk/c1t0d0
disk 8 0/4/1/0.0.0.1.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t1d0 /dev/rdsk/c1t1d0
disk 3 0/4/1/0.0.0.2.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t2d0 /dev/rdsk/c1t2d0
disk 6 0/4/1/0.0.0.3.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t3d0 /dev/rdsk/c1t3d0
disk 5 0/4/1/0.0.0.4.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t4d0 /dev/rdsk/c1t4d0
disk 2 0/4/1/0.0.0.5.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t5d0 /dev/rdsk/c1t5d0
disk 7 0/4/1/0.0.0.6.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t6d0 /dev/rdsk/c1t6d0
disk 4 0/4/1/0.0.0.7.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t7d0 /dev/dsk/c1t7d0s2 /dev/rdsk/c1t7d0 /dev/rdsk/c1t7d0s2
/dev/dsk/c1t7d0s1 /dev/dsk/c1t7d0s3 /dev/rdsk/c1t7d0s1 /dev/rdsk/c1t7d0s3
disk 0 0/6/0/0/0/0/4/0/0/0.0.0 sdisk CLAIMED DEVICE HP LOGICAL VOLUME
/dev/dsk/c0t0d0 /dev/rdsk/c0t0d0
disk 18 255/1/0.0.0 sdisk CLAIMED DEVICE Optiarc DVD RW AD-5590A
/dev/dsk/c2t0d0 /dev/rdsk/c2t0d0

Here's the drives with ioscan -m

# ioscan -m dsf
Persistent DSF Legacy DSF(s)
========================================
/dev/pt/pt3 /dev/rscsi/c3t0d0
/dev/pt/pt4 /dev/rscsi/c4t0d0
/dev/rdisk/disk9 /dev/rdsk/c0t0d0
/dev/rdisk/disk10 /dev/rdsk/c1t6d0
/dev/rdisk/disk11 /dev/rdsk/c1t5d0
/dev/rdisk/disk12 /dev/rdsk/c1t0d0
/dev/rdisk/disk13 /dev/rdsk/c1t2d0
/dev/rdisk/disk14 /dev/rdsk/c1t7d0
/dev/rdisk/disk14_p1 /dev/rdsk/c1t7d0s1
/dev/rdisk/disk14_p2 /dev/rdsk/c1t7d0s2
/dev/rdisk/disk14_p3 /dev/rdsk/c1t7d0s3
/dev/rdisk/disk15 /dev/rdsk/c1t3d0
/dev/rdisk/disk16 /dev/rdsk/c1t4d0
/dev/rdisk/disk17 /dev/rdsk/c1t1d0
/dev/rdisk/disk19 /dev/rdsk/c2t0d0

Re: disk info in integrity

Torsten. — Thu, 28 Oct 2010 14:55:51 GMT

Please post

# ioscan -fn

I want to see the controllers.

Re: disk info in integrity

Charles McCary — Thu, 28 Oct 2010 14:56:24 GMT

# ioscan -fn
Class I H/W Path Driver S/W State H/W Type Description
=================================================================================
root 0 root CLAIMED BUS_NEXUS
ioa 0 0 sba CLAIMED BUS_NEXUS System Bus Adapter (4030)
ba 0 0/0 lba CLAIMED BUS_NEXUS Local PCI-X Bus Adapter (122e)
tty 0 0/0/1/0 rmp3f01 CLAIMED INTERFACE PCI class(255,0) (103c1303)
tty 1 0/0/1/1 rmp3f01 CLAIMED INTERFACE PCI SimpleComm (103c1302)
tty 2 0/0/1/2 asio0 CLAIMED INTERFACE PCI Serial (103c1048)
/dev/diag/mux2 /dev/mux2 /dev/tty2p0
usb 0 0/0/2/0 hcd CLAIMED INTERFACE NEC OHCI Controller
usbcomp 0 0/0/2/0.1 usbcomposite CLAIMED DEVICE USB Composite Device
usbhid 0 0/0/2/0.1.0 hid CLAIMED DEVICE USB HID Kbd(0)
/dev/hid/hid_000
usbhid 1 0/0/2/0.1.1 hid CLAIMED DEVICE USB HID Pointer(1)
/dev/hid/hid_001
usb 1 0/0/2/1 hcd CLAIMED INTERFACE NEC OHCI Controller
usb 2 0/0/2/2 ehci CLAIMED INTERFACE NEC EHCI Controller
usbms 0 0/0/2/2.2 ms CLAIMED DEVICE USB Mass Storage [0]
graphics 0 0/0/4/0 gvid_core CLAIMED INTERFACE PCI Display (10025159)
ba 1 0/1 lba CLAIMED BUS_NEXUS Local PCI-X Bus Adapter (122e)
slot 0 0/1/1 pci_slot CLAIMED SLOT PCI Slot
slot 1 0/1/2 pci_slot CLAIMED SLOT PCI Slot
ba 2 0/2 lba CLAIMED BUS_NEXUS Local PCI-X Bus Adapter (122e)
slot 2 0/2/1 pci_slot CLAIMED SLOT PCI Slot
ba 3 0/3 gh2p CLAIMED BUS_NEXUS Local Bus Adapter
ba 4 0/3/0/0 PCItoPCI CLAIMED BUS_NEXUS PCItoPCI Bridge
slot 3 0/3/0/0/0 pci_slot CLAIMED SLOT PCI Slot
ba 5 0/3/0/0/0/0 PCItoPCI CLAIMED BUS_NEXUS PCItoPCI Bridge
ba 6 0/3/0/0/0/0/2/0 PCItoPCI CLAIMED BUS_NEXUS PCItoPCI Bridge
lan 0 0/3/0/0/0/0/2/0/0/0 iether CLAIMED INTERFACE HP AD221-60001 PCIe 1000Base-T 4Gb FC/1000B-T Combo Adapter
ba 7 0/3/0/0/0/0/4/0 PCItoPCI CLAIMED BUS_NEXUS PCItoPCI Bridge
fc 0 0/3/0/0/0/0/4/0/0/0 fclp CLAIMED INTERFACE HP AD221-60001 PCIe Fibre Channel 1-port 4Gb FC/1-port 1000B-T Combo Adapter
/dev/fclp0
fcp 0 0/3/0/0/0/0/4/0/0/0.8 fclp_fcp CLAIMED INTERFACE FCP Protocol Adapter
ext_bus 3 0/3/0/0/0/0/4/0/0/0.8.0.255.0 fclp_vbus CLAIMED INTERFACE FCP Device Interface
target 9 0/3/0/0/0/0/4/0/0/0.8.0.255.0.0 tgt CLAIMED DEVICE
ctl 1 0/3/0/0/0/0/4/0/0/0.8.0.255.0.0.0 sctl CLAIMED DEVICE HP P2000 G3 FC
/dev/rscsi/c3t0d0
ba 8 0/4 lba CLAIMED BUS_NEXUS Local PCI-X Bus Adapter (122e)
slot 4 0/4/1 pci_slot CLAIMED SLOT PCI Slot
escsi_ctlr 1 0/4/1/0 sasd CLAIMED INTERFACE HP PCI/PCI-X SAS MPT Adapter
/dev/sasd1
ext_bus 1 0/4/1/0.0.0 sasd_vbus CLAIMED INTERFACE SAS Device Interface
target 3 0/4/1/0.0.0.0 tgt CLAIMED DEVICE
disk 1 0/4/1/0.0.0.0.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t0d0 /dev/rdsk/c1t0d0
target 8 0/4/1/0.0.0.1 tgt CLAIMED DEVICE
disk 8 0/4/1/0.0.0.1.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t1d0 /dev/rdsk/c1t1d0
target 4 0/4/1/0.0.0.2 tgt CLAIMED DEVICE
disk 3 0/4/1/0.0.0.2.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t2d0 /dev/rdsk/c1t2d0
target 6 0/4/1/0.0.0.3 tgt CLAIMED DEVICE
disk 6 0/4/1/0.0.0.3.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t3d0 /dev/rdsk/c1t3d0
target 7 0/4/1/0.0.0.4 tgt CLAIMED DEVICE
disk 5 0/4/1/0.0.0.4.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t4d0 /dev/rdsk/c1t4d0
target 2 0/4/1/0.0.0.5 tgt CLAIMED DEVICE
disk 2 0/4/1/0.0.0.5.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t5d0 /dev/rdsk/c1t5d0
target 1 0/4/1/0.0.0.6 tgt CLAIMED DEVICE
disk 7 0/4/1/0.0.0.6.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t6d0 /dev/rdsk/c1t6d0
target 5 0/4/1/0.0.0.7 tgt CLAIMED DEVICE
disk 4 0/4/1/0.0.0.7.0 sdisk CLAIMED DEVICE HP DG0300FARVV
/dev/dsk/c1t7d0 /dev/dsk/c1t7d0s2 /dev/rdsk/c1t7d0 /dev/rdsk/c1t7d0s2
/dev/dsk/c1t7d0s1 /dev/dsk/c1t7d0s3 /dev/rdsk/c1t7d0s1 /dev/rdsk/c1t7d0s3
slot 5 0/4/2 pci_slot CLAIMED SLOT PCI Slot
lan 1 0/4/2/0 iether CLAIMED INTERFACE HP AB352-60003 PCI/PCI-X 1000Base-T Dual-port Core
lan 2 0/4/2/1 iether CLAIMED INTERFACE HP AB352-60003 PCI/PCI-X 1000Base-T Dual-port Core
ba 9 0/5 lba CLAIMED BUS_NEXUS Local PCI-X Bus Adapter (122e)
slot 6 0/5/1 pci_slot CLAIMED SLOT PCI Slot
ba 10 0/6 gh2p CLAIMED BUS_NEXUS Local Bus Adapter
ba 11 0/6/0/0 PCItoPCI CLAIMED BUS_NEXUS PCItoPCI Bridge
ba 12 0/6/0/0/0/0 PCItoPCI CLAIMED BUS_NEXUS PCItoPCI Bridge
ba 13 0/6/0/0/0/0/2/0 PCItoPCI CLAIMED BUS_NEXUS PCItoPCI Bridge
slot 7 0/6/0/0/0/0/2/0/0 pci_slot CLAIMED SLOT PCI Slot
ba 14 0/6/0/0/0/0/4/0 PCItoPCI CLAIMED BUS_NEXUS PCItoPCI Bridge
slot 8 0/6/0/0/0/0/4/0/0 pci_slot CLAIMED SLOT PCI Slot
ext_bus 0 0/6/0/0/0/0/4/0/0/0 ciss CLAIMED INTERFACE PCIe SAS SmartArray P400 RAID Controller
/dev/ciss0
target 0 0/6/0/0/0/0/4/0/0/0.0 tgt CLAIMED DEVICE
disk 0 0/6/0/0/0/0/4/0/0/0.0.0 sdisk CLAIMED DEVICE HP LOGICAL VOLUME
/dev/dsk/c0t0d0 /dev/rdsk/c0t0d0
ba 15 0/7 gh2p CLAIMED BUS_NEXUS Local Bus Adapter
ba 16 0/7/0/0 PCItoPCI CLAIMED BUS_NEXUS PCItoPCI Bridge
slot 9 0/7/0/0/0 pci_slot CLAIMED SLOT PCI Slot
ba 17 0/7/0/0/0/0 PCItoPCI CLAIMED BUS_NEXUS PCItoPCI Bridge
ba 18 0/7/0/0/0/0/2/0 PCItoPCI CLAIMED BUS_NEXUS PCItoPCI Bridge
lan 3 0/7/0/0/0/0/2/0/0/0 iether CLAIMED INTERFACE HP AD221-60001 PCIe 1000Base-T 4Gb FC/1000B-T Combo Adapter
ba 19 0/7/0/0/0/0/4/0 PCItoPCI CLAIMED BUS_NEXUS PCItoPCI Bridge
fc 1 0/7/0/0/0/0/4/0/0/0 fclp CLAIMED INTERFACE HP AD221-60001 PCIe Fibre Channel 1-port 4Gb FC/1-port 1000B-T Combo Adapter
/dev/fclp1
fcp 1 0/7/0/0/0/0/4/0/0/0.8 fclp_fcp CLAIMED INTERFACE FCP Protocol Adapter
ext_bus 4 0/7/0/0/0/0/4/0/0/0.8.0.255.0 fclp_vbus CLAIMED INTERFACE FCP Device Interface
target 10 0/7/0/0/0/0/4/0/0/0.8.0.255.0.0 tgt CLAIMED DEVICE
ctl 2 0/7/0/0/0/0/4/0/0/0.8.0.255.0.0.0 sctl CLAIMED DEVICE HP P2000 G3 FC
/dev/rscsi/c4t0d0
processor 0 120 processor CLAIMED PROCESSOR Processor
processor 1 121 processor CLAIMED PROCESSOR Processor
processor 2 122 processor CLAIMED PROCESSOR Processor
processor 3 123 processor CLAIMED PROCESSOR Processor
processor 4 124 processor CLAIMED PROCESSOR Processor
processor 5 125 processor CLAIMED PROCESSOR Processor
processor 6 126 processor CLAIMED PROCESSOR Processor
processor 7 127 processor CLAIMED PROCESSOR Processor
ba 20 250 pdh CLAIMED BUS_NEXUS Core I/O Adapter
ipmi 0 250/0 ipmi CLAIMED INTERFACE IPMI Controller
/dev/ipmi
tty 3 250/1 asio0 CLAIMED INTERFACE Built-in RS232C
/dev/diag/mux3 /dev/mux3 /dev/tty3p0
acpi_node 0 250/2 acpi_node CLAIMED INTERFACE Acpi Hardware
usbmsvbus 1 255/1 mass_storage CLAIMED VIRTBUS USB Mass Storage
ext_bus 2 255/1/0 usb_ms_scsi CLAIMED INTERFACE USB Mass Storage SCSI
target 11 255/1/0.0 tgt CLAIMED DEVICE
disk 18 255/1/0.0.0 sdisk CLAIMED DEVICE Optiarc DVD RW AD-5590A
/dev/dsk/c2t0d0 /dev/rdsk/c2t0d0

Re: disk info in integrity

Charles McCary — Thu, 28 Oct 2010 18:27:34 GMT

So after looking at this today, I've made some assumptions:

1) The following disks shown in ioscan are physical drives that I can use.
disk 10 64000/0xfa00/0x2 esdisk CLAIMED DEVICE HP DG0300FARVV
/dev/disk/disk10 /dev/rdisk/disk10
disk 11 64000/0xfa00/0x3 esdisk CLAIMED DEVICE HP DG0300FARVV
/dev/disk/disk11 /dev/rdisk/disk11
disk 12 64000/0xfa00/0x4 esdisk CLAIMED DEVICE HP DG0300FARVV
/dev/disk/disk12 /dev/rdisk/disk12
disk 13 64000/0xfa00/0x5 esdisk CLAIMED DEVICE HP DG0300FARVV
/dev/disk/disk13 /dev/rdisk/disk13
disk 14 64000/0xfa00/0x6 esdisk CLAIMED DEVICE HP DG0300FARVV
/dev/disk/disk14 /dev/disk/disk14_p2 /dev/rdisk/disk14 /dev/rdisk/disk14_p2
/dev/disk/disk14_p1 /dev/disk/disk14_p3 /dev/rdisk/disk14_p1 /dev/rdisk/disk14_p3
disk 15 64000/0xfa00/0x7 esdisk CLAIMED DEVICE HP DG0300FARVV
/dev/disk/disk15 /dev/rdisk/disk15
disk 16 64000/0xfa00/0x8 esdisk CLAIMED DEVICE HP DG0300FARVV
/dev/disk/disk16 /dev/rdisk/disk16
disk 17 64000/0xfa00/0x9 esdisk CLAIMED DEVICE HP DG0300FARVV
/dev/disk/disk17 /dev/rdisk/disk17

Disk 14 is already used by vg00 and it's partitioned. Why did the factory partition this disk vs. using the entire disk?

This disk:
disk 9 64000/0xfa00/0x1 esdisk CLAIMED DEVICE HP LOGICAL VOLUME
/dev/disk/disk9 /dev/rdisk/disk9

is a RAID disk. Here's more info on the disks that are part of the smart array controller.

# saconfig /dev/ciss0

******************** SmartArray RAID Controller /dev/ciss0 ********************

Auto-Fail Missing Disks at Boot = disabled
Cache Configuration Status = cache enabled
Cache Ratio = 25% Read / 75% Write

---------- PHYSICAL DRIVES ----------

Location Ct Enc Bay WWID Size Status

Internal 1I 1 12 0x5000cca00acca73d 300.0 GB OK
Internal 1I 1 11 0x5000cca00ad2136d 300.0 GB OK
Internal 1I 1 10 0x5000cca00acd27e5 300.0 GB UNASSIGNED
Internal 1I 1 9 0x5000cca00ace4e9d 300.0 GB UNASSIGNED
Internal 2I 1 16 0x5000cca00aceae59 300.0 GB UNASSIGNED
Internal 2I 1 15 0x5000cca00ad54bc9 300.0 GB UNASSIGNED
Internal 2I 1 14 0x5000cca00ace8c39 300.0 GB UNASSIGNED
Internal 2I 1 13 0x5000cca00ad66da1 300.0 GB UNASSIGNED

---------- LOGICAL DRIVE 0 ----------

Device File = /dev/dsk/c0t0d0
RAID Level = 1+0
Size = 286063 MB
Stripe Size = 128 KB
Status = OK

Participating Physical Drive(s):

Ct Enc Bay WWID
1I 1 12 0x5000cca00acca73d
1I 1 11 0x5000cca00ad2136d

Participating Spare Drive(s):

None

Question, why did the factory build a single smart array raid disk?

Are my assumptions correct in that I can use the physical drives for whatever I wish, but that I can't add them into the RAID config?

Re: disk info in integrity

Torsten. — Fri, 29 Oct 2010 04:33:27 GMT

As you already know there are disks connected to the default controller, the remaining disks are connected to the P400.

The 3 partitions on the boot disk are normal and needed (EFI/HPUX/service partition).

Re: disk info in integrity

Torsten. — Fri, 29 Oct 2010 05:50:20 GMT

>> Are my assumptions correct in that I can use the physical drives for whatever I wish, but that I can't add them into the RAID config?

You can built 2 pairs of hardware mirrored disks for the default LSI controller (/dev/sasd_).

Re: disk info in integrity

Charles McCary — Fri, 29 Oct 2010 11:25:29 GMT

Thanks!