Intergrity SX2000 SD64B PCI slot speed

[Aneesh Mohan]

Hi ,

PLease let me know the maximum data transfer rate supported in the SD64B PCI-X slots.

I can see speed column in olrad o/p , but it is in Mhz , How I can get in MB/Sec for each slots .


fyi:-

[Complex]
Complex Name : Complex 01
Complex Capacity
Compute Cabinet (8 cell capable) : 2
IO Expansion Cabinet : 1
Active MP Location : cabinet 0
Original Product Name : superdome server SD64B
Original Serial Number : DEH47265KE
Current Product Order Number : A9834A
OEM Manufacturer :
Complex Profile Revision : 1.0
The total number of partitions present : 9
GSM sharing : Disabled Complex-wide

> olrad -q
Driver(s)
Capable
Slot Path Bus Max Spd Pwr Occu Susp OLAR OLD Max Mode
Num Spd Mode
8-0-3-0 3/0/0/1 12288 133 133 Off No N/A N/A N/A PCI-X PCI-X
8-0-3-1 3/0/1/1 12544 133 133 On Yes No Yes Yes PCI-X PCI-X
8-0-3-2 3/0/2/1 12800 133 133 On Yes No Yes Yes PCI-X PCI-X
8-0-3-3 3/0/4/1 13056 133 133 On Yes No Yes Yes PCI-X PCI-X
8-0-3-4 3/0/5/1 13312 133 133 On Yes No Yes Yes PCI-X PCI-X
8-0-3-5 3/0/6/1 13568 266 266 Off No N/A N/A N/A PCI-X PCI-X
8-0-3-6 3/0/14/1 15104 266 266 Off No N/A N/A N/A PCI-X PCI-X
8-0-3-7 3/0/13/1 14848 133 133 On Yes No Yes Yes PCI-X PCI-X
8-0-3-8 3/0/12/1 14592 133 133 Off No N/A N/A N/A PCI-X PCI-X
8-0-3-9 3/0/10/1 14336 133 133 On Yes No Yes Yes PCI-X PCI-X
8-0-3-10 3/0/9/1 14080 133 133 Off No N/A N/A N/A PCI-X PCI-X
8-0-3-11 3/0/8/1 13824 133 133 On Yes No Yes Yes PCI-X PCI-X


Aneesh

[Torsten. · Accepted solution]

This will tell you:

http://h20195.www2.hp.com/v2/GetDocument.aspx?docname=5982-9830EEW&doctype=data%20sheet

[Aneesh Mohan]

Hi,

I belive the mapping could be something like this ......am I right ?

266mhz â 2133mb/sec
133mhz â 1066mb/sec
66mhz â 533mb/sec


h> ioscan -fnkC fc
Class I H/W Path Driver S/W State H/W Type Description
==================================================================
fc 0 3/0/4/1/0 fcd CLAIMED INTERFACE HP AB378-60101 4Gb Single Port PCI/PCI-X Fibre Channel Adapter (FC Port 1)
/dev/fcd0
fc 1 3/0/5/1/0 fcd CLAIMED INTERFACE HP AB378-60101 4Gb Single Port PCI/PCI-X Fibre Channel Adapter (FC Port 1)
/dev/fcd1
fc 2 3/0/13/1/0 fcd CLAIMED INTERFACE HP AB378-60101 4Gb Single Port PCI/PCI-X Fibre Channel Adapter (FC Port 1)
/dev/fcd2

We have 3 x 4GB FCs , 2 is using for Data and 1 for backup and all are installed in 133Mhz slots , Is it wise plan to move 2 data FC`s from 133 Mhz to 266 Mhz slot for better SAN I/O throughput ....the OS installed is 11.31 since it uses Persistent DF this change can be done easily ..I guess...


Aneesh

[Torsten.]

Normally the I/O card (HBA) is setting the limit.

Unless the documentation of the card say "install in slot x, y,... only", it doesn't matter where it is.

An example is 10Gbe ethernet cards in some servers.

[Torsten.]

The FC adapter support matrix says

"Maximum supported number of AB378B/AB379B adapters is limited by the number of available PCI slots in any listed system."

[Aneesh Mohan]

Abstract from the "AB378A Fibre Channel Mass Storage Adapter Installation Guide"

This card is capable of running at higher bus speeds, up to 266Mhz. The speed of the server slot determines
the maximum speed. The actual speed is displayed as the PCI Mode.

Current Setup
==========

The card /dev/fcd0 is installed in 133Mhz Speed Slot. As per the above abstract when I move FCD0 to 266 Mhz slot the PCI Mode of the FC card should change to 266Mhz . Please correct me If I am wrong.


hpus66^root:/ > fcmsutil /dev/fcd0

Vendor ID is = 0x1077
Device ID is = 0x2422
PCI Sub-system Vendor ID is = 0x103C
PCI Sub-system ID is = 0x12D6
PCI Mode = PCI-X 133 MHz
ISP Code version = 4.0.86
ISP Chip version = 3
Topology = PTTOPT_FABRIC
Link Speed = 4Gb
Local N_Port_id is = 0x011000
Previous N_Port_id is = None
N_Port Node World Wide Name = 0x5001438001001549
N_Port Port World Wide Name = 0x5001438001001548
Switch Port World Wide Name = 0x201000051e3650e6
Switch Node World Wide Name = 0x100000051e3650e6
Driver state = ONLINE
Hardware Path is = 3/0/4/1/0
Maximum Frame Size = 2048
Driver-Firmware Dump Available = NO
Driver-Firmware Dump Timestamp = N/A
Driver Version = @(#) fcd B.11.31.01 Jan 7 2007

hpus66^root:/ > fcmsutil /dev/fcd0 vpd
V I T A L P R O D U C T D A T A
--------- ------------- -------

Product Description : HP PCI-X 2.0 4Gb Fibre Channel HBA

Part number : AB378-60101

Engineering Date Code : A-4713

Part Serial number : JP47372610

Misc. Information : PW=7.5W;PCI=66MHZ;PCI-X=266MHZ

Mfd. Date : 4737

Mfd. ID : AB378-60101

Check Sum : 0x24

EFI version : 01.09

ROM Firmware version : 04.00.90

BIOS version : 01.26

FCODE version : 01.17

Asset Tag : NA

Regards,
Aneesh

[Torsten.]

So try in another slot if it becomes faster.
Please tell.

[Aneesh Mohan]

Hi ,

But in 2nd box the above assumption is not working ...

hpus46^root:/ > olrad -q
Driver(s)
Capable
Slot Path Bus Max Spd Pwr Occu Susp OLAR OLD Max Mode
Num Spd Mode
0-1-3-0 0/0/0/1 0 133 133 Off No N/A N/A N/A PCI-X PCI-X
0-1-3-1 0/0/1/1 256 133 133 On Yes No Yes Yes PCI-X PCI-X
0-1-3-2 0/0/2/1 512 133 133 On Yes No Yes Yes PCI-X PCI-X
0-1-3-3 0/0/4/1 768 133 133 On Yes No Yes Yes PCI-X PCI-X
0-1-3-4 0/0/5/1 1024 133 133 On Yes No Yes Yes PCI-X PCI-X
0-1-3-5 0/0/6/1 1280 266 133 On Yes No Yes Yes PCI-X PCI-X
0-1-3-6 0/0/14/1 2816 266 133 On Yes No Yes Yes PCI-X PCI-X
0-1-3-7 0/0/13/1 2560 133 133 On Yes No Yes Yes PCI-X PCI-X
0-1-3-8 0/0/12/1 2304 133 133 On Yes No Yes Yes PCI-X PCI-X
0-1-3-9 0/0/10/1 2048 133 133 Off No N/A N/A N/A PCI-X PCI-X
0-1-3-10 0/0/9/1 1792 133 133 On Yes No Yes Yes PCI-X PCI-X
0-1-3-11 0/0/8/1 1536 133 133 On Yes No Yes Yes PCI-X PCI-X
hpus46^root:/ > ioscan -fnkCfc
Class I H/W Path Driver S/W State H/W Type Description
======================================================================
fc 0 0/0/4/1/0 fcd CLAIMED INTERFACE HP AB378-60101 4Gb Single Port PCI/PCI-X Fibre Channel Adapter (FC Port 1)
/dev/fcd0
fc 1 0/0/5/1/0 fcd CLAIMED INTERFACE HP AB378-60101 4Gb Single Port PCI/PCI-X Fibre Channel Adapter (FC Port 1)
/dev/fcd1
fc 3 0/0/6/1/0/4/0 fcd CLAIMED INTERFACE HP AD193-60001 PCI/PCI-X Fibre Channel 1-port 4Gb FC/1-port 1000B-T Combo Adapter (FC Port 1)
/dev/fcd3
fc 2 0/0/13/1/0 fcd CLAIMED INTERFACE HP AB378-60101 4Gb Single Port PCI/PCI-X Fibre Channel Adapter (FC Port 1)
/dev/fcd2
fc 4 0/0/14/1/0/4/0 fcd CLAIMED INTERFACE HP AD193-60001 PCI/PCI-X Fibre Channel 1-port 4Gb FC/1-port 1000B-T Combo Adapter (FC Port 1)
/dev/fcd4


Also I have a 3rd box in which PCI mode showing 266 Mhz as well ..

hpus81^root:/ > olrad -q
Driver(s)
Capable
Slot Path Bus Max Spd Pwr Occu Susp OLAR OLD Max Mode
Num Spd Mode
0-0-1-1 1/0/8/1 396 133 133 Off No N/A N/A N/A PCI-X PCI-X
0-0-1-2 1/0/10/1 425 133 133 On Yes No Yes Yes PCI-X PCI-X
0-0-1-3 1/0/12/1 454 266 266 On Yes No Yes Yes PCI-X PCI-X
0-0-1-4 1/0/14/1 483 266 266 On Yes No Yes Yes PCI-X PCI-X
0-0-1-5 1/0/6/1 368 266 266 On Yes No Yes Yes PCI-X PCI-X
0-0-1-6 1/0/4/1 340 266 133 On Yes No Yes Yes PCI-X PCI-X
0-0-1-7 1/0/2/1 312 133 133 On Yes No Yes Yes PCI-X PCI-X
0-0-1-8 1/0/1/1 284 133 133 On Yes No Yes Yes PCI-X PCI-X
hpus81^root:/ > fcmsutil /dev/fcd0

Vendor ID is = 0x1077
Device ID is = 0x2422
PCI Sub-system Vendor ID is = 0x103C
PCI Sub-system ID is = 0x12D6
PCI Mode = PCI-X 266 MHz
ISP Code version = 4.0.90
ISP Chip version = 3
Topology = PTTOPT_FABRIC
Link Speed = 4Gb
Local N_Port_id is = 0x01bb00
Previous N_Port_id is = None
N_Port Node World Wide Name = 0x500143800118b5ab
N_Port Port World Wide Name = 0x500143800118b5aa
Switch Port World Wide Name = 0x20bb00051e3664e8
Switch Node World Wide Name = 0x100000051e3664e8
Driver state = ONLINE
Hardware Path is = 1/0/6/1/0
Maximum Frame Size = 2048
Driver-Firmware Dump Available = NO
Driver-Firmware Dump Timestamp = N/A
Driver Version = @(#) fcd B.11.31.0709 Jun 11 2007



Could you please let me know the reason why the second box FC card PCI mode is with 133 Mhz...

Thanks and Regards
Aneesh

[Aneesh Mohan]

Please find the fcmsutil of the box in question (PCI Mode shows 133 Mhz and card is installed in 266Mhz slot)

hpus46^root:/ > fcmsutil /dev/fcd3

Vendor ID is = 0x1077
Device ID is = 0x2422
PCI Sub-system Vendor ID is = 0x103C
PCI Sub-system ID is = 0x12DE
PCI Mode = PCI-X 133 MHz
ISP Code version = 4.0.86
ISP Chip version = 3
Previous Topology = UNINITIALIZED
Link Speed = UNKNOWN
Local N_Port_id is = None
Previous N_Port_id is = None
N_Port Node World Wide Name = 0x50060b0000c7ebb9
N_Port Port World Wide Name = 0x50060b0000c7ebb8
Switch Port World Wide Name = 0
Switch Node World Wide Name = 0
Driver state = AWAITING_LINK_UP
Hardware Path is = 0/0/6/1/0/4/0
Maximum Frame Size = 2048
Driver-Firmware Dump Available = NO
Driver-Firmware Dump Timestamp = N/A
Driver Version = @(#) fcd B.11.31.01 Jan 7 2007

hpus46^root:/ >


Aneesh

[Torsten.]

It is a different card, isn't it?

AD193

Look up the specs for this card too.