Comware-Based
cancel
Showing results for 
Search instead for 
Did you mean: 

Moving a blade to a new C7000 with 6125XLG

1arstr
Advisor

Moving a blade to a new C7000 with 6125XLG

Hi,

We have moved a G8 blade from an old C7000 with FlexFabric to a newer C7000 (in slot 5) with 6125XLG.

Selection_298.png

We have configured the switch with the same VLAN trunks as other servers in that same  C7000. 

interface Ten-GigabitEthernet1/0/5
port link-mode bridge
description XYZ-esx-10
port link-type trunk
port trunk permit vlan all
flow-control
stp edged-port

The problem is that the interface is in a DOWN state:

[XYZ-ENC01-ETH01]display interface Ten-GigabitEthernet 1/0/5
Ten-GigabitEthernet1/0/5
Current state: DOWN
Line protocol state: DOWN
IP packet frame type: Ethernet II, hardware address: bcea-fa03-1faf
Description: Ten-GigabitEthernet1/0/5 Interface
Bandwidth: 10000000 kbps
Loopback is not set
Media type is not sure, port is connected to backplane
Unknown-speed mode, unknown-duplex mode
Link speed type is autonegotiation, link duplex type is autonegotiation
Flow-control is not enabled
Maximum frame length: 10000
Allow jumbo frames to pass
Broadcast max-ratio: 100%
Multicast max-ratio: 100%
Unicast max-ratio: 100%
PVID: 1
MDI type: Automdix
Port link-type: Access
Tagged VLANs: None
Untagged VLANs: 1
Port priority: 0
Last clearing of counters: Never
Peak input rate: 0 bytes/sec, at 2011-01-01 01:00:57
Peak output rate: 0 bytes/sec, at 2011-01-01 01:00:57
Last 300 second input: 0 packets/sec 0 bytes/sec -%
Last 300 second output: 0 packets/sec 0 bytes/sec -%
Input (total): 0 packets, 0 bytes
0 unicasts, 0 broadcasts, 0 multicasts, 0 pauses
Input (normal): 0 packets, - bytes
0 unicasts, 0 broadcasts, 0 multicasts, 0 pauses
Input: 0 input errors, 0 runts, 0 giants, 0 throttles
0 CRC, 0 frame, - overruns, 0 aborts
- ignored, - parity errors
Output (total): 0 packets, 0 bytes
0 unicasts, 0 broadcasts, 0 multicasts, 0 pauses
Output (normal): 0 packets, - bytes
0 unicasts, 0 broadcasts, 0 multicasts, 0 pauses
Output: 0 output errors, - underruns, - buffer failures
0 aborts, 0 deferred, 0 collisions, 0 late collisions
0 lost carrier, - no carrier

 Any clue to where I should look next in order to troubleshoot this issue? Also on the ESXi side (6.0U3) it reports that the network is down.

Lars

18 REPLIES
peyrache
Trusted Contributor

Re: Moving a blade to a new C7000 with 6125XLG

What are version/driver version on both part ?
G8/6125 ?
Thanks
JY
bamaskas
Advisor

Re: Moving a blade to a new C7000 with 6125XLG

6125XLG-CMW710-R2432P03.ipe for 6125XLG

 

For the C7000, use the latest support pack.  Not knowing the adapters installed on your G8 blade servers, you should update all to the latest support pack. 

peyrache
Trusted Contributor

Re: Moving a blade to a new C7000 with 6125XLG

Shall you post
Result of display diag ?
1arstr
Advisor

Re: Moving a blade to a new C7000 with 6125XLG

I used the same iso to update the G8 server that was previous used for the rest of the systems (C7000 and G9 servers, SPP2016040.2016_0317.20.iso) and we have: 

ProLiant BL460c Gen8
Discovered: No System ROM I31 12/20/2013

 

The 6125XLG information is as follows:

HPE Comware Software, Version 7.1.045, Release 2422P01
Copyright (c) 2010-2015 Hewlett Packard Enterprise Development LP
HPE 6125XLG Blade Switch uptime is 82 weeks, 6 days, 2 hours, 48 minutes
Last reboot reason : USER reboot

Boot image: flash:/6125xlg-cmw710-boot-r2422p01.bin
Boot image version: 7.1.045, Release 2422P01
Compiled Dec 14 2015 16:00:11
System image: flash:/6125xlg-cmw710-system-r2422p01.bin
System image version: 7.1.045, Release 2422P01
Compiled Dec 14 2015 16:00:11


Slot 1:
Uptime is 82 weeks,6 days,2 hours,48 minutes
6125XLG Blade Switch with 2 Processors
BOARD TYPE: 6125XLG Blade Switch
DRAM: 2048M bytes
FLASH: 512M bytes
PCB 1 Version: VER.B
Bootrom Version: 105
CPLD 1 Version: 002
CPLD 2 Version: 255
Release Version: HPE 6125XLG Blade Switch-2422P01
Patch Version : None
Reboot Cause : UserReboot
[SubSlot 0] 16*10Gb/1Gb Downlinks + 4*10Gb CrossLinks
[SubSlot 1] LSW1X8BS

Slot 2:
Uptime is 82 weeks,6 days,2 hours,51 minutes
6125XLG Blade Switch with 2 Processors
BOARD TYPE: 6125XLG Blade Switch
DRAM: 2048M bytes
FLASH: 512M bytes
PCB 1 Version: VER.B
Bootrom Version: 105
CPLD 1 Version: 002
CPLD 2 Version: 255
Release Version: HPE 6125XLG Blade Switch-2422P01
Patch Version : None
Reboot Cause : UserReboot
[SubSlot 0] 16*10Gb/1Gb Downlinks + 4*10Gb CrossLinks
[SubSlot 1] LSW1X8BS

The driver is the one included in the HP image for ESXi 6.0U2: VMware-ESXi-6.0.0-Update2-3620759-HPE-600.9.6.5.7-Dec2016

The nics appears to be FlexFabric 554 FLB Adapters,  while the existing servers have 536 FLB adapters.

Lars

peyrache
Trusted Contributor

Re: Moving a blade to a new C7000 with 6125XLG

Did you reinstall completely vmware since nic hardware are differents ?
bamaskas
Advisor

Re: Moving a blade to a new C7000 with 6125XLG

Do you know how to update the Comware on the 6125XLGs to R2432P03 ?  

binary ftp the .ipe  file to the slot 1 switch (or which ever switch is the IRF master), then

boot-loader file flash:/6125xlg-CMW710-R2432P03.ipe slot 1 main, then again for slot 2 main, then reboot the irf doman.

1arstr
Advisor

Re: Moving a blade to a new C7000 with 6125XLG

Yes, the host was reinstalled from scratch  after being moved physically. And I can see two 10GbE nics in the VMware console, but they are both disconnected.

1arstr
Advisor

Re: Moving a blade to a new C7000 with 6125XLG


bamaskas wrote:

Do you know how to update the Comware on the 6125XLGs to R2432P03 ?  

 


You think a firmware update of the 6125XLG solve this issue?If it was a Gen10 server tat would make sense, but this is an older server. I did upgrade the firmware last year and wrote a few sentences about it here: http://www.core-four.info/2016/03/configuring-hpe-6125xlg-ethernet-blade.html

Lars

VoIP-Buddy
Trusted Contributor

Re: Moving a blade to a new C7000 with 6125XLG

Lars,

Can you check the port mapping on the c7000 to ensure that slot 5 is going to each 6125XLG port 5?  I haven't looked lately but the internal ports may be 1/1/5.  I seem to recall that 1/0/5 is the external port.

Also, have you IRF'd the two 6125XLG's for redundancy?

Regards,

David

1arstr
Advisor

Re: Moving a blade to a new C7000 with 6125XLG


VoIP-Buddy wrote:

Can you check the port mapping on the c7000 to ensure that slot 5 is going to each 6125XLG port 5?  I haven't looked lately but the internal ports may be 1/1/5.  I seem to recall that 1/0/5 is the external port.

David,

It's working fine for the other servers in slot 1-4 with 1/0/x and I doubt it would be any different for the server in slot 5.

Selection_038.png

Also, have you IRF'd the two 6125XLG's for redundancy?

Yes, I have described most of the setup here:

http://www.core-four.info/2016/08/configuring-hpe-6125xlg-ethernet-blade.html 

 

Lars

bamaskas
Advisor

Re: Moving a blade to a new C7000 with 6125XLG

The blade ports are 1/0/1 to 16 and if IRF also 2/0/1-16.   The uplinks are 1/1/x and 2/1/x. 

 

Are you configuring FCoE - if so,  is an FCoE VFC configured?  

 

There have been numerous fixes between R2422 and R2432P03.   But most importantly the Blade BLOM or MEZ has to align to the bay where the 6125XLG resides.  This is easy tocheck via the various C7000 mapping displays.

1arstr
Advisor

Re: Moving a blade to a new C7000 with 6125XLG


bamaskas wrote:

The blade ports are 1/0/1 to 16 and if IRF also 2/0/1-16.   The uplinks are 1/1/x and 2/1/x. 

Are you configuring FCoE - if so,  is an FCoE VFC configured?  

No, we're using native FC with dedicated FC infrastructure. I can see all the FC storage from the newly moved blade.

There have been numerous fixes between R2422 and R2432P03.   But most importantly the Blade BLOM or MEZ has to align to the bay where the 6125XLG resides.  This is easy tocheck via the various C7000 mapping displays.


Yes, as far as I can see port 5 of the switch is linked with the correct mezzanine card. I also probably wouldnt see any FC storage if it had been wrong:

Selection_298.png

Selection_009.jpg

Lars

bamaskas
Advisor

Re: Moving a blade to a new C7000 with 6125XLG

The 6125xlg is only Ethernet, FCoE, iscsi. There are no FC ports. Only Ethernet ports.



Sent via the Samsung Galaxy S7 active, an AT&T 4G LTE smartphone
peyrache
Trusted Contributor

Re: Moving a blade to a new C7000 with 6125XLG

will you try to force speed on 6125 ?

also can you post display interface result please

1arstr
Advisor

Re: Moving a blade to a new C7000 with 6125XLG


bamaskas wrote:
The 6125xlg is only Ethernet, FCoE, iscsi. There are no FC ports. Only Ethernet ports.


Yes, seperate FC infrastructure means that we're using Brocade FC swithes in addition to the 6125XLG ethernet switches.

Lars

1arstr
Advisor

Re: Moving a blade to a new C7000 with 6125XLG


peyrache wrote:

will you try to force speed on 6125 ?

I added speed 10000 and port up-mode and now have this config:

#
interface Ten-GigabitEthernet1/0/5
port link-mode bridge
description xxx-esx-07
port link-type trunk
port trunk permit vlan all
speed 10000
port up-mode
flow-control
stp edged-port
lldp compliance admin-status cdp txrx
#

also can you post display interface result please


Here are my results:

>disp interface Ten-GigabitEthernet 1/0/5
Ten-GigabitEthernet1/0/5
Current state: DOWN
Line protocol state: DOWN
IP packet frame type: Ethernet II, hardware address: bcea-fa03-1faf
Description: xxx-esx-07
Bandwidth: 10000000 kbps
Loopback is not set
Media type is not sure, port is connected to backplane
10Gbps-speed mode, unknown-duplex mode
Link speed type is force link, link duplex type is autonegotiation
Flow-control is enabled
Maximum frame length: 10000
Allow jumbo frames to pass
Broadcast max-ratio: 100%
Multicast max-ratio: 100%
Unicast max-ratio: 100%
PVID: 1
MDI type: Automdix
Port up-mode is enabled
Port link-type: Trunk
VLAN Passing: 1(default vlan), 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20
VLAN permitted: 1(default vlan), 2-4094
Trunk port encapsulation: IEEE 802.1q
Port priority: 0
Last clearing of counters: Never
Peak input rate: 0 bytes/sec, at 2011-01-01 01:00:57
Peak output rate: 0 bytes/sec, at 2011-01-01 01:00:57
Last 300 second input: 0 packets/sec 0 bytes/sec 0%
Last 300 second output: 0 packets/sec 0 bytes/sec 0%
Input (total): 0 packets, 0 bytes
0 unicasts, 0 broadcasts, 0 multicasts, 0 pauses
Input (normal): 0 packets, - bytes
0 unicasts, 0 broadcasts, 0 multicasts, 0 pauses
Input: 0 input errors, 0 runts, 0 giants, 0 throttles
0 CRC, 0 frame, - overruns, 0 aborts
- ignored, - parity errors
Output (total): 0 packets, 0 bytes
0 unicasts, 0 broadcasts, 0 multicasts, 0 pauses
Output (normal): 0 packets, - bytes
0 unicasts, 0 broadcasts, 0 multicasts, 0 pauses
Output: 0 output errors, - underruns, - buffer failures
0 aborts, 0 deferred, 0 collisions, 0 late collisions
0 lost carrier, - no carrier

Lars

 

 

peyrache
Trusted Contributor

Re: Moving a blade to a new C7000 with 6125XLG

Shall post vm-support please for host connected in slot 5
Highlighted
1arstr
Advisor

Re: Moving a blade to a new C7000 with 6125XLG

Since I have no network connectivity on this host I guess I'll have to be physically at the server to get hold of the resulting files. I can probably do that next week.

 

Lars