P4500 G2

[Lakshantha]

We have a P4500 G2 14.4TB SAS virtualization SAN (2 noodes) with dual port 10Gb SFP + NIC'S connected to 2 Cisco nexus switches with 2 VLANS. 1 Vlan for management (192.x.x.x) and other for iSCSi traffic (172.x.x.x)

10GB NIC's are on the iSCSI VLAN and i have create a ALB NIC bond using the 2 ports.

Everything worked fine and i create a cluster and all LUNs

Then we moved the SAN to a data enter and connect it to the same switch but its just one switch instead of 2 switches at the moment.

Now we have lost connectivity on the iSCSI network and can't ping within the 2 nodes.

Anyone has come across anything like this before or any advice on how to resolve this is highly appreciated.

Thanks.

[David_Tocker]

My understanding of the P4000 contra-indicates a seperate management network and iSCSI network.

Basically if you want to mange the nodes they should be on one VLAN with a gateway with access to the 'management' network. If you want OOB *out of band* access then the seperate iLO ports on the nodes are your ticket.

[L1nklight]

Yeah I agree with David here. Check your bonds (if you have any created) and make sure the bond with the IP address you want the node to have has a gateway. The server should only allow you to have a single gateway IP address. I too thought it was kind of lame that you couldn't bond the 2 onboard NICs for management traffic and bond the 2 TenGig Ethernet NICs for iSCSI traffic. 

Edit: I reread what I typed and it seemed vague.

You can only have a single gateway specified on the entire P4500 (excluding the iLO). The minute you add a gateway to an alternate interface, that becomes your Mangement AND iSCSI network address. So say you have two bonds one for your TenGig Ethernet and one for your on board nic cards. The TenGig-E bond's ip address is 172.16.1.20 and the gateway is 172.16.1.1 and the on board bond's IP address is 192.168.1.20. When you go to add a gateway to the 192.168.1.20 bond (just say you add 192.168.1.1) and then you apply that config, the gateway to the 172.16.1.20 bond should disappear (IIRC from messing around on my P4500s).