Oracle RAC + flexfabric without stacking

[Enrico Ferro]

We are defining a configuration for Oracle RAC running on linux rh5 + blade G7 + flexfabric. Currently we have 2 VC per enclosure, each enclosure is composing a domain (no stacking between different enclosures). We are using VCEM to manage them.

We are considering to use 4 VC per enclosure to separate physically the production network from the interconnect network needed by oracle. Is it possible to do not stack together 4 VC and to have something working? I am a bit confused: if they are not stacked together, can they still compose a domain or is it a wrong configuration (and so it is mandatory to stack them)?

Again: there is someone running oracle RAC with flexfabric in production?

Thanks for suggestions,
best regards,
ef

[Shadders]

Hi Enrico,

We have a simmilar setup.

Although we dont have flexfabric or G7's, We dont have stacking links & we use SLES 10 SP3.

What we did was create shared uplink sets on the VC's that use interfaces on both Flex-10 VC's in a single C7000. (we have 2 per C7000) Then create multiple bonds in Linux, taking care to split the bonded nic mac addresses over the 2 VC's

One bond was for the LAN, the other for the Oracle interconnect.

RAC nodes were spit over the C7000's.

It all seems to be working fine. if we loose a node, a VC module, a link, a switch or a whole C7000, - the system stays up.

Hope that helps a little?

Regards,
Steve

[Enrico Ferro]

Thank you Steve for you answer. We found an official document in the HP site that describe a configuration like your using Flex-10, so a couple of VC is definitely enough. Our management is looking for a similar document for the Flexfabric (the DB is business critical and so they want everything "ultra-certified").

Thanks again,
ef

[Shadders]

Hi Enrico,

There is a Flexfabric Cookbook available here:
http://h20000.www2.hp.com/bc/docs/support/SupportManual/c02616817/c02616817.pdf

Hopefully it will help you with a solution...

Regards,
Steve

[Casper42]

If you want to connect Chassis A to Chassis B without stacking, it is theoretically possible to do this as long as you only have 2 chassis. Daisy chain to 3+ will not work.

You would just define a Network on A and seperately on B for the RAC Cluster Heartbeat. Then connect the 2 together with a DAC or Fiber cable.

I have not personally tested this, but it doesn't violate any of the rules of VC modules and how their traffic flows.

Ideally though you would just use a real Switch in the middle. It doesnt have to be connected to the rest of thenetwork per say and then you can connect as many chassis as you want to it. The A5820XG is good if you need alot of ports. There are other cheaper HP Switches that will get you up to 4 10Gb ports as well.