Around the Storage Block
1748158 Members
4222 Online
108758 Solutions
New Article ๎ฅ‚
Nick_Dyer

Re: NimbleOS 5.1 - iSCSI & FC MultiProtocol Access

As part of the NimbleOS 5.1 blog series, this covers multiprotocol access (iSCSI and Fibre Channel).
 
Written by Walter van Hoolst, Nimble Storage SME, Belgium
 

Historically, a Nimble array could be solely configured as iSCSI or Fibre Channel, and the system didn't let you choose what protocol to use. In fact, during initial installation if the array detects Fibre Channel cards it will default to FC protocol. If no FC cards were detected, iSCSI was the protocol you could use. It was also not possible to switch protocols in a Nimble array.

Nimble OS 5.1 solves this issue, as we now support provisioning iSCSI and FC protocols on the same array.

If you wish to connect iSCSI hosts and FC hosts to the same Nimble array, and use both protocols at the same time, you can do that using Nimble OS 5.1 It delivers more flexible hardware options and customers can now switch between protocols much easier.

Multi-protocol access over a scale out groupMulti-protocol access over a scale out group

There are some conditions to be met, of course.

Mixed protocol is only supported on homogeneous groups, meaning that all arrays in the group needs to have similar hardware capabilities. In a single array configuration, this isn't a problem - but if you are scaling out with multiple arrays within a group, then this is something to consider. The protocol chosen always applied on the entire group and cannot be set differently per pool. You can't disable both protocols on the group, obviously.

A volume can only be presented using a single protocol. So that volume can be accessed using iSCSI or FC, never both at the same time. The volume ACL are assigned to an iSCSI initiator group or a FC initirator group.

Initial setup is no different as actual.

If on initial array boot it detects FC cards, than FC will be the default protocol choosen by the installer software. This can then be changed using "Administrator > Network > Configure Active Settings". You will see the following view:

Screen Shot 2019-04-16 at 14.11.44.png

 

Now you can choose your protocol you want to use. In this example, we can now add iSCSI to the possible protocols.

gui with both protocols.png

 

When you change this you will see the following warning. Don't worry, it's a temporary IO pause whilst the second protocol stack is initiated.

warning.png

 

When provisioning new volumes, you now have the choice between FC or iSCSI (but not both).

new volume.png

The rest is business as usual, no surprises there.

Those changes can also be done using CLI.

โ€œgroup --edit โ€“-scsi_enabled {yes|no} | --fc_enabled {yes|no}"

"group --info"

It's also possible to change the protocol for an existing volume. Volumes and volume collections are in fact protocol agnostic. The access protocol is only tied with the initiator group.

So what needs to be done if you want to change the protocol on an existing volume? Well, as you may expect, it is a disruptive process.

1. Disconnect the volume from the host, remove all ACLs on the volume
2. Add volume ACLs to initiatorgroup with new protocol
3. Some hosts need manual re-scan to avoid host errors connecting to unavailable targets.

And finally, we also adapted the new vCenter Plugin to support this new functionality: As you can see below, during creation of the datastore, the protocol used can be set upon your choice:

vmware plugin.png

 

Thanks for taking the time to read this blog. If you have any questions, please don't hesitate to ask them in the comments section below.

Enjoy the new Nimble OS 5.1!Screenshot 2019-04-17 at 09.32.42.png

Written by Walter van Hoolst, Nimble Storage SME, Belgium

Nick Dyer
twitter: @nick_dyer_
0 Kudos
About the Author

Nick_Dyer

Nick is a Storage Field CTO & Technologist - focusing on helping customers deliver business value with innovative technologies such as Nimble Storage & dHCI, HPE Cloud Volumes & much more.

Comments
Scott42

Could you present a snapshot of a FC presented volume to an iSCSI host?

RE: Could you present a snapshot of a FC presented volume to an iSCSI host?

Yes, you absolutely can, via the Zero Copy Clone methodology. Simply clone a snapshot and change the Access Control List from that of an FC initiator group to an iSCSI initiator group

Is there comprehensive guidance (beyond the above) on switching a Nimble group that's already deployed as FC to multiprotocol?   Things like workflow, what to watch out for, preparation, etc...

Also, in light of being unable to export a volume with both protocols simultaneously, would you happen to know if an iSCSI-connected Veeam backup proxy can still leverage its direct attach method when all of the "live" volumes are FC?  I'm not sure if accessing zero copy clones is sufficient or if Veeam would require access to the original volumes.  

"Is there comprehensive guidance (beyond the above) on switching a Nimble group that's already deployed as FC to multiprotocol?   Things like workflow, what to watch out for, preparation, etc..."

Things to consider:

  1. Ensure your Ethernet fabric is correctly configured (as you'll be failing over controllers to perform the FC HBA installation)
  2. Ensure your NCM/NWT/NLT are up to date with the revision of NimbleOS 5.1
  3. Make sure your FC zoning is correctly configured

Follow the PCI upgrade process from Infosight, and highly recommend a call to Nimble Support if you need to discuss the process further.

"iSCSI-connected Veeam backup proxy can still leverage its direct attach method when all of the "live" volumes are FC? "

My understanding is that Veeam must access the volumes using the same protocol as the host it's backing up from. Therefore if volumes are FC mounted, then the Veeam proxy must also be FC attached.