- Community Home
- >
- Storage
- >
- Midrange and Enterprise Storage
- >
- HPE 3PAR StoreServ Storage
- >
- Re: 3PAR RDMs for VMware SQL Cluster
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-05-2017 01:59 AM
04-05-2017 01:59 AM
I’m trying to add RDMs for HP 3PAR SAN storage onto a SQL cluster of VMware VMs. Although I did a lot of research and am following a nicely documented method (“How-To: Migrate MS SQL Cluster to a New SAN”), it just isn’t working.
We have two VMs running as SQL cluster nodes. They have vmdk files for their C: and E: drives, and RDM files (on our old EMC SAN) for the cluster drives (Quorum, DTC, SQL data & log volumes). The cluster nodes and their SQL databases all work fine, as does failover. All the files for one VM (vmdk and old RDM pointers) are located in that server’s folder on one datashare, and all the files for the other VM are in the second VM’s folder on another datashare; and the SCSI controllers are both set as non-shared. This does look slightly strange (to my untutored eye) as it is NOT how the internet method instructs for adding new disks – and after completing the instructions I get errors when starting the VMs.
The internet instructions say to create thin LUNs (except thick for the new Quorum drive). Then (presumably with both VMs off) set the SCSI controllers to shared physical, add disks (as new RDM disks) to one VM, and note the disk-filenames generated. Then add them to the other VM (as existing disks, browse to the same files). Then restart both VMs and rescan disks on one, create volumes, create cluster disks, test failover etc. The VMs won’t restart, though, vSphere shows the message “Thin/TBZ/Sparse disks cannot be opened in multiwriter mode”. In order to get these production machines running again for our users, I remove the added disks, but the machines will only start if I reset the SCSI controllers as non-shared again.
Can anyone help me escape from this quandary, please? Should the SCSI controllers be non-shared (as working now), or shared physical (as per instructions)? Should I be creating files separately for each VM’s new disks in that VM’s datastore folder (as working now) or re-using newly-created files (as in the How-to)?
TIA
Ian
Solved! Go to Solution.
- Tags:
- SAN SQL VMware RDM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-05-2017 07:14 AM
04-05-2017 07:14 AM
Re: 3PAR RDMs for VMware SQL Cluster
Additional Info
VMware is ESXi 5.1 U3. Guest OS is Windows Server 2008 R2. SQL version is SQL Server 2012 (two instances).
Both old & new SANs are FC connected to the VMware hosts, so using RDMs in physical mode is correct (VMware KB2147662 : “In vSphere 5.1 and earlier, configurations using shared storage for Quorum and/or Data must be on FC based RDMs (physical mode for Cluster Across Boxes, virtual mode for Cluster In A Box”). We have anti-affinity rules to keep the two VMs on separate hosts (CAB).
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-06-2017 07:12 AM
04-06-2017 07:12 AM
Re: 3PAR RDMs for VMware SQL Cluster
After more research :-
Having the VMs running or not may be part of the secret - one guide says you can add RDMs to the first VM if it is running and is the primary node (i.e. running the cluster). Then failover everything to the second VM and switch off the first VM. Then add the RDMs to the second VM, as existing disks in physical mode by browsing to the location recorded for the first VM.
Can anybody confirm this?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-06-2017 07:57 AM
04-06-2017 07:57 AM
Re: 3PAR RDMs for VMware SQL Cluster
As someone who is not a storage guy but a VMware guy that only comes here to figure out this silly storage stuff, consider not using RDMs at all. I know that's not the answer you want to hear, but its better from a VMware perspective. RDMs are absolutely horrible for VMware admins to work with and represent the old way of doing SQL. I'm not a SQL guy, but our SQL guys went with SQL Always on so we could get rid of RDMs and just do VMDK storage for all SQL servers.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-07-2017 02:53 AM
04-07-2017 02:53 AM
Re: 3PAR RDMs for VMware SQL Cluster
Thanks for that - you're probably right, in an ideal world, in which we'd be on latest ESXi & everything.
However, VMware KB 2147662 says that for ESXi 5.1 (our case), shared storage for SQL Quorum & Data (Cluster Across Boxes) must be on RDMs (which must be FC), and must using virtual controllers in physical compatibility mode.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-12-2017 12:23 AM
04-12-2017 12:23 AM
SolutionSolution found! - After much trial & error. This works for ESXi 5.1 hosts / Windows 2008 R2 guests / MS SQL 2012 / MSCS Clustering
- In Failover Cluster Manager, offline SQL resources and shutdown both nodes. (This may only be required if creating new SCSI controllers & needing to set bus sharing - you can't do anything with controllers if the VM is running.) Other internet guidance isn't clear about this.
- In vSphere, choose first node, Edit Settings, add Hard Disk, choose RDM, select LUN, store with VM, Physical mode, choose a SCSI Id on a new controller (e.g. 2:0). I chose to use a new set of Ids because I am migrating SQL files (also Quorum & DTC disks) from an old SAN to a new one, and will eventually delete old RDM disks residing on the old SAN.
- This creates a new SCSI controller - set it to SCSI Bus Sharing as Physical.
- Add more hard disks as necessary, choosing SCSI Ids on the new controller.
- Note the filenames & locations of the RDM mapping file for each new disk.
- Now choose the second cluster node in vSphere, Edit Settings, add Hard Disk, Use Existing Disk, browse to the first file/location noted earlier, choose matching SCSI Id (2:0)
- Again a new SCSI controller is created - set its SCSI Bus sharing to Physical.
- Add remaining hard disks, in each case matching up the filenames/locations/SCSI Ids with the values for the first node.
- Restart both nodes.
- On one node, go to Disk Management, Rescan Disks. Online the disks, initialise them, and create new volumes.
- In Failover Cluster Manager, online SQL resources again, create Cluster Disks and assign them as required.
- Test failover & check the new disks migrate between nodes.