- Community Home
- >
- Storage
- >
- HPE SimpliVity
- >
- Safely shutdown SimpliVity cluster with internal v...
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-06-2019 08:29 AM
тАО08-06-2019 08:29 AM
Hello,
What is the procedure to safely shutdown a 4 nodes SImpliVity cluster with vCSA VM hosted by this cluster?
Thanks !
Solved! Go to Solution.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-06-2019 08:57 AM
тАО08-06-2019 08:57 AM
SolutionHello @jfc
Normally you would shutdown all vms (or evacuate them) and shutdown the Omnistack controller before shutting down the host. The recommended method to shutdown the Omnistack controller is to connect via putty (SSH) and run the command "svt-shudown-safe" and wait until it's down.
Now, this command won't work when you you power off the VCSA VM so you need an alternate method. I would suggest doing the following:
1. Work first on the hosts that don't have the VCSA running on them.
2. Shutdown all VMs.
3. Connect via putty to the Omnistack controller and run the command "svt-shutdown-safe". Wait until you see it turned off in vcenter.
4. Put the node in maintenance mode and shut it down.
For the host that has VCSA running on it:
1. Shutdown all VMs except OmniStack controller.
2. Connect to the Omnistack controller via putty (SSH). Since VCSA will be down, you won't be able to use Vcenter credentials. Instead, use your svtcli account to log in.
3. Once logged in, run these commands:
-- sudo su
-- source /var/tmp/build/bin/appsetup
-- stop svtfs (wait until you get the prompt back and says "stop/waiting")
-- shutdown -hy now
This is going to shutdown the OVC gracefully.
Continue and put this host in maintenance mode and shut it down.
NOTE: The above procedure assumes you are running software version 3.7.3 or later. If you are on an older version you will need to contact support for assistance.
Hope it helps,
Gus
I am an HPE employee.
[Any personal opinions expressed are mine, and not official statements on behalf of Hewlett Packard Enterprise]
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО09-15-2020 12:00 PM
тАО09-15-2020 12:00 PM
Re: Safely shutdown SimpliVity cluster with internal vCenter Server Appliance
Hi!
Is this still a valid method to properly shutdown a SimpliVity cluster?
I need to shutdown a customers 2-node cluster for maintenace next week.
Running on OmniStack 4.0.1
Br / Tony
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО09-15-2020 12:15 PM
тАО09-15-2020 12:15 PM
Re: Safely shutdown SimpliVity cluster with internal vCenter Server Appliance
Hello @fahlis
The only command that changes is -- stop svtfs (wait until you get the prompt back and says "stop/waiting")
Use instead "systemctl stop svtfs@0" in version 4.0.1
I am an HPE employee.
[Any personal opinions expressed are mine, and not official statements on behalf of Hewlett Packard Enterprise]
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО09-15-2020 12:23 PM
тАО09-15-2020 12:23 PM
Re: Safely shutdown SimpliVity cluster with internal vCenter Server Appliance
Many thanks.
Then I feel confident.
Is there perhaps a white paper available for the procedure?
Br / Tony
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО09-15-2020 12:36 PM
тАО09-15-2020 12:36 PM
Re: Safely shutdown SimpliVity cluster with internal vCenter Server Appliance
Check our video library with the procedure:
https://support.hpe.com/hpesc/public/docDisplay?docLocale=en_US&docId=sf000045407en_us
I am an HPE employee.
[Any personal opinions expressed are mine, and not official statements on behalf of Hewlett Packard Enterprise]
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО09-15-2020 12:51 PM
тАО09-15-2020 12:51 PM
Re: Safely shutdown SimpliVity cluster with internal vCenter Server Appliance
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО09-30-2020 08:37 PM
тАО09-30-2020 08:37 PM
Re: Safely shutdown SimpliVity cluster with internal vCenter Server Appliance
I had some issues with this.
It worked just fine until after the step.
"systemctl stop svtfs@0"
At this point the OVC stalled and nothing happened for approx 30min.
I then decided to power it off.
Set the host in maintenance mode and shut down.
Crossed my fingers and booted up after maintenance window and found all VMs on that node as "inaccessible"
Exit maintenance mode.
The OVC could not start.
Enter maintenance mode again.
One more reboot and lucky for me it worked.
I don't know what the cause of OVC stalling was.
Any hints?
Br /Tony
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО11-09-2020 12:45 PM - edited тАО11-12-2020 12:02 PM
тАО11-09-2020 12:45 PM - edited тАО11-12-2020 12:02 PM
Re: Safely shutdown SimpliVity cluster with internal vCenter Server Appliance
I replied to this some time ago but it seems my post never made it. So I'll try again, albeit more condensed than my original.
I had the same problem when I first performed maintenance on an inherited SimpliVity Cluster, specifically one I upgrade from one node to two nodes. I was doing a firmware upgrade and had to fail-over to one node. The arbiter and VCSA are running inside the cluster, which isn't best practice, but there you go. When I failed over to one node I lost all storage as the remaining OVC split-brained, all the VMs just stopped including vCenter, OVC, etc. My problem was maintenance of one and yours is shutdown of both of the nodes but similar problems happened.
The correct process is this:
- Before you start, you'll want to make sure you have https access to each vmware node, vmware root account for each node, ssh access and account to OVC
- SSH to an OVC in the cluster and check that each VM is in storage HA: svt-vm-show --violationsтАЛ
- Storage vMotion the Arbiter to local storage and compute of a node that will be shutdown last
- Storage vMotion the VCSA to local storage and compute of the same node as 1 that will be shutdown last
- On each of the nodes gracefully shutdown all VMs except the Arbiter, VCSA, and OVCs. Clearly do this in proper order for your environment, such as domain controllers last, etc.
- Proceed with safe shutdown of the OVC of each node (Using SSH, one at a time), they should gracefully shutdown: svt-shutdown-safeтАЛ
- Hosts should now successfully enter maintenance mode.
- Shut down the VMware hosts until you get to the last one running Arbiter and VCSA
- Sign-in to the HTTPS management page of this VMware host
- The OVC should be shutdown, now gracefully shutdown the Arbiter and VCSA. You will lose VCSA oversight as it shuts down.
- Shut down the host with the management page you opened earlier
The power on process is in reverse:
- Power on each host
- When fully up, power on VCSA and Arbiter, when fully up proceed
- Ensure you can sign-in to VCSA without issue, if so proceed
- Power on OVC on each host
- SSH to each OVC and monitor the startup of SVTFS. Once it has a post-start process everything should be nearly running: watch status svtfsтАЛ
Every 2.0s: status svtfs
svtfs (0) start/post-start, process 3499 post-start process 5002 - Staying on OVC check the federation status and should be connected: svt-federation-showтАЛ
- Check to ensure the VMs are in HA then start powering them on: svt-vm-show --violationsтАЛ . If not let them sychronize then power on
- Monitor servers and they should boot up ok
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО11-19-2020 11:46 AM
тАО11-19-2020 11:46 AM
Re: Safely shutdown SimpliVity cluster with internal vCenter Server Appliance
Thanks for your reply and guide. I will progress in that order next time. You really should take the Arbiter out of the Simplivity cluster. Having it within the Simplivity cluster is "Shoot yourself in the foot" as I'm sure you are aware of.