- Community Home
- >
- Storage
- >
- Midrange and Enterprise Storage
- >
- StoreVirtual Storage
- >
- Broke It - Help!
StoreVirtual Storage
1753703
Members
4668
Online
108799
Solutions
Forums
Categories
Company
Local Language
back
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Discussions
back
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Blogs
Information
Community
Resources
Community Language
Language
Forums
Blogs
Topic Options
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
10-06-2010 09:24 AM
10-06-2010 09:24 AM
Broke It - Help!
OK bit of a drastic subject line and fortunately it's an eval unit, but today we managed to do something we didn't expect.
Two P4500 12 disk nodes in a single cluster connected to the same switch.
We'd been pulling various cables/drives to simulate failure modes and with the FOM installed and running we were blown away at the whole "5 pings lost and it's back" thing when you pull a node completely.
However, then we pulled "Node 2" (we just pulled both NICs for speed) and the group IP was no longer pingable.
Upon investigation it would seem that what happened was that on "Node 1", the manager had somehow got stopped, so with us losing Node 2 deliberately all we now had left working was Node 1 with no manager, and a FOM.
We just could not connect to Node 1 as (I think) you connect to a management group by the group IP, which was dead, so I was in a chicken and egg where (I think) I knew I needed to start the manager on Node 1, but I couldn't log onto the group IP to do so because two managers were down so no quorum.
The solution was to reconnect the NICs to the second node so the quorum came back, and to then start the manager on the first node - but in a full on disaster we may not have that luxury.
What have I missed?
Two P4500 12 disk nodes in a single cluster connected to the same switch.
We'd been pulling various cables/drives to simulate failure modes and with the FOM installed and running we were blown away at the whole "5 pings lost and it's back" thing when you pull a node completely.
However, then we pulled "Node 2" (we just pulled both NICs for speed) and the group IP was no longer pingable.
Upon investigation it would seem that what happened was that on "Node 1", the manager had somehow got stopped, so with us losing Node 2 deliberately all we now had left working was Node 1 with no manager, and a FOM.
We just could not connect to Node 1 as (I think) you connect to a management group by the group IP, which was dead, so I was in a chicken and egg where (I think) I knew I needed to start the manager on Node 1, but I couldn't log onto the group IP to do so because two managers were down so no quorum.
The solution was to reconnect the NICs to the second node so the quorum came back, and to then start the manager on the first node - but in a full on disaster we may not have that luxury.
What have I missed?
The opinions expressed above are the personal opinions of the authors, not of Hewlett Packard Enterprise. By using this site, you accept the Terms of Use and Rules of Participation.
News and Events
Support
© Copyright 2024 Hewlett Packard Enterprise Development LP