Can't remove missing disk group from MSA2050

BeerChaser — Wed, 17 Aug 2022 04:45:23 GMT

There is an MSA2050 in which there is a pool A of three disk groups dgA01, dgA02 and dgA03

Raid-5 dgA03 by the will of fate and crooked little hands was destroyed beyond repair.
It was decided to remove the dgA03 disk group from the pool.

And that's where the PROBLEMS arose

with the "remove disk-groups dgA03", the group was seemingly deleted - its disks received the use status and were removed.

But! the group itself remained in pool A, received the status of MSNG (missing)
And the entire pool has received a malfunction status

# show pools
Name Serial Number Blocksize Total Size Avail Snap Size OverCommit Disk Groups Volumes Low Thresh Mid Thresh
High Thresh Sec Fmt Health Reason
Action
-------------------------------------------------------------------------------------------------------------------------------------
A 00c0ff50dbac000009e61d5e01000000 512 6789.4GB 87.3GB 0B Disabled 3 2 50.00 % 75.00 %
96.83 % Mixed Fault The virtual pool is offline. At least one virtual disk group component is offline.
- Bring the missing virtual disk group back online.
-------------------------------------------------------------------------------------------------------------------------------------
Success: Command completed successfully.

# show disk-groups
Name Size Free Pool Tier % of Pool Own RAID Disks Status Current Job Job% Sec Fmt Health Reason Action
--------------------------------------------------------------------------------------------------------------------------------------
dgA01 797.0GB 28.9GB A Performance 11 A RAID1 2 FTOL VRSC 0% 512e OK
dgA02 5992.3GB 1234.6GB A Standard 88 A RAID6 7 FTOL VRSC 0% 512n OK
dgA03 0B 0B A N/A 0 A N/A 0 MSNG Unknown OK
--------------------------------------------------------------------------------------------------------------------------------------
Success: Command completed successfully.

and now this group dgA03 does not want to be removed at all with very strange behavior (I will give the commands, their output and my comment):

# remove disk-groups dgA03
Error: The requested operation cannot be completed because the virtual pool is unhealthy. - Failed to remove the virtual disk groups. (00c0ff50dbac00004e57e96201000000)
Error: The requested operation cannot be completed because the virtual pool is unhealthy.

"we cannot delete the existing group because the pool is unhealthy" and the number of the disk group is shown heximal (highlighted in bold)
OK, we will try to delete by number

# remove disk-groups 00c0ff50dbac00004e57e96201000000
Error: The disk group was not found on this system. (00c0ff50dbac00004e57e96201000000) - (2022-08-14 12:27:57)
Error: The disk group was not found on this system.

and here we are informed that there is no group with such a number at all !!!

Rescans, restarts of controllers, etc. had no effect
It seems that I have already searched the entire Internet

And what to do? Help with advice pliz!
Maybe there are some undocumented commands executed from under the superuser?

P.S. the firmware of the storage and disks is the latest

Re: Can't remove missing disk group from MSA2050

JonPaul — Tue, 16 Aug 2022 16:36:46 GMT

@BeerChaser
With Virtual Storage, the data on the Pool can reside in any disk-group and therefore ALL the disk-groups are dependent on each other and have metadata including all disk-groups in the pool. A disk-group can be removed from a pool but the disk-group will go into a DRAIN state where the data that is on the disk-group will be migrated to the other disk-groups in the pool only if space is available. Draining a disk-group can take quite a long time depending on the amount of data residing in the disk-group.
From the description it would appear that the DRAIN did not complete correctly and your data may be incomplete.
This really needs to be brought into the HPE support process as your data could be at risk and any suggestions without the full picture could result in permanent loss of data.

topic Can't remove missing disk group from MSA2050 in MSA Storage

Can't remove missing disk group from MSA2050

Re: Can't remove missing disk group from MSA2050