SimpliVity reached 100% physical disk space.

[MGonca3]

Hello There.

My customer has a Simplivity Cluster with 02 nodes. A few weeks ago he started to received messages about capacity 

“SimpliVity OmniCube physical capacity is dangerously low. Usage: 95%".

It look strange because when he went to Vcenter Console he got the follow.

Datastore

Name                                                    Type                               Capacity                          Free

datastore-BRL0020BH2                    VMFS5                            271,75GB                          248.55GB

Simplivity_data01                                 NFS                                4T                                     647.03GB

Simplivity_data02                                 NFS                                4T                                     1.5TB

Simplivity_data03                                 NFS                                4T                                     1.57TB

 Now everything has stopped and the nodes are in the read only state because it reached 100%.

Below is the output of the command "dsv-balance-show -showHiveName -consumption -showNodeIp"

Omnistack host | Node GUID | Space I/O (Read / Write) | Space I/O |
+----------------+-------------------------------- ------+------------------------------+--------------- ------------------+
| 10.255.255.14 | 420c6a24-a501-20b0-0135-8043a62897c7 | 100% 1% ( 592 / 87 ) | 0B ( 22124 / 15057 ) |
| 10.255.255.13 | 420c7ec0-890f-0e14-f585-2a8865ea0211 | 100% 1% ( 592 / 87 ) | 0B (22124/15057)

It is difficult to understand (and explains to the customer) the difference between Physical and Logical disk space utilization.

Any suggestion?

Best Regards

Marco A Da Ronch

[Mr_Techie]

Hello @MGonca3 

This looks similar to your issue. refer this one: 

https://community.hpe.com/t5/hpe-simplivity/simplivity-reached-100-space/td-p/7216027

[Aditya_A]

Hi,
Given that the nodes have already reached a not responding state, I will recommend you to open a P1 ticket and have this addressed.

vCenter metrics don't match SimpliVity storage resources, and one should rely on HPE SimpliVity plugin to monitor the cluster storage. With InfoSight, predictive data trends can be obtained as well.

Moreover, I'd recommend going through this blog to learn more about data management in SimpliVity: https://community.hpe.com/t5/around-the-storage-block/how-vm-data-is-managed-within-an-hpe-simplivity-cluster-part-1/ba-p/7019102

[Aditya_A]

Hi,
Please let me know if you were able to resolve the issue.

[Aditya_A]

Hello,
Let me know if you were able to resolve the issue.
If you have no further query and you are satisfied with the answer then kindly mark the topic as Solved so that it is helpful for all community members.

[MGonca3]

Hi there! The issue wasn't solved. unfortunately our customer to not have an active support contract. This client is a Public Sector customer and they had difficulties to renew the contract when its expired.  They asked us to provide a quote to renew the contract. We are trying to use other alternatives to help them.. Regards

[Aditya_A]

Hi, Thank you for letting me know.

[gustenar]

Hello @MGonca3 

Look at the Storage efficiency page in vCenter to have an idea of what is taking the most space in the cluster. To do this, simply click on the cluster in question and select the "Monitor" tab. Scroll down until you see HPE SimpliVity > Storage Efficiency menu. This is going to give you an idea of what is taken the most space at cluster level. If it is Local backups you can review your local policies and see if you can optimize them. Some VMs may have different backup requirements than others, perhaps split them into different datastores and assign different policies for each. Also, check your retention policies. If there are backups that you no longer need and can delete, that could help with this problem as well. 

You may want to look into very large VMs being hosted and see if you can reduce the size of them, think of the sdelete script available online or other alternatives. Some other helpul tips: 

This is an old one but still useful, how to check for backups of VMs: 

https://support.hpe.com/hpesc/public/docDisplay?docId=sf000067576en_us&docLocale=en_US

Backup strategy considerations

https://support.hpe.com/hpesc/public/docDisplay?docId=sd00004275en_us&page=GUID-FF3CDFC4-CC47-4911-95C5-451AB72A48AF.html&docLocale=en_US

SimpliVity OmniCube Available Physical Capacity 10 Percent or Less

https://support.hpe.com/hpesc/public/docDisplay?docId=sd00004279en_us&page=GUID-BAEDE61C-9245-4243-9798-03D9CADAE47D.html