topic Re: Calculate Over provisioned space in 3PAR StoreServ Storage
https://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6996953#M3979
<P>I'm also interested in calculating overprovisioning since we compress all VV that are also thin on our 8450's and 20850's..</P><P>So what is the exact formula and what should be divided by what (no small excel available ?) .</P><P>It been very confusing , all figure presented by CLI anfd GUI , even after 1,5 years working on 3PAR</P><P>Customer from Belgium</P>Wed, 14 Feb 2018 07:29:22 GMTMvhkbc2018-02-14T07:29:22ZCalculate Over provisioned space
https://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6995907#M3938
<P>I need to calculate how much space is overprovisioned in raw format, We have to maintain certain amount of over provisioning per environment. I get the actual usage using showvv, where as showsys gives me in raw. I need to convert my actual usage to raw. I do get the raw reserved, but that is not actual allocation value. Here is my showsys and showvv (trunkated output for better reading). </P><P>As you can see from the output, I have 307TiB total , 195TiB allocated and 112TiB free space. 195TiB is allocated (180TiB for volumes and 14 TiB for system includes internal and sparing). 180TiB is raw reserved and not actual allocation. 262Tib of space is actually allocated. Clearely this array is already way overprovisioned, but I don't know how much unless I convert the 262TiB to raw (also separate overhead value). Any idea how to calculate this ? Appreciate your insight</P><P>my3par cli% showsys -space<BR />------------- System Capacity (MB) --------------<BR />Total Capacity : <FONT size="5"><STRONG>322424832</STRONG></FONT><BR />Allocated : <STRONG><FONT size="5">204573696</FONT></STRONG><BR />Volumes : <STRONG><FONT size="5">189517824</FONT></STRONG><BR />Non-CPGs : 0<BR />User : 0<BR />Snapshot : 0<BR />Admin : 0<BR />CPGs (TPVVs & TDVVs & CPVVs) : 189517824<BR />User : 184893736<BR />Used : 184893736<BR />Used (Bulk VVs) : 0<BR />Unused : 0<BR />Snapshot : 3481304<BR />Used : 3414<BR />Used (Bulk VVs) : 0<BR />Unused : 3477890<BR />Admin : 1142784<BR />Used : 620160<BR />Used (Bulk VVs) : 0<BR />Unused : 522624<BR />Unmapped : 0<BR />System : 15055872<BR />Internal : 465920<BR />Spare : 14589952<BR />Used : 0<BR />Unused : 14589952<BR />Free : <FONT size="5"><STRONG>117847040</STRONG></FONT><BR />Initialized : 117847040<BR />Uninitialized : 0<BR />Unavailable : 0<BR />Failed : 4096<BR />-------------- Capacity Efficiency --------------<BR />Compaction : 2.0<BR />Dedup : ---------</P><P>my3par cli% showvv<BR />------Rsvd(MB)------- --(MB)---<BR />Id Name Prov Type CopyOf BsId Rd -Detailed_State- Adm Snp Usr VSize<BR />1 .srdata full base --- 1 RW normal 0 0 81920 81920<BR />0 admin full base --- 0 RW normal 0 0 10240 10240<BR />-----------------------------------------------------------------------------------------------------------------<BR />419 total 206720 2560 138762496 <FONT size="5"><STRONG>274768896</STRONG></FONT></P>Fri, 02 Feb 2018 14:15:14 GMThttps://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6995907#M3938sakshymn2018-02-02T14:15:14ZRe: Calculate Over provisioned space
https://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6996015#M3942
<P>Have you looked at "showvv -r" or "showvv -space"?</P>Sun, 04 Feb 2018 01:39:20 GMThttps://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6996015#M3942Dennis Handly2018-02-04T01:39:20ZRe: Calculate Over provisioned space
https://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6996140#M3945
<P>I did look at showvv -r and showvv -space. Here is the output. All I see the actual allocation value, not raw.</P><P>my3par cli% showvv -r<BR />------------------------------------(MB)-------------------------------------<BR />-----Adm------ ----Snp----- --------Usr-------- --------Tot--------<BR />Id Name Prov Type RawRsvd Rsvd RawRsvd Rsvd RawRsvd Rsvd RawRsvd Rsvd VSize</P><P>-----------------------------------------------------------------------------------------------------------------------------<BR />419 total 620160 206720 3415 2560 185114785 138790144 185738359 138999424 <FONT size="5"><STRONG>274768896</STRONG></FONT></P><P>my3par cli% showvv -space<BR />----Adm----- ---------Snp---------- ---------------Usr---------------<BR />----(MB)---- --(MB)--- -(% VSize)-- -------(MB)-------- --(% VSize)-- -------(MB)-------- -Capacity Efficiency-<BR />Id Name Prov Type Rsvd Used Rsvd Used Used Wrn Lim Rsvd Used Used Wrn Lim Tot_Rsvd</P><P>---------------------------------------------------------------------------------------------------------------------------------------------------------------<BR />419 total 206720 88511 2560 0 138790144 137360689 138999424 <FONT size="5"><STRONG>274768896</STRONG></FONT> 2.0 --</P>Tue, 06 Feb 2018 01:11:19 GMThttps://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6996140#M3945sakshymn2018-02-06T01:11:19ZRe: Calculate Over provisioned space
https://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6996363#M3951
<P>showvv -r will show both raw space & user space.</P><P>RawSpace -> RawRsvd</P><P>UserSpace -> Rvsd</P><P>Attached screenshots which will be helpfull for you to match vv space with 3par used space.</P><P>Showsys space will show detail spilt of cpacity</P>Thu, 08 Feb 2018 11:50:11 GMThttps://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6996363#M3951mrsr21742018-02-08T11:50:11ZRe: Calculate Over provisioned space
https://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6996863#M3973
274768896 Is the provisioned space through showvv (around 262 TiB). I cannot find a raw equivalent for itTue, 13 Feb 2018 15:49:53 GMThttps://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6996863#M3973sakshymn2018-02-13T15:49:53ZRe: Calculate Over provisioned space
https://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6996953#M3979
<P>I'm also interested in calculating overprovisioning since we compress all VV that are also thin on our 8450's and 20850's..</P><P>So what is the exact formula and what should be divided by what (no small excel available ?) .</P><P>It been very confusing , all figure presented by CLI anfd GUI , even after 1,5 years working on 3PAR</P><P>Customer from Belgium</P>Wed, 14 Feb 2018 07:29:22 GMThttps://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6996953#M3979Mvhkbc2018-02-14T07:29:22ZRe: Calculate Over provisioned space
https://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6996959#M3982
<P>If you factor in compress things get complicated. Let's look at the basics:</P><P>1. Say you have a 3PAR with SAS disks only, after RAID the total usable capacity is 50TiB.<BR />2. You start provisioning THIN volumes, and you've provisioned 50TiB worth of volumes. However, the actual used space is only 10TiB with the rest of 40TiB "saved" or "avoided" due to the thin provisioning feature. At this point you are NOT yet overprovisioning.<BR />3. Now you provision another 50TiB, for a total of 100TiB usable to your hosts. However, due to thin provisioning savings - you are only using 20TiB now. You have provisioned 100TiB of space, but only consumed 20TiB of space and have approximately 30TiB usable free still. At this point, you ARE already overprovisioning.<BR /><BR />Now throw in dedupe/compression in the scenario above, you might end up with:<BR />1. Provisioned 100TiB usable, however with dedupe/compression you end up using only 10TiB instead of 20TiB (just with thin). And you have 40TiB usable capacity "free".</P><P>At this point, you will see that it's very hard and also it's pointless to see how much you're overprovisioning, because you can't really tell the savings you will get from dedupe/compression as you add more workloads. If for example, you do a clone of all volumes and double up the provisioned space to 200TiB, the actual used might still be at 10TiB (as all clones are just "deduped").</P><P>Or in another extreme case - you suddenly throw in 20TiB of PDF, MP3, video or encrypted files. None of these will compress well, so you will start to consume a lot of space without much savings from compression. The overprovisioning number doesn't mean anything here, but your overall data reduction and free space will start to drop.</P><P>IMHO, more important is for you to monitor these metrics instead :<BR />1. What is the total usable capacity of your 3PAR - you can get this from your HPE sales/presales with their sizer tool output or if you have only 1 CPG, look in the SSMC GUI for that CPG it will tell you how much of usable capacity you have without factoring in thin or dedupe/compress. This is your usable capacity before data reduction.<BR />2. Monitor the data reduction ratio, and the free space available. Follow ITIL best practices and ensure that you have a free space threshold set based on your workload (70%, 80%, etc... it's unique to your environment depending on your data growth and also procurement cycle to get more disks in). Then use that to monitor and plan. The actual usable capacity will be your capacity x data reduction ratio, e.g. if you have 50TiB usable, and on average you're getting 3:1 data reduction, the total usable capacity is approximately 150TiB (just from dedupe/compress, excluding thin savings).</P><P>If you're using an 8450/20850 with compression, then you're running on 3.3.1 - if you look at the output of "showsys -space" you can see system wide data reduction numbers at the bottom of that output. Also you can work out the % of free space you have vs the total.</P>Wed, 14 Feb 2018 07:56:57 GMThttps://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6996959#M3982yapkl2018-02-14T07:56:57ZRe: Calculate Over provisioned space
https://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6997449#M3998
<P>Thanks <SPAN>yapkl for the detailed reply. 3PAR is not the only one does thin and de-dupe. I have netapp cluster mode where we do thin provisioning heavily. Netapp let's me calculate overprovisioned capacity. There has to be a way to tell, even if a rough number will be ideal. I plan to open a ticker with HP to see if they can share some insight. Will update this thread if I get usable solution.</SPAN></P>Mon, 19 Feb 2018 19:29:24 GMThttps://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6997449#M3998sakshymn2018-02-19T19:29:24ZRe: Calculate Over provisioned space
https://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6997474#M4000
<P>In CLI "showsys -space" you should be able to see overprovisioning info. Opening a call to HPE is a good idea to get confirmation.</P><P> </P>Tue, 20 Feb 2018 01:27:20 GMThttps://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6997474#M4000yapkl2018-02-20T01:27:20ZRe: Calculate Over provisioned space
https://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6997790#M4011
<P>Hi Mrsr,</P><P>Can you please clarify the difference between,</P><P>Allocated Capacity from showsys -space and overall Vsize from showvv -r?</P><P>Allocation capacity should be equal to overall vvsize I am guessing? In case, we have tpvv, does te allocation capacity mean the physical capacity allocated??</P><P> </P>Thu, 22 Feb 2018 14:23:15 GMThttps://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6997790#M4011kisalipa2018-02-22T14:23:15ZRe: Calculate Over provisioned space
https://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6997794#M4012
Perhaps this might help explain.. <A href="https://d8tadude.com/2014/07/31/viewing-free-capacity-in-3par/" target="_blank">https://d8tadude.com/2014/07/31/viewing-free-capacity-in-3par/</A>Thu, 22 Feb 2018 14:32:28 GMThttps://community.hpe.com/t5/3par-storeserv-storage/calculate-over-provisioned-space/m-p/6997794#M4012yapkl2018-02-22T14:32:28Z