- Community Home
- >
- Storage
- >
- HPE Nimble Storage
- >
- Array Performance and Data Protection
- >
- Re: Nimble Storage Deduplication?
Categories
Company
Local Language
Forums
Discussions
Forums
- Data Protection and Retention
- Entry Storage Systems
- Legacy
- Midrange and Enterprise Storage
- Storage Networking
- HPE Nimble Storage
Discussions
Discussions
Discussions
Forums
Forums
Discussions
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
- BladeSystem Infrastructure and Application Solutions
- Appliance Servers
- Alpha Servers
- BackOffice Products
- Internet Products
- HPE 9000 and HPE e3000 Servers
- Networking
- Netservers
- Secure OS Software for Linux
- Server Management (Insight Manager 7)
- Windows Server 2003
- Operating System - Tru64 Unix
- ProLiant Deployment and Provisioning
- Linux-Based Community / Regional
- Microsoft System Center Integration
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Discussion Boards
Community
Resources
Forums
Blogs
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-04-2014 07:06 AM
тАО08-04-2014 07:06 AM
Hi all,
I want to understand how deduplication of nimble storage work but i can't see any document about that. Maybe i miss to find that. Please someone can tell me about that !
Thanks !!
Solved! Go to Solution.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-04-2014 07:32 AM
тАО08-04-2014 07:32 AM
SolutionCurrently the Nimble OS only support LZ4 compression. Because the array has such a low cost per GB, we don't need to deploy De-duplication to save storage space. Deduplication for primary storage only helps save storage in a couple specific workloads. Deploying deduplication for VDI clones workloads for example don't save you much.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-04-2014 09:00 AM
тАО08-04-2014 09:00 AM
Re: How nimble storage deduplication ?
Thank you, but can you explain for me how LZ4 compression work ?, and how much percent capacity space reduced when compressed ?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-04-2014 09:23 AM
тАО08-04-2014 09:23 AM
Re: How nimble storage deduplication ?
RealTime Data Compression: LZ4 explained here's a good explanation.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-04-2014 10:39 AM
тАО08-04-2014 10:39 AM
Re: How nimble storage deduplication ?
Hoang DV. Given the fact that we have Infosight, and thus an insane amount of detail about a customers data we can tell you that we average around 50% compression (as a total customer average). However, as you know all workloads are different and your individual mileage may vary. While databases tend to skew the graph higher, video files etc move it in the opposite direction (as they offer no compression). We can see file share data being highly compressable at times as well. Exchange data, OS Volumes etc are compressable as well, to what extent will again, vary based on your particular data sampling.
Hope that helps.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-04-2014 11:42 AM
тАО08-04-2014 11:42 AM
Re: Nimble Storage Deduplication?
Hoang,
If you really want to know the gory details, here are more some good articles:
LZ4 (compression algorithm) - Wikipedia, the free encyclopedia
lz4 - Extremely Fast Compression algorithm - Google Project Hosting
Wow, LZ4 is fast! - Adrien Grand
My point in sharing this is that while there are other algorithms that can provide slightly better compression ratios, Nimble chose LZ4 because of its speed - which is critical when you're designing an enterprise disk array.
Is there a particular type of workload in which you're interested? I could probably look up some average compression ratios for you.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО08-04-2014 03:54 PM
тАО08-04-2014 03:54 PM
Re: Nimble Storage Deduplication?
Thanks about your support, this really helpful for me !
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-03-2016 11:13 AM
тАО03-03-2016 11:13 AM
Re: Nimble Storage Deduplication?
I know this has already been flagged as answered but aren't we talking two entirely different things here?
Compression and deduplication aren't the same thing at least not from my understanding of what each does and how it does it.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-09-2016 10:48 AM
тАО03-09-2016 10:48 AM
Re: Nimble Storage Deduplication?
Hi John,
Thank you for bumping this thread. We actually have a great blog post discussing Nimble's entire data reduction approach following the launch of our all flash arrays. It goes into deduplication, inline compression, zero-pattern elimination, and zero-copy clones. There is also an in-depth technical blog post for our Nimble OS 3.0 blog that discusses dedupe from an engineering perspective.
I hope this provides a better picture of what you're asking about.
All Flash: Data Reduction Beyond Dedupe | Nimble Storage
Dedupe тАУ An Engineer Looks Under the Hood
Cheers,
Kat Usavage - NimbleConnect Admin
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
тАО03-09-2016 10:59 AM
тАО03-09-2016 10:59 AM
Re: Nimble Storage Deduplication?
Kat,
Thanks very much for this info. Nice to know that this is coming!