Would you like de-dupe and auto-tiering with that?

What I’ve noticed for a while now is customers will always ask for these features and whilst they are great technologies, I see little relevance for them in today’s SDS environments. Why is that you ask? Well, if you look at auto-tiering this was introduced into storage arrays 10 years ago when SSD’s were really expensive. The SSD’s in the storage array were used to store hot blocks of data and overtime auto-tier those blocks down to magnetic media as the data got colder. In order to keep track of those blocks the storage array will need to consume extra CPU and memory to continuously run algorithms to find out which blocks to move and which blocks not to move…yet. Now that SSD’s are at the cross point of being cost competitive with magnetic media, the notion of auto-tiering will be irrelevant in the very near future if you ask me.

One huge benefit of going all SSD is that you don’t have to worry about which type of volume to assign or is their enough performance for the application to consume. Just assign an all SSD volume and these operational tasks are gone. You’re probably thinking well what about moving blocks of data from NVMe to SSD? I don’t know of any single application that requires 100K IOPs let alone millions and if the SDS system is capable of scaling to millions of IOPs with sub-millisecond latencies with just SSD media then why do you need to auto-tier? Also, with NVMe media being introduced today the adoption rate will be slow as they will be used for specific applications that require extremely low nanosecond latencies, not necessarily for IOPs. These are usually in the form of high compute financial trading applications or complex scientific calculations. Just a handful when compared to the majority of applications that run in your datacenter today.

Next is de-duplication; again, fantastic technology but it was solely designed for the backup world – not for primary storage. De-duplication is very, very CPU and memory heavy and is usually performed as a post process as compared to inline as it needs to compare all blocks of data against data that is already written to disk and find out what is duplicate. Imagine the performance impact of doing everything all at once; storage and backup. Yes, some may say that CPU’s are getting faster so it shouldn’t matter but remember that the most expensive component in a server is the CPU and memory so shouldn’t you maximize your investment by running as many VM’s as possible? If you have to reserve CPU and memory to perform auto-tiering and de-duplication, which if you ask me will save you anywhere between 5-10% total storage, you might as well buy more storage since it is cheaper than buying more CPU and memory. By reducing the VM count per server will ultimately mean more hardware and more real-estate in your datacenter.

Remember, SSD’s are getting cheaper and fatter so the cost of buying more storage is way more cost effective than buying more servers to run your VM’s. Vendors who can offload these data services onto a proprietary card (HW lock in!) or can do both primary storage and backup on to the same appliance to me is a single point of failure. It’s like asking your backup admin to also be the storage admin which in most organisations will violate compliance as that single person will have too much control of your environment. Segregation of duties is very important. Imagine collapsing storage, backup, virtualisation, network and server teams into a single person in your datacenter? Might be perfect for ROBO use cases but never for the enterprise datacenter! 

Comments

Post a Comment

Popular posts from this blog

Attack of the tools!

As part of my last post that showed who was attacking who around the globe, in this post I will focus on the recent ransomware attacks. I’m pretty sure we’ve all heard in the news of the WannaCry ( https://en.wikipedia.org/wiki/WannaCry_ransomware_attack ) and Nyetya ( http://blog.talosintelligence.com/2017/06/worldwide-ransomware-variant.html ) attacks and the devastating effects that this has caused to corporations and people around the globe. For those that don’t know, these would be attackers would try to gain access to your computer system by exploiting a vulnerability in an un-patched Windows operating system. The attackers would then encrypt your system rendering your files useless until you pay the ransom, hence ransomware, for the decryption key. These payments are usually in the form of bitcoin and it is nearly impossible to track who these attackers are and you are never guaranteed to get the decryption key after paying the ransom. So, as part of any data protection strateg...
Keep reading

Who's attacking who?

Image
These days with the super powers pointing the finger at each other for cyber warfare, I was interested to find out where they do they really originate from? After a bit of Googling there are quite a few websites from security vendors that show real time cyber-attacks occurring across the globe. I was quite surprised to see that it’s not just the super powers but nearly every nation and some are even attacking themselves! So, if you have nothing better to do and want to make your monitor look busy, visit the below sites and bring some popcorn. You might even spot the next ransomware attack!         http://map.norsecorp.com/#/   https://threatmap.checkpoint.com/ThreatPortal/livemap.html
Keep reading

Why one Software Defined Storage solution will rule them all!!!

Image
In my travels across Asia I’ve spoken to many customers to showcase the merits of running their datacenter with software defined storage. If webscalers like Google and Facebook can run their datacenter using commodity x86 servers along with software defined storage, why can’t you? When was the last time you saw 404 in your browser when accessing Google or Facebook? In this blog post I’ll describe why you should consider Dell EMC ScaleIO as the ONLY software defined block storage solution that not only replaces traditional SAN but can also run in hyperconverged environments. No other solution in the market today can run both at the same time in the same cluster for any application at any scale! Software defined storage has been around for a short period of time and yet it has garnered a lot of attention over the years. There are many solutions out there in the market that claim to be the leader and that’s ok. What you need to understand first and foremost is the architecture of how...
Keep reading