Can we get a side of context with them IOPS server storage metrics?

Can we get a side of context with them server storage metrics?

Whats the best server storage I/O network metric or benchmark? It depends as there needs to be some context with them IOPS and other server storage I/O metrics that matter.

There is an old saying that the best I/O (Input/Output) is the one that you do not have to do.

In the meantime, let’s get a side of some context with them IOPS from vendors, marketers and their pundits who are tossing them around for server, storage and IO metrics that matter.

Expanding the conversation, the need for more context

The good news is that people are beginning to discuss storage beyond space capacity and cost per GByte, TByte or PByte for both DRAM or nand flash Solid State Devices (SSD), Hard Disk Drives (HDD) along with Hybrid HDD (HHDD) and Solid State Hybrid Drive (SSHD) based solutions. This applies to traditional enterprise or SMB IT data center with physical, virtual or cloud based infrastructures.

This is good because it expands the conversation beyond just cost for space capacity into other aspects including performance (IOPS, latency, bandwidth) for various workload scenarios along with availability, energy effective and management.

Adding a side of context

The catch is that IOPS while part of the equation are just one aspect of performance and by themselves without context, may have little meaning if not misleading in some situations.

Granted it can be entertaining, fun to talk about or simply make good press copy for a million IOPS. IOPS vary in size depending on the type of work being done, not to mention reads or writes, random and sequential which also have a bearing on data throughout or bandwidth (Mbytes per second) along with response time. Not to mention block, file, object or blob as well as table.

However, are those million IOP’s applicable to your environment or needs?

Likewise, what do those million or more IOPS represent about type of work being done? For example, are they small 64 byte or large 64 Kbyte sized, random or sequential, cached reads or lazy writes (deferred or buffered) on a SSD or HDD?

How about the response time or latency for achieving them IOPS?

In other words, what is the context of those metrics and why do they matter?

Click on image to view more metrics that matter including IOP’s for HDD and SSD’s

Metrics that matter give context for example IO sizes closer to what your real needs are, reads and writes, mixed workloads, random or sequential, sustained or bursty, in other words, real world reflective.

As with any benchmark take them with a grain (or more) of salt, they key is use them as an indicator then align to your needs. The tool or technology should work for you, not the other way around.

Here are some examples of context that can be added to help make IOP’s and other metrics matter:

• What is the IOP size, are they 512 byte (or smaller) vs. 4K bytes (or larger)?
• Are they reads, writes, random, sequential or mixed and what percentage?
• How was the storage configured including RAID, replication, erasure or dispersal codes?
• Then there is the latency or response time and IO queue depths for the given number of IOPS.
• Let us not forget if the storage systems (and servers) were busy with other work or not.
• If there is a cost per IOP, is that list price or discount (hint, if discount start negotiations from there)
• What was the number of threads or workers, along with how many servers?
• What tool was used, its configuration, as well as raw or cooked (aka file system) IO?
• Was the IOP’s number with one worker or multiple workers on a single or multiple servers?
• Did the IOP’s number come from a single storage system or total of multiple systems?
• Fast storage needs fast serves and networks, what was their configuration?
• Was the performance a short burst, or long sustained period?
• What was the size of the test data used; did it all fit into cache?
• Were short stroking for IOPS or long stroking for bandwidth techniques used?
• Data footprint reduction (DFR) techniques (thin provisioned, compression or dedupe) used?
• Were write data committed synchronously to storage, or deferred (aka lazy writes used)?

The above are just a sampling and not all may be relevant to your particular needs, however they help to put IOP’s into more contexts. Another consideration around IOPS are the configuration of the environment, from an actual running application using some measurement tool, or are they generated from a workload tool such as IOmeter, IOrate, VDbench among others.

Sure, there are more contexts and information that would be interesting as well, however learning to walk before running will help prevent falling down.

Does size or age of vendors make a difference when it comes to context?

Some vendors are doing a good job of going for out of this world record-setting marketing hero numbers.

Meanwhile other vendors are doing a good job of adding context to their IOP or response time or bandwidth among other metrics that matter. There is a mix of startup and established that give context with their IOP’s or other metrics, likewise size or age does not seem to matter for those who lack context.

Some vendors may not offer metrics or information publicly, so fine, go under NDA to learn more and see if the results are applicable to your environments.

Likewise, if they do not want to provide the context, then ask some tough yet fair questions to decide if their solution is applicable for your needs.

Where To Learn More

View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

• Can we get a side of context with them IOPS and other storage metrics?
• WHEN AND WHERE TO USE NAND FLASH SSD FOR VIRTUAL SERVERS
• Revisiting RAID storage remains relevant and resources
• NVMe overview and primer – Part I
• Part 1 of HDD for content servers series Trends and Content Application Servers
• Part 2 of HDD for content servers series Content application server decisions and testing plans
• Part 3 of HDD for content servers series Test hardware and software configuration
• Part 4 of HDD for content servers series Large file I/O processing
• Part 5 of HDD for content servers series Small file I/O processing
• Part 6 of HDD for content servers series General I/O processing
• Part 7 of HDD for content servers series How HDD continue to evolve over different generations and wrap up
• As the platters spin, HDD’s for cloud, virtual and traditional storage environments
• How many IOPS can a HDD, HHDD or SSD do?
• Hard Disk Drives (HDD) for Virtual Environments
• Server and Storage I/O performance and benchmarking tools
• Server storage I/O performance benchmark workload scripts Part I and Part II
• How to test your HDD, SSD or all flash array (AFA) storage fundamentals
• What is the best server storage I/O workload benchmark? It depends
• I/O, I/O how well do you know about good or bad server and storage I/Os?
• Big Files Lots of Little File Processing Benchmarking with Vdbench
• Part II – NVMe overview and primer (Different Configurations)
• Part III – NVMe overview and primer (Need for Performance Speed)
• Part IV – NVMe overview and primer (Where and How to use NVMe)
• Part V – NVMe overview and primer (Where to learn more, what this all means)
• PCIe Server I/O Fundamentals
• If NVMe is the answer, what are the questions?
• NVMe Wont Replace Flash By Itself
• Via Computerweekly – NVMe discussion: PCIe card vs U.2 and M.2
• Intel and Micron unveil new 3D XPoint Non Volatie Memory (NVM) for servers and storage
• Part II – Intel and Micron new 3D XPoint server and storage NVM
• Part III – 3D XPoint new server storage memory from Intel and Micron
• Server storage I/O benchmark tools, workload scripts and examples (Part I) and (Part II)
• Data Infrastructure Overview, Its Whats Inside of Data Centers
• All You Need To Know about Remote Office/Branch Office Data Protection Backup (free webinar with registration)
• Software Defined, Converged Infrastructure (CI), Hyper-Converged Infrastructure (HCI) resources
• The SSD Place (SSD, NVM, PM, SCM, Flash, NVMe, 3D XPoint, MRAM and related topics)
• The NVMe Place (NVMe related topics, trends, tools, technologies, tip resources)
• Data Protection Diaries (Archive, Backup/Restore, BC, BR, DR, HA, RAID/EC/LRC, Replication, Security)
• Software Defined Data Infrastructure Essentials (CRC Press 2017) including SDDC, Cloud, Container and more
• Various Data Infrastructure related events, webinars and other activities
• www.objectstoragecenter.com and Software Defined, Cloud, Bulk and Object Storage Fundamentals
• Server Storage I/O Network PCIe Fundamentals

Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

What This All Means

What this means is let us start putting and asking for metrics that matter such as IOP’s with context.

If you have a great IOP metric, if you want it to matter than include some context such as what size (e.g. 4K, 8K, 16K, 32K, etc.), percentage of reads vs. writes, latency or response time, random or sequential.

IMHO the most interesting or applicable metrics that matter are those relevant to your environment and application. For example if your main application that needs SSD does about 75% reads (random) and 25% writes (sequential) with an average size of 32K, while fun to hear about, how relevant is a million 64 byte read IOPS? Likewise when looking at IOPS, pay attention to the latency, particular if SSD or performance is your main concern.

Get in the habit of asking or telling vendors or their surrogates to provide some context with them metrics if you want them to matter.

So how about some context around them IOP’s (or latency and bandwidth or availability for that matter)?

Ok, nuff said, for now.

Gs

Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.