Storage Optimization: Performance, Availability, Capacity, Effectiveness

Storage I/O trends

With the IT and storage industry shying away from green hype, green washing and other green noise, there is also a growing realization that the new green is about effectively boosting efficiency to improve productivity and profitability or to sustain business and IT growth during tough economic times.

This past week while doing some presentations (I’ll post a link soon to the downloads) at the 2008 San Francisco installment of Storage Decisions event focused on storage professionals, as well as a keynote talk at the value added reseller (VAR) channel professional focused storage strategies event, a common theme was boosting productivity, improving on efficiency, stretching budgets and enabling existing personal and resources to do more with the same or less.

During these and other presentations, keynotes, sessions and seminars both here in the U.S. as well as in Europe recently, these common themes of booting efficiency as well as the closing of the green gap, that is, the gap between industry and marketing rhetoric around green hype, green noise, green washing and issues that either do not resonate with, or, can not be funded by IT organizations compared with the disconnect of where many IT organizations issues exist which are around power, cooling, floor space or footprint as well as EH&S (Environmental health and safety) and economics.

The green gap (here, and here, and here) is that many IT organizations around the world have not realized due to green hype around carbon footprints and related themes that in fact, boosting energy efficiency for active and on-line applications, data and workloads (e.g. doing more I/O operations per second-IOPS, transactions, files or messages processed per watt of energy) to address power, cooling, floor space are in fact a form of addressing green issues, both economic and environmental.

Likewise for inactive or idle data, there is a bit more of a linkage that green can mean powering things off, however there is also a disconnect in that many perceive that green storage for example is only green if the storage can be powered off which while true for in-active or idle data and applications, is not true for all data and applications types.

As mentioned already, for active workloads, green means doing more with the same or less power, cooling and floor space impact, this means doing more work per unit of energy. In that theme, for active workload, a slow, large capacity disk may in fact not be energy efficient if it impedes productivity and results in more energy to get the same amount of work done. For example, larger capacity SATA disk drives are also positioned as being the most green or energy efficiency which can be true for idle or in-active or non performance (time) sensitive applications where more data is stored in a denser footprint.

However for active workload, lower capacity 15.5K RPM 300GB and 400GB Fibre Channel (FC) and SAS disk drives that deliver more IOPS or bandwidth per watt of energy can get more work done in the same amount of time.

There is also a perception that FC and SAS disk drives use more power than SATA disk drives which in some cases can be true, however current generations of high performance 10K RPM and 15.5K RPM drives have very similar power draw on a raw spindle or device basis. What differs is the amount of capacity per watt for idle or inactive applications, or, the number of IOPS or amount of performance for active configurations.

On the other hand, while not normally perceived as being green compared to tape or IPM and MAID (1st generation and MAID 2.0) solutions, along with SSD (Flash and RAM), not to mention fast SAS and FC disks or tiered storage systems that can do more IOPS or bandwidth per watt of energy are in fact green and energy efficiency for getting work done. Thus, there are two sides to optimizing storage for energy efficiency, optimizing for when doing work e.g. more miles per gallon per amount of work done, and, how little energy used when not doing work.

Thus, a new form of being green to sustain business growth while boosting productivity is Gaining Realistic Economic Efficiency Now that as a by product helps both business bottom lines as well as the environment by doing more with less. These are themes that are addressed in my new book

“The Green and Virtual Data Center” (Auerbach) that will be formerly launched and released for generally availability just after the 1st of the year (hopefully sooner), however you can beat the rush and order your copy now to beat the rush at Amazon and other fine venues around the world.

Ok, nuff said.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

SSD activity continues to go virtually round and round

Storage I/O trends

Solid State Disk (SSD) (both FLASH and RAM based) activities and discussions continue to go round and round (pun intended) with announcements (here, here, here, here, here, and here and among others) of various improvements and evolution for technologies focused from the consumer to the small office home office (SOHO) to small medium business (SMB) to enterprise with technologies from vendors including Intel, Sandisk, Seagate and many others.

Recent innovations are looking to address write performance issues or challenges associated with FLASH based SSD, which while better than magnetic hard disk drives (HDD), are slower than their RAM based counterparts.

Other activity includes extending the useful life or duration of how many times a FLASH based device can be rewritten or modified before problems arise or performance degrades. Yet another activity is Sandisk introducing “virtual RPM” (vRPM) metrics to provide consumers an indication of relative revolutions per minute (RPM) of a non-rotating SSD device to make comparisons to help with shopping decisions makings. Can you say SSDs going round and round and round at least in a virtual world? Now that should make for some interesting “virtual benchmarking” discussions!

Meanwhile industry trade groups include the SNIA Solid State Storage Initiative (SSSI) are gathering momentum to address marketing, messaging, awareness, education as well as metrics or benchmarks among things normally done around industry trade group camp fires and camp outs.

So, as the HDDs spin, so to does the activity in and around SSD based technologies.

Ok, nuff said.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

Will 6Gb SAS kill Fibre Channel?

Storage I/O trends

With the advent of 6Gb SAS (Serial Attached SCSI) which doubles the speed from earlier 3Gb along with other enhancements including longer cable distances up to 10m, does this mean that Fibre Channel will be threatened? Well, I’m sure some conspiracy theorist or iSCSI die hards might jump up and down and say yes, finally, even though some of the FCoE cheering section has already arranged a funeral or wake for FC even while Converged enhanced Ethernet based Fibre Channel over Ethernet (FCoE) and its complete ecosystem completely evolves.

Needless to say, SAS will be in your future, it may not be as a host server to storage system interconnect, however look for SAS high performance drives to appear sometime in the not so distant future. While over time, Fibre Channel based high performance disk drives can be expected to give way to SAS based disks, similar to how Parralel SCSI or even IBM SSA drives gave way to FC disks, SAS as a server to storage system interconnect will at leat for the forseeable future be more for smaller configurations, direct connect storage for blade centers, two server clusters, extremely cost sensitive environments that do not need or can afford a more expensive iSCSI, NAS let alone an FC or FCoE based solution.

So while larger storage systems over time can be expected to support high performance 3.5″ and 2.5″ SAS disks to replace FC disks, those systems will be accessed via FCoE, FC, iSCSI or NAS while mid-range and entry-level systems as they do today will see a mix of SAS, iSCSI, FC, NAS and in the future, some FCoE as well not to mention some InfiniBand based NAS or SRP for block access.

From an I/O virtualization (IOV) standpoint, keep an eye on whats taking place with the PCI SIG and Single Root IOV and multi-root IOV from a server I/O and I/O virtualization standpoint.

Ok, nuff said.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

Comfort Zones – Stating What Might Be Obvious to Some…

Storage I/O trends

Over the past couple of weeks I have talked with many IT professionals who work in IT data centers of varying size from different locations around the world. A couple of interesting patterns or trends if you prefer I have noticed are that while IT and storage professionals in general see disk based backup as the future and for some instances, a good tool today, there is still very much a comfort factor with magnetic tape.

The most cited reasons for continued use of tape being affordability, low power requirements, portability (assuming media is encrypted and secure) and familiar or comfort and confidence with the technology. A related trend or pattern is that while many IT professionals see the value and benefit of SSD including FLASH and RAM, there is also a concern or lack of confidence in the first so called enterprise class FLASH based SSD technology.

A related trend should hardly be a surprise in that enterprise customers I talk to who cling to tape as a data retention medium (even when using disk based backups) are also the most likely to have an early adopter aversion towards FLASH based enterprise storage. During discussions, what I also hear is that given time SSD including both RAM and enhanced or next generation FLASH will be adopted and deployed along magnetic hard disk drives (HDDs) and that HDDs will be used more in the future for backups and other data protection tasks.

Thus the consensus is that while HDDs have been declared dead by some with the arrival of FLASH and SSD, HDDs have joined the “Zombie” list of technologies declared dead, yet that continue to be produced and bought by customers. Other “Zombie” technologies include the IBM Mainframe, Fibre Channel, Magnetic Tapes, Copper based Ethernet and Printers among others. So with the magnetic HDD being over 50 years old, its safe to assume that magnetic HDD will be around for many more years, especially now that HDDs are on the “Zombie” technology list, a rather esteemed list I might add!

Ok, nuff said.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

Mainframe, CMG, Virtualization, Storage and “Zombie Technologies”

In case you missed the news, IBM today announced a new mainframe the z10, yes, that’s right, the mother of all “Zombie Technologies” (and I say this with all due respect), you know, technologies that are declared dead yet are viable, working and still living thus purchasable. Some other examples of Zombie technologies include magnetic tape which was declared dead at least ten years ago if not longer yet continues to evolve, granted a bit slower and with fewer vendors, yet the technology is still economically viable when paired up with disk to disk based backup as an off-line (read no power required) medium for preserving idle and inactive archive data. Another example of a Zombie technology is the printer as you may recall we were supposed to be completely paperless by now, yeh right.

Then there is Fibre Channel which was declared still born over a decade ago yet shows plenty of signs of life in the form of 8GFC (8Gb Fibre Channel) and emerging FCoE even with iSCSI waging another assault to kill the FC beast. Even the venerable 50 year old magnetic disk drive has been declared a dead technology with the re-emergence of SSD in the form of DRAM and FLASH yet magnetic hard disk drives (HDD) continue to be manufactured and shipped in record numbers making it a member of the Zombie technology club, a club that has some pretty esteemed members and more on the way.

I forget how many decades ago it was now that the IBM mainframe was declared dead and granted we have seen the exodus of Hitachi, Amdahl, NEC and others from the active marketplace developing and selling IBM plug compatible mainframes (PCMs). However the venerable mainframe from IBM like the energizer bunny keeps ticking and finding new roles including leveraging its built-in logical partition (LPAR) capabilities to support virtual machines, something that has been available for at least a few decades to enable being leveraged as a consolidation platform of not only legacy zOS (aka revamped MVS) and zVM (not to be confused with VMware) as well native Linux.

Shifting gears a bit, last week I had the pleasure of key-noting at a local Computer Measurement Group (CMG) event, a group that I have been involved with presenting at their events around the world for over a decade. Last weeks theme at the CMG event was Is Storage and I/O Still Important in a Virtual World? If you are not familiar with the CMG folks and you have an interesting in servers, storage, I/O and networking along with performance, capacity planning and virtualization these are some people to get to know. Granted the organization has its roots back in the mainframe era and thus the organization is a gazillion years old, yet, younger than the mainframe however not by much. Over the past several years with the advent of lower cost hardware and the attitude of hardware is cheap, just throw more hardware at the problem has in part led to the decline of what CMG once was as an organization.

However, given the collective knowledge base and broad background, skills and areas of interest spanning servers, storage, I/O, networking, virtualization, hardware, software, mainframe and open systems among others, given the current focus on addressing IT data center power, cooling, floor space and associated ecological and economic related topics (see www.greendatastorage.com) CMG has an opportunity to revive itself even more so than it has over the past few years. That is, CMG assuming its leaders and members can recognize the opportunity can stand up to take a lead role in tying together the skills and knowledge to implement cross technology domain IT infrastructure resource management including working with facilities personal to insure adequate resources (servers, storage, networking, power, cooling and floor space) are available when and where needed moving forward not to mention help shape and guide the server, storage and networking industry groups and forums on applicable metrics and measurement usage. If you are not familiar with CMG, check them out, it’s a good group with a lot of good subject matter expertise to tap into.

Ok, nuff said.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

The Many Faces of Solid State Devices/Disks (SSD)

Storage I/O trends

Here’s a link to a recent article I wrote for Enterprise Storage Forum titled “Not a Flash in the PAN” providing a synopsis of the many faces, implementations and forms of SSD based technologies that includes several links to other related content.

A popular topic over the past year or so has been SSD with FLASH based storage for laptops, also sometimes referred to as hybrid disk drives along with announcements late last year by companies such as Texas Memory Systems (TMS) of a FLASH based storage system combining DRAM for high speed cache in their RAMSAN-500 and more recently EMC adding support for FLASH based SSD devices in their DMX4 systems as a tier-0 to co-exist with other tier-1 (fast FC) and tier-2 (SATA) drives.

Solid State Disks/Devices (SSD) or memory based storage mediums have been around for decades, they continue to evolve using different types of memory ranging from volatile dynamic random access (DRAM) memory to persistent or non-volatile RAM (NVRAM) and various derivatives of NAND FLASH among other users. Likewise, the capacity cost points, performance, reliability, packaging, interfaces and power consumption all continue to improve.

SSD in general, is a technology that has been miss-understood over the decades particularly when simply compared on a cost per capacity (e.g. dollar per GByte) basis which is an unfair comparison. The more approaches comparison is to look at how much work or amount of activity for example transactions per second, NFS operations per second, IOPS or email messages that can be processed in a given amount of time and then comparing the amount of power and number of devices to achieve a desired level of performance. Granted SSD and in particular DRAM based systems cost more on a GByte or TByte basis than magnetic hard disk drives however it also requires more HDDs and controllers to achieve the same level of performance not to mention requiring more power and cooling than compared to a typical SSD based device.

The many faces of SSD range from low cost consumer grade products based on consumer FLASH products to high performance DRAM based caches and devices for enterprise storage applications. Over the past year or so, SSD have re-emerged for those who are familiar with the technology, and emerged or appeared for those new to the various implementations and technologies leading to another up swinging in the historic up and down cycles of SSD adoption and technology evolution in the industry.

This time around, a few things are different and I believe that SSD in general, that is, the many difference faces of SSD will have staying power and not fade away into the shadows only to re-emerge a few years later as has been the case in the past.

The reason I have this opinion is based on two basic premises which are economics and ecological”. Given the focus on reducing or containing costs, doing more with what you have and environmental or ecological awareness in the race to green the data center and green storage, improving on the economics with more energy efficiency storage, that is, enabling your storage to do more work with less energy as opposed to avoiding energy consumption, has the by product of improved economics (cost savings and improved resource utilization and better service delivery) along with ecological (better use of energy or less use of energy).

Current implementations of SSD based solutions are addressing both the energy efficiency topics to enable better energy efficiency ranging from maximizing battery life to boosting performance while drawing less power. Consequently we are now seeing SSD in general are not only being used for boosting performance, also we are seeing it as one of many different tools to address power, cooling, floor space and environmental or green storage issues.

Here’s a link to a StorageIO industry trends and perspectives white paper at www.storageio.com/xreports.htm.

Here’s the bottom line, there are many faces to SSD. SSD (FLASH or DRAM) based solutions and devices have a place in a tiered storage environment as a Tier-0 or as an alternative in some laptop or other servers where appropriate. SSD compliments other technologies and SSD benefits from being paired with other technologies including high performance storage for tier-1 and near-line or tier-2 storage implementing intelligent power management (IPM).

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved