As the Hard Disk Drive HDD continues to spin

As the Hard Disk Drive HDD continues to spin

server storage data infrastructure i/o iop hdd ssd trends

Updated 2/10/2018

Despite having been repeatedly declared dead at the hands of some new emerging technology over the past several decades, the Hard Disk Drive (HDD) continues to spin and evolve as it moves towards its 60th birthday.

More recently HDDs have been declared dead due to flash SSD that according to some predictions, should have caused the HDD to be extinct by now.

Meanwhile, having not yet died in addition to having qualified for its AARP membership a few years ago, the HDD continues to evolve in capacity, smaller form factor, performance, reliability, density along with cost improvements.

Back in 2006 I did an article titled Happy 50th, hard drive, but will you make it to 60?

IMHO it is safe to say that the HDD will be around for at least a few more years if not another decade (or more).

This is not to say that the HDD has outlived its usefulness or that there are not other tiered storage mediums to do specific jobs or tasks better (there are).

Instead, the HDD continues to evolve and is complimented by flash SSD in a way that HDDs are complimenting magnetic tape (another declared dead technology) each finding new roles to support more data being stored for longer periods of time.

After all, there is no such thing as a data or information recession!

What the importance of this is about technology tiering and resource alignment, matching the applicable technology to the task at hand.

Technology tiering (Servers, storage, networking, snow removal) is about aligning the applicable resource that is best suited to a particular need in a cost as well as productive manner. The HDD remains a viable tiered storage medium that continues to evolve while taking on new roles coexisting with SSD and tape along with cloud resources. These and other technologies have their place which ideally is finding or expanding into new markets instead of simply trying to cannibalize each other for market share.

Here is a link to a good story by Lucas Mearian on the history or evolution of the hard disk drive (HDD) including how a 1TB device that costs about $60 today would have cost about a trillion dollars back in the 1950s. FWIW, IMHO the 1 trillion dollars is low and should be more around 2 to 5 trillion for the one TByte if you apply common costs for management, people, care and feeding, power, cooling, backup, BC, DR and other functions.

Where To Learn More

View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

Software Defined Data Infrastructure Essentials Book SDDC

What This All Means

IMHO, it is safe to say that the HDD is here to stay for at least a few more years (if not decades) or at least until someone decides to try a new creative marketing approach by declaring it dead (again).

Ok, nuff said, for now.

Gs

Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

Happy Holidays 2010

Here in the Stillwater Minnesota area we are on the verge of being the snowiest December on record, enough to even challenge SANta.

With the snow we have been accumulating you can a) complain about it, b) go elsewhere, c) do nothing or d) enjoy it.

Having the right technology and tools to address the various snow challenges also helps.

Taking a break between projects including chapters for a new book among other items, following are some videos of enjoying and having some fun snow sledding in the back yard here in the St. Croix river valley.

Click on the following images to see some videos we recorded today using a flip camera including action shots while out on the hill. Fun was had by both the kids and the big kids aka adults!

Click here, here or here to view smaller (e.g. shorter more compact .wmv versions)

Refer to this link (and video in the post) to see how much more snow we have accumulated in the past month since thanksgiving and how the sleeding conditions have evolved.

Rest assured there will be more tech related blog posts coming soon.

Have a safe and happy holiday season.

Nuff said for now

Cheers gs

Greg Schulz – Author The Green and Virtual Data Center (CRC) and Resilient Storage Networks (Elsevier)
twitter @storageio

Happy Thanks giving 2010

Taking a break from industry trends and perspectives activity, here is using some technology to show how even in the snow and cold, for those who are bold, they wont grow old, as kids of all ages enjoy snow sled sliding in the scenic St. Croix River Valley.

Here is a video (.MPG) (and smaller .wmv version) that I put together this afternoon of the neighbor kids and their crew enjoying the snow during the first sled runs of the year.

For those enjoying the thanksgiving holidays in the U.S. try not to eat to much and thus avoid the sleep to much syndrome. However for everyone else, enjoy, have fun and best wishes.

Nuff said for now

Cheers gs

Greg Schulz – Author The Green and Virtual Data Center (CRC) and Resilient Storage Networks (Elsevier)
twitter @storageio

Technology Tiering, Servers Storage and Snow Removal

Granted it is winter in the northern hemisphere and thus snow storms should not be a surprise.

However between December 2009 and early 2010, there has been plenty of record activity from in the U.K. (or here), to the U.S. east coast including New York, Boston and Washington DC, across the midwest and out to California, it made for a white christmas and SANta fun along with snow fun in general in the new year.

2010 Snow Storm via www.star-telegram.com

What does this have to do with Information Factories aka IT resources including public or private clouds, facilities, server, storage, networking along with data management let alone tiering?

What does this have to do with tiered snow removal, or even snow fun?

Simple, different tools are needed for addressing various types of snow from wet and heavy to light powdery or dustings to deep downfalls. Likewise, there are different types of servers, storage, data networks along with operating systems, management tools and even hyper visors to deal with various application needs or requirements.

First, lets look at tiered IT resources (servers, storage, networks, facilities, data protection and hyper visors) to meet various efficiency, optimization and service level needs.

Do you have tiered IT resources?

Let me rephrase that question to do you have different types of servers with various performance, availability, connectivity and software that support various applications and cost levels?

Thus the whole notion of tiered IT resources is to be abe to have different resources that can be aligned to the task at hand in order to meet performance, availability, capacity, energy along with economic along with service level agreement (SLA) requirements.

Computers or servers are targeted for different markets including Small Office Home Office (SOHO), Small Medium Business (SMB), Small Medium Enterprise (SME) and ultra large scale or extreme scaling, including high performance super computing. Servers are also positioned for different price bands and deployment scenarios.

General categories of tiered servers and computers include:

  • Laptops, desktops and workstations
  • Small floor standing towers or rack mounted 1U and 2U servers
  • Medium sizes floor standing towers or larger rack mounted servers
  • Blade Centers and Blade Servers
  • Large size floor standing servers, including mainframes
  • Specialized fault tolerant, rugged and embedded processing or real time servers

Servers have different names email server, database server, application server, web server, and video or file server, network server, security server, backup server or storage server associated with them depending on their use. In each of the previous examples, what defines the type of server is the type of software is being used to deliver a type of service. Sometimes the term appliance will be used for a server; this is indicative of the type of service the combined hardware and software solution are providing. For example, the same physical server running different software could be a general purpose applications server, a database server running for example Oracle, IBM, Microsoft or Teradata among other databases, an email server or a storage server.

This can lead to confusion when looking at servers in that a server may be able to support different types of workloads thus it should be considered a server, storage, networking or application platform. It depends on the type of software being used on the server. If, for example, storage software in the form a clustered and parallel file system is installed on a server to create highly scalable network attached storage (NAS) or cloud based storage service solution, then the server is a storage server. If the server has a general purpose operating system such as Microsoft Windows, Linux or UNIX and a database on it, it is a database server.

While not technically a type of server, some manufacturers use the term tin wrapped software in an attempt to not be classified as an appliance, server or hardware vendor but want their software to be positioned more as a turnkey solution. The idea is to avoid being perceived as a software only solution that requires integration with hardware. The solution is to use off the shelf commercially available general purpose servers with the vendors software technology pre integrated and installed ready for use. Thus, tin wrapped software is a turnkey software solution with some tin, or hardware, wrapped around it.

How about the same with tiered storage?

That is different tiers (Figure 1) of fast high performance disk including RAM or flash based SSD, fast Fibre Channel or SAS disk drives, or high capacity SAS and SATA disk drives along with magnetic tape as well as cloud based backup or archive?

Tiered Storage Resources
Figure 1: Tiered Storage resources

Tiered storage is also sometimes thought of in terms large enterprise class solutions or midrange, entry level, primary, secondary, near line and offline. Not to be forgotten, there are also tiered networks that support various speeds, convergence, multi tenancy and other capabilities from IO Virtualization (IOV) to traditional LAN, SAN, MAN and WANs including 1Gb Ethernet (1GbE), 10GbE up to emerging 40GbE and 100GbE not to mention various Fibre Channel speeds supporting various protocols.

The notion around tiered networks is like with servers and storage to enable aligning the right technology to be used for the task at hand economically while meeting service needs.

Two other common IT resource tiering techniques include facilities and data protection. Tiered facilities can indicate size, availability, resiliency among other characteristics. Likewise, tiered data protection is aligning the applicable technology to support different RTO and RPO requirements for example using synchronous replication where applicable vs. asynchronous time delayed for longer distance combined with snapshots. Other forms of tiered data protection include traditional backups either to disk, tape or cloud.

There is a new emerging form of tiering in many IT environments and that is tiered virtualization or specifically tiered server hyper visors in virtual data centers with similar objectives to having different server, storage, network, data protection or facilities tiers. Instead of an environment running all VMware, Microsoft HyperV or Xen among other hyper visors may be deployed to meet different application service class requirements. For example, VMware may be used for premium features and functionality on some applications, where others that do not need those features along with requiring lower operating costs leverage HyperV or Zen based solutions. Taking the tiering approach a step further, one could also declare tiered databases for example Oracle legacy vs. MySQL or Microsoft SQLserver among other examples.

What about IT clouds, are those different types of resources, or, essentially an extension of existing IT capabilities for example cloud storage being another tier of data storage?

There is another form of tiering, particularly during the winter months in the northern hemisphere where there is an abundance of snow this time of the year. That is, tiered snow management, removal or movement technologies.

What about tiered snow removal?

Well lets get back to that then.

Like IT resources, there are different technologies that can be used for moving, removing, melting or managing snow.

For example, I cant do much about getting ready of snow other than pushing it all down the hill and into the river, something that would take time and lots of fuel, or, I can manage where I put snow piles to be prepared for next storm, plus, to help put it where the piles of snow will melt and help avoid spring flood. Some technologies can be used for relocating snow elsewhere, kind of like archiving data onto different tiers of storage.

Regardless of if snowstorm or IT clouds (public or private), virtual, managed service provider (MSP), hosted or traditional IT data centers, all require physical servers, storage, I/O and data networks along with software including management tools.

Granted not all servers, storage or networking technology let alone software are the same as they address different needs. IT resources including servers, storage, networks, operating systems and even hyper visors for virtual machines are often categorized and aligned to different tiers corresponding to needs and characteristics (Figure 2).

Tiered IT Resources
Figure 2: Tiered IT resources

For example, in figure 3 there is a light weight plastic shovel (Shove 1) for moving small amounts of snow in a wide stripe or pass. Then there is a narrow shovel for digging things out, or breaking up snow piles (Shovel 2). Also shown are a light duty snow blower (snow thrower) capable of dealing with powdery or non wet snow, grooming in tight corners or small areas.

Tiered Snow tools
Figure 3: Tiered Snow management and migration tools

For other light dustings, a yard leaf blower does double duty for migrating or moving snow in small or tight corners such as decks, patios or for cleanup. Larger snowfalls, or, where there is a lot of area to clear involves heavier duty tools such as the Kawasaki mule with 5 foot curtis plow. The mule is a multifunction, multi protocol tool capable of being used for hauling items, towing, pulling or recreational tasks.

When all else fails, there is a pickup truck to get or go out and about, not to mention to pull other vehicles out of ditches or piles of snow when they become stuck!

Snow movement
Figure 4: Sometimes the snow light making for fast, low latency migration

Snow movement
Figure 5: And sometimes even snow migration technology goes off line!

Snow movement

And that is it for now!

Enjoy the northern hemisphere winter and snow while it lasts, make the best of it with the right tools to simplify the tasks of movement and management, similar to IT resources.

Keep in mind, its about the tools and when along with how to use them for various tasks for efficiency and effectiveness, and, a bit of snow fun.

Ok, nuff said.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

SNOW Fun and Information Technology – They Do Mix

In the spirit of the holidays (which ever holidays you prefer), here’s a bit lighter posting (rest assured, there are plenty of upcoming more technology focused postings in the works) about what many folks in the northern hemisphere are either dreading and dealing with, or, enjoying this time of the year and that is SNOW.

From the deserts of Las Vegas NV to New England, from Canada to Texas and most points in between and that’s just in the U.S., its that time of the year for SNOW (while friends from Oz remind me its summer down under this time of the year).

Holiday HoundsGreg snow sleedingNetworking in the SnowLittle Leo having a SNOW snackGreg walking on "Frozen" waterGreg and Friends Sleeding and Riding on Snowplow

With that in mind and knowing how IT or other tech savvy folks enjoy or depend on the use of acronyms, buzzwords and so forth, here are some reworked terms in the spirit of the northern hemisphere winter season. You might want to down load "Valley Winter Song" (e.g. the song from the LL Bean commercials) rom Fountains Of Wayne via Amazon.com or some other venue if you have not done so to enjoy with your snow or working on your holiday shopping list.

Some acronyms include among others:

  • Backup Target – Where a lot of shoppers are waiting in line or stuck in traffic
  • Backup – Getting out of a snow bank, stuck in traffic, what the snow plows do sometimes
  • Battery backup – Spare or extra batteries to put into all of those new toys and gadgets
  • BC – Before Cold sets in
  • Best practices – How to use the snow removable equipment
  • Bus driver – person driving the metric transit bus full of holiday shoppers and revelers
  • Capacity planning – figuring out where to pile up the snow
  • Chain of events – Car driver on cell phone, Car hits ice, car slides into another car, chain reaction accident
  • Cloud – where the snow comes from
  • Cluster – Many cars piled up together stuck in traffic, nothing moving, see gridlock
  • Compress – Pile the snow up, let it settle
  • DAS – Direct Attached Snowplow
  • DR – Doctor to go see for your cold or back ache from shoveling snow or too much holiday cheer
  • Fibre Channel – How to get the weather channel on local cable
  • Global warming – What those dealing with snow might like to see a bit of right now
  • Generator – Essential equipment for geek’s and techno folks
  • Green – What the snow is now covering on the golf courses in much of the northern hemisphere colder areas
  • Grid – how the traffic highways are plugged with stopped cars and holiday shoppers
  • Grid lock – Encryption and security for grids or traffic jams
  • Hardware- Snow removable equipment
  • ILM – iPhone Loves Multimedia
  • InfiniBand – Giant bow around holiday presents
  • iPhone – I will call you latter
  • iSCSI – What some are referring to the slippery and dirty roads today
  • MSP – Managed snow removal professionals, or the Minneapolis / St. Paul Airport where holiday travelers may be stranded
  • Need Another Shovel (NAS)
  • Networking – Talking with your neighbors
  • NFS – Nevada Fresh Snow
  • North pole – Future location for Google to keep their storage and reduce cooling costs
  • Offline – Power outage or, snow plow gets stuck
  • Offsite – where the snow gets moved too
  • Online – where most snow bound holiday shoppers should be shopping instead of being stuck in the snow
  • Optics – Evening light shows during holiday parades
  • Outsourcing – Have someone else remove the snow
  • PC ? Payment Card
  • PCI – Payment card industry that is busy this time of the year processing credit card transactions
  • POS – Point of sale, plain old shovel
  • Provisioning – going to the store and stocking up on food, fuel and other essentials
  • RAID – Remove All Ice Daily
  • RAIN – Snow before it freezes
  • Removable Media – Chasing the news crew off your property after the nightly light show
  • Replication – Repeated snow storms in a row
  • ROI – Remove old Ice
  • SAS = Sleds and Snow
  • SANd = Stuff at the beach in the summer, stuff on the road in the winter time
  • SPAMHormel product
  • SATA – Santa without an "n"
  • Shipping tapes – How 3M gets tape from their factories to you for gift wrapping
  • Single instance – Rare snowstorm like what happened in Las Vegas
  • SLED – snow sled with a disk Dedupe – Let the snow piles shrink
  • Slide ware – Picture on the wall of a nice tropical warm place while the snowstorm is outside
  • Snapshot – Picture of the snow on a tree Restore – When the power comes back on
  • SNOW – Storage Networking Organizations West or, Storage Networking outsource World
  • Software – What goes in the Wii or play station during a snowstorm (if you have power)
  • Spanning tree – very big tree with lots of snow on it
  • SRM – Snow removable management, or, Sunday Rolls into Monday
  • Standby power – Waiting on the phone for the power company to answer during an outage
  • Tape – What 3M makes to wrap presents with
  • Tiered servers – Wait staff at a restraunt
  • Tiered storage – How snow is piled to maximize space
  • Tweet – What takes place on twitter or perhaps from eating too much sweets
  • UPS – The people in the brown trucks bringing things from Amazon and others
  • Snow plow offlineSnow plowingSnow and cold family

    Have a safe and happy holiday season and enjoy the snow while you can.

    Ok, nuff said.

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved