Industry trend: People plus data are aging and living longer

Lets face it, people and information are living longer and thus there are more of each along with a strong interdependency by both.

People living and data being retained longer should not be a surprise, take a step back and look at the bigger picture. There is no such thing as an information recession with more data being generated, processed, moved and stored for longer periods of time not to mention that a data object is also getting larger.

Industry trend and performance

By data objects getting larger, think about a digital photo taken on a typical camera ten years ago which whose resolution was lower and thus its file size would have been measured in kilo bytes (thousands). Today megapixel resolutions are common from cell phones, smart phones, PDAs and even larger with more robust digital and high definition (HD) still and video cameras. This means that a photo of the same object that resulted in a file of hundreds of Kbytes ten years ago would be measured in Megabytes today. With three dimensional (3D) cameras appearing along with higher resolution, you do not need to be a rocket scientist or industry pundit to figure out what that growth trend trajectory looks like.

However it is not just the size of the data that is getting larger, there are also more instances along with copies of those files, photos, videos and other objects being created, stored and retained. Similar to data, there are more people now than ten years ago and some of those have also grown larger, or at least around the waistline. This means that more people are creating and relying on larger amounts of information being available or accessible when and where needed. As people grow older, the amount of data that they generate will naturally increase as will the information that they consume and rely upon.

Where things get interesting is that looking back in history, that is more than ten or even a hundred years, the trend is that there are more people, they are living longer, and they are generating larger amounts of data that is taking on new value or meaning. Heck you can even go back from hundreds to thousands of years and see early forms of data archiving and storage with drawings on walls of caves or other venues. I Wonder if had the cost (and ease of use) to store and keep data had been lower back than would there have been more information saved? Or was it a case of being too difficult to use the then state of art data and information storage medium combined with limited capacities so they simply ran out of storage and retention mediums (e.g. walls and ceilings)?

Lets come back to the current for a moment which is another trend of data that in the past would have been kept offline or best case near line due to cost and limits or constraints are finding their way online either in public or private venues (or clouds if you prefer).

Thus the trend of expanding data life cycles with some types of data being kept online or readily accessible as its value is discovered.

Evolving data life cycle and access patterns

Here is an easy test, think of something that you may have googled or searched for a year or two ago that either could not be found or was very difficult to find. Now take that same search or topic query and see if anything appears and if it does, how many instances of it appear. Now make a note to do the same test again in a year or even six months and compare the results.

Now back to the future however with an eye to the past and things get even more interesting in that some researchers are saying that in centuries to come, we should expect to see more people not only living into their hundreds, however even longer. This follows the trend of the average life expectancy of people continues to increase over decades and centuries.

What if people start to live hundreds of years or even longer, what about the information they will generate and rely upon and its later life cycle or span?

More information and data

Here is a link to a post where a researcher sees that very far down the road, people could live to be a thousand years old which brings up the question, what about all the data they generate and rely upon during their lifetime.

Ok, now back to the 21st century and it is safe to say that there will be more data and information to process, move, store and keep for longer periods of time in a cost effective way. This means applying data footprint reduction (DFR) such as archiving, backup and data protection modernization, compression, consolidation where possible, dedupe and data management including deletion where applicable along with other techniques and technologies combined with best practices.

Will you out live your data, or will your data survive you?

These are among other things to ponder while you enjoy your summer (northern hemisphere) vacation sitting on a beach or pool side enjoying a cool beverage perhaps gazing at the passing clouds reflecting on all things great and small.

Clouds: Dont be scared, however look before you leap and be prepared

Ok, nuff said for now.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2011 StorageIO and UnlimitedIO All Rights Reserved

Storage Effiency and Optimizaiton – Balancing Time and Space

Storage I/O trends

Here’s a link to the presentation I recently delivered at the Spring 2009 Minneapolis/St. Paul area CMG (Computer Measurement Group – CMG) March 20th, 2009 hosted by Nexus Information Systems and organized by Tom Becchetti. The theme of the event was "Is your storage efficient? There are many ways to rate your storage, how does yours stack up?". Tom organized a great event as usual with a diverse set of speakers for the well attended event graciously hosted by Keith Norbie of Nexus at their Minnetonka facility. The title of my presentation was "Storage Efficiency: Mirror Mirror On The Wall, Who or What is The Most Efficient of Them All? Finding the Correct Balance" that looked at balancing the need to reduce (or maximize) space (utilization) with time (performance) to meet different requirements including maintaining quality of service, response time and availability.

Keeping in mind that there is no such thing as a data or I/O performance recession, there is a common myth that storage optimization or efficiency is all about driving up storage space capacity utilization which can be true for some environments, applications, data or storage types. However there is also the need to maintain or boost performance, reduce response time and latency, doing more work in a more productive and efficieny manner. Not all data or storage can be consolidated to boost utilization without concern for degrading or in any other way penalizing performance, response time or availability.

Thus it is about time and space, that is, balancing data movement and processing rates with storage space capacity utilization and that sometimes, more is not better for performance when it comes to ratios or the number of components in a solution.

Likewise there is the need to balance energy avoidance with energy efficient, balancing the need to store more data in a smaller footprint using less energy and the need to process more data in less time efficiently for productivity.

These and other related themes are expanded on in more detail in my book "The Green and Virtual Data Center" (CRC). These and other related themes will covered in one of my upcoming presentations (The Other Green — Storage Efficiency and Optimization) at StorageDecisions in Chicago the week of June 1st, 2009, as well as in various seminars and events that I will be involved in the coming weeks and months.

Thanks to all those who helped organize, support, sponsored, presented and attended the recent CMG event, look forward to seeing or hearing from you all again soon.

Ok, nuff said.

Ok, nuff said.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

March and Mileage Mania Wrap-up

Today’s flight to Santa Ana (SNA) Orange County California for an 18 hour visit marks my 3rd trip to the left coast in the past four weeks that started out with a trip to Los Angeles. The purpose of today’s trip is to deliver a talk around Business Continuance (BC) and Disaster recovery (DR) topics for virtual server and storage environments along with related data transformation topics themes, part of a series of on-going events.

Planned flight path from MSP to SNA, note upper midwest snow storms. Thanks to Northwest Airlines, now part of Delta!
Planned flight path from MSP to SNA courtesy of Northwest Airlines, now part of Delta

This is a short trip to southern California in that I have to be back in Minneapolis for a Wednesday afternoon meeting followed by keynoting at an IT Infrastructure Optimization Seminar downtown Minneapolis Thursday morning. Right after Thursday morning session, its off to the other coast for some Friday morning and early afternoon sessions in the Boston area, the results of which I hope to be able to share with you in a not so distant future posting.

Where has March gone? Its been a busy and fun month out on the road with in-person seminars, vendor and user group events in Minneapolis, Los Angles, Las Vegas, Milwaukee, Atlanta, St. Louis, Birmingham, Minneapolis for CMG user group, Cincinnati and Orange County not to mention some other meetings and consulting engagements elsewhere including participating in a couple of webcast and virtual conference/seminars while on the road. Coverage and discussion around my new book "The Green and Virtual Data Center" (CRC) continues expand, read here to see what’s being said.

What has made the month fun in addition to traveling around the country is the interaction with the hundreds of IT professionals from organizations of all size hearing what they are encountering, what their challenges are, what they are thinking, and in general what’s on their mind.

Some of the common themes include:

  • There’s no such thing as a data recession, however the result is doing more with less, or, with what you have
  • Confusion abounds around green hype including carbon footprints vs. core IT and business issues
  • There is life beyond consolidation for server and storage virtualization to enable business agility
  • Security and encryption remain popular topic as does heterogeneous and affordable key management
  • End to end IT resource management for virtual environments is needed that is scalable and affordable
  • Performance and quality of service can not be sacrificed in the quest to drive up storage utilization
  • Clouds, SSD (FLASH), Dedupe, FCoE and Thin Provisioning among others are on the watch list
  • Tape continues to be used complimenting disks in tiered storage environments along with VTLs
  • Dedupe continues to be deployed and we are just seeing the very tip of the ice-berg of opportunity
  • Software licensing cost savings or reallocation should be a next step focus for virtual environments
  • Now, for a bit of irony and humor, overheard was a server sales person talking to a storage sales person comparing notes on how they are missing their forecasts as their customers are buying fewer servers and storage now that they are consolidating with virtualization, or using disk dedupe to eliminate disk drives. Doh!!!

    Now if those sales people can get their marketing folks to get them the play book for virtualization for business agility, improving performance and enabling business growth in an optimized, transformed environment, they might be able to talk a different story with their customers for new opportunities…

    What’s on deck for April? More of the same, however also watch and listen for some additional web based content including interviews quotes and perspectives on industry happenings, articles, tips and columns, reports, blogs, videos, podcasts, webcasts and twitter activity as well as appearances at events in Boston, Chicago, New Jersey and Providence among other venues.

    To all of those who came out to the various events in March, thank you very much and look forward to future follow-up conversations as well as seeing you at some of the upcoming future events.

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved

    Work and Entertainment From Coast to Coast

    A week ago I was in St. Petersburg, Tampa and Miami Florida for a mix of work and relaxation along with Karen (Mrs. Schulz), visiting with my cousin and her husband who lives in the St. Pete beach area for a few days before back to work. While in the St. Pete and Tampa area, for fun, we did an afternoon at Busch Garden including a ride on Montu. For those who have not ridden on Montu, here’s a video I found that someone recorded to help give you a perspective of the ride. Other fun activities included stops or time at Billys Stonecrab and Seafood joint, Kayaking, lounging pool-side, shelling at Ft. Desoto and St. Pete Beach as well as a visit to the Hurricane among others.

    In Miami, the pool area at the Four Seasons including a nice cabana pool-side spot to escape the cool breeze made for a great relaxing and catch-up on some work spot while Karen relaxed in the sun. Some of the restraunts in Miami we visited when taking a break from work included Gordon Birsch and Rosa for some outstanding, made at the table side fresh Guacamole en Molcajet!.

    Speaking of work, the Florida trip involved doing keynotes at events in both Tampa and Miami with a theme of IT Infrastructure Optimization with both events being well attended. Themes included doing more with less, or, doing more with what you have, addressing data footprint and data management to boost productivity, how to address the continued growth in data and need to process, move and store more data and information. A discussion point prompted the thought of if there is a data recession or not (See previous blog post and here). Other topics of discussion and interested included converged networking for voice, data and general networking, security, server and storage virtualization, performance and capacity planning, data protection and BC/DR among others.

    This past week involved a lunch and learn Keynote in the Minneapolis area with a local VAR, before a quick trip to the other (left) coast for another IT Infrastructure Optimization session and keynote, this time in Los Angeles. Some common themes heard from IT professionals at this past weeks events echoed those heard in Florida as well as concern about managing encryption keys not to mention securing virtual environments and software licensing models in virtualized server environments. The trip to LA also enabled a quick visit with friend Bruce Rave of Go Deep fame who provided a great tour and sightseeing of the Hollywood music scene.

    Hollywood stops included dinner at Genghis Cohens (The duck and cashew chicken were outstanding) followed by visits to the Cat and Fiddle and Infamous Rainbow Bar & Grill next door to legendary Roxy. People watching was great as was the music and ambiance including a Nikki Sixx of Motely Crew sighting at the Rainbow as well as Dr. Sanjay Gupta of CNN seen in hotel lobby minutes after appearing on Larry King Live.

    Thanks too everyone who came out and participated in the seminar events in Tampa, Miami, Minneapolis and LA, look forward to seeing and hearing from you again soon. Now its time to get ready to head off too the airport for this weeks events and activities including stops in Las Vegas and Milwaukee among others.

    Cheers
    Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved