Why VASA is important to have in your VMware CASA

Here is a link to a recent guest post that I was invited to do over at The virtualization Practice (TVP) pertaining to VMware vSphere V5.0 VASA.

This new post follows up on one that I did about a month ago pertaining to recent vSphere V5.0 storage and IO enhancements including Storage DRS (SDRS).

VMware vSphere Storage Aware API (VASA) is an Applications Programming Interface (API) that provides insight and awareness into supported storage systems configuration, current health, status and capabilities that can be used for enabling various management activities.

Read more here.

Ok, nuff said for now.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2011 StorageIO and UnlimitedIO All Rights Reserved

Practical Email optimization and archiving strategies

Email is a popular tool for messaging, calendaring, and managing contacts along with attachments in most organizations.

Email and messaging

Given the popularity of email and diverse ways that it is used for managing various forms of unstructured data attachments including photos, video, audio, spreadsheets, presentations and other document objects, there are corresponding back end challenges. Those back end challenges including managing the data storage repositories (e.g. file systems and storage systems) that are used for preserving and serving email documents along with enabling regulatory or compliance mandates.

Email archiving is an important enabler for regulatory compliance and e-discovery functions. However there is another important use for E-mail archiving which as a data footprint reduction (DFR) technique and technology enables storage optimization, being green and supporting growth while stretching budgets further. There is after all no such thing as a data or information recession and all one has to do to verify the trend is to look at your own email activity.

Industry Trend: Data growth and demand

There are however constraints on time, budgets and demands to do more while relying on more information and email has become a central tool for messaging including social media networking, handling of attachments and means to manage all of that data.

DFR enables more data to be stored, retained, managed and maintenance in a cost effective manner. This includes storing more data managed per person, where when the additional data being retained adds value to an organization. Also included is keeping more data readily accessible, not necessarily instantly accessible, however but within minutes instead of hours or days depending on service requirements.

Data footprint reduction (DFR) techniques and technologies

Here is a link to a recent article that I did presenting five tips and strategies for optimizing e-mail using archiving.

Hopefully many of you will find these to be common sense tips being implemented, however if not, now is the time to take action to stretch your resources further to do more.

In general email optimization tips include:

  • Set policies for retention and disposal
  • Establish filters and rules
  • Index and organize your inbox
  • Archive messages regularly
  • Perform routine cleanup and optimization
  • Leverage cloud data protection services and solutions

When it comes to archiving projects, walk before you run, establish success to build upon for broader deployment of E-mail archiving by finding and address low hanging fruit opportunities.

Instead of trying to do to much, find opportunities that can be addressed and leveraged as examples to build business cases to move forward.

By having some success stories and proof points, these can be used to help convince management to support additional steps not to mention getting them to back your polices to achieve success.

An effective way to convince management these days is to show them how by taking additional Email archiving steps you can support increased growth demand, reduce costs while enhancing productivity not to mention adding compliance and ediscovery capabilities as side benefits.

You can read more here and here, ok, nuff said for now.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2011 StorageIO and UnlimitedIO All Rights Reserved

HDS buys BlueArc, any surprises here?

Technically here in the northern hemisphere it is still summer, so there is another summer wedding to announce.

The other day Hitachi Data Systems (aka HDS) announced that they finally tied the knot buying their Network Attached Storage (NAS) partner BlueArc whom they have been in a OEM premarital arrangement for the last five years or so (wow, was that a long engagement or what?). HDS being a subsidiary of Hitachi Ltd. a Japanese company it should be no surprise that they operate in a cool, calculated conservative manner with products that have over the past several decades been known for delivering resiliency, functionality, performance and value.

To those in the IT and specifically data storage industry, the only surprise about HDS buying BlueArc should be what took them so long to do so myself included. With unstructured data, big data, high performance computing, high productivity computing (aka HPC), and big bandwidth needs expanding, it only makes sense that HDS finally ties the knot formally acquiring BlueArc signaling what I hope are a few things for their collective future together.

Things that I hope HDS can accomplish with their acquisition of BlueArc include among others:

  • Leverage the BlueArc hardware and performance combine with the HDS software suite to expand further upstream (and downstream) as well as into different adjacent markets leveraging their success over the long courtship where both parties got to know each other more.
  • Signal to the industry that they are truly committed to a long term NAS product solution strategy. HDS has been doing a good job of sticking with BlueArc for the past five or so years having had several previous NAS partner relationships including with NetApp, NSS and others besides their own internal projects.
  • Expand their focus to lead with NAS pulling storage with it in addition to using NAS to accessorize (or bling aka Mr. T starter kit to go with Mr. T storage videos) storage systems which means of course, going more direct toe to toe with the likes of former partner NetApp, EMC, HP (with IBRIX), IBM and Dell among many others. Ironically former HDS partner NetApp acquired the Engenio storage group from LSI whose products competed with HDS in some spaces, while BlueArc was a Engenio partner.
  • Continue to develop both the hardware and software feature functionality around the BlueArc products in addition to further integration across the joint product lines for both traditional, as well as clustered, scale out, bulk, big data, big bandwidth and HPC environments.
  • Sharpen their NAS message and solution offerings including providing the support, tools and programs to enable both their joint direct sales forces as well as their partner value added reseller (VAR) and channel networks.

Check out (here) some additional comments and perspectives by Ray Lucchesi (aka twitter @raylucchesi) over on his blog pertaining to HDS buying BlueArc.

Congratulations to both HDS and BlueArc along with best wishes, this is a deal that is good for both, now, or once the honeymoon is over, lets see how this is executed upon building on their prior joint success to expand into new market opportunities on a global basis. HDS has tools and people to move into and leverage these new as well as existing opportunities, lets see how they can execute on those hopefully not spending too much time or money on the honeymoon while their competitors are out being busy in some of those same accounts in this last month of an important sales quarter (all quarters are important when it comes to sales).

Disclosure for those interested and FWIW: BlueArc had been a client of StorageIO a few years ago, however not currently. HDS is not nor have they been a client of StorageIO, however in prior life I was a customer of theirs in addition to being a partner and supplier when I was on the vendor side of the table.

 

Ok, nuff said for now.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2011 StorageIO and UnlimitedIO All Rights Reserved

Check out these top 50 IT blogs

The other day I saw something come in via the net about a top 50 IT blog list from Biztech Magazine, so being curious I clicked on the link (after making sure that it was safe).

To my surprise, I saw my blog (aka Gregs StorageIOblog) listed near the top (they sorted by blog name order) of the top 50 IT blog sites that they listed.

Must-Read IT Blog

Im honored to have been included in such an esteemed and diverse list of blogs spanning various technologies, topics and IT focus areas.

Congratulations to all that made the list as well as others blogs that you will want to add to your reading lists including those mentioned over on Calvin Zitos (aka @hpstorageguy) blog.

Check out the top 50 IT blog list here.

Ok, nuff said for now.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2011 StorageIO and UnlimitedIO All Rights Reserved

Cloud and Virtual Data Storage Networking book released

Ok, it’s now official, following its debut at the VMworld 2011 book store last week in Las Vegas, my new book Cloud and Virtual Data Storage Networking (CRC Press) is now formally released with general availability announced today along with companion material located at https://storageioblog.com/book3 including the Cloud and Virtual Data Storage Networking LinkedIn group page launched a few months ago. Cloud and Virtual Data Storage Networking (CVDSN) a 370 page hard cover print is my third solo book that follows The Green and Virtual Data Center (CRC Press 2009) and Resilient Storage Networks (Elsevier 2004).

Cloud and Virtual Data Storage Networking Book by Greg Schulz
CVDSN book was on display at VMworld 2011 book store last week along with a new book by Duncan Epping (aka @DuncanYB ) and Frank Denneman (aka @frankdenneman ) titled VMware vSphere 5 Clustering Technical Deepdive. You can get your copy of Duncan and Franks new book on Amazon here.

Greg Schulz during book signing at VMworld 2011
Here is a photo of me on the left visiting a VMworld 2011 attendee in the VMworld book store.

 

Whats inside the book, theme and topics covered

When it comes to clouds, virtualization, converged and dynamic infrastructures Dont be scared however do look before you leap to be be prepared including doing your homework.

What this means is that you should do your homework, prepare, learn, and get involved with proof of concepts (POCs) and training to build the momentum and success to continue an ongoing IT journey. Identify where clouds, virtualization and data storage networking technologies and techniques compliment and enable your journey to efficient, effective and productive optimized IT services delivery.

 

There is no such thing as a data or information recession: Do more with what you have

A common challenge in many organizations is exploding data growth along with associated management tasks and constraints, including budgets, staffing, time, physical facilities, floor space, and power and cooling. IT clouds and dynamic infrastructure environments enable flexible, efficient and optimized, cost-effective and productive services delivery. The amount of data being generated, processed, and stored continues to grow, a trend that does not appear to be changing in the future. Even during the recent economic crisis, there has been no slow down or information recession. Instead, the need to process, move, and store data has only increased, in fact both people and data are living longer. CVDSN presents options, technologies, best practices and strategies for enabling IT organizations looking to do more with what they have while supporting growth along with new services without compromising on cost or QoS delivery (see figure below).

Driving Return on Innovation the new ROI: Doing more, reducing costs while boosting productivity

 

Expanding focus from efficiency and optimization to effectiveness and productivity

A primary tenant of a cloud and virtualized environment is to support growing demand in a cost-effective manner  with increased agility without compromising QoS. By removing complexity and enabling agility, information services can be delivered in a timely manner to meet changing business needs.

 

There are many types of information services delivery model options

Various types of information services delivery modes should be combined to meet various needs and requirements. These complimentary service delivery options and descriptive terms include cloud, virtual and data storage network enabled environments. These include dynamic Infrastructure, Public & Private and Hybrid Cloud, abstracted, multi-tenant, capacity on demand, Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS) among others.

Convergence combing different technology domains and skill sets

Components of a cloud and virtual environment include desktop, servers, and storage, networking, hardware, and software, services along with APIs and software stacks. This include virtual and physical desktops, data, voice and storage networks, LANs, SANs, MANs, WANs, faster blade and rack servers with more memory, SSD and high-capacity storage and associated virtualization tools and management software. True convergence combines leveraging technology and people, processes and best practices aligned to make the most of those resources to deliver cost-effective services delivery.

 

Best people, processes, practices and products (the four Ps)

Bringing all the various components together is the Ps (people skill sets, process, practices and products). This means leveraging and enhancing people skill sets and experience, process and procedures to optimize workflow for streamlined service orchestration, practices and policies to be more effectively reducing waste without causing new bottlenecks, and products such as racks, stacks, hardware, software, and managed or cloud services.

 

Service categories and catalogs, templates SLO and SLA alignment

Establishing service categories aligned to known service levels and costs enables resources to be aligned to applicable SLO and SLA requirements. Leveraging service templates and defined policies can enable automation and rapid provisioning of resources including self-service requests.

 

Navigating to effective IT services delivery: Metrics, measurements and E2E management

You cannot effectively manage what you do not know about; likewise, without situational awareness or navigation tools, you are flying blind. E2E (End to End) tools can provide monitoring and usage metrics for reporting and accounting, including enabling comparison with other environments. Metrics include customer service satisfaction, SLO and SLAs, QoS, performance, availability and costs to service delivered.

 

The importance of data protection for virtual, cloud and physical environments

Clouds and virtualization are important tools and technologies for protecting existing consolidated or converged as well as traditional environments. Likewise, virtual and cloud environments or data placed there also need to be protected. Now is the time to rethink and modernize your data protection strategy to be more effective, protecting, preserving and serving more data for longer periods of time with less complexity and cost.

 

Packing smart and effectively for your journey: Data footprint reduction (DFR)

Reducing your data footprint impact leveraging data footprint reduction (DFR) techniques, technologies and best practices is important for enabling an optimized, efficient and effective IT services delivery environment. Reducing your data footprint is enabled with clouds and virtualization providing a means and mechanism for archiving inactive data and for transparently moving it. On the other hand, moving to a cloud and virtualized environment to do more with what you have is enhanced by reducing the impact of your data footprint. The ABCDs of data footprint reduction include Archiving, Backup modernization, Compression and consolidation, Data management and dedupe along with Storage tiering and thin provisioning among other techniques.

Cloud and Virtual Data Storage Networking book by Greg Schulz

How the book is laid out:

  • Table of content (TOC)
  • How the book is organized and who should read it
  • Preface
  • Section I: Why the need for cloud, virtualization and data storage networks
  • Chapter 1: Industry trends and perspectives: From issues and challenges to opportunities
  • Chapter 2: Cloud, virtualization and data storage networking fundamentals
  • Section II: Managing data and resources: Protect, preserve, secure and serve
  • Chapter 3: Infrastructure Resource Management (IRM)
  • Chapter 4: Data and storage networking security
  • Chapter 5: Data protection (Backup/Restore, BC and DR)
  • Chapter 6: Metrics and measurement for situational awareness
  • Section III: Technology, tools and solution options
  • Chapter 7: Data footprint reduction: Enabling cost-effective data demand growth
  • Chapter 8: Enabling data footprint reduction: Storage capacity optimization
  • Chapter 9: Storage services and systems
  • Chapter 10: Server virtualization
  • Chapter 11: Connectivity: Networking with your servers and storage
  • Chapter 12: Cloud and solution packages
  • Chapter 13: Management and tools
  • Section IV: Putting IT all together
  • Chapter 14: Applying what you have learned
  • Chapter 15: Wrap-up, what’s next and book summary
  • Appendices:
  • Where to Learn More
  • Index and Glossary

Here is the release that went out via Business Wire (aka Bizwire) earlier today.

 

Industry Veteran Greg Schulz of StorageIO Reveals Latest IT Strategies in “Cloud and Virtual Data Storage Networking” Book
StorageIO Founder Launches the Definitive Book for Enabling Cloud, Virtualized, Dynamic, and Converged Infrastructures

Stillwater, Minnesota – September 7, 2011  – The Server and StorageIO Group (www.storageio.com), a leading independent IT industry advisory and consultancy firm, in conjunction with  publisher CRC Press, a Taylor and Francis imprint, today announced the release of “Cloud and Virtual Data Storage Networking,” a new book by Greg Schulz, noted author and StorageIO founder. The book examines strategies for the design, implementation, and management of hardware, software, and services technologies that enable the most advanced, dynamic, and flexible cloud and virtual environments.

Cloud and Virtual Data Storage Networking

The book supplies real-world perspectives, tips, recommendations, figures, and diagrams on creating an efficient, flexible and optimized IT service delivery infrastructures to support demand without compromising quality of service (QoS) in a cost-effective manner. “Cloud and Virtual Data Storage Networking” looks at converging IT resources and management technologies to facilitate efficient and effective delivery of information services, including enabling information factories. Schulz guides readers of all experience levels through various technologies and techniques available to them for enabling efficient information services.

Topics covered in the book include:

  • Information services model options and best practices
  • Metrics for efficient E2E IT management and measurement
  • Server, storage, I/O networking, and data center virtualization
  • Converged and cloud storage services (IaaS, PaaS, SaaS)
  • Public, private, and hybrid cloud and managed services
  • Data protection for virtual, cloud, and physical environments
  • Data footprint reduction (archive, backup modernization, compression, dedupe)
  • High availability, business continuance (BC), and disaster recovery (DR)
  • Performance, availability and capacity optimization

This book explains when, where, with what, and how to leverage cloud, virtual, and data storage networking as part of an IT infrastructure today and in the future. “Cloud and Virtual Data Storage Networking” comprehensively covers IT data storage networking infrastructures, including public, private and hybrid cloud, managed services, virtualization, and traditional IT environments.

“With all the chatter in the market about cloud storage and how it can solve all your problems, the industry needed a clear breakdown of the facts and how to use cloud storage effectively. Greg’s latest book does exactly that,” said Greg Brunton of EDS, an HP company.

Click here to listen and watch Schulz discuss his new book in this Video about Cloud and Virtual Data Storage Networking book by Greg Schulz video.

About the Book

Cloud and Virtual Data Storage Networking has 370 pages, with more than 100 figures and tables, 15 chapters plus appendices, as well as a glossary. CRC Press catalog number K12375, ISBN-10: 1439851735, ISBN-13: 9781439851739, publication September 2011. The hard cover book can be purchased now at global venues including Amazon, Barnes and Noble, Digital Guru and CRCPress.com. Companion material is located at https://storageioblog.com/book3 including images, additional information, supporting site links at CRC Press, LinkedIn Cloud and Virtual Data Storage Networking group, and other books by the author. Direct book editorial review inquiries to John Wyzalek of CRC Press at john.wyzalek@taylorfrancis.com (twitter @jwyzalek) or +1 (917) 351-7149. For bulk and special orders contact Chris Manion of CRC Press at chris.manion@taylorandfrancis.com or +1 (561) 998-2508. For custom, derivative works and excerpts, contact StorageIO at info@storageio.com.

About the Author

Greg Schulz is the founder of the independent IT industry advisory firm StorageIO. Before forming StorageIO, Schulz worked for several vendors in systems engineering, sales, and marketing technologist roles. In addition to having been an analyst, vendor and VAR, Schulz also gained real-world hands on experience working in IT organizations across different industry sectors. His IT customer experience spans systems development, systems administrator, disaster recovery consultant, and capacity planner across different technology domains, including servers, storage, I/O networking hardware, software and services. Today, in addition to his analyst and research duties, Schulz is a prolific writer, blogger, and sought-after speaker, sharing his expertise with worldwide technology manufacturers and resellers, IT users, and members of the media. With an insightful and thought-provoking style, Schulz is also author of the books “The Green and Virtual Data Center” (CRC Press, 2009) which is on the Intel developers recommended reading list and the SNIA-endorsed reading book “Resilient Storage Networks: Designing Flexible Scalable Data Infrastructures” (Elsevier, 2004). Schulz is available for interviews and commentary, briefings, speaking engagements at conferences and private events, webinars, video and podcast along with custom advisory consultation sessions. Learn more at https://storageio.com.

End of press release.

Wrap up

I want to express thanks to all of those involved with the project that spanned over the past year.

Stayed tuned for more news and updates pertaining to Cloud and Virtual Data Storage Networking along with related material including upcoming events as well as chapter excerpts. Speaking of events, here is information on an upcoming workshop seminar that I will be involved with for IT storage and networking professionals to be held October 4th and 5th in the Netherlands.

You can get your copy now at global venues including Amazon, Barnes and Noble, Digital Guru and CRCPress.com.

Ok, nuff said, for now.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2011 StorageIO and UnlimitedIO All Rights Reserved

StorageIO going Dutch again: October 2011 Seminar for storage professionals

Greg Schulz of StorageIO in conjunction with or dutch partner Brouwer Storage Consultancy will be presenting a two day workshop seminar for IT storage, virtualization, and networking professionals Monday 3rd and Tuesday 4th of October 2011 at Ampt van Nijkerk Netherlands.

Brouwer Storage ConsultanceyThe Server and StorageIO Group

This two day interactive education seminar for storage professionals will focus on current data and storage networking trends, technology and business challenges along with available technologies and solutions. During the seminar learn what technologies and management techniques are available, how different vendors solutions compare and what to use when and where. This seminar digs into the various IT tools, techniques, technologies and best practices for enabling an efficient, effective, flexible, scalable and resilient data infrastructure.

The format of this two seminar will be a mix of presentation and interactive discussion allowing attendees plenty of time to discuss among themselves and with seminar presenters. Attendees will gain insight into how to compare and contrast various technologies and solutions in addition to identifying and aligning those solutions to their specific issues, challenges and requirements.

Major themes that will be discussed include:

  • Who is doing what with various storage solutions and tools
  • Is RAID still relevant for today and tomorrow
  • Are hard disk drives and tape finally dead at the hands of SSD and clouds
  • What am I routinely hearing, seeing or being asked to comment on
  • Enabling storage optimization, efficiency and effectiveness (performance and capacity)
  • Opportunities for leveraging various technologies, techniques,trends
  • Supporting virtual servers including re-architecting data protection
  • How to modernize data protection (backup/restore, BC, DR, replication, snapshots)
  • Data footprint reduction (DFR) including archive, compression and dedupe
  • Clarifying cloud confusion, don’t be scared, however look before you leap
  • Big data, big bandwidth and virtual desktop infrastructures (VDI)

In addition this two day seminar will look at what are some new and improved technologies and techniques, who is doing what along with discussions around industry and vendor activity including mergers and acquisitions. In addition to seminar handout materials, attendees will also receive a copy Cloud and Virtual Data Storage Networking (CRC Press) by Greg Schulz that looks at enabling efficient, optimized and effective information services delivery across cloud, virtual and traditional environments.

Cloud and Virtual Data Storage Networking Book

Buzzwords and topic themes to be discussed among others include E2E, FCoE and DCB, CNAs, SAS, I/O virtualization, server and storage virtualization, public and private cloud, Dynamic Infrastructures, VDI, RAID and advanced data protection options, SSD, flash, SAN, DAS and NAS, object storage, big data and big bandwidth, backup, BC, DR, application optimized or aware storage, open storage, scale out storage solutions, federated management, metrics and measurements, performance and capacity, data movement and migration, storage tiering, data protection modernization, SRA and SRM, data footprint reduction (archive, compress, dedupe), unified and multi-protocol storage, solution bundle and stacks.

For more information or to register contact Brouwer Storage Consultancy

Brouwer Storage Consultancy
Olevoortseweg 43
3861 MH Nijkerk
The Netherlands
Telephone: +31-33-246-6825
Cell: +31-652-601-309
Fax: +31-33-245-8956
Email: info@brouwerconsultancy.com
Web: www.brouwerconsultancy.com

Brouwer Storage Consultancey

Learn about other events involving Greg Schulz and StorageIO at www.storageio.com/events

Ok, nuff said for now

Cheers Gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier)
twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2011 StorageIO and UnlimitedIO All Rights Reserved

Cloud and Virtual Data Storage Networking book VMworld 2011 debut

Following up from a previous preview post about my new book Cloud and Virtual Data Storage Networking (CRC Press) for those for those attending VMworld 2011 in Las Vegas Monday August 29 through Thursday September 1st 2011, you can pick up your copy at the VMworld book store.

Cloud and Virtual Data Storage Networking Book

Book signing at VMworld 2011

On Tuesday August 30 at 1PM local time, I will be at the VMworld store signing books. Stop by the book store and say hello, pickup your copy of Cloud and Virtual Data Storage Networking (CRC Press). Also check out the other new releases by fellow vExpert authors during the event. I have also heard rumors that some exhibitors among others will be doing drawings, so keep an eye out in the expo hall and go visit those showing copies of my new book.

The VMworld book store hours are:

Monday 8:30am to 7:30pm
Tuesday 8:30am to 6:00pm
Wednesday 8:30am to 8:00pm
Thursday 8:00am to 2:00pm

For those not attending VMworld 2011, you can order your copy from different venues including Amazon.com, Barnes and Noble, DigitalGuru and CRC Press among others.

Learn more about Cloud and Virtual Data Storage Networking (CRC Press) at https://storageioblog.com/book3

Look forward to seeing you at the various VMworld events in Las Vegas as well as at other upcoming venues.

Ok, nuff said for now.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2011 StorageIO and UnlimitedIO All Rights Reserved

2011 Summer momentus hybrid hard disk drive (HHDD) moment

This is the fourth in a series of posts (others are here, here and here) that I have been doing for over a year now taking a moment now and then to share some of my experiences with using hybrid hard disk drives (HHDD) along side my hard disk drives (HDD) and solid state drives (SSD).

It has been  a several months now since applying the latest firmware (SD25) which resulted in even better stability that was further enhanced when upgrading a few months ago to Windows 7 on all systems with the Seagate Momentus XT HHDD installed in them. One additional older system was recently upgraded from a slower, lower capacity 3.5 inch form factor SATA HDD to a physically smaller 2.5 inch HHDD. The net result is that system now boots in a fraction of the time, shuts down faster, work on it is much more productive and capacity was increased by three and half times.

Why use an HHDD when you could get an SSD?

With flash SSD devices continuing to become more affordable for a given price capacity point, why did I not simply install some of those devices instead of using the HHDDs?

With the money saved from buying the 500GB Momentus XT on Amazon.com (under $100 USD) vs. buying a smaller capacity SSD, I was also able to double the amount of DRAM in that system furthering its useful life plus buying some time to decide what to replace it with while having extra funds for other projects.

Sure I would like to have more and larger capacity SSDs to go along with those I already have, however there is balancing budget with needs and improving productivity (needs vs. wants).

To expand more on why the HHDD at this time vs. SSD, want some more SSD devices to coexist with those I already have and use for different functions. Looking to stretch my budget further, the HHDDs are a great balance of being almost and in some cases as fast as SSDs while at the cost of a high capacity HDD. In other words Im getting the best of both worlds which is a 7,200 RPM 2.5 inch 500GB HDD (e.g. for space capacity) that has 4GB of single layer cell (SLC) flash (e.g. SSD) and 32MB of DRAM as buffers (for read and write performance) to help speed up read and write operations.

Given for what Im using them for, I do not need the consistent higher performance of an SSD across all of my data which brings up the other benefit, Im able to retain more data on the device as a buffer or cache instead of having to go to a NAS or other storage repository to get it. Even though the amount of data being stored on the HHDD is increasing, not all of it gets backed up locally or to my cloud provider as there is already a copy(s) elsewhere. Instead, a small subset of data that is changing or very important gets routinely protected locally and remotely to the cloud enabling easier and faster restores when needed. Now if you have a large budget or someone is willing to buy or give you one, sure, go ahead and get one of the high capacity SSDs (preferably SLC based if concerned about endurance) however there are some good MLC ones out there as well.

Step back a bit, what is an HHDD?

Hybrid hard disk drives (HHDDs) such as the Seagate Momentus XT are, as their name implies, a combination of large- to medium-capacity HDDs with FLASH SSDs. The result is a mix of performance and capacity in a cost effective footprint. HHDDs have not seen much penetration in the enterprise space and may not see much more, given how many vendors are investing in the firmware and associated software technology to achieve hybrid results using a mix of SSDs and high capacity disk drives along with the lack of awarness that they exist.

Where HHDDs could have some additional traction is in secondary or near-line solutions that need some performance enhancements while having a large amount of capacity in a cost-effective footprint. For now, HHDDs are appearing mainly in desktops, laptops, and workstations that need lots of capacity with some performance but without the high price of SSDs. Before I installed the HHDDs in my laptops, I initially used one as a backup and data movement device, and I found that large, gigabyte-sized files could be transferred as fast as with SSDs and much faster than via my WiFi based network and NAS. The easiest way to characterize where HHDDs fit is where you want an SSD for performance, but your applications do not always need speed and you need a large amount of storage capacity at an affordable price.

SSDs are part of the future, however HDDs have a lot of life in them including increased capacities, both are best used where their strengths can be maximized, thus HHDDs are a great compliment or stepping stone for some applications. Note, Seagate recently announced that they have shipped over one million HHDDs in just over a years time.

I do find it interesting though when I hear from those who claim that the HDD is dead and that SSD is the future yet they do not have SSDs in their systems let alone do they have or talk about HHDDs, hmmmm.

Ok, nuff said for now.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2011 StorageIO and UnlimitedIO All Rights Reserved

Supporting IT growth demand during economic uncertain times

Doing more with less, doing more with what you have or reducing cost have been the mantra for the past several years now.

Does that mean as a trend, they are being adopted as the new way of doing business, or simply a cycle or temporary situation?

Reality is that many if not most IT organizations are and will remain under pressure to stretch their budgets further for the immediate future. Over the past year or two some organizations saw increases in their budgets however also increased demand while others saw budgets fixed or reduced while having to support growth. On the other hand, there is no such thing as an information recession with more data being generated, moved, processed, stored and retained for longer periods of time.

Industry trend: No such thing as a data recession

Something has to give as shown in the following figure which is that on one curve there is continued demand and growth, while another curve shows need to reduce costs while another reflects the importance of maintaining or enhancing service level objectives (SLOs) and quality of service (QoS).

Enable growth while removing complexity and cost without compromising service levels

One way to reduce costs is to inhibit growth while another is to support growth by sacrificing QoS including performance, response time or availability as a result of over consolidation, excessive utilization or instability as a result of stretching resources to far. Where innovation comes into play is finding and fixing problems vs. moving or masking them or treating symptoms vs. the real issue and challenge. Innovation also comes into play by identifying both near term tactical as well as longer term strategic means of taking complexity and cost out of service delivery and the resources needed to support them. For example determining the different resources and processes involved in delivering an email box of a given size and reliability. Another being supporting a virtual machine (VM) with a given performance and capacity capability. Yet another scenario is a file share or home directory of a specific size and availability. By streamlining work flows, leveraging automation and other tools to enforce polices as well as adopting new best practices complexity and thereby costs can be reduced. The net rest is a lower cost to provide a given service to a specific level which when multiplied out over many users or instances, results in cost savings however also productivity gains.

The above is all good and well for longer term strategic and where you want to go or get to, however what can be done right now today?

Here are a few tips to do more with what you have while supporting growth demands

If you have service level agreements (SLAs) and SLOs as part of your service category, review with your users as to what they need vs. what they would like to have. What you may find is that your users want or expect a given level of service, yet would be happy and ok with moving to a cloud service that had lower SLO and SLA expectations if lower cost. The previous scenario would be an indicator that you users want and thus you give them a higher level of service, yet their requirements are actually lower than what is expected. On the other hand if you do not have SLOs and SLAs aligned with cost for the services then set them up and review customer or client expectations, needs vs. wants on a regular basis. You might find out that you can stretch your budget by delivering a lower (or higher) class of services to meet different users requirements than what was assumed to be the case. In the case of supporting a better class of service, if you can use an SSD enabled solution to reduce latency or wait times and boost productivity, more transactions or page views or revenue per hour, that could prompt a client to request that capability to meet their business needs.

Reduce your data footprint impact in order to support growth using the ABCDs of data footprint reduction (DFR), that is Archive (email, file, database), Backup modernization, Compression and consolidation, Data management and dedupe, storage tiering among other techniques.

Storage, server virtualization and optimization using capacity consolidation where practical and IO consolidation to fast storage and SSD where possible. Also review storage configuration including RAID and allocation to identity if any relatively easy changes can improve performance, availability, capacity and energy impact.

Investigate available upgrades and enhancements to your existing hardware, software and services that can be applied to provide breathing room within current budgets while evaluating new technologies.

Find and fix problems vs. chasing false positives that provide near term relief only to have the real issue reappear. Maximize your budgets by identifying where people time and other resources are being spent due to processes, work flows, technology configuration complexity or bottlenecks and address those.

Enhance and leverage existing management measurements to gain more insight along with implementing new metrics for End to End (E2E) situational awareness of your environment which will enable effective decision making. For example you may be told to move some function to the cloud as it will be cheaper, yet if you do not have metrics to indicate one way or the other, how can that be an informed decision? If you have metrics that show your cost for the same service being moved to a cloud or managed service provider as well as QoS, SLO, SLA, RTO, RPO and other TLAs, then you can make informed decisions. That decision may still be to move functions to a cloud or other service even if in fact it is more expensive compared to what you can provide it for in order that your resources can be directed to supporting other important internal functions.

Look for ways to reduce cost of a service delivered as opposed to simply cutting costs. They sound like one and the same, however if you have metrics and measurements providing situational awareness to know what the cost of a service is, you can also then look at how to streamline those services, remove complexity, reduce workflow, leverage automation there by removing cost. The goal is the same, however how you go about removing cost can have an impact on your return on innovation not to mention customer satisfaction.

Also be an informed shopper, have a forecast or plan on what you will need and when, along with what you must have (core requirements) vs. what you would like to have or want. When looking at options, balance what is needed and then if you can get what you want or would like for little or no extra cost if they add value or enable other initiatives. Part of being an informed shopper is having support of the business to be able to procure what you want or need which means aligning technology resources and their cost to delivery of business functions and services.

What you need vs. what you want
In a recent interview with the associated press (AP) the reporter wanted to know my comments about spending vs. saving during economic tough times (you can read the story here). Basically my comments were to spend within your means by identifying what you need vs. what you want, what is required to keep the business running or improve productivity and remove cost as opposed to acquiring nice to have things that can wait. Sure I would like to have a new 85 to 120" 3D monitor for my workstation that could double as a TV, however I do not need or require it.

On the other hand, I recently upgraded an existing workstation adding a Hybrid Hard Disk Drive (HHDD) and some additional memory, about a $200USD investment that is already paying for itself via increased productivity. That is instead of enjoying a cup of dunkin donut coffee while waiting for some tasks to complete on that system, Im able to get more done in a given amount of time boosting productivity.

For IT environments this means looking at expenditures to determine what is needed or required to keep things running while supporting near term strategic and tactical initiatives or pet projects.

For vendors and vars, if things have not been a challenge yet, now they will need to refine their messages to show more value, return on innovation (ROI) in terms of how to help their customers or prospects stretch resources (budgets, people, skill sets, products, services, licenses, power and cooling, floor space) further to support growth, while removing costs without compromising on service delivery. This also means a shift in thinking of short term or tactical cost cutting to longer term strategic approaches of reducing costs to deliver a service or resources.

Related links pertaining to stretching your resources, doing more with what you have, increasing productivity and maximizing your budget to support growth without compromising on customer service.

Saving Money with Green IT: Time To Invest In Information Factories
Storage Efficiency and Optimization – The Other Green
Shifting from energy avoidance to energy efficiency
Saving Money with Green Data Storage Technology
Green IT Confusion Continues, Opportunities Missed!
Storage Efficiency and Optimization – The Other Green
PUE, Are you Managing Power, Energy or Productivity?
Cloud and Virtual Data Storage Networking
Is There a Data and I/O Activity Recession?
More Data Footprint Reduction (DFR) Material

What is your take?

Are you and your company going into a spending freeze mode, or are you still spending, however placing or having constraints put on discretionary spending?

How are you stretching your IT budget to go further?

 

Ok, nuff said for now.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2011 StorageIO and UnlimitedIO All Rights Reserved

VMware vSphere v5 and Storage DRS

Here is a link to a recent guest post that I was invited to do over at The virtualization Practice (TVP) pertaining to the recent VMware vSphere 5.0 announcement. A theme of the vSphere 5.0 launch is reducing complexity, enabling automation, and supporting scaling with confidence for cloud and virtual environments. As a key component for supporting cloud, virtual and dynamic infrastructure environments, vSphere V5.0 includes many storage related enhancements and new features including Storage Distributed Resource Scheduler (SDRS).

Read more here.

Ok, nuff said for now.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2011 StorageIO and UnlimitedIO All Rights Reserved

Measuring Windows performance impact for VDI planning

Here is a link to a recent guest post that I was invited to do over at The Virtualization Practice (TVP) pertaining to measuring the impact of Windows Boot performance and what that means for planning for Virtual Desktop Infrastructure (VDI) initiatives.

With Virtual Desktop Infrastructures (VDI) initiatives adoption being a popular theme associated with cloud and dynamic infrastructure environments a related discussion point is the impact on networks, servers and storage during boot or startup activity to avoid bottlenecks. VDI solution vendors include Citrix, Microsoft and VMware along with various server, storage, networking and management tools vendors.

A common storage and network related topic involving VDI are boot storms when many workstations or desktops all startup at the same time. However any discussion around VDI and its impact on networks, servers and storage should also be expanded from read centric boots to write intensive shutdown or maintenance activity as well.

Having an understanding of what your performance requirements are is important to adequately design a configuration that will meet your Quality of Service (QoS) and service level objectives (SLOs) for VDI deployment in addition to knowing what to look for in candidate server, storage and networking technologies. For example, knowing how your different desktop applications and workloads perform on a normal basis provides a baseline to compare with during busy periods or times of trouble. Another benefit is that when shopping for example storage systems and reviewing various benchmarks, knowing what your actual performance and application characteristics are helps to align the applicable technology to your QoS and SLO needs while avoiding apples to oranges benchmark comparisons.

Check out the entire piece including some test results using the hIOmon tool from hyperIO to gather actual workstation performance numbers.

Keep in mind that the best benchmark is your actual applications running as close to possible to their typical workload and usage scenarios.

Also keep in mind that fast workstations need fast networks, fast servers and fast storage.

Ok, nuff said for now.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2011 StorageIO and UnlimitedIO All Rights Reserved

Getting SASy, the other shared storage option for disk and SSD systems

Here is a link to a recent guest post that I was invited to do over at The Virtualization Practice (TVP) pertaining to Getting SASsy, the other shared server to storage interconnect for disk and SSD systems. Serial Attached SCSI (SAS) is better known as an interface for connecting hard disk drives (HDD) to servers and storage systems; however it is also widely used for attaching storage systems to physical as well as virtual servers. An important storage requirement for virtual machine (VM) environments with more than one physical machine (PM) server is shared storage. SAS has become a viable interconnect along with other Storage Area Network (SAN) interfaces including Fibre Channel (FC), Fibre Channel over Ethernet (FCoE) and iSCSI for block access.

Read more here.

Ok, nuff said for now.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2011 StorageIO and UnlimitedIO All Rights Reserved

Industry trend: People plus data are aging and living longer

Lets face it, people and information are living longer and thus there are more of each along with a strong interdependency by both.

People living and data being retained longer should not be a surprise, take a step back and look at the bigger picture. There is no such thing as an information recession with more data being generated, processed, moved and stored for longer periods of time not to mention that a data object is also getting larger.

Industry trend and performance

By data objects getting larger, think about a digital photo taken on a typical camera ten years ago which whose resolution was lower and thus its file size would have been measured in kilo bytes (thousands). Today megapixel resolutions are common from cell phones, smart phones, PDAs and even larger with more robust digital and high definition (HD) still and video cameras. This means that a photo of the same object that resulted in a file of hundreds of Kbytes ten years ago would be measured in Megabytes today. With three dimensional (3D) cameras appearing along with higher resolution, you do not need to be a rocket scientist or industry pundit to figure out what that growth trend trajectory looks like.

However it is not just the size of the data that is getting larger, there are also more instances along with copies of those files, photos, videos and other objects being created, stored and retained. Similar to data, there are more people now than ten years ago and some of those have also grown larger, or at least around the waistline. This means that more people are creating and relying on larger amounts of information being available or accessible when and where needed. As people grow older, the amount of data that they generate will naturally increase as will the information that they consume and rely upon.

Where things get interesting is that looking back in history, that is more than ten or even a hundred years, the trend is that there are more people, they are living longer, and they are generating larger amounts of data that is taking on new value or meaning. Heck you can even go back from hundreds to thousands of years and see early forms of data archiving and storage with drawings on walls of caves or other venues. I Wonder if had the cost (and ease of use) to store and keep data had been lower back than would there have been more information saved? Or was it a case of being too difficult to use the then state of art data and information storage medium combined with limited capacities so they simply ran out of storage and retention mediums (e.g. walls and ceilings)?

Lets come back to the current for a moment which is another trend of data that in the past would have been kept offline or best case near line due to cost and limits or constraints are finding their way online either in public or private venues (or clouds if you prefer).

Thus the trend of expanding data life cycles with some types of data being kept online or readily accessible as its value is discovered.

Evolving data life cycle and access patterns

Here is an easy test, think of something that you may have googled or searched for a year or two ago that either could not be found or was very difficult to find. Now take that same search or topic query and see if anything appears and if it does, how many instances of it appear. Now make a note to do the same test again in a year or even six months and compare the results.

Now back to the future however with an eye to the past and things get even more interesting in that some researchers are saying that in centuries to come, we should expect to see more people not only living into their hundreds, however even longer. This follows the trend of the average life expectancy of people continues to increase over decades and centuries.

What if people start to live hundreds of years or even longer, what about the information they will generate and rely upon and its later life cycle or span?

More information and data

Here is a link to a post where a researcher sees that very far down the road, people could live to be a thousand years old which brings up the question, what about all the data they generate and rely upon during their lifetime.

Ok, now back to the 21st century and it is safe to say that there will be more data and information to process, move, store and keep for longer periods of time in a cost effective way. This means applying data footprint reduction (DFR) such as archiving, backup and data protection modernization, compression, consolidation where possible, dedupe and data management including deletion where applicable along with other techniques and technologies combined with best practices.

Will you out live your data, or will your data survive you?

These are among other things to ponder while you enjoy your summer (northern hemisphere) vacation sitting on a beach or pool side enjoying a cool beverage perhaps gazing at the passing clouds reflecting on all things great and small.

Clouds: Dont be scared, however look before you leap and be prepared

Ok, nuff said for now.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2011 StorageIO and UnlimitedIO All Rights Reserved

Have you heard of 2DRS data protection technology?

Have you heard of 2DRS as a data storage technology?

If not, dont worry, you would probably be in a minority if you said yes.

Anyway, Phil White of ECCTek has sent lots of material about 2DRS (2 dimensional error correction code: ECC) over the past few months.

In a nutshell, if you have an interest in data integrity, low level data storage topics, RAID, SSD or HDDs, you may want to have a look. I have no affiliation with Phil, ECCtek or 2DRS, nor can I vouch for what ECCtek is doing. However as he has been persistent (in a polite way), time to share some info and you can decide what to do with it.

The following is from Phil:

Hello,

You may be able to start a project to develop a 2D-RS product in your company.

You may be able to write and publish an article promoting the 2D-RS ideas.

You may be able to send me e-mail addresses of others who may be interested in the 2D-RS ideas.

You could forward this e-mail to others who may be interested in the 2D-RS ideas.

I am asking you to please take the time you need to read the web pages at the end of this e-mail, and please think seriously about the ideas and ask questions if something is unclear.

After you have read the web pages and thought about the ideas, I am asking that you please do one or more of the following things…

Start a project to develop a 2D-RS product in your company.
Write and publish an article to promote the 2D-RS ideas.
Send me e-mail addresses of others who may be interested in the 2D-RS ideas.
Forward this e-mail to others.

Regards,

Phil White
President
ECC Technologies, Inc. (ECC Tek)
4750 Coventry Road East
Minnetonka, MN 55345-3909
Phone: 952-935-2885
Fax:   952-935-2491
www.ecctek.com
 
Web Pages
ECC Teks Web Site
ECC Tek Company Profile
PRS Patent

2D ECC Concepts
2D RS HDDs
2D RS HDD Products
2D RS SSDs
2D RS Storage Systems
2D RS Comments
2D RS A
2D RS Believers

Basic ECC Concepts
Finite Fields, RS Codes and RS RAID
Finite Fields with 4bit Elements

I will leave it up to you if you want to check out what Phil has to say and if or where 2D may or may not be relevant.

Ok, nuff said for now.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2011 StorageIO and UnlimitedIO All Rights Reserved