StorageIOblog full RSS feed (http://storageioblog.com/RSsfull.xml)

Are large storage arrays dead at the hands of SSD?

Thu, 17 May 2012 12:34:56 CST

Are large storage arrays dead at the hands of SSD?

By Greg Schulz

An industry trends and perspective.

Are large storage arrays dead at the hands of SSD? Short answer NO not yet.
There is still a place for traditional storage arrays or appliances particular those with extensive features, functionality and reliability availability serviceability (RAS). In other words, there is still a place for large (and small) storage arrays or appliances including those with SSDs.

Is there a place for newer flash SSD storage systems, appliances and architectures? Yes
Similar to how there is a place for traditional midrange storage arrays or appliances have found their roles vs. traditional higher end so-called enterprise arrays. Think as an example EMC CLARiiON/VNX or HP EVA/P6000 or HDS AMS/HUS or NetApp FAS or IBM DS5000 or IBM V7000 among others vs. EMC Symmetric/DMX/VMAX or HP P10000/3Par or HDS VSP/USP or IBM DS8000. In addition to traditional enterprise or high-end storage systems and midrange also known as modular, there are also specialized appliances or targets such as for backup/restore and archiving. Also do not forget the IO performance SSD appliances like those from TMS among others that have been around for a while.

Is the role of large storage systems changing or evolving? Yes
Given their scale and ability to do large amounts of work in a dense footprint, for some the role of these systems is still mission critical tier 1 application and data support. For other environments, their role continues to evolve being used for high-density tier 2 bulk or even near-line storage for on-line access at scale.

Does this mean there is completion between the old and new systems? Yes
In some circumstances as we have seen already with SSD solutions. Some will place as competing or replacements while others as complementing. For example in the PCIe flash SSD card segment EMC VFCache is positioned is complementing Dell, EMC, HDS, HP, IBM, NetApp, Oracle or others storage vs. FusionIO who positions as a replacement for the above and others. Another scenario is how some SSD vendors have and continue to position their all-flash SSD arrays using either drives or PCIe cards to complement and coexist with other storage systems in an environment (e.g. data center level tiering) vs. as a replacement. Also keep in mind SSD solutions that also support a mix of flash devices and traditional HDDs for capacity and cost savings or cloud access in the same solution.

Does this mean that the industry has adopted all SSD appliances as the state of art?
Avoid confusing industry adoption or talk with industry and customer deployment. They are similar, however one is focused on what the industry talks about or discusses as state of art or the future while the other is what customers are doing. Certainly some of the new flash SSD appliance and storage startups such as Solidfire, Nexgen, Violin, Whiptail or veteran TMS among others have promising futures, some of which may actually be in play with the current SSD market shakeout and consolidation.

Does that mean everybody is going SSD?
SSD customer adoption and deployment continues to grow, however so too does the deployment of high-capacity HDDs.

Do SSDs need HDDs, do HDDs need SSDs? Yes
Granted there are environments where needs can be addressed by all of one or the other. However at least near term, there is a very strong market for tiering and mix of SSD, some fast HDDs and lots of high-capacity HDDs to meet various needs including performance, availability, capacity, energy and economics. After all, there is no such thing, as a data or information recession yet budgets are tight or being reduced. Likewise, people and data are living longer.

What does this mean?
If there, were no such thing as a data recession and budgets a non-issue, perhaps everything could move to all flash SSD storage systems. However, we also know that people and data are living longer along with changing data life-cycle patterns. There is also the need for performance to close the traditional data center IO performance to space capacity gap and bottlenecks as well as store and keep data longer.

There will continue to be a need for a mix of high-capacity and high performance. More IO will continue to gravitate towards the IO appliances, however more data will settle in for longer-term retention and continued access as data life-cycle continue to evolve. Watch for more SSD and cache in the large systems, along with higher density SAS-NL (SAS Near Line e.g. high capacity) type drives appearing in those systems.

If you like new shiny new toys or technology (SNTs) to buy, sell or talk about, there will be plenty of those to continue industry adoption while for those who are focused on industry deployment, there will be a mix of new, and continued evolution for implementation.

Ok, nuff said for now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Storage and IO metrics that matter

Thu, 3 May 2012 16:54:32 CST

Storage and IO metrics that matter

By Greg Schulz

It is great to see more conversations and coverage around storage metrics that matter beyond simply focusing on cost per GByte or TByte (e.g. space capacity). Likewise, it is also good to see conversations expanding beyond data footprint reduction (DFR) from a space capacity savings or reduction ratio to also address data movement and transfer rates. Also good to see is increase in discussion around input/output operations per section (IOPs) tying into conversations from virtualization, VDI, cloud to Sold State Devices (SSD).

Other storage and IO metrics that matter include latency or response time, which is how fast work is done, or time spent. Latency also ties to IOPS in that as more work arrives to be done (IOPS) of various size, random or sequential, reads or writes, queue depths are an indicator of how well work is flowing. Another storage and IO metric that matters is availability because without it, performance or capacity can be affected. Likewise, without performance, availability can be affected.

Needless to say that I am just scratching the surface here with storage and IO metrics that matter for physical, virtual and cloud environments from servers to networks to storage.

Here is a link to a post I did called IO, IO, it is off to storage and IO metrics we go that ties in themes of performance measurements and solid-state disk (SSD) among others. Also check out this piece about why VASA (VMware storage analysis metrics) is important to have your VMware CASA along with Windows boot storage and IO performance for VDI and traditional planning purposes.

Check out this post about metrics and measurements that matter along with this conversation about IOPs, capacity, bandwidth and purchasing discussion topics.

Ok, nuff said for now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Is SSD dead? No, however some vendors might be

Thu, 3 May 2012 16:54:32 CST

Is SSD dead? No, however some vendors might be

By Greg Schulz

In a recent conversation with Dave Raffo about the nand flash solid state disk (SSD) market, we talked about industry trends, perspectives and where the market is now as well as headed. One of my comments is, has been and will remain that the industry has still not reached anywhere near full potential for deployment of SSD for enterprise, SMB and other data storage needs. Granted, there is broad adoption in terms of discussion or conversation and plenty of early adopters.

SSD and in particular nand flash is anything but dead, in fact in the big broad picture of things, it is still very early in the game. Sure, for those who cover and crave the newest, latest and greatest technology to talk about, nand flash SSD might seem old, yesterday news, long in the tooth and time for something else. However, for those who are focused on deployment vs. adoption such as customers, in general, nand flash SSD in its many packaging options has still not yet reached its full potential.

Despite the hype, fanfare from CEOs or their evangelist along with loyal followers of startups that help drive industry adoption (e.g. what is talked about), there is still lots of upside growth in the customer drive industry deployment (actually buying, installing and using) for nand flash SSD.

What about broad customer deployments?

Sure, there are the marquee customer success stories that you need a high-capacity SAS or SATA drive to hold the YouTube videos, slide decks, press releases for.

However, have we truly, reached broad customer deployment or broad industry adoption?

Hence, I see more startups coming into the market space, and some exiting on their own, via mergers and acquisition or other means.

Will we see a feeding frenzy or IPO craze as with earlier hype cycles of technologies, IMHO there will be some companies that get the big deal, some will survive as new players running as a business vs. running to be acquired or IPO. Others will survive by evolving into something else while others will join the where are they now list.

If you are a SSD startup, CEO, CxO, or marketer, their PR, evangelist or loyal follower do not worry as the SSD market and even nand flash is far from being dead. On the other hand, if you think that it has hit its full stride, you are missing either the bigger picture, or too busy patting yourselves on the back for a job well done. There is much more opportunity out there and not even all the low hanging fruit has been picked yet.

Check out the conversation with Dave Raffo along with comments from others here.

Ok, nuff said for now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

What is the best kind of IO? The one you do not have to do

Thu, 3 May 2012 16:54:32 CST

What is the best kind of IO? The one you do not have to do

By Greg Schulz

If no IO (input/output) operation is the best IO, than the second best IO is the one that can be done as close to the application and processor with best locality of reference. Then the third best IO is the one that can be done in less time, or at least cost or impact to the requesting application which means moving further down the memory and storage stack (figure 1).

Figure 1 memory and storage hierarchy

The problem with IO is that they are basic operation to get data into and out of a computer or processor so they are required; however, they also have an impact on performance, response or wait time (latency). IO require CPU or processor time and memory to set up and then process the results as well as IO and networking resources to move data to their destination or retrieve from where stored. While IOs cannot be eliminated, their impact can be greatly improved or optimized by doing fewer of them via caching, grouped reads or writes (pre-fetch, write behind) among other techniques and technologies.

Think of it this way, instead of going on multiple errands, sometimes you can group multiple destinations together making for a shorter, more efficient trip; however, that optimization may also take longer. Hence sometimes it makes sense to go on a couple of quick, short low latency trips vs. one single larger one that takes half a day however accomplishes many things. Of course, how far you have to go on those trips (e.g. locality) makes a difference of how many you can do in a given amount of time.

What is locality of reference?

Locality of reference refers to how close (e.g location) data exists for where it is needed (being referenced) for use. For example, the best locality of reference in a computer would be registers in the processor core, then level 1 (L1), level 2 (L2) or level 3 (L3) onboard cache, followed by dynamic random access memory (DRAM). Then would come memory also known as storage on PCIe cards such as nand flash solid state device (SSD) or accessible via an adapter on a direct attached storage (DAS), SAN or NAS device. In the case of a PCIe nand flash SSD card, even though physically the nand flash SSD is closer to the processor, there is still the overhead of traversing the PCIe bus and associated drivers. To help offset that impact, PCIe cards use DRAM as cache or buffers for data along with Meta or control information to further optimize and improve locality of reference. In other words, help with cache hits, cache use and cache effectiveness vs. simply boosting cache utilization.

What can you do the cut the impact of IO

Establish baseline performance and availability metrics for comparison
Realize that IOs are a fact of IT virtual, physical and cloud life
Understand what is a bad IO along with its impact
Identify why an IO is bad, expensive or causing an impact
Find and fix the problem, either with software, application or database changes
Throw more software caching tools, hyper visors or hardware at the problem
Hardware includes faster processors with more DRAM and fast internal busses
Leveraging local PCIe flash SSD cards for caching or as targets
Utilize storage systems or appliances that have intelligent caching and storage optimization capabilities (performance, availability, capacity).
Compare changes and improvements to baseline, quantify improvement

Ok, nuff said for now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Congratulations to new and returning 2012 VMware vExperts

Mon, 30 Apr 2012 11:44:55 CST

Congratulations to new and returning 2012 VMware vExperts

By Greg Schulz

A quick note of congratulations to all the new as well as too my fellow returning 2012 VMware vExperts from around the world.

Here is a link listing the 2012 VMware vExperts including how you can follow them on twitter if you are interested in virtualization, cloud, data and storage networking related topics either VMware specific or industry and technology general.

Also, here are some added links to follow and check out.

twitter @VMwareCommunity
plantetv12n blogs and information
Wmware and community blogs
VMware communities
vExpert spotlights (follow links to various profiles)

I'm honored to be among such a great group of people and again, congratulations to all.

Ok, nuff said for now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

More Storage IO momentus HHDD and SSD moments part I

Sun, 29 Apr 2012 12:34:56 CST

More Storage IO momentus HHDD and SSD moments part I

By Greg Schulz

This is the first of a two part series on my latest experiences with HHDD and SSD's

About two years ago I wanted to start installing solid state devices (SSD's) into my workstations and laptops. Like many others, I found the expensive price for the limited capacity gains of the then generation SSD's did not make for a good business decision based on my needs. Dont get me wrong, I have been a huge fan of SSD for decades as an IT user, vendor, analysts, consultant and consumer and still am. In fact I have some SSD's used for different purposes as well as many Hard Disk Drives (HDD) and Hybrid Hard Disk Drives (HHDD's). Almost two years ago when I first tested the HHDD's, I did an first post in this ongoing series and this two-part post is part of that string of experiences observed evolving from HDD's to HHDD's to SSD's

Image courtesy of Seagate.com

As a refresher, HHDD's like the Seagate Momentus XT combine a traditional 7,200 RPM 2.5 inch 500GB or 750GB HDD with an integrated single level cell (SLC) nand flash SSD within the actual device. The SSD in the HHDD's is part of the HDD's controller complementing the existing DRAM buffer by adding 4GB (500GB models) or 8GB (750GB models) of fast nand flash SSD cache. This means that no external special controller, adapter, data movement or migration software are required to get the performance boost over a traditional HDD and the capacity above a SSD at an affordable cost. In other words, the HHDD's bridge the gap between those who need large capacity and some performance increases, without having to spend a lot on a lower capacity SSD.

However based on my needs or business requirements two years ago I found the justification to get all the extra performance of SSD not quite there when. Back two years ago my thinking was that it would be about two maybe three years before the right point for a mix of performance, availability (or reliability e.g. duty cycles), capacity and economics aligned.

Note that this was based on my specific needs and requirements as opposed to my wants or wishes (I wanted SSD back then, however my budget needed to go elsewhere). My requirements and performance needs are probably not the same as yours or others might be. I also wanted to see the incremental technology, product and integration improvements ranging from duty cycle or program/erase cycles (P/E) with newer firmware and flash translation layers (FTLs) among other things. Particularly with multilevel cell (MLC) or enhanced multilevel cell (eMLC) which helps bring the cost down while boosting the capacity, I'm seeing enough to have more confidence in those devices. Note that for the past couple of years I have used single level cell (SLC) nand flash SSD technology in my HHDD's, the same SSD flash technology that has been found in enterprise class storage.

While I wanted SSD's two years ago in my laptops and workstations to improve productivity which involves a lot of content creation in addition to consumption, however as mentioned above, there were barriers. So instead of sitting on the sidelines, waiting for SSD's to either become lower cost, or more capacity for a given cost, or wishing somebody would send me some free stuff (that may or may not have worked), I took a different route. That route was to try the HHDD's such as Seagate Momentus XT.

Disclosure: Seagate sent me my first HHDD for first testing and verifications before buying several more from Amazon.com and installing them in all laptops, workstations and a server (not all servers have the HHDD's, or at least yet).

The main reason I went with the HHDD's two years ago and continue to use them today is to bridge the gap and gain some benefit vs. waiting and wishing and talking about what SSD's would enable me to do in the future while missing out on productivity enhancements.

The HHDD's also appealed to me in that my laptops are space constrained for putting two drives and playing the hybrid configuration game of installing both a small SSD and HDD and migrating data back and forth. Sure I could do that for in the office or carry an extra external device around however been there, done that in the past and want to move away from those types of models where possible.

Ok, nuff said for now, lets resume this discussion in part II.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

More Storage IO momentus HHDD and SSD moments part II

Sun, 29 Apr 2012 12:34:56 CST

More Storage IO momentus HHDD and SSD moments part II

By Greg Schulz

This follows the first of a two-part series on my latest experiences with Hybrid Hard Disk Drives (HHDD's) and Solid State Devices (SSD's). In my ongoing last momentus moment post I discussed what I have done with HHDD's and setting the stage for expanded SSD use. I have the newer HHDD's, e.g. Seagate Momentus XT II 750GB (8GB SLC nand flash) installed and have since bought another from Amazon as well as having some of the older 500GB (4GB SLC nand flash) in various systems. Those are all functioning great, however still waiting and looking forward to the rumored firmware enhancements to boost write capabilities.

This brings me up to the latest momentus moment which now includes SSD's.

Well its two years later and I now have a 256GB (usable capacity is lower) Samsung SSD that I bought from Amazon.com and installed in one of my laptops and just as when I made the first switch to HHDD's, I also have a backup copy/clone to fall back to in case of emergency.

Was it worth the wait? Yes, particularly using the HHDD's to bridge the gap and enable some productivity gain which more than paid for them based on some different projects. I'm already seeing productivity improvements that will make future upgrades more easy to justify (to myself).

I deviated from my strategy a bit and installed the SSD about six months earlier than I was planning to do so because of a physical barrier. That physical barrier was my new traveling laptop only accepts 7mm height 2.5 inch small form factor devices and the 750GB HHDD that I had planned on installing was 2.5mm to thick which pushed up the SSD installation.

What will become of the 750GB HHDD? Its being redeployed to help speed up file serving, backups and other functions.

Will I replace the HHDD's in my other workstations and laptops now with SSD's? Across the board no, not yet, however there is one other system that is a prime candidate to maybe upgrade in a month or two (maybe less).

Will I stick with the Samsung SSD's or look at other options? I'm keeping my options open and using this as a gauge to test and compare other options in a real world working environment as opposed to a lab bench test simulation. In other words, taking the next step past the lab test and product reviews, gaining comfort and confidence and then trying out with real use activity.

What will happen in the future as I install more SSD's and have surplus HHDD's? Redeployed them of course into file or NAS servers, backup targets that in turn will replace HDD's that will either get retired, or redeployed to replace older, smaller capacity, higher cost to handle HDD's used for offsite protection.

I tried using the software that came with the SSD to do the cloning and should have known better, however wanted to see what the latest version of ghost was like (it was a waste of time to be polite). Instead I used Seagate Discwizard (aka Acronis) which requires at least one Seagate product (source or target) for cloning.

Cloning from the Seagate HHDD that have been previously cloned from the Hitachi HDD that came with the laptop, was a none issue. However, I wanted to see what would happen if I attached the Samsung SSD to the Seagate Goflex cable and clone directly from the Hitachi HDD, it worked. Hence another reason to have some of the Seagate Goflex cables (USB and eSATA) like the ones I bought at Amazon.com around in your toolbox.

While I do not have concrete empirical numbers to share, cloning from a HDD to a SSD is shall we say fast, however, what's really fun to watch is cloning from a HHDD to a SSD using an eSata (GoFlex) connector adapter. The reason I say that it is fun is that you dont have to sit and wait for hours, it's not minutes to move 100s of GBs, however you can very much see the progress bar move at a good pace.

Also, I put the HHDD on an eSata port and try that out as a backup or data dump target if you have the need for speed, capacity and cost effectiveness, yes its fast, has lots of capacity and so forth. Now if Seagate and Synology or EMC Iomega would get their acts together and add support for the HHDD's in those different unified SMB and SOHO NAS solutions, that would be way cool.

Will I be racing to put SSD's in my other laptops or workstations soon? Probably not as there are things in the works and working their way into and through the market place that I wanted to wait for, and thus will wait for now, that is unless a more interesting opportunity pops up.

Ok, nuff said for now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

IT Optimization, efficiency, convergence and cloud conversations from SNW

Fri, 13 Apr 2012 17:16:18 CST

IT Optimization, efficiency, convergence and cloud conversations from SNW

By Greg Schulz

Recently I did a presentation titled Cloud and Virtual Data Storage Networking (hmm, I think I know of a book with the same title) at the spring 2012 SNW in Dallas. My presentation was on the first morning of the session as I needed to be in Boston to record a video the following Tuesday morning, thus I missed out on the storm clouds and tornadoes that rolled in the next day.

While I was at SNW, had the honor of being a guest on Calvin Zito (aka @HPStorageguy) pod cast that can be found on his Around the Storage Block Blog or by clicking here.

Check out our conversations about clouds, related topics and more from a practical perspective cutting through the hype and fud.

Oh, if you are interested in Cloud and Virtual Data Storage Networking, click here to learn more about the book, or here to find various downloads and associated presentations, and here to see some upcoming events, activities and venues both in the U.S. and in Europe.

Ok, nuff said for now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Part I: PureSystems, something old, something new, something from big blue

Thu, 12 Apr 2012 21:01:10 CST

Part I: PureSystems, something old, something new, something from big blue

By Greg Schulz

This is the first in a five-part series around the recent IBM PureSystems announcements. You can view the next post here.

For a certain generation of IBM faithful or followers the recently announced PureFlex and PureApplication systems might give a sense of DejaVu perhaps even causing some to wonder if they just woke up from a long Rip Van Winkle type nap.

Yet for another generation who may not yet be future IBM followers, fans, partners or customers, there could be a sense of something new and revolutionary with the PureFlex and PureApplication systems (twitter @ibmpuresystems).

In between those two groups, exist others who are either scratching their heads or reinvigorated with enthusiasm to get out and be able to discuss opportunities around little data (traditional and transactional) and big data, servers, virtualized, converged infrastructure, dynamic data centers, private clouds, ITaaS, SaaS and AaaS, PaaS, IaaS and other related themes or buzzword bingo topics.

Let us dig a little deeper and look at some So What types of questions and industry trends perspectives comments around what IBM has announced.

So what did IBM announce?
IBM announced PureSystems including:

PureFlex systems, products and technologies
PureApplication systems
PureSystems Centre

You can think of IBM PureSystems and Flex Systems Products and technology as a:

Private cloud or turnkey solution bundle solution
Platform deploying public or hybrid clouds
Data center in a box or converged and dynamic system
ITaaS or SaaS/AaaS or PaaS or IaaS or Cloud in a box
Rackem stack and package them type solution

So what is an IBM PureFlex System and what is IBM using?
It is a factory integrated data and compute infrastructure in a cabinet combing cloud, virtualization, servers, data and storage networking capabilities. The IBM PureFlex system is comprised of various IBM and products and technologies (hardware, software and services) optimized with management across physical and virtual resources (servers, storage (V7000), networking, operating systems, hypervisors and tools).

PureFlex includes automation and optimization technologies along with what IBM is referring to as patterns of expertise or what you might relate to as templates. Support for various hypervisors and management integration along with application and operating system support by leveraging IBM xSeries (x86 such as Intel) and pSeries (Power7) based processors for compute. Storage is the IBM V7000 (here and here) with networking and connectivity via IBM and their partners. The solution is capable of supporting traditional, virtual and cloud deployment models as well as platform for deploying Infrastructure as a Service (IaaS) on a public, managed service provider (MSP), hosting or private basis.

Click here to view the next post in this series, ok nuff said for now.

Here are some links to learn more:
Various IBM Redbooks and related content
The blame game: Does cloud storage result in data loss?
What do you need when its time to buy a new server?
2012 industry trends perspectives and commentary (predictions)
Convergence: People, Processes, Policies and Products
Buzzword Bingo and Acronym Update V2.011
The function of XaaS(X) Pick a letter
Hard product vs. soft product
Buzzword Bingo and Acronym Update V2.011
Part I: PureSystems, something old, something new, something from big blue
Part II: PureSystems, something old, something new, something from big blue
Part III: PureSystems, something old, something new, something from big blue
Part IV: PureSystems, something old, something new, something from big blue
Part V: PureSystems, something old, something new, something from big blue
Cloud and Virtual Data Storage Networking

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Part II: PureSystems, something old, something new, something from big blue

Thu, 12 Apr 2012 21:01:10 CST

Part II: PureSystems, something old, something new, something from big blue

By Greg Schulz

This is the second in a five-part series around the recent IBM PureSystems announcements. You can view the earlier post here, and the next post here.

So what are the speeds and feeds of a PureFlex system?
The components that make up the PureFlex line include:

IBM management node (server with management software tools).
10Gb Ethernet (LAN) switch, adapters and associated cabling.
IBM V7000 virtual storage (also see here and here).
Dual 8GFC (8Gb Fibre Channel) SAN switches and adapters.
Servers with either x86 xSeries using for example Intel Sandy Bridge EP 2.6 GHz 8 core processors, or IBMs Power7 based pSeries for AIX. Note that IBM with their blade center systems (now rebadged as part of being PureSystems) support various IO and networking interfaces include SAS, Ethernet, Fibre Channel (FC), Fibre Channel over Ethernet (FCoE), and InfiniBand using adapters and switches from various partners.
Virtual machine (VM) hypervisors such as Microsoft Hyper V and VMware vSphere/ESX among others. In addition to x86 based hypervisors or kernel virtual machines (KVM), IBM also supports its own virtual technology found in Power7 based systems. Check IBM support matrix for specific configurations and current offerings.
Optional middleware such as IBM WebSphere.

Read more speeds and feeds at the various IBM sites including on Tony Pearson's blog site.

So what is IBM PureApplication System?
This builds off and on PureFlex systems as a foundation for deploying various software stacks to deliver traditional IT applications or cloud Platform as a Service (PaaS) or Software as a Service (SaaS) and Application as a Service (AaaS) models. For example cloud or web stacks, java, database, analytics or other applications with buzzwords of elastic, scalable, repeatable, self-service, rapid provisioning, resilient, multi tenant and secure among others. Note that if are playing or into Buzzword bingo, go ahead and say Bingo when you are ready as IBM has a winner in this category.

So what is the difference between PureFlex and PureApplication systems?
PureApplication systems leverage PureFlex technologies adding extra tools and functionality for cloud like application functionality delivery.

So what is IBM PureSystems Centre?
It is a portal or central place where IBM and their business partner solutions pertaining to PureApplication and PureFlex systems can be accessed for including information for first installation support along with maintenance and upgrades. At launch, IBM is touting more than 150 solutions or applications that are available or qualified for deployment on PureApplication and PureFlex systems. In addition, IBM Patterns (aka templates) can also be accessed via this venue. Examples of application or independent software vendor (ISV) developed solutions for banking, education, financial, government, healthcare and insurance can be found at the PureSystems Centre portal (here, here and here).

So what part of this is a service and what is a product?
Other than the PureSystem center, which is a web portal for accessing information and technologies, PureFlex and PureApplication along with Virtual Appliance Factory are products or solutions that can be bought from IBM or their business partners. In addition, IBM business partners or third parties can also use these solutions housed in their own, a customer, or third-party facility for delivering managed service provided (MSP) capabilities, along with other PaaS and SaaS or AaaS type functionalities. In other words, these solutions can be bought or leased by IT and other organizations for their own use in a traditional IT deployment model, private, hybrid or public cloud model.

Another option is for service providers to acquire these solutions for use in developing and delivering their own public and private or hybrid services. IBM is providing the hard product (hardware and software) that enables your return on innovation (the new ROI) to create and deliver your own soft product (services and experiences) consumed by those who use those capabilities. In addition to traditional financial quantitative return on investment (traditional ROI) and total cost of ownership (TCO), the new ROI complements those by adding a qualitative aspect. Your return on innovation will be dependent on what you are capable of doing that enables your customers or clients to be productive or creative. For example enabling your customers or clients to boost productivity, remove complexity and cost while maintaining or enhancing Quality of Service (QoS), service level objectives (SLOs) and service level agreements (SLAs) in addition to supporting growth by using a given set of hard products. Thus, your soft product is a function of your return on innovation and vise versa.

Note that in this context, not to be confused with hardware and software, hard product are those technologies including hardware, software and services that are obtained and deployed as a soft product. A soft product in this context does not refer to software, rather the combination of hard products plus your own developed or separately obtained software and tools along with best practices and usage models. Thus, two organizations can use the same hard products and deliver separate soft products with different attributes and characteristics including cost, flexibility and customer experience.

So what is a Pattern of Expertise?
Combines operational know how experience and knowledge about common infrastructure resource management (IRM), data center infrastructure management (DCIM) and other commonly repeatable related process, practices and workflows including provisioning. Common patterns of activity and expertise for routine or other time-consuming tasks, which some might refer to as templates or workflows enable policy driven based automation. For example, IBM cites recurring time-consuming tasks that lend themselves to being automated such as provisioning, configuration, and upgrades and associated IRM, DCIM and data protection, storage and application management activities. Automation software tools are included as part of the PureSystems with patterns being downloadable as packages for common tasks and applications found at the IBM PureSystem center.

At announcement, there are three types or categories of patterns:

IBM patterns: Factory created and supplied with the systems based on experiences IBM has derived from various managers, engineers and technologist for automating common tasks including configuration, deployment and application upgrades and maintenance. The aim is to cut the amount of time and intervention for deployment of applications and other common functions enabling IT staff to be more productive and address other needs.
ISV patterns: These leverage experience and knowledge from ISVs partnered with IBM, which at time of launch numbers over 125 vendors offering certified PureSystems Ready applications. The benefit and objective are to cut the time and complexity associated with procuring (e.g. purchasing), deploying and managing third-party ISV software. Downloadable patterns packages can be found at the IBM PureSystem center.
Customer patterns: Enables customers to collect and package their own knowledge, processes, rules, policies and best practices into patterns for automation. In addition to collecting knowledge for acquisition, configuration, day to day management and troubleshooting, these patterns can facility automation of tasks to ease on boarding of new staff employees or contractors. In addition, these patterns or templates capture workflows for automation enabling shorter deployment times of systems and applications into locations where skill sets do not exist.

Here is a link to some additional information about patterns on the IBM developerWorks site.

Click here to view the next post in this series, ok, nuff said for now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Part III: PureSystems, something old, something new, something from big blue

Thu, 12 Apr 2012 21:01:10 CST

Part III: PureSystems, something old, something new, something from big blue

By Greg Schulz

This is the third in a five-part series around the recent IBM PureSystems announcements. You can view the earlier post here, and the next post here.

So what about the IBM Virtual Appliance Factory?
Where PureFlex and PureApplication (PureSystems) are the platforms or vehicles for enabling your journey to efficient and effective information services delivery, and PureSystem centre (or center for those of you in the US) is the portal or information center, the IBM Virtual Appliance Factory (VAF) is a collection of tools, technologies, processes and methodologies. The VAF helps developers or ISVs to prepackage applications or solutions for deployment into Kernel Virtual Machine (KVM) on Intel and IBM PowerVM virtualized environments that are also supported by PureFlex and PureApplication systems.

VAF technologies include Distributed Management Task Force (DMTF) Open Virtual Alliance (OVA) Open Virtualization Format (OVF) along with other tools for combing operating systems (OS), middleware and solution software into a delivery package or a virtual appliance that can be deployed into cloud and virtualized environments. Benefits include reducing complexity of working logical partions (LPAR) and VM configuration, abstraction and portability for deployment or movement from private to public environments. Net result should be less complexity lowering costs while reducing mean time to install and deploy. Here is a link to learn more about VAF and its capabilities and how to get started.

So what does cloud ready mean?
IBM is touting cloud ready capability in the context of rapid out of the box, ease of deployment and use as well as easy to acquire. This is in line with what others are doing with converged server, storage, networking, hardware, software and hypervisor solutions. IBM is also touting that they are using the same public available products as what they use in their own public services SmartCloud offerings.

So what is scale in vs. scale up, scale out or scale within?
Traditional thinking is that scaling refers to increasing capacity. Scaling also means increasing performance, availability, functionality with stability. Scaling with stability means that as performance, availability, capacity or other features are increased problems are not introduced or complexity is not increased. For example, scaling with stability for performance should not result in loss of availability or capacity, capacity increase should not be at the cost of performance or availability, should not cost performance or capacity and management tools should work for you, instead of you working for them.

Scaling up and scaling out have been used to describe scaling performance, availability, capacity and other attributes beyond the limits of a single system, box or cabinet. For example clustered, cloud, grid and other approaches refer to scaling out or horizontally across different physical resources. Scaling up or scaling vertically means scaling within in a system using faster, denser technologies doing more in the same footprint. HDS announced a while back what they refer to 3D scaling which embraces the above notions of scaling up, out and within across different dimensions. IBM is building on that by emphasizing scaling leveraging faster, denser components such as Power7 and Intel processors to scale within the box or system or node, which can also be scaled out using enhanced networking from IBM and their partners.

So what about backup/restore, BC, DR and general data protection?
I would expect IBM to step up and talk about how they can leverage their data protection and associated management toolsets, technologies and products. IBM has the components (hardware, software) already for backup/restore, BC, DR, data protection and security along with associated service offerings. One would expect IBM to not only come out with a data protection optimized solution or version, as well as ones for archiving or data preservation, compliance appliance variants as well as related themes. We know that IBM has the pieces, people, process and practices, let us see if IBM has learned from their competitors who may have missed data protection messaging opportunities. Sometimes what is assumed to be understood does not get discussed, however often what is assumed and is not understood should be discussed, hence, let us see if IBM does more than say oh yes, we have those capabilities and products too.

So what do these have compared to others who are doing similar things?
Different vendors have taken various approaches for bringing converged products or solutions to the market place. Not surprising, storage centric vendors EMC and NetApp have partnered with Cisco for servers (compute). Where Cisco was known for networking having more recently moved into compute servers, EMC and NetApp are known for storage and moving into converged space with servers. Since EMC and NetApp often compete with storage solutions offerings from traditional server vendors Dell, HP, IBM and Oracle among others, and now Cisco is also competing with those same server vendors it has previously partnered with for networking thus it makes sense for Cisco, EMC and NetApp to partner.

While EMC owns a large share of VMware, they do also support Microsoft and other partners including Citrix. NetApp followed EMC into the converged space partnering with Cisco for compute and networking adding their own storage along with supporting hypervisors from Citrix, Microsoft and VMware along with third-party ISVs including Microsoft and SAP among others. Dell has evolved from reference architectures to products called vStart that leverage their own technologies along with those of partners.

A challenge for Dell however is that vStart sounds more like a service offering as opposed to a product that they or their VARs and business partners can sell and add value around. HP is also in the converged game as is Oracle among others. With PureSystems IBM is building on what their competitors and in some cases partners are doing by adding and messaging more around the many ISVs and applications that are part of the PureSystems initiative. Rest assured, there is more to PureSystems than simply some new marketing, press releases, videos and talking about partners and ISVs. The following table provides a basic high level comparison of what different vendors are doing or working towards and is not intended to be a comprehensive review.

Who	What	Server	Storage	Network	Software	Other comments
Cisco	UCS	Cisco	Partner	Cisco	Cisco and Partners	Various hypervisors and OS
Dell	vStart	Dell	Dell	Dell and Partners	Dell and partners	Various hypervisors, OS and bundles
EMC VCE	Vblock VSPEX	Cisco	EMC	Cisco and partners	EMC, Cisco and partners	Various hypervisors, OS and bundles, VSPEX adds more partner solution bundles
HP	Converged	HP	HP	HP and partners	HP and partners	Various hypervisors, OS and bundles
IBM	PureFlex	IBM	IBM	IBM and partners	IBM and partners	Various hypervisors, OS and bundles adding more ISV partners
NetApp	FlexPod	Cisco	NetApp	Cisco and partners	NetApp, Cisco and partners	Various hypervisors, OS and bundles for SAP, Microsoft among others
Oracle	ExaLogic (Exadata database)	Oracle	Oracle	Partners	Oracle and partners	Various Oracle software tools and technologies

So what took IBM so long compared to others?
Good question, what is the saying? Rome was not built-in a day!

Click here to view the next post in this series, ok, nuff said for now.

Cheers
Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Part IV: PureSystems, something old, something new, something from big blue

Thu, 12 Apr 2012 21:01:10 CST

Part IV: PureSystems, something old, something new, something from big blue

By Greg Schulz

This is the fourth in a five-part series around the recent IBM PureSystems announcements. You can view the earlier post here, and the next post here.

So what does this mean for IBM Business Partners (BPs) and ISVs?
What could very well differentiate IBM PureSystems from those of other competitors is to take what their partner NetApp has done with FlexPods combing third-party applications from Microsoft and SAP among others and take it to the next level. Similar to what helped make EMC Centera a success (or at least sell a lot of them) was inclusion and leveraging third-party ISVs and BPs to add value. Compared to other vendors with object based or content accessible storage (CAS) or online archive platforms that focused on the technology feature, function speeds and feeds, EMC realized the key was getting ISVs to support so that BPs and their own direct sales force could sell the solution.

With PureSystems, IBM is revisiting what they have done in the past which if offer bundled solutions providing incentives for ISVs to support and BPs to sell the IBM brand solution. EMC took an early step with including VMware with their Vblock combing server, storage, networking and software with NetApp taking the next step adding SAP, Microsoft and other applications. Dell, HP, Oracle and others are following suit so it only makes sense that IBM returns to its roots leveraging its DNA to reach out and get their ISVs who are now, have been in the past, or are new opportunities to be on board.

IBM is throwing its resources including their innovation centers for training around the world where business partners can get the knowledge and technical support they need. In other words, workshops or seminars on how to sell deploy and setting up of these systems, application and customer testing or proof of concepts and things one would expect out of IBM for such an initiative. In addition to technology and sales training along with marketing support, IBM is making their financing capabilities available to help customers as well as offer incentives to their business partners to simplify acquisitions.

So what buzzword bingo topics and themes did IBM address with this announcement:
IBM did a fantastic job in terms of knocking the ball out of the park with this announcement pertaining buzzword bingo and deserves an atta boy or atta girl!

So what about how this will affect sales of Bladecenters or other systems?
If all IBM and their BPs do are, encroach on existing systems sales to circle the wagons and protect the installed base, which would be one thing. However if IBM and their BPs can use the new packaging and model approach to reestablish customers and partnerships, or open and expand into new adjacent markets, then the net differences should be more Bladecenters (excuse me, PureFlex) being sold.

So what will this cost?
IBM is citing entry PureSystems Express models starting at around $100,000 USD for base systems with others starting at around $200,000 and $300,000 expandable into larger configurations and budgets. Note that like airlines that advertise a low airfare and then you get to pay extra for peanuts, drinks, extra bag space, changes to reservations and so forth, look at these and related systems not just for the first starting price, also for expansion costs over different time periods. Contact IBM, your BP or ISV to find out what one of these systems will do for and cost you.

So what about VARs and IBM business partners (BPs)?
This could be a boon for those BPs and ISVs that had previously sold their software solutions bundled with IBM hardware platforms who were being challenged by other converged solution stacks or were being forced to unbundled. This will also allow those business partners to compete on par with other converged solutions or continue selling the pieces of what they are familiar with however under a new umbrellas. Of course, pricing will be a focus and concern for some who will want to see what added value exists vs. acquiring the various components. This also means that IBM will have to make incentives available for their partners to make a living while also allowing their customers to afford solutions and maximize their return on innovation (the new ROI) and enablement.

Click here to view the next post in this series, ok nuff said for now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Part V: PureSystems, something old, something new, something from big blue

Thu, 12 Apr 2012 21:01:10 CST

Part V: PureSystems, something old, something new, something from big blue

By Greg Schulz

This is the fifth in a five-part series around the recent IBM PureSystems announcements. You can view the earlier post here.

So what about vendor or technology lock in?
So who is responsible for vendor or technology lock in? When I was working in IT organizations, (e.g. what vendors call the customer) the thinking was vendors are responsible for lock in. Later when I worked for different vendors (manufactures and VARs) the thinking was lock in is what was caused by the competition. More recently I'm of the mind set that vendor lock in is a shared responsibility issue and topic. I'm sure some marketing wiz or sales type will be happy to explain the subtle differences of how their solution does not cause lock in.

Vendor lock in can be a shared responsibility. Generally speaking, lock in, stickiness and account control are essentially the same, or at least strive to get similar results. For example, vendor lock in too some has a negative stigma. However vendor stickiness may be a new term, perhaps even sounding cool thus it is not a concern. Remember the Mary Poppins song a spoon full of sugar makes the medicine go down? In other words, sometimes changing and using a different term such as sticky vs. vendor lock in helps make the situation taste better.

So what should you do?
Take a closer look if you are considering converged infrastructures, cloud or data centers in a box, turnkey application or information services deployment platforms. Likewise, if you are looking at specific technologies such as those from Cisco UCS, Dell vStart, EMC Vblock (or via VCE), HP, NetApp FlexPod or Oracle (ExaLogic, ExaData, etc) among others, also check out the IBM PureSystems (Flex and PureApplication). Compare and contrast these converged solutions with your traditional procurement and deployment modes including cost of acquiring hardware, software, ongoing maintenance or service fees along with value or benefit of bundled tools. There may be a higher cost for converged systems in some scenarios, however compare on the value and benefit derived vs. doing the integration yourself.

Compare and contrast how converged solutions enable, however also consider what constraints exists in terms of flexibility to reconfigure in the future or make other changes. For example as part of integration, does a solution take a lowest common denominator approach to software and firmware revisions for compatibility that may lag behind what you can apply to standalone components. Also, compare and contrast various reference architectures with different solution bundles or packages.

Most importantly compare and evaluate the solutions on their ability to meet and exceed your base requirements while adding value and enabling return on innovation while also being cost-effective. Do not be scared of these bundled solutions; however do your homework to make informed decisions including overcoming any concerns of lock in or future costs and fees. While these types of solutions are cool or interesting from a technology perspective and can streamline acquisition and deployment, make sure that there is a business benefit that can be addressed as well as enablement of new capabilities.

So what does this all mean?
Congratulations to IBM with their PureSystems for leveraging their DNA and roots bundling what had been unbundled before cloud and stacks were popular and trendy. IBM has done a good job of talking vision and strategy along lines of converged and dynamic, elastic and smart, clouds and other themes for past couple of years while selling the pieces as parts of solutions or ala carte or packaged by their ISVs and business partners.

What will be interesting to see is if bladecenter customers shift to buying PureFlex, which should be an immediate boost to give proof points of adoption, while essentially up selling what was previously available. However, more interesting will be to see if net overall new customers and footprints are sold as opposed to simply selling a newer and enhanced version of previous components.

In other words will IBM be able to keep up their focus and execution where they have sold the previous available components, while also holding onto current ISV and BP footprint sales and perhaps enabling those partners to recapture some hardware and solution sales that had been unbundled (e.g. ISV software sold separate of IBM platforms) and move into new adjacent markets.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Going dutch and other Spring 2012 StorageIO activities

Wed, 28 Mar 2012 22:44:33 CST

Going dutch and other Spring 2012 StorageIO activities

By Greg Schulz

Spring 2012 StorageIO traveling out and about events are underway with activities already having occurred in New York City along with several online live and recorded web casts that you can find here and here. Other upcoming events and traveling to various venues include Dallas (SNW), San Francisco, Washington DC, Nijkerk Netherlands and Las Vegas among others you can see here. Themes and topics of these and other events include data center convergence, infrastructure optimization, data protection modernization, data protection for virtual and cloud environments, performance and capacity planning, metrics that matter and strategy among others.

For those of you in the Netherlands, or elsewhere in Europe, Im going to be doing a two day seminar for storage professionals along with for those involved in strategy, architecture and related data infrastructure topics on May 7 and 8. On May 9, I will be doing a deep dive companion seminar. You can learn more about these seminars being organized by Brouwer Consultancy in Nijkerk Netherlands by visiting their site here which includes agenda and related information.

Watch for more events, seminars, webinars and virtual trade shows by visiting the StorageIO events page.

Drop me a note if you would like to schedule or arrange for a seminar or event near you.

Ok, nuff said for now, see you out and about

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

If March 31st is backup day, dont be fooled with restore on April 1st

Wed, 28 Mar 2012 21:12:21 CST

If March 31st is backup day, dont be fooled with restore on April 1st

By Greg Schulz

With March 31st as world backup day, hopefully some will keep recovery and restoration in mind to not be fooled on April 1st.

When it comes to protecting data, it may not be a headline news disaster such as earthquake, fire, flood, hurricane or act of man, rather something as simply accidentally overwriting a file, not to mention virus or other more likely to occur problems. Depending upon who you ask, some will say backup or saving data is more important while others will standby that it is recovery or restoration that matter. Without one the other is not practical, they need each other and both need to be done as well as tested to make sure they work.

Just the other day I needed to restore a file that I accidentally overwrote and as luck would have it, my local bad copy had also just overwrote my local backup. However I was able to go and pull an earlier version from my cloud provider which gave a good opportunity to test and try some different things. In the course of testing, I did find some things that have since been updated as well as found some things to optimize for the future.

My opinion is that if not used properly including ignoring best practices, any form of data storage medium or media as well as software could result or be blamed for data loss. For some people they have lost data as a result of using cloud storage services just as other people have lost data or access to information on other storage mediums and solutions. For example, data has been lost on cloud, tape, Hard Disk Drives (HDDs), Solid State Devices (SSD), Hybrid HDDs (HHDD), RAID and non RAID, local and remote and even optical based storage systems large and small. In some cases, there have been errors or problems with the medium or media, in other cases storage systems have lost access to, or lost data due to hardware, firmware, software, or configuration including due to human error among other issues.

Now is the time to start thinking about modernizing data protection, and that means more than simply swapping out media. Data protection modernization the past several years has been focused on treating the symptoms of downstream problems at the target or destination. This has involved swapping out or moving media around, applying data footprint reduction (DFR) techniques downstream to give near term tactical relief as has been the cause with backup, restore, BC and DR for many years. The focus is starting to expand to how to discuss the source of the problem with is an expanding data footprint upstream or at the source using different data footprint reduction tools and techniques. This also means using different metrics including keeping performance and response time in perspective as part of reduction rates vs. ratios while leveraging different techniques and tools from the data footprint reduction tool box. In other words, its time to stop swapping out media like changing tires that keep going flat on a car, find and fix the problem, change the way data is protected (and when) to cut the impact down stream.

Here is a link to a free download of chapter 5 (Data Protection: Backup/Restore and Business Continuance / Disaster Recovery) from my new book Cloud and Virtual Data Storage Networking (CRC Press).

Additional related links to read more and sources of information:

Choosing the Right Local/Cloud Hybrid Backup for SMBs
E2E Awareness and insight for IT environments
Poll: What Do You Think of IT Clouds?
Convergence: People, Processes, Policies and Products
What do VARs and Clouds as well as MSPs have in common?
Industry adoption vs. industry deployment, is there a difference?
Cloud conversations: Loss of data access vs. data loss
Clouds and Data Loss: Time for CDP (Commonsense Data Protection)?
Clouds are like Electricity: Dont be scared
Wit and wisdom for BC and DR
Criteria for choosing the right business continuity or disaster recovery consultant
Local and Cloud Hybrid Backup for SMBs
Is cloud disaster recovery appropriate for SMBs?
Laptop data protection: A major headache with many cures
Disaster recovery in the cloud explained
Backup in the cloud: Large enterprises wary, others climbing on board
Cloud and Virtual Data Storage Networking (CRC Press, 2011)
Enterprise Systems Backup and Recovery: A Corporate Insurance Policy

Take a few minutes out of your busy schedule and check to see if your backups and data protection are working, as well as make sure to test restoration and recovery to avoid an April fools type surprise. One last thing, you might want to check out the data storage prayer while you are at it.

Ok, nuff said for now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Is 14.4TBytes of data storage for $52,503 a good deal? It depends!

Wed, 21 Mar 2012 11:20:30 CST

Is 14.4TBytes of data storage for $52,503 a good deal? It depends!

By Greg Schulz

A news story about the school board in Marshall Missouri approving data storage plans in addition to getting good news on health insurance rates just came into my in box.

I do not live in or anywhere near Marshall Missouri as I live about 420 miles north in the Stillwater Minnesota area.

What caught my eye about the story is the dollar amount ($52,503) and capacity amount (14.4TByte) for the new Marshall school district data storage solution to replace their old, almost full 4.8TByte system.

That prompted me to wonder, if the school district are getting a really good deal (if so congratulations), paying too much, or if about right.

Not knowing what type of storage system they are getting, it is difficult to know what type of value the Marshall School district is getting with their new solution. For example, what type of performance and availability in addition to capacity? What type of system and features such as snapshots, replication, data footprint reduction aka DFR capabilities (archive, compression, dedupe, thin provisioning), backup, cloud access, redundancy for availability, application agents or integration, virtualization support, tiering. Or if the 14.4TByte is total (raw) or usable storage capacity or if it includes two storage systems for replication. Or what type of drives (SSD, fast SAS HDD or high capacity SAS or SATA HDDs), block (iSCSI, SAS or FC) or NAS (CIFS and NFS) or unified, management software and reporting tools among capabilities not to mention service and warranty.

Sure there are less expensive solutions that might work, however since I do not know what their needs and wants are, saying they paid too much would not be responsible. Likewise, not knowing their needs vs. wants, requirements, growth and application concerns, given that there are solutions that cost a lot more with extensive capabilities, saying that they got the deal of the century would also not be fair. Maybe somewhere down the road we will hear some vendor and VAR make a press release announcement about their win in taking out a competitor from the Marshall school district, or perhaps that they upgraded a system they previously sold so we can all learn more.

With school districts across the country trying to stretch their budgets to go further while supporting growth, it would be interesting to hear more about what type of value the Marshall school district is getting from their new storage solution. Likewise, it would also be interesting to hear what alternatives they looked at that were more expensive, as well as cheaper however with less functionality. Im guessing some of the cloud crowd cheerleaders will also want to know why the school district is going the route they are vs. going to the cloud.

IMHO value is not the same thing as less or lower cost or cheaper, instead its the benefit derived vs. what you pay. This means that something might cost more than something cheaper, however if I get more benefit from what might be more expensive, then it has more value.

If you are a school district of similar size, what criteria or requirements would you want as opposed to need, and then what would you do or have you done?

What if you are a commercial or SMB environment, again not knowing the feature functionality benefit being obtained, what requirements would you have including want to have (e.g. nice to have) vs. must or have to have (e.g. what you are willing to pay more for), what would you do or have done?

How about if you were a cloud or managed service provider (MSP) or a VAR representing one of the many services, what would your pitch and approach be beyond simply competing on a cost per TByte basis?

Or if you are a vendor or VAR facing a similar opportunity, again not knowing the requirements, what would you recommend a school district or SMB environment to do, why and how to cost justify it?

What this all means to me is the importance of looking beyond lowest cost, or cost per capacity (e.g. cost per GByte or TByte) also factoring in value, feature functionality benefit.

Ok, nuff said for now, I need to get my homework assignments done.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Why SSD based arrays and storage appliances can be a good idea (Part I)

Tue, 13 Mar 2012 20:20:20 CST

Why SSD based arrays and storage appliances can be a good idea (Part I)

By Greg Schulz

This is the first of a two part series, you can read part II here.

Robin Harris (aka @storagemojo) recently in a blog post asks a question and thinks solid state devices (SSDs) using SAS or SATA interface in traditional hard disk drive (HDD) form factors are a bad idea in storage arrays (e.g. storage systems or appliances). My opinion is that as with many things about storing, processing or moving binary digital data (e.g. 1s and 0s) the answer is not always clear. That is there may not be a right or wrong answer instead it depends on the situation, use or perhaps abuse scenario. For some applications or vendors, adding SSD packaged in HDD form factors to existing storage systems, arrays and appliances makes perfect sense, likewise for others it does not, thus it depends (more on that in a bit). While we are talking about SSD, Ed Haletky (aka @texiwill) recently asked a related question of Fix the App or Add Hardware, which could easily be morphed into a discussion of Fix the SSD, or Add Hardware. Hmmm, maybe a future post idea exists there.

Lets take a step back for a moment and look at the bigger picture of what prompts the question of what type of SSD to use where and when along as well as why various vendors want you to look at things a particular way. There are many options for using SSD that is packaged in various ways to meet diverse needs including here and here (see figure 1).

Figure 1: Various packaging and deployment options for SSD

The growing number of startup and established vendors with SSD enabled storage solutions vying to win your hearts, minds and budget is looking like the annual NCAA basketball tournament (aka March Madness and march metrics here and here). Some of vendors have or are adding SSD with SAS or SATA interfaces that plug into existing enclosures (drive slots). These SSDs have the same form factor of a 2.5 inch small form factor (SFF) or 3.5 inch HDDs with a SAS or SATA interface for physical and connectivity interoperability. Other vendors have added PCIe based SSD cards to their storage systems or appliances as a cache (read or read and write) or a target device similar to how these cards are installed in servers.

Simply adding SSD either in a drive form factor or as a PCIe card to a storage system or appliance is only part of a solution. Sure, the hardware should be faster than a traditional spinning HDD based solution. However, what differentiates the various approaches and solutions is what is done with the storage systems or appliances software (aka operating system, storage applications, management, firmware or micro code).

So are SSD based storage systems, arrays and appliances a bad idea?

If you are a startup or established vendor able to start from scratch with a clean sheet design not having to worry about interoperability and customer investment protection (technology, people skills, software tools, etc), then you would want to do something different. For example, leverage off the shelf components such as a PCIe flash SSD card in an industry standard server combined with your software for a solution. You could also use extra DRAM memory in those servers combined with PCIe flash SSD cards perhaps even with embedded HDDs for a backing or preservation medium.

Other approaches might use a mix of DRAM, PCIe flash cards, as either a cache or target combined with some drive form factor SSDs. In other words, there is no right or wrong approach; sure, there are different technical merits that have advantages for various applications or environments. Likewise, people have preferences particular for technology focused who tend to like one approach vs. another. Thus, we have many options to leverage, use or abuse.

In his post, Robin asks a good question of if nand flash SSD were being put into a new storage system, why not use the PCIe backplane vs. using nand flash on DIMM vs. using drive formats, all of which are different packaging options (Figure 1). Some startups have gone the all backplane approach, some have gone with the drive form factor, some have gone with a mix and some even using HDDs in the background. Likewise some traditional storage system and array vendors who support a mix of SSD and HDD drive form factor devices also leverage PCIe cards, either as a server based cache (e.g. EMC VFCahe) or installed as a performance accelerator module (e.g. NetApp PAM) in their appliances.

While most vendors who put SSD drive form factor drives into their storage systems or appliances (or serves for that matter) use them as data targets for creating LUNs or file systems, others use them for internal functionality. By internal functionality I mean instead of the SSD appearing as another drive or target, they are used exclusively by the storage system or appliance for caching or similar purposes. On storage systems, this can be to increase the size of persistent cache such as EMC on the CLARiiON and VNX (e.g. FAST Cache). Another use is on backup or dedupe target appliances where SSDs are used to store dictionary, index or meta data repositories as opposed to being a general data pool.

Part two of this post looks at the benefits and caveats of SSD in storage arrays.

Here are some related links to learn more about SSD, where and when to use what:
Why SSD based arrays and storage appliances can be a good idea (Part II)
IT and storage economics 101, supply and demand
Researchers and marketers dont agree on future of nand flash SSD
Speaking of speeding up business with SSD storage
EMC VFCache respinning SSD and intelligent caching (Part I)
EMC VFCache respinning SSD and intelligent caching (Part II)
SSD options for Virtual (and Physical) Environments: Part I Spinning up to speed on SSD
SSD options for Virtual (and Physical) Environments, Part II: The call to duty, SSD endurance
SSD options for Virtual (and Physical) Environments Part III: What type of SSD is best for you?

Ok, nuff said for now, check part II.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Why SSD based arrays and storage appliances can be a good idea (Part II)

Tue, 13 Mar 2012 20:20:20 CST

Why SSD based arrays and storage appliances can be a good idea (Part II)

By Greg Schulz

This is the second of a two part post about why storage arrays and appliances with SSD drives can be a good idea, here is link to the first post.

So again, why would putting drive form factor SSDs be a bad idea for existing storage systems, arrays and appliances?

Benefits of SSD drive in storage systems, arrays and appliances:

Familiarity with customers who buy and use these devices
Reduces time to market enabling customers to innovate via deployment
Establish comfort and confidence with SSD technology for customers
Investment protection of currently installed technology (hardware and software)
Interoperability with existing interfaces, infrastructure, tools and policies
Reliability, availability and serviceability (RAS) depending on vendor implementation
Features and functionality (replicate, snapshot, policy, tiering, application integration)
Known entity in terms of hardware, software, firmware and microcode (good or bad)
Share SSD technology across more servers or accessing applications
Good performance assuming no controller, hardware or software bottlenecks
Wear leveling and other SSD flash management if implemented
Can end performance bottlenecks if backend (drives) are a problem
Coexist or complemented with server based SSD caching

Note, the mere presence of SSD drives in a storage system, array or appliance will not guarantee or enable the above items to be enabled, nor to their full potential. Different vendors and products will implement to various degrees of extensibility SSD drive support, so look beyond the check box of feature, functionality. Dig in and understand how extensive and robust the SSD implementation is to meet your specific requirements.

Caveats of SSD drives in storage systems, arrays and appliances:

May not use full performance potential of nand flash SLC technology
Latency can be an issue for those who need extreme speed or performance
May not be the most innovative newest technology on the block
Fun for startup vendors, marketers and their fans to poke fun at
Not all vendors add value or optimization for endurance of drive SSD
Seen as not being technology advanced vs. legacy or mature systems

Note that different vendors will have various performance characteristics, some good for IOPs, others for bandwidth or throughput while others for latency or capacity. Look at different products to see how they will vary to meet your particular needs.

Cost comparisons are tricky. SSD in HDD form factors certainly cost more than raw flash dies, however PCIe cards and FTL (flash translation layer) controllers also cost more than flash chips by themselves. In other words, apples to apples comparisons are needed. In the future, ideally the baseboard or motherboard vendors will revise the layout to support nand flash (or its replacement) with DRAM DIMM type modules along with associated FTL and BIOS to handle the flash program/erase cycles (P/E) and wear leveling management, something that DRAM does not have to encounter. While that provides great location or locality of reference (figure 1), it is also a more complex approach that takes time and industry cooperation.

Figure 1: Locality of reference for memory and storage

Certainly, for best performance, just like realty location matters and thus locality of reference comes into play. That is put the data as close to the server as possible, however when sharing is needed, then a different approach or a companion technique is required.

Here are some general thoughts about SSD:

Some customers and organizations get the value and role of SSD
Some see where SSD can replace HDD, others see where it compliments
Yet others are seeing the potential, however are moving cautiously
For many environments better than current performance is good enough
Environments with the need for speed need every bit of performance they can get
Storage systems and arrays or appliances continue to evolve including the media they use
Simply looking at how some storage arrays, systems and appliances have evolved, you can get an idea on how they might look in the future which could include not only SAS as a backend or target, also PCIe. After all, it was not that long ago where backend drive connections went from propriety to open parallel SCSI or SSA to Fibre Channel loop (or switched) to SAS.
Engineers and marketers tend to gravitate to newer products nand technology, which is good, as we need continued innovation on that front.
Customers and business people tend to gravitate towards deriving greatest value out of what is there for as long as possible.
Of course, both of the latter two points are not always the case and can be flip flopped.
Ultrahigh end environments and corner case applications will continue to push the limits and are target markets for some of the newer products and vendors.
Likewise, enterprise, mid market and other mainstream environments (outside of their corner case scenarios) will continue to push known technology to its limits as long as they can derive some business benefit value.

While not perfect, SSD in a HDD form factor with a SAS or SATA interface properly integrated by vendors into storage systems (or arrays or appliances) are a good fit for many environments today. Likewise, for some environments, new from the ground up SSD based solutions that leverage flash DIMM or daughter cards or PCIe flash cards are a fit. So to are PCIe flash cards either as a target, or as cache to complement storage system (arrays and appliances). Certainly, drive slots in arrays take up space for SSD, however so to does occupying PCIe space particularly in high density servers that require every available socket and slot for compute and DRAM memory. Thus, there are pros and cons, features and benefits of various approaches and which is best will depend on your needs and perhaps preferences, which may or may not be binary.

I agree that for some applications and solutions, non drive form factor SSD make sense while in others, compatibility has its benefits. Yet in other situations nand flash such as SLC combined with HDD and DRAM tightly integrated such as in my Momentus XT HHDD is good for laptops, however probably not a good fit for enterprise yet. Thus, SSD options and placements are not binary, of course, sometimes opinions and perspectives will be.

For some situations PCIe, based cards in servers or appliances make sense, either as a target or as cache. Likewise for other scenarios drive format SSD make sense in servers and storage systems, appliances, arrays or other solutions. Thus while all of those approaches are used for storing binary digital data, the solutions of what to use when and where often will not be binary, that is unless your approach is to use one tool or technique for everything.

Here are some related links to learn more about SSD, where and when to use what:
Why SSD based arrays and storage appliances can be a good idea (Part I)
IT and storage economics 101, supply and demand
Researchers and marketers dont agree on future of nand flash SSD
Speaking of speeding up business with SSD storage
EMC VFCache respinning SSD and intelligent caching (Part I)
EMC VFCache respinning SSD and intelligent caching (Part II)
SSD options for Virtual (and Physical) Environments: Part I Spinning up to speed on SSD
SSD options for Virtual (and Physical) Environments, Part II: The call to duty, SSD endurance
SSD options for Virtual (and Physical) Environments Part III: What type of SSD is best for you?

Ok, nuff said for now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

StorageIO by Greg Schulz books added to Intel Recommended Reading Lists

Sun, 11 Mar 2012 11:11:11 CST

StorageIO by Greg Schulz books added to Intel Recommended Reading Lists

By Greg Schulz

My two most recent books The Green and Virtual Data Center and Cloud and Virtual Data Storage Networking both published by CRC Press/Taylor and Francis have been added to the Intel Recommended Reading List for Developers.

If you are not familiar with the Intel Recommended Reading List for Developers, it is a leading comprehensive list of different books across various technology domains covering hardware, software, servers, storage, networking, facilities, management, development and more.

So what are you waiting for, check out the Intel Recommended Reading list for Developers where you can find a diverse line up of different books of which Im honored to have two of mine join the esteemed list. Here is a link to a free chapter download from Cloud and Virtual Data Storage Networking.

Ok, nuff said for now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Are social media and networking a waste of time?

Tue, 28 Feb 2012 15:14:13 CST

Are social media and networking a waste of time?

By Greg Schulz

Are social media and networking including twitter, blogs, google+ and linkedin among other venues and mediums a waste of time or only for those who have nothing else to do?

As with most things, the answer is it probably depends.

However IMHO the answer is NO, social media and networking when incorporated as a part of doing business is not a waste unless like anything else you let it become a waste of time.

I have chosen to leverage social media networking along with traditional mediums, venues, news letters, in person events, and other means of communicating, learning and doing business vs. ignoring it.

Does that I mean I jump on or join in every new social networking medium or venue? Nope, however Im always watching to see where to invest time and effort and determine the return or benefit.

Some observations about social media and networking include:

You get out of social media and networking what you put into it: When it comes to LinkedIn, Michael Naylor told me several years ago to get involved with and you will get out of what you put into LinkedIn (or other venues for that matter). Now about eight or nine years later, even despite the spam, I completely agree how true Mikes advise has been and remains.

Engagement, interaction, discussion (or debate) are all part of the discourse in and around social media and networking. Louis Gray who got me hooked on twitter and some other mediums years ago has a great blog post that unless you are engaging or interacting, you are not social networking. What that means is simply using social networking media and mediums as a broadcast or one way communication platform is just that, talking at vs. talking with or too people. Thus get out of your comfort zone, step out from behind your pulpit or podium and engage with audiences or participants vs. talking at them to get out of what you put into it.

Dont be afraid of joining different groups or venues, listen, lurk, observe, learn from others in the same or adjacent areas online, however also keep time in perspective to get other tasks completed. This also means you can build your own castle or venue for people to come to or you can do a hybrid including your own site(s) as well as taking discussions and conversations to where other audiences are.

Let me put this a different way, I like to fish and catch. Sometimes I know where the fish are based on experience and when they might bite, then there are other times when they move. This means knowing when and where to go to different locations to catch a fish or catch a conversation.

Building on the above, dont be afraid to get involved or start a conversation.

Sure on some venues you will get spammed and a bunch of responses that you might not like particular if venturing out away from the safety of your own castle or site. However use those conversations and engagements to learn and interact, see what is on peoples minds or that they are interested in vs. what you want to tell them.

Where wasting time can come into play is trying to be part of every discussion, watching what everybody is doing or saying in all the various venues. For the trick has been to pick which venues are useful for where I want to invest time along with what I will get out of them in addition to using different tools to help find the applicable conversations and discussions. If you are not using things as basic as Google alerts you are probably spending too much time out looking for conversations or discussions, or, you are missing out on them altogether.

I have also noticed that there tends to be a correlation between those who are involved in one way communication and comment diminishing or dismissing social media and networking as a waste of time or not practical, hmm, go figure.

Otoh, I have also noticed those who tend to be involved in one way or non interactive discussions or that limit comments and discourse tend to also have lower numbers of followers, appear on fewer lists or get shared by others, hmm, go figure.

I have also noticed that some who do very well in cyberspace may not do as well in person and vise versa, however there are many who can do both. Likewise there are those who do well in columns that support interactive comments and those who do not.

Perhaps there is a hadoop big data analytics algorithm out there for someone who has lots of time to do some research on all of this?

In the meantime, for those interested, check out Johnny Bentwood (@JonnyBentwood) and some of the things he has done around analytics and social media and metrics if so interested.

What this all means is that to each their own, that is comfort zones. If your comfort zone and sphere of influence is in one way communication via print, online, video or what ever, then play to your strengths. Likewise, if yours is as a commentator or something else, go with it.

Leverage and get involved, dont be scared, find your voice, engage, take part, however also be ready to be challenged while increasing your network of contacts, ability to learn and get out of what ever you put into it. Otherwise, stay in your comfort zone or within your sphere of influence.

As to if social media and networking are a waste of time and only for those who have nothing to do, well, if that is the case, last year was a banner year for me and my business. That is both in terms of activity, contacts, coverage, awards and accolades not to mention increasing discussions and experience in other areas as well as being involved in traditional media and venues or activities. I guess if that is the result of being involved or investing in social media and networking it is an honor to be among those who waste time and have nothing better to do.

Why do I take time out of my busy schedule to share this?

Simple, you get out of things what you put into it, and granted some will simply take advantage as opposed to contributing back, maybe they too will evolve to give back what they take out.

Feel free to engage or simply read and lurk, that option is all yours.

Ok, nuff said for now, have to get some other work projects done now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Some alternative and fun Cloud API meanings

Mon, 20 Feb 2012 17:21:12 CST

Some alternative and fun Cloud API meanings

By Greg Schulz

Hearing different discussions about APIs in general and cloud in particular got me thinking, besides the usual Application Programming Interface meaning, what other options exists including those to have some fun with.

How about some of these among others to have some fun and take a quick break from the otherwise serious side of clouds, virtualization data and storage networking, backup, archive, VDI, data protection and management topics.

Cloud API = A Payment Invoice
Cloud API = A Paid Infrastructure
Cloud API = A Pain Inthea$$
Cloud API = A Pathto Income
Cloud API = A Pathto IOP
Cloud API = A Payment Infrastructure
Cloud API = A Planned Inconvenience
Cloud API = A Processor Interconnect
Cloud API = A Program Incubator
Cloud API = A Propriety Interface
Cloud API = A Protected Income
Cloud API = A Protected Investment
Cloud API = A Public Infrastructure
Cloud API = Aaas Paas Iaas
Cloud API = All Partners Involved
Cloud API = All Programmers Involved
Cloud API = Amazon Plus IBM
Cloud API = Another Product Inititiave
Cloud API = Another Program Interface
Cloud API = Another Programmer Innovating
Cloud API = Architect Planned Infrastructure

Ok, nuff said for now before that cloud crowd cheerleaders API me out of existence.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Researchers and marketers dont agree on future of nand flash SSD

Sun, 19 Feb 2012 17:57:15 CST

Researchers and marketers dont agree on future of nand flash SSD

By Greg Schulz

Marketers particular those involved with anything resembling Solid State Devices (SSD) will tell you SSD is the future as will some researchers along with their fans and pundits. Some will tell you that the future only has room for SSD with the current flavor de jour being nand flash (both Single Level Cell aka SLC and Multi Level Cell aka MLC) with any other form of storage medium (e.g. Hard Disk Drives or HDD and tape) being dead and to avoid wasting your money on them.

Of course others and their fans or supporters who do not have an SSD play or product will tell forget about them, they are not ready yet. Then there are those who take no sides per say, simply providing comments and perspectives along with things to be considered that also get used to spin stories for or against by others.

For the record, I have been a fan and user of various forms of SSD along with other variations of tiered storage mediums using them for where they fit best for several decades as a customer in IT, as a vendor, analyst and advisory consultant. Thus my perspective and opinion is that SSDs do in fact have a very bright future. However I also believe that other storage mediums are not dead yet although their roles are evolving while their technologies continue be developed. In other words, use the right technology and tool, packaged and deployed in the best most effective way for the task at hand.

Memory and tiered storage hierarchy

Consequently while some SSD vendors, their fans, supporters, pundits and others might be put off by some recent UCSD research that does not paint SSD and particular nand flash in the best long term light, it caught my attention and here is why. First I have already seen in different venues where some are using the research as a tool, club or weapon against SSD and in particular nand flash which should be no surprise. Secondly I have also seen those who dont agree with the research at best dismiss the findings. Others are using it as a conversation or topic piece for their columns or other venues such as here.

The reason the UCSD research caught my eye was that it appeared to be looking at how will nand SSD technology evolve from where it is today to where it will be in ten years or so.

While ten years may seem like a long time, just look back at how fast things evolved over the past decade. Granted the UCSD research is open to discussion, debate and dismissal as clear in the comments of this article here. However the research does give a counter point or perspective to some of the hype which can mean somewhere between the two extremes, exists reality and where things are headed or need to be discussed. While I do not agree with all the observations or opinions of the research, it does give stimulus for discussing things including best practices around deployment vs. simply talking about adoption.

It has taken many decades for people to become comfortable or familiar with the pros and cons of HDD or tape for that matter.

Likewise some are familiar with (good or bad) with DRAM based SSD of earlier generations. On the other hand, while many people use various forms of nand flash SSD ranging from what is inside their cell phone or SD cards for cameras to USB thumb drives to SSD on drives, on PCIe cards or in storage systems and appliances, there is still an evolving comfort and confidence level for business and enterprise storage use. Some have embraced, some have dismissed, many if not most are intrigued wanting to know more, are using nand flash SSD in some shape or form, while gaining confidence.

Part of gaining confidence is moving beyond the industry hype looking at and understanding what are the pros, cons and how to leverage or work around the constraints. A long time ago a wise person told me that it is better to know the good, bad and ugly about a product, service or technology so that you could leverage the best, configure, plan and manage around the bad to avoid or minimized the ugly. Based on that philosophy I find many IT customers and even some VARs and vendors wanting to know the good, the bad and they ugly not for hanging out a vendor or their technology and products, rather so that they can be comfortable in knowing when, where, why and how to use to be most effective.

Granted to get some of the not so good information may need NDA (Non Disclosure Agreement) or other confidentially discussions as after all, what vendor or solution provider wants to show or let anything less than favorable out into the blogosphere, twittersphere, googleplus, tabloids, news sphere or other competitive landscapes venues.

Ok, lets bring this back to the UCSD research report titled The Bleak Future of NAND Flash Memory

Click here or on the above image to read the UCSD research report

Im not concerned that the UCSD research was less than favorable as some others might be, after all, it is looking out into the future and if a concern, provides a glimpse of what to keep an eye on.

Likewise, looking back, the research report could be taken as simply a barometer of what could happen if no improvements or new technologies evolve. For example, the HDD would have hit the proverbial brick wall also known as the super parametric barrier many years ago if new recording methods and materials had not been deployed including a shift to perpendicular recording, something that was recently added to tape.

Tomorrows SSDs and storage mediums will still be based on nand flash including SLC, MLC, eMLC along with other variants not to mention phased change memory (PCM) and other possible contenders.

Todays SSDs have shifted from being DRAM based with HDD or even flash based persistent backing storage to nand flash based, both SLC and MLC with enhanced or enterprise MLC appearing. Likewise the density of SSDs continue to increase meaning more data packed into the same die or footprint, more dies stacked in a chip package to boost capacity while decreasing cost. What is also happening is behind the scenes which is a big differentiator with SSDs and that is the quality of some firmware and low level page management at the flash translation layer (FTL). Hence they saying that anybody with a soldering iron and ability to pull together off the shelves FTLs and packaging can create some form of an SSD. How effective a product will be is based on the intelligence and robustness of the combination of the dies, FTL, controller and associated firmware and device drivers along with other packaging options plus the testing, validation and verification they undergo.

Various SSD locations, types, packaging and usage scenario options

Good SSD vendors and solution providers I believe will be able to discuss your concerns around endurance, duty cycles, data integrity and other related topics to set up confidence with current and future issues, granted you may have to go under NDA to gain that insight. On the other hand, those who feel threatened or not able or interested in addressing or demonstrating confidence for the long haul will be more likely to dismiss studies, research, reports, opinions or discussions that dig deeper into creating confidence via understanding of how things work so that customers can more fully leverage those technologies.

Some will view and use reports such as the one from UCSD as a club or weapon against SSD and in particular against nand flash to help their cause or campaign while others will use it to stimulate controversy and page hit views. My reason for bringing up the topic and discussion it to stimulate thinking and help increase awareness and confidence in technologies such as SSD near and long term. Regardless of if your view is that SSD will replace HDD, or that they will continue to coexist as tiered storage mediums into the future, gaining confidence in the technologies along with when, where and how to use them are important steps in shifting from industry adoption to customer deployment.

What say you?

Is SSD the best thing and you are dumb or foolish if you do not embrace it totally or a fan, pundit cheerleader view?

Or is SSD great when and where used in the right place so embrace it?

How will SSD continue to evolve including nand and other types of memories?

Are you comfortable with SSD as a long term data storage medium, or for today, its simply a good way to discuss performance bottlenecks?

On the other hand, is SSD interesting, however you are not comfortable or have confidence with the technology, yet you want to learn more, in other words a skeptics view?

Or perhaps the true cynic view which is that SSD are nothing but the latest buzzword bandwagon fad technology?

Ok, nuff said for now, other than here is some extra related SSD material:
SSD options for Virtual (and Physical) Environments: Part I Spinning up to speed on SSD
SSD options for Virtual (and Physical) Environments, Part II: The call to duty, SSD endurance
Part I: EMC VFCache respinning SSD and intelligent caching
Part II: EMC VFCache respinning SSD and intelligent caching
IT and storage economics 101, supply and demand
2012 industry trends perspectives and commentary (predictions)
Speaking of speeding up business with SSD storage
New Seagate Momentus XT Hybrid drive (SSD and HDD)
Are Hard Disk Drives (HDDs) getting too big?
Industry adoption vs. industry deployment, is there a difference?
Data Center I/O Bottlenecks Performance Issues and Impacts
EMC VPLEX: Virtual Storage Redefined or Respun?
EMC interoperability support matrix

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

EMC VFCache respinning SSD and intelligent caching (Part I)

Mon, 6 Feb 2012 12:13:14 CST

EMC vFCache respinning SSD and intelligent caching (Part I)

By Greg Schulz

This is the first part of a two part series covering EMC VFCache, you can read the second part here.

EMC formerly announced VFCache (aka Project Lightning) an IO accelerator product that comprises a PCIe nand flash card (aka Solid State Device or SSD) and intelligent cache management software. In addition EMC is also talking about the next phase of the flash business unit and project Thunder. The approach EMC is taking with vFCache should not be a surprise given their history of starting out with memory and SSD evolving it into an intelligent cache optimized storage solution.

Data center and storage IO performance capacity gap (Courtesy of Cloud and Virtual Data Storage Networking (CRC Press))

Could we see the future of where EMC will take VFCache along with other possible solutions already being hinted at by the EMC flash business unit by looking where they have been already?

Likewise by looking at the past can we see the future or how VFCache and sibling product solutions could evolve?

After all, EMC is no stranger to caching with both nand flash SSD (e.g. FLASH CACHE, FAST and SSD drives) along with DRAM based across their product portfolio not too mention being a core part of their company founding products that evolved into HDDs and more recent nand flash SSDs among others.

Unlike others who also offer PCIe SSD cards such as FusionIO with a focus on eliminating SANs or other storage (read their marketing), EMC not surprisingly is marching to a different beat. The beat EMC is marching too or perhaps leading by example for others to follow is that of going mainstream and using PCIe SSD cards as a cache to compliment theirs as well as other vendors storage systems vs. replacing them. This is similar to what EMC and other mainstream storage vendors have done in the past such as with SSD drives being used as flash cache extension on CLARiiON or VNX based systems as well as target or storage tier.

Various SSD locations, types, packaging and usage scenario options

Other vendors including IBM, NetApp and Oracle among others have also leveraged various packaging options of Single Level Cell (SLC) or Multi Level Cell (MLC) flash as caches in the past. A different example of SSD being used as a cache is the Seagate Momentus XT which is a desktop, workstation consumer type device. Seagate has shipped over a million of the Momentus XT which use SLC flash as a cache to compliment and enhance the integrated HDD performance (a 750GB with 8GB SLC memory is in the laptop Im using to type this with).

One of the premises of solutions such as those mentioned above for caching is to discuss changing data access patterns and life cycles shown in the figure below.

Evolving data access patterns and life cycles (more retention and reads)

Put a different way, instead of focusing on just big data or corner case (granted some of those are quite large) or ultra large cloud scale out solutions, EMC with VFCache is also addressing their core business which includes little data. What will be interesting to watch and listen too is how some vendors will start to jump up and down saying that they have done or enabling what EMC is announcing for some time. In some cases those vendors will be rightfully doing and making noise on something that they should have made noise about before.

EMC is bringing the SSD message to the mainstream business and storage marketplace showing how it is a compliment to, vs. a replacement of existing storage systems. By doing so, they will show how to spread the cost of SSD out across a larger storage capacity footprint boosting the effectiveness and productive of those systems. This means that customers who install the VFCache product can accelerate the performance of both their existing EMC as well as storage systems from other vendors preserving their technology along with people skills investment.

Key points of VFCache

Combines PCIe SLC nand flash card (300GB) with intelligent caching management software driver for use in virtualized and traditional servers
Making SSD complimentary to existing installed block based disk (and or SSD) storage systems to increase their effectiveness
Providing investment protection while boosting productivity of existing EMC and third party storage in customer sites
Brings caching closer to the application where the data is accessed while leverage larger scale direct attached and SAN block storage
Focusing message for SSD back on to little data as well as big data for mainstream broad customer adoption scenarios
Leveraging benefit and strength of SSD as a read cache and scalable of underlying downstream disk for data storage
Reducing concerns around SSD endurance or duty cycle wear and tear by using as a read cache
Off loads underlying storage systems from some read requests enabling them to do more work for other servers

Ok, nuff said for now, I think I see some storm clouds rolling in...

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

EMC VFCache respinning SSD and intelligent caching (Part II)

Mon, 6 Feb 2012 12:13:14 CST

EMC vFCache respinning SSD and intelligent caching (Part II)

By Greg Schulz

This is the second of a two part series pertaining to EMC VFCache, you can read the first part here.

In this part of the series, lets look at some common questions along with comments and perspectives.

Common questions, answers, comments and perspectives:

Why would EMC not just go into the same market space and mode as FusionIO, a model that many other vendors seam eager to follow? IMHO many vendors are following or chasing FusionIO thus most are selling in the same way perhaps to the same customers. Some of those vendors can very easily if they were not already also make a quick change to their playbook adding some new moves to reach broader audience. Another smart move here is that by taking a companion or complimentary approach is that EMC can continue selling existing storage systems to customers, keep those investments while also supporting competitors products. In addition, for those customers who are slow to adopt the SSD based techniques, this is a relatively easy and low risk way to gain confidence. Granted the disk drive was declared dead several years (and yes also several decades) ago, however it is and will stay alive for many years due to SSD helping to close the IO storage and performance gap.

Data center and storage IO performance capacity gap (Courtesy of Cloud and Virtual Data Storage Networking (CRC Press))

Has this been done before? There have been other vendors who have done LUN caching appliances in the past going back over a decade. Likewise there are PCIe RAID cards that support flash SSD as well as DRAM based caching. Even NetApp has had similar products and functionality with their PAM cards.

Does VFCache work with other PCIe SSD cards such as FusionIO? No, VFCache is a combination of software IO intercept and intelligent cache driver along with a PCIe SSD flash card (which could be supplied as EMC has indicated from different manufactures). Thus VFCache to be VFCache requires the EMC IO intercept and intelligent cache software driver.

Does VFCache work with other vendors storage? Yes, Refer to the EMC support matrix, however the product has been architected and designed to install and coexist into a customers existing environment which means supporting different EMC block storage systems as well as those from other vendors. Keep in mind that a main theme of VFCache is to compliment, coexist, enhance and protect customers investments in storage systems to improve their effectiveness and productivity as opposed to replacing them.

Does VFCache introduce a new point of vendor lockin or stickiness? Some will see or place this as a new form of vendor lockin, others assuming that EMC supports different vendors storage systems downstream as well as offer options for different PCIe flash cards and keeps the solution affordable will assert it is no more lockin that other solutions. In fact by supporting third party storage systems as opposed to replacing them, smart sales people and marketeers will place VFCache as being more open and interoperable than some other PCIe flash card vendors approach. Keep in mind that avoiding vendor lockin is a shared responsibility (read more here).

Does VFCache work with NAS? VFCache does not work with NAS (NFS or CIFS) attached storage.

Does VFCache work with databases? Yes, VFCache is well suited for little data (e.g. database) and traditional OLTP or general business application process that may not be covered or supported by other so called big data focused or optimized solutions. Refer to this EMC document (and this document here) for more information.

Does VFCache only work with little data? While VFCache is well suited for little data (e.g. databases, share point, file and web servers, traditional business systems) it also able to work with other forms of unstructured data.

Does VFCache need VMware? No, While VFCache works with VMware vSphere including a vCenter plug in, however it does not need a hypervisor and is practical in a physical machine (PM) as it is in a virtual machine (VM).

Does VFCache work with Microsoft Windows? Yes, Refer to the EMC support matrix for specific server operating systems and hypervisor version support.

Does VFCache work with other unix platforms? Refer to the EMC support matrix for specific server operating systems and hypervisor version support.

How are reads handled with VFCache? The VFCache software (driver if you prefer) intercepts IO requests to LUNs that are being cached performing a quick lookup to see if there is a valid cache entry in the physical VFCache PCIe card. If there is a cache hit the IO is resolved from the closer or local PCIe card cache making for a lower latency or faster response time IO. In the case of a cache miss, the VFCache driver simply passes the IO request onto the normal SCSI or block (e.g. iSCSI, SAS, FC, FCoE) stack for processing by the downstream storage system (or appliance). Note that when the requested data is retrieved from the storage system, the VFCache driver will based on caching algorithms determinations place a copy of the data in the PCIe read cache. Thus the real power of the VFCache is the software implementing the cache lookup and cache management functions to leverage the PCIe card that complements the underlying block storage systems.

How are writes handled with VFCache? Unless put into a write cache mode which is not the default, VFCache software simply passes the IO operation onto the IO stack for downstream processing by the storage system or appliance attached via a block interface (e.g. iSCSI, SAS, FC, FCoE). Note that as part of the caching algorithms, the VFCache software will make determinations of what to keep in cache based on IO activity requests similar to how cache management results in better cache effectiveness in a storage system. Given EMCs long history of working with intelligent cache algorithms, one would expect some of that DNA exists or will be leveraged further in future versions of the software. Ironically this is where other vendors with long cache effectiveness histories such as IBM, HDS and NetApp among others should also be scratching their collective heads saying wow, we can or should be doing that as well (or better).

Can VFCache be used as a write cache? Yes, while its default mode is to be used as a persistent read cache to compliment server and application buffers in DRAM along with enhance effectiveness of downstream storage system (or appliances) caches, VFCache can also be configured as a persistent write cache.

Does VFCache include FAST automated tiering between different storage systems? The first version is only a caching tool, however think about it a bit, where the software sits, what storage systems it can work with, ability to learn and understand IO paths and patterns and you can get an idea of where EMC could evolve it to, similar to what they have done with recoverpoint among other tools.

Evolving data access patterns and life cycles (more retention and reads)

Does VFCache mean all or nothing approach with EMC? While the complete VFCache solution comes from EMC (e.g. PCIe card and software), the solution will work with other block attached storage as well as existing EMC storage systems for investment protection.

Does VFCache support NAS based storage systems? The first release of VFCache only supports block based access, however the server that VFCache is installed in could certainly be functioning as a general purpose NAS (NFS or CIFS) server (see supported operating systems in EMC interoperability notes) in addition to being a database or other other application server.

Does VFCache require that all LUNs be cached? No, you can select which LUNs are cached and which ones are not.

Does VFCache run in an active / active mode? In the first release it is active passive, refer to EMC release notes for details.

Can VFCache be installed in multiple physical servers accessing the same shared storage system? Yes, however refer to EMC release notes on details about active / active vs. active / passive configuration rules for ensuring data integrity.

Who else is doing things like this? There are caching appliance vendors as well as others such as NetApp and IBM who have used SSD flash caching cards in their storage systems or virtualization appliances. However keep in mind that VFCache is placing the caching function closer to the application that is accessing it there by improving on the locality of reference (e.g. storage and IO effectiveness).

Does VFCache work with SSD drives installed in EMC or other storage systems? Check the EMC product support matrix for specific tested and certified solutions, however in general if the SSD drive is installed in a storage system that is supported as a block LUN (e.g. iSCSI, SAS, FC, FCoE) in theory it should be possible to work with VFCache. Emphasis, visit the EMC support matrix.
What type of flash is being used?

What type of nand flash SSD memory is EMC using in the PCIe card? The first release of VFCache is leveraging enterprise class SLC (Single Level Cell) nand flash which has been used in other EMC products for its endurance, long duty cycle to minnimize or eliminate concerns of wear and tear while meeting read and write performance. EMC has indicated that they will also as part of an industry trend leverage MLC along with Enterprise MLC (EMLC) technologies on a go forward basis.

Doesnt nand ssd flash cache wear out? While nand flash SSD can wear out over time due to extensive write use, the VFCache approach mitigates this by being primarily a read cache reducing the number or program / erase cycles (P/E cycles) that occur with write operations as well as initially leveraging longer duty cycle SLC flash. EMC also has several years experience from implementing wear leveling algorithms into the storage systems controllers to increase duty cycle and reduce wear on SLC flash which will play forward as MLC or Enterprise MLC (EMLC) techniques are leveraged. This differs from vendors who are positioning their SLC or MLC based flash PCIe SSD cards for mainly write operations which will cause more P/E cycles to occur at a faster rate reducing the duty or useful life of the device.

How much capacity does the VFCache PCIe card contain? The first release supports a 300GB card and EMC has indicated that added capacity and configuration options are in their plans.

Does this mean disks are dead? Contrary to popular industry folk lore (or wish) the hard disk drive (HDD) has plenty of life left part of which has been increased by being complimented by VFCache.

Various SSD locations, types, packaging and usage scenario options

Can VFCache work in blade servers? The VFCache software is transparent to blade, rack mount, tower or other types of servers. The hardware part of VFCache is a PCIe card which means that the blade server or system will need to be able to accommodate a PCIe card to compliment the PCIe based mezzaine IO card (e.g. iSCSI, SAS, FC, FCOE) used for accessing storage. What this means is that for blade systems or server vendors such as IBM who have a PCIe expansion module for their H series blade systems (it consumes a slot normally used by a server blade), PCIe cache cards like those being initially released by IBM could work, however check with the EMC interoperability matrix, as well as your specific blade server vendor for PCIe expansion capabilities. Given that EMC leverages Cisco UCS for their vBlocks, one would assume that those systems will also see VFCache modules in those systems. NetApp partners with Cisco using UCS in their FlexPods so you see where that could go as well along with potential other server vendors support including Dell, HP, IBM and Oracle among others.

What about benchmarks? EMC has released some technical documents that show performance improvements in Oracle environments such as this here. Hopefully we will see EMC also release other workloads for different applications including Microsoft Exchange Solutions Proven (ESRP) along with SPC similar to what IBM recently did with their systems among others.

How do the first EMC supplied workload simulations compare vs. other PCIe cards? This is tough to gauge as many SSD solutions and in particular PCIe cards are doing apples to oranges comparisons. For example to generate a high IOPs rating for marketing purposes, most SSD solutions are stress performance tested at 512 bytes or 1/2 of a KByte or at least 1/8 of a small 4Kbyte IO. Note that operating systems such as Windows are moving to 4Kbyte page allocation size to align with growing IO sizes with databases moving from the old average of 4Kbytes to 8Kbytes and larger. What is important to consider is what is the average IO size and activity profile (e.g. reads vs. writes, random vs. sequential) for your applications. If your application is doing ultra small 1/2 Kbyte IOs, or even smaller 64 byte IOs (which should be handled by better application or file system caching in DRAM), then the smaller IO size and record setting examples will apply. However if your applications are more mainstream or larger, then those smaller IO size tests should be taken with a grain of salt. Also keep latency in mind that many target or oppourtunity applications for VFCache are response time sensitive or can benefit by the improved productivity they enable.

What is locality of reference? Locality of reference refers to how close data is to where it is being requested or accessed from. The closer the data to the application requesting the faster the response time or quick the work gets done. For example in the figure below L1/L2/L3 on board processor caches are the fastest, yet smallest while closest to the application running on the server. At the other extreme further down the stack, storage becomes large capacity, lower cost, however lower performing.

What does cache effectiveness vs. cache utilization mean? Cache utilization is an indicator of how much the available cache capacity is being used however it does not give an indicator of if the cache is being well used or not. For example, cache could be 100 percent used, however there could be a low hit rate. Thus cache effectiveness is a gauge of how well the available cache is being used to improve performance in terms of more work being done (IOPS or bandwidth) or lower of latency and response time.

Isnt more cache better? More cache is not better, it is how the cache is being used, this is a message that I would be disappointed in HDS if they were not to bring up as a point of messaging (or rebuttal) given their history of emphasis cache effectiveness vs. size or quantity (Hu, that is a hint btw ;).

What is the performance impact of VFCache on the host server? EMC is saying greatest of 5 percent or less CPU consumption which they claim is several times less than the competitions worst scenario, as well as claiming 512MB to 1GB of DRM on the server vs. several times that of their competitors. The difference could be expected to be via more off load functioning including flash translation layer (FTL), wear leveling and other optimization being handled by the PCIe card vs. being handled in the servers memory and using host server CPU cycles.

How does this compare to what NetApp or IBM does? NetApp, IBM and others have done caching with SSD in their storage systems, or leveraging third party PCIe SSD cards from different vendors to be installed in servers to be used as a storage target. Some vendors such as LSI have done caching on the PCIe cards (e.g. CacheCaid which in theory has a similar software caching concept to VFCache) to improve performance and effectiveness across JBOD and SAS devices.

What about stale (old or invalid) reads, how does VFCache handle or protect against those? Stale reads are handled via the VFCache management software tool or driver which leverages caching algorithms to decide what is valid or invalid data.

How much does VFCache cost? Refer to EMC announcement pricing, however EMC has indicated that they will be competitive with the market (supply and demand).

If a server shutdowns or reboots, what happens to the data in the VFCache? Being that the data is in non volatile SLC nand flash memory, information is not lost when the server reboots or loses power in the case of a shutdown, thus it is persistent. While exact details are not know as of this time, it is expected that the VFCache driver and software do some form of cache coherency and validity check to guard against stale reads or discard any other invalid cache entries.

What will EMC do with VFCache in the future and on a larger scale such as an appliance? EMC via its own internal development and via acquisitions has demonstrated ability to use various clustered techniques such as RapidIO for VMAX nodes, InfiniBand for connecting Isilon nodes. Given an industry trend with several startups using PCIe flash cards installed in a server that then functions as a IO storage system, it seems likely given EMCs history and experience with different storage systems, caching, and interconnects that they could do something interesting. Perhaps Oracle Exadata III (Exadata I was HP, Exadata II was Sun/Oracle) could be an EMC based appliance (That is pure speculation btw)?

EMC has already shown how it can use SSD drives as a cache extension in VNX and CLARiiON servers ( FAST CACHE ) in addition to as a target or storage tier combined with Fast for tiering. Given their history with caching algorithms, it would not be surprising to see other instantiations of the technology deployed in complimentary ways.

Finally, EMC is showing that it can use nand flash SSD in different ways, various packaging forms to apply to diverse applications or customer environments. The companion or complimentary approach EMC is currently taking contrasts with some other vendors who are taking an all or nothing, its all SSD as disk is dead approach. Given the large installed base of disk based systems EMC as well as other vendors have in place, not to mention the investment by those customers, it makes sense to allow those customers the option of when, where and how they can leverage SSD technologies to coexist and complement their environments. Thus with VFCache, EMC is using SSD as a cache enabler to discuss the decades old and growing storage IO to capacity performance gap in a force multiplier model that spreads the cost over more TBytes, PBytes or EBytes while increasing the overall benefit, in other words effectiveness and productivity.

Ok, nuff said for now, I think I see some storm clouds rolling in...

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

IT and storage economics 101, supply and demand

Thu, 2 Feb 2012 13:14:15 CST

IT and storage economics 101, supply and demand

By Greg Schulz

In my 2012 (and 2013) industry trends and perspectives predictions I mentioned that some storage systems vendors who managed their costs could benefit from the current Hard Disk Drive (HDD) shortage. Most in the industry would say that is saying what they have said, however I have an alternate scenario. My scenario is that for vendors who already manage good (or great) margins on their HDD sales and who can manage their costs including inventories stand to make even more margin. There is a popular myth that there is no money or margin in HDD or for those who sell them which might be true for some.

Without going into any details, lets just say it is a popular myth just like saying that there is no money in hardware or that all software and people services are pure profit. Ok, lets leave sleeping dogs lay where rest (at least for now).

Why will some storage vendors make more margin off of HDD when everybody is supposed to be adopting or deploying solid state devices (SSD). Or Hybrid Hard Disk Drives (HHDD) in the case of workstation, desktop or laptops? Simple, SSD adoption (and deployment) is still growing and a lot of demand generator incentives available. Likewise HDD demand continues to be strong and with supplies affected, economics 101 says that some will raise their prices, manage their expenses, make more profits which can be used to help fund or stimulate increased SSD or other initiatives.

Storage, IT and general Economics 101

Economics 101 or basics introduces the concept of supply and demand along with revenue minus costs = profits or margin. If there is no demand yet a supply of a product exists then techniques such as discounting, bundling or other forms of adding value to incentivize customers to make a purchase. Bundling can include offering some other product, service or offering that could be as simple as an extended warranty to motivate sellers. Beyond discounts, coupons, two for one, future buying credits, gift cards or memberships for frequent buyers (or flyers) are other forms of stimulating sales activity.

Likewise if there is a supply or competition for a given market of a product or alternative, vendors or those selling the products including value added resellers (VARS) may sacrifice margin (profits) to meet revenue as well as unit shipped (e.g. expand their customer and installed base footprint) goals.

Currently in the IT industry and specifically around data storage even with increased and growing adoption and demand deployment around SSD, there is also a large supply in different categories. For example there are several fabrication facilities (FABs) that produce the silicon dies (e.g. chips) that form nand flash SSD memories including Intel, Micron, the joint Intel and Micron Fab (IMF) and Samsung. Even with continued strong demand growth, the various FABs seem to have enough capacity at least for now. Likewise manufactures of SSD drive form factor products with SAS or SATA interfaces for attaching to existing servers, storage or appliances including Intel, Micron, Samsung, Seagate, STEC and SANdisk among others seem to be able to meet demand. Even PCIe SSD card vendors have come under pressure of supply and demand. For example the high flying startup FusionIO recently saw its margins affected due to competition which includes Adaptec, LSI, Texas Memory Systems (TMS) and soon EMC among others. In the SSD appliance and storage system space there are even more vendors with what amounts to about one every month or so coming out of stealth. Needless to say there will be some shakeout in the not so distant future.

On the other hand, if there is a demand however limited supply, assuming that the market will support it, prices can be increased from what discounts had applied. Assuming that costs are kept inline any subsequent increase in average selling price (ASP) minus costs should result in higher margins.

Another variation is if there is strong demand and shortage of supply such as what is occurring with hard disk drives (HDD) due to recent flooding in Thailand, not only prices increase, there can also be changes to warranties or other services and incentives. Note some of HDD manufactures such as Western Digital were more affected by the flooding than Seagate. Likewise the Thailand flooding was not limited to just HDD having also affected other electronic chip and component suppliers. Even though HDDs have been declared dead by many in the SSD camps along with their supporters, record number of HDDs are produced every year. Note that economics 101 also tells us that even though more devices are produced and sold, that may not show a profit based on their cost and price. Like the CPU processor chips produced by AMD, Broadcom, IBM and Intel among others that are high volume, with varying margins, the HDD and nand flash SSD market is also high volume with different margins.

As an example, Seagate recently announced strong profits due to a number of factors even though enterprise drive supply and shipments were down while desktop drives were up. Given that many industry pundits have proclaimed a disaster for those involved with HDDs due to the shortage, they forgot about economics 101 (supply and demand). Sure marketing 101 says that HDDs are dead and if there is a shortage then more people will buy SSDs however that also assumes that people are a) ready to buy more SSDs (e.g. demand) and b) vendors or manufactures have supply and c) that those same vendors or manufactures are willing to give up margin while reducing costs to boost profits.

Note that costs typically include selling, general and administrative, cost of goods, manufacturing, transportation and shipping, insurance, research and development among others. If it has been awhile since you looked at one, take a few minutes sometime to look at public companies and their quarterly securities exchange commission (SEC) financial filings. Those public filing documents are a treasure trove of information for those who sift through them and where many reporters, analysts and researchers find information for what they are working or speculating on. These documents show total sales, costs, profits and losses among other things. Something that vendors may not show in these public filings which means you have to look or read between the lines or get the information elsewhere is how many units were actually shipped or the ASP to get an idea of the amount of discounting that is occurring. Likewise sales and marketing expenses often get lumped into or under general selling and administration (SGA). A fun or interesting metric is to look at the percentage of SGA dollars spent per revenue and profits.

What I find interesting is to get an estimate of what it is costing an organization to do or sustain a given level of revenue and margin. For example, while some larger vendors may seem to spend more on selling and marketing, on a percentage basis, they can easily be out spent by smaller startups. Granted the larger vendor may be spending more actually dollars however those are spread out over a larger sales and revenue basis.

What does this all mean?

Look at multiple metrics that have both a future trend or forecast as well as trailing or historical perspective view. Look at both percentages as well as dollar amounts as well as both revenue and margin while keeping units or number of devices (or copies) sold also into perspective. For example its interesting to know if a vendors sales were down 10% (or up) quarter over quarter, or versus the same quarter a year ago or year over year. It is also interesting to keep the margin in perspective along with SGA costs in addition to cost of product acquired for sale. Also important is to get a gauge of if sales were down, yet margins are up, how many devices or copies were sold to get a gauge on expanding footprint which could also be a sign of future annuity (follow up sales opportunities). What Im watching is over the next couple of quarters is to see how some vendors leverage the Thailand flooding and HDD as well as other electronic component supply shortages to meet demand by managing discounts, costs and other items that contribute to enhanced margins.

Rest assured there is a lot more to IT and storage economics, including advanced topics such as Return on Investment (ROI) or Return on Innovation (The new ROI) and Total Cost of Ownership (TCO) among others that maybe we will discuss in the future.

Ok, nuff fun for now, lets get back to work.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

AWS (Amazon) storage gateway, first, second and third impressions

Wed, 25 Jan 2012 13:31:13 CST

AWS (Amazon) storage gateway, first, second and third impressions

By Greg Schulz

Amazon Web Services (AWS) today announced the beta of their new storage gateway functionality that enables access of Amazon S3 (Simple Storage Services) from your different applications using an appliance installed in your data center site. With this beta launch, Amazon joins other startup vendors who are providing standalone gateway appliance products (e.g. Nasuni, Ctera, etc) along with those who have disappeared from the market (e.g. Cirtas). In addition to gateway vendors, there are also those with cloud access added to their software tools such as (e.g. Jungle Disk that access both Rack space and Amazon S3 along with Commvault Simpana Cloud connector among others). There are also vendors that have joined cloud access gateways as part of their storage systems such as TwinStrata among others. Even EMC (and here) has gotten into the game adding qualified cloud access support to some of their products.

What is a cloud storage gateway?

Before going further, lets take a step back and address what for some may be a fundemental quesiton of what is a cloud storage gateway?

Cloud services such as storage are accessed via some type of network, either the public Internet or a private connection. The type of cloud service being accessed (figure 1) will decide what is needed. For example, some services can be accessed using a standard Web browser, while others must plug-in or add-on modules. Some cloud services may need downloading an application, agent, or other tool for accessing the cloud service or resources, while others give an on-site or on-premises appliance or gateway.

Figure 1: Accessing and using clouds (From Cloud and Virtual Data Storage Networking (CRC Press))

Cloud access software and gateways or appliances are used for making cloud storage accessible to local applications. The gateways, as well as enabling cloud access, provide replication, snapshots, and other storage services functionality. Cloud access gateways or server-based software include tools from BAE, Citrix, Gladinet, Mezeo, Nasuni, Openstack, Twinstrata and Zadara among others. In addition to cloud gateway appliances or cloud points of presence (cpops), access to public services is also supported via various software tools. Many data protection tools including backup/restore, archiving, replication, and other applications have added (or are planning to add) support for access to various public services such as Amazon, Goggle, Iron Mountain, Microsoft, Nirvanix, or Rack space among several others.

Some of the tools have added native support for one or more of the cloud services leveraging various applicaiotn programming interfaces (APIs), while other tools or applications rely on third-party access gateway appliances or a combination of native and appliances. Another option for accessing cloud resources is to use tools (Figure 2) supplied by the service provider, which may be their own, from a third-party partner, or open source, as well as using their APIs to customize your own tools.

Figure 2: Cloud access tools (From Cloud and Virtual Data Storage Networking (CRC Press))

For example, I can use my Amazon S3 or Rackspace storage accounts using their web and other provided tools for basic functionality. However, for doing backups and restores, I use the tools provided by the service provider, which then deal with two different cloud storage services. The tool presents an interface for defining what to back up, protect, and restore, as well as enabling shared (public or private) storage devices and network drives. In addition to providing an interface (Figure 2), the tool also speaks specific API and protocols of the different services, including PUT (create or update a container), POST (update header or Meta data), LIST (retrieve information), HEAD (metadata information access), GET (retrieve data from a container), and DELETE (remove container) functions. Note that the real behavior and API functionality will vary by service provider. The importance of mentioning the above example is that when you look at some cloud storage services providers, you will see mention of PUT, POST, LIST, HEAD, GET, and DELETE operations as well as services such as capacity and availability. Some services will include an unlimited number of operations, while others will have fees for doing updates, listing, or retrieving your data in addition to basic storage fees. By being aware of cloud primitive functions such as PUT or POST and GET or LIST, you can have a better idea of what they are used for as well as how they play into evaluating different services, pricing, and services plans.

Depending on the type of cloud service, various protocols or interfaces may be used, including iSCSI, NAS NFS, HTTP or HTTPs, FTP, REST, SOAP, and Bit Torrent, and APIs and PaaS mechanisms including .NET or SQL database commands, in addition to XM, JSON, or other formatted data. VMs can be moved to a cloud service using file transfer tools or upload capabilities of the provider. For example, a VM such as a VMDK or VHD is prepared locally in your environment and then uploaded to a cloud provider for execution. Cloud services may give an access program or utility that allows you to configure when, where, and how data will be protected, similar to other backup or archive tools.

Some traditional backup or archive tools have added direct or via third party support for accessing IaaS cloud storage services such as Amazon, Rack space, and others. Third-party access appliance or gateways enable existing tools to read and write data to a cloud environment by presenting a standard interface such as NAS (NFS and/or CIFS) or iSCSI (Block) that gets mapped to the back-end cloud service format. For example, if you subscribe to Amazon S3, storage is allocated as objects and various tools are used to use or utilize. The cloud access software or appliance understands how to communicate with the IaaS storage APIs and abstracts those from how they are used. Access software tools or gateways, in addition to translating or mapping between cloud APIs, formats your applications including security with encryption, bandwidth optimization, and data footprint reduction such as compression and de-duplication. Other functionality include reporting, management tools that support various interfaces, protocols and standards including SNMP or SNIA, Storage Management Initiative Specification (SMIS), and Cloud Data Management Initiative (CDMI).

First impression: Interesting, good move Amazon, I was ready to install and start testing it today

The good news here is that Amazon is taking steps to make it easier for your existing applications and IT environments to use and leverage clouds for private and hybrid adoption models with both an Amazon branded and managed services, technology and associated tools.

This means leveraging your existing Amazon accounts to simplify procurement, management, ongoing billing as well as leveraging their infrastructure. As a standalone gateway appliance (e.g. it does not have to be bundled as part of a specific backup, archive, replication or other data management tool), the idea is that you can insert the technology into your existing data center between your servers and storage to begin sending a copy of data off to Amazon S3. In addition to sending data to S3, the integrated functionality with other AWS services should make it easier to integrated with Elastic Cloud Compute (EC2) and Elastic Block storage (EBS) capabilities including snapshots for data protection.

Thus my first impression of AWS storage gateway at a high level view is good and interesting resulting in looking a bit deeper resulting in a second impression.

Second impression: Hmm, what does it really do and require, time to slow down and do more home work

Digging deeper and going through the various publicly available material (note can only comment or discuss on what is announced or publicly available) results in a second impression of wanting and needing to dig deeper based on some of caveats. Now granted and in fairness to Amazon, this is of course a beta release and hence while on first impression it can be easy to miss the notice that it is in fact a beta so keep in mind things can and hopefully will change.

Pricing aside, which means as with any cloud or managed storage service, you will want to do a cost analysis model just as you would for procuring physical storage, look into the cost of monthly gateway fee along with its associated physical service running VMware ESXi configuration that you will need to supply. Chances are that if you are an average sized SMB, you have a physical machine (PM) laying around that you can throw a copy of ESXi on to if you dont already have room for some more VMs on an existing one.

You will also need to assess the costs for using the S3 storage including space capacity charges, access and other fees as well as charges for doing snapshots or using other functionality. Again these are not unique to Amazon or their cloud gateway and should be best practices for any service or solution that you are considering. Amazon makes it easy by the way to see their base pricing for different tiers of availability, geographic locations and optional fees.

Speaking of accessing the cloud, and cloud conversations, you will also want to keep in mind what your networking bandwidth service requirements will be to move data to Amazon that might not already be doing so.

Another thing to consider with the AWS storage gateway is that it does not replace your local storage (that is unless you move your applications to Amazon EC2 and EBS), rather makes a copy of what every you save locally to a remote Amazon S3 storage pool. This can be good for high availability (HA), business continuance (BC), disaster recovery (DR) and compliance among other data management needs. However in your cost model you also need to keep in mind that you are not replacing your local storage, you are adding to it via the cloud which should be seen as complimenting and enhancing your private now to be hybrid environment.

Walking the cloud data protection talk

FWIW, I leverage a similar model where I use a service (Jungle Disk) where critical copies of my data get sent to that service which in turn places copies at Rack space (Jungledisks parent) and Amazon S3. What data goes to where depends on different policies that I have established. I also have local backup copies as well as master gold disaster copy stored in a secure offsite location. The idea is that when needed, I can get a good copy restored from my cloud providers quickly regardless of where I am if the local copy is not good. On the other hand, experience has already demonstrated that without sufficient network bandwidth services, if I need to bring back 100s of GBytes or TBytes of data quickly, Im going to be better off bring back onsite my master gold copy, then applying fewer, smaller updates from the cloud service. In other words, the technologies compliment each other.

By the way, a lesson learned here is that once my first copy is made which have data footprint reduction (DFR) techniques applied (e.g. compress, de dupe, optimized, etc), later copies occur very fast. However subsequent restores of those large files or volumes also takes longer to retrieve from the cloud vs. sending up changed versions. Thus be aware of backup vs. restore times, something of which will apply to any cloud provider and can be mitigated by appliances that do local caching. However also keep in mind that if a disaster occurs, will your local appliance be affected and its cache rendered useless.

Getting back to AWS storage gateway and my second impression is that at first it sounded great.

However then I realized it only supports iSCSI and FWIW, nothing wrong with iSCSI, I like it and recommend using it where applicable, even though Im not using it. I would like to have seen a NAS (either NFS and/or CIFS) support for a gateway making it easier for in my scenario different applications, servers and systems to use and leverage the AWS services, something that I can do with my other gateways provided via different software tools. Granted for those environments that already are using iSCSI for your servers that will be using AWS storage gateway, then this is a non issue while for others it is a consideration including cost (time) to factor in to prepare your environment for using the ability.

Depending on the amount of storage you have in your environment, the next item that caught my eye may or may not be an issue that the iSCSI gateway supports up to 1TB volumes and up to 12 of them hence a largest capacity of 12TB under management. This can be gotten around by using multiple gateways however the increased complexity balanced to the benefit the functionality is something to consider.

Third impression: Dig deeper, learn more, address various questions

This leads up to my third impression the need to dig deeper into what AWS storage gateway can and cannot do for various environments. I can see where it can be a fit for some environments while for others at least in its beta version will be a non starter. In the meantime, do your homework, look around at other options which ironically by having Amazon launching a gateway service may reinvigorate the market place of some of the standalone or embedded cloud gateway solution providers.

What is needed for using AWS storage gateway

In addition to having an S3 account, you will need to acquire for a monthly fee the storage gateway appliance which is software installed into a VMware ESXi hypervisor virtual machine (VM). The requirements are VMware ESXi hypervisor (v4.1) on a physical machine (PM) with at least 7.5GB of RAM and four (4) virtual processors assigned to the appliance VM along with 75GB of disk space for the Open Virtual Alliance (OVA) image installation and data. You will also need to have an proper sized network connection to Amazon. You will also need iSCSI initiators on either Windows server 2008, Windows 7 or Red Hat Enterprise Linux.

Note that the AWS storage gateway beta is optimized for block write sizes greater than 4Kbytes and warns that smaller IO sizes can cause overhead resulting in lost storage space. This is a consideration for systems that have not yet changed your file systems and volumes to use the larger allocation sizes.

Some closing thoughts, tips and comments:

Congratulations to Amazon for introducing and launching an AWS branded storage gateway.
Amazon brings trust the value of trust to a cloud relationship.
Initially I was excited about the idea of using a gateway that any of may systems could use my S3 storage pools with vs. using gateway access functions that are part of different tools such as my backup software or via Amazon web tools. Likewise I was excited by the idea of having an easy to install and use gateway that would allow me to grow in a cost effective way.
Keep in mind that this solution or at least in its beta version DOES NOT replace your existing iSCSI based storage needs, instead it compliments what you already have.
I hope Amazon listens carefully to what they customers and prospects want vs. need to evolve the functionality.
This announcement should reinvigorate some of the cloud appliance vendors as well as those who have embedded functionality to Amazon and other providers.
Keep bandwidth services and optimization in mind both for sending data as well as for when retrieving during a disaster or small file restore.
In concept, the AWS storage gateway is not all that different than appliances that do snapshots and other local and remote data protection such as those from Actifio, EMC (Recoverpoint), Falconstor or dedicated gateways such as those from Nasuni among others.
Here is a link to added AWS storage gateways frequently asked questions (FAQs).
If the AWS were available with a NAS interface, I would probably be activating it this afternoon even with some of their other requirements and cost aside.
Im still formulating my fourth impression which is going to take some time, perhaps if I can get Amazon to help sell more of my books so that I can get some money to afford to test the entire solution leveraging my existing S3, EC2 and EBS accounts I might do so in the future, otherwise for now, will continue to research.
Learn more about the AWS storage gateway beta, check out this free Amazon web cast on February 23, 2012.

Learn more abut cloud based data protection, data footprint reduction, cloud gateways, access and management, check out my book Cloud and Virtual Data Storage Networking (CRC Press) which is of course available on Amazon Kindle as well as via hard cover print copy also available at Amazon.com.

Ok, nuff said for now, I need to get back to some other things while thinking about this all some more.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Cloud and travel fun

Wed, 25 Jan 2012 00:26:26 CST

Cloud and travel fun

By Greg Schulz

Warning if you are a cloud purist who does not take lightly to fun in and around all types of clouds, well, try to have some fun, otherwise enjoy this fun in and around clouds post.

On a recent trip to a video recording studio in the Boston (BOS) area, I took a few photos with my iPhone of traveling above, in and around clouds. In addition, during the trip I also used cloud based services from the airplane (e.g. Gogo WiFi) for cloud backup and other functions.

View of a GE CFM56 powering a Delta A320 journey to the clouds

Easy to understand cloud emergency and contingency procedures

Example of cloud marketing and value add services

Clouds are clearing nearing destination Boston aka IATA: BOS

Example of easy to understand converged cloud networking

GE Aviation plant in Lynn MA below GE CFM56 jet engine

Back at Logan, long day of travel, video shoot, time for a nap.

From a different trip, wrapping up a cloud focused day, at Cloud Expo in Santa Clara CA in November.

Here are some additional links about out and about, clouds, travel, technology, trends and fun:
Commentary on Clouds, Storage, Networking, Green IT and other topics
Cloud, virtualization and storage networking conversations
What am I hearing and seeing while out and about

Oh, what was recorded in the video studios on that day?

Why something about IT clouds, virtualization, storage, networking and other related topics of course that will be appearing at some venue in the not so distant future.

Ok, nuff fun for now, lets get back to work.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Can I ask for your support? Please vote for my blog

Tue, 24 Jan 2012 16:16:16 CST

Can I ask for your support? Please vote for my blog

By Greg Schulz

No Im not running for any elected office in a political or other organizational capacity, more on the voting stuff in a moment.

Let me start out by saying thank you to all of you who have and continue to read theses posts from where ever that happens to be from.

I also want to thank all of the sites and venues that pickup my blog feeds to make it easier for readers to view the content as well as thanks for all of the great comments and discussions.

Doing some recent end of year clean up and preparation for 2012, I was going back looking at some blog history and realized that StorageIOblog was launched back in late fall of 2006. For those not aware, my full blog feed is http://storageioblog.com/RSSfull.xml and there is also a brief feed at http://storageioblog.com/RSS.xml and the full archives going back to 2006 can be found at http://storageioblog.com/RSSfullArchive.xml.

Ok, now back to the voting stuff.

It is that time of the year to cast your vote over at Eric Sieberts (aka @ericsiebert) vsphere-land site where my StorageIOblog is among around 180 different IT technology blogs nominated for inclusion and balloting, many of whom are also fellow vExperts. The blogs over at vsphere-land cover diverse topics, technologies, trends and themes including servers, storage, networking, cloud, virtualization, security and related topic themes.

Here is the announcement for the 2012 vsphere-land voting.

Some of the blogs have been around for many years while there is also a category for new less than a year old. In this years voting, anyone can vote however only one ballot per person, there the top ten where you can pick up to ten different blogs and then rank those.

There are categories for virtualization, cloud and storage focused as well as for independent bloggers (e.g. non vendors) as well as for news and media venues. The blogs that are part of the balloting were all via open nomination and if yours or your favorite blog is not on the list, go easy on Eric as he made multiple attempts via different venues to make the process known (hint, make sure Eric knows of your site, however also follow him and his sites for the future).

The voting is up and running until February 7 2012 at this site here.

Check out the voting, balloting and polling process where you can select my StorageIOblog as one of ten overall selections, as well as rank it within those ten, then select StorageIOblog in the storage category as well as in the independent blogger categories if you are so inclined (thanks in advance).

Also, check out Erics great books Maximum vSphere along with VMware VI3 implementation at Amazon.com among other venues.

Ok, nuff said for now, please get out and vote and thank in advance for your interest and support.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Should you feel sorry for revenue prevention departments

Tue, 24 Jan 2012 00:33:44 CST

Should you feel sorry for revenue prevention departments

By Greg Schulz

Does your organization have or do you work with a revenue prevention department or revenue prevention team?

For those not familiar, a revenue prevention team or department is an expression that refers to those who get in the way of selling, closing and generating revenue for an organization.

In a sales dominated organization, the revenue prevention team or department might be refereed to as those who do not do what sales wants when and how they want it. Anything other than what sales wants is seen as getting in the way of revenue. Sometimes sales will see marketing, engineering, manufacturing, quality control, human resources, finance and accounting or legal as revenue prevention departments. In other instances, the revenue prevention team or department of some sales organizations will refer to those in customer or prospects organizations that get in the way or slow down the process of closing the deal. Yet another example can be outsiders or third parties such as consultants, analysts, advisors or others who are brought into the sales process by a customer or prospect and seen by a sales organizations as a barrier to revenue prevention obstacle.

On the other hand, sales can also be seen as a revenue prevention department when as a whole or on a smaller or personal basis they get in the way of actually bringing in the deals. For example a sales based revenue prevention department, team or individual may be spending too much time selling however not enough actually closing or getting the real deal. This can be due to different reasons such as the sales rep trying to sell the wrong solution to a particular customer or prospect needs, or simply not being able to close the deal.

If you have never seen the movie Glengary Glen Ross take a few minutes and check at least the highlights out including the classic lines such as ABC: Always Be Closing or Coffee is for Closers.

Now lets get back to revenue prevention in the context of this post which are some revenue prevention scenarios.

Should you feel sorry for the vendor or var who misses their revenue or sales forecast while they were busy trying to sell something new and forgetting to take the order on the existing items?

Should you feel sorry for the vendor or var whose disk or storage sales are down because their customers and prospects headed their advise from last couple of years to dedupe everything?

Well, if their dedupe sales are not making up for the shortfall, no, you should not feel sorry for them nor their investors.

Should you feel sorry for the vendor or var whose server sales and associated software including hyper visors and tools are down because their customers and prospects headed their advise from last couple of years to virtualize everything?

Well, if the corresponding increase in services, new tools, engagements for data protection and other modernization do not make up for it then no.

Should you feel sorry for the vendor or var whose laptop, desktop and workstation along with corresponding pull of other items has resulted in business going elsewhere while they have sold VDI?

How about should you feel sorry for the vendor or var whose customers or prospects are no longer buying as much hardware, software or services as they headed the advise and went to Goggle, Amazon or some other cloud?

Ok, do you get my point?

In the quest to increase opportunity, boost revenue, expand into adjacent markets and technologies there is a balancing act of generating awareness, moving customer and prospect into new areas while keeping the revenue prevention team on the bench to avoid disrupting annuities or current revenue streams.

In other words, embrace the new, avoid clinging to the old with a death grip, be careful with leading beading edge without a dual redundant blood bank (or at least a backup plan). Put another way, find a balance of taking orders for what your customers want while selling them on where you want them to go.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

My Server and Storage IO holiday break projects

Tue, 24 Jan 2012 00:33:44 CST

My Server and Storage IO holiday break projectsl

By Greg Schulz

Happy new years!

Following up from a flurry of posts in the closing days of 2011 including industry trends perspective predictions for 2012 and 2013, top blog posts from 2011, top all time posts, along with a couple of other items here and here, its time to get back to 2012 activity. Also if you missed it, here is the Fall (December) 2011 StorageIO news letter.

Actually I have been busy working on some other projects the past several weeks most of which are NDA so not much else can be said about them, however there are some other things Im working on that will show themselves in the weeks and months to come. Here is a link to a webinar and live chat that I did the first week of January on CDP (Continuous Data Protection) and how it can be applied to many different environments.

But lets take a step back for a moment and let me share with you some of the things I did or started during the holiday break between christmas and the new years.

Like many others, I found time to relax and get away from normal work activities during the recent holiday season.

However like many of you that may also be techniques or geeks or wanna be geeks at heart, I could not get away from server, storage, IO, networking, data protection, video and other things completely. I used some time to discuss a few projects that I had wanted to do or that I had started before the holidays and here is a synopsis.

Increased storage capacity on a DVR by about 5x In order to get this to work, I modified a 3.5 enclosure with a power supply to accept a 2.5 1.5TB SATA HDD with an eSATA connection, the easy part was then attaching it to the external eSATA port on my DVR. The hard part was then waiting for the DVR to reconfigure and start recording information again. Also as part of upgrading the external storage on the DVR was to get the media share option to do more than basic things leveraging audio and video real time trans coding using the Tversity software along with various codecs on a media server.

Another project involved upgrading a 500GB HHDD to a 750GB HHDD and did some testing Shortly before the holidays I received a new 750GB Seagate Momentus XT II HHDD to compare to my exiting 500GB previous generation model. I have been using the 750GB HHDD for over a month now and it is amazing to see so much space in a laptop that also has good performance. Some follow up activities are to go back and analyze some performance data that I collected before and after the upgrade. This includes both workload simulation of reads, writes, random, sequential of different IO size as well as comparing Windows startup and shutdown speed and impact to build on what I did last summer (see this post). More on these in the not so distance future.

Speaking of clouds, I had a chance to do some more testing with my Amazon EC2 and EBS accounts in addition to cleaning up my S3 pool in addition to my other cloud backup and storage providers accounts. This also involved refining some data protection backup/restore and archive frequency and retention settings. In addition to refinements for cloud based backup, Im also in the process of transitioning from Imation Odyssey Removable Hard Disk Drives (RHDD) to much larger capacity 2.5 portable RHDDs that are used for offsite bulk copies. Part of the migration includes seeing that end of year master or gold backups and archives were made and safely secured elsewhere in addition to having data sent to the cloud.

Another project involved doing some more testing and simulations with my SSD along with more windows boot and shutdown tests mentioned above. More on these results in a future post.

Sometime (actually not very much) was also spent adding some new shares to my Iomega IX4 NAS which is filling up so I also did some more research on what I will upgrade or replace it with. While Iomega has been great (knock on wood), Synology is also looking interesting as a future solution however keeping my options open for now. Right now Im leaning towards keeping the IX4 and adding another NAS filer using the two for different purposes.

Some other server, storage and IO projects also included upgrading some networking components, and to finish decommissioning old drives making them secure for safe disposal when the time comes.

I also was able to spend time on non tech items including outside enjoying the nice weather, cutting up some fallen trees and roasting them on a bonfire among other things.

Ok, nuff said for now, time to get back to work.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

A conversation from SNW 2011 with Jenny Hamel

Fri, 30 Dec 2011 14:41:14 CST

A conversation from SNW 2011 with Jenny Hamel

By Greg Schulz

Here (.qt) and here (.wmv) is a video from an interview that I did with Jenny Hamel (@jennyhamelsd6) during the Fall 2011 SNW event in Orlando Florida.

Topics covered during the discussion include:

Importance of metrics that matter for gaining and maintaining IT situational awareness
The continued journey of IT to improve customer service delivery in a cost effective manner
Reducing cost and complexity without negatively impacting customer service experience
Participating in SNW and SNIA for over ten years on three different continents

Industry trends, buzzword bingo (SSD, cloud, big data, virtualization), adoption vs. deployment
Increasing efficiency along with effectiveness and productivity
Stretching budgets to do more without degrading performance or availability
How customers can navigate their way around various options, products and services
Importance of networking at events such as SNW along with information exchange and learning
Why data footprint reduction is similar to packing smartly when going on a journey
Cloud and Virtual Data Storage Networking (now available on Kindle and other epub formats)

View the video from SNW fall 2011 here (.qt) or here (.wmv).

Check out other videos and pod casts here or at StorageioTV.com

Speaking of industry trends, check out the top 25 new posts from 2011, along with the top 25 all time posts and my comments (predictions) for 2012 and 2013.

Ok, nuff said

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

2012 industry trends perspectives and commentary (predictions)

Thu, 29 Dec 2011 15:51:15 CST

2012 industry trends perspectives and commentary (predictions)

By Greg Schulz

2011 is almost over, so its wrap up time of the year as well as getting ready for 2012.

Here is a link to a post of the top 25 new posts that appeared on StorageIOblog in 2011.

As a companion to the above, here is a link to the all time top 25 posts from StorageIOblog.

Looking back, here is a post about industry trends, thoughts and perspective predictions for 2010 and 2011 (preview 2012 and 2013 thoughts and perspectives here).

Im still finalizing my 2012 and 2013 predictions and perspectives which is a work in progress, however here is a synopsis:

Addressing storage woes at the source: Time to start treating the source of data management and protection including backup challenges instead of or in addition to addressing downstream target destination topics.

Big data and big bandwidth meet big backup: 2011 was a buzz with big data and big bandwidth so 2012 will see realization that big backup needs to be addressed. Also in 2012 there will be continued realization that many have been doing big data and big bandwidth thus also big backups for many years if not decades before the current big buzzword became popular.

Little data does not get left out of the discussion even though younger brother big data gets all of the press and praise. Little data may not be the shining diva it once was, however the revenue annuity stream will keep many software, tools, server and storage vendors afloat while customers continue to rely on the little data darling to run their business.

Cloud confusion finds clarity on the horizon: Granted there will be plenty of more cloud fud and hype, cloud washing and cleaning going around, however 2012 and beyond will also find organizations realizing where and how to use different types of clouds (public, private, hybrid) too meet various needs from SaaS and AaaS to PaaS to IaaS and other variations of XaaS. Part of the clarification that will help remove the confusion will be that there are many different types of cloud architectures, products, stacks, solutions, services and products to address various needs. Another part of the clarification will be discussion of what needs to be added to clouds to make them more viable for both new, as well as old or existing applications. This means organizations will determine what they need to do to move their existing applications to some form of a cloud model while understanding how clouds coexist and compliment what they are currently doing. Cloud conversations will also shift from low cost or for free focus expanding to discussions around value, trust, quality of service (QoS), SLOs, SLAs, security, reliability and related themes.

Cloud and virtualization stack battles: The golden rule of virtualization and clouds is that who ever controls the management and software stacks controls the gold. Hence, watch for more positioning around management and enablement stacks as well as solutions to see who gains control of the gold.

Data protection modernization: Building off of first point above, data protection modernization the past several years has been focused on treating the symptoms of downstream problems at the target or destination. This has involved swapping out or moving media around, applying data footprint reduction (DFR) techniques downstream to provide near term tactical relief as has been the cause with backup, restore, BC and DR for many years. Now the focus will start to expand to how to address the source of the problem with is an expanding data footprint upstream or at the source using different data footprint reduction tools and techniques. This also means using different metrics including keeping performance and response time in perspective as part of reduction rates vs. ratios while leveraging different techniques and tools from the data footprint reduction tool box. In other words, its time to stop swapping out media like changing tires that keep going flat on a car, find and fix the problem, change the way data is protected (and when) to reduce the impact down stream. This will not happen overnight, however with virtualization and cloud activities underway, now is a good time to start modernizing data protection.

End to End (E2E) management tools: Continue focus around E2E tools and capabilities to gain situational awareness across different technology layers.

FCoE and Fibre Channel continue to mature: One sure sign that Fibre Channel over Ethernet (FCoE) is continuing to evolve, mature and gain initial traction is the increase in activity declaring it dead or dumb or similar things. FCoE is still in its infancy while Fibre Channel (FC) is in the process of transitioning to 16Gb with a roadmap that will enable it to continue on for many more years. As FCoE continues to ramp up over next several years (remember, FC took several years to get where it is today), continued FC enhancements will provide options for those wishing to stick with it while gaining confidence with FCoE, iSCSI, SAS and NAS.

Hard drive shortages drive revenues and profits: Some have declared that the recent HDD shortages due to Thailand flooding will cause Solid State Devices (SSD) using flash memory to dramatically grow in adoption and deployment. I think that both single level cell (SLC) and multi level cell (MLC) flash SSDs will continue to grow in deployments counted in units shipped as well as revenues and hopefully also margin or profits. However I also think that with the HDD shortage and continued demand, vendors will use the opportunity to stabilize some of their pricing meaning less discounting while managing the inventory which should mean more margin or profits in a quarter or too. What will be interesting to watch will be if SSD vendors drop margin in an effort to increase units shipped and deployed to show market revenue and adoption growth while HDD margins rise.

QoS, SLA/SLOs part of cloud conversations: Low cost or cost avoidance will continue to be the focus of some cloud conversations. However with metrics and measurements to make informed decisions, discussions will expand to QoS, SLO, SLAs, security, mean time to restore or return information, privacy, trust and value also enter into the picture. In other words, clouds are growing up and maturing for some, while their existing capabilities become discovered by others.

Clouds are a shared responsibility model: The cloud blame game when something goes wrong will continue, however there will also be a realization that as with any technology or tool, there is a shared responsibility. This means that customers accept responsibility for how they will use a tool, technologies or service, the provider assumes responsibility, and both parties have a collective responsibility.

Return on innovation is the new ROI: For years, no make that decades a popular buzz term is return on investment the companion of total cost of ownership. Both ROI and TCO as you know and like (or hate) will continue to be used, however for situations that are difficult to monitize, a new variation exists. That new variation is return on innovation which is the measure of intangible benefits derived from how hard products are used to derive value for or of soft products and services delivered.

Solid State Devices (SSD) confidence: One of the barriers to flash SSD adoption has been cost per capacity with another being confidence in reliability and data consistency over time (aka duty cycle wear and tear). Many enterprise class solutions have used single level cell (SLC) flash SSD which has better endurance, duty cycle or wear handing capabilities however that benefit comes at the expense of a higher price per capacity. Consequently vendors are pushing multi level cell (MLC) flash SSD that reduces the cost per capacity, however needs additional controller and firmware functionality to manage the wear leaving and duty cycle. In some ways, MLC flash is to SSD memory what SATA high capacity desktop drives were to HDDs in the enterprise storage space about 8 to 9 years ago. What I mean by that is that more expense high performance disk drives were the norm, then lower cost higher capacity SATA drives appeared resulting in enhancements to make them more enterprise capable while boosting the confidence of customers to use the technology. Same thing is happening with flash SSD in that SLC is more expensive and for many has a higher confidence, while MLC is lower cost, higher capacity and gaining the enhancements to take on a role for flash SSD similar to what high capacity SATA did in the HDD space. In addition to confidence with SSD, new packaging variations will continue to evolve as well.

Virtualization beyond consolidation: The current wave of consolidation of desktop using VDI, server and storage aggregation will continue, however a trend that has been growing for a couple of years now that will take more prominence in 2012 and 2013 is realization that not everything can be consolidated, however many things can be virtualized. This means for some applications the focus will not be how many VMs to run per PM, rather, how a PM can be more effectively used to boost performance and agility for some applications during part of the day, while being used for other things at different times. For example a high performance database that normally would not be consolidated would be virtualized to enable agility for maintenance, BC, DR load balancing and placed on a fast PM with lots of fast memory, CPU and IO capabilities dedicated to it. However during off hours when little to no database activity is occurring, then other VMs would be moved onto that PM then moved off before the next busy cycle.

Will applications be ready to leverage cloud: Some applications and functionality can more easily be moved to cloud environments vs. others. A question that organizations will start to ask is what prevents their applications or business functionality from going to or using cloud resources in addition to asking cloud providers what new capabilities will they extend to support old environments.

Zombie list grows: More items will be declared dead meaning that they are either still alive, or have reached stability to the point where some want to see them dead so that their preferred technology or topic can take root.

Some other topics and trends include continued growing awareness that metrics and measurements matter for cloud, virtualization, data and storage networking. This also means a growing awareness that there are more metrics that matter for storage than cost per GByte or Tbyte that include IOPS, latency or response time, bandwidth, IO size, random and sequential along with availability. 2012 and 2013 will see continued respect being given to NAS at both the high end as well as low end of the market from enterprise down to consumer space. Speaking of consumer and SOHO (Small Office Home Office), now that SMB has generally been given respect or at least attention by many vendors, the new frontier will be to move further down market to the lower end of the SMB which is SOHO, just above consumer space. Of course some vendors have already closed the gap (or at least on paper, power point, web ex or you tube video) from consumer to enterprise. Of course Buzzword bingo will continue to be a popular game.

Oh, btw, DevOps will also appear in your vocabulary if it has not already.

Watch for more on these and other topics in the weeks and months to come and if you and to read more now, then get a copy of Cloud and Virtual Data Storage Networking. Also check out the top 25 new post of 2011 as well as some of the all time most popular posts at StorageIOblog.com that can also be seen on various other venues that pickup the full RSS feed or archive feed. Also check out the StorageIO news letter for additional industry trends perspectives and commentary.

Ok, nuff said

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Top 2011 cloud virtualization storage and networking posts

Thu, 29 Dec 2011 15:51:15 CST

Top 2011 cloud virtualization storage and networking posts

By Greg Schulz

Im in the process of wrapping up 2011 and getting ready for 2012. Here is a list of the top 25 new posts from this past year at StorageIOblog.

Looking back, here is a post about industry trends, thoughts and perspective predictions for 2010 and 2011 (preview 2012 and 2013 thoughts and perspectives here).

Top storageio cloud virtualization networking and data protection posts

Thu, 29 Dec 2011 15:51:15 CST

Top storageio cloud virtualization networking and data protection posts

By Greg Schulz

Im in the process of wrapping up 2011 and getting ready for 2012. Here is a list of the top 25 all time posts from StorageIOblog covering cloud, virtualization, servers, storage, green IT, networking and data protection. Looking back, here is 2010 and 2011 industry trends, thoughts and perspective predictions along with looking forward, a 2012 preview here.

Top 25 all time posts about storage, cloud, virtualization, networking, green IT and data protection

Check out the companion post to this which is the top 25 2011 posts located here as well as 2012 and 2013 predictions preview here.

Ok, nuff said

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Fall (December) 2011 StorageIO News Letter

Tue, 20 Dec 2011 10:11:22 CST

Fall (December) 2011 StorageIO News Letter

By Greg Schulz

Fall (December) 2011 News letter

Welcome to the Fall (December) 2011 edition of the Server and StorageIO Group (StorageIO) news letter. This follows the Summer 2011 edition.

You can get access to this news letter via various social media venues (some are shown below) in addition to StorageIO web sites and subscriptions.

Click on the following links to view the Fall (December) 2011 edition as an HTML or PDF or, to go to the news letter page to view previous editions.

Follow via Goggle Feedburner here or via email subscription here.

You can also subscribe to the news letter by simply sending an email to newsletter@storageio.com

Enjoy this edition of the StorageIO newsletter, let me know your comments and feedback.

Ok, nuff said

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Cloud and Virtual Data Storage Networking now on Kindle

Mon, 19 Dec 2011 23:32:23 CST

Cloud and Virtual Data Storage Networking now on Kindle

By Greg Schulz

It only makes sense that a book about Clouds, Virtualization, Data Storage and Networking be available via a cloud service in electronic format. Today Amazon and my publisher (CRC Press Taylor and Francis) released a Kindle version of my new book Cloud and Virtual Data Storage Networking which joins the previously released hardcopy version also available at Amazon.com among other venues.

Cloud and Virtual Data Storage Networking has been declared The New Enterprise Tech Bible by noted industry blogger and host of the Nekkid Tech (@NekkidTech) pod cast Greg Knieriemen (@Knieriemen). Check out Episode #11 (The Enterprise Tech Bible) of the Nekkid Tech pod cast show here.

Comments and reviews about Cloud and Virtual Data Storage Networking can be found at Amazon.com along with those from Stephen Guendert, PhD (@DrSteveGuendert) at CMG MeasureIT (@cmgnews) who says: Gregs latest book is the ibuprofen that will make these cloud computing information overload headaches go away. Cloud and Virtual Data Storage Networking is the single source you can read to get a clear understanding of the fundamentals of the cloud.

Greg Brunton, EDS, an HP Company commented: With all the chatter in the market about cloud storage and how it can solve all your problems, the industry needed a clear breakdown of the facts and how to use Cloud cloud storage effectively. Gregs latest book does exactly that.

Want to know more besides viewing the Google preview above?

Check out this free PDF download of Chapter 1 and view a PDF flyer with more information about the book including discount codes for ordering via the CRC Press or visit the StorageIO books page. In addition to Amazon Kindle version, other ebook formats including (PDF) are available here (bookdepository.com), and here (CRCnetBase) including each chapter.

View this post which has links too more information about cloud conversations and discussions.

Ok, nuff said

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

What industry pundits love and loathe about data storage

Wed, 14 Dec 2011 18:16:14 CST

What industry pundits love and loathe about data storage

By Greg Schulz

Drew Robb has a good article about what IT industry pundits including vendors, analysts, and advisors loath including comments from myself.

In the article Drew asks: What do you really love about storage and what are your pet peeves?

One of my comments and perspectives is that I like Hybrid Hard Disk Drives (HHDDs) in addition to traditional Hard Disk Drives (HDD) along with Solid State Devices (SSDs). As much as I like HHDDs, I also believe that with any technology, they are not the best solution for everything, however they can also be used in many ways than being seen. Here is the fifth installment of a series on HHDDs that I have done since June 2010 when I received my first HHDD a Seagate Momentus XT. You can read the other installments of my momentus moments here, here, here and here.

HHDD with integrated nand flash SSD photo courtesy Seagate.com

Molly Rector VP of marketing at magnetic tape vendor Spectra Logic mentioned that what she does not like is companies that base their business plan on patent law trolling. I would have expected something different along the lines of countering or correcting people that say tape sucks, tape is dead, or that tape is the cause problem of anything wrong with storage thus clearing the air or putting up a fight that tape is alive. Go figure...

Another of my comments involved clouds of which there are plenty of conversations taking place. I do like clouds (I even recently wrote a book involving them) however Im a fan of using them where applicable to coexist and enhance other IT resources. Dont be scared of clouds, however be ready, do your homework, listen, learn, do proof of concepts to decide best practices, when, where, what and how to use them.

Speaking of clouds, click here to read about who is responsible for cloud data loss and cast your vote, along with viewing what do you think about IT clouds in general here.

Mike Karp (aka twitter @storagewonk ) an analyst with Ptak Noel mentions that midrange environments dont get respect from big (or even startup) vendors.

I would take that a step further by saying compared to six or so years ago, SMB are getting night and day better respect along with attention by most vendors, however what is lacking is respect of the SOHO sector (e.g. lower end of SMB down to or just above consumer).

Granted some that have traditional sold into those sectors such as server vendors including Dell and HP get it or at least see the potential along with traditional enterprise vendor EMC via its Iomega . Yet I still see many vendors including startups in general discounting, shrugging off or sneering at the SOHO space similar to those who dissed or did not respect the SMB space several years ago. Similar to the SMB space, SOHO requires different products, packaging, pricing and routes to market via channel or etail mechanisms which means change for some vendors. Those vendors who embraced the SMB and realized what needed to change to adapt to those markets will also stand to do better with the SOHO.

Here is the reason that I think SOHO needs respect.

Simple, SOHOs grow up to become SMBs, SMBs grow up to become SMEs, SMEs grow up to become enterprises and not to mention that the amount of data being generated, moved, processed and stored continues to grow. The net result is that SMBs along with SOHO storage demands will continue to grow and for those vendors who can adjust to support those markets will also stand to gain new customers that in turn can become plans for other solution offerings.

Not surprising Eran Farajun of Asigra which has been doing cloud backups decades before they were known as clouds loves backup (and restores). However I am surprised that Eran did not jump on the its time to modernize and re architect data protection theme. Oh well, will have to have a chat with Eran on that sometime.

What was surprising were comments from Panzura who has a good distributed (e.g. read also cloud) file system that can be used for various things including online reference data. Panzura has a solution that normally I would not even think about in the context of being pulled into a Datadomain or dedupe appliance type discussion (e.g tape sucks or other similar themes). So it is odd that they are playing to the tape sucks camp and theme vs. playing to where the technology can really shine which IMHO is in the global, distributed, scale out and cloud file system space. Oh well, I guess you go with what you know or has worked in the past to get some attention.

Molly Rector of Spectra also mentioned that she likes High Performance Computing, surprised that she did not throw in high productivity computing as well in conjunction with big data, big bandwidth, green, dedupe, power, disk, tape and related buzzword bingo terms.

Also there are some comments from myself about cost cutting.

While I see the need for organizations to cut costs during tough economic times, Im not a fan of simply cutting cost for the sake of cost cutting as opposed to finding and removing complexity that in turn remove costs of doing work. In other words, Im a fan of finding and removing waste, becoming more effective and productive along with removing the cost of doing a particular piece of work. This in the end meets the aim of bean counters to cut costs, however can be done in a way that does not degrade service levels or customer service experience. For example instead of looking to cut backup costs, do you know where the real costs of doing data protection exist (hint swapping out media is treating the symptoms) and if so, what can be done to streamline those from the source of the problem downstream to the target (e.g. media or medium). In other words, redesign, review, modernize how data protection is done, leverage data footprint reduction (DFR) techniques including archive, compression, consolidation, data management, dedupe and other technologies in effective and creative ways, after all, return on innovation is the new ROI.

Checkout Drews article here to read more on the above topics and themes.

Ok, nuff said

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

New Seagate Momentus XT Hybrid drive (SSD and HDD)

Mon, 28 Nov 2011 23:11:11 CST

New Seagate Momentus XT Hybrid drive (SSD and HDD)

By Greg Schulz

Seagate recently announced the next generation Momentus XT Hybrid Hard Disk Drive (HHDD) with a capacity of 750GB in a 2.5 inch form factor and MSRP of $245.00 USD including integrated NAND flash solid state device (SSD). As a refresher, the Momentus XT is a HHDD in that it includes a 4GB nand flash SSD integrated with a 500GB (or larger) 7,200 RPM hard disk drive (HDD) in a single 2.5 inch package.

HHDD with integrated nand flash SSD photo courtesy Seagate.com

This is the fifth installment of a series that I have been doing since June 2010 when I received my first HHDD a Seagate Momentus XT. You can read the other installments of my momentus moments here, here, here and here.

Whats is new with the new generation.
Besides additional storage space capacity up to 750GB (was 500GB), there is twice as much single level cell (SLC) nand flash memory (8GB vs. 4GB in previous generation) along with an enhanced interface using 6Gb per second SATA that supports native command queuing (NCQ) for better performance. Note that NCQ was available on the previous generation Momentus XT that used a 3Gb SATA interface. Other enhancements include a larger block or sector size of 4096 bytes vs. traditional 512 bytes on previous generation storage devices.

This bigger sector size results in less overhead with managing data blocks on large capacity storage devices. Also new are caching enhancements are FAST Factor Flash Management, FAST Factor Boot and Adaptive Memory Technology. Not to be confused with EMC Fully Automated Storage Tiering the other FAST; Seagate FAST is technology that exists inside the storage drive itself. FAST Factor boot enables systems to boot and be productive with speeds similar to SSD or several times faster than traditional HDDs.

The FAST Factor Flash Management provides the integrated intelligence to maximize use of the nand flash or SSD capabilities along with spinning HDD to boot performance, maintain compatibility with different systems and their operating systems. In addition to performance and interoperability, data integrity and SSD flash endurance are also enhanced for investment protection. The Adaptive Memory technology is a self learning algorithm to provide SSD like performance for frequently used applications and data to close the storage capacity too performance gap that has been increasing along with data center bottlenecks.

Some questions and discussion comments:

When to use SSD vs. HDD vs. HHDD?
If you need the full speed of SSD to boost performance across all data access and cost is not an issue for available capacity that is where you should be focused. However if you are looking for lowest total cost of storage capacity with no need for performance, than lower cost high capacity HDDs should be on your shopping list. On the other hand, if you want a mix of performance and capacity at an effective price, than HHDDs should be considered.

Why the price jump compared to first generation HHDD?
IMHO, it has a lot to do with current market conditions, supply and demand.

With recent floods in Thailand and forecasted HDD and other technology shortages, the lay of supply and demand applies. This means that the supply may be constrained for some products causing demand to rise for others. Your particular vendor or supplier may have inventory however will be less likely to heavily discount while there are shortages or market opportunities to keep prices high. There are already examples of this if you check around on various sites to compare prices now vs. a few months ago. Granted it is the holiday shopping season for both individuals as well as organizations spending the last of their available budgets so more demand for available supplies.

What kind of performance or productivity have I seen with HHDDs?
While I have not yet tested and compared the second generation or new devices, I can attest to the performance improvements resulting in better productivity over the past year using Seagate Momentus XT HHDDs compared to traditional HDDs. Here is a post that you can follow to see some boot performance comparisons as part of some virtual desktop infrastructure (VDI) sizing testing I did earlier this year that included both HHDD and HDD.

	HHDD desktop 1	HDD desktop 1	HHDD desktop 2
Avg. IOPS	334	69 to 113	186 to 353
Avg. MByte sec	5.36	1.58 to 2.13	2.76 to 5.2
Percent IOPS read	94	80 to 88	92
Percent MBs read	87	63 to 77	84
Mbytes read	530	201 to 245	504
Mbytes written	128	60 to 141	100
Avg. read latency	2.24ms	8.2 to 9.5ms	1.3ms
Avg. write latency	10.41ms	20.5 to 14.96ms	8.6ms
Boot duration	120 seconds	120 to 240 sec	120

Click here to read the entire post about the above table

When will I jump on the SSD bandwagon?
Great question, I have actually been on the SSD train for several decades using them, selling them, covering, analyzing and consulting around them along with other storage mediums including HDD, HHDD, cloud and tape. I have some SSDs and will eventually put them into my laptops, workstations and servers as primary storage when the opportunity makes sense.

Will HHDDs help backup and other data protection tasks?
Yes, in fact I initially used my Momentus XTs as backup or data protection targets along with for moving large amounts of data between systems faster than what my network could support.

Why not use a SSD?
If you need the performance and can afford the price, go SSD!

On the other hand, if you are looking to add a small 64GB, 128GB or even 256GB SSD while retaining a larger capacity, slower and lower cost HDD, an HHDD should be considered as an option. By using an HHDD instead of both a SSD and HDD, you will eliminate the need of figuring out how to install both in space constrained laptops, desktop or workstations. In addition, you will eliminate the need to either manually move data between the different devices or avoid having to acquire software or drivers to do that for you.

How much does the new Seagate Momentus XT HHDD cost?
Manufactures Suggested Retail Price (MSRP) is listed at $245 for a 750GB version.

Does the Momentus XT HHDD need any special drivers, adapters or software?
No, they are plug and play. There is no need for caching or performance acceleration drivers, utilities or other software. Likewise no needs for tiering or data movement tools.

How do you install an HHDD into an existing system?
Similar to installing a new HDD to replace an existing one if you are familiar with that process. If not, it goes like this (or uses your own preferred approach).

Attach a new HHDD to an existing system using a cable
Utilize a disk clone or image tool to make a copy of the existing HDD to HHDD
Note that the system may not be able to be used during the copy, so plan ahead.
After the clone or image copy is made, shutdown system, remove existing HDD and replace it with the HHDD that was connected to the system during the copy (remember to remove the copy cable).
Reboot the system to verify all is well, note that it will take a few reboots before the HHDD will start to learn your data and files along with how they are used.
Regarding your old HDD, save it, put it in a safe place and use it as a disaster recovery (DR) backup. For example if you have a safe deposit box or somewhere else safe, put it there for when you will need it in the future.

Seagate Momentus XT and USB to SATA cable

Can an HHDD fit into an existing slot in a laptop, workstation or server?
Yes. In fact, unlike a HDD and SSD combination, that requires multiple slots or forcing one device to be external, HHDDs like the Momentus XT simply use the space where your current HDD is installed.

How do you move data to it?
Beyond the initial installation described above, the HHDD appears as just another local device meaning you can move data to or from it like any other HDD, SSD or CD.

Do you need automated tiering software?
No, not unless you need it for some other reason or if you want to use an HHDD as the lower cost, larger capacity option as a companion to a smaller SSD.

Do I have any of the new or second generation HHDDs?
Not yet, maybe soon and I will do another momentus moment point when that time arrives. For the time being, I will continue to use the first generation Momentus XT HHDDs

Bottom line (for now), If you are considering a large capacity, HDDs check out the HHDDs for an added performance boost including faster boot times in addition to accessing other data quicker.

On the other hand if you want an SSD however your budget restricts you to a smaller capacity version, look into how an HHDD can be a viable option for some of your needs.

Ok, nuff said

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Speaking of speeding up business with SSD storage

Mon, 28 Nov 2011 23:11:11 CST

Speaking of speeding up business with SSD storage

By Greg Schulz

Solid state devices (SSD) are a popular topic gaining both industry adoption and customer deployment to speed up storage performance. Here is a link to a recent conversation that I had with John Hillard to discuss industry trends and perspectives pertaining to using SSD to boost performance and productivity for SMB and other environments.

SSDs can be a great way for organizations to do IO consolidation to reduce costs in place of using many hard disk drives (HDDs) grouped together to achieve a certain level of performance. By consolidating the IOs off of many HDDs that often end up being under utilized from a space capacity basis, organizations can boost performance for applications while reducing, or reusing HDD based storage capacity for other purposes including growth.

You can read a transcript of the conversation and listen to the pod cast here, or download the MP3 audio here.

Ok, nuff said about SSD (for now)

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Cloud, virtualization and storage networking conversations

Thu, 24 Nov 2011 18:18:18 CST

Cloud, virtualization and storage networking conversations

By Greg Schulz

Here is a link to a series cloud, virtualization and storage networking conversations posts that Im doing over at IT-Toolbox. Each post in the series covers various topics along with a frequently asked question that I encounter pertaining to clouds, virtualization and storage networking.

Check out the cloud, virtualization and storage networking conversations series here.

Ok, nuff said (for now)

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

How to write, publish and promote a book or blog

Sat, 19 Nov 2011 13:45:54 CST

How to write, publish and promote a book or blogs

By Greg Schulz

Have you ever read an article, blog post or a book and said to yourself that you could do that, perhaps even better?

Well, unless you have already done so, what are you waiting for to write a book, blog, article or create some other form of content using different mediums or venues?

The other evening I attended a local Stillwater (Artreach St Croix) event (Publishers Forum) with my wife (karenofarcola.com). Karen is working on getting her first book (fiction for children and young adults) published so she was interested in meeting the different publishers. For me I wanted to learn about the local publishers, hear what they had to say in addition to meeting the purveyor of a local book store (Valley Book Seller) who helped promote the event.

It was interesting listening to the panel made up of a nonprofit publisher (Milkweed Editions), a full service self publishing venue (Beaver Pond Press) and regional publishing house (Tristin Publishing).

Having formally published books (e.g. with traditional publishers (Elseiver and CRC/Taylor Francis), ISBNs, Library of Congress (LOC) registration) along with contributing on other projects, not to mention over a thousand articles, tips, reports, white papers, solution briefs, videos and other content, I often get asked what does it take to write a book, blog or other material.

I also get told by people that they could do a better job to which I ask them then why dont they do something about it vs. simply saying that they could do something better.

Back to the Art Reach St Croix publishers forum event, the attendees were mainly aspiring authors looking to get their first works published. Having already been down the path that many in the room were looking to go (get published) it was interesting to hear the various questions and discussion topics. Some of those questions were about the process of self publishing vs. working with the publisher (large or small) in addition to how much costs or how to get discovered. It was also great to hear the panelist discuss some of the hurdles authors face in getting their books published along with promoting their works.

I learned several years ago before I did my first solo book was a tip that another author told me of the importance of promotion. That is your publisher will help enable, however it is up to you the author to promote your works by creating a platform or means of interacting with different audiences. Consequently it was fun to hear the panelist talk with the authors on the importance of creating a platform including a blog, twitter, Google Plus, facebook, doing articles and appearances to help create awareness. What was fun to watch were the authors who seemed to be more comfortable with creating their works and then waiting for the results to occur as opposed to helping make their work a success.

Anyways, for those who are aspiring to write a book, blog or article, or even for those who are content being arm chair authors or Monday morning quarterbacks, here is a link to a series about how to write a book or blog. The series (how to write a book or blog) can be read over at the VMware communities site that Im contributing for as a vExpert.

Oh, and for you aspiring authors or bloggers wondering about creating and developing a platform, what you are reading here is an example of doing just that. In other words, my platform includes what you are reading here in addition to on my regular blog or other venues including Google Plus (G+), Facebook, LinkedIn and twitter among other venues.

So what are you waiting for, go get your book or blog or article written, published and start promoting it.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Do you know HDS or what it means?

Thu, 10 Nov 2011 13:14:15 CST

Do you know HDS or what it means?s

By Greg Schulz

How much do you know about HDS?

When you hear HDS in the context of information technology do you think of Hitachi Data Systems?

Along with a bunch of other IT industry advisors, analysts, bloggers, consultants, financiers and pundits or influencers, Im attending a event being sponsored by HDS this week in San Jose California (SJC).

For those not familiar, as a division of the much larger Japan based conglomerate named Hitachi, HDS sells various types of data storage systems and associated management tools along with services.

While on the airplane from Seattle (SEA) to SJC the other night (Disclosure: HDS picked up the one way coach ticket) it occurred to me different things that HDS could refer to besides Hitachi Data Systems.

In addition to being the International Airtranspot Transport Association (IATA) code for Hoedspruit Airport in South Africa where HDS is in the process of buying Shoeden Data Systems (SDS), here are some other possibilities of what HDS could mean.

Hadoop Data Solutions
Half height Disk Shelve
Hardware Disks and Software
Has Dedupe Solutions
Has Disaster recovery Solutions
Has Disk Story
Has Disks Servers
Has Diverse Solutions
Has Done Servers
Have Daily Schnitzel (in Vienna aka Wien)

HDDs Depend on Software
Healthcare Data Systems
Helps Datacenters Save
Helps Data Survives
Helps Data Synchronize
Helps Delete Spam
Helps Dell Servers
Helps Disk Spin
High Density SAS
Houses Data on SSD
How Data Saved
Hu (Yoshida) Discusses Storage
Huge Disk System
HVAC Down Stairs (Heating Ventilation Air Conditioning)
Hybrid Data Systems

Ok, nuff said for now in case the HDS influence folks dont have a sense of influence humor.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

IT and technology turkeys

Tue, 8 Nov 2011 00:01:02 CST

Congratulations to IBM for releasing XIV SPC results

By Greg Schulz

Now that Halloween and talk of Zombies has past (at least for now), that means next up on the social or holiday calendar topics in the U.S. is thanksgiving which means turkey themes.

With turkey themes in mind, how about some past, current and maybe future technology flops or where are they now.

Roast Turkey
© 2006 Peggy Trowbridge Filippone

A technology turkey can be a product, trend, technique or theme that was touted (or hyped) and flopped for various reasons not flying up to, or meeting its expectations. That means that a technology turkey may have had industry adoption however lacked customer deployment.

Lets try a few, how about holographic storage, or is that still a future technology?

Were NEXT computer and the Apple Newton turkeys?

Disclosure: I have a Newton that has not been used since the mid 90s.

Is ATA over Ethernet (AoE) a future turkey candidate along with FCoE aka Fibre Channel over Ethernet (or here or here), or is that just some peoples wishful thinking regarding FCoE being a turkey?

Speaking of AoE, what ever happened to Zetera (aka Hammer storage) the iSCSI alternative of a few years ago?

To be fair how about IPFC not to be confused with FCIP (Fibre Channel frames mapped to IP for distance) or iFCP not to be confused with FCoE or iSCSI. IPFC mapped IP as upper level protocol (ULP) onto Fibre Channel coexisting with FCP and FICON. There were only a few adopters of IPFC that used it as a low latency channel to channel (CTC) mechanism for open systems before InfiniBand and other technologies matured.

Im guessing that someone will step up to defend the honor of Microsoft Windows Vista, however until then, IMHO it is or was a Turkey. While on the topic of operating systems, anyone have an opinion on IBMs OS2? Speaking of PCs, how about the DEC Rainbow and its sibling the Robin? Remember when IBM was in the PC business before selling it off to Lenovo, how about the IBM PCjr, turkey candidate or not?

HP should be on the turkey list with their now ex CEO Leo Apotheker whom they put out to pasture, on the technology front, anybody remember AutoRAID?

How about the Britton Lee Database machine which today would be referred to as a storage appliance or application optimized storage system such as the Oracle Exadata II (or Oracle Exadata I based on HP hardware) among others. Note that Im not saying Exadata I or Exadata II are turkeys as that will be left to your own determination. Both are cool from a technology standpoint, however there is more to having neat or interesting technology to move from announcement to industry adoption to customer deployment, things that Oracle has been having some success with.

Speaking of Oracle, remember when Sun bought the Encore storage system and renamed it the A7000 (not to be confused with the A5000 aka Photon) in an attempt to compete against the EMC Symmetrix. The Encore folks after Sun went on to their next project and still today call it DataCore. Meanwhile Sun discontinued the A7000 after a period of time similar to what they did with other acquisitions such as Pirus which became the 6920 which was end of lifed as part of a deal where Sun increased their resell activity of HDS which too has since been archived. Hmmm, that begs the question of what happens with Oracle acquiring Pillar with an earn out scheme where if there is revenue there is a payout, if there is no revenue then there is a tax write off.

What about big data, will that become a turkey following in the footsteps of other former high flyers such as cloud, virtualization, data classification, CDP, Green IT and SOA among many others. IMHO that depends upon what your view or definition along with expectations of big data is as a buzzword bingo topic. Depending on your view, that will determine if the above will join others that fade away from the limelight shifting into productive modes for customers and profitable activity for vendors.

Want to read what others have to say about technology turkeys or flops?

Here is what ibitimes has to say about technology flops (aka) turkeys, with Infoworlds lineup here, Computerworlds list is here. Meanwhile a couple from mashable here and here, Cnet weighs in here, with another list over at investorplace found here, and checkout the list at Money here with the telegraph represented here. Of course you could Google to find more however you would probably also stumble upon Googles own flops or technology turkeys including wave.

What is your take as to other technology turkeys past, present or future?

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Congratulations to IBM for releasing XIV SPC results

Tue, 25 Oct 2011 10:11:12 CST

Congratulations to IBM for releasing XIV SPC results

By Greg Schulz

Over the past several years I have done an annual post about IBM and their XIV storage system and this is the fourth in what has become a series. You can read the first one here, the second one here, and last years here and here after the announcement of the IBM V7000.

IBM XIV Gen3
IBM recently announced the generation 3 or Gen3 version of XIV along with releasing for the first time public performance comparison benchmarks using storage performance council (SPC) throughout SPC2 workload.

The XIV Gen3 is positioned by IBM as having up to four (4) times the performance of earlier generations of the storage system. In terms of speeds and feeds, the Gen3 XIV supports up to 180 2TB SAS hard disk drives (HDD) that provides up to 161TB of usable storage space capacity. For connectivity, the Gen3 XIV supports up to 24 8Gb Fibre Channel (8GFC) or for iSCSI 22 1Gb Ethernet (1 GbE) ports with a total of up to 360GBytes of system cache. In addition to the large cache to boost performance, other enhancements include leveraging multi core processors along with an internal InfiniBand network to connect nodes replacing the former 1 GbE interconnect. Note, InfiniBand is only used to interconnect the various nodes in the XIV cluster and is not used for attachment to applications servers which is handled via iSCSI and Fibre Channel.

IBM and SPC storage performance history
IBM has a strong history if not leading the industry with benchmarking and workload simulation of their storage systems including Storage Performance Council (SPC) among others. The exception for IBM over the past couple of years has been the lack of SPC benchmarks for XIV. Last year when IBM released their new V7000 storage system benchmarks include SPC were available close to if not at the product launch. I have in the past commented about IBMs lack of SPC benchmarks for XIV to confirm their marketing claims given their history of publishing results for all of their other storage systems. Now that IBM has recently released SPC2 results for the XIV it is only fitting then that I compliment them for doing so.

Benchmark brouhaha
Performance workload simulation results can often lead to applies and oranges comparisons or benchmark brouhaha battles or storage performance games. For example a few years back NetApp submitted a SPC performance result on behalf of their competitor EMC. Now to be clear on something, Im not saying that SPC is the best or definitive benchmark or comparison tool for storage or other purpose as it is not. However it is representative and most storage vendors have released some SPC results for their storage systems in addition to TPC and Microsoft ESRP among others. SPC2 is focused on streaming such as video, backup or other throughput centric applications where SPC1 is centered around IOPS or transactional activity. The metrics for SPC2 are Megabytes per second (MBps) for large file processing (LFP), large database query (LDQ) and video on demand delivery (VOD) for a given price and protection level.

What is the best benchmark?
Simple, your own application in as close to as actual workload activity as possible. If that is not possible, then some simulation or workload simulation that closets resembles your needs.

Does this mean that XIV is still relevant?
Yes

Does this mean that XIV G3 should be used for every environment?
Generally speaking no. However its performance enhancements should allow it to be considered for more applications than in the past. Plus with the public comparisons now available, that should help to silence questions (including those from me) about what the systems can really do vs. marketing claims.

How does XIV compare to some other IBM storage systems using SPC2 comparisons?

System	SPC2 MBps	Cost per SPC2	Storage GBytes	Price tested	Discount	Protection
DS5300	5,634.17	$74.13	16,383	417,648	0%	R5
V7000	3,132.87	$71.32	29,914	$223,422	38-39%	R5
XIV G3	7,467.99	$152.34	154,619	1,137,641	63-64%	Mirror
DS8800	9,705.74	$270.38	71,537	2,624,257	40-50%	R5

In the above comparisons, the DS5300 (NetApp/Engenio based) is a dual controller (4GB of cache per controller) with 128 x 146.8GB 15K HDDs configured as RAID 5 with no discount applied to the price submitted. The V7000 system which is based on the IBM SVC along with other enhancements consists of dual controllers each with 8GB of cache and 120 x 10K 300GB HDDs configured as RAID 5 with just under a 40% discount off list price for system tested. For the XIV Gen3 system tested, discount off list price for the submission is about 63% with 15 nodes and a total of 360GB of cache and 180 2TB 7.2K SAS HDDs configured as mirrors. The DS8800 system with dual controllers has a 256GB of cache, 768 x 146GB 15K HDDs configured in RAID5 with a discount between 40 to 50% off of list.

What the various metrics do not show is the benefit of various features and functionality which should be considered to your particular needs. Likewise, if your applications are not centered around bandwidth or throughput, then the above performance comparisons would not be relevant. Also note that the systems above have various discount prices as submitted which can be a hint to a smart shopper where to begin negotiations at. You can also do some analysis of the various systems based on their performance, configuration, physical footprint, functionality and cost plus the links below take you to the complete reports with more information.

DS8800 SPC2 executive summary and full disclosure report

XIV SPC2 executive summary and full disclosure report

DS5300 SPC2 executive summary and full disclosure report

V7000 SPC2 executive summary and full disclosure report

Bottom line, benchmarks and performance comparisons are just that, a comparison that may or may not be relevant to your particular needs. Consequently they should be used as a tool combined with other information to see how a particular solution might be a fit for your specific needs. The best benchmark however is your own application running as close to possible realistic workload to get a representative perspective of a systems capabilities.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

What am I hearing and seeing while out and about

Sun, 23 Oct 2011 19:18:17 CST

What am I hearing and seeing while out and about

By Greg Schulz

It has been a busy fall 2011 which started out with VMworld 2011 in Las Vegas just before the labor day weekend.

Scenes from the CXI party (@cxi) at VMworld 2011

Besides activity in support of the launch of my new book Cloud and Virtual Data Storage Networking (CRC Press), I have been busy with various client research, consulting and advisory projects. In addition to Las Vegas for VMworld, out and about travel activities for attending conferences and presenting seminars have included visits in Minneapolis (local), Nijkerk Holland and Denver (in the same week) and Orlando (SNW). Upcoming out and about events are scheduled for Los Angles, Atlanta, Chicago, Seattle and a couple of trips to San Jose area before the brief thanksgiving holiday break.

Beer and Bitter ballens on the left, coffee machine in Nijkerk on the right

Day one of two day seminar in Nijkerk

Bicycles lined up at the Nijkerk train station, waiting for the 6:30 train to Schiphol

Changing trains on way to Schiphol to board flight to MSP and then to DEN

After Denver back to MSP for a few days before SNW in Orlando

While being out and about I have had the chance to meet and visit with many different people. Here are some questions and comments that I have heard while out and about:

What comes after cloud?
Are there standards for clouds and virtualization?
Should cost savings be the justification for going to cloud, virtual or dynamic environments?
How is big data different than traditional stream and flat file analytics and processing using tools such as SAS (Statistical Analysis Software)?
Is big data only about map reduce and hadoop?
Are clouds any less secure or safe for storage and applications?
Do clouds and virtualization removing complexity and simplify infrastructures?
Are cloud storage services cheaper than buying and managing your own?
Is object based storage a requirement for public or private cloud?
Do solution bundles such as EMC vBlock and NetApp FlexPods reduce complexity?
Why is FCoE taking so long to be adopted and is it dead?
Should cost savings be the basis for deciding to do a VDI or virtualization project?
What is the best benchmark or comparison for making storage decisions?

In addition, there continues to be plenty of cloud confusion, FUD and hype around public, private, hybrid along with AaaS, SaaS, PaaS and IaaS among other XaaS. The myth that virtualization of servers, storage and workstations is only for consolidation continues. However there are more people beginning to see the next wave of life beyond consolidation where the focus expands to flexibility, agility and speed of deployment for non aggregated workloads and applications. Another popular myth that is changing is that data footprint reduction (DFR) is only about dedupe and backup. What is changing is an awareness that DFR spans all types of storage and data from primary to secondary leveraging different techniques including archive, backup modernization, compression, consolidation, data management and dedupe along with thin provisioning among other techniques.

Archiving for email, database and file systems needs to be rescued from being perceived as only for compliance purposes. If you want or need to reduce your data footprint impact (DFR), optimize your storage for performance or capacity, enable backup, BC and DR to be performed faster, achieve Green IT and efficiency objectives, expand your awareness around archiving. While discussing archiving, focus is often on the target or data storage medium such as disk, tape, optical or cloud along with DFR techniques such as compression and dedupe or functionally including ediscovery and WORM. The other aspects of archive that need to be looked at include policies, retention, application and software plugins for Exchange, SQL, Sharepoint, Sybase, Oracle, SAP, VMware and others.

Boot storms continue to be a common theme for apply solid state devices (SSD) in support of virtual desktop inititiaves (VDI). There is however a growing awareness and discussions around shutdown storms, day to day maintenance including virus scans in addition to applications that increase the number of writes. Consequently the discussions around VDI are expanding to include both reads and writes as well as reduced latency for storage and networks.

Some other general observations, thoughts and comments:

Getting into Holland as a visitor is easier than returning to the U.S. as a citizen
Airport security screening is more thorough and professional in Europe than in the U.S.
Hops add latency to beer (when you drink it) and to networks (time delay)
Fast tape drives need disk storage to enable streaming for reads and writes
SSD is keeping HDDs alive, HDDs are keeping tape alive and all there roles are evolving while the technologies continue to evolve.
Hybrid Hard Disk Drives (HHDDs) are gaining in awareness and deployments in workstations as well as laptops.
Confusion exists around what are flat layer 2 networks for LANs and Sans
Click here to view additional comments and perspectives

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

SNW Fall 2011 revisited and SNIA Emerald program

Sun, 23 Oct 2011 14:15:16 CST

SNW Fall 2011 revisited and SNIA Emerald program

By Greg Schulz

Blog post: SNW Fall 2011 revisited

A couple of weeks ago I traveled down to Orlando Florida for a few days to attend the fall 2011 SNW (Storage Networking World) produced in conjunction by IDG Computerworld and the Storage Networking Industry Association (SNIA).

While at the Orlando event, SNIA executive director Leo Legar asked me how many SNWs I had attended and my responses was on which continent?

My answer was part in fun however also serious as I have been attending SNWs (in addition to other SNIA events) for over ten years in both North and South America as well as in Europe including presenting SNIA tutorials and SNW sessions.

SNW is always good for meeting up with old friends and acquaintances along with meeting new ones including twitter tweeps (hashtag #snwusa #snw2011 @sniacloud @snwusa) and the recent event was no exception. Granted SNW is smaller than it was during its peak in the mid 2000s however it was great to go for a couple of days of meetings, checking out the expo hall and some sessions as well as getting out and about meeting people involved with servers, storage, networking, virtualization, cloud, hardware, software and services.

SNW remains as its name implies (Storage Networking World) an event around networking as in conversations, learning, knowledge exchange, information gathering and meetings not to mention the hands on lab. I found the two days I was there adequate to get the meetings and other activities I had planned, along with time for impromptu meetings. ANother observation was that during the peak of the large mega SNW events, while there were more meetings, they were also much shorter along the lines of speed dating vs. those a couple of weeks ago where there was time to have quality conversations.

Some of the news at the recent SNW event, involved SNIA and their Green Storage Initiative (GSI) announcing the availability of the Emerald program Green IT storage energy metrics that have been in the works for several years. The SNIA Emerald program consists of specifications, taxonomies, metrics and measurements standards to gauge various types of storage power or energy usage to gauge its effectiveness. In other words, yes, Green IT and Green storage are still alive, they just are not as trendy to talk about as they were a few years ago which a shift in focus towards productivity, effective use and supporting growth to help close the green gap and missed IT as well as business opportunities.

Also during the recent SNW event, I did a book signing event sponsored by SNIA. If you have not done so, check out the SNIA Cloud Storage Initiative (CSI) who arranged for several of my new book Cloud and Virtual Data Storage Networking to be given away. Book signings are fun in that I get to meet lots of people and hear what they are doing, encountering, looking for, have done, concerned or excited about. It was handy having SNIA CSI material available at the table as I was signing books and visiting with people to be able to give them information about things such as CDMI not to mention hearing what they were doing or looking for. Note to SNIA, if we do this again, lets make sure to have someone from the CSI at the table to join in the fun and conversations as there were some good ones. Learn more about the activities of the SNIA CSI including their Cloud Data Management Initiative (CDMI) here.

Thanks again to SNIA for arranging the book signing event and for those who were not able to get a copy of my new book before they ran out, my publisher CRC Press Taylor and Francis has arranged a special SNIA and SNW discount code. To take advantage of the SNIA and SNW discount code, go to the CRC Press web site (here) and apply the discount code KVK01 during checkout for catalog item K12375 (ISBN: 9781439851739).

Thanks again to Wayne Adams (@wma01606), Leo Legar and Michael Meleedy among others who arranged for a fantastic fall 2011 SNW event along with everyone who participated in the book signing event and other conversations while in Orlando and to those who were involved virtually via twitter.

Ok, nuff said, enough fun, lets get back to work, at least for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Trick or treat: 2011 IT Zombie technology poll

Tue, 18 Oct 2011 12:13:14 CST

Trick or treat: 2011 IT Zombie technology poll

By Greg Schulz

Warning: Do not be scared, however be ready for some trick and treat fun, it is after all, the Halloween season.

I like new emerging technologies and trends along with Zomboe technologies, you know, those technologies that have been declared dead yet are still being enhanced, sold and used.

Zombie technologies as a name may be new for some, while others will have a realization of experiencing something from the past, technologies being declared deceased yet still alive and being used. Zombie technologies are those that have been declared dead, yet still alive enabling productivity for customers that use them and often profits for the vendors who sell them.

Some people consider a technology or trend dead once it hits the peak of hype as that can signal a time to jump to the next bandwagon or shiny new technology (or toy).

Others will see a technology as being dead when it is on the down slope of the hype curve towards the trough of disillusionment citing that as enough cause for being deceased.

Yet others will declare something dead while it matures working its way through the trough of disillusionment evolving from market adoption to customer deployment eventually onto the plateau of productivity (or profitability).

Then there are those who see something as being dead once it finally is retired from productive use, or profitable for sale.

Of course then there are those who just like to call anything new or other than what they like or that is outside of their comfort zone as being dead. In other words, if your focus or area of interest is tied to new products, technology trends and their promotion, rest assured you better be where the resources are being applied and view other things as being dead and thus probably not a fan of Zombie technologies (or at least publicly).

On the other hand, if your area of focus is on leveraging technologies and products in a productive way, including selling things that are profitable without a lot of marketing effort, your view of what is dead or not will be different. For example if you are risk averse letting someone else be on the leading bleeding edge (unless you have a dual redundant HA blood bank attached to your environment) your view of what is dead or not will be much different from those promoting the newest trend.

Funny thing about being declared dead, often it is not the technology, implementation, research and development or customer acquisitions, rather simply a lack of promotion, marketing and general awareness. Take tape for example which has been a multi decade member of the Zombie technology list. Recently vendors banded together investing or spending on marketing awareness reaching out to say tape is alive. Guess what, lo and behold, there was a flurry of tape activity in venues that normally might not be talking about tape. Funny how marketing resources can bring something back from the dead including Zombie technologies to become popular or cool to discuss again.

With the 2011 Halloween season among us, it is time to take a look this years list of Zombie technologies. Keep in mind that being named a Zombie technology is actually an honor in that it usually means someone wants to see it dead so that his or her preferred product or technology can take it place.

Here are 2011 Zombie technologies.

Backup: Far from being dead, its focus is changing and evolving with a broader emphasis on data protection. While many technologies associated with backup have been declared dead along with some backup software tools, the reality is that it is time or modernizes how backups and data protection are performed. Thus, backup is on the Zombie technology list and will live on, like it or not until it is exorcised from, your environment replaced with a modern resilient and flexible protected data infrastructure.

Big Data: While not declared dead yet, it will be soon by some creative marketer trying to come up with something new. On the other hand, there are those who have done big data analytics across different Zombie platforms for decades which of course is a badge of honor. As for some of the other newer or shiny technologies, they will have to wait to join the big data Zombies.

Cloud: Granted clouds are still on the hype cycle, some argue that it has reached its peak in terms of hype and now heading down into the trough of disillusionment, which of course some see as meaning dead. In my opinion cloud, hype has or is close to peaking, real work is occurring which means a gradual shift from industry adoption to customer deployment. Put a different way, clouds will be on the Zombie technology list of a couple of decades or more. Also, keep in mind that being on the Zombie technology list is an honor indicating shift towards adoption and less on promotion or awareness fan fare.

Data centers: With the advent of the cloud, data centers or habitats for technology have been declared dead, yet there is continued activity in expanding or building new ones all the time. Even the cloud relies on data centers for housing the physical resources including servers, storage, networks and other components that make up a Green and Virtual Data Center or Cloud environment. Needless to day, data centers will stay on the zombie list for some time.

Disk Drives: Hard disk drives (HDD) have been declared dead for many years and more recently due to popularity of SSDs have lost their sex appeal. Ironically, if tape is dead at the hands of HDDs, then how can HDDs be dead, unless of course they are on the Zombie technology list. What is happening is like tape, HDDs role are changing as the technology continues to evolve and will be around for another decade or so.

Fibre Channel (FC): This is a perennial favorite having been declared dead on a consistent basis over three decades now going back to the early 90s. While there are challengers as there have been in the past, FC is far from dead as a technology with 16 Gb (16GFC) now rolling out and a transition path for Fibre Channel over Ethernet (FCoE). My take is that FC will be on the zombie list for several more years until finally retired.

Fibre Channel over Ethernet (FCoE): This is a new entrant and one uniquely qualified for being declared dead as it is still in its infancy. Like its peer FC which was also declared dead a couple of decades ago, FCoE is just getting started and looks to be on the Zombie list for a couple of decades into the future.

Green IT: I have heard that Green IT is dead, after all, it was hyped before the cloud era which has been declared dead by some, yet there remains a Green gap or disconnect between messaging and issues thus missed opportunities. For a dead trend, SNIA recently released their Emerald program which consists of various metrics and measurements (remember, zombies like metrics to munch on) for gauging energy effectiveness for data storage. The hype cycle of Green IT and Green storage may be dead, however Green IT in the context of a shift in focus to increased productivity using the same or less energy is underway. Thus Green IT and Green storage are on the Zombie list.

iPhone: With the advent of Droid and other smart phones, I have heard iPhones declared dead, granted some older versions are. However while the Apple cofounder Steve Jobs has passed on (RIP), I suspect we will be seeing and hearing more about the iPhone for a few years more if not longer.

IBM Mainframe: When it comes to information technology (IT), the king of the Zombie list is the venerable IBM mainframe aka zSeries. The IBM mainframe has been declared dead for over 30 years if not longer and will be on the zombie list for another decade or so. After all, IBM keeps investing in the technology as people buy them not to mention IBM built a new factory to assemble them in.

NAS: Congratulations to Network Attached Storage (NAS) including Network File System (NFS) and Windows Common Internet File System (CIFS) aka Samba or SMB for making the Zombie technology list. This means of course that NAS in general is no longer considered an upstart or immature technology; rather it is being used and enhanced in many different directions.

PC: The personal computer was touted as killing off some of its Zombie technology list members including the IBM mainframe. With the advent of tablets, smart phones, virtual desktops infrastructures (VDI), the PC has been declared dead. My take is that while the IBM mainframe may eventually drop of the Zombie list in another decade or two if it finds something to do in retirement, the PC will be on the list for many years to come. Granted, the PC could live on even longer in the form of a virtual server where the majority of guest virtual machines (VMs) are in support of Windows based PC systems.

Printers: How long have we heard that printers are dead? The day that printers are dead is the day that the HP board of directors should really consider selling off that division.

RAID: Its been over twenty years since the first RAID white paper and early products appeared. Back in the 90s RAID was a popular buzzword and bandwagon topic however, people have moved on to new things. RAID has been on the Zombie technology list for several years now while it continues to find itself being deployed at the high end of the market down into consumer products. The technology continues to evolve in both hardware as well as software implementations on a local and distributed basis. Look for RAID to be on the Zombie list for at least the next couple of decades while it continues to evolve, after all, there is still room for RAID 7, RAID 8, RAID 9 not to mention moving into hexadecimal or double digit variants.

SAN: Storage Area Networks (SANs) have been declared dead and thus on the Zombie technology list before, and will be mentioned again well into the next decade. While the various technologies will continue to evolve, networking your servers to storage will also expand into different directions.

Tape: Magnetic tape has been on the Zombie technology list almost as long as the IBM mainframe and it is hard to predict which one will last longer. My opinion is that tape will outlast the IBM mainframe, as it will be needed to retrieve the instructions on how to de install those Zombie monsters. Tape has seen resurgence in vendors spending some marketing resources and to no surprise, there has been an increase in coverage about it being alive, even at Google. Rest assured, tape is very safe on the Zombie technology list for another decade or more. <<

Windows: Similar to the PC, Microsoft Windows has been touted in the past as causing other platforms to be dead, however has been added to the Zombie list for many years now. Given that Windows is the most commonly virtualized platform or guest VM, I think we will be hearing about Windows on the Zombie list for a few decades more. There are particular versions of Windows as with any technology that have gone into maintenance or sustainment mode or even discontinued.

Poll: What are the most popular Zombie technologies?

Keep in mind that a Zombie technology is one that is still in use, being developed or enhanced, sold usually at a profit and used typically in a productive way. In some cases, a declared dead or Zombie technology may only be just in its infancy getting started having either just climbed over the peak of hype or coming out of the trough of disillusionment. In other instance, the Zombie technology has been around for a long time yet continues to be used (or abused).

[polldaddy poll="5592038"]

Note: Zombie voting rules apply which means vote early, vote often, and of course vote for those who cannot include those that are dead (real or virtual).

Ok, nuff said, enough fun, lets get back to work, at least for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

The blame game: Does cloud storage result in data loss?

Tue, 18 Oct 2011 12:13:14 CST

The blame game: Does cloud storage result in data loss?

By Greg Schulz

I recently came across a piece by Carl Brooks over at IT Tech News Daily that caught my eye, title was Cloud Storage Often Results in Data Loss. The piece has an effective title (good for search engine: SEO optimization) as it stood out from many others I saw on that particular day.

What caught my eye on Carls piece is that it reads as if the facts based on a quick survey point to clouds resulting in data loss, as opposed to being an opinion that some cloud usage can result in data loss.

My opinion is that if not used properly including ignoring best practices, any form of data storage medium or media could result or be blamed for data loss. For some people they have lost data as a result of using cloud storage services just as other people have lost data or access to information on other storage mediums and solutions. For example, data has been lost on tape, Hard Disk Drives (HDDs), Solid State Devices (SSD), Hybrid HDDs (HHDD), RAID and non RAID, local and remote and even optical based storage systems large and small. In some cases, there have been errors or problems with the medium or media, in other cases storage systems have lost access to, or lost data due to hardware, firmware, software, or configuration including due to human error among other issues.

Technology failure: Not if, rather when and how to decrease impact
Any technology regardless of what it is or who it is from along with its architecture design and implementation can fail. It is not if, rather when and how gracefully along with what safeguards to decrease the impact, in addition to containing or isolating faults differentiates various products or solutions. How they automatically repair and self heal to keep running or support accessibility and maintain data integrity are important as is how those options are used. Granted a failure may not be technology related per say, rather something associated with human intervention, configuration, change management (or lack thereof) along with accidental or intentional activities.

Walking the talk
I have used public cloud storage services for several years including SaaS and AaaS as well as IaaS (See more XaaS here) and knock on wood, have not lost any data yet, loss of access sure, however not data being lost.

I follow my advice and best practices when selecting cloud providers looking for good value, service level agreements (SLAs) and service level objectives (SLOs) over low cost or for free services.

In the several years of using cloud based storage and services there has been some loss of access, however no loss of data. Those service disruptions or loss of access to data and services ranged from a few minutes to a little over an hour. In those scenarios, if I could not have waited for cloud storage to become accessible, I could have accessed a local copy if it were available.

Had a major disruption occurred where it would have been several days before I could gain access to that information, or if it were actually lost, I have a data insurance policy. That data insurance policy is part of my business continuance (BC) and disaster recovery (DR) strategy. My BC and DR strategy is a multi layered approach combining local, offline and offsite as along with online cloud data protection and archiving.

Assuming my cloud storage service could get data back to a given point (RPO) in a given amount of time (RTO), I have some options. One option is to wait for the service or information to become available again assuming a local copy is no longer valid or available. Another option is to start restoration from a master gold copy and then roll forward changes from the cloud services as that information becomes available. In other words, I am using cloud storage as another resource that is for both protecting what is local, as well as complimenting how I locally protect things.

Minimize or cut data loss or loss of access
Anything important should be protected locally and remotely meaning leveraging cloud and a master or gold backup copy.

To cut the cost of protecting information, I also leverage archives, which mean not all data gets protected the same. Important data is protected more often reducing RPO exposure and speed up RTO during restoration. Other data that is not as important is protected, however on a different frequency with other retention cycles, in other words, tiered data protection. By implementing tiered data protection, best practices, and various technologies including data footprint reduction (DFR) such as archive, compression, dedupe in addition to local disk to disk (D2D), disk to disk to cloud (D2D2C), along with routine copies to offline media (removable HDDs or RHDDs) that go offsite, Im able to stretch my data protection budget further. Not only is my data protection budget stretched further, I have more options to speed up RTO and better detail for recovery and enhanced RPOs.

If you are looking to avoid losing data, or loss of access, it is a simple equation in no particular order:

Strategy and design
Best practices and processes
Various technologies
Quality products
Robust service delivery
Configuration and implementation
SLO and SLA management metrics
People skill set and knowledge
Usage guidelines or terms of service (ToS)

Unfortunately, clouds like other technologies or solutions get a bad reputation or blamed when something goes wrong. Sometimes it is the technology or service that fails, other times it is a combination of errors that resulted in loss of access or lost data. With clouds as has been the case with other storage mediums and systems in the past, when something goes wrong and if it has been hyped, chances are it will become a target for blame or finger pointing vs. determining what went wrong so that it does not occur again. For example cloud storage has been hyped as easy to use, dont worry, just put your data there, you can get out of the business of managing storage as the cloud will do that magically for you behind the scenes.

The reality is that while cloud storage solutions can offload functions, someone is still responsible for making decisions on its usage and configuration that impact availability. What separates various providers is their ability to design in best practices, isolate and contain faults quickly, have resiliency integrated as part of a solution along with various SLAs aligned to what the service level you are expecting in an easy to use manner.

Does that mean the more you pay the more reliable and resilient a solution should be?
No, not necessarily, as there can still be risks including how the solution is used.

Does that mean low cost or for free solutions have the most risk?
No, not necessarily as it comes down to how you use or design around those options. In other words, while cloud storage services remove or mask complexity, it still comes down to how you are going to use a given service.

Shared responsibility for cloud (and non cloud) storage data protection
Anything important enough that you cannot afford to lose, or have quick access to should be protected in different locations and on various mediums. In other words, balance your risk. Cloud storage service provider toned to take responsibility to meet service expectations for a given SLA and SLOs that you agree to pay for (unless free).

As the customer you have the responsibility of following best practices supplied by the service provider including reading the ToS. Part of the responsibility as a customer or consumer is to understand what are the ToS, SLA and SLOs for a given level of service that you are using. As a customer or consumer, this means doing your homework to be ready as a smart educated buyer or consumer of cloud storage services.

If you are a vendor or value added reseller (VAR), your opportunity is to help customers with the acquisition process to make informed decision. For VARs and solution providers, this can mean up selling customers to a higher level of service by making them aware of the risk and reward benefits as opposed to focus on cost. After all, if a order taker at McDonalds can ask Would you like to super size your order, why cant you as a vendor or solution provider also have a value oriented up sell message.

Additional related links to read more and sources of information:

Poll: Who is responsible for cloud storage data loss?

[polldaddy poll="5588729"]

Taking action, what you should (or not) do
Dont be scared of clouds, however do your homework, be ready, look before you leap and follow best practices. Look into the service level agreements (SLAs) associated with a given cloud storage product or service. Follow best practices about how you or someone else will protect what data is put into the cloud.

For critical data or information, consider having a copy of that data in the cloud as well as at or in another place, which could be in a different cloud or local or offsite and offline. Keep in mind the theme for critical information and data is not if, rather when so what can be done to decrease the risk or impact of something happening, in other words, be ready.

Data put into the cloud can be lost, or, loss of access to it can occur for some amount of time just as happens with using non cloud storage such as tape, disk or ssd. What impacts or minimizes your risk of using traditional local or remote as well as cloud storage are the best practices, how configured, protected, secured and managed. Another consideration is the type and quality of the storage product or cloud service can have a big impact. Sure, a quality product or service can fail; however, you can also design and configure to decrease those impacts.

Wrap up
Bottom line, do not be scared of cloud storage, however be ready, do your homework, review best practices, understand benefits and caveats, risk and reward. For those who want to learn more about cloud storage (public, private and hybrid) along with data protection, data management, data footprint reduction among other related topics and best practices, I happen to know of some good resources. Those resources in addition to the links provided above are titled Cloud and Virtual Data Storage Networking (CRC Press) that you can learn more about here as well as find at Amazon among other venues. Also, check out Enterprise Systems Backup and Recovery: A Corporate Insurance Policy by Preston De Guise (aka twitter @backupbear ) which is a great resource for protecting data.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Commentary on Clouds, Storage, Networking, Green IT and other topics

Tue, 18 Oct 2011 12:13:14 CST

Commentary on Clouds, Storage, Networking, Green IT and other topics

By Greg Schulz

Rather than doing a bunch of separate posts, here is a collection of different perspectives and commentary on various IT and data storage industry activity.

In this link are comments and perspectives regarding thin provisioning including how it works as well as when to use it for optimizing storage space capacity. Speaking of server and storage capacity, here in this link are comments on what server and storage would be needed to support an SMB office of 50 people (or more, or less) along with how to back it up.

For those interested or in need of managing data and other records in this link are comments on preparing yourself for regulatory scrutiny.

Storage networking interface or protocol debates (battles) can be interesting, in this link, see the role of iSCSI SANs for data storage environments. Lets not forget about Fibre Channel over Ethernet (FCoE) which is discussed in this link and here in this link. Here in this link are comments about how integrated rackem, stackem and package bundles stack up. To support increased continued demand for managed service providers (MSP), cloud and hosted services providers are continuing to invest in their infrastructures, so read some comments here. While technology plays a role particular as it matures, there is another barrier to leveraging converged solutions and that is organizational, read some perspectives and thoughts here.

Storage optimization including data footprint reduction (DFR) can be used to cut costs as well as support growth. In this link see tips on reducing storage costs and additional perspectives in this link to do more with what you have. Here in this link are some wit and wisdom comments on the world of disaster recovery solutions. Meanwhile in this link are perspectives for choosing the right business continuity (BC) and disaster recovery (DR) consultant. In this link are comments on BC and DR including planning for virtualization and life beyond consolidation. Are disk based dedupe and virtual tape libraries a hold over for old backup, or a gateway to the future, see some perspectives on those topics and technologies in this link.

Here are some more comments on DR and BC leveraging the cloud while perspectives on various size organizations looking at clouds for backup in this piece here. What is the right local, cloud or hybrid backup for SMBs, check out some commentary here while viewing some perspectives on cloud disaster recovery here. Not to be forgotten, laptop data protection can also be a major headache however there are also many cures discussed in this piece here.

The Storage Networking Industry Association (SNIA) Green Storage Initiative (GSI) debut their Emerald power efficiency measurement specification recently, read some perspectives and comments in this link here. While we are on the topic of data center efficiency and effectiveness, here in this link are perspectives on micro servers or mini blade systems. Solution bundles also known as data center in a box or SAN in a CAN have been popular with solutions from EMC (vBlocks) and NetApp (FlexPods) among others, read perspectives on them in this link.

What would a conversation involving data storage and IT (particularly buzzword bingo) be without comments about Big Data and Big Bandwidth which you can read here.

Want to watch some videos, from Spring 2011 SNW, check out starting around the 15:00 to 55:00 time scale in this video from the Cube where various topics are discussed. Interested in how to scale data storage with clustered or scale up and out solutions, check out this video here or if you want to see some perspectives on data de duplication watch this clip.

Here is a video discussing SMBs as the current sweet spot for server virtualization with comments on the SMB virtualization dark side also discussed here. Meanwhile here are comments regarding EMC Flashy announcements from earlier this year on the Cube. Check out this video where I was a guest of Cali Lewis and John MacArthur on the Cube from the Dell Storage Forum discussing a range of topics as well as having some fun. Check out these videos and perspectives from VMworld 2011.

Whats your take on choosing the best SMB NAS? Here are some of my perspectives on choosing a SMB NAS storage system. Meanwhile here are some perspectives on enterprise class storage features finding their way into SMB NAS storage systems.

Meanwhile industry leaders EMC and NetApp have been busy enhancing their NAS storage solutions that you can read comments here.

Are you familiar with the Open Virtualization Alliance (OVA)? Here are some comments about OVA and other server virtualization topics.

Whats your take on Thunderbolt the new interconnect Apple is using in place of USB, here are my thoughts. Meanwhile various other tips and Ask the Expert (AtE) and discussion can be found here.

Check out the above links, as well view more perspectives, comments and news here, here, here, here and here.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Trick or treat: Have you seen any IT Frankenstacks

Tue, 18 Oct 2011 12:13:14 CST

Trick or treat: Have you seen any IT Frankenstacks

By Greg Schulz

Given that it is Halloween season, time for some fun.

Over the past couple of weeks various product and solution services announcements have been made that result in various articles, columns, blogs and commentary in support of them.

Ever wonder which if any of those products could actually be stitched together to work in a production environment without increasing the overall cost and complexity that they sometimes promote as their individual value proposition? Granted, many can and do work quite well when introduced into heterogeneous or existing environments with good interoperability. However what about those that look good on paper or in a webex or you tube video on their own, however may be challenged to be pieced together to work with others?

Hence in the spirit of halloween, the vision of a Frankenstack appeared.

A Frankenstack is a fictional environment where you piece various technologies from announcements or what you see or hear about in different venues into a solution.

Part of being a Frankenstack is that the various pieces may look interesting on their own, good luck trying to put them together on paper let alone in a real environment.

While I have not yet attempted to piece together any Frankenstacks lately, I can visualize various ones.

A Frankenstack could be based on what a vendor, VAR, or solution provider proposes or talks about.

A Frankenstack could also also be what a analyst, blogger, consultant, editor, pundit or writer pieces together in a story or recommendation.

Some Frankenstacks may be more synergistic and interoperable than others perhaps even working in a real customer environment.

Of course even if the pieces could be deployed, would you be able to afford them let alone support them (interoperability aside) without adding complexity?

You see a Frankenstack might look good on paper or on a slide deck, webex or via some other venue, however will it actually work or apply to your environment or are they just fun to talk about?

Dont get me wrong, I like hearing about new technology and products as much as anyone else, however lets have some fun with Frankenstacks and keep in perspective do they help or add complexity to your environment.

Ok, enough fun for now, let me know what you see or can put together in terms of Frankenstacks.

Keep in mind they dont actually have to work as that is what qualifies them for trick or treat and Frankenstack status.

Enjoy your Halloween season, do not be afraid, however be ready for some tricks and treats, its that time of the year.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Convergence: People, Processes, Policies and Products

Thu, 29 Sep 2011 12:44:55 CST

Convergence: People, Processes, Policies and Products

By Greg Schulz

Converged and dynamic infrastructures, cloud and virtual environments are popular themes and industry trends with different levels of adoption and deployment occurring. Although are you focusing on products, or the other Ps, that is people, processes and policies (or more here).

The reason I bring this up is quite often I hear discussions that are centered around the products (or services) providing various benefits, return on investment or cost saving opportunities.

Very little discussions are heard around whats being done or enabled by vendors and service providers, or what is being adopted by customers to tie in people, process and policy convergence.

Put another way, the discussions focus around the new technology or service while forgetting or assuming that the people, process and policies will naturally fall into place.

Will customer policies, process or procedures along with internal organizational (e.g. politics) issues with how people leverage those converged products also evolve?

I assert that while there are benefits that can be obtained from leveraging new enabling technologies (hardware, software, networks, services) their full potential will not be realized until policies, process, people skill sets and even more important, organizational or intradepartmental turf wars and boundaries are also addressed.

Converged family team

This does not mean consolidating different groups, rather it can mean thawing out relations between groups if there are challenges, establishing an abstraction or virtual layer, a virtual team to cut across different technology domains combing various skill sets, new best practices, policies and procedures in order to streamline management of physical and virtual resources.

Chuck Hollis (aka twitter @ChuckHollis) of EMC has an interesting blog post (here) that ties in the themes of different IT groups working or not having situational awareness that is worth a read. You can also read this Industry Trends and Perspective solution brief that I did earlier this year on the topic of Removing Organizational Barriers for Leveraging Technology Convergence.

Here are some additional related posts:

What is your organization doing (or have done) to enable convergence factoring in people, processes, policies and products or is it a non issue for you?

Ok, nuff said for now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Why VASA is important to have in your VMware CASA

Tue, 20 Sep 2011 18:36:15 CST

Why VASA is important to have in your VMware CASA

By Greg Schulz

Here is a link to a recent guest post that I was invited to do over at The virtualization Practice (TVP) pertaining to VMware vSphere V5.0 VASA.

This new post follows up on one that I did about a month ago pertaining to recent vSphere V5.0 storage and IO enhancements including Storage DRS (SDRS).

VMware vSphere Storage Aware API (VASA) is an Applications Programming Interface (API) that provides insight and awareness into supported storage systems configuration, current health, status and capabilities that can be used for enabling various management activities.

Practical Email optimization and archiving strategies

Sat, 17 Sep 2011 12:34:56 CST

Practical Email optimization and archiving strategies

By Greg Schulz

Email is a popular tool for messaging, calendaring, and managing contacts along with attachments in most organizations.

Given the popularity of email and diverse ways that it is used for managing various forms of unstructured data attachments including photos, video, audio, spreadsheets, presentations and other document objects, there are corresponding back end challenges. Those back end challenges including managing the data storage repositories (e.g. file systems and storage systems) that are used for preserving and serving email documents along with enabling regulatory or compliance mandates.

Email archiving is an important enabler for regulatory compliance and e-discovery functions. However there is another important use for E-mail archiving which as a data footprint reduction (DFR) technique and technology enables storage optimization, being green and supporting growth while stretching budgets further. There is after all no such thing as a data or information recession and all one has to do to verify the trend is to look at your own email activity.

There are however constraints on time, budgets and demands to do more while relying on more information and email has become a central tool for messaging including social media networking, handling of attachments and means to manage all of that data.

DFR enables more data to be stored, retained, managed and maintenance in a cost effective manner. This includes storing more data managed per person, where when the additional data being retained adds value to an organization. Also included is keeping more data readily accessible, not necessarily instantly accessible, however but within minutes instead of hours or days depending on service requirements.

Here is a link to a recent article that I did presenting five tips and strategies for optimizing e-mail using archiving.

Hopefully many of you will find these to be common sense tips being implemented, however if not, now is the time to take action to stretch your resources further to do more.

In general email optimization tips include:

Set policies for retention and disposal
Establish filters and rules
Index and organize your inbox
Archive messages regularly
Perform routine cleanup and optimization
Leverage cloud data protection services and solutions

When it comes to archiving projects, walk before you run, establish success to build upon for broader deployment of E-mail archiving by finding and address low hanging fruit opportunities.

Instead of trying to do to much, find opportunities that can be addressed and leveraged as examples to build business cases to move forward.

By having some success stories and proof points, these can be used to help convince management to support additional steps not to mention getting them to back your policies to achieve success.

An effective way to convince management these days is to show them how by taking additional Email archiving steps you can support increased growth demand, reduce costs while enhancing productivity not to mention adding compliance and ediscovery capabilities as side benefits.

You can read more here and here, ok, nuff said for now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

HDS buys BlueArc, any surprises here?

Thu, 8 Sep 2011 15:15:16 CST

HDS buys BlueArc, any surprises here?

By Greg Schulz

Technically here in the northern hemisphere it is still summer, so there is another summer wedding to announce.

The other day Hitachi Data Systems (aka HDS) announced that they finally tied the knot buying their Network Attached Storage (NAS) partner BlueArc whom they have been in a OEM premarital arrangement for the last five years or so (wow, was that a long engagement or what?). HDS being a subsidiary of Hitachi Ltd. a Japanese company it should be no surprise that they operate in a cool, calculated conservative manner with products that have over the past several decades been known for delivering resiliency, functionality, performance and value.

To those in the IT and specifically data storage industry, the only surprise about HDS buying BlueArc should be what took them so long to do so myself included. With unstructured data, big data, high performance computing, high productivity computing (aka HPC), and big bandwidth needs expanding, it only makes sense that HDS finally ties the knot formally acquiring BlueArc signaling what I hope are a few things for their collective future together.

Things that I hope HDS can accomplish with their acquisition of BlueArc include among others:

Leverage the BlueArc hardware and performance combine with the HDS software suite to expand further upstream (and downstream) as well as into different adjacent markets leveraging their success over the long courtship where both parties got to know each other more.
Signal to the industry that they are truly committed to a long term NAS product solution strategy. HDS has been doing a good job of sticking with BlueArc for the past five or so years having had several previous NAS partner relationships including with NetApp, NSS and others besides their own internal projects.
Expand their focus to lead with NAS pulling storage with it in addition to using NAS to accessorize (or bling aka Mr. T starter kit to go with Mr. T storage videos) storage systems which means of course, going more direct toe to toe with the likes of former partner NetApp, EMC, HP (with IBRIX), IBM and Dell among many others. Ironically former HDS partner NetApp acquired the Engenio storage group from LSI whose products competed with HDS in some spaces, while BlueArc was a Engenio partner.
Continue to develop both the hardware and software feature functionality around the BlueArc products in addition to further integration across the joint product lines for both traditional, as well as clustered, scale out, bulk, big data, big bandwidth and HPC environments.
Sharpen their NAS message and solution offerings including providing the support, tools and programs to enable both their joint direct sales forces as well as their partner value added reseller (VAR) and channel networks.

Check out (here) some additional comments and perspectives by Ray Lucchesi (aka twitter @raylucchesi) over on his blog pertaining to HDS buying BlueArc.

Congratulations to both HDS and BlueArc along with best wishes, this is a deal that is good for both, now, or once the honeymoon is over, lets see how this is executed upon building on their prior joint success to expand into new market opportunities on a global basis. HDS has tools and people to move into and leverage these new as well as existing opportunities, lets see how they can execute on those hopefully not spending too much time or money on the honeymoon while their competitors are out being busy in some of those same accounts in this last month of an important sales quarter (all quarters are important when it comes to sales).

Disclosure for those interested and FWIW: BlueArc had been a client of StorageIO a few years ago, however not currently. HDS is not nor have they been a client of StorageIO, however in prior life I was a customer of theirs in addition to being a partner and supplier when I was on the vendor side of the table.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Check out these top 50 IT blogs

Thu, 8 Sep 2011 14:15:16 CST

Check out these top 50 IT blogs

By Greg Schulz

The other day I saw something come in via the net about a top 50 IT blog list from Biztech Magazine, so being curious I clicked on the link (after making sure that it was safe).

To my surprise, I saw my blog (aka Gregs StorageIOblog) listed near the top (they sorted by blog name order) of the top 50 IT blog sites that they listed.

Im honored to have been included in such an esteemed and diverse list of blogs spanning various technologies, topics and IT focus areas.

Congratulations to all that made the list as well as others blogs that you will want to add to your reading lists including those mentioned over on Calvin Zitos (aka @hpstorageguy) blog.

Check out the top 50 IT blog list here.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Cloud and Virtual Data Storage Networking book released

Wed, 7 Sep 2011 13:14:15 CST

Cloud and Virtual Data Storage Networking book released

By Greg Schulz

Ok, its now official, following its debut at the VMworld 2011 book store last week in Las Vegas, my new book Cloud and Virtual Data Storage Networking (CRC Press) is now formally released with general availability announced today along with companion material located at http://storageio.com/book3.html including the Cloud and Virtual Data Storage Networking LinkedIn group page launched a few months ago. Cloud and Virtual Data Storage Networking (CVDSN) a 370 page hard cover print is my third solo book that follows The Green and Virtual Data Center (CRC Press 2009) and Resilient Storage Networks (Elsevier 2004).

CVDSN book was on display at VMworld 2011 book store last week along with a new book by Duncan Epping (aka @DuncanYB ) and Frank Denneman (aka @frankdenneman ) titled VMware vSphere 5 Clustering Technical Deepdive. You can get your copy of Duncan and Franks new book on Amazon here.

Here is a photo of me on the left visiting an VMworld 2011 attendee in the VMworld book store.

Whats inside the book, theme and topics covered

When it comes to clouds, virtualization, converged and dynamic infrastructures Dont be scared however do look before you leap to be be prepared including doing your homework.

What this means is that you should do your homework, prepare, learn, and get involved with proof of concepts (POCs) and training to build the momentum and success to continue an ongoing IT journey. Identify where clouds, virtualization and data storage networking technologies and techniques compliment and enable your journey to efficient, effective and productive optimized IT services delivery.

There is no such thing as a data or information recession: Do more with what you have

A common challenge in many organizations is exploding data growth along with associated management tasks and constraints, including budgets, staffing, time, physical facilities, floor space, and power and cooling. IT clouds and dynamic infrastructure environments enable flexible, efficient and optimized, cost-effective and productive services delivery. The amount of data being generated, processed, and stored continues to grow, a trend that does not appear to be changing in the future. Even during the recent economic crisis, there has been no slow down or information recession. Instead, the need to process, move, and store data has only increased, in fact both people and data are living longer. CVDSN presents options, technologies, best practices and strategies for enabling IT organizations looking to do more with what they have while supporting growth along with new services without compromising on cost or QoS delivery (see figure below). Driving Return on Innovation the new ROI: Doing more, reducing costs while boosting productivity

Expanding focus from efficiency and optimization to effectiveness and productivity

A primary tenant of a cloud and virtualized environment is to support growing demand in a cost-effective manner with increased agility without compromising QoS. By removing complexity and enabling agility, information services can be delivered in a timely manner to meet changing business needs.

There are many types of information services delivery model options

Various types of information services delivery modes should be combined to meet various needs and requirements. These complimentary service delivery options and descriptive terms include cloud, virtual and data storage network enabled environments. These include dynamic Infrastructure, Public & Private and Hybrid Cloud, abstracted, multi-tenant, capacity on demand, Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS) among others.

Convergence combing different technology domains and skill sets

Components of a cloud and virtual environment include desktop, servers, and storage, networking, hardware, and software, services along with APIs and software stacks. This include virtual and physical desktops, data, voice and storage networks, LANs, SANs, MANs, WANs, faster blade and rack servers with more memory, SSD and high-capacity storage and associated virtualization tools and management software. True convergence combines leveraging technology and people, processes and best practices aligned to make the most of those resources to deliver cost effective services delivery.

Best people, processes, practices and products (the four Ps)

Bringing all of the various components together is the Ps (people skill sets, process, practices and products). This means leveraging and enhancing people skill sets and experience, process and procedures to optimize workflow for streamlined service orchestration, practices and policies to be more effectively reducing waste without causing new bottlenecks, and products such as racks, stacks, hardware, software, and managed or cloud services.

Service categories and catalogs, templates SLO and SLA alignment

Establishing service categories aligned to known service levels and costs enables resources to be aligned to applicable SLO and SLA requirements. Leveraging service templates and defined policies can enable automation and rapid provisioning of resources including self service requests.

Navigating to effective IT services delivery: Metrics, measurements and E2E management

You cannot effectively manage what you do not know about; likewise, without situational awareness or navigation tools, you are flying blind. E2E (End to End) tools can provide monitoring and usage metrics for reporting and accounting, including enabling comparison with other environments. Metrics include customer service satisfaction, SLO and SLAs, QoS, performance, availability and costs to service delivered.

The importance of data protection for virtual, cloud and physical environments

Clouds and virtualization are important tools and technologies for protecting existing consolidated or converged as well as traditional environments. Likewise, virtual and cloud environments or data placed there also need to be protected. Now is the time to rethink and modernize your data protection strategy to be more effective, protecting, preserving and serving more data for longer periods of time with less complexity and cost.

Packing smart and effectively for your journey: Data footprint reduction (DFR)

Reducing your data footprint impact leveraging data footprint reduction (DFR) techniques, technologies and best practices is important for enabling an optimized, efficient and effective IT services delivery environment. Reducing your data footprint is enabled with clouds and virtualization providing a means and mechanism for archiving inactive data and for transparently moving it. On the other hand, moving to a cloud and virtualized environment to do more with what you have is enhanced by reducing the impact of your data footprint. The ABCDs of data footprint reduction include Archiving, Backup modernization, Compression and consolidation, Data management and dedupe along with Storage tiering and thin provisioning among other techniques.

How the book is laid out:

Table of content (TOC)
How the book is organized and who should read it
Preface
Section I: Why the need for cloud, virtualization and data storage networks
Chapter 1: Industry trends and perspectives: From issues and challenges to opportunities
Chapter 2: Cloud, virtualization and data storage networking fundamentals
Section II: Managing data and resources: Protect, preserve, secure and serve
Chapter 3: Infrastructure Resource Management (IRM)
Chapter 4: Data and storage networking security
Chapter 5: Data protection (Backup/Restore, BC and DR)
Chapter 6: Metrics and measurement for situational awareness
Section III: Technology, tools and solution options
Chapter 7: Data footprint reduction: Enabling cost effective data demand growth
Chapter 8: Enabling data footprint reduction: Storage capacity optimization
Chapter 9: Storage services and systems
Chapter 10: Server virtualization
Chapter 11: Connectivity: Networking with your servers and storage
Chapter 12: Cloud and solution packages
Chapter 13: Management and tools
Section IV: Putting IT all together
Chapter 14: Applying what you have learned
Chapter 15: Wrap up, whats next and book summary
Appendices:
Where to Learn More
Index and Glossary

Here is the release that went out via Business Wire (aka Bizwire) earlier today.

Industry Veteran Greg Schulz of StorageIO Reveals Latest IT Strategies in Cloud and Virtual Data Storage Networking Book
StorageIO Founder Launches the Definitive Book for Enabling Cloud, Virtualized, Dynamic, and Converged Infrastructures

Stillwater, Minnesota – September 7, 2011 – The Server and StorageIO Group (www.storageio.com), a leading independent IT industry advisory and consultancy firm, in conjunction with publisher CRC Press, a Taylor and Francis imprint, today announced the release of “Cloud and Virtual Data Storage Networking,” a new book by Greg Schulz, noted author and StorageIO founder. The book examines strategies for the design, implementation, and management of hardware, software, and services technologies that enable the most advanced, dynamic, and flexible cloud and virtual environments.

The book supplies real-world perspectives, tips, recommendations, figures, and diagrams on creating an efficient, flexible and optimized IT service delivery infrastructures to support demand without compromising quality of service (QoS) in a cost-effective manner. “Cloud and Virtual Data Storage Networking” looks at converging IT resources and management technologies to facilitate efficient and effective delivery of information services, including enabling information factories. Schulz guides readers of all experience levels through various technologies and techniques available to them for enabling efficient information services.

Topics covered in the book include:

Information services model options and best practices
Metrics for efficient E2E IT management and measurement
Server, storage, I/O networking, and data center virtualization
Converged and cloud storage services (IaaS, PaaS, SaaS)
Public, private, and hybrid cloud and managed services
Data protection for virtual, cloud, and physical environments
Data footprint reduction (archive, backup modernization, compression, dedupe)
High availability, business continuance (BC), and disaster recovery (DR)
Performance, availability and capacity optimization

This book explains when, where, with what, and how to leverage cloud, virtual, and data storage networking as part of an IT infrastructure today and in the future. “Cloud and Virtual Data Storage Networking” comprehensively covers IT data storage networking infrastructures, including public, private and hybrid cloud, managed services, virtualization, and traditional IT environments.

“With all the chatter in the market about cloud storage and how it can solve all your problems, the industry needed a clear breakdown of the facts and how to use cloud storage effectively. Greg's latest book does exactly that,” said Greg Brunton of EDS, an HP company.

Click here to listen and watch Schulz discuss his new book in this video.

About the Book

Cloud and Virtual Data Storage Networking has 370 pages, with more than 100 figures and tables, 15 chapters plus appendices, as well as a glossary. CRC Press catalog number K12375, ISBN10: 1439851735, ISBN13: 9781439851739, publication September 2011. The hard cover book can be purchased now at global venues including Amazon, Barnes and Noble, Digital Guru and CRCPress.com. Companion material is located at http://storageio.com/book3.html including images, additional information, supporting site links at CRC Press, LinkedIn Cloud and Virtual Data Storage Networking group, and other books by the author. Direct book editorial review inquiries to John Wyzalek of CRC Press at john.wyzalek@taylorfrancis.com (twitter @jwyzalek) or +1 (917) 351-7149. For bulk and special orders contact Chris Manion of CRC Press at chris.manion@taylorandfrancis.com or +1 (561) 998-2508. For custom, derivative works and excerpts, contact StorageIO at info@storageio.com.

About the Author

Greg Schulz is the founder of the independent IT industry advisory firm StorageIO. Before forming StorageIO, Schulz worked for several vendors in systems engineering, sales, and marketing technologist roles. In addition to having been an analyst, vendor and VAR, Schulz also gained real world hands on experience working in IT organizations across different industry sectors. His IT customer experience spans systems development, systems administrator, disaster recovery consultant, and capacity planner across different technology domains, including servers, storage, I/O networking hardware, software and services. Today, in addition to his analyst and research duties, Schulz is a prolific writer, blogger, and sought-after speaker, sharing his expertise with worldwide technology manufacturers and resellers, IT users, and members of the media. With an insightful and thought-provoking style, Schulz is also author of the books “The Green and Virtual Data Center” (CRC Press, 2009) which is on the Intel developers recommended reading list and the SNIA-endorsed reading book “Resilient Storage Networks: Designing Flexible Scalable Data Infrastructures” (Elsevier, 2004). Schulz is available for interviews and commentary, briefings, speaking engagements at conferences and private events, webinars, video and podcast along with custom advisory consultation sessions. Learn more at http://storageio.com.

End of press release.

Wrap up

I want to express thanks to all of those involved with the project that spanned over the past year.

Stayed tuned for more news and updates pertaining to Cloud and Virtual Data Storage Networking along with related material including upcoming events as well as chapter excerpts. Speaking of events, here is information on an upcoming workshop seminar that I will be involved with for IT storage and networking professionals to be held October 4th and 5th in the Netherlands.

You can get your copy now at global venues including Amazon, Barnes and Noble, Digital Guru and CRCPress.com.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

StorageIO going Dutch again: October 2011 Seminar for storage professionals

Tue, 6 Sep 2011 22:11:22 CST

StorageIO going Dutch again: October 2011 Seminar for storage professionals

By Greg Schulz

Greg Schulz of StorageIO in conjunction with or dutch partner Brouwer Storage Consultancy will be presenting a two day workshop seminar for IT storage, virtualization, and networking professionals Monday 3rd and Tuesday 4th of October 2011 at Ampt van Nijkerk Netherlands.

This two day interactive education seminar for storage professionals will focus on current data and storage networking trends, technology and business challenges along with available technologies and solutions. During the seminar learn what technologies and management techniques are available, how different vendors solutions compare and what to use when and where. This seminar digs into the various IT tools, techniques, technologies and best practices for enabling an efficient, effective, flexible, scalable and resilient data infrastructure.

The format of this two workshop seminar will be a mix of presentation and interactive discussion allowing attendees plenty of time to discuss among themselves and with seminar presenters. Attendees will gain insight into how to compare and contrast various technologies and solutions in addition to identifying and aligning those solutions to their specific issues, challenges and requirements.

Major themes that will be discussed include:

Who is doing what with various storage solutions and tools
Is RAID still relevant for today and tomorrow
Are hard disk drives and tape finally dead at the hands of SSD and clouds
What am I routinely hearing, seeing or being asked to comment on
Enabling storage optimization, efficiency and effectiveness (performance and capacity)
Opportunities for leveraging various technologies, techniques,trends
Supporting virtual servers including re-architecting data protection
How to modernize data protection (backup/restore, BC, DR, replication, snapshots)
Data footprint reduction (DFR) including archive, compression and dedupe
Clarifying cloud confusion, dont be scared, however look before you leap
Big data, big bandwidth and virtual desktop infrastructures (VDI)

In addition this two day seminar will look at what are some new and improved technologies and techniques, who is doing what along with discussions around industry and vendor activity including mergers and acquisitions. In addition to seminar handout materials, attendees will also receive a copy Cloud and Virtual Data Storage Networking (CRC Press) by Greg Schulz that looks at enabling efficient, optimized and effective information services delivery across cloud, virtual and traditional environments.

Buzzwords and topic themes to be discussed among others include E2E, FCoE and DCB, CNAs, SAS, I/O virtualization, server and storage virtualization, public and private cloud, Dynamic Infrastructures, VDI, RAID and advanced data protection options, SSD, flash, SAN, DAS and NAS, object storage, big data and big bandwidth, backup, BC, DR, application optimized or aware storage, open storage, scale out storage solutions, federated management, metrics and measurements, performance and capacity, data movement and migration, storage tiering, data protection modernization, SRA and SRM, data footprint reduction (archive, compress, dedupe), unified and multi-protocol storage, solution bundle and stacks.

For more information or to register contact Brouwer Storage Consultancy

Brouwer Storage Consultancy
Olevoortseweg 43
3861 MH Nijkerk
The Netherlands
Telephone: +31-33-246-6825
Cell: +31-652-601-309
Fax: +31-33-245-8956
Email: info@brouwerconsultancy.com
Web: www.brouwerconsultancy.com

Learn about other events involving Greg Schulz and StorageIO at www.storageio.com/events

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Cloud and Virtual Data Storage Networking book VMworld 2011 debut

Wed, 24 Aug 2011 18:17:16 CST

Cloud and Virtual Data Storage Networking book VMworld 2011 debut

By Greg Schulz

Following up from a previous preview post about my new book Cloud and Virtual Data Storage Networking (CRC Press) for those for those attending VMworld 2011 in Las Vegas Monday August 29 through Thursday September 1st 2011, you can pick up your copy at the VMworld book store.

Book signing at VMworld 2011

On Tuesday August 30 at 1PM local time, I will be at the VMworld store signing books. Stop by the book store and say hello, pickup your copy of Cloud and Virtual Data Storage Networking (CRC Press). Also check out the other new releases by fellow vExpert authors during the event. I have also heard rumors that some exhibitors among others will be doing drawings, so keep an eye out in the expo hall and go visit those showing copies of my new book.

The VMworld book store hours are:

Monday 8:30am to 7:30pm
Tuesday 8:30am to 6:00pm
Wednesday 8:30am to 8:00pm
Thursday 8:00am to 2:00pm

For those not attending VMworld 2011, you can order your copy from different venues including Amazon.com, Barnes and Noble, DigitalGuru and CRC Press among others.

Learn more about Cloud and Virtual Data Storage Networking (CRC Press) at http://storageio.com/book3.html

Look forward to seeing you at the various VMworld events in Las Vegas as well as at other upcoming venues.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

2011 Summer momentus hybrid hard disk drive (HHDD) moment

Wed, 24 Aug 2011 16:13:12 CST

2011 Summer momentus hybrid hard disk drive (HHDD) moment

By Greg Schulz

This is the fourth in a series of posts (others are here, here and here) that I have been doing for over a year now taking a moment now and then to share some of my experiences with using hybrid hard disk drives (HHDD) along side my hard disk drives (HDD) and solid state drives (SSD).

It has been a several months now since applying the latest firmware (SD25) which resulted in even better stability that was further enhanced when upgrading a few months ago to Windows 7 on all systems with the Seagate Momentus XT HHDD installed in them. One additional older system was recently upgraded from a slower, lower capacity 3.5 inch form factor SATA HDD to a physically smaller 2.5 inch HHDD. The net result is that system now boots in a fraction of the time, shuts down faster, work on it is much more productive and capacity was increased by three and half times.

Why use an HHDD when you could get an SSD?

With flash SSD devices continuing to become more affordable for a given price capacity point, why did I not simply install some of those devices instead of using the HHDDs?

With the money saved from buying the 500GB Momentus XT on Amazon.com (under $100 USD) vs. buying a smaller capacity SSD, I was also able to double the amount of DRAM in that system furthering its useful life plus buying some time to decide what to replace it with while having extra funds for other projects.

Sure I would like to have more and larger capacity SSDs to go along with those I already have, however there is balancing budget with needs and improving productivity (needs vs. wants).

To expand more on why the HHDD at this time vs. SSD, want some more SSD devices to coexist with those I already have and use for different functions. Looking to stretch my budget further, the HHDDs are a great balance of being almost and in some cases as fast as SSDs while at the cost of a high capacity HDD. In other words Im getting the best of both worlds which is a 7,200 RPM 2.5 inch 500GB HDD (e.g. for space capacity) that has 4GB of single layer cell (SLC) flash (e.g. SSD) and 32MB of DRAM as buffers (for read and write performance) to help speed up read and write operations.

Given for what Im using them for, I do not need the consistent higher performance of an SSD across all of my data which brings up the other benefit, Im able to retain more data on the device as a buffer or cache instead of having to go to a NAS or other storage repository to get it. Even though the amount of data being stored on the HHDD is increasing, not all of it gets backed up locally or to my cloud provider as there is already a copy(s) elsewhere. Instead, a small subset of data that is changing or very important gets routinely protected locally and remotely to the cloud enabling easier and faster restores when needed. Now if you have a large budget or someone is willing to buy or give you one, sure, go ahead and get one of the high capacity SSDs (preferably SLC based if concerned about endurance) however there are some good MLC ones out there as well.

Step back a bit, what is an HHDD?

Hybrid hard disk drives (HHDDs) such as the Seagate Momentus XT are, as their name implies, a combination of large- to medium-capacity HDDs with FLASH SSDs. The result is a mix of performance and capacity in a cost effective footprint. HHDDs have not seen much penetration in the enterprise space and may not see much more, given how many vendors are investing in the firmware and associated software technology to achieve hybrid results using a mix of SSDs and high capacity disk drives along with the lack of awarness that they exist.

Where HHDDs could have some additional traction is in secondary or near-line solutions that need some performance enhancements while having a large amount of capacity in a cost-effective footprint. For now, HHDDs are appearing mainly in desktops, laptops, and workstations that need lots of capacity with some performance but without the high price of SSDs. Before I installed the HHDDs in my laptops, I initially used one as a backup and data movement device, and I found that large, gigabyte-sized files could be transferred as fast as with SSDs and much faster than via my WiFi based network and NAS. The easiest way to characterize where HHDDs fit is where you want an SSD for performance, but your applications do not always need speed and you need a large amount of storage capacity at an affordable price.

SSDs are part of the future, however HDDs have a lot of life in them including increased capacities, both are best used where their strengths can be maximized, thus HHDDs are a great compliment or stepping stone for some applications. Note, Seagate recently announced that they have shipped over one million HHDDs in just over a years time.

I do find it interesting though when I hear from those who claim that the HDD is dead and that SSD is the future yet they do not have SSDs in their systems let alone do they have or talk about HHDDs, hmmmm.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Supporting IT growth demand during economic uncertain times

Wed, 24 Aug 2011 14:13:12 CST

Supporting IT growth demand during economic uncertain times

By Greg Schulz

Doing more with less, doing more with what you have or reducing cost have been the mantra for the past several years now.

Does that mean as a trend, they are being adopted as the new way of doing business, or simply a cycle or temporary situation?

Reality is that many if not most IT organizations are and will remain under pressure to stretch their budgets further for the immediate future. Over the past year or two some organizations saw increases in their budgets however also increased demand while others saw budgets fixed or reduced while having to support growth. On the other hand, there is no such thing as an information recession with more data being generated, moved, processed, stored and retained for longer periods of time.

Something has to give as shown in the following figure which is that on one curve there is continued demand and growth, while another curve shows need to reduce costs while another reflects the importance of maintaining or enhancing service level objectives (SLOs) and quality of service (QoS).

One way to reduce costs is to inhibit growth while another is to support growth by sacrificing QoS including performance, response time or availability as a result of over consolidation, excessive utilization or instability as a result of stretching resources to far. Where innovation comes into play is finding and fixing problems vs. moving or masking them or treating symptoms vs. the real issue and challenge. Innovation also comes into play by identifying both near term tactical as well as longer term strategic means of taking complexity and cost out of service delivery and the resources needed to support them. For example determining the different resources and processes involved in delivering an email box of a given size and reliability. Another being supporting a virtual machine (VM) with a given performance and capacity capability. Yet another scenario is a file share or home directory of a specific size and availability. By streamlining work flows, leveraging automation and other tools to enforce policies as well as adopting new best practices complexity and thereby costs can be reduced. The net rest is a lower cost to provide a given service to a specific level which when multiplied out over many users or instances, results in cost savings however also productivity gains.

The above is all good and well for longer term strategic and where you want to go or get to, however what can be done right now today?

Here are a few tips to do more with what you have while supporting growth demands

If you have service level agreements (SLAs) and SLOs as part of your service category, review with your users as to what they need vs. what they would like to have. What you may find is that your users want or expect a given level of service, yet would be happy and ok with moving to a cloud service that had lower SLO and SLA expectations if lower cost. The previous scenario would be an indicator that you users want and thus you give them a higher level of service, yet their requirements are actually lower than what is expected. On the other hand if you do not have SLOs and SLAs aligned with cost for the services then set them up and review customer or client expectations, needs vs. wants on a regular basis. You might find out that you can stretch your budget by delivering a lower (or higher) class of services to meet different users requirements than what was assumed to be the case. In the case of supporting a better class of service, if you can use an SSD enabled solution to reduce latency or wait times and boost productivity, more transactions or page views or revenue per hour, that could prompt a client to request that capability to meet their business needs.

Reduce your data footprint impact in order to support growth using the ABCDs of data footprint reduction (DFR), that is Archive (email, file, database), Backup modernization, Compression and consolidation, Data management and dedupe, storage tiering among other techniques.

Storage, server virtualization and optimization using capacity consolidation where practical and IO consolidation to fast storage and SSD where possible. Also review storage configuration including RAID and allocation to identity if any relatively easy changes can improve performance, availability, capacity and energy impact.

Investigate available upgrades and enhancements to your existing hardware, software and services that can be applied to provide breathing room within current budgets while evaluating new technologies.

Find and fix problems vs. chasing false positives that provide near term relief only to have the real issue reappear. Maximize your budgets by identifying where people time and other resources are being spent due to processes, work flows, technology configuration complexity or bottlenecks and address those.

Enhance and leverage existing management measurements to gain more insight along with implementing new metrics for End to End (E2E) situational awareness of your environment which will enable effective decision making. For example you may be told to move some function to the cloud as it will be cheaper, yet if you do not have metrics to indicate one way or the other, how can that be an informed decision? If you have metrics that show your cost for the same service being moved to a cloud or managed service provider as well as QoS, SLO, SLA, RTO, RPO and other TLAs, then you can make informed decisions. That decision may still be to move functions to a cloud or other service even if in fact it is more expensive compared to what you can provide it for in order that your resources can be directed to supporting other important internal functions.

Look for ways to reduce cost of a service delivered as opposed to simply cutting costs. They sound like one and the same, however if you have metrics and measurements providing situational awareness to know what the cost of a service is, you can also then look at how to streamline those services, remove complexity, reduce workflow, leverage automation there by removing cost. The goal is the same, however how you go about removing cost can have an impact on your return on innovation not to mention customer satisfaction.

Also be an informed shopper, have a forecast or plan on what you will need and when, along with what you must have (core requirements) vs. what you would like to have or want. When looking at options, balance what is needed and then if you can get what you want or would like for little or no extra cost if they add value or enable other initiatives. Part of being an informed shopper is having support of the business to be able to procure what you want or need which means aligning technology resources and their cost to delivery of business functions and services.

What you need vs. what you want
In a recent interview with the AP) the reporter wanted to know my comments about spending vs. saving during economic tough times (you can read the story here). Basically my comments were to spend within your means by identifying what you need vs. what you want, what is required to keep the business running or improve productivity and remove cost as opposed to acquiring nice to have things that can wait. Sure I would like to have a new 85 to 120" 3D monitor for my workstation that could double as a TV, however I do not need or require it.

On the other hand, I recently upgraded an existing workstation adding a Hybrid Hard Disk Drive (HHDD) and some additional memory, about a $200USD investment that is already paying for itself via increased productivity. That is instead of enjoying a cup of dunkin donut coffee while waiting for some tasks to complete on that system, Im able to get more done in a given amount of time boosting productivity.

For IT environments this means looking at expenditures to determine what is needed or required to keep things running while supporting near term strategic and tactical initiatives or pet projects.

For vendors and vars, if things have not been a challenge yet, now they will need to refine their messages to show more value, return on innovation (ROI) in terms of how to help their customers or prospects stretch resources (budgets, people, skill sets, products, services, licenses, power and cooling, floor space) further to support growth, while removing costs without compromising on service delivery. This also means a shift in thinking of short term or tactical cost cutting to longer term strategic approaches of reducing costs to deliver a service or resources.

Related links pertaining to stretching your resources, doing more with what you have, increasing productivity and maximizing your budget to support growth without compromising on customer service.

Saving Money with Green IT: Time To Invest In Information Factories
Storage Efficiency and Optimization: The Other Green
Shifting from energy avoidance to energy efficiency
Saving Money with Green Data Storage Technology
Green IT Confusion Continues, Opportunities Missed!
Storage Efficiency and Optimization: The Other Green
PUE, Are you Managing Power, Energy or Productivity?
Cloud and Virtual Data Storage Networking
Is There a Data and I/O Activity Recession?
More Data Footprint Reduction (DFR) Material

What is your take?

Are you and your company going into a spending freeze mode, or are you still spending, however placing or having constraints put on discretionary spending?

How are you stretching your IT budget to go further?

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

VMware vSphere v5 and Storage DRS

Wed, 10 Aug 2011 14:13:12 CST

VMware vSphere v5 and Storage DRS

By Greg Schulz

Here is a link to a recent guest post that I was invited to do over at The Virtualization Practice (TVP) pertaining to the recent VMware vSphere 5.0 announcement. A theme of the vSphere 5.0 launch is reducing complexity, enabling automation, and supporting scaling with confidence for cloud and virtual environments. As a key component for supporting cloud, virtual and dynamic infrastructure environments, vSphere V5.0 includes many storage related enhancements and new features including Storage Distributed Resource Scheduler (SDRS).

Measuring Windows performance impact for VDI planning

Wed, 10 Aug 2011 14:13:12 CST

Measuring Windows performance impact for VDI planning

By Greg Schulz

Here is a link to a recent guest post that I was invited to do over at The Virtualization Practice (TVP) pertaining to measuring the impact of Windows Boot performance and what that means for planning for Virtual Desktop Infrastructure (VDI) initiatives.

With Virtual Desktop Infrastructures (VDI) initiatives adoption being a popular theme associated with cloud and dynamic infrastructure environments a related discussion point is the impact on networks, servers and storage during boot or startup activity to avoid bottlenecks. VDI solution vendors include Citrix, Microsoft and VMware along with various server, storage, networking and management tools vendors.

A common storage and network related topic involving VDI are boot storms when many workstations or desktops all startup at the same time. However any discussion around VDI and its impact on networks, servers and storage should also be expanded from read centric boots to write intensive shutdown or maintenance activity as well.

Having an understanding of what your performance requirements are is important to adequately design a configuration that will meet your Quality of Service (QoS) and service level objectives (SLOs) for VDI deployment in addition to knowing what to look for in candidate server, storage and networking technologies. For example, knowing how your different desktop applications and workloads perform on a normal basis provides a baseline to compare with during busy periods or times of trouble. Another benefit is that when shopping for example storage systems and reviewing various benchmarks, knowing what your actual performance and application characteristics are helps to align the applicable technology to your QoS and SLO needs while avoiding apples to oranges benchmark comparisons.

Check out the entire piece including some test results using the hIOmon tool from hyperIO to gather actual workstation performance numbers.

Keep in mind that the best benchmark is your actual applications running as close to possible to their typical workload and usage scenarios.

Also keep in mind that fast workstations need fast networks, fast servers and fast storage.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Getting SASy, the other shared storage option for disk and SSD systems

Wed, 10 Aug 2011 14:13:12 CST

Getting SASy, the other shared storage option for disk and SSD systems

By Greg Schulz

Here is a link to a recent guest post that I was invited to do over at The Virtualization Practice (TVP) pertaining to Getting SASsy, the other shared server to storage interconnect for disk and SSD systems. Serial Attached SCSI (SAS) is better known as an interface for connecting hard disk drives (HDD) to servers and storage systems; however it is also widely used for attaching storage systems to physical as well as virtual servers. An important storage requirement for virtual machine (VM) environments with more than one physical machine (PM) server is shared storage. SAS has become a viable interconnect along with other Storage Area Network (SAN) interfaces including Fibre Channel (FC), Fibre Channel over Ethernet (FCoE) and iSCSI for block access.

Industry trend: People plus data are aging and living longer

Thu, 04 Aug 2011 14:15:16 CST

Industry trend: People plus data are aging and living longer

By Greg Schulz

Lets face it, people and information are living longer and thus there are more of each along with a strong interdependency by both.

People living and data being retained longer should not be a surprise, take a step back and look at the bigger picture. There is no such thing as an information recession with more data being generated, processed, moved and stored for longer periods of time not to mention that a data object is also getting larger.

By data objects getting larger, think about a digital photo taken on a typical camera ten years ago which whose resolution was lower and thus its file size would have been measured in kilo bytes (thousands). Today megapixel resolutions are common from cell phones, smart phones, PDAs and even larger with more robust digital and high definition (HD) still and video cameras. This means that a photo of the same object that resulted in a file of hundreds of Kbytes ten years ago would be measured in Megabytes today. With three dimensional (3D) cameras appearing along with higher resolution, you do not need to be a rocket scientist or industry pundit to figure out what that growth trend trajectory looks like.

However it is not just the size of the data that is getting larger, there are also more instances along with copies of those files, photos, videos and other objects being created, stored and retained. Similar to data, there are more people now than ten years ago and some of those have also grown larger, or at least around the waistline. This means that more people are creating and relying on larger amounts of information being available or accessible when and where needed. As people grow older, the amount of data that they generate will naturally increase as will the information that they consume and rely upon.

Where things get interesting is that looking back in history, that is more than ten or even a hundred years, the trend is that there are more people, they are living longer, and they are generating larger amounts of data that is taking on new value or meaning. Heck you can even go back from hundreds to thousands of years and see early forms of data archiving and storage with drawings on walls of caves or other venues. I Wonder if had the cost (and ease of use) to store and keep data had been lower back than would there have been more information saved? Or was it a case of being too difficult to use the then state of art data and information storage medium combined with limited capacities so they simply ran out of storage and retention mediums (e.g. walls and ceilings)?

Lets come back to the current for a moment which is another trend of data that in the past would have been kept offline or best case near line due to cost and limits or constraints are finding their way online either in public or private venues (or clouds if you prefer).

Thus the trend of expanding data life cycles with some types of data being kept online or readily accessible as its value is discovered.

Here is an easy test, think of something that you may have googled or searched for a year or two ago that either could not be found or was very difficult to find. Now take that same search or topic query and see if anything appears and if it does, how many instances of it appear. Now make a note to do the same test again in a year or even six months and compare the results.

Now back to the future however with an eye to the past and things get even more interesting in that some researchers are saying that in centuries to come, we should expect to see more people not only living into their hundreds, however even longer. This follows the trend of the average life expectancy of people continues to increase over decades and centuries.

What if people start to live hundreds of years or even longer, what about the information they will generate and rely upon and its later life cycle or span?

Here is a link to a post where a researcher sees that very far down the road, people could live to be a thousand years old which brings up the question, what about all the data they generate and rely upon during their lifetime.

Ok, now back to the 21st century and it is safe to say that there will be more data and information to process, move, store and keep for longer periods of time in a cost effective way. This means applying data footprint reduction (DFR) such as archiving, backup and data protection modernization, compression, consolidation where possible, dedupe and data management including deletion where applicable along with other techniques and technologies combined with best practices.

Will you out live your data, or will your data survive you?

These are among other things to ponder while you enjoy your summer (northern hemisphere) vacation sitting on a beach or pool side enjoying a cool beverage perhaps gazing at the passing clouds reflecting on all things great and small.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Have you heard of 2DRS data protection technology?

Wed, 27 Jul 2011 21:11:12 CST

Have you heard of 2DRS data protection technology?

By Greg Schulz

Have you heard of 2DRS as a data storage technology?

If not, dont worry, you would probably be in a minority if you said yes.

Anyway, Phil White of ECCTek has been sending lots of material about 2DRS (2 dimensional error correction code: ECC) over the past few months.

In a nutshell, if you have an interest in data integrity, low level data storage topics, RAID, SSD or HDDs, you may want to have a look. I have no affiliation with Phil, ECCtek or 2DRS, nor can I vouch for what ECCtek is doing. However as he has been persistent (in a polite way), time to share some info and you can decide what to do with it.

The following is from Phil:

Hello,

You may be able to start a project to develop a 2D-RS product in your company.

You may be able to write and publish an article promoting the 2D-RS ideas.

You may be able to send me e-mail addresses of others who may be interested in the 2D-RS ideas.

You could forward this e-mail to others who may be interested in the 2D-RS ideas.

I am asking you to please take the time you need to read the web pages at the end of this e-mail, and please think seriously about the ideas and ask questions if something is unclear.

After you have read the web pages and thought about the ideas, I am asking that you please do one or more of the following things:

Start a project to develop a 2D-RS product in your company.
Write and publish an article to promote the 2D-RS ideas.
Send me e-mail addresses of others who may be interested in the 2D-RS ideas.
Forward this e-mail to others.

Regards,

Phil White
President
ECC Technologies, Inc. (ECC Tek)
4750 Coventry Road East
Minnetonka, MN 553453909
Phone: (952)9352885
Fax: (952)9352491
www.ecctek.com

Web Pages
ECC Teks Web Site
ECC Tek Company Profile
PRS Patent

2D ECC Concepts
2D RS HDDs
2D RS HDD Products
2D RS SSDs
2D RS Storage Systems
2D RS Comments
2D RS A
2D RS Believers

Basic ECC Concepts
Finite Fields, RS Codes and RS RAID
Finite Fields with 4bit Elements

I will leave it up to you if you want to check out what Phil has to say and if or where 2D may or may not be relevant.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Summer 2011 StorageIO News Letter

Wed, 27 Jul 2011 15:55:55 CST

Summer 2011 StorageIO News Letter

By Greg Schulz

Summer 2011 Newsletter

Welcome to the Summer 2011 edition of the Server and StorageIO Group (StorageIO) newsletter. This follows the Spring 2011 edition.

You can access this news letter via various social media venues (some are shown below) in addition to StorageIO web sites and subscriptions.

Click on the following links to view the Summer 2011 edition as an HTML or PDF or, to go to the newsletter page to view previous editions.

Follow via Goggle Feedburner here or via email subscription here.

You can also subscribe to the news letter by simply sending an email to newsletter@storageio.com

Enjoy this edition of the StorageIO newsletter, let me know your comments and feedback.

Cheers gs

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

twitter @storageio

Dell Storage Forum 2011 revisited

Mon, 11 Jul 2011 23:55:55 CST

Dell Storage Forum 2011 revisited

By Greg Schulz

About a month ago I was invited by Dell to make a quick trip down to Orlando to attend the Dell Storage Forum 2011 (e.g. twitter #dellsf11). Given that on Tuesday June 7th Minneapolis was having a heat wave with 100 degree (F) temperatures, it was actually cooler in Orlando.

Make no mistake however, there were plenty of technologies that were cool and being kept cool at the Hilton adjacent to Disney as Dell continues to expand their footprint into the hot data storage market. The event brought together three aspects of the Dell storage story which were the mergers of the recently acquired Compellent user group with the Dell Equallogic user group along with the rest of the Dell storage and data management lineup. While the limelight was focused on Compellent and Equalogic, the Dell disk Dudes (and Dudettes e.g. Gina Rosenthal aka twitter @gminks and Sheryl Koenigsberg aka twitter @storagediva ) have been involved with storage for many years in addition to the recent acquisitions.

During the event I was invited to tag along with Roger Lund (twitter @rogerlund) an IT customer of Dells and Ed Saipetch (twitter @edsai) an Dell partner to go talk with the Dell NAS dudes (aka Unified, clustered, grid, rain, big data, bulk, scale out NAS) team formerly known as Exanet. The team is mix of Dell, former Exanet and new members who have been relatively quietly enhancing their technology in addition to creating packaged solution bundles with other Dell products such as the FS7500 (coupled with EqualLogic). For those not familiar with Exanet, have a read here or hear and for those not familiar with scale out NAS (aka bulk, grid, clustered, big data, etc) have a read here.

There are lots of interesting things in the works or possible and the team that we spoke with are full of energy, ideas, support from management not to mention having some interesting technology tools to work with ranging from Ocarina (data footprint reduction aka DFR), Kace, Scalent, Powervault MD series, servers and micro servers, not to mention EqualLogic and Compellent among others including those from various partners.

NAS was not the only thing cool at the event, there was the Dell object storage solution (aka DX) based on Caringo CAS (Content Addressable Storage) OEM software technology that has been the Rx (prescription) for healthcare, medical and other archives. Keep in mind that Dell also earlier this year acquired Insight one that just happens to be involved with healthcare and medical data or information management.

Speaking of archives and objects there was also some activity this past week with Dell and Rainstor making an announcement of their joint solutions in addition. Speaking of making sure that data on Dell storage remains available, accessible and protected, preserved and served, there were also backup/restore as well as many other pieces of technology, services and solutions. There was also a good presence by Dell partners at the event including Brocade, Commvault, Quantum and Symantec among others.

Here is a link to a video from when I was a guest with hosts Cali Lewis and John McArthur on the Wikibon/Silicon Angle The Cube show while at the Dell Event. During the discussion we had some fun as well as discussed not to be scared of clouds and virtualization, however look before you leap, doing your homework to be prepared along with other themes in my new book Cloud and Virtual Data Storage Networking (CRC Press).

Speaking of Dell, I had a nice conversation with Michael Dell during the storage beers tweet up. Did we talk about SMB or SOHO NAS, SSD, tape, HHDD, Brocade, block vs. file vs. object, data footprint reduction, big backup vs. big data, clouds, 3PAR, Equallogic vs. Compellent, HP vs. EMC?

Nope, we talked about the Dallas Mavericks (who went on to win the NBA title for 2011), social media and other items. If you have never meet Michael Dell, he is one of the most relaxed, confident and approachable CEOs of any big or large company I have meet.

In addition to visiting with Michael Dell, I also had the pleasure of meeting many other great people from Dell, their partners and others face to face including many twitter tweeps. All in all it was a great day and a half trip down to the Dell event, look forward to seeing and hearing more from Dell in the future.

Oh, and for disclosure purposes, Dell covered my RT coach class airfare while I picked up my own hotel, airport transfers, parking and incidentals.

Thanks again to Gina Rosenthal for making it all happen!

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), Resilient Storage Networks (Elsevier, 2004) twitter @storageio

Unified storage systems showdown: NetApp FAS vs. EMC VNX

Mon, 11 Jul 2011 23:44:44 CST

By Greg Schulz

Unified storage systems showdown: NetApp FAS vs. EMC VNX

Unified storage systems that support concurrent block, file and in some cases object based access have become popular in terms of industry adoption as well as customer deployments with solutions from many vendors across different price bands, or market (customer) sectors. Two companies that are leaders in this space are also squared off against each other (here and here) to compete for existing, each others, as well as new customers in adjacent or different markets. Those companies are EMC and NetApp that I have described as two similar companies on parallel tracks offset by time.

Recently I was asked to provide some commentary about unified storage systems in general, as well as EMC and NetApp that you can read here, or view additional commentary on related themes here, here and here. EMC has a historical block based storage DNA that has evolved to file and object based while NetApp originated in the file space having moved into block based storage along with object based access. EMC converged various product technologies including those developed organically (e.g. internally) as well as via acquisition as part of their unified approach. NetApp who has had a unified produce has more recently added a new line of block products with their acquisition of Engenio from LSI. Obviously there are many other vendors with unified storage solutions that are either native (e.g. the functionality is built into the actual technology) or by parterning with others to combine their block or file based solutions as a unified offering.

What is unified storage, what does it enable, and why is it popular now?
Over the past couple of years, multifunction systems that can do both block- and file-based storage have become more popular. These systems simplify the acquisition process by removing the need to choose while enabling flexibility to use something else later. NAS solutions have evolved to support both NFS and CIFS and other TCP-based protocols, including HTTP and FTP, concurrently. NAS or file sharing based storage continues to gain popularity because of its ease of use and built-in data management capabilities. However, some applications, including Microsoft Exchange or databases, either require block-based storage using SAS, iSCSI, or Fibre Channel, or have manufacture configuration guidelines for block-based storage.

Multi protocol storage products enable the following:

Acquisition and installation without need for a specialist

Use by professionals with varied skills

Reprovisioning for different applications requirements

Expansion and upgrades to boost future capacity needs

Figure 1 shows variations of how storage systems, gateways, or appliances can provide multiple functionality support with various interfaces and protocols. The exact protocols, interfaces, and functionality supported by a given system, software stack, gateway, or appliance will vary by specific vendor implementation. Most solutions provide some combination of block and file storage, with increasing support for various object-based access as well. Some solutions provide multiple block protocols concurrently, while others support block, file, and object over Ethernet interfaces. In addition to various front-end or server and application-facing support, solutions also commonly utilize multiple back-end interfaces, protocols, and tiered storage media.

Figure 1: Multi protocol and function unified storage examples

For low end SMB, ROBO, workgroup, SOHO, and consumers, the benefit of multi protocol and unified storage solutions is similar to that of a multifunction printer, copier, fax, and scanner that is, many features and functionality in a common footprint that is easy to acquire, install, and use in an affordable manner.

For larger environments, the value proposition of multi protocol and multi functionality is the flexibility and ability to adapt to different usage scenarios that enable a storage system to take on more personalities. What this means is that by being able to support multiple interfaces and protocols along with different types of media and functionality, a storage system becomes multifunctional. A multifunction storage system may be configured for on-line primary storage with good availability and performance and for lower-cost, high-capacity storage in addition to being used as backup target. In other scenarios, a multifunction device may be configured to perform a single function with the idea of later redeploying it to use a different personality or mode of functionality.

An easy way to determine whether you need multi protocol storage is to look at your environment and requirements. If all you need is FC, FCoE, SAS, iSCSI, or NAS, and a multi protocol device is going to cost you more, it may not be a good fit.

If you think you may ever need multi protocol capability, and theres no extra charge for it, go ahead. If youre not being penalized in performance, extra management software fees, functionality or availability, and you have the capability, why wouldnt you implement a unified storage system?

Look for products that have the ability to scale to meet your current and future storage capacity, performance, and availability needs or that can coexist under common management with additional storage systems.

Vendors of unified storage in addition to EMC and NetApp include BlueArc, Fujitsu, Dell, Drobo, HDS (with BlueArc), HP, IBM, Huawei, Oracle, Overland, Quantum, Symantec and Synology among others.

So what does this all mean? Simple, if you are not already using unified storage in some shape or form, either at work or perhaps even at home, most likely it will be in your future. Thus the question of not if, rather when, where, with what and how.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), Resilient Storage Networks (Elsevier, 2004) twitter @storageio

SMB, SOHO and low end NAS gaining enterprise features

Mon, 11 Jul 2011 23:33:33 CST

By Greg Schulz

SMB, SOHO and low end NAS gaining enterprise features

Here is a link to an interview that I did providing industry trends, perspectives and commentary on how Network Attached Storage (NAS) aka file and data sharing for the Small Medium Business (SMB), Small Office Home Office (SOHO) and consumer or low end offerings are gaining features and functionality traditionally associated with larger enterprise, however without the large price. In addition, here is a link to some tips for small business NAS storage and to another perspective on how choosing an SMB NAS is getting easier (and here for comments on unified storage).

Click on the image below to listen to a pod cast that I did with comments and perspectives involving SMB, SOHO, ROBO and low end NAS.

If your favorite or preferred product or vendor was not mentioned in the above links, dont worry, as with many media interviews there is a limited amount of time or narrow scope so those mentioned were among others in the space.

Speaking of others, there are many others in the broad and diverse SMB, SOHO, ROBO and consumer NAS and unified storage space. For example there are QNAP, SMC, Huawei, Buffalo, Synology and Starwind among many others. There is a lot of diversity in this NAS space. You've got Buffalo Technology, Cisco, Dlink, Dell, Data Robotic Drobo, EMC Iomega, Hewlett-Packard (HP) Co. via Microsoft, Intel, Overland Storage Snap Server, Seagate Black Armour, Western Digital Corp., and many others. Some of these vendors are household names that you would expect to see in the upper SMB, mid sized environments, and even into the enterprise.

For those who have other favorites or want to add another vendor to those already mentioned above, feel free to respond with a polite comment below. Oh and for disclosure, I bought my SMB or low end NAS from Amazon.com and it is an Iomega IX4.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), Resilient Storage Networks (Elsevier, 2004) twitter @storageio

Whats your take on open virtualization alliance and VMware?

Mon, 11 Jul 2011 22:33:44 CST

By Greg Schulz

Whats your take on open virtualization alliance and VMware?

Have you heard about the open virtualization alliance (OVA), their kernel based virtual machine (KVM) and their diverse membership list?

If not, here is a link to the OVA FAQ, also take a moment and read this here that talks about OVA along with some perspectives commentary from others as well as myself.

Figure 1: Generic representation of virtual machines (VMs) and virtualized environment

In a nutshell, OVA can be seen by the faithful as a move or ploy to catch up and buck the success trend of VMware. To those who are not on the VMware bandwagon, this could be seen as a move to level the playing field for virtual machines, kernels and servers.

Yet to others, this can be seen as DejaVu to past attempts at operating systems or other technology alliances to bring parity to the ranks of those not at the top of the technology list of a particular topic, product or theme. For example, a decade or two ago, there were the various Unix groups (remember SCO etc?) that were attempted involving the late Ray Norda of Novell fame in a quest to battle Microsoft among others.

The industry road side is littered with alliances that either still exist yet collecting dust or that faltered. For storage people does anybody remember Aperi and how those in the IBM lead storage management alliance were all singing Kumbaya around a virtual campfire and later partnering with SNIA (Storage Networking Industry Association)? Speaking of SNIA, anybody remember the various supported solutions forums (SSFs) popular back in the early 2000s as a means to demonstrate and stimulate interoperability between different vendors technologies?

Alliances are not bad, however generally to be successful, they have to exist for the right reasons in addition to being well funded, have strong leadership that also means having clear objectives to minimize chances of compromise by committee. While we are talking about alliances, have you heard about the Open Data Center Alliance (ODCA)? The ODCA alliance of which StorageIO is a member is a bit different than many IT related groups in that it is customer or non vendor focused. ODCA has good potential for doing some interesting things as long as they do not get bogged down in bureaucracy as is to often the case with industry driven trade groups, associations or alliances.

Lets see how these and other alliances move forward or what becomes of them, not to mention the expanding awareness around vi rtualization, life beyond consolidation (and here).

Whats your take on OVA and other alliances? Click here to cast your vote and see what others think.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), Resilient Storage Networks (Elsevier, 2004) twitter @storageio

Are Hard Disk Drives (HDDs) getting too big?

Mon, 11 Jul 2011 18:04:04 CST

By Greg Schulz

Are Hard Disk Drives (HDDs) getting too big?

Lets start out by clarifying something, that is in terms of context or scope, big means storage capacity as opposed to the physical packaging size of a hard disk drive (HDD) which are getting smaller.

So are HDDs in terms of storage capacity getting to big?

This question of if HDDs storage capacity getting to big to manage comes up every few years and it is the topic of Rick Vanovers (aka twitter @RickVanover Episode 27 Pod cast: Are hard drives getting to big?

As I discuss in this pod cast with Rick Vannover of Veeam, with the 2TB and even larger future 4TB, 8 to 9TB, 18TB, 36TB and 48 to 50TB drives not many years away, sure they are getting bigger (in terms of capacity) however we have been here before (or at least some of us have). We discuss how back in the late 90s HDDs were going from 5.25 inch to 3.5 inch (now they are going from 3.5 inch to 2.5 inch), and 9GB were big and seen as a scary proposition by some for doing RAID rebuilds, drive copy or backups among other things, not to mention if putting to many eggs (or data) in one basket.

In some instances vendors have been able to combine various technologies, algorithms and other techniques to RAID rebuild a 1TB or 2TB drive in the same or less amount of time as it used to take to process a 9GB HDD. However those improvements are not enough and more will be needed leveraging faster processors, IO busses and back planes, HDDs with more intelligence and performance, different algorithms and design best practices among other techniques that I discussed with Rick. After all, there is no such thing as a data recession with more information to be generated, processed, moved, stored, preserved and served in the future.

If you are interested in data storage, check out Ricks pod cast and hear some of our other discussion points including how SSD will help keep the HDD alive similar to how HDDs are offloading tape from their traditional backup role, each with its changing or expanding focus among other things.

On a related note, here is post about RAID remaining relevant yet continuing to evolve. We also talk about Hybrid Hard Disk Drives (HHDD) where in a single sealed HDD device there is flash and dram along with a spinning disk all managed by the drives internal processor with no external special software or hardware needed.

Put on your head phones (or not) and check out Ricks pod cast here (or on the head phone image above).

Thanks again Rick, really enjoyed being a guest on your show.

Whats your take, are HDDs getting to big in terms of capacity or do we need to leverage other tools, technology and techniques to be more effective in managing expanding data footprint including use of data footprint reduction (DFR) techniques?

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), Resilient Storage Networks (Elsevier, 2004) twitter @storageio

Happy 100th birthday or anniversary wishes

Wed, 06 Jul 2011 16:54:32 CST

By Greg Schulz

Happy 100th birthday or anniversary wishes

I would like to take a moment to wish a happy 100th birthday (or anniversary) to entities (or items) that Im involved with in one form or another.

Both are technology and infrastructure related, both facilitate commerce and transportation and in active service.

One is a company known to many as IBM or International Business Machine Corporation that recently celebrated its 100th birthday. For anyone working or involved in some shape or form with computing or high technology, at some point in your life you most likely have directly or indirectly used something provided by IBM.

The other is the Arcola High Bridge aka Soo line railroad bridge that crosses the St. Croix River north of Stillwater (click here to see some old photos). The Arcola High Bridge (or here) is still in use where trains cross it several times a day (and night) as well as where legends and ghost stories permeate. Keep in mind that even though IBM was in business when this bridge was designed and built, the sophisticated computers and software that enables structures to be efficiently built today did not exist. You could say that this old bridge was built to last which it has, particularly in an era where much younger infrastructure items either wear out or fail.

Best wishes to both and hopefully many more.

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), Resilient Storage Networks (Elsevier, 2004) twitter @storageio

Industry adoption vs. industry deployment, is there a difference?

Wed, 06 Jul 2011 14:44:41 CST

By Greg Schulz

Industry adoption vs. industry deployment, is there a difference?

Industry adoption and deployment may be one and the same depending on your viewpoint.

However they can also mean different things depending on what you do or your area of interest.

For example, when I hear the term industry adoption that means that the industry (press, media, bloggers, analysts, consultants, evangelists, vendors, vars, investors) are talking about something as being common place.

On the other hand, when I hear industry deployment that means what customers or organizations are actually acquiring, deploying and routinely using on a broader scale. Sure they can and do often mean one and the same. However industry adoption in terms of things being talked about (socialized) often occurs before broad deployment.

Recently I heard a so called industry insider say that a particular technology had reached broad industry adoption. I asked the person if they meant that everyone (or at least in their social circles or community) was talking about it, aware of it with some use, or that everyone had deployed the technology. The person looked puzzled and asked what I meant and why would I care about adoption vs. deployment, there were one and the same. So I explained that there is a difference, one drives the other and that they are related, a cause and effect. Funny how some things resonate with customers however not always with so called industry insiders.

Next time you hear someone tossing around buzzword bingo topics or themes in conjunction with the term industry adoption, ask them if that means people are talking about it, or that people are actually doing what is being discussed. Of course there will be people doing or deploying what is being discussed, those are the early adopters and deployers.

What does this have to do with anything?

Not much really other than to throw out some food for thought.

Perhaps if you are a customer to have some fun with the pundits, evangelist and industry insiders or when vendors and vars show up for a game of buzzword bingo. On the other hand, if you are a vendor or var, clarify with and where your customers are as well as how they evolving from adoption to deployment to demonstrate success.

Ok, nuf said for now.

Cheers Gs

Greg Schulz - Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), Resilient Storage Networks (Elsevier, 2004) twitter @storageio

Summer greetings and happy holidays V2011

Sun, 03 Jul 2011 10:45:54 CST

By Greg Schulz

Summer greetings and happy holidays V2011

I will keep this simple and short.

For those of you in the US, happy fourth of July.

For those of you elsewhere, enjoy the nice weather while it lasts.

And to those who like fishing and catching, good luck.

After all, for those who at least give it or something a try, your chances of catching or succeeding increase, that is unless your version of fishing and catching is measured by simply going to the grocery store frozen food section, a seafood restaurant, or visiting your local fish monger.

The above photo of a North American bald eagle was taken by Karen Schulz (Aka Karen of Arcola) while we were out fishing on the St. Croix River north of Stillwater MN. No telephoto or high powered zoom lenses or trick photography (or photo shop) were involved, we were simply out fishing (and catching) in our backyard at the right time and being in right place to have been able to catch this photo of the eagle fishing.

Have a safe and happy holiday weekend and or summer vacation (holiday for those outside the US).

Cheers Gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

Cloud storage: Dont be scared, however look before you leap

Mon, 6 Jun 2011 19:12:34 CST

By Greg Schulz

Cloud storage: Dont be scared, however look before you leap

Here is a link to a web cast on BrightTalk I will be doing live on Thursday June 9, 2011 at 1PM Pacific, 3PM Central or 4PM Eastern time lasting about 45 minutes. The web cast is titled: Cloud storage: Dont be scared, however look before you leap.

This web cast session takes a look at the state of public, private and hybrid cloud storage solutions and services including what you need to know to be prepared for a successful deployment. Topics to be covered include best practices, management and data protection in addition to navigating the hype and FUD associated with cloud storage today.

Check out the web cast either live or the replay later.

Cheers Gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

Cloud and Virtual Data Storage Networking

Sun, 5 Jun 2011 12:34:56 CST

By Greg Schulz

Cloud and Virtual Data Storage Networking

For those who have read any of my previous posts, seen some of my articles, news letters, videos, pod casts, web casts or in person appearances you may have heard that I have a new book coming out this summer.

Here in the northern hemisphere its summer (well technically the solstice is just around the corner) and in Minnesota the ice (from the winter) is off the lakes and rivers. Granted, there is some ice floating that fell out of coolers for keeping beverages cool. This means that it is also fishing (and catching) season on the Scenic St. Croix River.

FTC disclosures (and for fun): Karenofarcola is wearing a StorageIO baseball cap and Im wearing a cap from a vendor marketing person who sent several as they too enjoy fishing and boating. Funny thing about the cap, all of the river rats and fishing people think it is from the people who make rod reels instead of solutions that go around tape and disk reels. Note, if you feel compelled to send me baseball caps, send at least a pair so there is a backup, standby, spare or extra one for a guest. The mustang survival jacket that Im wearing with the Seadoo logo is something I bought myself. I did get a discount however since there was a Seadoo logo on it and I used to have Seadoo jet boats. Btw, that was some disclosure fun and humor!

Ok, enough of the fun stuff, lets get back to the main theme of this post.

My new book which is the third in a series of solo projects including Resilient Storage Networks: Designing Flexible Scalable Data Infrastructures (Elsevier) and The Green and Virtual Data Center (CRC).

While the official launch and general availability will be later in the summer, following are some links and related content to give you advance information about the new book.

Click on the above image which will take you to the CRC Press page where you can learn more including what the book is about, view a table of contents, see reviews and more. Also check out the video below to learn more as well as visit my main web site where you can learn about Cloud and Virtual Data Storage Networking, my other books and view (or listen to) related content such as white papers, solution briefs, articles, tips, web cast, pod cast as well as view the recent and upcoming events schedule.

I also invite you to join Cloud and Virtual Data Storage Networking group

You can also view the short video at dailymotion, metacage, blip.tv, veoh, flickr, and photobucket among other venues.

If you are interested in being a reviewer, send a note to cvdsn@storageio.com with your name, blog or website and contact information including shipping address (sorry no PO boxes) plus telephone (or skype) number. Also indicate if you are a blogger, press/media, free lance writer, analyst, consultant, var, vendor, investor, IT professional or other.

Watch for more news and information as we get closer to the formal launch and release, in the meantime, you can pre order your copy now at Amazon, CRC Press and other venues around the world.

Ok, time to get back to work or go fishing, nuff said

Cheers Gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

Congratulations to Infosmack on episode 100

Sun, 5 Jun 2011 12:00:00 CST

By Greg Schulz

Congratulations to Infosmack on episode 100

Congratulations to the Infosmack crew hosts Greg Knieriemen and Marc Farley with the Diva of Disruptive Technologies, Christina Weil on their 100th episode. This episode included Robin Harris of StorageMojo and myself as guests.

Some items discussed in the 100th episode include Infosmack Live from the upcoming Dell Storage Forum, Cisco and the future of or with EMC and VMware, NetApp merger and acquisition activity, Sony and the death of Blu-ray, streaming video and related themes among others. Give it a listen when you get a chance and congratulations on the 100th episode.

Ok, nuff said

Cheers Gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

Dude, is Dell going to buy Brocade?

Fri, 3 Jun 2011 18:00:00 CST

By Greg Schulz

Dude, is Dell going to buy Brocade?

Some IT industry buzz this week is around continued speculation (or here) of who will Dell buy next and will it be Brocade.

Brocade was mentioned as a possible acquisition by some in the IT industry last fall after Dell stepped back from the 3PAR bidding war with HP. Industry rumors or speculations are not new involving Dell and Brocade some going back a year or more (or here or here).

Last fall I did a blog post commenting that I thought Dell would go on to buy someone else (turned out to be Compellent and Insight One). Those acquisitions by Dell followed their purchases of companies including Scalent, Kace, Exanet, Perot, and Ocarina among others. In that post, I also commented that I did not think (at least at that time) that Brocade would be a likely or good fit for Dell given their different business models, go to market strategy and other factors.

Dell is clearly looking to move further up into the enterprise space which means adding more products and routes to market of which one is via networking and another involves people with associated skill sets. The networking business at Dell has been good for them along with storage to complement their traditional server and workstation business, not to mention their continued expansion into medical, life science and healthcare related solutions. All of those are key building blocks for moving to cloud, virtual and data storage networking environments.

Dell has also done some interesting acquisitions around management and service or workflow tools with Scalent and Kace not to mention their scale out NAS file system (excuse me, big data) solutions via Exanet and data footprint reduction tools with Ocarina, all of which have plays in the enterprise, cloud and traditional Dell markets.

But what about Brocade?

Is it a good fit for Dell?

Dell certainly could benefit from owning Brocade as a means of expanding their Ethernet and IP businesses beyond OEM partnerships, like HP supplementing their networking business with 3COM and IBM with Blade networks.

However, would Dell acquiring Brocade disrupt their relationships with Cisco or other networking providers?

If Dell were to make a bid for Brocade, would Huawei (or here) sit on the sidelines and watch or jump in the game to stir things up?

Would Cisco counter with a deal Dell could not refuse to tighten their partnership at different levels perhaps even involving something with the UCS that was discussed on a recent Infosmack episode?

How would EMC, Fujitsu, HDS, HP, IBM, NetApp and Oracle among others, all of who are partners with Brocade respond to Dell now becoming their OEM supplier for some products?

Would those OEM partnerships continue or cause some of those vendors to become closer aligned with Cisco or others?

Again the question, will Huawei sit back or decide to enter the market on a more serious basis or continue to quietly increase their presences around the periphery?

Brocade could be a good fit for Dell giving them a networking solution (both Ethernet via the Foundry acquisition along with Fibre Channel and Fibre Channel over Ethernet (FCoE)) not to mention many other pieces of IP including some NAS and file management tools collecting dust on some Brocade shelf somewhere. What Dell would also get is a sales force that knows how to sell to OEMs, the channel and to enterprise customers, some of whom are networking (Ethernet or Fibre Channel) focused, some who have broader diverse backgrounds.

While it is possible that Dell could end up with Brocade along with a later bidding battle (unless others just let a possible deal go as is), Dell would find itself in new and unfamiliar waters similar to Brocade gaining its feet moving into the Ethernet and IP space after having been comfortable in the Fibre Channel storage centric space for over a decade.

While the networking products would be a good fit for Dell assuming that they were to do such a deal, the diamond in the rough so to speak could be Brocade channel, OEM and direct sales contact team of sales people, business development, systems engineers and support staff on a global basis. Keep in mind that while some of those Brocadians are network focused, many have connected servers and storage from mainframe to open systems across all vendors for years or in some cases decades. Some of those people who I know personally are even talented enough to sell ice to an Eskimo (that is a sales joke btw).

Sure the Brocadians would have to be leveraged to keep selling what they have done, a task similar to what NetApp is currently facing with their integration of Engenio.

However that DNA could help Dell set up more presences in organizations where they have not been in the past. In other words, Dell could use networking to pull the rest of their product lines into those accounts, vars or resellers.

Hmmm, does that sound like another large California based networking company?

After all, June is a popular month for weddings, lets see what happens next week down in Orlando during the Dell Storage Forum as some have speculated might be a launching pad for some type of deal.

Here are some related links to more material:

HP Buys one of the seven networking dwarfs and gets a bargain

Dell Will Buy Someone, However Not Brocade (At least for now)

While HP and Dell make counter bids, exclusive interview with 3PAR CEO David Scott

Acadia VCE: VMware + Cisco + EMC = Virtual Computing Environment

Did someone forget to tell Dell that Tape is dead?

Data footprint reduction (Part 1): Life beyond dedupe and changing data lifecycles

Data footprint reduction (Part 2): Dell, IBM, Ocarina and Storwize

What is DFR or Data Footprint Reduction?

Could Huawei buy Brocade?

Has FCoE entered the trough of disillusionment?

More on Fibre Channel over Ethernet (FCoE)

Dude, is Dell doing a disk deal again with Compellent?

Post Holiday IT Shopping Bargains, Dell Buying Exanet?

Back to school shopping: Dude, Dell Digests 3PAR Disk storage

Huawei should buy brocade

NetApp buying LSIs Engenio Storage Business Unit

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

StorageIO going Dutch: Seminar for Storage and I/O professionals

Sat, 7 May 2011 17:32:23 CST

By Greg Schulz

StorageIO going Dutch: Seminar for Storage and I/O professionals

Data and Storage Networking Industry Trends and Technology Seminar

Greg Schulz of StorageIO in conjunction with or dutch parter Brouwer Storage Consultancy will be presenting a two day seminar for Storage Professionals Tuesday 24th and Wednesday 25th of May 2011 at Ampt van Nijkerk Netherlands.

The format of this two seminar will be a mix of presentation and interactive discussion allowing attendees plenty of time to discuss among themselves and with seminar presenters. Attendees will gain insight into how to compare and contrast various technologies and solutions in addition to identifying and aligning those solutions to their specific issues, challenges and requirements.

Major themes that will be discussed include:

Who is doing what with various storage solutions and tools
Is RAID still relevant for today and tomorrow
Are hard disk drives and tape finally dead at the hands of SSD and clouds
What am I routinely hearing, seeing or being asked to comment on
Enabling storage optimization, efficiency and effectiveness (performance and capacity)
What do I see as opportunities for leveraging various technologies, techniques,trends
Supporting virtual servers including re-architecting data protection
How to modernize data protection (backup/restore, BC, DR, replication, snapshots)
Data footprint reduction (DFR) including archive, compression and dedupe
Clarifying cloud confusion, what you need to know to make effective decisions

In addition this two day seminar will look at what are some new and improved technologies and techniques, who is doing what along with discussions around industry and vendor activity including mergers and acquisitions. Greg will also preview the contents and themes of his new book Cloud and Virtual Data Storage Networking (CRC) for enabling efficient, optimized and effective information services delivery across cloud, virtual and traditional environments.

Buzzwords and topic themes to be discussed among others include: E2E, FCoE and DCB, CNAs, SAS, I/O virtualization, server and storage virtualization, public and private cloud, Dynamic Infrastructures, VDI, RAID and advanced data protection options, SSD, flash, SAN, DAS and NAS, object storage, application optimized or aware storage, open storage, scale out storage solutions, federated management, metrics and measurements, performance and capacity, data movement and migration, storage tiering, data protection modernization, SRA and SRM, data footprint reduction (archive, compress, dedupe), unified and multi-protocol storage, solution bundle and stacks.

For more information or to register contact Brouwer Storage Consultancy

Learn about other events involving Greg Schulz and StorageIO at www.storageio.com/events

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

Using Removable Hard Disk Drives (RHDDs)

Tue, 3 May 2011 04:04:04 CST

By Greg Schulz

Using Removable Hard Disk Drives (RHDDs)

Removable hard disk drives (RHDD) are a form of removable media which includes magnetic tape that address many common use cases. Usage scenarios include enabling bulk data portability for larger environments or for D2D backup where the media needs to be physically moved offsite for small and mid sized environments. RHDDs include among others those from Imation such as the Odyssey (which is what I use) and the Prostor RDX (OEMed by Imation and others). RHDD, tape along with other forms of portable media including those that use flash by being removable and portable presumable should have some extra packaging protection to safeguard against static shock in addition to supporting encryption capabilities.

Compared to disks including RHDD, tape for most and particularly larger environments should have an overall lower media cost for parking, preserving and when needed serving inactive or archived data (e.g. the changing roll of tape from day to back up to archive). Of course your real costs will vary by use in addition to how combined with data footprint reduction and other technologies.

A big benefit of RHDDs is that they are random meaning data can be searched and found quickly vs. tape media which has great sequential or streaming capabilities if you have a system that can support that ability. The other benefit of RHDD is that depending on their implementation, they should plug and play with your systems appearing as disk without any extra drivers or configuration or software tools making for ease of use. Being removable they can be used for portability such as sending data to a cloud or MSP as part of an initial bulk copy, or sending data offset or taking home as part of an offsite backup, data protection or BC/DR strategy as well as being used for archiving. The warning with RHDD is their cost per TByte will generally be higher than compared to tape as well as having to have a docking station or specific drive interface depending on specific product and configuration.

RHDD are a great compliment to traditional fixed or non removable disk, Hybrid Hard Disk Drive (HHDD) and Solid State Device (SSD) based storage as well as coexist with cloud or MSP backup and archive solutions. The smaller the environment the more affordable using RHDD become vs. tape for backup and archive operations or when portability is required. Even if using a cloud or managed service provider (MSP) backup provider, network bandwidth costs, availability or performance may limit the amount of data that can be moved in a cost effective way. For example placing an archive and gold or master copy of your static data on a RHDD that may be kept on site in a safe off-site place and then sending data that is routinely changed to the cloud or MSP provider (think full local and offsite plus partial full and incremental in the cloud).

By leveraging archiving and data footprint reduction (DFR) techniques including dedupe and compression, you can stretch your budget by sending less data to cloud or MSP services while using removable media for data protection. You would be surprised how many TBytes of data can be kept in a safe deposit box. For my own business, I have used RHDDs for several years to keep gold master copies as well as archives offsite as part of a disk to disk (D2D) or D2D2RHDD strategy. The data protection strategy is also complimented by sending active data to a cloud backup MSP (encrypted of course). It might be belt and suspenders, however it is also eating my own dog food practicing what I talk about and the approach has proven itself a few times.

Here are some related links to more material:
Removable disk drives vs. tape storage for small businesses
The pros and cons of removable disk storage for small businesses
Removable storage media appealing to SMBs, but with caveats
StorageIO Momentus Hybrid Hard Disk Drive (HHDD) Moments

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

StorageIO Momentus Hybrid Hard Disk Drive (HHDD) Moments

Mon, 2 May 2011 23:32:23 CST

By Greg Schulz

StorageIO Momentus Hybrid Hard Disk Drive (HHDD) Moments

This is the third in a series of posts that I have done about Hybrid Hard Disk Drives (HHDDs) along with pieces about Hard Disk Drives (HDD) and Solid State Devices (SSDs). Granted the HDD received its AARP card several years ago when it turned 50 and is routinely declared dead (or read here) even though it continues to evolve along SSD maturing and both expanding into different markets as well as usage roles.

For those who have not read previous posts about Hybrid Hard Disk Drives (HHDDs) and the Seagate Momentus XT you can find them here and here.

Since my last post, I have been using the HHDDs extensively and recently installed the latest firmware. The release of new HHDD firmware by Seagate for the Momentus XT (SD 25) like its predecessor SD24 cleaned up some annoyances and improved on overall stability. Here is a Seagate post by Mark Wojtasiak discussing SD25 and feedback obtained via the Momentus XT forum from customers.

If you have never done a HDD firmware update, its not as bad or intimidating as might be expected. The Seagate firmware update tools make it very easy, that is assuming you have a recent good backup of your data (one that can be restored) and about 10 to 15 minutes of time for a couple of reboots.

Speaking of stability, the Momentus XT HHDDs have been performing well helping to speed up accessing large documents on various projects including those for my new book. Granted an SSD would be faster across the board, however the large capacity at the price point of the HHDD is what makes it a hybrid value proposition. As I have said in previous posts, if you have the need for speed all of the time and time is money, get an SSD. Likewise if you need as much capacity as you can get and performance is not your primary objective, then leverage the high capacity HDDs. On the other hand, if you need a balance of some performance boost with capacity boost and a good value, then check out the HHDDs.

Image of Momentus XT courtesy of www.Seagate.com

Lets shift gears from that of the product or technology to that of common questions that I get asked about HHDDs.

Common questions I get asked about HHDDs include:

What is a Hybrid Hard Disk Drive?
A Hybrid Hard Disk Drive includes a combination of rotating HDD, solid state flash persistent memory along with volatile dynamic random access memory (DRAM) in an integrated package or product. The value proposition and benefit is a balance of performance and capacity at a good price for those environments, systems or applications that do not need all SSD performance (and cost) vs. those that need some performance in addition to large capacity.

How the Seagate Momentus XT differs from other Hybrid Disks?
One approach is to take a traditional HDD and pair it with a SSD using a controller packaged in various ways. For example on a large scale, HDDs and SSDs coexist in the same tiered storage system being managed by the controllers, storage processors or nodes in the solution including automated tiering and cache promotion or demotion. The main difference however between other storage systems, tiering and pairing and HHDDs is that in the case of the Momentus XT the HDD, SLC flash (SSD functionality) and RAM cache and their management are all integrated within the disk drive enclosure.

Do I use SSDs and HDDs or just HHDDs?
I have HHDDs installed internally in my laptops. I also have HDDs which are installed in servers, NAS and disk to disk (D2D) backup devices and Digital Video Recorders (DVRs) along with external SSD and Removable Hard Disk Drives (RHDDs). The RHDDs are used for archive and master or gold copy data protection that go offsite complimenting how I also use cloud backup services as part of my data protection strategy.

What are the technical specifications of a HHDD such as the Seagate Momentus XT?
3Gbs SATA interface, 2.5 inch 500GB 7,200 RPM HDD with 32MB RAM cache and integrated 4GByte SLC flash all managed via internal drive processor. Power consumption varies depending what the device is doing such as initial power up, idle, normal or other operating modes. You can view the Seagate Momentus XT 500GB (ST95005620AS which is what I have) specifications here as well as the product manual here.

One of my HHDDs on a note pad (paper) and other accessories

Do you need a special controller or management software?
Generally speaking no, the HHDD that I have been using plugged and played into my existing laptops internal bay replacing the HDD that came with those systems. No extra software was needed for Windows, no data movement or migration tools needed other than when initially copying from the source HDD to the new HHDD. The HHDD do their own caching, read ahead and write behind independent of the operating system or controller. Now the reason I say generally speaking is that like many devices, some operating systems or controllers may be able to leverage advanced features so check your particular system capabilities.

How come the storage system vendors are not talking about these HHDDs?
Good question which I assume it has a lot to do with the investment (people, time, engineering, money and marketing) that they have or are making in controller and storage system software functionality to effectively create hybrid tiered storage systems using SSD and HDDs on different scales. There have been some packaged HHDD systems or solutions brought to market by different vendors that combine HDD and SSD into a single physical package glued together with some software and controllers or processors to appear as a single system. I would not be surprised to see discrete HHDDs (where the HDD and flash SSD and RAM are all one integrated product) appear in lower end NAS or multifunction storage systems as well as for backup, dedupe or other system that requires large amounts of capacity space and performance boost now and then.

Why do I think this? Simple, say you have five HHDDs each with 500GB of capacity configured as a RAID5 set resulting in 2TByte of capacity. Using as a hypothetical example the Momentus XT yields 5 x 4GByte or 20GByte of flash cache helps accelerate write operations during data dumps, backup or other updates. Granted that is an overly simplified example and storage systems can be found with hundreds of GByte of cache, however think in terms of value or low cost balancing performance and capacity to cost for different usage scenarios. For example, applications such as bulk or scale out file and object storage including cloud or big data, entertainment, Server (Citrix/Xen, Microsoft/HyperV, VMware/vSphere) and Desktop virtualization or VDI, Disk to Disk (D2D) backup, business analytics among others. The common tenets of those applications and usage scenario is a combination of I/O and storage consolidation in a cost effective manner addressing the continuing storage capacity to I/O performance gap.

Storage and I/O performance gap

Do you have to backup HHDDs?
Yes, just as you would want to backup or protect any SSD or HHD device or system.

How does data get moved between the SSD and the HDD?
Other than the initial data migration from the old HDD (or SSD) to the HHDD, unless you are starting with a new system, once your data and applications exist on the HHDD, it automatically via the internal process of the device manages the RAM, flash and HDD activity. Unlike in a tiered storage system where data blocks or files may be moved between different types of storage devices, inside the HHDD, all data gets written to the HDD, however the flash and RAM are used as buffers for caching depending on activity needs. If you have sat through or listened to a NetApp or HDS use of cache for tiering discussion what the HHDDs do is similar in concept however on a smaller scale at the device level, potentially even in a complimentary mode in the future? Other functions performed inside the HHDD by its processor includes reading and writing, managing the caches, bad block replacement or re vectoring on the HDD, wear leveling of the SLC flash and other routine tasks such as integrity checks and diagnostics. Unlike paired storage solutions where data gets moved between tiers or types of devices, once data is stored in the HHDD, it is managed by the device similar to how a SSD or HDD would move blocks of data to and from the specific media along with leveraging RAM cache as a buffer.

Where is the controller that manages the SSD and HDD?
The HHDD itself is the controller per say in that the internal processor that manages the HDD also directly access the RAM and flash.

What type of flash is used and will it wear out?
The XT uses SLC (single level cell) flash which with wear leveling has a good duty cycle (life span) and is what is typically found in higher end flash SSD solutions vs. lower cost MLC (multi level cell)

Have I lost any data from it yet?
No, at least nothing that was not my own fault from saving the wrong file in the wrong place and having to recover from one of my recent D2D copies or the cloud. Oh, regarding what have I done with the HDDs that were replaced by the HHDDs? They are now an extra gold master backup copy as of a particular point in time and are being kept in a safe secure facility, encrypted of course.

Have you noticed a performance improvement?
Yes, performance will vary however in many cases I have seen performance comparable to SSD on both reads and writes as long as the HDDs keep up with the flash and RAM cache. Even as larger amounts of data are written, I have seen better performance than compared to HDDs. The caveat however is that initially you may see little to marginal performance improvement however over time, particularly on the same files, performance tends to improve. Working on large tens to hundreds of MByte size documents I noticed good performance when doing saves compared to working with them on a HDD.

What do the HHDDs cost?
Amazon.com has the 500GB model for about $100 which is about $40 to $50 less than when I bought my most recent one last fall. I have heard from other people that you can find them at even lower prices at other venues. In the theme of disclosures, I bought one of my HHDDs from Amazon and Seagate gave me one to test.

Will I buy more HHDDs or switch to SSDs?
Where applicable I will add SSDs as well as HDDs, however where possible and practical, I will also add HHDDs perhaps even replacing the HDDs in my NAS system with HHDDs at some time or maybe trying them in a DVR.

What is the down side to the HHDDs?
Im generating and saving more data on the devices at a faster rate which means that when I installed them I was wondering if I would ever fill up a 500GB drive. I still have hundreds of GBytes free or available for use, however I also am able to cary more reference data or information than in the past. In addition to more reference data including videos, audio, images, slide decks and other content, I have also been able to keep more versions or copies of documents which has been handy on the book project. Data that changes gets backed up D2D as well as to my cloud provider including while traveling. Leveraging compression and dedupe, given that many chapters or other content are similar, not as much data actually gets transmitted when doing cloud backups which has been handy when doing a backup from a airplane flying over the clouds. A wish for the XT type of HHDD that I have is for vendors such as Seagate to add Self Encrypting Disk (SED) capabilities to them along with applying continued intelligent power management (IPM) enhancements.

Why do I like the HHDD?
Simple, it solves both business and technology challenges while being an enabler, it gives me a balance of performance for productivity and capacity in a cost effective manner while being transparent to the systems it works with.

Here are some related links to additional material:
Data Center I/O Bottlenecks Performance Issues and Impacts
Has SSD put Hard Disk Drives (HDDs) On Endangered Species List?
Seagate Momentus XT SD 25 firmware
Seagate Momentus XT SD25 firmware update coming this week
A Storage I/O Momentus Moment
Another StorageIO Hybrid Momentus Moment
As the Hard Disk Drive (HDD) continues to spin
Has SSD put Hard Disk Drives (HDDs) On Endangered Species List?
Funeral for a Friend
As the Hard Disk Drive (HDD) continues to spin
Seagate Momentus XT product specifications
Seagate Momentus XT product manual
Technology Tiering, Servers Storage and Snow Removal
Self Encrypting Disks (SEDs)

Ok, nuff said for now

Cheers Gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

Buzzword Bingo and Acronym Update V2.011

Fri, 22 Apr 2011 18:18:18 CST

By Greg Schulz

Buzzword Bingo and Acronym Update V2.011

Note: THis is in part fun!

R U (e.g. Are you) JASSD about JACD or do you have a case of JAID and JACBUS?

Will RAID RAIN on your cloud parade?

For those who like to keep up on buzzwords (for buzzword bingo) and acronyms, perhaps even FTW (e.g. For the Win), here are some old and new, fun and real ones to ponder.

As to which are real or new, fun or old, I will leave that up to you.

BD = Business Development or Big Data or Backup Device
CEO = Chief Evangelist Officer or Change Everything Often
CJO = Chief Jailable Officer or anyone who is a legal Chief of a company
CMO = Creative Movie Officer or Chief Marketing Officer (same thing)
CNOC = Cloud network operations center
CPOP = Cloud point of presence aka cloud gateway, cloud appliance, cloud middle ware, cloud shims
DC = Direct Current or Diet Coke or Data Center
DTDS+ = Disaster Tolerant Disk Subsystem (Plus)
EMC = Entertaining Movie Creations
HP = Has printers and PCs
IBM = Itty Bitty Machine company or I Buy Mainframes
iHop = International House of pancakes or iPhone bouncing on floor
JACBUS = Just Another Cloud Backup Service
JACD = Just Another Cloud Device
JAFD = Just Another Flash Device
JAiD = Just Another iSCSI Device or Just Another iProduct Device
JAM = Producer of Tree size SRM tools or a U.S. concert promoter
JASSD = Just Another SSD
MIA = Missing In Action or airport code for Miami International Airport
MSP = My Storage Please or Minneapolis St. Paul Airport code
NetApp = Neat effective technology And product portfolio
PIROMA = Ask someone you know who has been in capacity planning
RAID = Redundant Array of Independent Disks or bug spray
RAIN = Redundant Array of Independent Nodes or something that falls from the clouds
RPD = Revenue prevention department: Groups, entities or management layers that get in the way of getting results done
Truth Squads = Teams representing various vendors or organizations that try to get you to see things their way
WATN = Where Are They Now: Former vendors or service providers that are now MIA
XaaS = Plug in what ever you like for X as a Service

Ok, nuff said and fun for now

Cheers
Gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

Happy Earth Day 2011

Thu, 21 Apr 2011 20:32:23 CST

By Greg Schulz

Happy Earth Day 2011

Let me keep this simple, efficient and effective, Happy Earth Day 2011 April 22, 2011.

Be smart, practical, conscious, aware, recycle, cut down on waste, work smarter and more effective.

Ok, nuff said for now, go hug a tree, your computer, hybrid car, droid, ipad, spouse, partner, kid, dog, cat or whatever suits your needs.

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

The new Green IT: Efficient, Effective, Smart and Productive

Fri, 15 Apr 2011 20:02:20 CST

By Greg Schulz

The new Green IT: Efficient, Effective, Smart and Productive

Given the buzz about big data and conversations or confusion around clouds along with virtualizing virtually anything possible, Green IT has fallen off the Buzzword Bingo Bandwagon.

Green IT like so many other buzzwords and trends typically go through a hype cycle before getting tired, worn out, or disillusioned (see here and here). Often these buzzwords will go to Some Day Isle for some rest and recuperation before reappearing later as part of a second or third buzzword wave either making it to broad adoption which means the plateau of profitability (for vendors or vars) and productivity (for customers) or disappearing.

Some Day Isle for those not familiar with it is a visional or fictional place that some day you will go to, a wishful happy place so to speak that is perfect for hyperbole R and R. After some R and R, these trends, technologies or techniques often reappear well rested and ready for the next wave of buzz, FUD, hype and activity.

Some Day Isle where technologies or trends go for R and R

Keep in mind that industry adoption (e.g. everybody is talking about it) can differ from industry deployment (e.g. some people have actually paid for, deployed and using the technology) to broad customer adoption (e.g. many people are actually paying for, deploying and using the technology on a routine basis).

Confusion still reigns around Green IT not surprising given the heavy dose of Green Washing that has occurred.

Consequently Green IT themes or pitches often fall on deaf ears as people have either become numb or ignore the Green washing hype or FUD. For example many people will skip reading this post because the word Green is in the title assuming that it is another CO2 or related themed piece missing out on the other themes or messages here. Unfortunately as I have discussed in the past, there remains a Green Gap that results in missed opportunities for vendors, vars, service providers, IT organizations along with those who would like to see environmental benefits or change.

Another example of a Green gap is messaging around energy avoidance as being efficient vs. using energy in a more productive or effective manner (doing more work with the same or fewer resources) shown in the figure below.

Expanding focus from energy avoidance to energy usage effectiveness

In routine conversations with IT professionals it is clear that the Green Gap and thus missed opportunities will continue for some time until the business and economic values of efficient, effective, smart and productive IT are understood to have environmental benefits as a by product and thus being Green. Watch for more missed messaging around CO2 and related themes popular with so called Greenies (or if you prefer environmentalists) that miss the mark with most business and IT organizations.

Business and thus IT are driven by economics and as such will invest where they can reduce complexity and costs, become more efficient and effective while increasing productivity and reducing waste by working smarter. In other words, by changing how information services are delivered in a smarter more effective efficient manner maximizes what resources are used enabling more to be done in a denser footprint (budget, people staffing, management, power, cooling, floor space) that have positive environmental benefits. Put another way, a benefit for IT organizations to remove complexity results in lower costs, by becoming more efficient and effective reducing waste results in better productivity and fewer missed opportunities meaning enhanced profits. The net result is that environmental concerns get a free ride or being funded as a result of IT organizations improving their productivity which of course should have a business benefit.

Wheel of Opportunity: Various techniques and technologies for infrastructure optimization

Efficient and effective IT (aka the other Green IT) that links to common technology and business issues with the benefit of helping the environment can be accomplished using a combination approaches. The approaches for enabling an efficient, effective, smarter and productive IT environment includes from a generic perspective various technologies, techniques and best practices shown in the wheel of opportunity figure.

For example:

Best practices, policies and procedures, streamlined work flows
Metrics and measurements for end to end (E2E) management insight
Mask or move issues (to the cloud or elsewhere)
Consolidate where possible or practical (virtualized, ssd, fast servers)
Reduce your data footprint impact using data footprint reduction (DFR)
Tiered servers, storage and networks
Energy avoidance (avoiding doing something)
Energy efficiency (doing more with what you have)
Power, cooling, HVAC and alternate energy
E-waste, EHS, RoHS, etc
Leverage financial incentives and rebates

Here are some related links for additional reading:

Also check out my book for enabling efficient, effective and smart IT The Green and Virtual Data Center (CRC) including a free sample chapter download here.

Ok, nuff said for now, go hug a tree, your computer, hybrid car, droid, ipad or whatever suits your needs.

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

The data storage prayer

Fri, 15 Apr 2011 20:02:20 CST

By Greg Schulz

The data storage prayer

On a lighter note.

For those who follow or are involved with data storage religiously with a passion, then this is for you. As for others who do not get or understand what this is about, just ask those who are devout data storage followers.

Now I lay my data to sleep
I pray the lord my backups to keep
If a disk should die before I wake
I hope like heck RAID works and my resume is up to date

Nuff said, now get back to work or what ever it was you were doing before reading this and best wishes!

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

Is FCoE Struggling to Gain Traction, or on a normal adoption course?

Fri, 1 Apr 2011 22:11:00 CST

By Greg Schulz

Is FCoE Struggling to Gain Traction, or on a normal adoption course?

Here is an article by Drew Robb over at Enterprise Storage Forum about Fibre Channel over Ethernet (FCoE) and its state of adoption. Drews article includes comments and perspectives from myself around where FCoE is going and why it is on a long road and not a sprint for a short temporal technology play (e.g. not a quick passing fad or bandwagon trend).

If you measure FCoE adoption in months, sure, its been slow to gain adoption and deployment similar to how Ethernet, Fibre Channel (FC) and even iSCSI took time to evolve. Part of the time involved is for developing the standards, implementing the technology as well as expanding the capabilities of the new tools. Another part of the time required for technologies that are targeted to be around for a decade or more include ecosystem maturity, education not to mention customers being comfortable with along with having budget to buy the new items.

I have previously said that FCoE was in the trough of disillusionment and depending on your view, that could be either entering, exiting or there to stay. Not surprisingly some cheerleaders thought that saying FCoE was in the trough of disillusionment was being cynical, while some cynics were cheerleading.

My point around FCoE is that any technology or paradigm that goes through a hype cycle that will actually have long term legs or be around for years if not decades goes through a post initial hype disillusionment phase before reappearing. Technologies or trends that go through the trough of disillusionment that will eventually reappear sometimes go to Some Day Isle for rest and relaxation (R and R). Some Day Isle for those not familiar with it is a visional or fictional place that some day you will go to, a wishful happy place so to speak that is perfect for hyperbole R and R. After some R and R, these trends, technologies or techniques often reappear well rested and ready for the next wave of buzz, fud, hype and activity.

Some Day Isle where technologies or trends go for R and R

Certainly there have been and will continue to be more battles or matches tied to early deployments along with plenty of hype or FUD. After all, if FCoE were to simply pack up and go away like some cynics or naysayers suggest, what will they have to talk, blog, write or speak about? Similarly if FCoE magically goes mainstream tomorrow, the cheerleaders will have to find a new bandwagon or Shiny New Toy (SNT) to rally around.

Also as I have said in the past, its not if, rather when FCoE will be deployed in yours or your customers environment along with how and using what tools or technologies. Another question to pose around FCoE as a converged technology is will you use it in a true converged manner meaning adapting how server, storage and networking resources are managed including best practices? Or, will you use FCoE in a hybrid SAN or LAN mode using traditional SAN and LAN management practice and separate teams perhaps even battling over who owns the tools or technology.

Fwiw, in case you did not pick up on it from my previous posts, tips, articles and coverage in books, I think that FCoE has a very bright future as does NAS and iSCSI along with shared SAS as complimentary technologies when used for the applicable scenario.

What is your take, Is FCoE struggling to gain traction?

Is FCoE on a normal technology evolution path and timeline?

Is it too early to tell what the future holds for FCoE?

Is FCoE too little to late and if so why?

Ok, nuff said for now.

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

StorageIO V20.11 (2011) out and about events seminars web casts schedule

Wed, 30 Mar 2011 23:32:23 CST

By Greg Schulz

StorageIO V20.11 (2011) out and about events seminars web casts schedule

The V20.11 (e.g. 2011 or follow up from V20.10) Server and StorageIO (StorageIO) out and about events schedule continues to evolve.

In the meantime, here are a few (actually a couple dozen) seminars and web casts currently on the event calendar for 2011 that I will be speaking or presenting at. Topics and themes include Server and Storage Optimization, Clouds, Virtualization, Data Protection Modernization (HA, BC, DR, Backup/restore) along with Data Footprint Reduction (DFR including archive, compression, dedupe), End to End (E2E) Management, efficient IT data centers (and storage) among other related items.

Later this summer watch for the release of my new book Cloud and Virtual Data Storage Networking (CRC) as well as keep an eye on the StorageIO events page for additional events or details to appear. Also check out the news page for commentary on industry activities, announcements, trends or related topics in addition to the tips (or articles) page. You can also view videos, webinars and pod casts along with news letters containing links from while out and about during 2011 activities (or from past events).

When	Venue	Event Name	Location
Nov 10, 2011		Data Center Summit BC and DR Track Key note speaker: Protect, preserve and server your organizations essential applications and information services in an affordable manner	Los Angeles, CA
Nov 8, 2011		Data Center Summit BC and DR Track Key note speaker: Protect, preserve and server your organizations essential applications and information services in an affordable manner	Seattle, WA
Nov 3, 2011		Data Center Summit BC and DR Track Key note speaker: Protect, preserve and server your organizations essential applications and information services in an affordable manner	Denver, CO
Nov 1, 2011		Data Center Summit BC and DR Track Key note speaker: Protect, preserve and server your organizations essential applications and information services in an affordable manner	Chicago, IL
Sept 29, 2011		Data Center Summit BC and DR Track Key note speaker: Protect, preserve and server your organizations essential applications and information services in an affordable manner	Minneapolis, MN
Aug 4, 2011		Data Center Summit BC and DR Track Key note speaker: Protect, preserve and server your organizations essential applications and information services in an affordable manner	San Francisco, CA
Jul 28, 2011		Data Center Summit BC and DR Track Key note speaker: Protect, preserve and server your organizations essential applications and information services in an affordable manner	Houston, TX
Jul 21, 2011		Event keynote Speaker: Data Center Summit: Virtualization, Business Continuity and Cloud Computing	Raleigh, NC
Jun 28, 2011		Data Center Summit BC and DR Track Key note speaker: Protect, preserve and server your organizations essential applications and information services in an affordable manner	Boston, MA
June 23, 2011		Data Center Summit BC and DR Track Key note speaker: Protect, preserve and server your organizations essential applications and information services in an affordable manner	New York City
June 21, 2011		Event keynote Speaker: Data Center Summit: Virtualization, Business Continuity and Cloud Computing	Tampa, FL
May 18, 2011		Keynote: 2011 Virtualization Best Practices	Irvine, CA
May 12, 2011		Keynote: 2011 Virtualization Best Practices	Chicago, IL
May 10, 2011		Keynote: 2011 Virtualization Best Practices	Dallas, TX
May 5, 2011		Keynote: 2011 Virtualization Best Practices	New York, NY
May 3, 2011		Keynote: 2011 Virtualization Best Practices	Boston, MA
Apr 28, 2011		Data Center Summit BC and DR Track Key note speaker: Protect, preserve and server your organizations essential applications and information services in an affordable manner	Dallas, TX
Apr 12, 2011		Event keynote Speaker: Data Center Summit: Virtualization, Business Continuity and Cloud Computing	St. Louis, MO
Mar 29, 2011	Webcast	Cloud and Virtual BC/DR	Webcast
Mar 24, 2011	Webcast	Tapes Evolving Data Storage Role	Webcast
Mar 15, 2011	Wildfire Grille	Keynote: Virtualization, storage and the enterprise cloud	Eden Prairie, MN
Feb 10, 2011		Guest participant - Enabling safe and secure SaaS	On demand eSeminar
Jan 31, 2011	century College	Cloud and Virtual Data Storage Networking: Industry Trends	Mahtomedi MN
Jan 12, 2011		Presenter - E2E Awareness and insight for cloud, virtualized and legacy IT environments See more here including viewing the webcast	Virtual event More information

Watch here for more events updates and information as well as signup for the free StorageIO news letter here.

Nuff said for now, look forward to seeing as well as hearing from you while out and about during 2011.

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

NetApp buying LSIs Engenio Storage Business Unit

Thu, 10 Mar 2011 05:43:21 CST

By Greg Schulz

NetApp buying LSIs Engenio Storage Business Unit

This has been a busy week as on Monday Western Digital (WD) announced that they were buying the disk drive business from Hitachi Ltd. (e.g. HGST) for about $4.3 billion USD. The deal includes about $3.5B in cash and 25 million WD common shares (e.g. $750M USD) which will give Hitachi Ltd. about ten (10) percent ownership in WD along with adding two Hitachi persons onto the WD board of directors. WD now moves into the number one hard disk drive (HDD) spot above Seagate (note Hitachi is not selling HDS) in addition to giving them a competitive positioning in both the enterprise HDD as well as emerging SSD markets.

Today NetApp announced that they have agreed to purchase portions of the LSI storage business known as Engenio for $480M USD.

The business and technology that LSI is selling to NetApp (aka Engenio) is the external storage system business that accounted for about $705M of their approximate $900M+ storage business in 2010. This piece of the business represents external (outside of the server) shared RAID storage systems that support Serial Attached SCSI (SAS), iSCSI, Fibre Channel (FC) and emerging FCoE (Fibre Channel over Ethernet) with SSD, SAS and FC high performance HDDs as well as high capacity HDDs. NetApp has block however there strong suit (sorry netapp guys) is file while Engenio strong suit is block that attaches to gateways from NetApp as well as others in addition to servers for scale out NAS and cloud.

What NetApp is getting from LSI is the business that sells storage systems or their components to OEMs including Dell, IBM (here and here), Oracle, SGI and TeraData (a former NCR spin off) among others.

What LSI is retaining are their custom storage silicon, ICs, PCI RAID adapter and host bus adapter (HBA) cards including MegaRAID, 3ware along with SAS chips, SAS switches, PCI SSD card and the Onstor NAS product they acquired about a year ago. Other parts of the LSI business which makes chips for storage, networking and communications vendors is also not affected by this deal.

In other words, the sign in front of the Wichita LSI facility that used to say NCR will now probably include a NetApp logo once the deal closes.

For those not familiar, Tom Georgens current CEO of NetApp is very familiar with Engenio and LSI as he used to work there (after leaving a career at EMC). In fact Mr. Georgens was part of the most recent attempt to spin the external storage business out of LSI back in the mid 2000s when it received the Engenio name and branding. In addition to Tom Georgens, Vic Mahadevan the current NetApp Chief Strategy Officer recently worked at LSI and before that at BMC, Compaq and Maxxan among others.

What do I mean by the most recent attempt to spin the storage business out of LSI? Simple, the Engenio storage business traces its lineage back to NCR and what become known as Symbiosis Logic that LSI acquired as part of some other acquisitions.

Going back to the late 90s, there was word on the street that the then LSI management was not sure what to do with storage business as their core business was and still is making high volume chips and related technologies. Current LSI CEO Abhi Talwalkar is a chip guy (nothing wrong with that) who honed his skills at Intel. Thus it should not be a surprise that there is a focus on the LSI core business model of making their own as well as producing silicon (not the implant stuff) for IT and consumer electronics (read their annual report).

As part of the acquisition, LSI has already indicated that they will use all or some of the cash to buy back their stock. However I also wonder if this does not open the door for Abhi and his team to do some other acquisitions more synergic with their core business.

What does NetApp get:

Expanded OEM and channel distribution capabilities
Block based products to coexist with their NAS gateways
Business with an established revenue base
Footprint into new or different markets
Opportunity to sell different product set to existing customers

NetApp gets an OEM channel distribution model to complement what they already have (mainly IBM) in addition to their mainly direct sales and with VARs. Note that Engenio went to an all OEM/distribution model several years ago maintaining direct touch support for their partners.

Note that NetApp is providing financial guidance that the deal could add $750M to FY12 which is based on retaining some portion of the existing OEM business however moving into new markets as well as increasing product diversity with existing direct customers, vars or channel partners.

NetApp also gets to address storage market fragmentation and enable OEM as well as channel diversification including selling to other server vendors besides IBM. The Engenio model in addition to supporting Dell, IBM, Oracle, SGI and other server vendors also involves working with vertical solution integrator OEMs in the video, entertainment, High Performance Compute (HPC), cloud and MSP markets. This means that NetApp can enter new markets where bandwidth performance is needed including scale out NAS (beyond what NetApp has been doing). This also means that NetApp gets a product to sell into markets where back end storage for big data, bulk storage, media and entertainment, cloud and MSP as well as other applications leverage SAS, iSCSI or FC and FCoE beyond what their current lineup offers. Who sells into those spaces? Dell, HP, IBM, Oracle, SGI and Supermicro among others.

What does LSI get:

$480M USD cash and buy back some stock to keep investors happy
Streamline their business or open door for new ones
Perhaps increase OEM sales to other new or existing customers
Perhaps do some acquisitions or be acquired

What does Engenio get:
A new parent that hopefully invest in the technology and marketing of the solution sets as well as leverage or take care of the installed base of customers

What do the combined Engenio and NetApp OEMs and partners get:
With combination of the organizations, hopefully streamlined support, service, and marketing, product enhancements to address new or different needs. Possibly comfort in knowing that Engenio now has a home and its future somewhat known.

What about the Engenio employees?
The reason I bring this up is wondering what happens to those who have many years invested and their LSI stock which I presume they keep hoping that the sale gives them a future return on their investment or efforts. Having been in similar acquisitions in the past, it can be a rough go however if the acquirer has a bright future, than enough said.

Some random thoughts:

Is this one of those industry trendy, sexy, cool everybody drooling type deals with new and upcoming technology and marketing buzz? No

Is this one of those industry deals that has good upside potential if executed upon and leveraged? Yes

Netapp already has a storage offering why do they need Engenio? No offense to NetApp, however they have needed a robust block storage offering to complement their NAS file serving and extensive software functionality to move into to different markets. This is not all that different from what EMC needed to do in the late 90s extending their capabilities from their sole cash cow platform Symmetrix to acquire DG to have a mid range offering.

NetApp is risking $480M on a business with technologies that some see or say is on the decline, so why would they do such a thing?

Ok, lets set the technology topics aside, from a pure numbers perspective, lets take two scenarios and Im not a financial person so go easy on me please. What some financial people have told me with other deals is that its sometimes about getting a return on cash vs. it not doing anything. So with that and other things in mind, say NetApp just lets $480M sit in the bank, can they get 12 per cent or better interest? Probably not and if they can, I want the name of that bank. What that means is that for a five year period, if they could get that rate of return (12 percent), they would only make $824M-480M=$344M on the investment (I know, there are tax and other financial considerations however lets keep simple). Now lets take another scenario, assume that NetApp simply rides a decline of the business at say a 20 percent per year rate (how many business are growing or in storage declining at 20 percent per year?) for five years. That works out to about $1.4B yield. Lets take a different scenario and assume that NetApp can simply maintain an annual run rate of $700-750M for that five years, that works out to around $3.66B-480M=$3.1B revenue or return on investment. In other words, even with some decline, over a five year period, the OEM business pays for the deal alone and perhaps helps funds investment in technology improvement with the business balance being positive upside.

Now both of those are extreme scenarios so lets take something more likely such as NetApp being able to simply maintain a 700-750M run rate by keeping some of the OEM business, finding new markets for challenge and OEM as well as direct, expanding footprint into their markets. Now that math gets even more interesting. Having said all of that, NetApp needs to keep investing in the business and products to get those returns which might help explain the relative low price to run rate.

Is this a good deal for NetApp?
IMHO yes, as long as NetApp does not screw it up. If NetApp can manage the business, invest in it, grow into new markets instead of simple cannibalization, they will have made a good deal similar to what EMC did with DG back in the late 90s. However NetApp needs to execute, leverage what they are buying, invest in it and pick up new business to make up for the declining business with some of the OEMs.

With several hundred thousand systems or controllers having been sold over the years (granted how many are actually running is your guess as good as mine), NetApp has a footprint to leverage with their other products. For example, should IBM, Dell or Oracle completely walk away from those installed footprints, NetApp can move in with firmware or other upgrades to support plus up sell with their NAS gateways to add value with compression, dedupe, etc.

What about NetApps acquisition track record? Fair question although Im sure the NetApp faithful wont like it. NetApp has had their ups and downs with acquisitions (Topio, Decru, Spinaker, Onaro, etc), perhaps with this one like EMC in the late 90s who bought DG to overcome some rough up and down acquisitions can also get their mojo on. (See this post).While we are on the topic of acquisitions, NetApp recently bought Akorri and last year Bycast which they now call StorageGrid that has been OEMd in the past by IBM. Guess what storage was commonly used under the IBM servers running the Bycast software? If you guessed XIV you might want to take a mulligan or a do over. Btw, HP also has OEMd the Bycast software. If you are not familiar with Bycast and interested in automated movement, tiering, policy management, objects and other buzzwords, ping your favorite NetApp person as it is a diamond in the rough if leveraged beyond healthcare capabilities.

What does this mean for Xyratex and Dothill who are NetApp partners?
My guess is that for now, the general purpose enclosures would stay the same (e.g. Xyratex) until there is a business case to do something different. For the high density enclosures, that could be a different scenario. As for others, we will have to wait and see.

Will NetApp port OnTap into Engenio?
The easiest and fastest thing is to do what NetApp and Engenio OEM customers have already been doing, that is, place the Engenio arrays behind the NetApp fas vfiler. Note that Engenio has storage systems that speak SAS to HDDs and SSDs as well as able to speak SAS, iSCSI and FC to hosts or gateways. NetApp has also embraced SAS for back end storage, maybe we will see them leverage a SAS connection out of their filers in the future to SAS storage systems or shelves instead of FC loop?

Speaking of SAS host or server attached storage, guess what many cloud, MSP, high performance and other environment are using for storage on the back end of their clusters or scale out NAS systems?
Yup, SAS.

Guess what gap NetApp gets to fill joining Dell, HP, IBM and Oracle who can now give a choice of SAS, iSCSI or FC in addition or NAS?
Yup, SAS.

Care to guess what vendor we can expect to hear downplay SAS?
Hmm

Is this all about SAS?
No

Will this move scare EMC?
No, EMC does not get scared, or at least that is what they tell me.

Will LSI buy Fusion IO who has or is filing their documents to IPO or someone else?
Your guess or speculation is better than mine.

Why only $480M for a business that did $705M in 2010?
Good question. There is risk in that if NetApp does not invest in the product, marketing, relationships that they will not see the previous annual run rate so it is not a straight annuity. Consequently NetApp is taking risk with the business and thus they should get the reward if they can run with it. Another reason is that there probably were not any investment bankers or brokers running up the price.

Why didnt Dell buy Engenio for $480M?
Good question, if they had the chance, they should have however it probably would not have been a good fit as Dell needs direct sales vs. OEM sales.

Ok, nuff said (for now).

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

Cloud conversations: Loss of data access vs. data loss

Tue, 1 Mar 2011 22:47:07 CST

By Greg Schulz

Cloud conversations: Loss of data access vs. data loss

Have you hugged your cloud or MSP lately?

Why give a cloud a hug and what does it have to do with loss of data access vs. loss of data?

First there is a difference between actually losing data and losing access to it.

Losing data means that you have no backup or copy of the information thus it is gone. This means there are no good valid backups, snapshots, copies or archives that can be used to restore or recover the information.

Losing access to data means that there is a copy of it somewhere however it will take time to make it usable (no data was actually lost). How long you have to wait until the data is restored or recovered will vary and during that time it may seem like data was lost.

Second, industry hype for and against clouds serves as a lighting rod for when things happen.

Lighting recently struck (or at least virtually) with some outages (see links below) including at Google Gmail.

Cloud crowd cheerleaders may need a hug to feel good while they or their technology get tossed about a bit. Google announced that they had a service disruption recently however that data was not lost, only loss of access for a period of time.

Lets take a step back before going forward.

With the Google Gmail disruption, following on previous incidents, true cynics and naysayers will probably jump on the anti cloud FUD feeding frenzy. The true cloud cynics will tell the skeptics all about cloud challenges perhaps never having had actually used any service or technology themselves.

Cloud crowd cheerleaders are generally a happy go lucky bunch with virtual beliefs and physical or real emotions. Cloud crowd cheerleaders have a strong passion for their technology or paradigm taking it various serious in some instances perceiving attacks or fud against cloud as an attack on them or their belief. Some cheerleaders will see this post as snarky or cynical (ok, get over it already).

Ongoing poll at StorageIOblog.com, click on the image to cast your vote.

Then there are the skeptics or interested audience who are not complete cynics or cheerleaders (those in the middle 80 percent of the above chart).

Generally speaking they want to learn more, understand issues to work around or take appropriate steps and institute best practices. They see a place for MSP or cloud services for some things to compliment what they are currently doing and tend to be the majority of audiences outside of special interest, vendor or industry trade groups.

Some additional thoughts, comments and perspectives:

Loss of data means you cannot get it back to a specific RPO (Recovery Point Objective or how much data you can afford to lose). Loss of access to data means that you cannot get to your data until a specific RTO (Recovery Time Objective).

Tiered data protection, RTO and RPOs, align technique and technology to SLO needs

RTO and RPOs

RAID and replication provide accessibility to data not data protection. The good news with RAID and replication or mirroring is if you make a change to the data it is copied or protected. The bad news is if it is deleted or corrupted that error or problem is also replicated.

Backup, snapshots, CDP or other time interval based techniques protect data against loss however may require time to restore, recovery or refresh from. A combination of data availability and accessibility along with time interval based protection are needed (e.g. the two previous above items should be combined). CDP should also mean complete, consistent, coherent or comprehensive data protection including data in application or VM buffers.

Any technology will fail either on its own or via human intervention or lack of configuration. It is not if rather when as well as how gracefully a failure along with fault isolation occurs and is remediate (corrected). There is generally speaking, no such thing as a bad technology, rather poor or inappropriate use, configuration or deployment of it.

Protect onsite data with offsite mediums including MSP or cloud backup services while keeping a local onsite copy. Why keep an onsite local copy when using a cloud? Simple, when you lose access to the cloud or MSP for extended periods of time, if needed you have a copy of data to work with (assuming it is still valid). On other hand, important data that is onsite needs to be kept offsite. Hence cloud and MSP should compliment what is done for data protection and vise versa. Thats what I do, is what you do?

The technology golden rule which applies to cloud and virtualization is whoever controls the management of the technology controls the gold. Leverage CDP, which is Commonsense Data Protection or Cloud Data Protection. Hops are great in beer (as well as some other foods) however they add latency including with networks. Aggregation can cause aggravation, not everything can be consolidated, however much can be virtualized.

Here are some related blog posts:

Additional links to related articles and commentary:

Closing thoughts and comments (for now) regarding clouds.

Its not if, rather when, where, why, how and with what will you leverage a cloud or MSP technologies, products, service, solution or architectures to compliment your environment.

How will cloud or MSP work for you vs. you working for it (unless you actually do work for one of them).

Dont be scared of clouds or virtualization, however look before you leap!

BTW, for those in the Minneapolis St. Paul area (aka the other MSP), check out this event on March 15, 2011. I have been invited to talk about optimizing your data storage and virtual environments and be prepared to take advantage of cloud computing opportunities as they mature.

Nuff said for now

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC) at http://storageio.com/books
twitter @storageio

What do you need when its time to buy a new server?

Tue, 1 Mar 2011 07:47:07 CST

By Greg Schulz

What do you need when its time to buy a new server?

You have been told by someone or determined on your own that it is time for a new server, however what to get?

A blade server, rack mount, floor model, physical or virtual perhaps cloud?

How about one that is fully configured and accessorized to meet your specific environments needs?

There are several considerations involving what type of server or computer is needed to meet your specific needs or application requirements. Options include price, packaging, vendor preferences, blade center, freestanding, 1U rack mount, virtual and cloud support, with or without storage and networking, performance as well as power and cooling among other considerations.

Here is a link (PDF version here, may require registration) to an article that I put together to help determine your needs as well as consider various options for your next server.

Hope you find the information useful!

Nuff said for now

Cheers gs

From bits to bytes: Decoding Encoding

Tue, 1 Mar 2011 07:07:07 CST

By Greg Schulz

From bits to bytes: Decoding Encoding

With networking, care should be taken to understand if a given speed or performance capacity is being specified in bits or bytes as well as in base 2 (binary) or base 10 (decimal). Another consideration and potential point of confusion are line rates (GBaud) and link speed which can vary based on encoding and low level frame or packet size. For example 1GbE along with 1, 2, 4 and 8Gb Fibre Channel along with Serial Attached SCSI (SAS) use an 8b/10b encoding scheme. This means that at the lowest physical layer 8bits of data are placed into 10bits for transmission with 2 bits being for data integrity.

With an 8Gb link using 8b/10b encoding, 2 out of every 10 bits are overhead. To determine the actual data throughput for bandwidth, or, number of IOPS, frames or packets per second is a function of the link speed, encoding and baud rate. For example, 1Gb FC has a 1.0625 Gb per second speed which is multiple by the current generation so 8Gb FC or 8GFC would be 8 x 1.0625 = 8.5Gb per second.

Remember to factor in that encoding overhead (e.g. 8 of 10 bits are for data with 8b/10b) and usable bandwidth on the 8GFC link is about 6.8Gb per second or about 850Mbytes (6.8Gb / 8 bits) per second. 10GbE uses 64b/66b encoding which means that for every 64 bits of data, only 2 bits are used for data integrity checks thus less overhead.

What do all of this bits and bytes have to do with clouds and virtual data storage network?

Quite a bit when you consider what we have talked about the need to support more information processing, moving as well as storing in a denser footprint.

In order to support higher densities faster servers, storage and networks are not enough and require various approaches to reducing the data footprint impact.

What this means is for fast networks to be effective they also have to have lower overhead to avoid moving more extra data in the same amount of time instead using that capacity for productive work and data.

PCIe leverages multiple serial unidirectional point to point links, known as lanes, compared to traditional PCI that used a parallel bus based design. With traditional PCI, the bus width varied from 32 to 64 bits while with PCIe, the number of lanes combined with PCIe version and signaling rate determines performance. PCIe interfaces can have one, two, four, eight, sixteen or thirty two lanes for data movement depending on card or adapter format and form factor. For example, PCI and PCIx performance can be up to 528 MByte per second with 64 bit 66 MHz signaling rate.

	PCIe Gen 1	PCIe Gen 2	PCIe Gen 3
Giga transfers per second	2.5	5	8
Encoding scheme	8b/10b	8b/10b	128b/130b
Data rate per lane per second	250MB	500MB	1GB
x32 lanes	8GB	16GBs	32GB

Table 1: PCIe generation comparisons

Table 1 shows performance characteristics of PCIe various generations. With PCIe Gen 3, the effective performance essentially doubles however the actual underlying transfer speed does not double as it has in the past. Instead the improved performance is a combination of about 60 percent link speed and 40 percent efficiency improvements by switching from an 8b/10b to 128b/130b encoding scheme among other optimizations.

Serial interface	Encoding
PCIe Gen 1	8b/10b
PCIe Gen 2	8b/10b
PCIe Gen 3	128b/130b
Ethernet 1Gb	8b/10b
Ethernet 10Gb	64b/66b
Fibre Channel 1/2/4/8 Gb	8b/10b
SAS 6Gb	8b/10b

Table 2: Common encoding

Bringing this all together is that in order to support cloud and virtual computing environments, data networks need to become faster as well as more efficient otherwise you will be paying for more overhead per second vs. productive work being done. For example, with 64b/66b encoding on a 10GbE or FCoE link, 96.96% of the overall bandwidth or about 9.7Gb per second are available for useful work.

By comparison if an 8b/10b encoding were used, the result would be only 80% of available bandwidth for useful data movement. For environments or applications this means better throughput or bandwidth while for applications that require lower response time or latency it means more IOPS, frames or packets per second.

The above is an example of where a small change such as the encoding scheme can have large benefit when applied to high volume or large environments.

Learn more in The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC) at http://storageio.com/books

Nuff said for now

Cheers gs

Greg Schulz
twitter @storageio

Winter 2011 Server and StorageIO News Letter

Thu, 17 Feb 2011 23:03:03 CST

By Greg Schulz

Winter 2011 Server and StorageIO News Letter

Winter 2011 Newsletter

Welcome to the Winter 2011 edition of the Server and StorageIO Group (StorageIO) newsletter. This follows the Fall 2011 edition.

You can access this news letter via various social media venues (some are shown below) in addition to StorageIO web sites and subscriptions. Click on the following links to view the Winter 2011 edition as an HTML or PDF or, to go to the newsletter page to view previous editions.

Follow via Goggle Feedburner here or via email subscription here.

You can also subscribe to the news letter by simply sending an email to newsletter@storageio.com

Enjoy this edition of the StorageIO newsletter, let me know your comments and feedback.

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

Tape talk time

Thu, 17 Feb 2011 05:43:21 CST

By Greg Schulz

Tape talk time

For being a declared dead or zombie technology (here, here or here) tape remains very much alive however its role is changing. There is no disputing that hard disk drives (HDDs) are continuing to expand their role for data protection including backup/restore, BC and DR where tape has been used for decades.

What is also occurring is that tapes role is changing from day to day backup to that of longer term data preservation including archiving with more data stored on tape today than in past history at a lower cost. In fact the continued reduced cost per tape and improved capacity as well as utilization has worked against tape from a marketing competitive standpoint. For example if you look at a chart showing tape (media and drive) revenues you see a decline, similar to what was seen a couple of years ago for HDDs.

What is not shown on some charts are how many units (drives or media) shipped with more capacity for a given price (again what was reported for HDDs a few years ago) when net capacity had increased. Vendors of tape technology have also had a rather low profile particular for those with other technologies that have received more marketing resources (people, time, money). After all, if a product is on a plateau of productivity and profitability why spend time or effort on extensive marketing or promotion vs. directing resources to get new items into the market.

As a result, for those looking to make a case that tape is on the decline based on revenues to convince customers to move away from that technology should have a marketing freebie. Recently Oracle announced a new large capacity tape drive and media following on previous announcements of enhanced LTO roadmap and future 35TByte tape capabilities announced January 2010 by Fujifilm and IBM.

For those who are interested following are some links to various topics including how SSD, HDD and tape can coexist complementing each other for different roles or functions. As to those who do not like tape, feel free to read if you like as there is also material on SSD, HDD, dedupe, cloud, data protection and other topics.

Some previous blog posts:

Here are some additional articles, commentary and reports pertaining to tape related topics:

Want another example of why tape is alive or proof of life? Check out Greg Duplessie (Steves brother) upcoming Tape Summit media event (more here or sponsor info here) to generate awareness and coverage of the tape ecosystem.

Something tells me we will be hearing, reading or watching more about tape being alive in the months to come.

Nuff said for now

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

Securing data at rest: Self Encrypting Disks (SEDs)

Thu, 17 Feb 2011 02:34:56 CST

By Greg Schulz

Securing data at rest: Self Encrypting Disks (SEDs)

Here is a link to a recent guest post that I was invited to do over at The Virtualization Practice (TVP) pertaining to Self Encrypting Disk (SEDs).

Based on the trusted computing group (TCG) DriveTrust and OPAL disk drive security models, SEDs offload encryption to the disk drive while complimenting other encryption security solutions to protect against theft or lost storage devices. There is another benefit however for SEDs which is simplifying the process of decommissioning a storage device safely and quickly.

If you are not familiar with them, SEDs perform encryption within the hard disk drive (HDD) itself using the onboard processor and resident firmware. Since SEDs only protect data at rest, other forms of encryption should be combined to protect data in flight or on the move.

There is also another benefit of SEDs in that for those of you concerned about how to digital destroy, shred or erase large capacity disks in the future, you may have a new option. While intended for protecting data, a byproduct is that when a SED is removed from the system or server or controller that it has established an affinity with, its contents are effectively useless until reattached. If the encryption key for a SED is changed, then the data is instantly rendered useless, or at least for most environments.

Learn more about SEDs here and via the following links:

Self-Encrypting Drives for IBM System x
Trusted Computing Group OPAL Summary
Storage Performance Council (SPC) SED and Non SED benchmarks
Seagate SED information
Trusted Computing Group SED information

Nuff said for now

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

What do VARs and Clouds as well as MSPs have in common?

Wed, 9 Feb 2011 23:01:23 CST

By Greg Schulz

What do VARs and Clouds as well as MSPs have in common?

Several things it turns out:

Some Value Added Resellers (VARS) (links to VAR related content and comments here, here and here) sell cloud services or solutions
Some VARs are also cloud or managed solutions providers (MSPs) themselves, thus some cloud or MSPs are VARs
Some VARs, cloud and MSPs compete on lowest or cheapest price
Some VARs, cloud and MSPs have diverse product offering portfolios
Some VARs, cloud and MSPs compete on value (e.g. not price)
Some VARs cloud and MSPs value is in the trust and security or piece of mind that they provide

For some, the value of a given VAR, cloud or MSP is the ability to shop around for a resource to get the lowest price.

For others, the value of a given VAR, cloud or MSP is the ability to get the best value which may not be the lowest price, however may be the most effective overall cost, services, trust, security, experience and peace of mind.

Value to often is confused with cheap or low cost.

However value can also mean a slightly higher price that includes more thus providing a better effective option.

On the other hand, higher priced should not be confused with always being a better product or service.

Watch out for hidden fees or add on charges when evaluating and acquiring technologies or services that have an initial value of being lower cost.

You may find that the initial low cost requires other add on fees or charges for installation, surcharges for use or activity along with optional services to make the solution useful resulting in an overall higher amount to be paid.

Lowest cost may result in a bargain now and then or if that is what fits your needs, then that is what is probably best for you.

However value can also mean a better option providing an improved return on investment if the solution or service meets and exceeds your needs and expectations.

As an example, I recently switched from a cloud backup MSP (Mozy) not due to cost (costs would have gone down with their recent service plan
announcement) rather I needed more value and functionality. With my new cloud backup MSP I get more functionality and capability that I can continue to grow into even though the price per GByte is higher than with my previous provider. What made the change of positive is what I get in the higher fee per GByte that in the end, actually makes it more affordable, not cheaper, just better value and return on investment.

For some low cost is value while for others, value is more than lowest cost including what you get for a given fee including trust, security, service and experience among other items. Different people will have different requirements or needs for what is or is not value.

If you do not like the term value, then try price performer.

Bottom line for now, with VARs, MSPs and Cloud (Public or private) dont be scared, however look before you leap!

Cheers
gs

Nuff said for now

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

What have I been doing this winter?

Wed, 9 Feb 2011 21:12:21 CST

By Greg Schulz

Its been almost a month since my last post and want to say hello and let you know what I have been doing.

What I have been doing is:

Accumulating a long list of ideas for upcoming blog post, article, tips, webinars and other content.
Recording some podcasts, web casts doing interviews and commentary along with a few articles here and there.
Working with some new venues where if all comes together you should be seeing material or commentary appearing soon.
Filling some dates for the 2011 out and about events and activities page.
Doing research in several different areas as well as working with clients on various project activities, many of which that are NDA.
Getting some recently finished content ready to appear on the main web site as well as in the blog and other venues.
Attending vendor events and briefing sessions on solutions some of which are yet to be announced.
Enjoying the cold and snowy winter as best as can be (see some videos here) while trying to avoid cold and flue season.

In addition to the above, I have been trying to stay very focused on is getting my new book which is titled Cloud and Virtual Data Storage Networking (CRC) wrapped up for a summer 2011 release. This is my third solo book project that is in addition to co writing or contributing to several other book projects.

Im doing the project the old fashioned way which means writing it myself as opposed to using ghost writers along with a traditional publishing house (CRC, same as my last book) all of which takes a bit more time. For anyone who has done a project like this you know what is involved. For those who have not it includes research, writing, editing, working with editors and copyeditors, subject matter experts doing initial reviews, illustrations and page layouts, markups, more edits and proofs. Then there are the general project management activities along with marketing and rollout plans, companion presentation material working with the publisher and others.

Anyway, hope you are all doing well, look forward to sharing more with you soon, now it is time to get back to work...

Nuff said for now

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

Are you on the StorageIO IT Data Infrastructure industry links page?

Wed, 9 Feb 2011 20:02:20 CST

By Greg Schulz

Hey IT data infrastructure vendors, VARs or service providers, are you on the Server and StorageIO IT industry interesting links page?

Dont worry, its free and no obligation!

There are no hidden charges or fees, you will not be obligated to pay a fee or subscribe to a service, or be called or contacted via a sales or account manager person to buy something. Nor will you be required to sign up for a annual or short term retainer, make a donation, honorarium, endowment, contribution, subsidy, renumerate or sponsor in any other manner directly or via indirect means including second, third, fourth or by way of other virtual means or physical means. This also means via other organizations, venues, institutes, associations, communities, events or causes. (Btw, that is some industry humor some will get however to others that feel it is poking fun of their lively hoods, too bad!)

Your contact information will not be sold, bartered, traded, borrowed or abused being kept confidential nor will you be called or bothered (contact me if somebody does reach out to you). However you may get an occasional Server and StorageIO newsletter sent to you via email (privacy and disclosure statement can be found here).

There is however one small caveat and that is no spamming and direct submissions on yours or your companies behalf. If you are a public relations firm feel free to submit on behalf of your own organization, however have your clients submit on their own (or use their identity when doing so on their own behalf).

Why do I make this links page and list available for free to those who read it, as well as to those who are on it?

Simple, I use it myself to keep a list of companies, firms or organizations that are involved with data infrastructures (servers, storage, I/O and networking, hardware, software, services) that I have come across and worth keeping track of that I also feel worth sharing with others.

Of course, if you feel compelled, you can always contact Server and StorageIO to discuss other services or simply buy one of my books including Resilient Storage Networks: Designing Flexible Scalable Data Infrastructures (Elsevier), The Green and Virtual Data Center (CRC) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC) at Amazon or one of the other many fine global venues.

Still interested, all you need to do is the following:

No SPAM submission please

Please do not submit via web or blog page unless you want your contact information known to others.

Send an email to links at storageio dot com that includes the following:

1. Your company name
2. Your company URL
3. Your company contact person (you or someone else) including:
Name
Title or position
Phone or Skype
Email
Optional twitter

4. Brief 40 character or less description of what you do, or solution categories (tip, avoid superlatives, see links page for ideas)

5. Optionally indicate to DND (Do Not Disturb) you with email newsletters, coverage or mentions.

Again, please, No Spam!

Its that simple.

Now its up to you to decide if you want to be included or not.

Nuff said for now

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

NetApp and Akorri: An E2E cross technology domain SRA play

Fri, 14 Jan 2011 02:33:02 CST

By Greg Schulz

The other day NetApp announced that it was planning on doing another acquisition following on their recent purchase of Bycast (policy based storage and management software).

This time, NetApp is doing yet another software acquisition of Infrastructure Resource Management (IRM) as well as End to End (E2E) cross technology domain management and Storage or Systems Resource Analysis (SRA) startup Akorri which also builds on its past acquisition of SRA solution Onaro.

Is this a good move by NetApp?

Assuming they got a good price, yes, this has very potential for NetApp assuming they can assimilate the solution as well as articulate where it fits complimenting its other management tools including SANscreen (aka Onaro).

Is Akorii a good product?

Yes, most of the customers and var partners of Akorri that I talk to have great things to say and having looked into the technology, it has lots of good potential for NetApp. However, there is a common theme around Akorri that has been its high price, something that was also heard from Onaro customers before NetApp did that acquisition. If NetApp can leverage its direct as well as partner touch to reduce the cost of sale for Akorri as well as rationalize the pricing or at least better articulate the value proposition to make it a must have vs nice to have, they can do well.

The importance of E2E awareness of IT resources across different technology domains (or focus areas) is that you can not effectively manage what you do not have timely access or visibility into. Hence the theme of session being You cannot effectively manage what you do not know about in a timely manner. I recently did a couple of Industry Trends and Perspectives webcast events around the topic and themes of End to End (E2E) awareness and cross domain (or technology) management insight for cloud, virtual and other abstracted as well as physical IT environments.

Nuff said for now

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

E2E Awareness and insight for IT environments

Thu, 13 Jan 2011 21:21:21 CST

By Greg Schulz

I recently did a couple of Industry Trends and Perspectives webcast events around the topic themes of End to End (E2E) awareness as well as cross domain (or technology) management insight for cloud, virtual or other abstracted as well as physical IT environments.

Here is the abstract for the webcast:

Virtualization, clouds and other forms of abstraction help IT organizations enable flexible and scalable services delivery. While abstraction of underlying resources simplifies services delivery from an IT customers perspective, additional layers of technology along with interdependencies still need to be tracked as well as managed. A key enabler for IT organizations is having end to end (E2E) situational awareness of available resources and how they are being used. By having timely situational awareness across various technology domains, IT organizations gain insight into how resources can be more effectively deployed in an efficient manner.

Join independent IT industry analyst, author and blogger Greg Schulz as he looks at common challenges as well as opportunities for leveraging E2E situational awareness to remove blind spots from efficient effective IT services delivery. Greg will look several scenarios including among others cost reduction, maximize resource usage, shrink migration and data consolidation times for cloud, virtual and traditional IT environments while maintaining or enhancing IT services delivery.

If you are interested in IT Infrastructure Resource Management (IRM) of servers, storage, IO networking, virtualization, cloud, backup or restore, optimization as well as cloud or legacy environments and metrics, I invite you to view the following web cast.

Click on the above image to access the BrightTalk web cast from their recent Virtualization Summit series (may require registration)

If you are interested, here is a link to a previous post I did on E2E management, SRA (systems or storage resource analysis) and management insight along with a recent related white paper sponsored by SANpulse that you can access here.

More later

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

What records will EMC break in NYC January 18, 2011?

Thu, 13 Jan 2011 19:19:19 CST

What records will EMC break in NYC January 18, 2011?

In case you have not seen or heard, EMC is doing an event next week in New York City (NYC) at the AXA Equitable Center winter weather snow storm clouds permitting (and adequate tools or technologies to deal with the snow removal), that has a theme around breaking records. If you have yet to see any of the advertisements, blogs, tweets, facebook, friendfeed, twitter, yourtube or other mediums messages, here (and here and here) are a few links to learn more as well as register to view the event.

Click on the above image to see more

There is already speculation along with IT industry wiki leaks of what will be announced or talked about next week that you can google or find at some different venues.

The theme of the event is breaking records.

What might we hear?

In addition to the advisor, author, blogger and consultant hats that I wear, Im also in the EMCs analysts relations program and as such under NDA, consequently, what the actual announcement will be next week, no comment for now. BTW, I also wear other hats including one from Boeing even though I often fly on Airbus products as well.

Other hats I wear

However, how about some fun as to what might be covered at next week with getting into a wiki leak situation?

A no brainier would be product (hardware, software, services) related as it is mid January and if you have been in the industry for more than a year or two, you might recall that EMC tends to a mid winter launch around this time of year along with sometimes an early summer refresh. Guess what time of the year it is.
Im guessing lots of superlatives, perhaps at a record breaking pace (e.g. revolutionary first, explosive growth, exponential explosive growth, perfect storm among others that could be candidates for the Storagebrain wall of fame or shame)
Maybe we will even hear that EMC has set a new record of number of members in Chads army aka the vspecialists focused on vSphere related topics along with a growing (quietly) number of Microsoft HyperV specialist.
That EMC has a record number of twitter tweeps engaged in conversations (or debates) with different audiences, collectives, communities, competitors, customers, individuals, organizations, partners or venues among others.
Possibly that their involvement in the CDP (Carbon Disclosure Project) has resulted in enough savings to offset the impact of hosting the event making it carbon and environment neutral. After all, we already know that EMC has been in the CDP as in Continual or Constant Data Protection as well as Complete or Comprehensive Data Protection along with Cloud Data Protection not to mention Common Sense Data Protection (CSDP) for sometime now.
Perhaps something around the number of acquisitions, patents, products, platforms, products and partners they have amassed recently.
For investors, wishful thinking that they will be moving their stock into record territories.
Im also guessing we will hear or see a record number of tweets, posts, videos and stories.
To be fair and balanced, Im also expecting a record number of counter tweets, counter posts, counter videos and counter stories coming out of the event.

Some records I would like to see EMC break however Im not going to hold my breath for at least for next week include:

Announcement of upping the game in performance benchmarking battles with record setting or breaking various SPC benchmark results submitted on their own (instead of via a competitor or here) in different categories of block storage devices along with entries for SSD based, clustered and virtualized. Of course we would expect to hear how those benchmarks and workload simulations really do not matter which would be fine, at least they would have broken some records.
Announcement of having shipped more hard disk drives (HDD) than anyone else in conjunction with shipping more storage than anyone else. Despite being continually declared dead (its not) and SSD gaining traction, EMC would have a record breaking leg to stand on if the qualify amount of storage shipped as external or shared or networked (SAN or NAS) as opposed to collective (e.g. HP with servers and storage among others).
Announcement that they are buying Cisco, or Cisco is buying them, or that they and Cisco are buying Microsoft and Oracle.
Announcement of being proud of the record setting season of the Patriots, devastated to losing a close and questionable game to the NY Jets, wishing them well in the 2010 NFL Playoffs (Im just sayin...).
Announcement of being the first vendor and solution provider to establish SaaS, PaaS, IaaS, DaaS and many other XaaS offerings via their out of this world new moon base (plans underway for Mars as part of a federated offering).
Announcement that Fenway park will be rebranded as the house that EMC built (or rebuilt).

Disclosure: I will be in NYC on Tuesday the 18th as one of EMCs many guests that they have picked up airfare and lodging, thanks to Len Devanna and the EMC social media crew for reaching out and extending the invitation.

Other guests of the event will include analysts, advisors, authors, bloggers, beat writers, consultants, columnist, customers, editors, media, paparazzi, partners, press, protesters (hopefully polite ones), publishers, pundits, twitter tweepps and writers among others.

I wonder if there will also be a record number of disclosures made by others attending the event as guests of EMC?

More after (or maybe during) the event.

Ok, nuff fun and said for now, thats a wrap (for now).

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio

As the Hard Disk Drive (HDD) continues to spin

Mon, 3 Jan 2011 23:41:32 CST

Despite having been repeatedly declared dead at the hands of some new emerging technology over the past several decades, the Hard Disk Drive (HDD) continues to evolve as it moves towards its 60th birthday.

More recently HDDs have been declared dead due to flash SSD that according to some predictions, should have caused the HDD to be extinct by now.

Meanwhile, having not yet died in addition to having qualified for its AARP membership a few years ago, the HDD continues to evolve in capacity, smaller form factor, performance, reliability, density along with cost improvements.

Back in 2006 I did an article titled Happy 50th, hard drive, but will you make it to 60?

IMHO it is safe to say that the HDD will be around for at least a few more years if not another decade (or more).

This is not to say that the HDD has outlived its usefulness or that there are not other tiered storage mediums to do specific jobs or tasks better (there are).

Instead, the HDD continues to evolve and is complimented by flash SSD in a way that HDDs are complimenting magnetic tape (another declared dead technology) each finding new roles to support more data being stored for longer periods of time.

After all, there is no such thing as a data or information recession!

What the importance of this is about technology tiering and resource alignment, matching the applicable technology to the task at hand.

Technology tiering (Servers, storage, networking, snow removal) is about aligning the applicable resource that is best suited to a particular need in a cost as well as productive manner. The HDD remains a viable tiered storage medium that continues to evolve while taking on new roles coexisting with SSD and tape along with cloud resources. These and other technologies have their place which ideally is finding or expanding into new markets instead of simply trying to cannibalize each other for market share.

Here is a link to a good story by Lucas Mearian on the history or evolution of the hard disk drive (HDD) including how a 1TB device that costs about $60 today would have cost about a trillion dollars back in the 1950s. FWIW, IMHO the 1 trillion dollars is low and should be more around 2 to 5 trillion for the one TByte if you apply common costs for management, people, care and feeding, power, cooling, backup, BC, DR and other functions.

Here are some related links and posts:

Hybrid Hard Disk Drives (HHDD) (combine flash + RAM along with an integrated HDD)
7.2K RPM 2.5 inch SAS (or SATA) 1TB HDD
Top 10 technologies that remain the backbone of storage
Hard disk drives density improvements with perpendicular recording (from 2006)
Seagate discusses HAMR (Heat Assisted Magnetic Recording) and BPM (Bit Patterned Media)

IMHO, it is safe to say that the HDD is here to stay for at least a few more years (if not decades) or at least until someone decides to try a new creative marketing approach by declaring it dead (again).

Ok, nuf said for now.

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC) and Resilient Storage Networks (Elsevier)
twitter @storageio

Green IT goes mainstream: What about data storage environments?

Mon, 3 Jan 2011 21:01:02 CST

I recently did an interview with the folks over at Infortrend (a RAID storage company) discussing various industry trends and perspectives including RAID, data footprint reduction (DFR) as well as Green IT including how the Green Gap.

The Green Gap is the disconnect between common messaging around carbon and environment vs. IT and business productivity sustainment challenges that continues to result in confusion along with missed opportunities.

There is no such thing as a data or information recession
Organizations of all size will continue to have to support growth in a denser fashion
Doing more in a denser manner also means acquiring as well as managing more usable IT resources per dollar spent
Optimization and data footprint reduction (DFR) expands focus from reduction efficiency to productivity effectiveness
Energy efficiency shifts from avoidance to energy effectiveness where more work is done to support business productivity and sustainment
RAID is alive however it continues to evolve as well as leveraged in conjunction with other techniques

Here is the link to the first of a two part series where you can read my comments on how many organizations are missing out on economic as well as business sustainability benefits due to confusion and the Green Gap among other topics.

Ok, nuf said for now.

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC) and Resilient Storage Networks (Elsevier)
twitter @storageio

Site news: Full RSS archive feeds are now available (http://storageioblog.com/RSSfullArchive.xml)

Sat, 25 Jun 2011 10:12:34 CST

To speed up access to the StorageIO and StorageIOblog site RSS full and RSS summary feeds, older posts have been moved to a new archive RSS feed. Theese changes are only to the RSS full and summary feed files, no changes have been made to the StorageIOblog site.

View or access the full StorageIO RSS feed (httP://storageioblog.com/RSSfullArchive.xml) here.

Enjoy the faster access RSS full and summary feed, plus archived feeds. Ok, nuf said for now

Cheers gs

Greg Schulz - Author The Green and Virtual Data Center (CRC), Resilient Storage Networks (Elsevier) and coming summer 2011 Cloud and Virtual Data Storage Networking (CRC)
twitter @storageio