Announcing SAS SANs for Dummies book, LSI edition

There is a new (free) book that I’m a co-author of along Bruce Grieshaber and Larry Jacob (both of LSI) along with foreword by Harry Mason of LSI and President of the SCSI Trade Association titled SAS SANs for Dummies compliments of LSI.

SAS SANs for Dummies, LSI Edition

This new book (ebook and print hard copy) looks at Serial Attached SCSI (SAS) and how it can be used beyond traditional direct attached storage (DAS) configurations for support various types of storage mediums including SSD, HDD and tape. These configuration options include as entry-level SAN with SAS switches for small clusters or server virtualization, or as shared DAS as well as being a scale out back-end solution for NAS, object, cloud and big data storage solutions.

Here is the table of contents (TOC) of SAS SANs for Dummies

Chapter 1: Data storage challenges

  • Storage Growth Demand Drivers
  • Recognizing Challenges
  • Solutions and Opportunities
  • Chapter 2: Storage Area Networks

  • Introducing Storage Area Networks
  • Moving from Dedicated Internal to Shared Storage
  • Chapter 3: SAS Basics

  • Introducing the Basics of SAS
  • How SAS Functions
  • Components of SAS
  • SAS Target Devices
  • SAS for SANs
  • Chapter 4: SAS Usage Scenarios

  • Understanding SAS SANs Usage
  • Shared SAS SANs Scenarios including:
    • SAS in HPC environments
    • Big data and big bandwidth
    • Database, e-mail, back-office
    • NAS and object storage servers
    • Cloud, wen and high-density
    • Server virtualization

    Chapter 5: Advanced SAS Topics

  • The SAS Physical Layer
  • Choosing SAS Cabling
  • Using SAS Switch Zoning
  • SAS HBA Target Mode
  • Chapter 6: Nine Common Questions

  • Can You Interconnect Switches?
  • What Is SAS Cable Distance?
  • How Many Servers Can Be In a SAS SAN?
  • How Do You Manage SAS Zones?
  • How Do You Configure SAS for HA?
  • How Does SAS Zoning Compare to LUN Mapping?
  • Who Has SAS Solutions?
  • How Do SAS SANs Compare?
  • Where Can You Learn More?
  • Chapter 7: Next Steps

  • SAS Going Forward
  • Next Steps
  • Great Take Away’s
  • Regardless of if you are looking to use SAS as a primary SAN interface, or leverage it for DAS or implementing back-end storage for big-data, NAS, object, cloud or other types of scalable storage solutions, check out and get your free copy of SAS SANs for Dummies here compliments of LSI.

    SAS SANs for Dummies, LSI Edition

    Click here to ask your free copy of SAS SANs for Dummies compliments of LSI, tell them Greg from StorageIO sent you and enjoy the book.

    Ok, nuff said.

    Cheers Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved

    How can direct attached storage (DAS) make a comeback if it never left?

    Server and StorageIO industry trend and perspective DAS

    Have you seen or heard the theme that Direct Attached Storage (DAS), either dedicated or shared, internal or external is making a comeback?

    Wait, if something did not go away, how can it make a comeback?

    IMHO it is as simple as for the past decade or so, DAS has been overshadowed by shared networked storage including switched SAS, iSCSI, Fibre Channel (FC) and FC over Ethernet (FCoE) based block storage area networks (SAN) and file based (NFS and Windows SMB/CIFS) network attached storage (NAS) using IP and Ethernet networks. This has been particularly true by most of the independent storage vendors who have become focused on networked storage (SAN or NAS) solutions.

    However some of the server vendors have also jumped into the deep end of the storage pool with their enthusiasm for networked storage, even though they still sell a lot of DAS including internal dedicated, along with external dedicated and shared storage.

    Server and StorageIO industry trend and perspective DAS

    The trend for DAS storage has evolved with the interfaces and storage mediums including from parallel SCSI and IDE to SATA and more recently 3Gbs and 6Gbs SAS (with 12Gbs in first lab trials). Similarly the storage mediums include a mix of fast 10K and 15K hard disk drives (HDD) along with high-capacity HDDs and ultra-high performance solid state devices (SSD) moving from 3.5 to 2.5 inch form factors.

    While there has been a lot of industry and vendor marketing efforts around networked storage (e.g. SAN and NAS), DAS based storage was over shadowed so it should not be a surprise that those focused on SAN and NAS are surprised to hear DAS is alive and well. Not only is DAS alive and well, it’s also becoming an important scaling and convergence topic for adding extra storage to appliances as well as servers including those for scale out, big data, cloud and high density not to mention high performance and high productivity computing.

    Server and StorageIO industry trend and perspective DAS

    Consequently its becoming ok to talk about DAS again. Granted you might get some peer pressure from your trend setting or trend following friends to get back on the networked storage bandwagon. Keep this in mind, take a look at some of the cool trend setting big data and little data (database) appliances, backup, dedupe and archive appliances, cloud and scale out NAS and object storage systems among others and will likely find DAS on the back-end. On a smaller scale, or in high-density rack deployments in large cloud or similar environments you may also find DAS including switched shared SAS.

    Does that mean SANs are dead?
    No, not IMHO despite what some vendors marketers and their followers will claim which is ironic given how some of them were leading the DAS is dead campaign in favor of iSCSI or FC or NAS a few years ago. However simply comparing DAS to SAN or NAS in a competing way is like comparing apples to oranges, instead, look at how and where they can complement and enable each other. In other words, different tools for various tasks, various storage and interfaces for different needs.

    Thus IMHO DAS never left or went anywhere per say, it just was not fashionable or cool to talk about until now as it is cool and trend to discuss it again.

    Ok, nuff said for now.

    Cheers Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved

    Dell is buying Quest software, not the phone company Qwest

    Dell Storage Customer Advisory Panel (CAP)

    For those not familiar with Quest, they are a software company not to be confused with the telephone communications company formerly known as Qwest (aka now known as centurylink).

    Both Dell and Quest have been on software related acquisition initiatives that past few years with Quest having purchased vKernel, Vizoncore (vRanger virtualization backup), BakBone (who had acquire Alavarii and Asempra) for traditional backup and data protection among others. Not to be out done, as well as purchasing Quest, Dell has also more recently bought Appassure (Disclosure: StorageIOblog site sponsor) for data protection, Sonicwall and Wyse in addition to some other recent purchases (ASAP, Boomi, Compellent, Exanet, EqualLogic, Force10, InsightOne, KACE, Ocarina, Perot, RNA and Scalent among others).

    What does this mean?
    Dell is expanding the scope of their business with more products (hardware, software), solution bundles, services and channel partnering opportunities Some of the software tools and focus areas that Quest brings to the Dell table or portfolio include:

    Database management (Oracle, SQLserver)
    Data protection (virtual and physical backup, replication, bc, dr)
    Performance monitoring (DCIM and IRM) of applications and infrastructure
    User workspace management (application delivery)
    Windows server management (migrate and manage, AD, exchange, sharepoint)
    Identify and access management (security, compliance, privacy)

    What does Dell get by spending over $2B USD on quest?

  • Additional software titles or product
  • More software developers for their Software group
  • Sales people to help promote, partner and sell software solutions
  • Create demand pull for other Dell products and services via software
  • Increase its partner reach via existing Quest VARs and business partners
  • Extend the size of the Dell software and intellectual property (IP) portfolio
  • New revenue streams that compliment existing products and lines of business
  • Potential for better rate of return on some of its $12B USD in cash or equivalence

    Is this a good move for Dell?
    Yes for the above reasons

  • Is there a warning to this for Dell?
    Yes, they need to execute, keep the Quest team focused along with their other teams on the respective partners, products and market opportunities while expanding into new areas. Dell needs to also leverage Quest to further its cause in creating trust, confidence and strategic relationships with channel partners to reach new markets in different geographies. In addition, Dell needs to articulate its strategy and positioning of the various solutions to avoid products being perceived as competing vs. complimenting each other.

    Additional Dell related links:
    Dell Storage Customer Advisory Panel (CAP)
    Dell Storage Forum 2011 revisited
    Dude, is Dell doing a disk deal again with Compellent?
    Data footprint reduction (Part 2): Dell, IBM, Ocarina and Storwize
    Post Holiday IT Shopping Bargains, Dell Buying Exanet?
    Dell Will Buy Someone, However Not Brocade (At least for now)

    Ok, nuff said for now

    Cheers Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved

    EMCworld 2012: Trust and marketing, can they coexist?

    Storage I/O Industry Trends and Perspectives

    Recently while at EMCworld in Las Vegas (Thanks btw to EMC who covered coach airfare and 3 nights hotel) I had the opportunity along with group of other industry analysts and advisors to have a series of small group meeting sessions with key EMC leadership.

    EMC world

    These sessions included time with Chairman of the Board of Directors and Chief Executive Officer Joe Tucci, Chairmen of VCE Michael Capellas (who is also on the Cisco Board of Directors), President and Chief Operating Officer, EMC Information Infrastructure and Cloud Services Howard Elias, President and Chief Operating Officer, EMC Information Infrastructure Products Pat Gelsinger, and Executive Vice President and Chief Marketing Officer (CMO) Jeremy Burton.

    Joe Tucci is always fun to listen and engage with in small groups and conveys a cordial confidence when you meet face to face. Howard Elias who is now heading up the services business talked about walking the talk with services, public and private cloud including what EMC is doing internally. Michael Capellas had some good insight into what he is doing with VCE, along with his role on the Cisco BOD. Pat Gelsinger had some interesting points however seemed a bit more reserved than in earlier sessions. Jeremy Burton who is normally associated with the effective marketing company or everything movie campaigns at EMC did not use any backdrops, visual aids, theatrics or Vegas style entertainment during his session.

    Of the above-mentioned executives, the one that impressed me the most, and talking with other analysts/advisors had similar perspectives was Jeremy Burton. I have seen and heard him talk before in live and virtual venues along with what he is doing to focus EMC messaging and themes.

    A common comment and theme in talking with other analysts and advisors was that in five minutes, Jeremy did more to advance, clarify, articulate and explain who EMC is, what they are doing now and for the future.

    Image courtesy of EMC.com

    Trust was one of the themes of the EMCworld event as it pertains to collaborating with vendors and service providers as well as consultants, advisors and others. Trust is also important for going to the cloud on a public or private basis. It is easy to talk about trust however, it is also something that is earned and is important to keep up and protect. Normally given some of the stigma associated with marketing and or sales, trust too often becomes a punch line or term tossed around with skepticism, cynicism or empty promises. The reason I bring trust up in this discussion was that in Jeremy’s interaction with those in the room, whether others realized it or not, he was working on planting the seeds and establishing the basis for trust.

    Does that mean there is automatic trust now in anything that EMC or their marketing organization says or more so than what heard from other organizations? Perhaps some will automatically take what is heard and go with that as gospel however, they may be doing that already. For others who are skeptical by default and do their homework, analysis, research and other related tasks, they may be more likely to give the benefit of the doubt vs. automatically questioning everything looking for multiple confirmations and added fact checking.

    As for me, I generally take what any vendor or their pundits say with a grain of salt giving benefit of doubt where applicable unless trust has been previously impacted. In the case of EMC, I generally take what they say with a grain of salt. However, a level of trust and confidence can make validating what they say sometimes easier than with others. This is in part due to knowing where to go internally for details and information including NDA based material and the good job their analyst relations team and other group do on building and keep up relationships.

    Does this mean I like EMC more or less than other vendors? It means there is a level of trust, communication, relationship, contact, interaction and access to resources with EMC that might be more or less than with other vendors.  Disclosure EMC along with some companies they have acquired have been past clients.

    Now back to Jeremy.

    What impressed me the most was while other executives were engaging to different degrees, when I asked Jeremy how he and EMC balances entertainment (videos and movies, theatrics), education (expanding knowledge of EMC solutions, technology advancement) and being engaging (not just sales calls, social media, golfing or other in person activities) to drive business economics his response included all three of those aspects.

    Storage I/O Industry Trends and Perspectives

    Ok, I know, some of you should be saying that is the job and role of a marketing person to be an effective communicator which I would agree, however why don’t more marketers do a more effective job of what they do?

    In other words, Jeremy educated by sharing what and why they are doing certain things, Jeremy engaged with the entire audience while answering my question however not singular responding to me, he also entertained with some of his answers while also keeping them to the point, not rambling on. Afterwards I had a few minutes to talk one on one with Jeremy without the handlers or others and I can say it was refreshing and as is too of the case with marketers, there is trust.

    That does not mean I will take anything verbatim or follow the scripts or other things the truth squads want preached or handed out from EMC, Jeremy or any other vendor for that matter.

    I can say that in the few minutes up close and in a smaller setting, EMC has a secret weapon who can do more to build and convey trust and that is Jeremy Burton, hope I am not wrong ;).

    Ok, nuff said for now

    Cheers Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved

    NetApp on rough ground, or a diamond in the rough?

    Storage I/O Industry Trends and Perspectives

    In case you missed it, NetApp announced their most recent quarterly earnings a few weeks ago which in themselves were not bad. However what some of their competition jumping up and down for joy while others are scratching their heads is the forward-looking guidance given by NetApp.

    NetApp can be seen as being on rough ground given their forward-looking guidance over the next year which could be seen as either very conservative, or an admission that they are not growing as fast as some of their competitors are challenging them.

    Reading between the lines, looking at various financial and other resources in addition to factoring in technology items, there is more to NetApp then meets the eye and current stock price or product portfolio.

    For example, NetApp is sitting on over $4 Billion USD cash that they could use for an acquisition, buying back stock, launching a major sales and marketing initiative to expand into new or adjacent markets or other activities. Speaking of acquisitions, NetApp has done some in the past including Spinnaker, which is now integrated with Ontap (e.g. clustering), Topio, Decru (security encryption) and Onaro (DCIM and IRM management software tools). More recently, NetApp has acquired Bycast (archiving and policy storage management software), Akorri (capacity management and DCIM and IRM software) and Engenio. NetApp is also maintaining good margins via both direct, channel and OEM activities while launching new products such as the channel and SMB focused FAS 2220.

    Its arguable depending upon your point of view (or who you for or are a fan of) if NetApp has all the right product pieces now, in the works, or on their radar for acquisitions. Assuming that NetApp has the pieces, they also need to move beyond selling simply what is on the truck or what is safe and comfortable or perhaps easy to sell. This is not to say that NetApp is not being effective in selling what they have and pushing the envelope, however keeping in mind who their main competitor is, the old sales saying of being able to sell ice to an Eskimo comes to mind.

    Two companies on parralel tracks offset by time: EMC and NetApp

    In the case of NetApp, when the competition makes an issue about scalibility or performance of their flagship storage systems FAS and Ontap storage software, change the playing field leveraging all the tools in their portfolio. NetApp like EMC before them is figuring out how to sell via different channels or venues their complete portfolio with a mix of direct, channel and OEM. After all, it seems like only yesterday that EMC was trying to figure out where and when to sell CLARiiON (e.g. now VNX) as opposed to avoiding competing with the Symmetrix (aka now the VMAX) not to mention expanding from a direct to channel and OEM model. Perhaps NetApp can continue to figure out how to leverage more effectively the Engenio E series for big bandwidth beyond their current OEMs. NetApp can also leverage their existing partners who have embraced Bycast (aka StorageGrid) while finding new ones.

    The reality is that NetApp is being challenged by EMC who is moving down market into some of NetApp’s traditional accounts along with in the scale-out NAS and big data sectors. This is where NetApp can leverage their technical capabilities including people combined with some effective sales and marketing execution to change the playing field vs. responding to EMC and others.

    NetApp has many of the pieces, parts, products, people, programs and partners so now how can they leverage those to expand both their revenues, as well as support margin to grow the business, unless they are looking to be acquired.

    I still subscribe that NetApp and EMC are two similar companies on parallel tracks offset by time, by about a decade or decade and a half.

    Storage I/O Industry Trends and Perspectives

    Thus, IMHO NetApp is a diamond in the rough, granted I am guessing EMC and some others do not see it that way. However, there was a time when EMC was seen as a diamond in the rough while others discounted that notion, particularly an Itty Bitty Manufacturing company from New York who is now focusing on services among other things.

    Keep in mind however, diamonds can also be lost or taken as well as there can be fake gems.

    Here are some related links:
    Unified storage systems showdown: NetApp FAS vs. EMC VNX
    Two companies on parallel tracks moving like trains offset by time: EMC and NetApp
    NetApp buying LSI’s Engenio Storage Business Unit

    Ok, nuff said for now

    Cheers Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved

    Why FC and FCoE vendors get beat up over bandwidth?

    Storage I/O Industry Trends and Perspectives

    Have you noticed how Fibre Channel (FC) and FC over Ethernet (FCoE) switch and adapter vendors and their followers focus around bandwidth vs. response time, latency or other performance activity? For example, 8Gb FC (e.g. 8GFC), or 10Gb as opposed to latency and response time, or IOPS and other activity indicators.

    When you look at your own environment, or that of a customers or prospects or hear of a conversation involving storage networks, is the focus on bandwidth, or lack of it, or perhaps throughput being a non-issue? For example, a customer says why go to 16GFC when they are barely using 8Gb with their current FC environment.

    This is not a new phenomenon and is something I saw when working for a storage-networking vendor who had SAN, MAN and WAN solutions (E.g. INRANGE). Those with networking backgrounds tended to focus on bandwidth when discussing storage networks while those with storage, server or applications background also look at latency or IO completion time (response time), queuing, message size, IOPs or frames and packets per second. Thus there are different storage and networking metrics that matter that are also discussed further in my first book Resilient Storage Networks: Designing Flexible Scalable Data Infrastructures.

    When I hear a storage networking vendor talk about their latest 16GFC based product I like to ask them what is the biggest benefit vs. 8GFC and not surprisingly, the usual response is like twice the bandwidth. When I ask them about what that means in terms of more IOPS in a given amount of time, or reduced IO completion time, lower latency, sometimes I often get the response along the lines of Yeah, that too, however it has twice the bandwidth.

    Ok, I get it, yes, bandwidth is important for some applications, however so too are activity measured in IOPS, transactions, packets, frames, pages, sequences and exchanges among other units of measure along with response time and latency (e.g. different storage and networking metrics that matter).

    What many storage networking vendors actually get, however they don’t talk about it for various reasons, perhaps because they are not be asked about it, or engaged in the conversation is that there is an improvement in response time in going from such as 8GFC to 16GFC. Likewise, there can be improvements in response time in addition to the more commonly discussed bandwidth.

    If you are a storage networking switch, adapter or other component vendor, var or channel partner expand your conversation to include activity and response time as part of your value proposition. Likewise, if you are a customer, ask your technology providers to expand on the conversation of how new technologies help in areas other than bandwidth.

    Ok, nuff said for now

    Cheers Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved

    How much SSD do you need vs. want?

    Storage I/O Industry Trends and Perspectives

    I have been getting asked by IT customers, VAR’s and even vendors how much solid state device (SSD) storage is needed or should be installed to address IO performance needs to which my standard answer is it depends.

    I also am also being asked if there is rule of thumb (RUT) of how much SSD you should have either in terms of the number of devices or a percentage; IMHO, the answer is it depends. Sure, there are different RUTs floating around based on different environments, applications, workloads however are they applicable to your needs.

    What I would recommend is instead of focusing on percentages, RUTs, or other SWAG estimate’s or PIROMA calculations, look at your current environment and decide where the activity or issues are. If you know how many fast hard disk drives (HDD) are needed to get to a certain performance level and amount of used capacity that is a good starting point.

    If you do not have that information, use tools from your server, storage or third-party provider to gain insight into your activity to help size SSD. Also if you have a database environment and are not familiar with the tools, talk with your DBA’s to have them run some reports that show performance information the two of you can discuss to zero in hot spots or opportunity for SSD.

    Keep in mind when looking at SSD what is that you are trying to address by installing SSD. For example, is there a specific or known performance bottleneck resulting in poor response time or latency or is there a general problem or perceived opportunity?

    Storage I/O Industry Trends and Perspectives

    Is there a lack of bandwidth for large data transfers or is there a constraint on how many IO operations per second (e.g. IOPS) or transaction or activity that can be done in a given amount of time. In other words the more you know where or what the bottleneck is including if you can trace it back to a single file, object, database, database table or other item the closer you are to answering how much SSD you will need.

    As an example if using third-party tools or those provided by SSD vendors or via other sources you decide that your IO bottleneck are database transaction logs and system paging files, then having enough SSD space capacity to fit those in part of the solution. However, what happens when you remove the first set of bottlenecks, what new ones will appear and will you have enough space capacity on your SSD to accommodate the next in line hot spot?

    Keep in mind that you may want more SSD however what can you get budget approval to buy now without having more proof and a business case. Get some extra SSD space capacity to use for what you are confident can address other bottlenecks, or, enable new capabilities.

    On other hand if you can only afford enough SSD to get started, make sure you also protect it. If you decide that two SSD devices (PCIe cache or target cards, drives or appliances) will take care of your performance and capacity needs, make sure to keep availability in mind. This means having extra SSD devices for RAID 1 mirroring, replication or other form of data protection and availability. Keep in mind that while traditional hard disk drive (HDD) storage is often gauged on cost per capacity, or dollar per GByte or dollar per TByte, with SSD measure its value on cost to performance. For example, how many IOPS, or response time improvement or bandwidth are obtained to meet your specific needs per dollar spent.

    Related links
    What is the best kind of IO? The one you do not have to do
    Is SSD dead? No, however some vendors might be
    Speaking of speeding up business with SSD storage
    Has SSD put Hard Disk Drives (HDD’s) On Endangered Species List?
    Why SSD based arrays and storage appliances can be a good idea (Part I)
    EMC VFCache respinning SSD and intelligent caching (Part I)
    SSD options for Virtual (and Physical) Environments Part I: Spinning up to speed on SSD

    Ok, nuff said for now

    Cheers Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved

    Spring (May) 2012 StorageIO news letter

    StorageIO News Letter Image
    Spring (May) 2012 News letter

    Welcome to the Spring (May) 2012 edition of the Server and StorageIO Group (StorageIO) news letter. This follows the Fall (December) 2011 edition.

    You can get access to this news letter via various social media venues (some are shown below) in addition to StorageIO web sites and subscriptions.

    Click on the following links to view the Spring May 2012 edition as an HTML or PDF or, to go to the news letter page to view previous editions.

    You can subscribe to the news letter by clicking here.

    Enjoy this edition of the StorageIO newsletter, let me know your comments and feedback.

    Nuff said for now

    Cheers
    Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved

    Various cloud, virtualization, server, storage I/O poll’s

    The following are a collection of on-going industry trends and perspectives poll’s pertaining to server, storage, IO, networking, cloud, virtualization, data protection (backup, archive, BC and DR) among other related themes and topics.

    In addition to those listed below, check out the comments section where additional poll’s are added over time.

    Storage I/O Industry Trends and Perspectives

    Here is a link to a poll as a follow-up to a recent blog post Are large storage arrays dead at the hands of SSD? (also check these posts pertaining to storage arrays and SSD and flash SSD’s emerging role).

    Poll: Are large storage arrays day’s numbered?

    Poll: What’s your take on magnetic tape storage?

    Poll: What do you think of IT clouds?

    Poll: Who is responsible for cloud storage data loss?

    Poll: What are the most popular Zombie technologies?

    Storage I/O Industry Trends and Perspectives

    Poll: What’s your take on OVA and other alliances?

    Poll: Where is most common form or concern of vendor lockin?

    Poll: Who is responsible for, or preventing vendor lockin?

    Poll: Is vendor lockin a good or bad thing?

    Poll: Is IBM V7000 relevant?

    Storage I/O Industry Trends and Perspectives

    Poll: What is your take on EMC and NetApp on similar tracks or paths?

    Poll: What’s your take on RAID still being relevant?

    Poll: What do you see as barriers to converged networks?

    Poll: Who are you?

    Poll: What is your preferred converged network?

    Storage I/O Industry Trends and Perspectives

    Poll: What is your converged network status?

    Poll: Are converged networks in your future?

    Poll: What do you think were top 2009 technologies, events or vendors?

    Poll: What technologies, events, products or vendors did not live up to 2009 predictions?

    Storage I/O Industry Trends and Perspectives

    Poll: What do you think of IT clouds?

    Poll: What is your take on the new FTC blogger disclosure guidelines?

    Poll: Is RAID dead?

    Poll: When will you deploy Windows 7? Note: I upgraded all my systems to Windows 7 during summer of 2011

    Poll: EMC and Cisco VCE, what does it mean?

    Poll: Is IBM XIV still relevant?

    Storage I/O Industry Trends and Perspectives

    Note: Feel free to share, use and make reference to the above poll’s and their results however please remember to attribute the source.

    Ok, nuff said for now

    Cheers Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved

    Are large storage arrays dead at the hands of SSD?

    Storage I/O trends

    An industry trends and perspective.

    .

    Are large storage arrays dead at the hands of SSD? Short answer NO not yet.
    There is still a place for traditional storage arrays or appliances particular those with extensive features, functionality and reliability availability serviceability (RAS). In other words, there is still a place for large (and small) storage arrays or appliances including those with SSDs.

    Is there a place for newer flash SSD storage systems, appliances and architectures? Yes
    Similar to how there is a place for traditional midrange storage arrays or appliances have found their roles vs. traditional higher end so-called enterprise arrays. Think as an example  EMC CLARiiON/VNX or HP EVA/P6000 or HDS AMS/HUS or NetApp FAS or IBM DS5000 or IBM V7000 among others vs. EMC Symmetrix/DMX/VMAX or HP P10000/3Par or HDS VSP/USP or IBM DS8000. In addition to traditional enterprise or high-end storage systems and midrange also known as modular, there are also specialized appliances or targets such as for backup/restore and archiving. Also do not forget the IO performance SSD appliances like those from TMS among others that have been around for a while.

    Is the role of large storage systems changing or evolving? Yes
    Given their scale and ability to do large amounts of work in a dense footprint, for some the role of these systems is still mission critical tier 1 application and data support. For other environments, their role continues to evolve being used for high-density tier 2 bulk or even near-line storage for on-line access at scale.

    Storage I/O trends

    Does this mean there is completion between the old and new systems? Yes
    In some circumstances as we have seen already with SSD solutions. Some will place as competing or replacements while others as complementing. For example in the PCIe flash SSD card segment EMC VFCache is positioned is complementing Dell, EMC, HDS, HP, IBM, NetApp, Oracle or others storage vs. FusionIO who positions as a replacement for the above and others. Another scenario is how some SSD vendors have and continue to position their all-flash SSD arrays using either drives or PCIe cards to complement and coexist with other storage systems in an environment (e.g. data center level tiering) vs. as a replacement. Also keep in mind SSD solutions that also support a mix of flash devices and traditional HDDs for capacity and cost savings or cloud access in the same solution.

    Does this mean that the industry has adopted all SSD appliances as the state of art?
    Avoid confusing industry adoption or talk with industry and customer deployment. They are similar, however one is focused on what the industry talks about or discusses as state of art or the future while the other is what customers are doing. Certainly some of the new flash SSD appliance and storage startups such as Solidfire, Nexgen, Violin, Whiptail or veteran TMS among others have promising futures, some of which may actually be in play with the current SSD market shakeout and consolidation.

    Does that mean everybody is going SSD?
    SSD customer adoption and deployment continues to grow, however so too does the deployment of high-capacity HDDs.

    Storage I/O trends

    Do SSDs need HDDs, do HDDs need SSDs? Yes
    Granted there are environments where needs can be addressed by all of one or the other. However at least near term, there is a very strong market for tiering and mix of SSD, some fast HDDs and lots of high-capacity HDDs to meet various needs including performance, availability, capacity, energy and economics. After all, there is no such thing, as a data or information recession yet budgets are tight or being reduced. Likewise, people and data are living longer.

    What does this mean?
    If there, were no such thing as a data recession and budgets a non-issue, perhaps everything could move to all flash SSD storage systems. However, we also know that people and data are living longer along with changing data life-cycle patterns. There is also the need for performance to close the traditional data center IO performance to space capacity gap and bottlenecks as well as store and keep data longer.

    There will continue to be a need for a mix of high-capacity and high performance. More IO will continue to gravitate towards the IO appliances, however more data will settle in for longer-term retention and continued access as data life-cycle continue to evolve. Watch for more SSD and cache in the large systems, along with higher density SAS-NL (SAS Near Line e.g. high capacity) type drives appearing in those systems.

    If you like new shiny new toys or technology (SNTs) to buy, sell or talk about, there will be plenty of those to continue industry adoption while for those who are focused on industry deployment, there will be a mix of new, and continued evolution for implementation.

    Related links
    Industry adoption vs. industry deployment, is there a difference?

    Industry trend: People plus data are aging and living longer

    No Such Thing as an Information Recession

    Changing Lifecycles & Data Footprint Reduction
    What is the best kind of IO? The one you do not have to do
    Is SSD dead? No, however some vendors might be
    Speaking of speeding up business with SSD storage
    Are Hard Disk Drives (HDD’s) getting too big?
    IT and storage economics 101, supply and demand
    Has SSD put Hard Disk Drives (HDD’s) On Endangered Species List?
    Why SSD based arrays and storage appliances can be a good idea (Part I)
    Researchers and marketers don’t agree on future of nand flash SSD
    EMC VFCache respinning SSD and intelligent caching (Part I)
    SSD options for Virtual (and Physical) Environments Part I: Spinning up to speed on SSD

    Ok, nuff said for now

    Cheers Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved

    Is SSD dead? No, however some vendors might be

    Storage I/O trends

    Is SSD dead? No, however some vendors might be

    In a recent conversation with Dave Raffo about the nand flash solid state disk (SSD) market, we talked about industry trends, perspectives and where the market is now as well as headed. One of my comments is, has been and will remain that the industry has still not reached anywhere near full potential for deployment of SSD for enterprise, SMB and other data storage needs. Granted, there is broad adoption in terms of discussion or conversation and plenty of early adopters.

    SSD and in particular nand flash is anything but dead, in fact in the big broad picture of things, it is still very early in the game. Sure, for those who cover and crave the newest, latest and greatest technology to talk about, nand flash SSD might seem old, yesterday news, long in the tooth and time for something else. However, for those who are focused on deployment vs. adoption such as customers, in general, nand flash SSD in its many packaging options has still not yet reached its full potential.

    Despite the hype, fanfare from CEOs or their evangelist along with loyal followers of startups that help drive industry adoption (e.g. what is talked about), there is still lots of upside growth in the customer drive industry deployment (actually buying, installing and using) for nand flash SSD.

    What about broad customer deployments?

    Sure, there are the marquee customer success stories that you need a high-capacity SAS or SATA drive to hold the YouTube videos, slide decks, press releases for.

    However, have we truly, reached broad customer deployment or broad industry adoption?

    Hence, I see more startups coming into the market space, and some exiting on their own, via mergers and acquisition or other means.

    Will we see a feeding frenzy or IPO craze as with earlier hype cycles of technologies, IMHO there will be some companies that get the big deal, some will survive as new players running as a business vs. running to be acquired or IPO. Others will survive by evolving into something else while others will join the where are they now list.

    If you are a SSD startup, CEO, CxO, or marketer, their PR, evangelist or loyal follower do not worry as the SSD market and even nand flash is far from being dead. On the other hand, if you think that it has hit its full stride, you are missing either the bigger picture, or too busy patting yourselves on the back for a job well done. There is much more opportunity out there and not even all the low hanging fruit has been picked yet.

    Check out the conversation with Dave Raffo along with comments from others here.

    Related links on storage IO metrics and SSD performance
    What is the best kind of IO? The one you do not have to do
    Is SSD dead? No, however some vendors might be
    Storage and IO metrics that matter
    IO IO it is off to Storage and IO metrics we go
    SSD and Storage System Performance
    Speaking of speeding up business with SSD storage
    Are Hard Disk Drives (HDD’s) getting too big?
    Has SSD put Hard Disk Drives (HDD’s) On Endangered Species List?
    Why SSD based arrays and storage appliances can be a good idea (Part I)
    IT and storage economics 101, supply and demand
    Researchers and marketers dont agree on future of nand flash SSD
    EMC VFCache respinning SSD and intelligent caching (Part I)
    SSD options for Virtual (and Physical) Environments Part I: Spinning up to speed on SSD
    SSD options for Virtual (and Physical) Environments Part II: The call to duty, SSD endurance
    SSD options for Virtual (and Physical) Environments Part III: What type of SSD is best for you?
    SSD options for Virtual (and Physical) Environments Part IV: What type of SSD is best for your needs

    Ok, nuff said for now

    Cheers Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved

    More storage and IO metrics that matter

    It is great to see more conversations and coverage around storage metrics that matter beyond simply focusing on cost per GByte or TByte (e.g. space capacity). Likewise, it is also good to see conversations expanding beyond data footprint reduction (DFR) from a space capacity savings or reduction ratio to also address data movement and transfer rates. Also good to see is increase in discussion around input/output operations per section (IOPs) tying into conversations from virtualization, VDI, cloud to Sold State Devices (SSD).

    Other storage and IO metrics that matter include latency or response time, which is how fast work is done, or time spent. Latency also ties to IOPS in that as more work arrives to be done (IOPS) of various size, random or sequential, reads or writes, queue depths are an indicator of how well work is flowing. Another storage and IO metric that matters is availability because without it, performance or capacity can be affected. Likewise, without performance, availability can be affected.

    Needless to say that I am just scratching the surface here with storage and IO metrics that matter for physical, virtual and cloud environments from servers to networks to storage.

    Here is a link to a post I did called IO, IO, it is off to storage and IO metrics we go that ties in themes of performance measurements and solid-state disk (SSD) among others. Also check out this piece about why VASA (VMware storage analysis metrics) is important to have your VMware CASA along with Windows boot storage and IO performance for VDI and traditional planning purposes.

    Check out this post about metrics and measurements that matter along with this conversation about IOPs, capacity, bandwidth and purchasing discussion topics.

    Related links on storage IO metrics and SSD performance
    What is the best kind of IO? The one you do not have to do
    Is SSD dead? No, however some vendors might be
    Storage and IO metrics that matter
    IO IO it is off to Storage and IO metrics we go
    SSD and Storage System Performance
    Speaking of speeding up business with SSD storage
    Are Hard Disk Drives (HDD’s) getting too big?
    Has SSD put Hard Disk Drives (HDD’s) On Endangered Species List?
    Why SSD based arrays and storage appliances can be a good idea (Part I)
    IT and storage economics 101, supply and demand
    Researchers and marketers dont agree on future of nand flash SSD
    EMC VFCache respinning SSD and intelligent caching (Part I)
    SSD options for Virtual (and Physical) Environments Part I: Spinning up to speed on SSD
    SSD options for Virtual (and Physical) Environments Part II: The call to duty, SSD endurance
    SSD options for Virtual (and Physical) Environments Part III: What type of SSD is best for you?
    SSD options for Virtual (and Physical) Environments Part IV: What type of SSD is best for your needs

    Ok, nuff said for now

    Cheers Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved

    What is the best kind of IO? The one you do not have to do

    What is the best kind of IO? The one you do not have to do

    data infrastructure server storage I/O trends

    Updated 2/10/2018

    What is the best kind of IO? If no IO (input/output) operation is the best IO, than the second best IO is the one that can be done as close to the application and processor with best locality of reference. Then the third best IO is the one that can be done in less time, or at least cost or impact to the requesting application which means moving further down the memory and storage stack (figure 1).

    Storage and IO or I/O locality of reference and storage hirearchy
    Figure 1 memory and storage hierarchy

    The problem with IO is that they are basic operation to get data into and out of a computer or processor so they are required; however, they also have an impact on performance, response or wait time (latency). IO require CPU or processor time and memory to set up and then process the results as well as IO and networking resources to move data to their destination or retrieve from where stored. While IOs cannot be eliminated, their impact can be greatly improved or optimized by doing fewer of them via caching, grouped reads or writes (pre-fetch, write behind) among other techniques and technologies.

    Think of it this way, instead of going on multiple errands, sometimes you can group multiple destinations together making for a shorter, more efficient trip; however, that optimization may also take longer. Hence sometimes it makes sense to go on a couple of quick, short low latency trips vs. one single larger one that takes half a day however accomplishes many things. Of course, how far you have to go on those trips (e.g. locality) makes a difference of how many you can do in a given amount of time.

    What is locality of reference?

    Locality of reference refers to how close (e.g location) data exists for where it is needed (being referenced) for use. For example, the best locality of reference in a computer would be registers in the processor core, then level 1 (L1), level 2 (L2) or level 3 (L3) onboard cache, followed by dynamic random access memory (DRAM). Then would come memory also known as storage on PCIe cards such as nand flash solid state device (SSD) or accessible via an adapter on a direct attached storage (DAS), SAN or NAS device. In the case of a PCIe nand flash SSD card, even though physically the nand flash SSD is closer to the processor, there is still the overhead of traversing the PCIe bus and associated drivers. To help offset that impact, PCIe cards use DRAM as cache or buffers for data along with Meta or control information to further optimize and improve locality of reference. In other words, help with cache hits, cache use and cache effectiveness vs. simply boosting cache utilization.

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    What can you do the cut the impact of IO

    • Establish baseline performance and availability metrics for comparison
    • Realize that IOs are a fact of IT virtual, physical and cloud life
    • Understand what is a bad IO along with its impact
    • Identify why an IO is bad, expensive or causing an impact
    • Find and fix the problem, either with software, application or database changes
    • Throw more software caching tools, hyper visors or hardware at the problem
    • Hardware includes faster processors with more DRAM and fast internal busses
    • Leveraging local PCIe flash SSD cards for caching or as targets
    • Utilize storage systems or appliances that have intelligent caching and storage optimization capabilities (performance, availability, capacity).
    • Compare changes and improvements to baseline, quantify improvement

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2026 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    More Storage IO momentus HHDD and SSD moments part II

    This follows the first of a two-part series on my latest experiences with Hybrid Hard Disk Drives (HHDD’s) and Solid State Devices (SSD’s). In my ongoing last momentus moment post I discussed what I have done with HHDD’s and setting the stage for expanded SSD use. I have the newer HHDD’s, e.g. Seagate Momentus XT II 750GB (8GB SLC nand flash) installed and have since bought another from Amazon as well as having some of the older 500GB (4GB SLC nand flash) in various systems. Those are all functioning great, however still waiting and looking forward to the rumored firmware enhancements to boost write capabilities.

    This brings me up to the latest momentus moment which now includes SSD’s.

    Well its two years later and I now have a 256GB (usable capacity is lower) Samsung SSD that I bought from Amazon.com and installed in one of my laptops and just as when I made the first switch to HHDD’s, I also have a backup copy/clone to fall back to in case of emergency.

    Was it worth the wait? Yes, particularly using the HHDD’s to bridge the gap and enable some productivity gain which more than paid for them based on some different projects. I’m already seeing productivity improvements that will make future upgrades more easy to justify (to myself).

    I deviated from my strategy a bit and installed the SSD about six months earlier than I was planning to do so because of a physical barrier. That physical barrier was my new traveling laptop only accepts 7mm height 2.5 inch small form factor devices and the 750GB HHDD that I had planned on installing was 2.5mm to thick which pushed up the SSD installation.

    What will become of the 750GB HHDD? Its being redeployed to help speed up file serving, backups and other functions.

    Will I replace the HHDD’s in my other workstations and laptops now with SSD’s? Across the board no, not yet, however there is one other system that is a prime candidate to maybe upgrade in a month or two (maybe less).

    Will I stick with the Samsung SSD’s or look at other options? I’m keeping my options open and using this as a gauge to test and compare other options in a real world working environment as opposed to a lab bench test simulation. In other words, taking the next step past the lab test and product reviews, gaining comfort and confidence and then trying out with real use activity.

    What will happen in the future as I install more SSD’s and have surplus HHDD’s? Redeployed them of course into file or NAS servers, backup targets that in turn will replace HDD’s that will either get retired, or redeployed to replace older, smaller capacity, higher cost to handle HDD’s used for offsite protection.

    I tried using the software that came with the SSD to do the cloning and should have known better, however wanted to see what the latest version of ghost was like (it was a waste of time to be polite). Instead I used Seagate Discwizard (aka Acronis) which requires at least one Seagate product (source or target) for cloning.

    Cloning from the Seagate HHDD that have been previously cloned from the Hitachi HDD that came with the laptop, was a none issue. However, I wanted to see what would happen if I attached the Samsung SSD to the Seagate Goflex cable and clone directly from the Hitachi HDD, it worked. Hence another reason to have some of the Seagate Goflex cables (USB and eSATA) like the ones I bought at Amazon.com around in your toolbox.

    While I do not have concrete empirical numbers to share, cloning from a HDD to a SSD is shall we say fast, however, what’s really fun to watch is cloning from a HHDD to a SSD using an eSata (GoFlex) connector adapter. The reason I say that it is fun is that you don’t have to sit and wait for hours, it’s not minutes to move 100s of GBs, however you can very much see the progress bar move at a good pace.

    Also, I put the HHDD on an eSata port and try that out as a backup or data dump target if you have the need for speed, capacity and cost effectiveness, yes its fast, has lots of capacity and so forth. Now if Seagate and Synology or EMC Iomega would get their acts together and add support for the HHDD’s in those different unified SMB and SOHO NAS solutions, that would be way cool.

    Will I be racing to put SSD’s in my other laptops or workstations soon? Probably not as there are things in the works and working their way into and through the market place that I wanted to wait for, and thus will wait for now, that is unless a more interesting opportunity pops up.

    Related links on SDD, HHDD and HDD
    More Storage IO momentus HHDD and SSD moments part I
    More Storage IO momentus HHDD and SSD moments part II
    IO IO it is off to Storage and IO metrics we go
    New Seagate Momentus XT Hybrid drive (SSD and HDD)
    Other Momentus moments posts here here, here, here and here
    SSD and Storage System Performance
    Speaking of speeding up business with SSD storage
    Are Hard Disk Drives (HDD’s) getting too big?
    Has SSD put Hard Disk Drives (HDD’s) On Endangered Species List?
    Why SSD based arrays and storage appliances can be a good idea (Part I)
    Why SSD based arrays and storage appliances can be a good idea (Part II)
    IT and storage economics 101, supply and demand
    Researchers and marketers dont agree on future of nand flash SSD
    EMC VFCache respinning SSD and intelligent caching (Part I)
    EMC VFCache respinning SSD and intelligent caching (Part II)
    SSD options for Virtual (and Physical) Environments Part I: Spinning up to speed on SSD
    SSD options for Virtual (and Physical) Environments Part II: The call to duty, SSD endurance
    SSD options for Virtual (and Physical) Environments Part III: What type of SSD is best for you?
    SSD options for Virtual (and Physical) Environments Part IV: What type of SSD is best for your needs

    Ok, nuff said for now.

    Cheers Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved