VMware VVOLs and storage I/O fundementals (Part 2)

VMware VVOL’s and storage I/O fundamentals (Part II)

Note that this is a three part series with the first piece here (e.g. Are VMware VVOL’s in your virtual server and storage I/O future?), the second piece here (e.g.VMware VVOL’s and storage I/O fundamentals Part 1) and the third piece here (e.g. VMware VVOL’s and storage I/O fundamentals Part 2).

Picking up from where we left off in the first part of the VMware VVOL’s and storage I/O fundamentals, lets take a closer look at VVOL’s.

First however lets be clear that while VMware uses terms including object and object storage in the context of VVOL’s, its not the same as some other object storage solutions. Learn more about object storage here at www.objectstoragecenter.com

Are VVOL’s accessed like other object storage (e.g. S3)?

No, VVOL’s are accessed via the VMware software and associated API’s that are supported by various storage providers. VVOL’s are not LUN’s like regular block (e.g. DAS or SAN) storage that use SAS, iSCSI, FC, FCoE, IBA/SRP, nor are they NAS volumes like NFS mount points. Likewise VVOL’s are not accessed using any of the various object storage access methods mentioned above (e.g. AWS S3, Rest, CDMI, etc) instead they are an application specific implementation. For some of you this approach of an applications specific or unique storage access method may be new, perhaps revolutionary, otoh, some of you might be having a DejaVu moment right about now.

VVOL is not a LUN in the context of what you may know and like (or hate, even if you have never worked with them), likewise it is not a NAS volume like you know (or have heard of), neither are they objects in the context of what you might have seen or heard such as S3 among others.

Keep in mind that what makes up a VMware virtual machine are the VMK, VMDK and some other files (shown in the figure below), and if enough information is known about where those blocks of data are or can be found, they can be worked upon. Also keep in mind that at least near-term, block is the lowest common denominator that all file systems and object repositories get built-up.

VMware ESXi basic storage I/O
VMware ESXi storage I/O, IOPS and data store basics

Here is the thing, while VVOL’s will be accessible via a block interface such as iSCSI, FC or FCoE or for that matter, over Ethernet based IP using NFS. Think of these storage interfaces and access mechanisms as the general transport for how vSphere ESXi will communicate with the storage system (e.g. their data path) under vCenter management.

What is happening inside the storage system that will be presented back to ESXi will be different than a normal SCSI LUN contents and only understood by VMware hypervisor. ESXi will still tell the storage system what it wants to do including moving blocks of data. The storage system however will have more insight and awareness into the context of what those blocks of data mean. This is how the storage systems will be able to more closely integrate snapshots, replication, cloning and other functions by having awareness into which data to move, as opposed to moving or working with an entire LUN where a VMDK may live. Keep in mind that the storage system will still function as it normally would, just think of VVOL as another or new personality and access mechanism used for VMware to communicate and manage storage.

VMware VVOL basics
VMware VVOL concepts (in general) with VMDK being pushed down into the storage system

Think in terms of the iSCSI (or FC or something else) for block or NFS for NAS as being the addressing mechanism to communicate between ESXi and the storage array, except instead of traditional SCSI LUN access and mapping, more work and insight is pushed down into the array. Also keep in mind that with a LUN, it is simply an address from what to use Logical Block Numbers or Logical Block Addresses. In the case of a storage array, it in turn manages placement of data on SSD or HDDs in turn using blocks aka LBA/LBN’s In other words, a host that does not speak VVOL would get an error if trying to use a LUN or target on a storage system that is a VVOL, that’s assuming it is not masked or hidden ;).

What’s the Storage Provider (SP)

The Storage Provider aka SP is created by the, well, the provider of the storage system or appliance leveraging a VMware API (hint, sign up for the beta and there is an SDK). Simply put, the SP is a two-way communication mechanism leveraging VASA for reporting information, configuration and other insight up to VMware ESXi hypervisor, vCenter and other management tools. In addition the storage provider receives VASA configuration information from VMware about how to configure the storage system (e.g. storage containers). Keep in mind that the SP is the out of band management interface between the storage system supporting and presenting VVOL’s and VMware hypervisors.

What’s the Storage Container (SC)

This is a storage pool created on the storage array or appliance (e.g. VMware vCenter works with array and storage provider (SP) to create) in place of using a normal LUN. With a SP and PE, the storage container becomes visible to ESXi hosts, VVOL’s can be created in the storage container until it runs out of space. Also note that the storage container takes on the storage profile assigned to it which are inherited by the VVOLs in it. This is in place of presenting LUN’s to ESXi that you can then create VMFS data stores (or use as raw) and then carve storage to VMs.

Protocol endpoint (PE)

The PE provides visibility for the VMware hypervisor to see and access VMDK’s and other objects (e.g. .vmx, swap, etc) stored in VVOL’s. The protocol endpoint (PE) manages or directs I/O received from the VM enabling scaling across many virtual volumes leveraging multipathing of the PE (inherited by the VVOL’s.). Note that for storage I/O operations, the PE is simply a pass thru mechanism and does not store the VMDK or other contents. If using iSCSI, FC, FCoE or other SAN interface, then the PE works on a LUN basis (again not actually storing data), and if using NAS NFS, then with a mount point. Key point is that the PE gets out-of-the-way.

VVOL Poll

What are you VVOL plans, view results and cast your vote here

Wrap up (for now)

There certainly are many more details to VVOL’s. that you can get a preview of in the beta, a well as via various demos, webinars, VMworld sessions as more becomes public. However for now, hope you found this quick overview on VVOL’s. of use, since VVOL’s. at the time of this writing are not yet released, you will need to wait for more detailed info, or join the beta or poke around the web (for now). Also if you have not seen the first part overview to this piece, check it out here as I give some more links to get you started to learn more about VVOL’s.

Keep an eye on and learn more about VVOL’s. at VMworld 2014 as well as in various other venues.

IMHO VVOL’s. are or will be in your future, however the question will be is there going to be a back to the future moment for some of you with VVOL’s.?

What VVOL questions, comments and concerns are in your future and on your mind?

Ok, nuff said (for now)

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

VMware VVOLs storage I/O fundementals (Part 1)

VMware VVOL’s storage I/O fundamentals (Part I)

Note that this is a three part series with the first piece here (e.g. Are VMware VVOL’s in your virtual server and storage I/O future?), the second piece here (e.g.VMware VVOL’s and storage I/O fundamentals Part 1) and the third piece here (e.g. VMware VVOL’s and storage I/O fundamentals Part 2).

Some of you may already be participating in the VMware beta of VVOL involving one of the initial storage vendors also in the beta program.

Ok, now let’s go a bit deeper, however if you want some good music to listen to while reading this, check out @BruceRave GoDeepMusic.Net and shows here.

Taking a step back, digging deeper into Storage I/O and VVOL’s fundamentals

Instead of a VM host accessing its virtual disk (aka VMDK) which is stored in a VMFS formatted data store (part of ESXi hypervisor) built on top of a SCSI LUN (e.g. SAS, SATA, iSCSI, Fibre Channel aka FC, FCoE aka FC over Ethernet, IBA/SRP, etc) or an NFS file system presented by a storage system (or appliance), VVOL’s push more functionality and visibility down into the storage system. VVOL’s shift more intelligence and work from the hypervisor down into the storage system. Instead of a storage system simply presenting a SCSI LUN or NFS mount point and having limited (coarse) to no visibility into how the underlying storage bits, bytes as well as blocks are being used, storage systems gain more awareness.

Keep in mind that even files and objects still get ultimately mapped to pages and blocks aka sectors even on nand flash-based SSD’s. However also keep an eye on some new technology such as the Seagate Kinetic drive that instead of responding to SCSI block based commands, leverage object API’s and associated software on servers. Read more about these emerging trends here and here at objectstoragecenter.com.

With a normal SCSI LUN the underlying storage system has no knowledge of how the upper level operating system, hypervisor, file system or application such as a database (doing raw IO) is allocating the pages or blocks of memory aka storage. It is up to the upper level storage and data management tools to map from objects and files to the corresponding extents, pages and logical block address (LBA) understood by the storage system. In the case of a NAS solution, there is a layer of abstractions placed over the underlying block storage handling file management and the associated file to LBA mapping activity.

Storage I/O basics
Storage I/O and IOP basics and addressing: LBA’s and LBN’s

Getting back to VVOL, instead of simply presenting a LUN which is essentially a linear range of LBA’s (think of a big table or array) that the hypervisor then manages data placement and access, the storage system now gains insight into what LBA’s correspond to various entities such as a VMDK or VMX, log, clone, swap or other VMware objects. With this more insight, storage systems can now do native and more granular functions such as clone, replication, snapshot among others as opposed to simply working on a coarse LUN basis. The similar concepts extend over to NAS NFS based access. Granted, there are more to VVOL’s including ability to get the underlying storage system more closely integrated with the virtual machine, hypervisor and associated management including supported service manage and classes or categories of service across performance, availability, capacity, economics.

What about VVOL, VAAI and VASA?

VVOL’s are building from earlier VMware initiatives including VAAI and VASA. With VAAI, VMware hypervisor’s can off-load common functions to storage systems that support features such as copy, clone, zero copy among others like how a computer can off-load graphics processing to a graphics card if present.

VASA however provides a means for visibility, insight and awareness between the hypervisor and its associated management (e.g. vCenter etc) as well as the storage system. This includes storage systems being able to communicate and publish to VMware its capabilities for storage space capacity, availability, performance and configuration among other things.

With VVOL’s VASA gets leveraged for unidirectional (e.g. two-way) communication where VMware hypervisor and management tools can tell the storage system of things, configuration, activities to do among others. Hence why VASA is important to have in your VMware CASA.

What’s this object storage stuff?

VVOL’s are a form of object storage access in that they differ from traditional block (LUN’s) and files (NAS volumes/mount points). However, keep in mind that not all object storage are the same as there are object storage access and architectures.

object storage
Object Storage basics, generalities and block file relationships

Avoid making the mistake of when you hear object storage that means ANSI T10 (the folks that manage the SCSI command specifications) Object Storage Device (OSD) or something else. There are many different types of underlying object storage architectures some with block and file as well as object access front ends. Likewise there are many different types of object access that sit on top of object architectures as well as traditional storage system.

Object storage I/O
An example of how some object storage gets accessed (not VMware specific)

Also keep in mind that there are many different types of object access mechanism including HTTP Rest based, S3 (e.g. a common industry defacto standard based on Amazon Simple Storage Service), SNIA CDMI, SOAP, Torrent, XAM, JSON, XML, DICOM, IL7 just to name a few, not to mention various programmatic bindings or application specific implementations and API’s. Read more about object storage architectures, access and related topics, themes and trends at www.objecstoragecenter.com

Lets take a break here and when you are ready, click here to read the third piece in this series VMware VVOL’s and storage I/O fundamentals Part 2.

Ok, nuff said (for now)

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

Are VMware VVOLs in your virtual server and storage I/O future?

Are VMware VVOL’s in your virtual server and storage I/O future?

Note that this is a three part series with the first piece here (e.g. Are VMware VVOL’s in your virtual server and storage I/O future?), the second piece here (e.g. VMware VVOL’s and storage I/O fundamentals Part 1) and the third piece here (e.g. VMware VVOL’s and storage I/O fundamentals Part 2).

With VMworld 2014 just around the corner, for some of you the question is not if Virtual Volumes (VVOL’s) are in your future, rather when, where, how and with what.

What this means is that for some hands on beta testing is already occurring or will be soon, while for others that might be around the corner or down the road.

Some of you may already be participating in the VMware beta of VVOL involving one of the first storage vendors also in the beta program.

VMware vvol beta

On the other hand, some of you may not be in VMware centric environments and thus VVOL’s may not yet be in your vocabulary.

How do you know if VVOL are in your future if you don’t know what they are?

First, to be clear, as of the time this was written VMware VVOL’s are not released and only in beta as well as having been covered in earlier VMworld’s. Consequently what you are going to read here is based on what VVOL material has already been made public in various venues including earlier VMworld’s and VMware blogs among other places.

The quick synopsis of VMware VVOL’s overview:

  • Higher level of abstraction of storage vs. traditional SCSI LUN’s or NAS NFS mount points
  • Tighter level of integration and awareness between VMware hypervisors and storage systems
  • Simplified management for storage and virtualization administrators
  • Removing complexity to support increased scaling
  • Enable automation and service managed storage aka software defined storage management
  • VVOL considerations and your future

    As mentioned, as of this writing, VVOL’s are still a future item granted they exist in beta.

    For those of you in VMware environments, now is the time to add VVOL to your vocabulary which might mean simply taking the time to read a piece like this, or digging deeper into the theories of operations, configuration, usage, hints and tips, tutorials along with vendor specific implementations.

    Explore your options, and ask yourself, do you want VVOL or do you need it

    What support does your current vendor(s) have for VVOL or what is their statement of direction (SOD) which you might have to get from them under NDA.

    This means that there will be some first vendors with some of their products supporting VVOL’s with more vendors and products following (hence watch for many statements of direction announcements).

    Speaking of vendors, watch for a growing list of vendors to announce their current or plans for supporting VVOL’s, not to mention watch some of them jump up and down like Donkey in Shrek saying "oh oh pick me pick me".

    When you ask a vendor if they support VVOL’s, move beyond the simple yes or no, ask which of their specific products, it is a block (e.g. iSCSI) or NAS file (e.g. NFS) based and other caveats or configuration options.

    Watch for more information about VVOL’s in the weeks and months to come both from VMware along with from their storage provider partners.

    How will VVOL impact your organizations best practices, policies, workflow’s including who does what, along with associated responsibilities.

    Where to learn more

    Check out the companion piece to this that takes a closer look at storage I/O and VMware VVOL fundamentals here and here.

    Also check out this good VMware blog via Cormac Hogan (@CormacJHogan) that includes a video demo, granted its from 2012, however some of this stuff actually does take time and thus this is very timely. Speaking of VMware, Duncan Epping (aka @DuncanYB) at his Yellow-Bricks site has some good posts to check out as well with links to others including this here. Also check out the various VVOL related sessions at VMworld as well as the many existing, and soon to be many more blogs, articles and videos you can find via Google. And if you need a refresher, Why VASA is important to have in your VMware CASA.

    Of course keep an eye here or whichever venue you happen to read this for future follow-up and companion posts, and if you have not done so, sign up for the beta here as there are lots of good material including SDKs, configuration guides and more.

    VVOL Poll

    What are you VVOL plans, view results and cast your vote here

    Wrap up (for now)

    Hope you found this quick overview on VVOL’s of use, since VVOL’s at the time of this writing are not yet released, you will need to wait for more detailed info, or join the beta or poke around the web (for now).

    Keep an eye on and learn more about VVOL’s at VMworld 2014 as well as in various other venues.

    IMHO VVOL’s are or will be in your future, however the question will be is there going to be a back to the future moment for some of you with VVOL’s?

    Also what VVOL questions, comments and concerns are in your future and on your mind?

    And remember to check out the second part to this series here.

    Ok, nuff said (for now)

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    July 2014 Server and StorageIO Update newsletter


    Server and StorageIO Update newsletter – July 2014

    Welcome to the July 2014 edition of the StorageIO Update (newsletter) containing trends perspectives on cloud, virtualization and data infrastructure topics. For some of you it is mid summer (e.g. in the northern hemisphere) while for others it mid-winter (southern hemisphere). Here in the Stillwater MN area it is mid-summer which means enjoying the warm outdoor weather as well as getting ready for the busy late summer and early fall 2014 schedule of events including VMworld among others. Starting in this edition there are a couple of new and expanded sections including Technology tips and tools and the return of Just For Fun.

    Greg Schulz Storage I/OGreg Schulz @StorageIO

    Lets jump into this mid-summer, or for some of you mid-winter edition of the StorageIO Update newsletter.

    Industry and Technology Updates

    StorageIO Industry Trends and Perspectives

    Following up from our June 2014 Newsletter that included coverage of NetApp and Avago selling its newly acquired (via LSI acquisition) flash storage division to Seagate, along with other activity, here are some current industry activities. From a flash memory and solid state device (SSD) perspective, the flash memory summit (FMS) is occurring in Santa Clara the week of August 5, 2014. Having insight under NDA into some of the many announcements as well as other things occurring, keep an eye out for various news from the FMS event.

    EMC MegaLaunch and MegaActivist Investor

    In addition to their recent MegaLaunch series of product announcements and updates, EMC is also in the news as it comes under pressure from activist investor Hedge fund Elliot Management Corp to spin-off VMware to increase shareholder value. What would a spin-off of VMware mean for customers of the EMC federation of EMC core technologies, VMware and Pivotal labs if the activists get their way? Here are some additional comments and perspectives via CruxialCIO. Click here to view the recent (July 23, 2014) earnings announcement for a summary of how EMC is doing in the market and financially.

    Speaking of EMC MegaLaunch on July 8, 2014, EMC also announced enhancements and new models of their Isilon scale out storage, new VMAX3 models with embedded virtualization and other enhancements, XtremeIO 3.0 and new models among other enhancements. EMC also announced the general availability of some previously announced at EMCworld (May 2014) solutions including Elastic Cloud Storage (ECS) and VIPR 2.0 along with SRM 2.0 among other items. For those not familiar with EMC ViPR Software Defined Storage Management you can read more here, here, here and here.

    What’s in the works?

    Several projects and things are in the works that will show themselves in the coming weeks or months if not sooner. Some of which are more proof points coming out of the StorageIO labs involving software defined, converged, cloud, virtual, SSD, cache software, data protection and more.

    Speaking of Software Defined, join me for a free Webinar on August 7 Hardware agnostic Virtual SAN for VMware ESXi Free (sponsored by Starwind Software). Other upcoming webinars include BackupU Summer Semester series (Sponsored by Dell Software) where we continue Exploring the Data Protection Toolbox. August also means VMworld in San Francisco so see you there. Check out the activities calendar below and at our main website to learn about these and other events.

    Watch for more StorageIO posts, commentary, perspectives, presentations, webinars, tips and events on information and data infrastructure topics, themes and trends. Data Infrastructure topics include among others cloud, virtual, legacy server, storage I/O networking, data protection, hardware and software.

    Enjoy this edition of the StorageIO Update newsletter and look forward to catching up with you live or online while out and about this summer.

    StorageIO comments and perspectives in the news

    StorageIO in the news

    The following is a synopsis of some StorageIOblog posts, articles and comments in different venues on various industry trends, perspectives and related themes about clouds, virtualization, data and storage infrastructure topics among related themes.

    NetworkComputing: Comments on Data Backup: Beyond Band-Aids
    StorageNewsletter: Comments on Unified Storage Appliance Buying Guide
    Forbes: Comments on Big Data and Enterprise Information Management
    Toms Hardware: Comments on Server SAN: Demystifying Today’s Newest Storage Buzzword
    CruxialCIO: Comments on EMC Bridges Cloud, On-Premise Storage With TwinStrata Buy
    ComputerWeekly: Comments on Backup vs archive: Can they be merged?
    CruxialCIO: Comments on EMC under pressure to spin-off VMware
    EnterpriseStorageForum: Comments on Unified Storage and buyers guide tips

    StorageIO video and audio pod casts

    StorageIOblog postStorageIOblog post
    StorageIO audio pod casts are also available via
    and at StorageIO.tv

    StorageIOblog posts and perspectives

    StorageIOblog post

  • AWS adds Zocalo Enterprise File Sync Share and Collaboration
  • June 2014 Server and StorageIO Update newsletter
  • Remember to check out our objectstoragecenter.com page where you will find a growing collection of information and links on cloud and object storage themes, technologies and trends from various sources.

    If you are interested in data protection including Backup/Restore, BC, DR, BR and Archiving along with associated technologies, tools, techniques and trends visit our storageioblog.com/data-protection-diaries-main/ page.

    StorageIO events and activities

    Server and StorageIO seminars, conferences, web cats, events, activities

    The StorageIO calendar continues to evolve including several new events being added for August and well into the fall with more in the works. Here are some recent and upcoming activities including live in-person seminars, conferences, keynote and speaking activities as well as on-line webinars, twitter chats, Google+ hangouts among others.

    October 10, 2014 Seminar: Server, Storage and IO Data Center Virtualization JumpstartNijkerk Holland
    Netherlands
    October 9, 2014 Seminar: Data Infrastructure Industry Trends and Perspectives – What’s The BuzzNijkerk Holland
    Netherlands
    October 8, 2014 Private Seminar – Contact Brouwer Storage ConsultancyNijkerk Holland
    Netherlands
    Sep. 2, 2014Dell BackupUExploring the Data Protection Toolbox – Data and Application ReplicationOnline Webinar
    11AM PT
    August 25-28, 2014VMworldVarious ActivitiesSan Francisco
    Aug. 21, 2014 BrightTalkSAN, LAN, MAN, WAN, POTS & PANs – How you CAN network your servers & storage beyond the cable?

    Webinar
    11AM PT
    Aug. 20, 2014TBASoftware Defined Data CentersTBA
    1:30PM CT
    Aug. 19, 2014Dell BackupUExploring the Data Protection Toolbox – The ABCDs of DFR (Data Footprint Reduction), part IIGoogle+ Hangout
    9AM PT
    Aug. 13, 2014 BrightTalkWhat is Your Virtualization Optimization Objective?Webinar
    1PM PT
    Aug. 7, 2014Starwind SoftwareLive webinar: Hardware agnostic Virtual SAN for VMware ESXi FreeWebinar
    1PM CT
    Aug. 5, 2014Dell BackupUExploring the Data Protection Toolbox – The ABCDs of DFR (Data Footprint Reduction), part IIOnline Webinar
    11AM PT

    Click here to view other upcoming along with earlier event activities. Watch for more 2014 events to be added soon to the StorageIO events calendar page. Topics include data protection modernization (backup/restore, HA, BC, DR, archive), data footprint reduction (archive, compression, dedupe), storage optimization, SSD, object storage, server and storage virtualization, big data, little data, cloud and object storage, performance and management trends among others.

    Vendors, VAR’s and event organizers, give us a call or send an email to discuss having us involved in your upcoming pod cast, web cast, virtual seminar, conference or other events.

    Server and StorageIO Technology Tips and Tools

    Server and StorageIO seminars, conferences, web cats, events, activities

    FedTech:  Use a VPN for More than Remote Access
    InfoStor:  Data Archiving: Life Beyond Compliance

    Just for fun and on a lighter note

    Wrapping up this edition of the StorageIO Update newsletter is the return of the Just for fun and on a lighter note section where we share something non IT related. In this edition how about summertime backyard home video taken a few weeks ago? Check out this video of a black bear and her two cubs walking in, well, my backyard. First you will see Big Mama Bear, then Yogi Jr. that appear from the left, followed by baby Boo Boo also from the left.

    Backyard Black Bears
    Video courtesy of KarenofArcola – Click on image to view

    StorageIO Update Newsletter Archives

    Click here to view earlier StorageIO Update newsletters (HTML and PDF versions) at www.storageio.com/newsletter. Subscribe to this newsletter (and pass it along) by clicking here (Via Secure Campaigner site). View archives of past StorageIO update news letters as well as download PDF versions at: www.storageio.com/newsletter

    Ok, nuff said (for now)

    Cheers
    Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    AWS adds Zocalo Enterprise File Sync Share and Collaboration

    AWS adds Zocalo Enterprise File Sync Share and Collaboration

    In case you missed it today, Amazon Web Services (AWS) announced Zocalo an enterprise class storage and file sharing service. As you might have guessed, by being file sync and share of cloud storage Zocalo can be seen as a competitor or option to other services including Box, Dropbox and Google among many others in the enterprise file sync and share (EFSS) space.

    Amazon Zocalo enterprise storage and sharing service

    AWS Enterprise File Sync Share (EFSS) Zocalo overview and summary:

    • Document collaboration (Comments and sharing) including available with AWS WorkSpaces
    • Central common hub for sharing documents along with those owned by a user
    • Select AWS regions where data is stored, along with set up users polices and audit trails
    • Sharing of various types of documents, worksheets, web pages, presentations, text and PDF among other files
    • Support for Windows and other PCs, Macs, tablets and other mobile devices
    • Cost effective (priced at $5 per user per month for 200GB of storage)
    • Free 30 day trial for up to 50 users each with 200GB (e.g. 10TB)
    • Secure leveraging existing AWS regions and tools (encryption in transit and while at rest)
    • Active directory credentials integration

    Learn more in the Zocalo FAQ found here

    Register for the limited free Zocalo trial here

    Additional Zocalo product details can be found here

    AWS also announced as part of its Mobile Services Cognito a mobile service for simple user identity and data synchronization, along with SNS, Mobile Analytics and other enhancements. Learn more about AWS Cognito here and Mobile Services here.

    Check out other AWS updates, news and enhancements here

    Ok, nuff said

    Cheers
    gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    June 2014 Server and StorageIO Update newsletter

    Server and StorageIO Update newsletter – June 2014

    Welcome to the June 2014 edition of the StorageIO Update (newsletter) containing trends perspectives on cloud, virtualization and data infrastructure topics. June has been busy on many fronts with lots of activities, not to mention spring and summer are finally here in the Stillwater MN area.

    Speaking of busy, the spring rains came a month or two late, or the summer storms early as we will end up with one of the, if not rainiest Junes in history here in Stillwater MN area.

    Greg Schulz Storage I/OGreg Schulz @StorageIO

    Industry and Technology Updates

    There has also been plenty of activity in the Information Technology (IT) and in particular the data infrastructure sector (databases, file systems, operating systems, servers, storage, I/O networking, cloud, virtualization, SSD, data protection and DCIM among others). SANdisk announced their intention to buy SSD vendor Fusion IO for a $1.1 Billion dollars as part of a continued flash consolidation trend For example Cisco buys Whiptail, WD buys Virident, Seagate buys Avago/LSI Flash division among others (read more about flash SSD here). Even with flash SSD vendor and technology consolidation, this is in no way an indication of the health of the market. Quite the opposite in that flash SSD has a very bright future and we are still in the relative early phase or waves and flash will be in your future. The question remains how much, when, where, with what and from whom. Needless to say there is plenty of SSD related hardware and software activity occurring in the StorageIO labs as well as StorageIO.com/SSD;).

    StorageIO Industry Trends and Perspectives

    NetApp Updates

    In early June I was invited by NetApp to attend their annual analyst summit along with many others from around the world for a series of briefings, NDA updates and other meetings. Disclosure NetApp has been a client in the past and covered travel and lodging expenses to attend their event.

    While the material under NDA naturally can not be discussed, there was discussion around NetApp previously announced earnings, their continued relationship with IBM (for the E Series) along with the June product updates. Shortly after the NetApp event they announced enhancements to there ONTAP FAS based systems that followup to those released earlier this year. These recent enhancements NetApp claims as being their fastest FAS based systems ever.

    Given the success NetApp has had with their ONTAP FAS based systems including with FlexPod, it should not be a surprise that they continue to focus on those as their flagship offerings. What was clear from listening to CEO Tom Georgens is that NetApp as a company needs to offer, promote and sell the entire portfolio including E Series (disk, hybrid and all flash EF), StorageGrid (bycast), FlexPod and FAS among other tools (software defined storage management) and services (for legacy, virtual and cloud). Watch for some interesting updates and enhancements for the above and other things from NetApp in the future.

    Staying busy is a good thing

    What have I been doing during June 2014 to stay busy besides getting ready for summer fun (as well as preparing for fall industry events) including in and around the water?

    • Presented several BrightTalk Webinars (see events below) with more coming up
    • Release of new ITP white paper and StorageIO lab proof points with more in the works
    • More videos and pod casts, technology reviews including servers among other things
    • Moderated a software defined panel discussion at MSP area VMUG
    • Providing industry commentary in different venues (see below)
    • Not to mention various client consulting projects

    What’s in the works?

    Several projects and things are in the works that will show themselves in the coming weeks or months if not sooner. Some of which are more proof points coming out of the StorageIO labs involving software defined, converged, cloud, virtual, SSD, data protection and more.

    Speaking of Software Defined, join me for a free Spiceworks Webinar on July 2, Do More with Less Hardware Using Software Defined Storage Management (sponsored by Starwind Software). The webinar looks at the many faces and facets of virtualization and software defined storage and software defined storage management for Hyper-V environments. Learn more about the Hyper-V event here or here.

    In addition to the upcoming July 2 Hyper-V software defined storage webinar ( a recording for replay will be posted to the StorageIO.com/events page after the event), I also did a webinar on BrightTalk a few weeks covering software defined storage management. View the BrightTalk webinar replays by clicking the following links The Changing Face and Landscape of Enterprise Storage (June 11), The Many Facets of Virtual Storage and Software Defined Storage Virtualization (June 12), Evolving from Disaster Recovery and Business Continuity (BC) to Business Resiliency (BR) recorded Jun 19.

    Watch for more StorageIO posts, commentary, perspectives, presentations, webinars, tips and events on information and data infrastructure topics, themes and trends. Data Infrastructure topics include among others cloud, virtual, legacy server, storage I/O networking, data protection, hardware and software.

    Enjoy this edition of the StorageIO Update newsletter and look forward to catching up with you live or online while out and about this spring.

    Ok, nuff said (for now)

    Cheers gs

    June 2014 Industry trend and perspectives

    Tips, commentary, articles and blog posts

    StorageIO Industry Trends and Perspectives

    The following is a synopsis of some StorageIOblog posts, articles and comments in different venues on various industry trends, perspectives and related themes about clouds, virtualization, data and storage infrastructure topics among related themes.

    StorageIO comments and perspectives in the news

    StorageIO in the news

    Toms Hardware: Comments on Selecting the Right Type, Amount and Location of Flash SSD to use 
    TechPageOne: Comments on best practices for virtual data protection
    SearchAWS: Comments on Google vs. AWS SSD which is better
    InfoStor: Comments on Cloud Appliance Buying Guide

    StorageIO video and audio pod casts

    StorageIOblog postStorageIOblog post
    StorageIO audio podcasts are also available via
    and at StorageIO.tv

    StorageIOblog posts and perspectives

    StorageIOblog post

  • Is there an information or data recession, are you using less storage (with polls)
  • April and May 2014 Server and StorageIO Update newsletter
  • StorageIO White Papers, Solution Briefs and StorageIO Lab reports

    White Paper

    New White Paper: StarWind Virtual SAN:
    Hardware Agnostic Hyper-Convergence for Microsoft Hyper-V
    Using less hardware with software defined storage management There is no such thing as an information recession with more data being generated, processed, moved, stored and retained longer. In addition, people and data are living longer as well as getting larger.

    Key to support various types of business environments and their information technology (IT) / ITC applications are cost effective, flexible and resilient data infrastructures that support virtual machine (VM) centric solutions. This StorageIO Industry Trends Perspective thought leadership white paper looks at addressing the needs of Microsoft Hyper-V environments to address economic, service, growth, flexibility and technology challenges.

    The focus is on how software defined storage management solutions unlock the full value of server-based storage for Hyper-V environments. Benefits include removing complexity to cut cost while enhancing flexibility, service and business systems resiliency along with disaster recovery without compromise. Primary audiences include Small Medium Business (SMB), Remote Office Branch Office (ROBO) of larger organizations along with managed service providers (Cloud, Internet and Web) that are using Hyper-V as part of their solutions. Read more in this StorageIO Industry Trends and Perspective (ITP) white paper compliments of StarWind Software Virtual SAN (VSAN) for Microsoft Hyper-V.

    Remember to check out our objectstoragecenter.com page where you will find a growing collection of information and links on cloud and object storage themes, technologies and trends from various sources.

    If you are interested in data protection including Backup/Restore, BC, DR, BR and Archiving along with associated technologies, tools, techniques and trends visit our storageioblog.com/data-protection-diaries-main/ page.

    StorageIO events and activities

    Server and StorageIO seminars, conferences, web cats, events, activities

    The StorageIO calendar continues to evolve, here are some recent and upcoming activities including live in-person seminars, conferences, keynote and speaking activities as well as on-line webinars, twitter chats, Google+ hangouts among others.

    October 10, 2014 Seminar: Server, Storage and IO Data Center Virtualization JumpstartNijkerk Holland
    Netherlands
    October 9, 2014 Seminar: Data Infrastructure Industry Trends and Perspectives – Whats The BuzzNijkerk Holland
    Netherlands
    October 8, 2014 Private Seminar – Contact Brouwer Storage ConsultancyNijkerk Holland
    Netherlands
    October 7, 2014 Seminar: Data Movement and MigrationNijkerk Holland
    Netherlands
    October 6, 2014 Seminar: From Backup and Disaster Recovery to Business Resiliency and ContinuanceNijkerk Holland
    Netherlands
    August 25-28, 2014VMworldTBASan Francisco
    August 7, 2014TBATBATBA
    July 2, 2014Starwind SoftwareLive webinar: Live Webinar: Do More with Less Hardware Using Software Defined Storage ManagementWebinar
    1PM CT
    June 26, 2014MSP VMUGModerate Live Panel Software Defined DiscussionPanel
    12:45PM CT
    June 17, 2014Dell BackupUExploring the Data Protection Toolbox – Data Footprint ReductionDell BackupU
    Online Webinar
    May 14, 2014 Seminar: Vendor Neutral Archiving for HealthcareNijkerk Holland
    Netherlands
    May 5-7, 2014EMC WorldLas Vegas
    April 23, 2014SNIA DSI EventKeynote: Enabling Data Infrastructure Return On Innovation – The Other ROIbackup, restore, BC, DR and archiving
    April 22, 2014SNIA DSI EventThe Cloud Hybrid “Homerun” – Life Beyond The Hypebackup, restore, BC, DR and archiving
    April 16, 2014
    Open Source and Cloud Storage – Enabling business, or a technology enabler?Webinar
    9AM PT
    April 9, 2014
    Storage Decision Making for Fast, Big and Very Big Data EnvironmentsWebinar
    9AM PT

    Click here to view other upcoming along with earlier event activities. Watch for more 2014 events to be added soon to the StorageIO events calendar page. Topics include data protection modernization (backup/restore, HA, BC, DR, archive), data footprint reduction (archive, compression, dedupe), storage optimization, SSD, object storage, server and storage virtualization, big data, little data, cloud and object storage, performance and management trends among others.

    Vendors, VAR’s and event organizers, give us a call or send an email to discuss having us involved in your upcoming pod cast, web cast, virtual seminar, conference or other events.

    StorageIO Update Newsletter Archives

    Click here to view earlier StorageIO Update newsletters (HTML and PDF versions) at www.storageio.com/newsletter. Subscribe to this newsletter (and pass it along) by clicking here (Via Secure Campaigner site). View archives of past StorageIO update news letters as well as download PDF versions at: www.storageio.com/newsletter

    Ok, nuff said (for now)

    Cheers
    Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    April and May 2014 Server and StorageIO Update newsletter


    Server and StorageIO Update newsletter – April and May 2014

    Welcome to the April and May 2014 edition of the StorageIO Update (newsletter) containing trends perspectives on cloud, virtualization and data infrastructure topics.

    The good news is that while spring is running late (as is this newsletter ;) here in the Stillwater MN area as well as other parts of the world, both are finally here. To say that a lot has been going on and things busy would be an understatement, however that is probably also the situation with you as well. So what has been going on during April and May 2014?

    Industry and Technology Updates

    Sony and Fujifilm (with their partner IBM) are trading marketing and proof of concept (POC) lab material in the efforts to show tape is still alive for data storage. Sony announced a month or so ago that it was moving the bar to 185TB per tape (without dedupe). Not to be out done, Fujifilm announced in late May that they in conjunction with IBM have a POC for a 154 TB LTO in the works.

    Greg Schulz Storage I/OGreg Schulz on break
    On the Hard Disk Drive (HDD) front, Seagate released a new 6TB device that they claim to be fast. I asked Seagate to send me one of the drives to see how fast it really is vs. their claims. While I have not completed all tests yet, what I can tell you is that the 6TB 3.5" 12Gbps SAS 7.2K RPM drive is like an american football linebacker or fullback. Its big, bulky, high-capacity, resilient with 10 to the 15 bit error rate (higher than normal high-capacity HDD’s) and fast.

    Sure the 6TB HDD is not in the speed race of a quick SSD or SSHD or 15K, however I was surprised at just how fast it is for its space capacity. Watch for a follow-up review in the not so distant future and if a WD 6TB drive were to show up on my door step can give some perspectives on that as well.

    As for SSD, they are following the trend paths of tape and HDD’s of increasing in space capacity, coming down in price and improving on resiliency. While I see HDD and even tape surviving for some time, granted in different roles, I’m also a firm believer that flash SSD in some form are in your future. The question is how much, when, where, with what and from whom. Needless to say there is plenty of SSD related hardware and software activity occurring in the StorageIO labs ;).

    Vendors and revenue earnings, is there storage slowdown?

    In other industry news and activity, vendor quarterly earnings are out and there is mixed information (see this recent post of if there is an information recession). IBM is one of those who have announced lowered storage related revenues as NetApp had mixed results (as did other vendors). In addition IBM is officially saying they are finally dropping the NetApp (FAS/ONTAP) based N series (was originally reported a week or so ago via Bloomberg). Note that IBM will continue to OEM NetApp E series (e.g. Engenio based). Some of you might remember (or do a Google search) that IBM indicated a few years back that it was De emphasizing the N series or moving away from it. Perhaps this time they really mean it while NetApp could move to embrace those VAR’s and IBM business partners to sell NetApp vs. IBM branded versions of the product. Here are some more perspectives appearing in SearchStorage. Watch for more about NetApp in a future follow-up post.

    In some other industry news, you might remember back in the February StorageIO update newsletter there was mention of Avago buying LSI. Now Avago is selling the flash business of LSI to Seagate for about $450M USD in the ongoing flash dance for cache and cash.

    Staying busy is a good thing

    What have I been doing during April and May 2014 to stay busy besides getting ready for spring and summer fun including in and around the water?

    • Attended NAB 2014 in Las Vegas where it is not just about archiving pertaining to data storage
    • Presented backup, restore, BC, DR and archiving including a keynote at the SNIA DSI conference
    • Was back in Las Vegas to attend EMCworld, I have some updates in the works from that event
    • Presented several BrightTalk Webinars (see events below) with more coming up in June
    • Release of new ITP white paper and StorageIO lab proof points with more in the works
    • More videos and pod casts, technology reviews including servers among other things
    • Participated including keynote at a vendor neutral archiving event in Europe
    • Providing industry commentary in different venues (see below) along with some writing
    • Not to mention various client consulting projects
    • Remember, work hard play hard, play hard and work hard!

    Whats in the works?

    Several projects and things are in the works that will show themselves in the coming weeks or months if not sooner. Some of which are more proof points coming out of the StorageIO labs involving software defined, converged, cloud, virtual, SSD, data protection and more.

    Speaking of Software Defined, join me for a free BrightTalk Webinar on June 12 on the many faces and facets of virtualization and software defined storage. Learn more about that event here as well as in the activities section down below.

    Watch for more StorageIO posts, commentary, perspectives, presentations, webinars, tips and events on information and data infrastructure topics, themes and trends. Data Infrastructure topics include among others cloud, virtual, legacy server, storage I/O networking, data protection, hardware and software.

    Enjoy this edition of the StorageIO Update newsletter and look forward to catching up with you live or online while out and about this spring.

    Ok, nuff said (for now)

    Cheers gs

    April and May 2014 Industry trend and perspectives

    Tips, commentary, articles and blog posts

    StorageIO Industry Trends and Perspectives

    The following is a synopsis of some StorageIOblog posts, articles and comments in different venues on various industry trends, perspectives and related themes about clouds, virtualization, data and storage infrastructure topics among related themes.

    StorageIO comments and perspectives in the news

    StorageIO in the news

    SearchStorage: Comments on IBM dropping N series, NetApp is still OEM to IBM
    InfoStor: Comments on Software Defined Storage: 10 Things You Need to Know
    SearchDataBackup: Comments about buying guides for enterprise Hard Disk Drives (HDD)
    SearchDataBackup: Conversation about data protection modernization
    InfoStor: Comments on cloud storage, 10 things you need to know
    InfoStor: Comments on Data Archiving: Life Beyond Compliance
    NetworkComputing: Comments on Sorting Through Storage Industry Hype
    StateTech: Comments on Secure Erasing HDDs and SSDs including planning in advance
    SNIA: Comments on CDMI Cloud Management Conformance Testing
    EnterpriseStorageForum: Comments on Hybrid Cloud Storage Tips
    NetworkComputing: Comments on Sorting Through Storage Industry Hype

    StorageIO tips and articles appearing in various venues

    StorageIO tips and articles

    Via InformationSecurityBuzz:  Dark Territories MH370 Do You Know Where Your Information Is? We still dont know 100% where the missing Malaysian airlines flight 370 is which amplifies the fact that there are still dar territories or gaps in coverage in this large world. Likewise there are gaps in coverage in many IT environments yet tools and technologies are available to gain better situational awareness and insight.

    Via The Virtualization Practice: This piece looks at the EMC ViPR V1.1 and SRM V3.0 (Software Defined Storage Management) announcements from earlier this year, along with links to earlier announcement and technology analysis. Note that EMC announced May 5, 2014 ViPR 2.0 along with their new Elastic Cloud Storage Appliance (ECS) among other enhancements at EMC World. Additional perspectives on ViPR 2.0, Elastic Cloud Storage Appliance and EMCworld announcement summary analysis can be found here in this video (with text) that I did (produced via TechTarget) while at EMCworld 2014. Watch for more coverage of ViPR 2.0 and other related new as well as updated items from EMCworld 2014 in upcoming posts, articles and commentary.

    Via InfoStor: Data Archiving: Life Beyond Compliance. Today many people think or assume based on what they hear that Archiving is only for regulatory archiving. Meanwhile some of you may remember a time before the regulatory compliance era of the early 2000s when Archiving was used as a general purpose tool, technology and solution to many IT data management storage challenges. This piece I did over at InfoStor looks at Data Archiving: Life Beyond Compliance and how Archiving is also a key technology that are part of Data Footprint Reduction (DFR) that also includes compression, dedupe, thin provisioning amount other techniques and tools. Here is a related Email Archiving piece (beyond compliance) from over at StateTech along with Practical tips in a piece over at VMware Communities.

    StorageIO video and audio pod casts

    StorageIOblog postStorageIOblog post
    Video conversation with Rob Emsley of EMC and me discussing data protection modernization moving beyond the product pitch!(Via TechTarget SearchDataBackup). In this conversation Rob and me talk about various aspects of data protection modernization including finding and fixing problems at the source, accidental architectures, using new (and old) things in new ways, rethinking data protection. However the conversation is a discussion about the topics, issues, trends, what can be done as opposed to a product pitch infomercial. Check out this video blog (vblog) of Rob and me via TechTarget SearchDataBackup, then weigh in with your comments.

    audioSNIA DSI David Dale
    Audio Podcast: Data Storage Innovation Conversation with SNIA Wayne Adams and David Dale
    In this episode, SNIA Chairman Emeritus Wayne Adams and current Chairman David Dale join me in a conversation from the Data Storage Innovation (DSI) 2014 conference event. DSI is a new event produced by SNIA targeted for IT professionals involved with data storage related topics, themes, technologies and tools spanning hardware, software, cloud, virtual and physical. In this conversation, we talk about the new DSI event, the diversity of new attendees who are attending their first SNIA event, along with other updates. Some of these updates include what is new with the SNIA Cloud Data Management Initiative (CDMI), Non Volatile Memory (think flash and SSD), SMIS, education and more. Listen in to our conversation in this podcast here as we cover cloud, convergence, software defined and more about data storage.

    audiocash coleman cleardb
    Audio Podcast: Catching up with Cash Coleman talking ClearDB, cloud database and Johnny Cash
    In this episode from the SNIA DSI 2014 event I am joined by Cashton Coleman (@Cash_Coleman). Cashton (Cash) is a Software architect, product mason, family bonder, life builder, idea founder along with Founder & CEO of SuccessBricks, Inc., makers of ClearDB. ClearDB is a provider of MySQL database software tools for cloud and physical environments. We talk about ClearDB, what they do and whom they do it with including deployments in cloud’s as well as onsite. For example if you are using some of the Microsoft Azure cloud services using MySQL, you may already be using this technology. However, there is more to the story and discussion including how Cash got his name, how to speed up databases for little and big data among other topics. Check out ClearDB and listen in to the conversation with Cash podcast here.

    audio
    Audio Podcast: Matt Vogt talks VMware vCOP in his first ever podcast
    In this episode from the Computex Rethink your Datacenter for 2017 planning and strategy event I am joined by Matt Vogt (@MattVogt). Matt is a Principal Architect with Computex Technology Solutions as well as certified VMware specialist and fellow vExpert. We talk about the role of automation for performance and capacity optimization along with how VMware vCop plays an important role. Listen in to learn more about how to gain insight and situational awareness to make informed decisions for your data infrastructure environment with Matt. Check out Matt’s blog here at blog.mattvogt.net and listen in to the podcast here.

    StorageIO audio podcasts are also available via
    and at StorageIO.tv

    StorageIOblog posts and perspectives

    StorageIOblog post

  • Is there an information or data recession, are you using less storage (with polls)
  • Lenovo TS140 Server and Storage IO Review Part I here and Part II here
  • Nand flash SSD server storage I/O conversations: See more SSD stories here
  • Data Protection Diaries: March 31 World Backup Day is Restore Data Test, read more here
  • March 2014 StorageIO Update Newsletter: Click here to read more
  • StorageIO White Papers, Solution Briefs and StorageIO Lab reports

    White Paper

    New White Paper: Solid State Hybrid Drives (SSHD)
    Enterprise SSHD and Flash SSD – Better Together – Part of an Enterprise Tiered Storage Strategy The question to ask yourself is not if flash Solid State Device (SSD) technologies are in your future. Instead the questions are when, where, using what, how to configure and related themes. SSD including traditional DRAM and NAND flash-based technologies are like real estate where location matters; however, there are different types of properties to meet various needs.

    This means leveraging different types of NAND flash SSD technologies in different locations in a complementary and cooperative aka hybrid way. In this StorageIO Industry Trends Perspective thought leadership white paper we look at how enterprise class Solid State Hybrid Drives (SSHD) and how they address current and next generation tiered storage for virtual, cloud, traditional Little and Big Data infrastructure environments. This includes providing proof points running various workloads including Database TPC-B, TPC-E and Microsoft Exchange in the StorageIO Labscomparing SSHD, SSD and different HDDs. Read more in this StorageIO Industry Trends and Perspective (ITP) white paper compliments of Seagate Enterprise Turbo SSHD. Read the companion blog post here that includes more proof points for large file transfer performance.

    Remember to check out our objectstoragecenter.com page where you will find a growing collection of information and links on cloud and object storage themes, technologies and trends from various sources.

    If you are interested in data protection including Backup/Restore, BC, DR, BR and Archiving along with associated technologies, tools, techniques and trends visit our storageioblog.com/data-protection-diaries-main/ page. For those who follow SSD and related technologies, we have organized a series of items at storageio.com/ssd.

    StorageIO events and activities

    Server and StorageIO seminars, conferences, web cats, events, activities

    The StorageIO calendar continues to evolve, here are some recent and upcoming activities including live in-person seminars, conferences, keynote and speaking activities as well as on-line webinars, twitter chats, Google+ hangouts among others.

    June 12, 2014The Many Facets of Virtual Storage and Software Defined Storage VirtualizationWebinar
    9AM PT
    June 11, 2014The Changing Face and Landscape of Enterprise StorageWebinar
    9AM PT
    May 14, 2014Brouwer Storage ConsultancyKeynote – Healthcare Vendor Neutral Archiving SymposiumNijkerk Netherlands
    May 5-7, 2014EMC WorldLas Vegas
    April 23, 2014SNIA DSI EventKeynote: Enabling Data Infrastructure Return On Innovation – The Other ROIbackup, restore, BC, DR and archiving
    April 22, 2014SNIA DSI EventThe Cloud Hybrid “Homerun” – Life Beyond The Hypebackup, restore, BC, DR and archiving
    April 16, 2014Open Source and Cloud Storage – Enabling business, or a technology enabler?Webinar
    9AM PT
    April 9, 2014Storage Decision Making for Fast, Big and Very Big Data EnvironmentsWebinar
    9AM PT

    Click here to view other upcoming along with earlier event activities. Watch for more 2014 events to be added soon to the StorageIO events calendar page. Topics include data protection modernization (backup/restore, HA, BC, DR, archive), data footprint reduction (archive, compression, dedupe), storage optimization, SSD, object storage, server and storage virtualization, big data, little data, cloud and object storage, performance and management trends among others.

    Vendors, VAR’s and event organizers, give us a call or send an email to discuss having us involved in your upcoming pod cast, web cast, virtual seminar, conference or other events.

    StorageIO Update Newsletter Archives

    Click here to view previous StorageIO Update newsletters (HTML and PDF versions) at www.storageio.com/newsletter. Subscribe to this newsletter (and pass it along) by clicking here (Via Secure Campaigner site). View archives of past StorageIO update news letters as well as download PDF versions at: www.storageio.com/newsletter

    Ok, nuff said (for now)

    Cheers
    Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    Is there an information or data recession? Are you using less storage? (With Polls)

    Is there an information or data recession? Are you using less storage? (With Polls)

    StorageIO industry trends

    Is there an information recession where you are creating, processing, moving or saving less data?

    Are you using less data storage than in the past either locally online, offline or remote including via clouds?

    IMHO there is no such thing as a data or information recession, granted storage is being used more effectively by some, while economic pressures or competition enables your budgets to be stretched further. Likewise people and data are living longer and getting larger.

    In conversations with IT professionals particular the real customers (e.g. not vendors, VAR’s, analysts, blogalysts, consultants or media) I routinely hear from people that they continue to have the need to store more information, however they’re data storage usage and acquisition patterns are changing. For some this means using what they have more effectively leveraging data footprint reduction (DFR) which includes (archiving, compression, dedupe, thin provision, changing how and when data is protected). This also means using different types of storage from flash SSD to HDD to SSHD to tape summit resources as well as cloud in different ways spanning block, file and object storage local and remote.

    A common question that comes up particular around vendor earnings announcement times is if the data storage industry is in decline with some vendors experience poor results?

    Look beyond vendor revenue metrics

    As a back ground reading, you might want to check out this post here (IT and storage economics 101, supply and demand) which candidly should be common sense.

    If all you looked at were a vendors revenues or margin numbers as an indicator of how well such as the data storage industry (includes traditional, legacy as well as cloud) you would not be getting the picture.

    What needs to be factored into the picture is how much storage is being shipped (from components such as drives to systems and appliances) as well as delivered by service providers.

    Looking at storage systems vendors from a revenue earnings perspective you would get mixed indicators depending on who you include, not to mention on how those vendors report break of revenues by product, or amount units shipped. For example looking at public vendors EMC, HDS, HP, IBM, NetApp, Nimble and Oracle (among others) as well as the private ones (if you can see the data) such as Dell, Pure, Simplivity, Solidfire, Tintri results in different analysis. Some are doing better than others on revenues and margins, however try to get clarity on number of units or systems shipped (for actual revenue vs. loaners (planting seeds for future revenue or trials) or demos).

    Then look at the service providers such as AWS, Centurlylink, Google, HP, IBM, Microsoft Rackspace or Verizon (among others) you should see growth, however clarity about how much they are actually generating on revenues plus margin for storage specific vs. broad general buckets can be tricky.

    Now look at the component suppliers such as Seagate and Western Digital (WD) for HDDs and SSHDs who also provide flash SSD drives and other technology. Also look at the other flash component suppliers such as Avago/LSI whose flash business is being bought by Seagate, FusionIO, SANdisk, Samsung, Micron and Intel among others (this does not include the systems vendors who OEM those or other products to build systems or appliances). These and other component suppliers can give another indicator as to the health of the industry both from revenue and margin, as well as footprint (e.g. how many devices are being shipped). For example the legacy and startup storage systems and appliance vendors may have soft or lower revenue numbers, however are they shipping the same or less product? Likewise the cloud or service providers may be showing more revenues and product being acquired however at what margin?

    What this all means?

    Growing amounts of information?

    Look at revenue numbers in the proper context as well as in the bigger picture.

    If the same number of component devices (e.g. processors, HDD, SSD, SSHD, memory, etc) are being shipped or more, that is an indicator of continued or increased demand. Likewise if there is more competition and options for IT organizations there will be price competition between vendors as well as service providers.

    All of this means that while IT organizations budgets stay stretched, their available dollars or euros should be able to buy (or rent) them more storage space capacity.

    Likewise using various data and storage management techniques including DFR, the available space capacity can be stretched further.

    So this then begs the question of if the management of storage is important, why are we not hearing vendors talking about software defined storage management vs. chasing each other to out software define storage each other?

    Ah, that’s for a different post ;).

    So what say you?

    Are you using less storage?

    Do you have less data being created?

    Are you using storage and your available budget more effectively?

    Please take a few minutes and cast your vote (and see the results).

    Sorry I have no Amex or Amazon gift cards or other things to offer you as a giveaway for participating as nobody is secretly sponsoring this poll or post, it’s simply sharing and conveying information for you and others to see and gain insight from.

    Do you think that there is an information or data recession?

    How about are you using or buying more storage, could there be a data storage recession?

    Some more reading links

    IT and storage economics 101, supply and demand
    Green IT deferral blamed on economic recession might be result of green gap
    Industry trend: People plus data are aging and living longer
    Is There a Data and I/O Activity Recession?
    Supporting IT growth demand during economic uncertain times
    The Human Face of Big Data, a Book Review
    Garbage data in, garbage information out, big data or big garbage?
    Little data, big data and very big data (VBD) or big BS?

    Ok, nuff said (for now)

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    Enterprise SSHD and Flash SSD Part of an Enterprise Tiered Storage Strategy

    Enterprise SSHD and Flash SSD Part of an Enterprise Tiered Storage Strategy

    The question to ask yourself is not if flash Solid State Device (SSD) technologies are in your future.

    Instead the questions are when, where, using what, how to configure and related themes. SSD including traditional DRAM and NAND flash-based technologies are like real estate where location matters; however, there are different types of properties to meet various needs. This means leveraging different types of NAND flash SSD technologies in different locations in a complementary and cooperative aka hybrid way.

    Introducing Solid State Hybrid Drives (SSHD)

    Solid State Hybrid Disks (SSHD) are the successors to previous generation Hybrid Hard Disk Drives (HHDD) that I have used for several years (you can read more about them here, and here).

    While it would be nice to simply have SSD for everything, there are also economic budget realities to be dealt with. Keep in mind that a bit of nand flash SSD cache in the right location for a given purpose can go a long way which is the case with SSHDs. This is also why in many environments today there is a mix of SSD, HDD of various makes, types, speeds and capacities (e.g. different tiers) to support diverse application needs (e.g. not everything in the data center is the same).

    However, If you have the need for speed and can afford or benefit from the increased productivity by all means go SSD!

    Otoh if you have budget constraints and need more space capacity yet want some performance boost, then SSHDs are an option. The big difference however between today’s SSHDs that are available for both enterprise class storage systems and servers, as well as desktop environments is that they can accelerate both reads and writes. This is different from their predecessors that I have used for several years now that had basic read acceleration, however no write optimizations.

    SSHD storage I/O oppourtunity
    Better Together: Where SSHDs fit in an enterprise tiered storage environment with SSD and HDDs

    As their names imply, they are a hybrid between a nand flash Solid State Device (SSD) and traditional Hard Disk Drive (HDD) meaning a best of situation. This means that the SSHD are based on a traditional spinning HDD (various models with different speeds, space capacity, interfaces) along with DRAM (which is found on most modern HDDs), along with nand flash for read cache, and some extra nonvolatile memory for persistent write cache combined with a bit of software defined storage performance optimization algorithms.

    Btw, if you were paying attention to that last sentence you would have picked up on something about nonvolatile memory being used for persistent write cache which should prompt the question would that help with nand flash write endurance? Yup.

    Where and when to use SSHD?

    In the StorageIO Industry Trends Perspective thought leadership white paper I recently released compliments of Seagate Enterprise Turbo SSHD (that’s a disclosure btw ;) enterprise class Solid State Hybrid Drives (SSHD) were looked at and test driven in the StorageIO Labs with various application workloads. These activities include being in a virtual environment for common applications including database and email messaging using industry standard benchmark workloads (e.g. TPC-B and TPC-E for database, JetStress for Exchange).

    Storage I/O sshd white paper

    Conventional storage system focused workloads using iometer, iorate and vdbench were also run in the StorageIO Labs to set up baseline reads, writes, random, sequential, small and large I/O size with IOPs, bandwidth and response time latency results. Some of those results can be found here (Part II: How many IOPS can a HDD, HHDD or SSD do with VMware?) with other ongoing workloads continuing in different configurations. The various test drive proof points were done in the   comparing SSHD, SSD and different HDDs.

    Data Protection (Archiving, Backup, BC, DR)

    Staging cache buffer area for snapshots, replication or current copies before streaming to other storage tier using fast read/write capabilities. Meta data, index and catalogs benefit from fast reads and writes for faster protection.

    Big Data DSS
    Data Warehouse

    Support sequential read-ahead operations and “hot-band” data caching in a cost-effective way using SSHD vs. slower similar capacity size HDDs for Data warehouse, DSS and other analytic environments.

    Email, Text and Voice Messaging

    Microsoft Exchange and other email journals, mailbox or object repositories can leverage faster read and write I/Os with more space capacity.

    OLTP, Database
     Key Value Stores SQL and NoSQL

    Eliminate the need to short stroke HDDs to gain performance, offer more space capacity and IOP performance per device for tables, logs, journals, import/export and scratch, temporary ephemeral storage. Leverage random and sequential read acceleration to compliment server-side SSD-based read and write-thru caching. Utilize fast magnetic media for persistent data reducing wear and tear on more costly flash SSD storage devices.

    Server Virtualization

    Fast disk storage for data stores and virtual disks supporting VMware vSphere/ESXi, Microsoft Hyper-V, KVM, Xen and others.  Holding virtual machines such as VMware VMDKs, along with Hyper-V and other hypervisor virtual disks.  Compliment virtual server read cache and I/O optimization using SSD as a cache with writes going to fast SSHD. For example VMware V5.5 Virtual SAN host disk groups use SSD as a read cache and can use SSHD as the magnetic disk for storing data while boosting performance without breaking the budget or adding complexity.

    Speaking of Virtual, as mentioned the various proof points were run using Windows systems that were VMware guests with the SSHD and other devices being Raw Device Mapped (RDM) SAS and SATA attached, read how to do that here.

    Hint: If you know about the VMware trick for making a HDD look like a SSD to vSphere/ESXi (refer to here and here) think outside the virtual box for a moment on some things you could do with SSHD in a VSAN environment among other things, for now, just sayin ;).

    Virtual Desktop Infrastructure (VDI)

    SSHD can be used as high performance magnetic disk for storing linked clone images, applications and data. Leverage fast read to support read ahead or pre-fetch to compliment SSD based read cache solutions. Utilize fast writes to quickly store data enabling SSD-based read or write-thru cache solutions to be more effective. Reduce impact of boot, shutdown, and virus scan or maintenance storms while providing more space capacity.

    Table 1 Example application and workload scenarios benefiting from SSHDs

    Test drive application proof points

    Various workloads were run using Seagate Enterprise Turbo SSHD in the StorageIO lab environment across different real world like application workload scenarios. These include general storage I/O performance characteristics profiling (e.g. reads, writes, random, sequential or various IOP size) to understand how these devices compare to other HDD, HHDD and SSD storage devices in terms of IOPS, bandwidth and response time (latency). In addition to basic storage I/O profiling, the Enterprise Turbo SSHD was also used with various SQL database workloads including Transaction Processing Council (TPC); along with VMware server virtualization among others use case scenarios.

    Note that in the following workload proof points a single drive was used meaning that using more drives in a server or storage system should yield better performance. This also means scaling would be bound by the constraints of a given configuration, server or storage system. These were also conducted using 6Gbps SAS with PCIe Gen 2 based servers and ongoing testing is confirming even better results with 12Gbs SAS, faster servers with PCIe Gen 3.

    SSHD large file storage i/o
    Copy (read and write) 80GB and 220GB file copies (time to copy entire file)

    SSHD storage I/O TPCB Database performance
    SQLserver TPC-B batch database updates

    Test configuration: 600GB 2.5” Enterprise Turbo SSHD (ST600MX) 6 Gbps SAS, 600GB 2.5” Enterprise Enhanced 15K V4 (15K RPM) HDD (ST600MP) with 6 Gbps SAS, 500GB 3.5” 7.2K RPM HDD 3 Gbps SATA, 1TB 3.5” 7.2K RPM HDD 3 Gbps SATA. Workload generator and virtual clients ran on Windows 7 Ultimate. Microsoft SQL Server 2012 Database was on Windows 7 Ultimate SP1 (64 bit) 14 GB DRAM, Dual CPU (Intel x3490 2.93 GHz)), with LSI 9211 6Gbps SAS adapters with TPC-B (www.tpc.org) workloads. VM resided on separate data store from devices being tested. All devices being tested with SQL MDF were Raw Device Mapped (RDM) independent persistent with database log file (LDF) on a separate SSD device also persistent (no delayed writes). Tests were performed in StorageIO Lab facilities by StorageIO personal.

    SSHD storage I/O TPCE Database performance
    SQLserver TPC-E transactional workload

    Test configuration: 600GB 2.5” Enterprise Turbo SSHD (ST600MX) 6 Gbps SAS, 600GB 2.5” Enterprise Enhanced 15K V4 (15K RPM) HDD (ST600MP) with 6 Gbps SAS, 300GB 2.5” Savio 10K RPM HDD 6 Gbps SAS, 1TB 3.5” 7.2K RPM HDD 6 Gbps SATA. Workload generator and virtual clients Windows 7 Ultimate. Microsoft SQL Server 2012 database was on Windows 7 Ultimate SP1 (64 bit) 14 GB DRAM, Dual CPU (E8400 2.99GHz), with LSI 9211 6Gbps SAS adapters with TPC-E (www.tpc.org) workloads. VM resided on separate SSD based data store from devices being tested (e.g., where MDF resided). All devices being tested were Raw Device Mapped (RDM) independent persistent with database log file on a separate SSD device also persistent (no delayed writes). Tests were performed in StorageIO Lab facilities by StorageIO personal.

    SSHD storage I/O Exchange performance
    Microsoft Exchange workload

    Test configuration: 2.5” Seagate 600 Pro 120GB (ST120FP0021 ) SSD 6 Gbps SATA, 600GB 2.5” Enterprise Turbo SSHD (ST600MX) 6 Gbps SAS, 600GB 2.5” Enterprise Enhanced 15K V4 (15K RPM) HDD (ST600MP) with 6 Gbps SAS, 2.5” Savio 146GB HDD 6 Gbps SAS, 3.5” Barracuda 500GB 7.2K RPM HDD 3 Gbps SATA. Email server hosted as guest on VMware vSphere/ESXi V5.5, Microsoft Small Business Server (SBS) 2011 Service Pack 1 64 bit, 8GB DRAM, One CPU (Intel X3490 2.93 GHz) LSI 9211 6 Gbps SAS adapter, JetStress 2010 (no other active workload during test intervals). All devices being tested were Raw Device Mapped (RDM) where EDB resided. VM on a SSD based separate data store than devices being tested. Log file IOPs were handled via a separate SSD device.

    Read more about the above proof points along view data points and configuration information in the associated white paper found here (no registration required).

    What this all means

    Similar to flash-based SSD technologies the question is not if, rather when, where, why and how to deploy hybrid solutions such as SSHDs. If your applications and data infrastructures environment have the need for storage I/O speed without loss of space capacity and breaking your budget, SSD enabled devices like the Seagate Enterprise Turbo 600GB SSHD are in your future. You can learn more about enterprise class SSHD such as those from Seagate by visiting this link here.

    Watch for extra workload proof points being performed including with 12Gbps SAS and faster servers using PCIe Gen 3.

    Ok, nuff said.

    Cheers
    Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    Data Storage Innovation Chat with SNIA Wayne Adams and David

    Data Storage Innovation Chat with SNIA Wayne Adams and David

    In this episode, SNIA Chairman Emeritus Wayne Adams and current Chairman David Dale join me in a conversation from the Data Storage Innovation Conference (DSICON) 2014 conference event.

    SNIA DSI David Dale
    SNIA Chairman David Dale opening remarks SNIA DSICON 2014

    SNIA DSI Conference (DSICON), CDMI Conformance Testing and other updates

    DSICON is a new event produced by SNIA targeted for IT professionals involved with data storage related topics, themes, technologies and tools spanning hardware, software, cloud, virtual and physical. In this conversation, we talk about the new DSI event, the diversity of new attendees who are attending their first SNIA event, along with other updates. Some of these updates include what is new with the SNIA Cloud Data Management Initiative (CDMI), Non Volatile Memory (think flash and SSD), SMIS, education and more. In addition to the DSICON event, SNIA also announced CDMI Cloud Interoperability Conformance Test Program is now available for cloud solution vendors and providers.

    DSI, Santa Clara, CA (April 22, 2014)— The Storage Networking Industry Association (SNIA), today announced the launch of a Cloud Data Management Interface (CDMI) Conformance Test Program (CTP)that validates cloud products’ conformance to the ISO/IEC CDMI standard for cloud data interoperability(ISO catalog number ISO/IEC 17826:2012). Cloud solutions that pass the CDMI CTP offer cloud consumers assurance that the CDMI standard has been properly implemented and that data stored in any conformant implementation will be transportable to any other conformant implementation.

    Here is a perspective commentary quote that I issued which was included in the SNIA Press Release.

    “Today, the cloud market is crowded with a slew of vendors offering different solutions for migration, data management and security, often leaving IT customers confused about the right solution for their requirements,” said Greg Schulz, founder of StorageIO, a storage technology advisory and consulting firm. “SNIA’s CDMI Conformance Test Program is a great step forward helping IT customers, VARs or others in the industry navigate their way through the fog of cloud interoperability requirements in a streamlined fashion, not to mention laying standard routes vendors will want to adopt going forward.”

    Check out the full SNIA CDMI press release announcement for the conformance testing here, as well as learn more about CDMI here.

    audio

    Listen in to our podcast conversation here as we cover cloud, convergence, software defined and more about data storage.

    Topics and themes discussed:

  • Data Storage Innovation (DSICON) Conference
  • Data Storage Infrastructures and Convergence
  • Cloud Data Management Initiative (CDMI) and Conformance Testing
  • CDMI Update and Overview (or refresher)
  • Nonvolatile Memory and flash SSD
  • Standards, education and other technical activities
  • Check out SNIA and DSICON listen in to the conversation with David Dale and Wayne Adams here.

    Also available via 

    Ok, nuff said.

    Cheers
    Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    Chat with Cash Coleman talking ClearDB, cloud database and Johnny Cash

    Podcast with Cash Coleman talking ClearDB, cloud database and Johnny Cash

    audio

    In this episode from the SNIA DSI 2014 event I am joined by Cashton Coleman (@Cash_Coleman).

    cash coleman cleardb

    Introducing Cashton (Cash) Coleman and ClearDB

    Cashton (Cash) is a Software architect, product mason, family bonder, life builder, idea founder along with Founder & CEO of SuccessBricks, Inc., makers of ClearDB. ClearDB is a provider of MySQL database software tools for cloud and physical environments. In our conversation talk about ClearDB, what they do and whom they do it with including deployments in cloud’s as well as onsite. For example if you are using some of the Microsoft Azure cloud services using MySQL, you may already be using this technology. However, there is more to the story and discussion including how Cash got his name, how to speed up databases for little and big data among other topics.

    If you are a database person, you will want to listen to what Cash has to say about boosting performance and getting more value out of your physical hardware or cloud services. On the other hand if you are a storage person, listen in to get some insight and ideas on to address database performance and resiliency. For others who just like to listen to new trends, technology talk, or hear about emerging companies to keep an eye on, you wont want to miss the podcast conversation.

    Topics and themes discussed:

  • Traditional and Cloud Database
  • MySQL and Database as a Service (DaaS)
  • Microsoft Azure and Amazon Web Services (AWS)
  • Little Data, Big Data and Big Data Databases
  • Boosting database performance with less hardware
  • Getting more value out of fast SSD hardware
  • Database performance and resiliency
  • What’s the Johnny Cash and Cloud Connection
  • Check out ClearDB and listen in to the conversation with Cash podcast here.

    Also available via 

    Ok, nuff said.

    Cheers
    Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    Data Protection Diaries: March 31 World Backup Day is Restore Data Test Time

    Storage I/O trends

    World Backup Day Generating Awareness About Data Protection

    This World Backup Day piece is part of my ongoing Data Protection Diaries series of posts (www.dataprotecitondiaries.com) about trends, strategies, tools and best practices spanning applications, archiving, backup/restore, business continuance (BC), business resiliency (BR), cloud, data footprint reduction (DFR), security, servers, storage and virtualization among other related topic themes.

    data protection threat risk scenarios
    Different threat risks and reasons to protect your digital assets (data)

    March 31 is World Backup Day which means you should make sure that your data and digital assets (photos, videos, music or audio, scanned items) along with other digital documents are protected. Keep in mind that various reasons for protecting, preserving and serving your data regardless of if you are a consumer with needs to protect your home and personal information, or a large business, institution or government agency.

    Why World Backup Day and Data Protection Focus

    By being protected this means making sure that there are copies of your documents, data, files, software tools, settings, configurations and other digital assets. These copies can be in different locations (home, office, on-site, off-site, in the cloud) as well as for various points in time or recovery point objective (RPO) such as monthly, weekly, daily, hourly and so forth.

    Having different copies for various times (e.g. your protection interval) gives you the ability to go back to a specific time to recover or restore lost, stolen, damaged, infected, erased, or accidentally over-written data. Having multiple copies is also a safeguard incase either the data, files, objects or items being backed up or protected are bad, or the copy is damaged, lost or stolen.

    Restore Test Time

    While the focus of world backup data is to make sure that you are backing up or protecting your data and digital assets, it is also about making sure what you think is being protected is actually occurring. It is also a time to make sure what you think is occurring or know is being done can actually be used when needed (restore, recover, rebuild, reload, rollback among other things that start with R). This means testing that you can find the files, folders, volumes, objects or data items that were protected, use those copies or backups to restore to a different place (you don’t want to create a disaster by over-writing your good data).

    In addition to making sure that the data can be restored to a different place, go one more step to verify that the data can actually be used which means has it be decrypted or unlocked, have the security or other rights and access settings along with meta data been applied. While that might seem obvious it is often the obvious that will bite you and cause problems, hence take some time to test that all is working, not to mention get some practice doing restores.

    Data Protection and Backup 3 2 1 Rule and Guide

    Recently I did a piece based on my own experiences with data protection including Backup as well as Restore over at Spiceworks called My copies were corrupted: The 3-2-1 rule. For those not familiar, or as a reminder 3 2 1 means have more than three copies or better yet, versions stored on at least two different devices, systems, drives, media or mediums in at least one different location from the primary or main copy.

    Following is an excerpt from the My copies were corrupted: The 3-2-1 rule piece:

    Not long ago I had a situation where something happened to an XML file that I needed. I discovered it was corrupted, and I needed to do a quick restore.

    “No worries,” I thought, “I’ll simply copy the most recent version that I had saved to my file server.” No such luck. That file had been just copied and was damaged.

    “OK, no worries,” I thought. “That’s why I have a periodic backup copy.” It turns out that had worked flawlessly. Except there was a catch — it had backed up the damaged file. This meant that any and all other copies of the file were also damaged as far back as to when the problem occurred.

    Read the full piece here.

    Backup and Data Protection Walking the Talk

    Yes I eat my own dog food meaning that I practice what I talk about (e.g. walking the talk) leveraging not just a  3 2 1 approach, actually more of a 4 3 2 1 hybrid which means different protection internals, various retention’s and frequencies, not all data gets treated the same, using local disk, removable disk to go off-site as well as cloud. I also test candidly more often by accident using the local, removable and cloud copies when I accidentally delete something, or save the wrong version.

    Some of my data and applications are protected throughout the day, others on set schedules that vary from hours to days to weeks to months or more. Yes, some of my data such as large videos or other items that are static do not change, so why backup them up or protect every day, week or month? I also align the type of protection, frequency, retention to meet different threat risks, as well as encrypt data. Part of actually testing and using the restores or recoveries is also determining what certificates or settings are missing, as well as where opportunities exist or needed to enhance data protection.

    Closing comments (for now)

    Take some time to learn more about data protection including how you can improve or modernize while rethinking what to protect, when, where, why how and with what.

    In addition to having copies from different points in time and extra copies in various locations, also make sure that they are secured or encrypted AND make sure to protect your encryption keys. After all, try to find a digital locksmith to unlock your data who is not working for a government agency when you need to get access to your data ;)…

    Learn more about data protection including Backup/Restore at www.storageioblog.com/data-protection-diaries-main/ where there are a collection of related posts and presentations including:

    Also check out the collection of technology and vendor / product neutral data protection and backup/restore content at BackupU (disclosure: sponsored by Dell Data Protection Software) that includes various webinars and Google+ hangout sessions that I have been involved with.

    Watch for more data protection conversations about related trends, themes, technologies, techniques perspectives in my ongoing data protection diaries discussions as well as read more about Backup and other related items at www.storageioblog.com/data-protection-diaries-main/.

    Ok, nuff said

    Cheers
    Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    Matt Vogt of Computex talks VMware vCOPs in his first ever podcast

    Storage I/O trends

    Matt Vogt of Computex talks VMware vCOPs in his first ever podcast

    audio

    In this episode from the Computex Rethink your Datacenter for 2017 planning and strategy event I am joined by Matt Vogt (@MattVogt).

    Introducing Matt Vogt

    Matt is a Principal Architect with Computex Technology Solutions as well as certified VMware specialist and fellow vExpert.

    audio

    Not only is this the first appearance by Matt on the StorageIO Podcasts, it is also his first time as a guest on any podcast so I’m honored to host his global debut podcast appearance here.

    We talk about the role of automation for performance and capacity optimization along with how VMware vCOPs plays an important role.

    Listen in to learn more about how to gain insight and situational awareness to make informed decisions for your data infrastructure environment with Matt.

    Check out Matt’s blog here at blog.mattvogt.net and listen in to the pod cast here.

    Also available via 

    Ok, nuff said.

    Cheers
    Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    Missing MH370 should remind us, do you know where your digital assets are?

    Storage I/O trends

    Missing MH370 should remind us, do you know where your digital assets are?

    I recently did a piece over at InformationSecurityBuzz called Dark Territories, Do You Know Where Your Information Is?

    Clouds and lack of insight awarness

    In that piece (click here), I bring up the topic of dark territories which with the recent missing Malaysian Airlines flight 370 (e.g. MH370) reminds us that even with today’s 24×7 Internet of Things (IoT) connected world, there are still dark spot areas lacking in coverage or monitoring.

    Some of you might have heard of dark territories as a term used in days of old that refereed to parts of railroads or other transportation that were out of site with no command, control, monitoring or communications.

    Perhaps something that the tragedy of MH370 will remind us all is just how big this planet is, and not everything is connected or covered or monitored yet, or, at least that we know about or have access to.

    Excerpt from the piece:

    It might seem awkward today in this era of instant access to news, information as it happens, or in some cases before it happens how can we not know where something is?

    Between traditional media and social media, not to mention public on-line web sites, along with big data powered government (or private) surveillance using radar, cell-phone or other radio based, not to mention satellite tracking.

    Thus, how can we not know where things are?

    Do you know where your data and information are or have been?

    Do you have positive control over where you data and information have been?

    Is your data and information exposed to dark territories?

    With the recent disappearance of Malaysian Airlines flight 370 (MH 370) a Boeing 777 flying from Kula Lumpur to Beijing China, how can we not know where it is? After all, we all have public access to sites such as FlightAware and FlightRadar among many others, not to mention sites we in the public may not have access to. Same with using Cell phones or other forms of electronics, surely in the 7×24 non-stop, always connected world we should have insight and situational awareness about where things are always at, right?

    Wrong!

    Click here to read more.

    Do you have digital dark territory or security surveillance gaps in your environment?

    Dark Territory and digital data security

    How safe and secure are your digital assets and information resources including data, software applications, hardware and services?

    Are you securing your information and digital assets with rings or layers of defense?

    What about tracking where those items including data or hardware and software have been or do you have dark territory points of exposure

    Hopefully you are not one of those that I see at airports, coffee shops or at events who leave your computer or other digital assets alone, unattended while going to get a new beverage, or off to the rest room, talking on the phone? No worries, others will watch over your digital assets, right?

    Closing comments about MH370

    In the meantime condolences to those who lost friends and family including crew members on MH370. I only have flown MH a couple of times including over some dark or almost dark territories between the US and Asia and on to Australia in and out Kuala Lumpur which was a good experience. Also would like to extend thanks and best wishes to all of those involved in the search efforts so that someday we can learn what happened as well as to prevent it in the future.

    Ok, nuff said (for now)

    Cheers
    Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved