Matt Vogt of Computex talks VMware vCOPs in his first ever podcast
In this episode from the Computex Rethink your Datacenter for 2017 planning and strategy event I am joined by Matt Vogt (@MattVogt).
Introducing Matt Vogt
Matt is a Principal Architect with Computex Technology Solutions as well as certified VMware specialist and fellow vExpert.
Not only is this the first appearance by Matt on the StorageIO Podcasts, it is also his first time as a guest on any podcast so I’m honored to host his global debut podcast appearance here.
We talk about the role of automation for performance and capacity optimization along with how VMware vCOPs plays an important role.
Listen in to learn more about how to gain insight and situational awareness to make informed decisions for your data infrastructure environment with Matt.
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
Industry Trends Perspectives: Cisco Cloud and VMware VSAN
Welcome to the March 2014 edition of the StorageIO Update (newsletter) containing trends perspectives on cloud, virtualization and data infrastructure topics. Technically it is now spring here in North America and to say that we have had abnormal cold weather would be an understatement. However it is March with April just around the corner meaning plenty to do including several upcoming events (see below).
Clouds and Cisco
Some recent industry activity has included Cisco announcing its Cloud intentions (e.g. more than simply selling servers and networking hardware). So far the Cisco Cloud move appears to be more about hybrid and partner ecosystem including channels vs. going toes to toe with an Amazon Web Service (AWS). Cisco appears to playing the hybrid theme of being a technology supplier as well as provider or partner. Thus, it looks like for the near term the Cisco cloud target is not as much AWS as the likes of an IBM who recently added Softlayer or an HP.
Greg Schulz on break
This will also be interesting to watch where along with how other Cisco partners such as EMC, Microsoft, NetApp, VCE and VMware participate. Keep in mind that some of these and other Cisco partners also have their own public, private and hybrid cloud initiatives, services along with being a supplier to each other.
VMware VSAN Software Defined Storage
Another industry activity involving servers storage I/O networking hardware software and virtualization (aka software defined) was the general announcement (GA) by VMware of Virtual SAN (VSAN). VMware VSAN went into public beta shortly after VMworld 2013 timeframe when many of us downloaded, installed and did various types of testing with it.
For those not familiar with VSAN, it is added licensed software functionality for VMware that creates a cluster to host Virtual Machines (VMs) along with its own shared resilient storage solution (e.g. Software Defined Storage). How VSAN works is to use PCIe, SAS, SATA dedicated direct attached storage (DAS) including that are local to the VMware host server (physical machine or PM). The VMware host PMs support DAS Hard Disk Drives (HDD), Solid State Devices (SSD) including PCIe cards, drives or DIMMs, along with Solid State Hybrid Drives (SSHD). This local DAS storage is served and shared among the nodes (up to 32 host or PMs) per VSAN cluster balancing performance, availability (and resiliency) along with space capacity to host VM objects. Note that VM objects include VMDKs (e.g. virtual disks) and are not to be confused with the other type of object storage or access such as CDMI/SWIFT/S3/HTTP/REST.
VMs (and those managing them) see in the VSAN cluster dats that are familiar with other VMware implementations including storage policies and other tools. Here is a link to a great piece by Patrick Schulz a data infrastructure systems engineer in Germany (no relation, at least not that I know of yet) where he shares his experiences with VSAN implementation.
Generic VSAN example
Instead of using an external iSCSI, Fibre Channel (FC) or FC over Ethernet (FCoE) shared SAN or NAS storage system / appliance to create the storage repository, local DAS is leveraged in groups spread across the hosts in the VSAN cluster (up to 32 nodes ). VSAN requires a percentage of SSD for each storage group on the host cluster nodes that a part is used for caching data which is persistently stored on HDD based media.
VSAN software is licensed by the number of active sockets (not the cores) in the host servers (PM) that are in the cluster or by number of VDI users (guest VMs). For example if there are four servers two with one socket and two with dual sockets there would be six socket licenses. MSRP License cost per processor socket is $2,495 USD which also assumes core VMware licenses already exist. There are also a per guest VM license of $50 per VDI instance, as well as other optional license models and bundles with different features or upgrades.
What is different with VSAN vs. other VMware clusters is that a) the storage is only accessible to VMs that are in the VSAN cluster (unless a VM exports and serves to others via NFS, iSCSI, etc which is a different conversation for another day). Another difference is that today VSAN leverage storage inside of servers or direct attached as opposed to using iSCSI, FC, FCoE SAN or NAS storage systems.
Btw, the current maximum LUN, volume or target storage device size is 4TB so if you were thinking of taking a SAS attached storage system and creating a bunch of small LUNs, you might want to review that from a cost perspective, or at least for today.
There is much more to VSAN including how it works, what it can and can not do, who it is for and whom should not use for different app’s, however IMHO besides lower-end, SMB, workgroup, departmental, VMware centric environments, the number one scenario today is VDI along with where converged solutions such as those from Nutanix, Simplivity and Tintri among others are playing.
Watch for more StorageIO posts, commentary, perspectives, presentations, webinars, tips and events on information and data infrastructure topics, themes and trends. Data Infrastructure topics include among others cloud, virtual, legacy server, storage I/O networking, data protection, hardware and software.
Industry trends tips, commentary, articles and blog posts What is being seen, heard and talked about while out and about
The following is a synopsis of some StorageIOblog posts, articles and comments in different venues on various industry trends, perspectives and related themes about clouds, virtualization, data and storage infrastructure topics among related themes.
Recent StorageIO comments and perspectives in the news
SearchSolidStateStorage: Comments on automated storage tiering and flash EnterpriseStorageForum: Comments on Cloud-Storage Mergers and Acquisitions SearchDataBackup: Comments on near-CDP nudging true CDP from landscape EnterpriseStorageForum: Comments on Ways to Avoid Cloud Storage Pricing Surprises SearchDataBackup: Q&A: Snapshot, replication ‘great approach’ for data protection SearchDataBackup: Comments on LTFS-enabled products
Recent StorageIO tips and articles in various venues
InformationSecurityBuzz: Dark Territories – Do You Know Where Your Information Is? InformationSecurityBuzz: Rings Of Security For Data Protection Or For Appearance? SearchSolidStateStorage: Q&A on automated storage tiering and flash SpiceWorks: My copies were corrupted: The 3-2-1 data protection rule
Recent StorageIOblog posts and perspectives
Missing MH370 reminds us, do you know where your digital assets are? Click to read more
Remember to check out our objectstoragecenter.com page where you will find a growing collection of information and links on cloud and object storage themes, technologies and trends from various sources.
StorageIO activities (out and about)
Seminars, symposium, conferences, webinars Live in person and recorded recent and upcoming events
The StorageIO calendar continues to evolve, here are some recent and upcoming activities.
June 12, 2014
The Many Facets of Virtual Storage and Software Defined Storage Virtualization
National Association Broadcasters (e.g. Very Big Fast data Event)
Las Vegas
March 27, 2014
Keynote: The 2017 Datacenter – PREPARING FOR THE 2017 DATACENTER SESSIONS
Edina 8:00AM Register Here
129/78/148/103/1527/350/242/91 = 650
Click here to view other upcoming along with earlier event activities. Watch for more 2014 events to be added soon to the StorageIO events calendar page. Topics include data protection modernization (backup/restore, HA, BC, DR, archive), data footprint reduction (archive, compression, dedupe), storage optimization, SSD, object storage, server and storage virtualization, big data, little data, cloud and object storage, performance and management trends among others.
Vendors, VAR’s and event organizers, give us a call or send an email to discuss having us involved in your upcoming pod cast, web cast, virtual seminar, conference or other events.
Thank you to the current StorageIoblog.com site sponsor advertisers
Druva (End Point Data Protection) Unitrends (Enterprise backup solution and management tools) Veeam (VMware and Hyper-V virtual server backup and data protection tools).
Contact StorageIO to learn about sponsorship and other partnership opportunities.
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
The current calendar which continues to be updated includes a mix of webinars (playback are available), and live events covering data infrastructure topics from cloud, virtual, physical and software defined across servers, storage I/O networking, SSD, performance, object storage and data protection among other related themes.
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
USENIX FAST (File and Storage Technologies) 2014 Conference Proceedings
In case you missed it, the 12th annual USENIX conference on File and Storage Technologies (FAST) was recently held in Santa Clara, CA.
Big Data, Little Data, Fast SSD and Erasure Code Data
If like me you are interested in FAST related technologies, trends, tools and related research, check out the conference PDF proceedings here.
You can also go here to the USENIX FAST site to view additional information about the sessions along with other download material.
The PDF format proceedings contain over 320 pages of content including some good white papers and information covering RAID and Erasure code, Big Data and Little Data, Cloud and Virtualization, Flash, DRAM, SSD, Filesystem performance, metrics, measurement and related software along with plenty of file system related material.
Heads up though, these are not your usual vendor high-level marketing white papers rather what you would expect from a technical conference such as FAST as you can see in the above index with abstracts.
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
Welcome to the February 2014 edition of the StorageIO Update (newsletter) containing trends perspectives on cloud, virtualization and data infrastructure topics. Its winter here in North America and specifically in the Stillwater Minnesota to say that there is plenty of snow and cold would be an understatement. However in a few months instead of dealing with -20F or -40F wind chills, it will be 100F head index, thus the saying of if you don’t like the weather, either leave or wait a bit as it will change.
In case you missed the December 2013 StorageIO holiday greeting which was in place of the normal newsletter you can view that here. In the absence of the regular December and January StorageIO Update newsletters, this is a larger edition to get caught up. However not to worry as there is more content and items in the wings for March.
2013 wrapped up with a flurry of industry activity including some acquisitions (Avago buying LSI and Seagate acquiring Xyratex among others). Likewise 2014 so far is continuing the momentum living up to the mantra that while there may be economic challenges, there is no such thing as a data or information recession.
Watch for future posts, commentary, perspectives and other information down the road (and in the not so distant future) pertaining to information and data infrastructure topics, themes and trends across cloud, virtual, legacy server, storage, networking, hardware and software. Also check out our backup, restore, BC, DR and archiving (Under the resources section on StorageIO.com) for various presentation, book chapter downloads and other content.
Enjoy this edition of the StorageIO Update newsletter and keep in mind, at least here in North America spring is just around the corner with summer not to far off either.
Ok, nuff said (for now)
Cheers gs
Industry trends tips, commentary, articles and blog posts What is being seen, heard and talked about while out and about
The following is a synopsis of some StorageIOblog posts, articles and comments in different venues on various industry trends, perspectives and related themes about clouds, virtualization, data and storage infrastructure topics among related themes.
Recent StorageIO comments and perspectives in the news
SearchSMBStorage: Comments on Lenovo EMC Iomega new SMB NAS products ChannelProSMB: Comments on what the future holds for HDDs NetworkAsia: Comments on WORM disk and tape SeaarchSolidStateStorage: Comments on SSD industry activity and OCZ bankruptcy EnterpriseStorageForum: Comments on software defined storage Ironmountain: Comments on storage efficiency in small businesses PC Today: Comments on best practices PC Today: Commnets on How to recover lost data PC Today: Comments on Virtualization 101, understand context which virtualization is used PC Today: Comments on going paperless PC Today: Optimize Now – Comments on optimize to improve IT productivity Processor: Comments on Know Which Emerging Technologies Could Make An Impact Processor: Comments on Backup Problems – What To Do Before & After Issues Arise Processor: Comments on Know When & When Not To Replace Servers Processor: Comments on Enterprise Backup Solutions Buying Tips Processor: Comments on Server Trends, Technologies Reshape The Industry
Recent StorageIO tips and articles in various venues
Information Security Buzz: How Secure Is Your Data Storage? SearchStorage: Bridging the gap: Choosing storage-over-distance network technology SearchEnterpriseWAN: Wide area network resiliency best practices StateTech: 5 Tips for Factoring Software into Disaster Recovery Plans BizTech: How to Turn Storage Networks into Better Performers InfoStor: The Many Variations of RAID Storage
Recent StorageIOblog posts and perspectives
Server Storage I/O Network Benchmark Winter Olympic Games – Click to read more
Removing complexity and cost to drive return on innovation – Click to read more
StorageIO data infrastructure links page updated (1,200+ entries) – Click to read more
IoD, IoT, IoE, IoS, IoP, IoU and IoX are in your future – Click to read more
Goodbye 2013, hello 2014, predictions past, present and future – Click to read more
Small Medium Business (SMB) IT gains respect, what about SOHO? – Click to read more
Seasons Greetings, Happy Holidays 2013 from StorageIO – Click to read more
Server virtualization nested and tiered hypervisors – Click to read more
Remember to check out our objectstoragecenter.com page where you will find a growing collection of information and links on cloud and object storage themes, technologies and trends from various sources.
StorageIO activities (out and about)
Seminars, symposium, conferences, webinars Live in person and recorded recent and upcoming events
The StorageIO calendar continues to evolve, here are some recent and upcoming activities.
March 13, 2014
BrightTalk
Business Resiliency (BR), Business Continuity (BC) and Disaster Recovery (DR) Management
Webinar 9AM PT
March 12, 2014
BrightTalk
Hybrid Clouds – Bridging the Gap between public and private environments
Webinar 9AM PT
February 18, 2014
BrightTalk
Networking with your Servers and Storage – Cloud, virtual and physical environments
Click here to view other upcoming along with earlier event activities. Watch for more 2014 events to be added soon to the StorageIO events calendar page. Topics include data protection modernization (backup/restore, HA, BC, DR, archive), data footprint reduction (archive, compression, dedupe), storage optimization, SSD, object storage, server and storage virtualization, big data, little data, cloud and object storage, performance and management trends among others.
Vendors, VAR’s and event organizers, give us a call or send an email to discuss having us involved in your upcoming pod cast, web cast, virtual seminar, conference or other events.
Thank you to the current StorageIoblog.com site sponsor advertisers
Druva (End Point Data Protection)
EMC (EMC Community Network) Unitrends (Enterprise backup solution and management tools) Veeam (VMware and Hyper-V virtual server backup and data protection tools).
Contact StorageIO to learn about sponsorship and other partnership opportunities.
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
Server Storage I/O Network Benchmark Winter Olympic Games
It is time for the 2014 Winter Olympic games in Sochi Russia where competitors including some athletes come together in what has become a mix of sporting and entertainment engaging activities.
Games of inches and seconds, performance and skill
Some of these activities including real Olympic game events are heavier on sports appeal, some with artistic and others pure entertainment with a mix of beauty, braun and maybe even a beast or two. Then there are those events that have been around since the last ice age, while others being post global warming era.
Hence some have been around longer than others showing a mix of old, new in terms of the sports, athletes not to mention technology and their outfits.
I mean how about some of the new snow boarding and things on skis being done, can you image if they brought in as a new "X" sport roller derby on the short speed skating track sponsored by Red Bull or Bud light? Wait, that sounds like the Red Bull Crashed Ice event (check this out if not familiar with) think motto cross, hockey, down hill on ice. How about getting some of the south African long distance sprinters to learn how to speed skate, talk about moving some gold metal as in medals back to the african continent! On the other hand, the current powers to be would lodge protest, change the benchmark or rules to stay in power, hmm, sound familiar with IT?
Ok, enough of the fun stuff (for now), let’s get back on track here (catch that pun?).
Metrics that matter, winners and losers
Since these are the Olympics, lets also remember that there still awards for personal and team winners (along with second and third place), after all, if all Olympians were winners, there would be no losers and if no losers, how could there be a winner?
Who or what decides the winners vs. losers involves metrics that matter, something that also applies to servers, storage I/O networking hardware, software and services.
In the case of the Olympics, some of the sports or events are based on speed or how fast (e.g. time) something is done, or how much is accumulated or done in that amount of time while in other events the metrics that matter may be more of a mystery based on judging that maybe subjective.
The technologies to record times, scores, movements and other things that go into scoring have certainly improved, as have the ability for fans to engage and vote their choice, or opposition via social media venues from twitter to face book among others.
What about server storage I/O networking benchmarks
There could easily be an Information Technology (IT) or data infrastructure benchmarking Olympics with events such as faster server (physical, virtual or cloud, personal or consortium team), storage, I/O and networking across hardware, software or services. Of course there would be different approaches favored by the various teams with disputes, protests and other things sometimes seen during Olympic games. One of the challenges however is what would be the metrics that matter particularly to the various marketing groups of each organization or their joint consortium?
Just like with sports, which of the various industry trade groups or consortiums would be the ruling party or voice for a particular event specifying the competition criteria, scoring and other things. What happens when there is a break away group that launches their own competing approach yet when it comes time for the IT benchmarking Olympics, which of the various bodies does the Olympic committee defer to? In case you are not familiar with in sports there are various groups and sub-groups who can decide the participants for various supports perhaps independent of an overall group, sound like IT?
Let the games begin
So then the fun starts, however which of the events are relevant to your needs or interest, sure some are fun or entertaining while others are not practical. Some you can do yourself, while others are just fun to watch, both the thrill of victory and agony of defeat.
This is similar to IT industry benchmarking and specmanship competitions, some of which is more relevant than others, then there are those that are entertaining.
Likewise some benchmarks or workload claims can be reproduced to confirm the results or claims, while others remain more like the results of figure skating judges.
Hence some of the benchmark games are more entertaining, however for those who are not aware or informed, they may turn out to be more misinformation or lead to poor decision-making.
Consequently benchmarks and metrics that matter are those that most closely aging with what your environment is or will be doing.
If your environment is going to be running a particularly simulation or script, than so be it, otoh, look for comparisons that are reflective.
On the other hand, if you can’t find something that is applicable, then look at tools and results that have meaning along with relevance, not to mention that provide clarity and repeatable. Being repeatable means that you can get access to the tools, scripts or scenario (preferably free) to run in your own environment.
There is a long list of benchmarks and workload simulation tools, as well as traces available, some for free, some for fee that apply to components, subsystems or complete application systems from server, storage I/O networking applications and hardware. These include those for Email such as Microsoft Exchange related, SQL databases, , LoginVSI for VDI, VMmark for VMware, Hadoop and HDFS related for big data among many others (see more here).
Apples to Apples vs. Apple pie vs. Orange Jello
Something else that matters are apples to apples vs. apples to oranges or worse, apple pie to orange Jello.
This means knowing or gaining insight into the pieces as we as how they behave under different conditions as well as the entire system for a baseline (e.g normal) vs. abnormal.
Hence its winter server storage I/O networking benchmark games with the first event having been earlier this week with team Brocade taking on Cisco. Here is a link to a post by Tony Bourke (@tbourke) that provides some interesting perspectives and interactions, along with a link here to the Brocade sponsored report done by Evaluator Group.
In this match-up, Team Brocade (with HP servers, Brocade switches and an unnamed 16GFC SSD storage system) take on Team Cisco and their UCS (also an un-named 16GFC SSD system that I wonder if Cisco even knows whose’s it was?). Ironic that it was almost six years to the date that there was a similar winter benchmark wonder event when NetApp submitted an SPC result for EMC (read more about that cold day here).
The Brocade FC (using HP servers and somebody’s SSD storage) vs. Cisco FCoE using UCS (and somebody else’s storage) comparison is actually quite entertaining, granted it can also be educational on what to do or not do, focus on or include among others things. The report also raises many questions that seem more wondering why somebody won in an ice figuring skating event vs. the winner of a men’s or women’s hockey game.
Take metrics and benchmarks with a grain of salt however look for transparency in both how they are produced, information provided and most important, does it matter or is it relevant to your environment or simply entertaining.
Lets see what the next event in the ongoing server storage I/O networking benchmark 2014 winter Olympic games will be.
Disclosure: I used to work for Evaluator Group after working for a company called Inrange that competed with, then got absorbed (via CNT and McData) into Brocade who has been a client as has Cisco. I also do performance and functionality testing, audits, validation and proof of concepts services in my own as well as in client labs using various industry standard available tools and techniques. Otoh, not sure that I even need to disclose anything however its easy enough to do so why not ;).
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
The StorageIO industry links page has been updated with over thousand different industry related companies, vendors, vars, trade groups, part and solution suppliers along with cloud and managed service providers. The common theme with these industry links is information and data infrastructures which means severs, storage, IO and networking, hardware, software, applications and tools, services, products and related items for traditional, virtual and cloud environments.
The industry links page is accessed from the StorageIO main web page via the Tools and Links menu tab, or via the URL https://storageio.com/links. An example of the StorageIO industry links page is shown below with six different menu tabs in alphabetical order.
Know of a company, service or organization that is not listed on the links page, if so, send an email note to info at storageio.com. If your company or organization is listed, contact StorageIO to discuss how to expand your presence on the links page and other related options.
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
Part II – Until the focus expands to data protection – What to do about it
This is the second of a three-part series (read part I here) about how vendors are keeping backup alive, however what they can and should do to shift and expand the conversation to data protection and related themes.
Modernizing data protection and what to do about it
Building off of what was mentioned in the first post, lets take a look at what can be done including expanding the conversation around data protection in support of business continuance (BC), disaster recovery (DR), high availability (HA), business resiliency (BR) not to mention helping backup to actually retire (someday). Now when I backup retire, I’m not necessarily talking about a technology such as hardware, software or a service including clouds, rather when, where, why and how data gets protected. What I mean by this is to step back from looking at the tools and technologies to how they are used and can be used in new and different ways moving forward.
Converged people and technology teams
All to often I see where new technologies or tools get used in old ways which while providing some near-term relief, the full capabilities of what is being used may not be fully realized. This also ties into the theme of people not technologies can be a barrier to convergence and transformation that you can read more about here and here.
Whats your data protection strategy, business or technology focused?
Data protection strategy evolving beyond tools looking for a problem to solve
Part of modernizing data protection is getting back to the roots or fundamentals including revisiting business needs, requirements along with applicable threat risks to then align application tools, technologies and techniques. This means expanding focus from just the technology, however also more importantly how to use different tools for various scenarios. In other words having a tool-box and know how to use it vs. everything looking like a nail as all you have is a hammer. Check out various webinars, Google+ hangouts and other live events that I’m involved with on the StorageIO.com events page on data protection and related data infrastructure themes including BackupU (getting back to the basics and fundamentals).
Everything is not the same, leverage different data protection approaches to different situations
Wrap up (for now)
Continue reading part three of this series here to see what can be done (taking action) about shifting the conversation about modernizing data protection. Also check out conversations about trends, themes, technologies, techniques perspectives in my ongoing data protection diaries discussions (e.g. www.storageioblog.com/data-protection-diaries-main/).
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
Blog post: Data Protection Diaries – My data protection needs and wants
Update 1/10/18
Rather than talking about what others should do or consider for their data protection needs, for this post I wrote down some notes using my Livescribe about what I need and want for my environment. As part of walking the talk in future posts I’m going to expand a bit more on what I’m doing as well as considering for enhancements to my environment for data protection which consists of cloud, virtual and physical.
Why and what am I Protecting?
Livescribe notes that I used for creating the following content
What is my environment
Server and StorageIO (aka StorageIO) is a small business that is focused in and around data infrastructures which includes data protection as a result, have lots of data including videos, audio, images, presentations, reports, research as well, file serving as back-office applications. Then there are websites, blog, email and related applications, some of which are cloud based that are also part of my environment that have different availability, durable, and accessibility requirements.
My environment includes local on-site physical as well as virtual systems, mobile devices, as well as off-site resources including a dedicated private server (DPS) at a service provider. On one hand as a small business, I could easily move most if not everything into the cloud using an as a service model. However, I also have a lab and research environment for doing various things involving data infrastructure including data protection so why not leverage those for other things.
Why do I need to protect my information and data infrastructure?
Protect and preserve the business along with associated information as well as assets
Compliance (self and client based, PCI and other)
Security (logical and physical) and privacy to guard against theft, loss, instrusions
Logical (corruption, virus, accidental deletion) and physical damage to systems, devices, applications and data
Isolate and contain faults of hardware, software, networks, people actions from spreading to disasters
Guard against on-site or off-site incidents, acts of man or nature, head-line news and non head-line news
Address previous experience, incidents and situations, preventing future issues or problems
Support growth while enabling agility, flexibity
Walk the talk, research, learning increasing experience
My wants – What I would like to have
Somebody else pay for it all, or exist in world where there are no threat risks to information (yeh right ;) )
Cost effective and value (not necessarily the cheapest, I also want it to work)
High availability and durability to protect against different threat risks (including myself)
Automated, magically to take care of everything enabled by unicorns and pixie dust ;).
My requirements – What I need (vs. want):
Support mix of physical, virtual and cloud applications, systems and data
Different applications and data, local and some that are mobile
Various operating environments including Windows and Linux
NOT have to change my environment to meet limits of a particular solution or approach
Need a solution (s) that fit my needs and that can scale, evolve as well as enable change when my environment does
Also leverage what I have while supporting new things
Data protection topics, trends, technologies and related themes
Software Defined Data Infrastructure Essentials (CRC 2017) Book
Wrap and summary (for now)
Taking a step back to look at a high-level of what my data protection needs are involves looking at business requirements along with various threat risks, not to mention technical considerations. In a future post I will outline what I am doing as well as considering for enhancements or other changes along with different tools, technologies used in hybrid ways. Watch for more posts in this ongoing series of the data protection dairies via www.storageioblog.com/data-protection-diaries-main/.
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
This is a series of posts about data protection which includes security (logical and physical), backup/restore, business continuance (BC), disaster recovery (DR), business resiliency (BR) along with high availability (HA), archiving and related topic themes, technologies and trends.
Think of data protection like protect, preserve and serve information across cloud, virtual and physical environments spanning traditional servers, storage I/O networking along with mobile (ok, some IoT as well), SOHO/SMB to enterprise.
Getting started, taking a step back
Recently I have done a series of webinars and Google+ hangouts as part of the BackupU initiative brought to you by Dell Software (that’s a disclosure btw ;) ) that are vendor and technology neutral. Instead of the usual vendor product or technology focused seminars and events, these are about getting back to the roots, the fundamentals of what to protect when and why, then decide your options as well as different approaches (e.g. what tools to use when).
In addition over the past year (ok, years) I have also been doing other data protection related events, seminars, workshops, articles, tips, posts across cloud, virtual and physical from SOHO/SMB to enterprise. These are in addition to the other data infrastructure server and storage I/O stuff (e.g. SSD, object storage, software defined, big data, little data, buzzword bingo and others).
Keep in mind that in the data center or information factory everything is not the same as there are different applications, threat risk scenarios, availability and durability among other considerations. In this series like the cloud conversations among others, I’m going to be pulling various data protection themes together hopefully to make it easier for others to find, as well as where I know where to get them.
Some notes for an upcoming post in this series using my Livescribe about data protection
Data protection topics, trends, technologies and related themes
BackupU resources (Sponsored by Dell): Various Application, Virtualization and Related Data Protection links and resources (vendor and product neutral)
BackupU resources (Sponsored by Dell): Various Application, Virtualization and Related Data Protection webinars and G+ chats (vendor and product neutral)
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
Recently Hailey Lynne McKeefry (@HaileyMcK), Editor in Chief over at Data Center Acceleration (@DataAccelerate) reached out for a conversation about well, data center themes and topics. Given Hailey’s background in covering technology as well as business supply chain we somehow ended up talking about business, IT and data center sustainability. Hailey wrote a piece about Driving for Datacenter Sustainability and in addition I was honored to be an invited guest for a live on-line chat yesterday (you can view the conversation here).
Excerpt from Haileys piece:
Too often, sustainability efforts in the datacenter are written off as feel-good, public relations efforts. In reality, green is about economics — and done well, it can save the datacenter tons of cash.
"You mention green, and datacenter managers run or cringe and roll their eyes, because there’s been so much green washing done in the past few years," said Greg Schulz, founder of IT consultancy StorageIO. "It’s really about green economics, though, and getting more work done with the same budget."
Read more of Hailey’s piece here
Many different faces of IT and data center sustainability
Granted, when you here the term sustainability, IT and data centers you may think of different things depending on your view or area of focus.
For some it will be Green or environmental focused such as use of renewable and EH&S themes, recycling among others Related to the previous item some will see sustainability as being tied to energy, either tied to cost, availability/accessibility, standby or alternative and renewable Yet for others, it will mean business continuance (BC), disaster recovery (DR), business resiliency (BR), high availability or reliability availability service (RAS) among others Then the economics concerns of keeping the business running to discuss top and bottom line concerns.
Otoh, if your focus is on one of the above or a subset of one of them, you might not view the other areas as being tied to sustainability.
Likewise, you might even want to not be included in another other, let alone share your area with others. For example if your focus is on security you may not want to see or hear that data protection is part of sustainability, not to mention backup/restore, bc, dr and so forth.
Learning, education and knowledge sustainability
Part of sustainability is also continuing to learn about new things not only in your field or focus area, also in adjacent spaces.
Keep in mind that there is more of a data center or information factory than just a building or facility with power, cooling as there are the technologies, tools, people, process, delivery/distribution network, warehouse for storing raw and finished material, metrics and management that all go into delivering the product which is information services.
Hence there are many aspects to IT and data center sustainability and thus think more pragmatically about sustaining information factories, however lets also be realistic and not jump the shark by declaring everything as sustainable ;).
Check out the live talk chat that we had yesterday over at Data Center Acceleration by clicking here.
Dell Inspiron 660 i660, Virtual Server Diamond in the rough?
During the 2013 post thanksgiving black friday shopping day, I did some on-line buying including a Dell Inspiron 660 i660 (5629BK) to be used as a physical machine (PM) or VMware host (among other things).
Now technically I know, this is a workstation or desktop and thus not what some would consider a server, however as another PM to add to my VMware environment (or be used as a bare metal platform), it is a good companion to my other systems.
Taking a step back, needs vs. wants
Initially my plan for this other system was to go with a larger, more expensive model with as many DDR3 DIMM (memory) and PCIe x4/x8/x16 expansion slots as possible. Some of my other criteria were PCIe Gen 3, latest Intel processor generation with VT (Virtualization Technology) and Extended Page Tables (EPT) for server virtualization support without breaking my budget. Heck, I would love a Dell VRTX or some similar types of servers from the likes of Cisco, HP, IBM, Lenovo, Supermicro among many others. On the other hand, I really don’t need one of those types of systems yet, unless of course somebody wants to send some to play with (excuse me, test drive, try-out).
Hence needs are what I must have or need, while wants are those things that would be, well, nice to have.
Server shopping and selection
In the course of shopping around, looking at alternatives and having previously talked with Robert Novak (aka @gallifreyan) and he reminded me to think outside the box a bit, literally. Check out Roberts blog (aka rsts11 a great blog name btw for those of use who used to work with RSTS, RSX and others) including a post he did shortly after I had a conversation with him. If you read his post and continue through this one, you should be able to connect the dots.
While I still have a need and plans for another server with more PCIe and DDR3 (maybe wait for DDR4? ;) ) slots, I found a Dell Inspiron 660.
Candidly normally I would have skipped over this type or class of system, however what caught my eye was that while limited to only two DDR3 DIMM slots and a single PCIe x16 slot, there were three extra x1 slots which while not as robust, certainly gave me some options if I need to use those for older, slower things. Likewise leveraging higher density DIMM’s, the system is already now at 16GB RAM waiting for larger DIMM’s if needed.
The Dell Inspiron 660-i660 I found had a price of a little over $550 (delivered) with an Intel i5-3330 processor (quad-core, quad thread 3GHz clock), PCIe Gen 3, one PCIe x16 and three PCIe x1 slots, 8GB DRAM (since reallocated), GbE port and built-in WiFi, Windows 8 (since P2V and moved into the VMware environment), keyboard and mouse, plus a 1TB 6Gb SATA drive, I could afford two, maybe three or four of these in place of a larger system (at least for now). While for something’s I have a need for a single larger server, there are other things where having multiple smaller ones with enough processing performance, VT and EPT support comes in handy (if not required for some virtual servers).
Some of the enhancements that I made were once the initial setup of the Windows system was complete, did a clone and P2V of that image, and then redeploying the 1TB SATA drive to join others in the storage pool. Thus the 1TB SATA HDD has been replaced with (for now) a 500GB Momentus XT HHDD which by time you read this could already changed to something else.
Another enhancements was bumping up the memory from 8GB to 16GB, and then adding a StarTech enclosure (See below) for more internal SAS / SATA storage (it supports both 2.5" SAS and SATA HDD’s as well as SSD’s). In addition to the on-board SATA drive port plus one being used for the CD/DVD, there are two more ports for attaching to the StarTech or other large 3.5" drives that live in the drive bay. Depending on what I’m using this system for, it has different types of adapters for external expansion or networking some of which have already included 6Gbps and 12Gbps SAS HBA’s.
What about adding more GbE ports?
As this is not a general purpose larger system with many expansion ports for PCIe slots, that is one of the downsides you get for this cost. However depending on your needs, you have some options. For example I have some Intel PCIe x1 GbE cards to give extra networking connectivity if or when needed. Note however that as these are PCIe x1 slots they are PCIe Gen 1 so from a performance perspective exercise caution when mixing these with other newer, faster cards when performance matters (more on this in the future).
One of the caveats to be aware of if you are going to be using VMware vSphere/ESXi is that the Realtek GbE NIC on the Dell Inspiron D600-i660 may not play well, however there are work around’s. Check out some of the work around’s over at Kendrick Coleman (@KendrickColeman) and Erik Bussink (@ErikBussink) sites both of which were very helpful and I can report that the Realtek GbE is working fine with VMware ESXi 5.5a.
Need some extra SAS and SATA internal expansion slots for HDD and SSD’s?
The StarTech 4 x 2.5″ SAS and SATA internal enclosures supports various speed SSD and HDD’s depending on what you connect the back-end connector port to. On the back of the enclosure chassis there is a connector that is a pass-thru to the SAS drive interface that also accepts SATA drives. This StarTech enclosure fits nicely into an empty 5.2″ CD/DVD expansion bay and then attach the individual drive bays to your internal motherboard SAS or SATA ports, or to those on another adapter.
So far I have used these enclosures attached to various adapters at different speeds as well as with HDD, HHDD, SSHD and SSD’s at various SAS/SATA interface speeds up to 12Gbps. Note that unlike some other enclosures that have SAS or SATA expander, the drive bays in the StarTech are pass-thru hence are not regulated by the expander chip and its speed. Price for these StarTech enclosures is around $60-90 USD and are good for internal storage expansion (hmm, need to build your own NAS or VSAN or storage server appliance? ;) ).
Note that you will also need to get a Molex power connector to go from the back of the drive enclosure to an available power port such as for expansion DVD/CD that you can find at a Radio Shack, Fry’s or many other venues for couple of dollars. Double check your specific system and cable connector leads to verify what you will need.
How is it working and performing
So far so good, in addition to using it for some initial calibration and validation activities, the D660 is performing very well and no buyers remorse. Ok, sure, would like more PCIe Gen 3 x4/x8/x16 or an extra on-board Ethernet, however all the other benefits have outweighed those pitfalls.
Speaking of which, if you think a SSD (or other fast storage device) is fast on a 6Gbps SAS or PCIe Gen 2 interface for physical or virtual servers, wait until you experience those IOPs or latencies at 12Gbps SAS and PCIe Gen 3 with a faster current generation Intel processor, just saying ;)…
In the above chart (slide scroll bar to view more to the right) a Windows 7 64 bit systems (VMs configured with 14GB DRAM) on VMware vSphere V5.5.1 is shown running on different hardware configurations. The Windows system is running Futuremark PCMark 7 Pro (v1.0.4). From left to right the Windows VM on the Dell Inspiron 660 with 16GB physical DRAM using a SSHD (Solid State Hybrid Drive). Second from the left shows results running on a Dell T310 with an Intel X3470 processor also on a SSHD. Middle is the workload on the Dell 660 running on a HHDD, second from right is the workload on the Dell T310 also on a HHDD, while on the right is the same workload on an HP DCS5800 with an Intel E8400. The workload results show a composite score, system storage, simulating user productivity, lightweight processing, and compute intensive tasks.
Don’t forget about the KVM (Keyboard Video Mouse)
Mention KVM to many people in and around the server, storage and virtualization world and they think KVM as in the hypervisor, however to others it means Key board, Video and Mouse aka the other KVM. As part of my recent and ongoing upgrades, it was also time to upgrade from the older smaller KVM’s to a larger, easier to use model. The benefit, support growth while also being easier to work with. Having done some research on various options that also varied in price, I settled in on the StarTech shown below.
Via Amazon.com StarTech 8 Port 1U USB KVM Switch
What’s cool about the above 8 port StarTech KVM switch is that it comes with 8 cables (there are 8 ports) that on one end look like a regular VGA monitor screen cable connector. However on the other end that attached to your computer, there is the standard VGA connection that attached to your video out, and a short USB tail cable that attached to an available USB port for Keyboard and Mouse. Needless to say it helps to cut down on the cable clutter while coming in around $38.00 USD per server port being managed, or about a dollar a month over a little over three years.
Word of caution on make and models
Be advised that there are various makes and models of the Dell Inspiron available that differ in the processor generation and thus feature set included. Pay attention to which make or model you are looking at as the prices can vary, hence double-check the processor make and model and then visit the Intel site to see if it is what you are expecting. For example I double checked that the processor for the different models I looked at were i5-3330(view Intel specifications for that processor here).
Summary
Thanks to Robert Novak (aka @gallifreyan) for taking some time providing useful tips and ideas to help think outside the box for this, as well as some future enhancements to my server and StorageIO lab environment.
Consequently while the Dell Inspiron D600-i660 was not the server that I wanted, it has turned out to be the system that I need now and hence IMHO a diamond in the rough, if you get the right make and mode.
Understanding scale storage architectures (hmm, great way of saying hybrid ;)
Rethinking data protection including disaster recovery (DR) best practices
Enhancing data protection using cloud snapshots beyond traditional backups
Deterministic thin recovery capabilities while dynamically expanding capacity to the cloud
Implement data footprint reduction (DFR) including archiving digital documents to the cloud
Insight and awareness into keep performance indicators along with various use cases
Rethinking Enterprise Storage book Details
Publisher: Microsoft Press Author: Marc Farley Paper back Features: Many diagrams, figures, index, glossary Pages: 101 ISBN: 978-0-7356-7990-3 Published: 2013 MSRP: $9.99 USD
One of the many books many figures on the right, on the left i needed to hold a page down ;)!
What’s inside the book
Make no mistake that this is a Microsoft and Storsimple themed book, however IMHO Marc (aka Farley) does a great job of making it more relevant than just another vendor product book (JAVPB). While it is a Microsoft focused book around enabling hybrid cloud storage for various applications, the premises presented could be adapted for other environments or implementations. The book at 101 pages including table of contents (TOC), index, appendix, glossary and other front matter is a very easy and fast read while providing more information or coverage than what might be found in a "Dummies" type themed book.
Start thinking outside the box (or cloud), imagine what you can do with a Hybrid cloud!
Summary
Overall I found the book to be good and not just because I know Marc or that the O’Reilly folks sent me a free copy (I had actually previously received the electronic ebook version), rather that it is timely and does a nice job of conveying the topic theme and setting up the conversation, time to rethink storage for enterprise and other environments. IMHO the question is not if hybrid cloud storage is in your future, rather when, where, why, for what, how, with whom and related conversations. While you can buy a copy of the book at various venues, it shouldn’t take a lot of effort to get your own printed soft cover copy, or an ebook version.
Btw, here’s a pod cast discussion with Marc Farley from spring 2013 at SNW, as well as a link to a hybrid cloud and object storage post he did over at Microsoft Technet.
The following are some commands and tools for Microsoft Windows environments that are useful for storage I/O activities (among others).
Finding a Windows physical disk, SSD or storage system device name
So you may know and how to find out the more familiar Windows storage device (Solid State Device – SSD, Hard Disk Drives – HDD among others) names such as A:, B:, C:, D: as what you can view from the Windows Explorer, Computer or Admin tools.
However what if you need to find out a physical name for raw (not mounted) and mounted devices for configuration? For example, if you have a tool that wants the physical name for your C: drive that might be \\.\PhysicalDrive0\?
No worries, use the command WMIC DISKDRIVE LIST BRIEF
Need more detail about the devices beyond what is shown above?
Then use WMIC DISKDRIVE LIST or as in the above example, direct the output to a file with the results shown below (scroll to the left or right to see more detail information).
Availability BytesPerSector Capabilities CapabilityDescriptions CompressionMethod ConfigManagerErrorCode ConfigManagerUserConfig DefaultBlockSize Description DeviceID ErrorCleared ErrorDescription ErrorMethodology Index InstallDate InterfaceType LastErrorCode Manufacturer MaxBlockSize MaxMediaSize MediaLoaded MediaType MinBlockSize Model Name NeedsCleaning NumberOfMediaSupported Partitions PNPDeviceID PowerManagementCapabilities PowerManagementSupported SCSIBus SCSILogicalUnit SCSIPort SCSITargetId SectorsPerTrack Signature Size Status StatusInfo SystemName TotalCylinders TotalHeads TotalSectors TotalTracks TracksPerCylinder
512 {3, 4} {"Random Access", "Supports Writing"} 0 FALSE Disk drive \\.\PHYSICALDRIVE2 2 SCSI (Standard disk drives) TRUE Fixed hard disk media ATA ST3000DM001-1CH1 SCSI Disk Device \\.\PHYSICALDRIVE2 0 SCSI\DISK&VEN_ATA&PROD_ST3000DM001-1CH1\5&3626375C&0&000600 0 0 3 6 63 0 3000590369280 OK DBIOTEST 364801 255 5860528065 93024255 255
512 {3, 4} {"Random Access", "Supports Writing"} 0 FALSE Disk drive \\.\PHYSICALDRIVE3 3 SCSI (Standard disk drives) TRUE Fixed hard disk media SEAGATE ST600MP0034 SCSI Disk Device \\.\PHYSICALDRIVE3 0 SCSI\DISK&VEN_SEAGATE&PROD_ST600MP0034\5&3626375C&0&000A00 0 0 3 10 63 600124654080 OK DBIOTEST 72961 255 1172118465 18605055 255
512 {3, 4} {"Random Access", "Supports Writing"} 0 FALSE Disk drive \\.\PHYSICALDRIVE4 4 SCSI (Standard disk drives) TRUE Fixed hard disk media SEAGATE ST600MX0004 SCSI Disk Device \\.\PHYSICALDRIVE4 0 SCSI\DISK&VEN_SEAGATE&PROD_ST600MX0004\5&3626375C&0&000C00 0 0 3 12 63 600124654080 OK DBIOTEST 72961 255 1172118465 18605055 255
512 {3, 4} {"Random Access", "Supports Writing"} 0 FALSE Disk drive \\.\PHYSICALDRIVE1 1 SCSI (Standard disk drives) TRUE Fixed hard disk media SEAGATE ST9300603SS SCSI Disk Device \\.\PHYSICALDRIVE1 0 SCSI\DISK&VEN_SEAGATE&PROD_ST9300603SS\5&3626375C&0&000400 0 0 3 4 63 299992412160 OK DBIOTEST 36472 255 585922680 9300360 255
512 {3, 4} {"Random Access", "Supports Writing"} 0 FALSE Disk drive \\.\PHYSICALDRIVE0 0 SCSI (Standard disk drives) TRUE Fixed hard disk media VMware Virtual disk SCSI Disk Device \\.\PHYSICALDRIVE0 2 SCSI\DISK&VEN_VMWARE&PROD_VIRTUAL_DISK\5&1982005&1&000000 0 0 2 0 63 -873641784 64420392960 OK DBIOTEST 7832 255 125821080 1997160 255
Remembering (or learning) Xcopy
Some of you might be familiar with Xcopy and if not, it is a handy tool for copying files, folders and directories to local as well as networked storage. Some handy Xcopy command switches include:
/j = use un-buffered IO for large files /y = suppress prompting /c = continue if error /E = copy sub directories /H = copy hidden files /Q = quiet mode (don’t list files being copied)
In the following example the content of the Videos folder and its sub-directories (83.5GB) are copied to another destination. Note the Time /T command that is also shown which is useful for timing how long the copy takes (e.g. subtract start-time from end-time and you have elapsed time). In this example 83.5GB are copied from one place to another on the same SSD device and using the results of the Time /T command the elapsed time was about 12 minutes.
Xcopy command example
Diskpart, don’t be scared, however be careful
Ever have a Windows storage device or system that failed to boot, or a problem with a partition, volume or other issue?
How about running into a situation where you are not able to format a device that you know and can confirm is ok to erase, yet you get a message that the volume is write protected or read only?
Diskpart is handy, powerful and potentially dangerous tool if you are not careful as you could mistakenly drop a good volume or partition (e.g. the importance of having good backups). However Diskpart can be used to help repair storage devices that have boot problems, or for clearing read only attributes among other tasks. If you are prefer GUI interfaces, many of the Diskpart functions can also be done via Disk Management interface (e.g. Control Panel -> All Control Panel Items -> Administrative Tools -> Computer Management -> Storage -> Disk Management ). Note that Diskpart to do certain functions will need to be run as Administrator.
In the above example the LIST DISK command shows what disks are present (on-line or off-line) which means that you may see devices here that do not show up elsewhere. Also shown is selecting a disk and then listing partitions, selecting a partition and showing attributes. The Attribute command can be used for clearing Read Only modes should a partition become write protected.
Hint, ever have a device that was once had VMware installed on it, then you move it to Windows and try to reformat for use and get a Read Only error? If so, you will want to have a look at Diskpart and the Attribute commands. However BE CAREFULL and pay attention which disk, partition and volumes you are working with as you can easily cause a problem that would result in testing how good your backups are.
Is SATA SSD TRIM Enabled?
If you have a SATA SSD the TRIM command is a form of garbage collection that is supported with Windows 7 (SAS drives use the SCSI UNMAP). Not sure if your system has TRIM enabled? Try the following command as administrator. Note that if you see a result of "0" then TRIM is enabled while a value of "1" means that it is disabled for your system.
Want to learn more about TRIM, check out this piece from Intel as well as this Microsoft Windows item.
Having issues with collecting CPU and performance statistics?
Try the Lodctr /R command (as administrator), however read this Microsoft Tip first to learn more.
Sdelete and drive erase
Like its name implies, if you do not have this tool, you can download it here from Microsoft to not only delete files, folders, as well as write "0" patterns across a disk to secure erase it. You can specify the number of times you want to run the write "0" patterns across a disk to meet your erasure requirements.
There is also another use for Sdelete which is if you need or want to pre-condition a SSD or other device such as for testing, you can run a pre-conditioning pass using Sdelete.
Some command options include -p #n where "n" is the number of times to run, -s recursive to process sub-directories, -z to write "0" or zero out the space on the device, -c for clean, -a to process read-only attributes. Learn more and get your copy of Sdelete from Microsoft here.
Rufus, Seatools, Samsung Disk Magician and Cyberduck
A handy tool available from Seagate (may only work with Seagate and their partner devices) is SeaTools that can give drive information, health and status as well as perform various tests including SMART.
Seagate Seatools example
Different HDD and SSD as well as storage system vendors give tools for configuration, monitoring, management and in some cases data movement with their solutions. Samsung SSD Magician is a tool I have installed for managing my SSDs (830 and 840 Pros) that has features for updating firmware, drive health as well as performance optimization. Other hand tools include the Samsung copy tool based on Clonix as Acronis among other clone or data migration utilities (more on those in a future post).
Samsung SSD Magician
While the Microsoft WIndows USB Tool is handy for dealing with Microsoft ISO, however for creating USB’s with ISO’s such as for installing VMware or Linux on bare metal systems, Rufus is a handy tool to have in the tool-box.
Another useful tool that functions as an SSH and FTP utility is Cyberduck that also supports access to Amazon S3 among other cloud services.
There are many other tools for server, storage I/O and other activities on WIndows, not to mention other platforms, however hopefully you find the above useful.
How about it, what’s your favorite Windows server, storage I/O tools and commands?
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved