Stability without compromise or increased complexity
Dimension and direction – Scaling-up (vertical), scaling-out (horizontal), scaling-down
Scaling PACE – Performance Availability Capacity Economics
Often I hear people talk about scaling only in the context of space capacity. However there are aspects including performance, availability as well as scaling-up or scaling-out. Scaling from application workloads perspectives include four main group themes which are performance, availability, capacity and economics (as well as energy).
Performance – Transactions, IOP’s, bandwidth, response time, errors, quality of service
Availability – Accessibility, durability, reliability, HA, BC, DR, Backup/Restore, BR, data protection, security
Capacity – Space to store information or place for workload to run on a server, connectivity ports for networks
Economics – Capital and operating expenses, buy, rent, lease, subscription
Scaling with Stability
The latter of the above items should be thought of more in terms of a by-product, result or goal for implementing scaling. Scaling should not result in a compromise of some other attribute such as increasing performance and loss of capacity or increased complexity. Scaling with stability also means that as you scale in some direction, or across some attribute (e.g. PACE), there should not be a corresponding increase in complexity of management, or loss of performance and availability. To use a popular buzz-term scaling with stability means performance, availability, capacity, economics should scale linear with their capabilities or perhaps cost less.
Some examples of scaling in different directions include:
Scaling-up (vertical scaling with bigger or faster)
Scaling-down (vertical scaling with less)
Scaling-out (horizontal scaling with more of what being scaled)
Scaling-up and out (combines vertical and horizontal)
Of course you can combine the above in various combinations such as the example of scaling up and out, as well as apply different names and nomenclature to see your needs or preferences. The following are a closer look at the above with some simple examples.
Example of scaling up (vertically)
Example of scaling-down (e.g. for smaller scenarios)
Example of scaling-out (horizontally)
Example of scaling-out and up(horizontally and vertical)
Summary and what this means
There are many aspects to scaling, as well as side-effects or impacts as a result of scaling.
Scaling can refer to different workload attributes as well as how to support those applications.
Regardless of what you view scaling as meaning, keep in mind the context of where and when it is used and that others might have another scale view of scale.
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
CompTIA needs input for their Storage+ certification, can you help?
The CompTIA folks are looking for some comments and feedback from those who are involved with data storage in various ways as part of planning for their upcoming enhancements to the Storage+ certification testing.
As a point of disclosure, I am member of the CompTIA Storage+ certification advisory committee (CAC), however I don’t get paid or receive any other type of renumeration for contributing my time to give them feedback and guidance other than a thank, Atta boy for giving back and playing it forward to help others in the IT community similar to what my predecessors did.
I have been asked to pass this along to others (e.g. you or who ever forwards it on to you).
Please take a few moments and feel free to share with others this link here to the survey for CompTIA Storage+.
What they are looking for is to validate the exam blueprint generated from a recent Job Task Analysis (JTA) process.
In other words, does the certification exam show real-world relevance to what you and your associates may be doing involved with data storage.
This is opposed to being aligned with those whose’s job it is to create test questions and may not understand what it is you the IT pro involved with storage does or does not do.
If you have ever taken a certification exam test and scratched your head or wondered out why some questions that seem to lack real-world relevance were included, vs. ones of practical on-the-job experience were missing, here’s your chance to give feedback.
Note that you will not be rewarded with an Amex or Amazon gift card, Starbucks or Dunkin Donuts certificates, free software download or some other incentive to play and win, however if you take the survey let me know and will be sure to tweet you an Atta boy or Atta girl! However they are giving away a free T-Shirt to every 10 survey takers.
Btw, if you really need something for free, send me a note (I’m not that difficult to find) as I have some free copies of Resilient Storage Networking (RSN): Designing Flexible Scalable Data Infrastructures (Elsevier) you simply pay shopping and handling. RSN can be used to help prepare you for various storage testing as well as other day-to-day activities.
CompTIA is looking for survey takers who have some hands-on experience or involved with data storage (e.g. can you spell SAN, NAS, Disk or SSD and work with them hands-on then you are a candidate ;).
Welcome to the CompTIA Storage+ Certification Job Task Analysis (JTA) Survey
Your input will help CompTIA evaluate which test objectives are most important to include in the CompTIA Storage+ Certification Exam
Your responses are completely confidential.
The results will only be viewed in the aggregate.
Here is what (and whom) CompTIA is looking for feedback from:
Has at least 12 to 18 months of experience with storage-related technologies.
Makes recommendations and decisions regarding storage configuration.
Facilitates data security and data integrity.
Supports a multiplatform and multiprotocol storage environment with little assistance.
Has basic knowledge of cloud technologies and object storage concepts.
As a small token of CompTIA appreciation for your participation, they will provide an official CompTIA T-shirt to every tenth (1 of every 10) person who completes this survey. Go here for official rules.
Click here to complete the CompTIA Storage+ survey
Contact CompTIA with any survey issues, research@comptia.org
What say you, take a few minutes like I did and give some feedback, you will not be on the hook for anything, and if you do get spammed by the CompTIA folks, let me know and I in turn will spam them back for spamming you as well as me.
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
Note that this is a three part series with the first piece here (e.g. Are VMware VVOL’s in your virtual server and storage I/O future?), the second piece here (e.g.VMware VVOL’s and storage I/O fundamentals Part 1) and the third piece here (e.g. VMware VVOL’s and storage I/O fundamentals Part 2).
Some of you may already be participating in the VMware beta of VVOL involving one of the initial storage vendors also in the beta program.
Ok, now let’s go a bit deeper, however if you want some good music to listen to while reading this, check out @BruceRaveGoDeepMusic.Net and shows here.
Taking a step back, digging deeper into Storage I/O and VVOL’s fundamentals
Instead of a VM host accessing its virtual disk (aka VMDK) which is stored in a VMFS formatted data store (part of ESXi hypervisor) built on top of a SCSI LUN (e.g. SAS, SATA, iSCSI, Fibre Channel aka FC, FCoE aka FC over Ethernet, IBA/SRP, etc) or an NFS file system presented by a storage system (or appliance), VVOL’s push more functionality and visibility down into the storage system. VVOL’s shift more intelligence and work from the hypervisor down into the storage system. Instead of a storage system simply presenting a SCSI LUN or NFS mount point and having limited (coarse) to no visibility into how the underlying storage bits, bytes as well as blocks are being used, storage systems gain more awareness.
Keep in mind that even files and objects still get ultimately mapped to pages and blocks aka sectors even on nand flash-based SSD’s. However also keep an eye on some new technology such as the Seagate Kinetic drive that instead of responding to SCSI block based commands, leverage object API’s and associated software on servers. Read more about these emerging trends here and here at objectstoragecenter.com.
With a normal SCSI LUN the underlying storage system has no knowledge of how the upper level operating system, hypervisor, file system or application such as a database (doing raw IO) is allocating the pages or blocks of memory aka storage. It is up to the upper level storage and data management tools to map from objects and files to the corresponding extents, pages and logical block address (LBA) understood by the storage system. In the case of a NAS solution, there is a layer of abstractions placed over the underlying block storage handling file management and the associated file to LBA mapping activity.
Storage I/O and IOP basics and addressing: LBA’s and LBN’s
Getting back to VVOL, instead of simply presenting a LUN which is essentially a linear range of LBA’s (think of a big table or array) that the hypervisor then manages data placement and access, the storage system now gains insight into what LBA’s correspond to various entities such as a VMDK or VMX, log, clone, swap or other VMware objects. With this more insight, storage systems can now do native and more granular functions such as clone, replication, snapshot among others as opposed to simply working on a coarse LUN basis. The similar concepts extend over to NAS NFS based access. Granted, there are more to VVOL’s including ability to get the underlying storage system more closely integrated with the virtual machine, hypervisor and associated management including supported service manage and classes or categories of service across performance, availability, capacity, economics.
What about VVOL, VAAI and VASA?
VVOL’s are building from earlier VMware initiatives including VAAI and VASA. With VAAI, VMware hypervisor’s can off-load common functions to storage systems that support features such as copy, clone, zero copy among others like how a computer can off-load graphics processing to a graphics card if present.
VASA however provides a means for visibility, insight and awareness between the hypervisor and its associated management (e.g. vCenter etc) as well as the storage system. This includes storage systems being able to communicate and publish to VMware its capabilities for storage space capacity, availability, performance and configuration among other things.
With VVOL’s VASA gets leveraged for unidirectional (e.g. two-way) communication where VMware hypervisor and management tools can tell the storage system of things, configuration, activities to do among others. Hence why VASA is important to have in your VMware CASA.
What’s this object storage stuff?
VVOL’s are a form of object storage access in that they differ from traditional block (LUN’s) and files (NAS volumes/mount points). However, keep in mind that not all object storage are the same as there are object storage access and architectures.
Object Storage basics, generalities and block file relationships
Avoid making the mistake of when you hear object storage that means ANSI T10 (the folks that manage the SCSI command specifications) Object Storage Device (OSD) or something else. There are many different types of underlying object storage architectures some with block and file as well as object access front ends. Likewise there are many different types of object access that sit on top of object architectures as well as traditional storage system.
An example of how some object storage gets accessed (not VMware specific)
Also keep in mind that there are many different types of object access mechanism including HTTP Rest based, S3 (e.g. a common industry defacto standard based on Amazon Simple Storage Service), SNIA CDMI, SOAP, Torrent, XAM, JSON, XML, DICOM, IL7 just to name a few, not to mention various programmatic bindings or application specific implementations and API’s. Read more about object storage architectures, access and related topics, themes and trends at www.objecstoragecenter.com
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
Server and StorageIO Update newsletter – April and May 2014
Welcome to the April and May 2014 edition of the StorageIO Update (newsletter) containing trends perspectives on cloud, virtualization and data infrastructure topics.
The good news is that while spring is running late (as is this newsletter ;) here in the Stillwater MN area as well as other parts of the world, both are finally here. To say that a lot has been going on and things busy would be an understatement, however that is probably also the situation with you as well. So what has been going on during April and May 2014?
Industry and Technology Updates
Sony and Fujifilm (with their partner IBM) are trading marketing and proof of concept (POC) lab material in the efforts to show tape is still alive for data storage. Sony announced a month or so ago that it was moving the bar to 185TB per tape (without dedupe). Not to be out done, Fujifilm announced in late May that they in conjunction with IBM have a POC for a 154 TB LTO in the works.
Greg Schulz on break
On the Hard Disk Drive (HDD) front, Seagate released a new 6TB device that they claim to be fast. I asked Seagate to send me one of the drives to see how fast it really is vs. their claims. While I have not completed all tests yet, what I can tell you is that the 6TB 3.5" 12Gbps SAS 7.2K RPM drive is like an american football linebacker or fullback. Its big, bulky, high-capacity, resilient with 10 to the 15 bit error rate (higher than normal high-capacity HDD’s) and fast.
Sure the 6TB HDD is not in the speed race of a quick SSD or SSHD or 15K, however I was surprised at just how fast it is for its space capacity. Watch for a follow-up review in the not so distant future and if a WD 6TB drive were to show up on my door step can give some perspectives on that as well.
As for SSD, they are following the trend paths of tape and HDD’s of increasing in space capacity, coming down in price and improving on resiliency. While I see HDD and even tape surviving for some time, granted in different roles, I’m also a firm believer that flash SSD in some form are in your future. The question is how much, when, where, with what and from whom. Needless to say there is plenty of SSD related hardware and software activity occurring in the StorageIO labs ;).
Vendors and revenue earnings, is there storage slowdown?
In other industry news and activity, vendor quarterly earnings are out and there is mixed information (see this recent post of if there is an information recession). IBM is one of those who have announced lowered storage related revenues as NetApp had mixed results (as did other vendors). In addition IBM is officially saying they are finally dropping the NetApp (FAS/ONTAP) based N series (was originally reported a week or so ago via Bloomberg). Note that IBM will continue to OEM NetApp E series (e.g. Engenio based). Some of you might remember (or do a Google search) that IBM indicated a few years back that it was De emphasizing the N series or moving away from it. Perhaps this time they really mean it while NetApp could move to embrace those VAR’s and IBM business partners to sell NetApp vs. IBM branded versions of the product. Here are some more perspectives appearing in SearchStorage. Watch for more about NetApp in a future follow-up post.
In some other industry news, you might remember back in the February StorageIO update newsletter there was mention of Avago buying LSI. Now Avago is selling the flash business of LSI to Seagate for about $450M USD in the ongoing flash dance for cache and cash.
Staying busy is a good thing
What have I been doing during April and May 2014 to stay busy besides getting ready for spring and summer fun including in and around the water?
Attended NAB 2014 in Las Vegas where it is not just about archiving pertaining to data storage
Was back in Las Vegas to attend EMCworld, I have some updates in the works from that event
Presented several BrightTalk Webinars (see events below) with more coming up in June
Release of new ITP white paper and StorageIO lab proof points with more in the works
More videos and pod casts, technology reviews including servers among other things
Participated including keynote at a vendor neutral archiving event in Europe
Providing industry commentary in different venues (see below) along with some writing
Not to mention various client consulting projects
Remember, work hard play hard, play hard and work hard!
Whats in the works?
Several projects and things are in the works that will show themselves in the coming weeks or months if not sooner. Some of which are more proof points coming out of the StorageIO labs involving software defined, converged, cloud, virtual, SSD, data protection and more.
Speaking of Software Defined, join me for a free BrightTalk Webinar on June 12 on the many faces and facets of virtualization and software defined storage. Learn more about that event here as well as in the activities section down below.
Watch for more StorageIO posts, commentary, perspectives, presentations, webinars, tips and events on information and data infrastructure topics, themes and trends. Data Infrastructure topics include among others cloud, virtual, legacy server, storage I/O networking, data protection, hardware and software.
Enjoy this edition of the StorageIO Update newsletter and look forward to catching up with you live or online while out and about this spring.
Ok, nuff said (for now)
Cheers gs
April and May 2014 Industry trend and perspectives
Tips, commentary, articles and blog posts
The following is a synopsis of some StorageIOblog posts, articles and comments in different venues on various industry trends, perspectives and related themes about clouds, virtualization, data and storage infrastructure topics among related themes.
StorageIO comments and perspectives in the news
SearchStorage: Comments on IBM dropping N series, NetApp is still OEM to IBM InfoStor: Comments on Software Defined Storage: 10 Things You Need to Know SearchDataBackup: Comments about buying guides for enterprise Hard Disk Drives (HDD) SearchDataBackup: Conversation about data protection modernization InfoStor: Comments on cloud storage, 10 things you need to know InfoStor: Comments on Data Archiving: Life Beyond Compliance NetworkComputing: Comments on Sorting Through Storage Industry Hype StateTech: Comments on Secure Erasing HDDs and SSDs including planning in advance SNIA: Comments on CDMI Cloud Management Conformance Testing EnterpriseStorageForum: Comments on Hybrid Cloud Storage Tips NetworkComputing: Comments on Sorting Through Storage Industry Hype
StorageIO tips and articles appearing in various venues
Via InformationSecurityBuzz: Dark Territories MH370 Do You Know Where Your Information Is? We still dont know 100% where the missing Malaysian airlines flight 370 is which amplifies the fact that there are still dar territories or gaps in coverage in this large world. Likewise there are gaps in coverage in many IT environments yet tools and technologies are available to gain better situational awareness and insight.
Via The Virtualization Practice: This piece looks at the EMC ViPR V1.1 and SRM V3.0 (Software Defined Storage Management) announcements from earlier this year, along with links to earlier announcement and technology analysis. Note that EMC announced May 5, 2014 ViPR 2.0 along with their new Elastic Cloud Storage Appliance (ECS) among other enhancements at EMC World. Additional perspectives on ViPR 2.0, Elastic Cloud Storage Appliance and EMCworld announcement summary analysis can be found here in this video (with text) that I did (produced via TechTarget) while at EMCworld 2014. Watch for more coverage of ViPR 2.0 and other related new as well as updated items from EMCworld 2014 in upcoming posts, articles and commentary.
Via InfoStor: Data Archiving: Life Beyond Compliance. Today many people think or assume based on what they hear that Archiving is only for regulatory archiving. Meanwhile some of you may remember a time before the regulatory compliance era of the early 2000s when Archiving was used as a general purpose tool, technology and solution to many IT data management storage challenges. This piece I did over at InfoStor looks at Data Archiving: Life Beyond Compliance and how Archiving is also a key technology that are part of Data Footprint Reduction (DFR) that also includes compression, dedupe, thin provisioning amount other techniques and tools. Here is a related Email Archiving piece (beyond compliance) from over at StateTech along with Practical tips in a piece over at VMware Communities.
StorageIO video and audio pod casts
Video conversation with Rob Emsley of EMC and me discussing data protection modernization moving beyond the product pitch!(Via TechTarget SearchDataBackup). In this conversation Rob and me talk about various aspects of data protection modernization including finding and fixing problems at the source, accidental architectures, using new (and old) things in new ways, rethinking data protection. However the conversation is a discussion about the topics, issues, trends, what can be done as opposed to a product pitch infomercial. Check out this video blog (vblog) of Rob and me via TechTarget SearchDataBackup, then weigh in with your comments.
Audio Podcast: Data Storage Innovation Conversation with SNIA Wayne Adams and David Dale In this episode, SNIA Chairman Emeritus Wayne Adams and current Chairman David Dale join me in a conversation from the Data Storage Innovation (DSI) 2014 conference event. DSI is a new event produced by SNIA targeted for IT professionals involved with data storage related topics, themes, technologies and tools spanning hardware, software, cloud, virtual and physical. In this conversation, we talk about the new DSI event, the diversity of new attendees who are attending their first SNIA event, along with other updates. Some of these updates include what is new with the SNIA Cloud Data Management Initiative (CDMI), Non Volatile Memory (think flash and SSD), SMIS, education and more. Listen in to our conversation in this podcast here as we cover cloud, convergence, software defined and more about data storage.
Audio Podcast: Catching up with Cash Coleman talking ClearDB, cloud database and Johnny Cash In this episode from the SNIA DSI 2014 event I am joined by Cashton Coleman (@Cash_Coleman). Cashton (Cash) is a Software architect, product mason, family bonder, life builder, idea founder along with Founder & CEO of SuccessBricks, Inc., makers of ClearDB. ClearDB is a provider of MySQL database software tools for cloud and physical environments. We talk about ClearDB, what they do and whom they do it with including deployments in cloud’s as well as onsite. For example if you are using some of the Microsoft Azure cloud services using MySQL, you may already be using this technology. However, there is more to the story and discussion including how Cash got his name, how to speed up databases for little and big data among other topics. Check out ClearDB and listen in to the conversation with Cash podcast here.
Audio Podcast: Matt Vogt talks VMware vCOP in his first ever podcast In this episode from the Computex Rethink your Datacenter for 2017 planning and strategy event I am joined by Matt Vogt (@MattVogt). Matt is a Principal Architect with Computex Technology Solutions as well as certified VMware specialist and fellow vExpert. We talk about the role of automation for performance and capacity optimization along with how VMware vCop plays an important role. Listen in to learn more about how to gain insight and situational awareness to make informed decisions for your data infrastructure environment with Matt. Check out Matt’s blog here at blog.mattvogt.net and listen in to the podcast here.
StorageIO audio podcasts are also available via and at StorageIO.tv
StorageIO White Papers, Solution Briefs and StorageIO Lab reports
New White Paper: Solid State Hybrid Drives (SSHD) Enterprise SSHD and Flash SSD – Better Together – Part of an Enterprise Tiered Storage Strategy The question to ask yourself is not if flash Solid State Device (SSD) technologies are in your future. Instead the questions are when, where, using what, how to configure and related themes. SSD including traditional DRAM and NAND flash-based technologies are like real estate where location matters; however, there are different types of properties to meet various needs.
This means leveraging different types of NAND flash SSD technologies in different locations in a complementary and cooperative aka hybrid way. In this StorageIO Industry Trends Perspective thought leadership white paper we look at how enterprise class Solid State Hybrid Drives (SSHD) and how they address current and next generation tiered storage for virtual, cloud, traditional Little and Big Data infrastructure environments. This includes providing proof points running various workloads including Database TPC-B, TPC-E and Microsoft Exchange in the StorageIO Labscomparing SSHD, SSD and different HDDs. Read more in this StorageIO Industry Trends and Perspective (ITP) white paper compliments of Seagate Enterprise Turbo SSHD. Read the companion blog post here that includes more proof points for large file transfer performance.
Remember to check out our objectstoragecenter.com page where you will find a growing collection of information and links on cloud and object storage themes, technologies and trends from various sources.
If you are interested in data protection including Backup/Restore, BC, DR, BR and Archiving along with associated technologies, tools, techniques and trends visit our storageioblog.com/data-protection-diaries-main/ page. For those who follow SSD and related technologies, we have organized a series of items at storageio.com/ssd.
StorageIO events and activities
The StorageIO calendar continues to evolve, here are some recent and upcoming activities including live in-person seminars, conferences, keynote and speaking activities as well as on-line webinars, twitter chats, Google+ hangouts among others.
June 12, 2014
The Many Facets of Virtual Storage and Software Defined Storage Virtualization
Click here to view other upcoming along with earlier event activities. Watch for more 2014 events to be added soon to the StorageIO events calendar page. Topics include data protection modernization (backup/restore, HA, BC, DR, archive), data footprint reduction (archive, compression, dedupe), storage optimization, SSD, object storage, server and storage virtualization, big data, little data, cloud and object storage, performance and management trends among others.
Vendors, VAR’s and event organizers, give us a call or send an email to discuss having us involved in your upcoming pod cast, web cast, virtual seminar, conference or other events.
StorageIO Update Newsletter Archives
Click here to view previous StorageIO Update newsletters (HTML and PDF versions) at www.storageio.com/newsletter. Subscribe to this newsletter (and pass it along) by clicking here (Via Secure Campaigner site). View archives of past StorageIO update news letters as well as download PDF versions at: www.storageio.com/newsletter
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
The current calendar which continues to be updated includes a mix of webinars (playback are available), and live events covering data infrastructure topics from cloud, virtual, physical and software defined across servers, storage I/O networking, SSD, performance, object storage and data protection among other related themes.
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
USENIX FAST (File and Storage Technologies) 2014 Conference Proceedings
In case you missed it, the 12th annual USENIX conference on File and Storage Technologies (FAST) was recently held in Santa Clara, CA.
Big Data, Little Data, Fast SSD and Erasure Code Data
If like me you are interested in FAST related technologies, trends, tools and related research, check out the conference PDF proceedings here.
You can also go here to the USENIX FAST site to view additional information about the sessions along with other download material.
The PDF format proceedings contain over 320 pages of content including some good white papers and information covering RAID and Erasure code, Big Data and Little Data, Cloud and Virtualization, Flash, DRAM, SSD, Filesystem performance, metrics, measurement and related software along with plenty of file system related material.
Heads up though, these are not your usual vendor high-level marketing white papers rather what you would expect from a technical conference such as FAST as you can see in the above index with abstracts.
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
Its Award Season: Time for 2014 top VMware and virtualization blog voting
It’s that time of the year again for award season including with the recently wrapped up 2014 Winter Olympic (and benchmarking games), the academy awards and many others. That also means it is time again for the annual top VMware, Virtualization, Storage and related blogs voting now taking place until March 17th over at Eric Siebert (aka @ericsiebert) vsphere-land.com site that then appears on his vLaunchPad site. There is plenty of new school, as well as some old school and a few current or future school theme blogs represented with some being more VMware specific while others are cloud, virtual, server, storage, networking, development or other related themes.
Click on the above image to cast your vote
My StorageIOblog.com has been on the vLaunchPad site for a few years now as well as having syndicated content that also appears via some of the other venues listed there.
Thus as this is a peoples choice process, I’m asking if you can take a few moments and cast your vote here (thank you in advance) which I hope includes StorageIOblog.com as part of the top ten, in addition to being nominated in the Storage, Podcast and Independent blogger categories.
In addition to mine, you will also find many of my fellow VMware vExperts among others at the vLaunchpad site so check them out as well.
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
Server Storage I/O Network Benchmark Winter Olympic Games
It is time for the 2014 Winter Olympic games in Sochi Russia where competitors including some athletes come together in what has become a mix of sporting and entertainment engaging activities.
Games of inches and seconds, performance and skill
Some of these activities including real Olympic game events are heavier on sports appeal, some with artistic and others pure entertainment with a mix of beauty, braun and maybe even a beast or two. Then there are those events that have been around since the last ice age, while others being post global warming era.
Hence some have been around longer than others showing a mix of old, new in terms of the sports, athletes not to mention technology and their outfits.
I mean how about some of the new snow boarding and things on skis being done, can you image if they brought in as a new "X" sport roller derby on the short speed skating track sponsored by Red Bull or Bud light? Wait, that sounds like the Red Bull Crashed Ice event (check this out if not familiar with) think motto cross, hockey, down hill on ice. How about getting some of the south African long distance sprinters to learn how to speed skate, talk about moving some gold metal as in medals back to the african continent! On the other hand, the current powers to be would lodge protest, change the benchmark or rules to stay in power, hmm, sound familiar with IT?
Ok, enough of the fun stuff (for now), let’s get back on track here (catch that pun?).
Metrics that matter, winners and losers
Since these are the Olympics, lets also remember that there still awards for personal and team winners (along with second and third place), after all, if all Olympians were winners, there would be no losers and if no losers, how could there be a winner?
Who or what decides the winners vs. losers involves metrics that matter, something that also applies to servers, storage I/O networking hardware, software and services.
In the case of the Olympics, some of the sports or events are based on speed or how fast (e.g. time) something is done, or how much is accumulated or done in that amount of time while in other events the metrics that matter may be more of a mystery based on judging that maybe subjective.
The technologies to record times, scores, movements and other things that go into scoring have certainly improved, as have the ability for fans to engage and vote their choice, or opposition via social media venues from twitter to face book among others.
What about server storage I/O networking benchmarks
There could easily be an Information Technology (IT) or data infrastructure benchmarking Olympics with events such as faster server (physical, virtual or cloud, personal or consortium team), storage, I/O and networking across hardware, software or services. Of course there would be different approaches favored by the various teams with disputes, protests and other things sometimes seen during Olympic games. One of the challenges however is what would be the metrics that matter particularly to the various marketing groups of each organization or their joint consortium?
Just like with sports, which of the various industry trade groups or consortiums would be the ruling party or voice for a particular event specifying the competition criteria, scoring and other things. What happens when there is a break away group that launches their own competing approach yet when it comes time for the IT benchmarking Olympics, which of the various bodies does the Olympic committee defer to? In case you are not familiar with in sports there are various groups and sub-groups who can decide the participants for various supports perhaps independent of an overall group, sound like IT?
Let the games begin
So then the fun starts, however which of the events are relevant to your needs or interest, sure some are fun or entertaining while others are not practical. Some you can do yourself, while others are just fun to watch, both the thrill of victory and agony of defeat.
This is similar to IT industry benchmarking and specmanship competitions, some of which is more relevant than others, then there are those that are entertaining.
Likewise some benchmarks or workload claims can be reproduced to confirm the results or claims, while others remain more like the results of figure skating judges.
Hence some of the benchmark games are more entertaining, however for those who are not aware or informed, they may turn out to be more misinformation or lead to poor decision-making.
Consequently benchmarks and metrics that matter are those that most closely aging with what your environment is or will be doing.
If your environment is going to be running a particularly simulation or script, than so be it, otoh, look for comparisons that are reflective.
On the other hand, if you can’t find something that is applicable, then look at tools and results that have meaning along with relevance, not to mention that provide clarity and repeatable. Being repeatable means that you can get access to the tools, scripts or scenario (preferably free) to run in your own environment.
There is a long list of benchmarks and workload simulation tools, as well as traces available, some for free, some for fee that apply to components, subsystems or complete application systems from server, storage I/O networking applications and hardware. These include those for Email such as Microsoft Exchange related, SQL databases, , LoginVSI for VDI, VMmark for VMware, Hadoop and HDFS related for big data among many others (see more here).
Apples to Apples vs. Apple pie vs. Orange Jello
Something else that matters are apples to apples vs. apples to oranges or worse, apple pie to orange Jello.
This means knowing or gaining insight into the pieces as we as how they behave under different conditions as well as the entire system for a baseline (e.g normal) vs. abnormal.
Hence its winter server storage I/O networking benchmark games with the first event having been earlier this week with team Brocade taking on Cisco. Here is a link to a post by Tony Bourke (@tbourke) that provides some interesting perspectives and interactions, along with a link here to the Brocade sponsored report done by Evaluator Group.
In this match-up, Team Brocade (with HP servers, Brocade switches and an unnamed 16GFC SSD storage system) take on Team Cisco and their UCS (also an un-named 16GFC SSD system that I wonder if Cisco even knows whose’s it was?). Ironic that it was almost six years to the date that there was a similar winter benchmark wonder event when NetApp submitted an SPC result for EMC (read more about that cold day here).
The Brocade FC (using HP servers and somebody’s SSD storage) vs. Cisco FCoE using UCS (and somebody else’s storage) comparison is actually quite entertaining, granted it can also be educational on what to do or not do, focus on or include among others things. The report also raises many questions that seem more wondering why somebody won in an ice figuring skating event vs. the winner of a men’s or women’s hockey game.
Take metrics and benchmarks with a grain of salt however look for transparency in both how they are produced, information provided and most important, does it matter or is it relevant to your environment or simply entertaining.
Lets see what the next event in the ongoing server storage I/O networking benchmark 2014 winter Olympic games will be.
Disclosure: I used to work for Evaluator Group after working for a company called Inrange that competed with, then got absorbed (via CNT and McData) into Brocade who has been a client as has Cisco. I also do performance and functionality testing, audits, validation and proof of concepts services in my own as well as in client labs using various industry standard available tools and techniques. Otoh, not sure that I even need to disclose anything however its easy enough to do so why not ;).
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
The StorageIO industry links page has been updated with over thousand different industry related companies, vendors, vars, trade groups, part and solution suppliers along with cloud and managed service providers. The common theme with these industry links is information and data infrastructures which means severs, storage, IO and networking, hardware, software, applications and tools, services, products and related items for traditional, virtual and cloud environments.
The industry links page is accessed from the StorageIO main web page via the Tools and Links menu tab, or via the URL https://storageio.com/links. An example of the StorageIO industry links page is shown below with six different menu tabs in alphabetical order.
Know of a company, service or organization that is not listed on the links page, if so, send an email note to info at storageio.com. If your company or organization is listed, contact StorageIO to discuss how to expand your presence on the links page and other related options.
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
Blog post: Data Protection Diaries – My data protection needs and wants
Update 1/10/18
Rather than talking about what others should do or consider for their data protection needs, for this post I wrote down some notes using my Livescribe about what I need and want for my environment. As part of walking the talk in future posts I’m going to expand a bit more on what I’m doing as well as considering for enhancements to my environment for data protection which consists of cloud, virtual and physical.
Why and what am I Protecting?
Livescribe notes that I used for creating the following content
What is my environment
Server and StorageIO (aka StorageIO) is a small business that is focused in and around data infrastructures which includes data protection as a result, have lots of data including videos, audio, images, presentations, reports, research as well, file serving as back-office applications. Then there are websites, blog, email and related applications, some of which are cloud based that are also part of my environment that have different availability, durable, and accessibility requirements.
My environment includes local on-site physical as well as virtual systems, mobile devices, as well as off-site resources including a dedicated private server (DPS) at a service provider. On one hand as a small business, I could easily move most if not everything into the cloud using an as a service model. However, I also have a lab and research environment for doing various things involving data infrastructure including data protection so why not leverage those for other things.
Why do I need to protect my information and data infrastructure?
Protect and preserve the business along with associated information as well as assets
Compliance (self and client based, PCI and other)
Security (logical and physical) and privacy to guard against theft, loss, instrusions
Logical (corruption, virus, accidental deletion) and physical damage to systems, devices, applications and data
Isolate and contain faults of hardware, software, networks, people actions from spreading to disasters
Guard against on-site or off-site incidents, acts of man or nature, head-line news and non head-line news
Address previous experience, incidents and situations, preventing future issues or problems
Support growth while enabling agility, flexibity
Walk the talk, research, learning increasing experience
My wants – What I would like to have
Somebody else pay for it all, or exist in world where there are no threat risks to information (yeh right ;) )
Cost effective and value (not necessarily the cheapest, I also want it to work)
High availability and durability to protect against different threat risks (including myself)
Automated, magically to take care of everything enabled by unicorns and pixie dust ;).
My requirements – What I need (vs. want):
Support mix of physical, virtual and cloud applications, systems and data
Different applications and data, local and some that are mobile
Various operating environments including Windows and Linux
NOT have to change my environment to meet limits of a particular solution or approach
Need a solution (s) that fit my needs and that can scale, evolve as well as enable change when my environment does
Also leverage what I have while supporting new things
Data protection topics, trends, technologies and related themes
Software Defined Data Infrastructure Essentials (CRC 2017) Book
Wrap and summary (for now)
Taking a step back to look at a high-level of what my data protection needs are involves looking at business requirements along with various threat risks, not to mention technical considerations. In a future post I will outline what I am doing as well as considering for enhancements or other changes along with different tools, technologies used in hybrid ways. Watch for more posts in this ongoing series of the data protection dairies via www.storageioblog.com/data-protection-diaries-main/.
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
Lenovo buys IBM’s xSeries x86 server business for $2.3B USD, what about EMC?
Once again Lenovo is new owner of some IBM computer technology, this time by acquiring the x86 (e.g. xSeries) server business unit from big blue. Today Lenovo announced its plan to acquire the IBM x86 server storage business unit for $2.3B USD.
Research Triangle Park, North Carolina, and Armonk, New York – January 23, 2014
Lenovo (HKSE: 992) (ADR: LNVGY) and IBM (NYSE: IBM) have entered into a definitive agreement in which Lenovo plans to acquire IBM’s x86 server business. This includes System x, BladeCenter and Flex System blade servers and switches, x86-based Flex integrated systems, NeXtScale and iDataPlex servers and associated software, blade networking and maintenance operations. The purchase price is approximately US$2.3 billion, approximately two billion of which will be paid in cash and the balance in Lenovo stock.
IBM will retain its System z mainframes, Power Systems, Storage Systems, Power-based Flex servers, and PureApplication and PureData appliances.
If you recall (or didn’t’t know) around a decade or so ago IBM also spun off its Laptop (e.g. Thinkpads) and workstation business unit to Lenovo after being one of the early PC players (I still have a model XT in my collection along with Mac SE and Newton).
What this means for IBM?
What this means is that IBM is selling off a portion of its systems technology group which is where the servers, storage and related hardware, software technologies report into. Note however that IBM is not selling off its entire server portfolio, only the x86 e.g. Intel/AMD based products that make up the xSeries as well as companion Blade and related systems. This means that IBM is retaining its Power based systems (and processors) that include the pSeries, iSeries and of course the zSeries mainframes in addition to the storage hardware/software portfolio.
However as part of this announcement, Lenovo is also licensing from IBM the Storwize/V7000 technology as well as tape summit resources, GPFS based scale out file systems used in SONAS and related products that are part of solution bundles tied to the x86 business.
Again to be clear, IBM is not selling off (or at least at this time) Storwize, tape or other technology to Lenovo other than x86 server business. By server business, this means the technology, patents, people, processes, products, sales, marketing, manufacturing, R&D along with other entities that form the business unit, not all that different from when IBM divested the workstation/laptop aka PC business in the past.
What this means for Lenovo?
What Lenovo gets are an immediate (once the deal closes) expansion of their server portfolio including high-density systems for cloud, HPC as well as regular enterprise, not to mention also for SME and SMB. Lenovo also gets blade systems as well as converged systems (server, storage, networking, hardware, software) hence why IBM is also licensing some technology to Lenovo that it is not selling. Lenovo also gets the sales, marketing, design, support and other aspects to also expand their server business. By gaining the server business unit, Lenovo will now be in a place to take on Dell (who was also rumored to be in the market for the IBM servers), as well as HP, Oracle and other x86 system based suppliers.
What about EMC and Lenovo?
Yes, EMC, that storage company who is also a primary owner of VMware, as well as partner with Cisco and Intel in the VCE initiatives, not to mention who also entered into a partnership with Lenovo a year or so ago.
In case you forgot or didn’t’t know, EMC after breaking up with Dell, entered into a partnership with Lenovo back in 2012.
This partnership and initiatives included developing servers that in turn EMC could use for their various storage and data appliances which continue to leverage x86 type technology. In addition, that agreement found the EMC Iomega brand transitioning over into the Lenovo line-up for both domestic North America, as well as international including the chinese market. Hence I have an older Iomega IX4 that says EMC, and a newer one that says EMC/Lenovo, also note that at CES a few weeks ago, some new Iomega products were announced.
In checking with Lenovo today, they indicated that it is business as usual and no changes with or to the EMC partnership.
Via email from Lenovo spokesperson today:
A key piece to Lenovo’s Enterprise strategy has always included strong partnerships. In fact today’s announcements reinforce that strategy very clearly.
Given the new scale, footprint and Enterprise credibility that this server acquisition affords Lenovo, we see great opportunity in offering complimentary storage offerings to new and existing customers.
Lenovo’s partnership with EMC is multifaceted and stays in-tact as an important part of Lenovo’s overall strategy to offer customers compelling solutions built on world-class technology.
Lenovo will continue to offer Lenovo/EMC NAS products from our joint venture as well as resell EMC stand-alone storage platforms.
IBM Storwize storage and other products are integral to the in-scope platforms and solutions we acquired. In order to ensure continuity of business and the best customer experience we will partner with IBM for storage products as well.
We believe this is a great opportunity for all three companies, but most importantly these partnerships are in place and will remain healthy for the benefit for our customers.
Hence it is my opinion that for now it is business as usual, the IBM x8x business unit has a new home, those people will be getting new email addresses and business cards similar to how some of their associates did when the PC group was sold off a few years ago.
Otoh, there may also be new products that might become opportunities to be placed into he Lenovo EMC partnership, however that is just my speculation at this time. Likewise while there will be some groups within Lenovo focused on selling the converged Lenovo solutions coming from IBM that may in fact compete with EMC (among others) in some scenarios, that should be no more and hopefully less than what IBM has with their server groups at times competing with themselves.
What does this mean for Cisco, Dell, HP and others?
For Cisco, instead of competing with one of their OEMs (e.g. IBM) for networking equipment (note IBM also owns some of its own networking), the server competition shifts to Lenovo who is also a Cisco partner (its called coopitition), and perhaps business as usual in many areas. For Dell, in the mid-market space, things could get interesting and the Round Rock folks need to get creative and beyond VRTX.
For HP, this is where IMHO it’s going to get really interesting as Lenovo gets things transitioned. Near-term, HP could have a disruptive upper hand, however longer-term, HP has to get their A-Game on. Oracle is in the game as are a bunch of others from Fujitsu to SuperMicro to outside of North America and in particular china there is also Huawei. Back to EMC and VCE, while I expect the Cisco partnership to stay, I also see a wild card where EMC can leverage their Lenovo partnership into more markets, while Cisco continues to move into storage and other adjacent areas (e.g. more coopitition).
What this means now and going forward?
Thus this is as much about enterprise, SME, SMB as it is HPC, cloud and high-density where the game is about volume. Likewise there is also the convergence or data infrastructure angle combing server, storage, networking hardware, software and services.
One of the things I have noticed about Lenovo as a customer using ThinkPads for over 13 years now (not the same one) is that while they are affordable, instead of simply cutting cost and quality, they seem to have found ways to remove cost which is different then simply cutting to go cheap.
Case in point about a year and a half ago I dropped my iPhone on my Lenovo X1 keyboard that is back-lit and broke a key. Calling Lenovo after trying to find a replacement key on the web, they said no worries and next morning a new keyboard for the laptop was on my doorstep by 10:30Am with instructions on how to remove the old, put in the new, and do the RMA, no questions asked (read more about this here).
The reason I mention that story about my X1 laptop is that it ties to what I’m curious and watching with their soon to be expanded new server business.
Will they go in and simply look to reduce cost by making cuts from design to manufacturing to part quality, service and support, or, find ways to remove complexity and cost while providing more value?
Now I wonder whose technology will join my HP and Dell systems to fill some empty rack space in the not so distant future to support growth?
Time will tell, congratulations to Lenovo and the IBMers who now have a new home best wishes.
Dell Inspiron 660 i660, Virtual Server Diamond in the rough?
During the 2013 post thanksgiving black friday shopping day, I did some on-line buying including a Dell Inspiron 660 i660 (5629BK) to be used as a physical machine (PM) or VMware host (among other things).
Now technically I know, this is a workstation or desktop and thus not what some would consider a server, however as another PM to add to my VMware environment (or be used as a bare metal platform), it is a good companion to my other systems.
Taking a step back, needs vs. wants
Initially my plan for this other system was to go with a larger, more expensive model with as many DDR3 DIMM (memory) and PCIe x4/x8/x16 expansion slots as possible. Some of my other criteria were PCIe Gen 3, latest Intel processor generation with VT (Virtualization Technology) and Extended Page Tables (EPT) for server virtualization support without breaking my budget. Heck, I would love a Dell VRTX or some similar types of servers from the likes of Cisco, HP, IBM, Lenovo, Supermicro among many others. On the other hand, I really don’t need one of those types of systems yet, unless of course somebody wants to send some to play with (excuse me, test drive, try-out).
Hence needs are what I must have or need, while wants are those things that would be, well, nice to have.
Server shopping and selection
In the course of shopping around, looking at alternatives and having previously talked with Robert Novak (aka @gallifreyan) and he reminded me to think outside the box a bit, literally. Check out Roberts blog (aka rsts11 a great blog name btw for those of use who used to work with RSTS, RSX and others) including a post he did shortly after I had a conversation with him. If you read his post and continue through this one, you should be able to connect the dots.
While I still have a need and plans for another server with more PCIe and DDR3 (maybe wait for DDR4? ;) ) slots, I found a Dell Inspiron 660.
Candidly normally I would have skipped over this type or class of system, however what caught my eye was that while limited to only two DDR3 DIMM slots and a single PCIe x16 slot, there were three extra x1 slots which while not as robust, certainly gave me some options if I need to use those for older, slower things. Likewise leveraging higher density DIMM’s, the system is already now at 16GB RAM waiting for larger DIMM’s if needed.
The Dell Inspiron 660-i660 I found had a price of a little over $550 (delivered) with an Intel i5-3330 processor (quad-core, quad thread 3GHz clock), PCIe Gen 3, one PCIe x16 and three PCIe x1 slots, 8GB DRAM (since reallocated), GbE port and built-in WiFi, Windows 8 (since P2V and moved into the VMware environment), keyboard and mouse, plus a 1TB 6Gb SATA drive, I could afford two, maybe three or four of these in place of a larger system (at least for now). While for something’s I have a need for a single larger server, there are other things where having multiple smaller ones with enough processing performance, VT and EPT support comes in handy (if not required for some virtual servers).
Some of the enhancements that I made were once the initial setup of the Windows system was complete, did a clone and P2V of that image, and then redeploying the 1TB SATA drive to join others in the storage pool. Thus the 1TB SATA HDD has been replaced with (for now) a 500GB Momentus XT HHDD which by time you read this could already changed to something else.
Another enhancements was bumping up the memory from 8GB to 16GB, and then adding a StarTech enclosure (See below) for more internal SAS / SATA storage (it supports both 2.5" SAS and SATA HDD’s as well as SSD’s). In addition to the on-board SATA drive port plus one being used for the CD/DVD, there are two more ports for attaching to the StarTech or other large 3.5" drives that live in the drive bay. Depending on what I’m using this system for, it has different types of adapters for external expansion or networking some of which have already included 6Gbps and 12Gbps SAS HBA’s.
What about adding more GbE ports?
As this is not a general purpose larger system with many expansion ports for PCIe slots, that is one of the downsides you get for this cost. However depending on your needs, you have some options. For example I have some Intel PCIe x1 GbE cards to give extra networking connectivity if or when needed. Note however that as these are PCIe x1 slots they are PCIe Gen 1 so from a performance perspective exercise caution when mixing these with other newer, faster cards when performance matters (more on this in the future).
One of the caveats to be aware of if you are going to be using VMware vSphere/ESXi is that the Realtek GbE NIC on the Dell Inspiron D600-i660 may not play well, however there are work around’s. Check out some of the work around’s over at Kendrick Coleman (@KendrickColeman) and Erik Bussink (@ErikBussink) sites both of which were very helpful and I can report that the Realtek GbE is working fine with VMware ESXi 5.5a.
Need some extra SAS and SATA internal expansion slots for HDD and SSD’s?
The StarTech 4 x 2.5″ SAS and SATA internal enclosures supports various speed SSD and HDD’s depending on what you connect the back-end connector port to. On the back of the enclosure chassis there is a connector that is a pass-thru to the SAS drive interface that also accepts SATA drives. This StarTech enclosure fits nicely into an empty 5.2″ CD/DVD expansion bay and then attach the individual drive bays to your internal motherboard SAS or SATA ports, or to those on another adapter.
So far I have used these enclosures attached to various adapters at different speeds as well as with HDD, HHDD, SSHD and SSD’s at various SAS/SATA interface speeds up to 12Gbps. Note that unlike some other enclosures that have SAS or SATA expander, the drive bays in the StarTech are pass-thru hence are not regulated by the expander chip and its speed. Price for these StarTech enclosures is around $60-90 USD and are good for internal storage expansion (hmm, need to build your own NAS or VSAN or storage server appliance? ;) ).
Note that you will also need to get a Molex power connector to go from the back of the drive enclosure to an available power port such as for expansion DVD/CD that you can find at a Radio Shack, Fry’s or many other venues for couple of dollars. Double check your specific system and cable connector leads to verify what you will need.
How is it working and performing
So far so good, in addition to using it for some initial calibration and validation activities, the D660 is performing very well and no buyers remorse. Ok, sure, would like more PCIe Gen 3 x4/x8/x16 or an extra on-board Ethernet, however all the other benefits have outweighed those pitfalls.
Speaking of which, if you think a SSD (or other fast storage device) is fast on a 6Gbps SAS or PCIe Gen 2 interface for physical or virtual servers, wait until you experience those IOPs or latencies at 12Gbps SAS and PCIe Gen 3 with a faster current generation Intel processor, just saying ;)…
In the above chart (slide scroll bar to view more to the right) a Windows 7 64 bit systems (VMs configured with 14GB DRAM) on VMware vSphere V5.5.1 is shown running on different hardware configurations. The Windows system is running Futuremark PCMark 7 Pro (v1.0.4). From left to right the Windows VM on the Dell Inspiron 660 with 16GB physical DRAM using a SSHD (Solid State Hybrid Drive). Second from the left shows results running on a Dell T310 with an Intel X3470 processor also on a SSHD. Middle is the workload on the Dell 660 running on a HHDD, second from right is the workload on the Dell T310 also on a HHDD, while on the right is the same workload on an HP DCS5800 with an Intel E8400. The workload results show a composite score, system storage, simulating user productivity, lightweight processing, and compute intensive tasks.
Don’t forget about the KVM (Keyboard Video Mouse)
Mention KVM to many people in and around the server, storage and virtualization world and they think KVM as in the hypervisor, however to others it means Key board, Video and Mouse aka the other KVM. As part of my recent and ongoing upgrades, it was also time to upgrade from the older smaller KVM’s to a larger, easier to use model. The benefit, support growth while also being easier to work with. Having done some research on various options that also varied in price, I settled in on the StarTech shown below.
Via Amazon.com StarTech 8 Port 1U USB KVM Switch
What’s cool about the above 8 port StarTech KVM switch is that it comes with 8 cables (there are 8 ports) that on one end look like a regular VGA monitor screen cable connector. However on the other end that attached to your computer, there is the standard VGA connection that attached to your video out, and a short USB tail cable that attached to an available USB port for Keyboard and Mouse. Needless to say it helps to cut down on the cable clutter while coming in around $38.00 USD per server port being managed, or about a dollar a month over a little over three years.
Word of caution on make and models
Be advised that there are various makes and models of the Dell Inspiron available that differ in the processor generation and thus feature set included. Pay attention to which make or model you are looking at as the prices can vary, hence double-check the processor make and model and then visit the Intel site to see if it is what you are expecting. For example I double checked that the processor for the different models I looked at were i5-3330(view Intel specifications for that processor here).
Summary
Thanks to Robert Novak (aka @gallifreyan) for taking some time providing useful tips and ideas to help think outside the box for this, as well as some future enhancements to my server and StorageIO lab environment.
Consequently while the Dell Inspiron D600-i660 was not the server that I wanted, it has turned out to be the system that I need now and hence IMHO a diamond in the rough, if you get the right make and mode.
The following are some commands and tools for Microsoft Windows environments that are useful for storage I/O activities (among others).
Finding a Windows physical disk, SSD or storage system device name
So you may know and how to find out the more familiar Windows storage device (Solid State Device – SSD, Hard Disk Drives – HDD among others) names such as A:, B:, C:, D: as what you can view from the Windows Explorer, Computer or Admin tools.
However what if you need to find out a physical name for raw (not mounted) and mounted devices for configuration? For example, if you have a tool that wants the physical name for your C: drive that might be \\.\PhysicalDrive0\?
No worries, use the command WMIC DISKDRIVE LIST BRIEF
Need more detail about the devices beyond what is shown above?
Then use WMIC DISKDRIVE LIST or as in the above example, direct the output to a file with the results shown below (scroll to the left or right to see more detail information).
Availability BytesPerSector Capabilities CapabilityDescriptions CompressionMethod ConfigManagerErrorCode ConfigManagerUserConfig DefaultBlockSize Description DeviceID ErrorCleared ErrorDescription ErrorMethodology Index InstallDate InterfaceType LastErrorCode Manufacturer MaxBlockSize MaxMediaSize MediaLoaded MediaType MinBlockSize Model Name NeedsCleaning NumberOfMediaSupported Partitions PNPDeviceID PowerManagementCapabilities PowerManagementSupported SCSIBus SCSILogicalUnit SCSIPort SCSITargetId SectorsPerTrack Signature Size Status StatusInfo SystemName TotalCylinders TotalHeads TotalSectors TotalTracks TracksPerCylinder
512 {3, 4} {"Random Access", "Supports Writing"} 0 FALSE Disk drive \\.\PHYSICALDRIVE2 2 SCSI (Standard disk drives) TRUE Fixed hard disk media ATA ST3000DM001-1CH1 SCSI Disk Device \\.\PHYSICALDRIVE2 0 SCSI\DISK&VEN_ATA&PROD_ST3000DM001-1CH1\5&3626375C&0&000600 0 0 3 6 63 0 3000590369280 OK DBIOTEST 364801 255 5860528065 93024255 255
512 {3, 4} {"Random Access", "Supports Writing"} 0 FALSE Disk drive \\.\PHYSICALDRIVE3 3 SCSI (Standard disk drives) TRUE Fixed hard disk media SEAGATE ST600MP0034 SCSI Disk Device \\.\PHYSICALDRIVE3 0 SCSI\DISK&VEN_SEAGATE&PROD_ST600MP0034\5&3626375C&0&000A00 0 0 3 10 63 600124654080 OK DBIOTEST 72961 255 1172118465 18605055 255
512 {3, 4} {"Random Access", "Supports Writing"} 0 FALSE Disk drive \\.\PHYSICALDRIVE4 4 SCSI (Standard disk drives) TRUE Fixed hard disk media SEAGATE ST600MX0004 SCSI Disk Device \\.\PHYSICALDRIVE4 0 SCSI\DISK&VEN_SEAGATE&PROD_ST600MX0004\5&3626375C&0&000C00 0 0 3 12 63 600124654080 OK DBIOTEST 72961 255 1172118465 18605055 255
512 {3, 4} {"Random Access", "Supports Writing"} 0 FALSE Disk drive \\.\PHYSICALDRIVE1 1 SCSI (Standard disk drives) TRUE Fixed hard disk media SEAGATE ST9300603SS SCSI Disk Device \\.\PHYSICALDRIVE1 0 SCSI\DISK&VEN_SEAGATE&PROD_ST9300603SS\5&3626375C&0&000400 0 0 3 4 63 299992412160 OK DBIOTEST 36472 255 585922680 9300360 255
512 {3, 4} {"Random Access", "Supports Writing"} 0 FALSE Disk drive \\.\PHYSICALDRIVE0 0 SCSI (Standard disk drives) TRUE Fixed hard disk media VMware Virtual disk SCSI Disk Device \\.\PHYSICALDRIVE0 2 SCSI\DISK&VEN_VMWARE&PROD_VIRTUAL_DISK\5&1982005&1&000000 0 0 2 0 63 -873641784 64420392960 OK DBIOTEST 7832 255 125821080 1997160 255
Remembering (or learning) Xcopy
Some of you might be familiar with Xcopy and if not, it is a handy tool for copying files, folders and directories to local as well as networked storage. Some handy Xcopy command switches include:
/j = use un-buffered IO for large files /y = suppress prompting /c = continue if error /E = copy sub directories /H = copy hidden files /Q = quiet mode (don’t list files being copied)
In the following example the content of the Videos folder and its sub-directories (83.5GB) are copied to another destination. Note the Time /T command that is also shown which is useful for timing how long the copy takes (e.g. subtract start-time from end-time and you have elapsed time). In this example 83.5GB are copied from one place to another on the same SSD device and using the results of the Time /T command the elapsed time was about 12 minutes.
Xcopy command example
Diskpart, don’t be scared, however be careful
Ever have a Windows storage device or system that failed to boot, or a problem with a partition, volume or other issue?
How about running into a situation where you are not able to format a device that you know and can confirm is ok to erase, yet you get a message that the volume is write protected or read only?
Diskpart is handy, powerful and potentially dangerous tool if you are not careful as you could mistakenly drop a good volume or partition (e.g. the importance of having good backups). However Diskpart can be used to help repair storage devices that have boot problems, or for clearing read only attributes among other tasks. If you are prefer GUI interfaces, many of the Diskpart functions can also be done via Disk Management interface (e.g. Control Panel -> All Control Panel Items -> Administrative Tools -> Computer Management -> Storage -> Disk Management ). Note that Diskpart to do certain functions will need to be run as Administrator.
In the above example the LIST DISK command shows what disks are present (on-line or off-line) which means that you may see devices here that do not show up elsewhere. Also shown is selecting a disk and then listing partitions, selecting a partition and showing attributes. The Attribute command can be used for clearing Read Only modes should a partition become write protected.
Hint, ever have a device that was once had VMware installed on it, then you move it to Windows and try to reformat for use and get a Read Only error? If so, you will want to have a look at Diskpart and the Attribute commands. However BE CAREFULL and pay attention which disk, partition and volumes you are working with as you can easily cause a problem that would result in testing how good your backups are.
Is SATA SSD TRIM Enabled?
If you have a SATA SSD the TRIM command is a form of garbage collection that is supported with Windows 7 (SAS drives use the SCSI UNMAP). Not sure if your system has TRIM enabled? Try the following command as administrator. Note that if you see a result of "0" then TRIM is enabled while a value of "1" means that it is disabled for your system.
Want to learn more about TRIM, check out this piece from Intel as well as this Microsoft Windows item.
Having issues with collecting CPU and performance statistics?
Try the Lodctr /R command (as administrator), however read this Microsoft Tip first to learn more.
Sdelete and drive erase
Like its name implies, if you do not have this tool, you can download it here from Microsoft to not only delete files, folders, as well as write "0" patterns across a disk to secure erase it. You can specify the number of times you want to run the write "0" patterns across a disk to meet your erasure requirements.
There is also another use for Sdelete which is if you need or want to pre-condition a SSD or other device such as for testing, you can run a pre-conditioning pass using Sdelete.
Some command options include -p #n where "n" is the number of times to run, -s recursive to process sub-directories, -z to write "0" or zero out the space on the device, -c for clean, -a to process read-only attributes. Learn more and get your copy of Sdelete from Microsoft here.
Rufus, Seatools, Samsung Disk Magician and Cyberduck
A handy tool available from Seagate (may only work with Seagate and their partner devices) is SeaTools that can give drive information, health and status as well as perform various tests including SMART.
Seagate Seatools example
Different HDD and SSD as well as storage system vendors give tools for configuration, monitoring, management and in some cases data movement with their solutions. Samsung SSD Magician is a tool I have installed for managing my SSDs (830 and 840 Pros) that has features for updating firmware, drive health as well as performance optimization. Other hand tools include the Samsung copy tool based on Clonix as Acronis among other clone or data migration utilities (more on those in a future post).
Samsung SSD Magician
While the Microsoft WIndows USB Tool is handy for dealing with Microsoft ISO, however for creating USB’s with ISO’s such as for installing VMware or Linux on bare metal systems, Rufus is a handy tool to have in the tool-box.
Another useful tool that functions as an SSH and FTP utility is Cyberduck that also supports access to Amazon S3 among other cloud services.
There are many other tools for server, storage I/O and other activities on WIndows, not to mention other platforms, however hopefully you find the above useful.
How about it, what’s your favorite Windows server, storage I/O tools and commands?
All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved
Greg Schulz on break
