Fall 2015 Server Storage I/O Cloud Virtual Seminars Going Dutch

Storage I/O trends

Fall 2015 Server Storage I/O Cloud Virtual Seminars Going Dutch

StorageIO events, object storage, ssd cloud, virtualization and big data

It’s that time of the year again where the fall 2015 events and activities are underway which also includes a week of sessions in Holland October 13-16. I will be participating in four days of workshop seminars being organized by Brouwer Storage Consultancy in Nijkerk covering server storage decision-making, converged and bulk storage options, software defined storage management, data center infrastructure management and data protection along with industry trends and update sessions.

Brouwer Storage Consultnacy

October 13th: Symposium – Software Defined Storage Management

09:00 -17:00

DOWNLOAD FLYER (Dutch)

REGISTER HERE

FREE Session! Access for end-users only, through invitation or contacting BSC.

Event Location: Hotel & Gasterij De Roode Schuur, Oude Barneveldseweg 98, 3862PS Nijkerk – www.deroodeschuur.nl

Brouwer Storage Making Decision Seminar Workshops

October 14th: Server Storage I/O Fundamental Trends V2.015 – What’s New, What’s the buzz, what you need to know about.

09:00 -17:00

DOWNLOAD Abstract/Agenda

REGISTER HERE

Event LocationGolden Tulip Ampt van Nijkerk Hotel, Berencamperweg 4, 3861MC, Nijkerk – www.goldentulipamptvannijkerk.com/en

Brouwer Storage Making Decision Seminar Workshops

October 15th: Symposium – Data Center Infrastructure Management

09:00 -17:00

DOWNLOAD Abstract / Agenda

REGISTER Here

FREE Session! Access, through invitation or contacting BSC.

Event Location: Hotel & Gasterij De Roode Schuur, Oude Barneveldseweg 98, 3862PS Nijkerk – www.deroodeschuur.nl

Going Dutch Storage Seminars

October 16th: "Converged Day" Server and Storage Decision making – How do you want or need your storage packaged?

09:00 -17:00

DOWNLOAD Abstract / Agenda

REGISTER HERE

Event LocationGolden Tulip Ampt van Nijkerk Hotel, Berencamperweg 4, 3861MC, Nijkerk – www.goldentulipamptvannijkerk.com/en

Going Dutch Server Storage I/O

Brouwer Storage Consultnacy

Learn more at the Brouwer Storage Consultancy site here, or getting in touch with them to reserve your seat at these events.

Office: Olevoortseweg 43
3861 MH Nijkerk
The Netherlands

T +31-33-246-6825
C +31-652-601-309
F +31-33-245-8956
E info@brouwerconsultancy.com

Where to read, watch and learn more

Watch for more events, seminars, live video, webinars and virtual trade shows by visiting the StorageIO events page.

StorageIO events, object storage, ssd cloud, virtualization and big data

What this all means and wrap up

Smart server and storage for cloud, virtual and physical or legacy environments starts with being informed, knowing your requirements, options and having insight into industry trends that are applicable to your environment. These sessions are vendor and technology neutral held off-site at hotel venues in Nijkerk Netherlands so no need to worry about the sales teams coming in to sell you something during the breaks or lunch which are provided. There are also opportunities throughout the workshops for engagement, discussion and interaction with other attendees that includes your peers from various commercial, government and service providers among others. Hope to see in Nijkerk to discuss server stowage I/O cloud virtual and other industry trends, technologies, techniques in October.

Ok, nuff said

Cheers
Gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2023 Server StorageIO(R) and UnlimitedIO All Rights Reserved

Modernizing Data Protection = Using new and old things in new ways

Server Storage I/O trends

Modernizing Data Protection = Using new and old things in new ways

This is part of an ongoing series of posts that part of www.storageioblog.com/data-protection-diaries-main/ on data protection including archiving, backup/restore, business continuance (BC), business resiliency (BC), data footprint reduction (DFR), disaster recovery (DR), High Availability (HA) along with related themes, tools, technologies, techniques, trends and strategies.

data protection trends

Keep in mind that a fundamental goal of an Information Technology (IT) organization is to protect, preserve and serve data and information in a cost-effective as well as productive way when needed. There is no such thing as an information recession with more data being generated and processed. In addition to more of it, data is also getting larger, having more dependencies on it being available as well as living longer (e.g. retention).

Proof Points, No Data or Information Recession

A quick easy proof point of more data and it getting larger is your cell phone and the pictures it take. Compare the size of those photos today to what you had in your previous generation of smart phone or even digital camera as the Mega Pixels (e.g. resolution and size of data) increased, along with the size of media (e.g. storage) to save those to also grew. Another proof point is look at your presentations, documents, web sites and other mediums with how the amount of rich or unstructured content (e.g. photos, videos) exists on those now vs. a few years ago. Yet another proof-point is to look at your structured little data databases and how there are more rows and columns, as well as how some of those columns have gotten larger or are point to external "blobs" or "objects" that have also gotten larger.

Industry trend and challenges

There has been industry buzz the past several years around data protection modernizing, modernizing data protection or simply modernizing backup along with modernizing your data and information infrastructure. Many of these conversations focus around swapping out an older technology in favor of whatever the new industry buzzword trend is (e.g. swap tape for disk, disk for cloud) or perhaps from one data protection, backup, archive or copy tool for another. Some of these conversations also focus around swapping legacy for virtual, cloud or some other variation of software defined marketing.

Data protection strategy

The Opportunity to do new things

What is common with all the above is basically swapping out one technology, tool, medium or technique for another new one yet using it in old ways. For example tape gets swapped for disk, yet the same approach to when, where, why, how often and what gets copied or protected is left the same. Sure some new tools and technologies get introduced.  However when was the last time you put the tools down, took a step back and revisited the fundamental questions of how and why you are doing data protection the way it is being done? When was the last time you thought about data protection as an asset or business enabler as opposed to a cost center, overhead or after thought?

Data protection tool box
What’s in your data protection toolbox, do you know what to use when?

What about modernizing beyond the tools

One of the challenges with modernizing is that there is a cost involved including people time, staff skills as well as budgets not to mention keeping things running, so how do you go about paying for any improvements? Sure you can go get a data infrastructure or habitat for technology aka data home improvement loan, however there are costs associated to that.

Big data garbage in = big data garbage out

What about reducing data protection costs?

So why not self-fund the improvements and modernization activities by finding and removing costs, eliminating complexity vs. moving and masking issues? Part of this can be accomplished by simply revisiting if you are treating all your applications and data the same from a data protection perspective. Are you providing a data protection service ability to your organization that is based on business wants or business needs? For example, does the business want recovery time objective (RTO) 0 and recovery point objective (RPO) 0 for all applications, while it needs RTO 4 hours and RPO 15 minutes for application-a while application-b requires RTO 12 hours and RPO of 2 hours and application must have RTO 24 hours with RPO of 12 hours?

As a reminder RTO is how much time, or how quickly you need your applications and data to be restored and made ready for use. RPO is the point in time to where data needs to be protected as of, or the amount of data or time frame data could be lost or missing. Thus RTO = 0 means instant recovery no downtime and RPO = 0 means no loss of data. RTO one day and RPO of ten (10) minutes means applications and their data are ready for use within 24 hours and no more than 10 minutes of data can be lost (e.g. the granularity of protection coverage)., Also keep in mind that you can have various RTO and RPO combinations to meet your specific application along with business needs as part of a tiered data protection strategy implementation.

With RTO and RPO in mind, when was the last time you sat down with the business and applications people to revisit what they want vs. what they must have? From these conversation you can easily Transition into how long to keep, how many copies in what place among other things which in turn allows you to review data protection as well as start using both old and new technologies, tools and techniques in new ways.

Where to learn more

Learn more about data protection and related topics, themes, trends, tools and technologies via the following links:

Server Storage I/O trends

What this all means and wrap-up

Data protection is a broad topic that spans from logical and physical security to HA, BC, BR, DR, archiving (including life beyond compliance) along with various tools, technologies, techniques. Key is aligning those to the needs of the business or organization for today’s as well as tomorrows requirements. Instead of doing things what has been done in the past that may have been based on what was known or possible due to technology capabilities, why not start using new and old things in new ways. Let’s start using all the tools in the data protection toolbox regardless of if they are new or old, cloud, virtual, physical, software defined product or service in new ways while keeping the requirements of the business in focus.

Keeping with the theme of protect preserve and serve, data protection to be modernized needs to become and be seen as a business asset or enabler vs. an after thought or cost over-head topic. Also, keep in mind that only you can prevent data loss, are your restores ready for when you need them? as well as one of the fundamental goals of IT is to protect, preserve and serve information including its applications as well as data when, where needed in a cost-effective way.

What say you?

Ok, nuff said for now

Cheers
Gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

Data Protection Gumbo = Protect Preserve and Serve Information

Storage I/O trends

Data Protection Gumbo = Protect Preserve and Serve Information

Recently I was invited to be a guest on the podcast Data Protection Gumbo hosted by Demetrius Malbrough (@dmalbrough).

Data Protection Gumbo Podcast Description
Data Protection Gumbo is set up with the aim of expanding the awareness of anyone responsible for protecting mission critical data, by providing them with a mix of the latest news, data protection technologies, and interesting facts on topics in the Data Backup and Recovery industry.

Data Protection Gumbo Also available on

Protect Preserve and Serve Applications, Information and Data

Keep in mind that a fundamental role of Information Technology (IT) is to protect, preserve and serve business or organizations information assets including applications, configuration settings and data for use when or where needed.

Our conversation covers various aspects of data protection which has a focus of protect preserve and serve information, applications and data across different environments and customer segments. While we discuss enterprise and small medium business (SMB) data protection, we also talk about trends from Mobile to the cloud among many others tools, technologies and techniques.

Where to learn more

Learn more about data protection and related trends, tools and technologies via the following links:

Data Protection Gumbo Also available on

What this all means and wrap-up

Data protection is a broad topic that spans from logical and physical security to high availability (HA), disaster recovery (DR), business continuance (BC), business resiliency (BR), archiving (including life beyond compliance) along with various tools, technologies, techniques. Keeping with the theme of protect preserve and serve, data protection to be modernized needs to become and be seen as a business asset or enabler vs. an after thought or cost over-head topic. Also, keep in mind that only you can prevent data loss, are your restores ready for when you need them?

Check out Demetrius Data Protection Gumbo podcast, also check out his Linkedin Backup & Recovery Professionals group. Speaking of data protection, check out the www.storageioblog.com/data-protection-diaries-main/ page for more coverage of backup/restore, HA, BC, DR, archiving and restated themes.

Ok, nuff said, for now..

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

March 2015 Server StorageIO Update Newsletter

 

 

Volume 15, Issue III

Hello and welcome to this March 2015 Server and StorageIO update newsletter. Here in the northern hemisphere at least by the calendar spring is here, weather wise winter continues to linger in some areas. March also means in the US college university sports tournaments with many focused on their NCAA men’s basketball championship brackets.

Besides various college championships, March also has a connection to back up and data protection. Thus this months newsletter has a focus on data protection, after all March 31 is World Backup Day which means it should also be World Restore test day!

Focus on Data Protection

Data protection including backup/restore, business continuance (BC), disaster recovery (DR), business resiliency (BR) and archiving across physical, virtual and cloud environments.

Data Protection Fundamentals

A reminder on the importance of data protection including backup, BC, DR and related technologies is to make sure they are occuring as planned. Also test your copies and remember the 4 3 2 1 rule or guide.

4 – Versions (different time intervals)
3 – Copies of critical data (including versions)
2 – Different media, devices or systems
1 – Off-site (cloud or elsewhere)

The above means having at least four (4) different versions from various points in time of your data. Having three (3) copies including various versions protects against one or more copies being corrupt or damaged. Placing those versions and copies on at least two (2) different storage systems, devices or media if something happens.

While it might be common sense, a bad April Fools recovery joke would be finding out all of your copies were on the same device which is damaged. That might seem obvious however sometimes the obvious needs to be stated. Also make sure that at least one (1) of your copies is off-site either on off-line media (tape, disk, ssd, optical) or cloud.

Take a few moments and to verify that your data protection strategy is being implemented and practiced as intended. Also test what is being copied including not only restore the data from cloud, disk, ssd or tape, also make sure you can actually read or use the data being protected. This means make sure that your security credentials including access certificates and decryption occur as expected.

Watch for more news, updates industry trends perspectives commentary, tips, articles and other information at Storageio.com, StorageIOblog.com, various partner venues as well as in future newsletters.

StorageIOblog posts

Data Protection Diaries
Are restores ready for World Backup Day?
In case you forgot or did not know, World Backup Day is March 31 2015 (@worldbackupday) so now is a good time to be ready. The only challenge that I have with the World Backup Day (view their site here) that has gone on for a few years know is that it is a good way to call out the importance of backing up or protecting data.
world backup day test your restore

However it’s also time to put more emphasis and focus on being able to make sure those backups or protection copies actually work.

By this I mean doing more than making sure that your data can be read from tape, disk, SSD or cloud service actually going a step further and verifying that restored data can actually be used (read, written, etc).

The problem, issue and challenges are simple, are your applications, systems and data protected as well as can you use those protection copies (e.g. backups, snapshots, replicas or archives) when as well as were needed? Read more here about World Backup Day and what I’m doing as well as various tips to be ready for successful recovery and avoid being an April 1st fool ;).

Cloud Conversations
AWS S3 Cross Region Replication
Amazon Web Services (AWS) announced several enhancements including a new Simple Storage Service (S3) cross-region replication of objects from a bucket (e.g. container) in one region to a bucket in another region.

AWS also recently enhanced Elastic Block Storage (EBS) increasing maximum performance and size of Provisioned IOPS (SSD) and General Purpose (SSD) volumes. EBS enhancements included ability to store up to 16 TBytes of data in a single volume and do 20,000 input/output operations per second (IOPS). Read more about EBS and other AWS server, storage I/O  enhancements here.
AWS regions and availability zones (AZ)
Example of some AWS Regions and AZs

AWS S3 buckets and objects are stored in a specific region designated by the customer or user (AWS S3, EBS, EC2, Glacier, Regions and Availability Zone primer can be found here). The challenge being addressed by AWS with S3 replication is being able to move data (e.g. objects) stored in AWS buckets in one region to another in a safe, secure, timely, automated, cost-effective way.

Continue reading more here about AWS S3 bucket and object replication feature along with related material.

Additional March StorageIOblog posts include:

Server Storage I/O performance (Image licensed from Shutterstock by StorageIO)

 

 

View other recent as well as past blog posts here

In This Issue

  • Industry Trends Perspectives News
  • Commentary in the news
  • Tips and Articles
  • StorageIOblog posts
  • Events and Webinars
  • Recommended Reading List
  • StorageIOblog posts
  • Server StorageIO Lab reports
  • Resources and Links

 

Industry News and Activity

Recent Industry news and activity

EMC sets up cloudfoundry Dojo
AWS S3, EBS IOPs and other updates
New backup/data protection vendor Rubrik
Google adds nearline Cloud Storage
AWS and Microsoft Cloud Price battle

View other recent and upcoming events here

StorageIO Commentary in the news

StorageIO news (image licensed for use from Shutterstock by StorageIO)
Recent Server StorageIO commentary and industry trends perspectives about news, activities and announcements.

Processor: Enterprise Backup Solution Tips
Processor: Failed & Old Drives
EnterpriseStorageForum: Disk Buying Guide
ChannelProNetwork: 2015 Tech and SSD
Processor: Detect & Avoid Drive Failures

View more trends comments here

StorageIO Tips and Articles

So you have a new storage device or system. How will you test or find its performance? Check out this quick-read tip on storage benchmark and testing fundamentals over at BizTech.

Keeping with this months theme of data protection including backup/restore, BC, DR, BR and archiving, here are some more tips. These tips span server storage I/O networking hardware, software, cloud, virtual, performance, data protection applications and related themes including:

  • Test your data restores, can you read and actually use the data? Is you data decrypted, proper security certificates applied?
  • Remember to back up or protect your security encryption keys, certificates and application settings!
  • Revisit what format your data is being saved in including how will you be able to use data saved to the cloud. Will you be able to do a restore to a cloud server or do you need to make sure a copy of your backup tools are on your cloud server instances?

Check out these resources and links on server storage I/O performance and benchmarking tools. View more tips and articles here

Various Industry Events

EMCworld – May 4-6 2015

Interop – April 29 2015 (Las Vegas)

Presenting Smart Shopping for Your Storage Strategy

NAB – April 14-15 2015

SNIA DSI Event – April 7-9

View other recent and upcoming events here

Webinars

December 11, 2014 – BrightTalk
Server & Storage I/O Performance

December 10, 2014 – BrightTalk
Server & Storage I/O Decision Making

December 9, 2014 – BrightTalk
Virtual Server and Storage Decision Making

December 3, 2014 – BrightTalk
Data Protection Modernization

Videos and Podcasts

StorageIO podcasts are also available via and at StorageIO.tv

From StorageIO Labs

Research, Reviews and Reports

Datadynamics StorageX
Datadynamics StorageX

More than a data mover migration tool, StorageX is a tool for adding management and automation around unstructured local and distributed NAS (NFS, CIFS, DFS) file data. Read more here.

View other StorageIO lab review reports here

Recommended Reading List

This is a new section being introduced in this edition of the Server StorageIO update mentioning various books, websites, blogs, articles, tips, tools, videos, podcasts along with other things I have found interesting and want to share with you.

    • Introducing s3motion (via EMCcode e.g. opensource) a tool for copying buckets and objects between public, private and hybrid clouds (e.g. AWS S3, GCS, Microsoft Azure and others) as well as object storage systems. This is a great tool which I have added to my server storage I/O cloud, virtual and physical toolbox. If you are not familiar with EMCcode check it out to learn more…
  • Running Hadoop on Ubuntu Linux (Series of tutorials) for those who want to get their hands dirty vs. using one of the All In One (AIO) appliances.
    • Yellow-bricks (Good blog focused on virtualization, VMware and other related themes) by Duncan Epping @duncanyb

Resources and Links

Check out these useful links and pages:
storageio.com/links
objectstoragecenter.com
storageioblog.com/data-protection-diaries-main/

storageperformance.us
thessdplace.com
storageio.com/raid
storageio.com/ssd

Enjoy this edition of the Server and StorageIO update newsletter and watch for new tips, articles, StorageIO lab report reviews, blog posts, videos and podcasts along with in the news commentary appearing soon.

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

Top vblog voting V2.015 (Its IT award season, cast your votes)

Top vblog voting V2.015 (Its IT award season, cast your votes)

Storage I/O trends

It’s that time of the year again for award season:

  • The motion picture association Academy awards (e.g. the Oscars)
  • The Grammys and other entertainment awards
  • As well as Eric Siebert (aka @ericsiebert) vsphere-land.com top vblog

Vsphere-land.com top vblog

Eric has run for several years now an annual top VMware, Virtualization, Storage and related blogs voting now taking place until March 16th 2015 (click on the image below). You will find a nice mix of new school, old school and a few current or future school theme blogs represented with some being more VMware specific. However there are also many blogs at the vpad site that have a cloud, virtual, server, storage, networking, software defined, development and other related themes.

top vblog voting
Click on the above image to cast your vote for favorite:

  • Ten blogs (e.g. select up to ten and then rank 1 through 10)
  • Storage blog
  • Scripting blog
  • VDI blog
  • New Blogger
  • Independent Blogger (e.g. non-vendor)
  • News/Information Web site
  • Podcast

Call to action, take a moment to cast your vote

My StorageIOblog.com has been on the vLaunchPad site for several years now as well as having syndicated content that also appears via some of the other venues listed there.

Six time VMware vExpert

In addition to my StorageIOblog and podcast, you will also find many of my fellow VMware vExperts among others at the vLaunchpad site so check them out as well.

What this means

This is a people’s choice process (yes it is a popularity process of sorts as well) however also a way of rewarding or thanking those who take time to create and share content with you and others. If you take time to read various blogs, listen to podcasts as well as consume other content, please take a few moments and cast your vote here (thank you in advance) which I hope includes StorageIOblog.com as part of the top ten, as well as being nominated in the Storage, Podcast and Independent blogger categories.

Ok, nuff said, for now…

Cheers gs

Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
twitter @storageio

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

February 2015 Server StorageIO Update Newsletter

Volume 15, Issue II

Hello and welcome to this February 2015 Server and StorageIO update newsletter. The new year is off and running with many events already underway including the recent USENIX FAST conference and others on the docket over the next few months.

Speaking of FAST (File and Storage Technologies) event which I attended last week, here is a link to where you can download the conference proceedings.

In other events, VMware announced version 6 of their vSphere ESXi hypervisor and associated management tools including VSAN, VVOL among other items.

This months newsletter has a focus on server storage I/O performance topics with various articles, tips, commentary and blog posts.

Watch for more news, updates and industry trends perspectives coming soon.

Commentary In The News

StorageIO news

Following are some StorageIO industry trends perspectives comments that have appeared in various print and on-line venues. Over at Processor there are comments on resilient & highly available, underutilized or unused servers, what abandoned data Is costing your company, align application needs with your infrastructure (server, storage, networking) resources.

Also at processor explore flash based (SSD) storage, enterprise backup buying tips, re-evaluate server security, new tech advancements for server upgrades, and understand cost of acquiring storage.

Meanwhile over at CyberTrend there are some perspectives on enterprise backup and better servers mean better business.

View more trends comments here

Tips and Articles

So you have a new storage device or system.

How will you test or find its performance?

Check out this quick-read tip on storage benchmark and testing fundamentals over at BizTech. Also check out these resources and links on server storage I/O performance and benchmarking tools.

View recent as well as past tips and articles here

StorageIOblog posts

Recent StorageIOblog posts include:

View other recent as well as past blog posts here

In This Issue

  • Industry Trends Perspectives
  • Commentary in the news
  • Tips and Articles
  • StorageIOblog posts
  • Events & Activities

    EMCworld – May 4-6 2015

    Interop – April 29 2015

    NAB – April 14-15 2015

    Deltaware Event – March 3 2015

    Feb. 18 – FAST 2015 – Santa Clara CA

    View other recent and upcoming events here

    Webinars

    December 11, 2014 – BrightTalk
    Server & Storage I/O Performance

    December 10, 2014 – BrightTalk
    Server & Storage I/O Decision Making

    December 9, 2014 – BrightTalk
    Virtual Server and Storage Decision Making

    December 3, 2014 – BrightTalk
    Data Protection Modernization

    November 13 9AM PT – BrightTalk
    Software Defined Storage

    Videos and Podcasts

    StorageIO podcasts are also available via and at StorageIO.tv

    From StorageIO Labs

    Research, Reviews and Reports

    StarWind Virtual SAN
    starwind virtual san

    Using less hardware with software defined storage management. This looks at the needs of Microsoft Hyper-V ROBO and SMB environments with software defined storage less hardware. Read more here.

    View other StorageIO lab review reports here.

    Resources and Links

    Check out these useful links and pages:
    storageio.com/links
    objectstoragecenter.com
    storageioblog.com/data-protection-diaries-main/

    storageperformance.us
    thessdplace.com
    storageio.com/raid
    storageio.com/ssd

    Enjoy this edition of the Server and StorageIO update newsletter and watch for new tips, articles, StorageIO lab report reviews, blog posts, videos and podcasts along with in the news commentary appearing soon.

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    VMware announces vSphere V6 and associated virtualization technologies

    VMware announces vSphere V6 and associated virtualization technologies

    server storage I/O trends

    VMware has announced version 6 (V6) of its software defined data center (SDDC) server virtualization hypervisor called vSphere aka ESXi. In addition to a new version of its software defined server hypervisor along with companion software defined management and convergence tools.

    VMware

    VMware vSphere Refresh

    As a refresh for those whose world does not revolve around VMware, vSphere and software defined data centers (believe it or not there are some who exist ;), ESXi is the hypervisor that virtualizes underlying physical machines (PM’s) known as hosts.

    software defined data center convergence
    The path to software defined data center convergence

    Guest operating systems (or other hypervisors using nesting) run as virtual machines (VM’s) on top of the vSphere hypervisor host (e.g. ESXi software). Various VMware management tools (or third-party) are used for managing the virtualized data center from initial configuration, configuration, conversion from physical to virtual (P2V) or virtual to virtual (V2V) along with data protection, performance, capacity planning across servers, storage and networks.

    virtual machines

    VMware vSphere is flexible and can adapt to different sized environments from small office home office (SOHO) or small SMB, to large SMB, SME, enterprise or cloud service provider. There are a free version of ESXi along with paid versions that include support and added management tool features. Besides the ESXi vSphere hypervisor, other commonly deployed modules include the vCenter administration along with Infrastructure Controller services platform among others. In addition, there are optional solution bundles to add support for virtual networking, cloud (public and private), data protection (backup/restore, replication, HA, BC, DR), big data among other capabilities.

    What is new with vSphere V6

    VMware has streamlined the installation, configuration and deployment of vSphere along with associated tools which for smaller environments makes things simply easier. For the larger environments, having to do less means being able to do more in the same amount of time which results in cost savings. In addition to easier to use, deploy and configure, VMware has extended the scaling capabilities of vSphere in terms of scaling-out (larger clusters), scaling-up (more and larger servers), as well as scaling-down (smaller environments and ease of use).

    cloud virtual software defined servers

    • Compute: Expanded support for new hardware, guest operating systems and general scalability in terms of physical, and virtual resources. For example increasing the number of virtual CPU (vCPUs), number of cluster nodes among other speeds and feeds enhancements.

    server storage I/O vsan

    • Storage: This is an area where several enhancements were made including updates for Storage I/O controls (Storage QoS and performance optimizations) with per VM reservations, NFS v4.1 with Kerberos client, Virtual SAN (VSAN) improvements (new back-end underlying file system) as well as new Virtual Volumes (vVOLs) for Storage Policy Based Management.
    • Availability: Improvements for vMotion (ability to live move virtual machines between physical servers (vmware hosts) including long distance fault-tolerance. Other improvements include faster replication, vMotion across vCenter servers, and long distance vMotion (up to 100ms round trip time latency).
    • Network: Network I/O Control (NIOC) provides per VM and dat (VM and data repository) bandwidth reservations for quality of service (QoS) performance optimization.
    • Management: Improvements for multi-site, virtual data centers, content-library (storage and versioning of files and objects including ISOs and OVFs (Open Virtualization Format files) that can be on a VMFS (VMware File System) dat or NFS volume, policy-based management and web-client performance enhancements.

    What is vVOL?

    The quick synopsis of VMware vVOL’s overview:

    • Higher level of abstraction of storage vs. traditional SCSI LUN’s or NAS NFS mount points
    • Tighter level of integration and awareness between VMware hypervisors and storage systems
    • Simplified management for storage and virtualization administrators
    • Removing complexity to support increased scaling
    • Enable automation and service managed storage aka software defined storage management

    server storage I/O volumes
    How data storage access and managed via VMware today (read more here)

    vVOL’s are not LUN’s like regular block (e.g. DAS or SAN) storage that use SAS, iSCSI, FC, FCoE, IBA/SRP, nor are they NAS volumes like NFS mount points. Likewise vVOL’s are not accessed using any of the various object storage access methods mentioned above (e.g. AWS S3, Rest, CDMI, etc) instead they are an application specific implementation. For some of you this approach of an applications specific or unique storage access method may be new, perhaps revolutionary, otoh, some of you might be having a DejaVu moment right about now.

    vVOL is not a LUN in the context of what you may know and like (or hate, even if you have never worked with them), likewise it is not a NAS volume like you know (or have heard of), neither are they objects in the context of what you might have seen or heard such as S3 among others.

    Keep in mind that what makes up a VMware virtual machine are the VMK, VMDK and some other files (shown in the figure below), and if enough information is known about where those blocks of data are or can be found, they can be worked upon. Also keep in mind that at least near-term, block is the lowest common denominator that all file systems and object repositories get built-up.

    server storage I/O vVOL basics
    How VMware data storage accessed and managed with vVOLs (read more here)

    Here is the thing, while vVOL’s will be accessible via a block interface such as iSCSI, FC or FCoE or for that matter, over Ethernet based IP using NFS. Think of these storage interfaces and access mechanisms as the general transport for how vSphere ESXi will communicate with the storage system (e.g. their data path) under vCenter management.

    What is happening inside the storage system that will be presented back to ESXi will be different than a normal SCSI LUN contents and only understood by VMware hypervisor. ESXi will still tell the storage system what it wants to do including moving blocks of data. The storage system however will have more insight and awareness into the context of what those blocks of data mean. This is how the storage systems will be able to more closely integrate snapshots, replication, cloning and other functions by having awareness into which data to move, as opposed to moving or working with an entire LUN where a VMDK may live.

    Keep in mind that the storage system will still function as it normally would, just think of vVOL as another or new personality and access mechanism used for VMware to communicate and manage storage. Watch for vVOL storage provider support from the who’s who of existing and startup storage system providers including Cisco, Dell, EMC, Fujitsu, HDS, HP, IBM, NetApp, Nimble and many others. Read more about Storage I/O fundamentals here and vVOLs here and here.

    What this announcement means

    Depending on your experiences, you might use revolutionary to describe some of the VMware vSphere V6 features and functionalities. Otoh, if you have some Dejavu moments looking pragmatically at what VMware is delivering with V6 of vSphere executing on their vision, evolutionary might be more applicable. I will leave it up to you do decide if you are having a Dejavu moment and what that might pertain to, or if this is all new and revolutionary, or something more along the lines of technolutionary.

    VMware continues to execute delivering on the Virtual Data Center aka Software Defined Data Center paradigm by increasing functionality, as well as enhancing existing capabilities with performance along with resiliency improvements. These abilities enable the aggregation of compute, storage, networking, management and policies for enabling a global virtual data center while supporting existing along with new emerging applications.

    Where to learn more

    If you were not part of the beta to gain early hands-on experience with VMware vSphere V6 and associated technologies, download a copy to check it out as part of making your upgrade or migration plans.

    Check out the various VMware resources including communities links here
    VMware vSphere Hypervisor getting started and general vSphere information (including download)
    VMware vSphere data sheet, compatibility guide along with speeds and feeds (size and other limits)
    VMware vExpert
    VMware Blogs and VMware vExpert page

    Various fellow VMware vExpert blogs including among many others vsphere-land, scott lowe, virtuallyghetto and yellow-bricks among many others found at the vpad here.

    StorageIO Out and About Update – VMworld 2014 (with Video)
    VMware vVOL’s and storage I/O fundamentals (Storage I/O overview and vVOL, details Part I and Part II)
    How many IOPs can a HDD or SSD do in a VMware environment (Part I and Part II)
    VMware VSAN overview and primer, DIY converged software defined storage on a budget

    Wrap up and summary

    Overall VMware vSphere V6 has a great set of features that support both ease of management for small environments as well as the scaling needs of larger organizations.

    Ok, nuff said, for now…

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    Server and Storage I/O Benchmarking 101 for Smarties

    Server Storage I/O Benchmarking 101 for Smarties or dummies ;)

    server storage I/O trends

    This is the first of a series of posts and links to resources on server storage I/O performance and benchmarking (view more and follow-up posts here).

    The best I/O is the I/O that you do not have to do, the second best is the one with the least impact as well as low overhead.

    server storage I/O performance

    Drew Robb (@robbdrew) has a Data Storage Benchmarking Guide article over at Enterprise Storage Forum that provides a good framework and summary quick guide to server storage I/O benchmarking.

    Via Drew:

    Data storage benchmarking can be quite esoteric in that vast complexity awaits anyone attempting to get to the heart of a particular benchmark.

    Case in point: The Storage Networking Industry Association (SNIA) has developed the Emerald benchmark to measure power consumption. This invaluable benchmark has a vast amount of supporting literature. That so much could be written about one benchmark test tells you just how technical a subject this is. And in SNIA’s defense, it is creating a Quick Reference Guide for Emerald (coming soon).

    But rather than getting into the nitty-gritty nuances of the tests, the purpose of this article is to provide a high-level overview of a few basic storage benchmarks, what value they might have and where you can find out more. 

    Read more here including some of my comments, tips and recommendations.

    Drew’s provides a good summary and overview in his article which is a great opener for this first post in a series on server storage I/O benchmarking and related resources.

    You can think of this series (along with Drew’s article) as server storage I/O benchmarking fundamentals (e.g. 101) for smarties (e.g. non-dummies ;) ).

    Note that even if you are not a server, storage or I/O expert, you can still be considered a smarty vs. a dummy if you found the need or interest to read as well as learn more about benchmarking, metrics that matter, tools, technology and related topics.

    Server and Storage I/O benchmarking 101

    There are different reasons for benchmarking, such as, you might be asked or want to know how many IOPs per disk, Solid State Device (SSD), device or storage system such as for a 15K RPM (revolutions per minute) 146GB SAS Hard Disk Drive (HDD). Sure you can go to a manufactures website and look at the speeds and feeds (technical performance numbers) however are those metrics applicable to your environments applications or workload?

    You might get higher IOPs with smaller IO size on sequential reads vs. random writes which will also depend on what the HDD is attached to. For example are you going to attach the HDD to a storage system or appliance with RAID and caching? Are you going to attach the HDD to a PCIe RAID card or will it be part of a server or storage system. Or are you simply going to put the HDD into a server or workstation and use as a drive without any RAID or performance acceleration.

    What this all means is understanding what it is that you want to benchmark test to learn what the system, solution, service or specific device can do under different workload conditions.

    Some benchmark and related topics include

    • What are you trying to benchmark
    • Why do you need to benchmark something
    • What are some server storage I/O benchmark tools
    • What is the best benchmark tool
    • What to benchmark, how to use tools
    • What are the metrics that matter
    • What is benchmark context why does it matter
    • What are marketing hero benchmark results
    • What to do with your benchmark results
    • server storage I/O benchmark step test
      Example of a step test results with various workers and workload

    • What do the various metrics mean (can we get a side of context with them metrics?)
    • Why look at server CPU if doing storage and I/O networking tests
    • Where and how to profile your application workloads
    • What about physical vs. virtual vs. cloud and software defined benchmarking
    • How to benchmark block DAS or SAN, file NAS, object, cloud, databases and other things
    • Avoiding common benchmark mistakes
    • Tips, recommendations, things to watch out for
    • What to do next

    server storage I/O trends

    Where to learn more

    The following are related links to read more about server (cloud, virtual and physical) storage I/O benchmarking tools, technologies and techniques.

    Drew Robb’s benchmarking quick reference guide
    Server storage I/O benchmarking tools, technologies and techniques resource page
    Server and Storage I/O Benchmarking 101 for Smarties.
    Microsoft Diskspd download and Microsoft Diskspd overview (via Technet)
    I/O, I/O how well do you know about good or bad server and storage I/Os?
    Server and Storage I/O Benchmark Tools: Microsoft Diskspd (Part I and Part II)

    Wrap up and summary

    We have just scratched the surface when it comes to benchmarking cloud, virtual and physical server storage I/O and networking hardware, software along with associated tools, techniques and technologies. However hopefully this and the links for more reading mentioned above give a basis for connecting the dots of what you already know or enable learning more about workloads, synthetic generation and real-world workloads, benchmarks and associated topics. Needless to say there are many more things that we will cover in future posts (e.g. keep an eye on and bookmark the server storage I/O benchmark tools and resources page here).

    Ok, nuff said, for now…

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    Microsoft Diskspd (Part II): Server Storage I/O Benchmark Tools

    Microsoft Diskspd (Part II): Server Storage I/O Benchmark Tools

    server storage I/O trends

    This is part-two of a two-part post pertaining Microsoft Diskspd.that is also part of a broader series focused on server storage I/O benchmarking, performance, capacity planning, tools and related technologies. You can view part-one of this post here, along with companion links here.

    Microsoft Diskspd StorageIO lab test drive

    Server and StorageIO lab

    Talking about tools and technologies is one thing, installing as well as trying them is the next step for gaining experience so how about some quick hands-on time with Microsoft Diskspd (download your copy here).

    The following commands all specify an I/O size of 8Kbytes doing I/O to a 45GByte file called diskspd.dat located on the F: drive. Note that a 45GByte file is on the small size for general performance testing, however it was used for simplicity in this example. Ideally a larger target storage area (file, partition, device) would be used, otoh, if your application uses a small storage device or volume, then tune accordingly.

    In this test, the F: drive is an iSCSI RAID protected volume, however you could use other storage interfaces supported by Windows including other block DAS or SAN (e.g. SATA, SAS, USB, iSCSI, FC, FCoE, etc) as well as NAS. Also common to the following commands is using 16 threads and 32 outstanding I/Os to simulate concurrent activity of many users, or application processing threads.
    server storage I/O performance
    Another common parameter used in the following was -r for random, 7200 seconds (e.g. two hour) test duration time, display latency ( -L ) disable hardware and software cache ( -h), forcing cpu affinity (-a0,1,2,3). Since the test ran on a server with four cores I wanted to see if I could use those for helping to keep the threads and storage busy. What varies in the commands below is the percentage of reads vs. writes, as well as the results output file. Some of the workload below also had the -S option specified to disable OS I/O buffering (to view how buffering helps when enabled or disabled). Depending on the goal, or type of test, validation, or workload being run, I would choose to set some of these parameters differently.

    diskspd -c45g -b8K -t16 -o32 -r -d7200 -h -w0 -L -a0,1,2,3 F:\diskspd.dat >> SIOWS2012R203_Eiscsi_145_noh_write000.txt

    diskspd -c45g -b8K -t16 -o32 -r -d7200 -h -w50 -L -a0,1,2,3 F:\diskspd.dat >> SIOWS2012R203_Eiscsi_145_noh_write050.txt

    diskspd -c45g -b8K -t16 -o32 -r -d7200 -h -w100 -L -a0,1,2,3 F:\diskspd.dat >> SIOWS2012R203_Eiscsi_145_noh_write100.txt

    diskspd -c45g -b8K -t16 -o32 -r -d7200 -h -S -w0 -L -a0,1,2,3 F:\diskspd.dat >> SIOWS2012R203_Eiscsi_145_noSh_test_write000.txt

    diskspd -c45g -b8K -t16 -o32 -r -d7200 -h -S -w50 -L -a0,1,2,3 F:\diskspd.dat >> SIOWS2012R203_Eiscsi_145_noSh_write050.txt

    diskspd -c45g -b8K -t16 -o32 -r -d7200 -h -S -w100 -L -a0,1,2,3 F:\diskspd.dat >> SIOWS2012R203_Eiscsi_145_noSh_write100.txt

    The following is the output from the above workload command.
    Microsoft Diskspd sample output
    Microsoft Diskspd sample output part 2
    Microsoft Diskspd sample output part 3

    Note that as with any benchmark, workload test or simulation your results will vary. In the above the server, storage and I/O system were not tuned as the focus was on working with the tool, determining its capabilities. Thus do not focus on the performance results per say, rather what you can do with Diskspd as a tool to try different things. Btw, fwiw, in the above example in addition to using an iSCSI target, the Windows 2012 R2 server was a guest on a VMware ESXi 5.5 system.

    Where to learn more

    The following are related links to read more about server (cloud, virtual and physical) storage I/O benchmarking tools, technologies and techniques.

    Drew Robb’s benchmarking quick reference guide
    Server storage I/O benchmarking tools, technologies and techniques resource page
    Server and Storage I/O Benchmarking 101 for Smarties.
    Microsoft Diskspd download and Microsoft Diskspd overview (via Technet)
    I/O, I/O how well do you know about good or bad server and storage I/Os?
    Server and Storage I/O Benchmark Tools: Microsoft Diskspd (Part I and Part II)

    Comments and wrap-up

    What I like about Diskspd (Pros)

    Reporting including CPU usage (you can’t do server and storage I/O without CPU) along with IOP’s (activity), bandwidth (throughout or amount of data being moved), per thread and total results along with optional reporting. While a GUI would be nice particular for beginners, I’m used to setting up scripts for different workloads so having an extensive options for setting up different workloads is welcome. Being associated with a specific OS (e.g. Windows) the CPU affinity and buffer management controls will be handy for some projects.

    Diskspd has the flexibility to use different storage interfaces and types of storage including files or partitions should be taken for granted, however with some tools don’t take things for granted. I like the flexibility to easily specify various IO sizes including large 1MByte, 10MByte, 20MByte, 100MByte and 500MByte to simulate application workloads that do large sequential (or random) activity. I tried some IO sizes (e.g. specified by -b parameter larger than 500MB however, I received various errors including "Could not allocate a buffer bytes for target" which means that Diskspd can do IO sizes smaller than that. While not able to do IO sizes larger than 500MB, this is actually impressive. Several other tools I have used or with have IO size limits down around 10MByte which makes it difficult for creating workloads that do large IOP’s (note this is the IOP size, not the number of IOP’s).

    Oh, something else that should be obvious however will state it, Diskspd is free unlike some industry de-facto standard tools or workload generators that need a fee to get and use.

    Where Diskspd could be improved (Cons)

    For some users a GUI or configuration wizard would make the tool easier to get started with, on the other hand (oth), I tend to use the command capabilities of tools. Would also be nice to specify ranges as part of a single command such as stepping through an IO size range (e.g. 4K, 8K, 16K, 1MB, 10MB) as well as read write percentages along with varying random sequential mixes. Granted this can easily be done by having a series of commands, however I have become spoiled by using other tools such as vdbench.

    Summary

    Server and storage I/O performance toolbox

    Overall I like Diskspd and have added it to my Server Storage I/O workload and benchmark tool-box

    Keep in mind that the best benchmark or workload generation technology tool will be your own application(s) configured to run as close as possible to production activity levels.

    However when that is not possible, the an alternative is to use tools that have the flexibility to be configured as close as possible to your application(s) workload characteristics. This means that the focus should not be as much on the tool, as opposed to how flexible is a tool to work for you, granted the tool needs to be robust.

    Having said that, Microsoft Diskspd is a good and extensible tool for benchmarking, simulation, validation and comparisons, however it will only be as good as the parameters and configuration you set it up to use.

    Check out Microsoft Diskspd and add it to your benchmark and server storage I/O tool-box like I have done.

    Ok, nuff said (for now)

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    I/O, I/O how well do you know good bad ugly server storage I/O iops?

    How well do you know good bad ugly I/O iops?

    server storage i/o iops activity data infrastructure trends

    Updated 2/10/2018

    There are many different types of server storage I/O iops associated with various environments, applications and workloads. Some I/Os activity are iops, others are transactions per second (TPS), files or messages per time (hour, minute, second), gets, puts or other operations. The best IO is one you do not have to do.

    What about all the cloud, virtual, software defined and legacy based application that still need to do I/O?

    If no IO operation is the best IO, then the second best IO is the one that can be done as close to the application and processor as possible with the best locality of reference.

    Also keep in mind that aggregation (e.g. consolidation) can cause aggravation (server storage I/O performance bottlenecks).

    aggregation causes aggravation
    Example of aggregation (consolidation) causing aggravation (server storage i/o blender bottlenecks)

    And the third best?

    It’s the one that can be done in less time or at least cost or effect to the requesting application, which means moving further down the memory and storage stack.

    solving server storage i/o blender and other bottlenecks
    Leveraging flash SSD and cache technologies to find and fix server storage I/O bottlenecks

    On the other hand, any IOP regardless of if for block, file or object storage that involves some context is better than those without, particular involving metrics that matter (here, here and here [webinar] )

    Server Storage I/O optimization and effectiveness

    The problem with IO’s is that they are a basic operations to get data into and out of a computer or processor, so there’s no way to avoid all of them, unless you have a very large budget. Even if you have a large budget that can afford an all flash SSD solution, you may still meet bottlenecks or other barriers.

    IO’s require CPU or processor time and memory to set up and then process the results as well as IO and networking resources to move data too their destination or retrieve them from where they are stored. While IO’s cannot be eliminated, their impact can be greatly improved or optimized by, among other techniques, doing fewer of them via caching and by grouping reads or writes (pre-fetch, write-behind).

    server storage I/O STI and SUT

    Think of it this way: Instead of going on multiple errands, sometimes you can group multiple destinations together making for a shorter, more efficient trip. However, that optimization may also mean your drive will take longer. So, sometimes it makes sense to go on a couple of quick, short, low-latency trips instead of one larger one that takes half a day even as it accomplishes many tasks. Of course, how far you have to go on those trips (i.e., their locality) makes a difference about how many you can do in a given amount of time.

    Locality of reference (or proximity)

    What is locality of reference?

    This refers to how close (i.e., its place) data exists to where it is needed (being referenced) for use. For example, the best locality of reference in a computer would be registers in the processor core, ready to be acted on immediately. This would be followed by levels 1, 2, and 3 (L1, L2, and L3) onboard caches, followed by main memory, or DRAM. After that comes solid-state memory typically NAND flash either on PCIe cards or accessible on a direct attached storage (DAS), SAN, or NAS device. 

    server storage I/O locality of reference

    Even though a PCIe NAND flash card is close to the processor, there still remains the overhead of traversing the PCIe bus and associated drivers. To help offset that impact, PCIe cards use DRAM as cache or buffers for data along with meta or control information to further optimize and improve locality of reference. In other words, this information is used to help with cache hits, cache use, and cache effectiveness vs. simply boosting cache use.

    SSD to the rescue?

    What can you do the cut the impact of IO’s?

    There are many steps one can take, starting with establishing baseline performance and availability metrics.

    The metrics that matter include IOP’s, latency, bandwidth, and availability. Then, leverage metrics to gain insight into your application’s performance.

    Understand that IO’s are a fact of applications doing work (storing, retrieving, managing data) no matter whether systems are virtual, physical, or running up in the cloud. But it’s important to understand just what a bad IO is, along with its impact on performance. Try to identify those that are bad, and then find and fix the problem, either with software, application, or database changes. Perhaps you need to throw more software caching tools, hypervisors, or hardware at the problem. Hardware may include faster processors with more DRAM and faster internal busses.

    Leveraging local PCIe flash SSD cards for caching or as targets is another option.

    You may want to use storage systems or appliances that rely on intelligent caching and storage optimization capabilities to help with performance, availability, and capacity.

    Where to gain insight into your server storage I/O environment

    There are many tools that you can be used to gain insight into your server storage I/O environment across cloud, virtual, software defined and legacy as well as from different layers (e.g. applications, database, file systems, operating systems, hypervisors, server, storage, I/O networking). Many applications along with databases have either built-in or optional tools from their provider, third-party, or via other sources that can give information about work activity being done. Likewise there are tools to dig down deeper into the various data information infrastructure to see what is happening at the various layers as shown in the following figures.

    application storage I/O performance
    Gaining application and operating system level performance insight via different tools

    windows and linux storage I/O performance
    Insight and awareness via operating system tools on Windows and Linux

    In the above example, Spotlight on Windows (SoW) which you can download for free from Dell here along with Ubuntu utilities are shown, You could also use other tools to look at server storage I/O performance including Windows Perfmon among others.

    vmware server storage I/O
    Hypervisor performance using VMware ESXi / vsphere built-in tools

    vmware server storage I/O performance
    Using Visual ESXtop to dig deeper into virtual server storage I/O performance

    vmware server storage i/o cache
    Gaining insight into virtual server storage I/O cache performance

    Wrap up and summary

    There are many approaches to address (e.g. find and fix) vs. simply move or mask data center and server storage I/O bottlenecks. Having insight and awareness into how your environment along with applications is important to know to focus resources. Also keep in mind that a bit of flash SSD or DRAM cache in the applicable place can go along way while a lot of cache will also cost you cash. Even if you cant eliminate I/Os, look for ways to decrease their impact on your applications and systems.

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    >Keep in mind: SSD including flash and DRAM among others are in your future, the question is where, when, with what, how much and whose technology or packaging.

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Green and Virtual IT Data Center Primer

    Green and Virtual Data Center Primer

    Moving beyond Green Hype and Green washing

    Green IT is about enabling efficient, effective and productive information services delivery. There is a growing green gap between green hype messaging or green washing and IT pain point issues including limits on availability or rising costs of power, cooling, floor-space as well as e-waste and environmental health and safety (PCFE). To close the gap will involve addressing green messaging and rhetoric closer to where IT organizations pain points are and where budget dollars exists that can address PCFE and other green related issues as a by-product. The green gap will also be narrowed as awareness of broader green related topics coincide with IT data center pain points, in other words, alignment of messaging with IT issues that have or will have budget dollars allocated towards them to sustain business and economic growth via IT resource usage efficiency. Read more here.

    There are many aspects to "Green" Information Technology including servers, storage, networks and associated management tools and techniques. The reasons and focus of "Green IT" including "Green Data Storage ", "Green Computing" and related focus areas are varied to discuss diverse needs, issues and requirements including among others:

    • Power, Cooling, Floor-space, Environmental (PCFE) related issues or constraints
    • Reduction of carbon dioxide (CO2) emissions and other green house gases (GHGs)
    • Business growth and economic sustain in an environmental friendly manner
    • Proper disposal or recycling of environmental harmful retired technology components
    • Reduction or better efficiency of electrical power consumption used for IT equipment
    • Cost avoidance or savings from lower energy fees and cooling costs
    • Support data center and application consolidation to cut cost and management
    • Enable growth and enhancements to application service level objectives
    • Maximize the usage of available power and cooling resources available in your region
    • Compliance with local or federal government mandates and regulations
    • Economic sustain and ability to support business growth and service improvements
    • General environmental awareness and stewardship to save and protect the earth

    While much of the IT industry focuses on CO2 emissions footprints, data management software and electrical power consumption, cooling and ventilation of IT data centers is an area of focus associated with "Green IT" as well as a means to discuss more effective use of electrical energy that can yield rapid results for many environments. Large tier-1 vendors including HP and IBM among others who have an IT and data center wide focus have services designed to do quick assessments as well as detailed analysis and re-organization of IT data center physical facilities to improve air flow and power consumption for more effective cooling of IT technologies including servers, storage, networks and other equipment.

    Similar to your own residence, basic steps to improve your cooling effectiveness can lead to use of less energy to cut your budget impact, or, enable you to do more with what you already have with your cooling capacity to support growth, acquisitions and or consolidation initiatives. Vendors are also looking at means and alternatives for cooling IT equipment ranging from computer assisted computational fluid dynamics (CFD) software analysis of data center cooling and ventilation to refrigerated cooling racks some leveraging water or inert liquid cooling.

    Various metrics exists and others are evolving for measuring, estimating, reporting, analyzing and discussing IT Data Center infrastructure resource topics including servers, storage, networks, facilities and associated software management tools from a power, cooling and green environmental standpoint. The importance of metrics is to focus on the larger impact of a piece of IT equipment that includes its cost and energy consumption that factors in cooling and other hosting or site environmental costs. Naturally energy costs and CO2 (carbon offsets) will vary by geography and region along with type of electrical power being used (Coal, Natural Gas, Nuclear, Wind, Thermo, Solar, etc) and other factors that should be kept in perspective as part of the big picture.

    Consequently your view and needs or interests around "Green" IT may be from an electrical power conservation perspective to maximize your power consumption or to adapt to a given power footprint or ceiling. Your focus around "Green" Data Centers and Green Storage may be from a carbon savings standpoint or proper disposition of old and retired IT equipment or from a data center cooling standpoint. Another area of focus may be that you are looking to cut your data footprint to align with your power, cooling and green footprint while enhancing application and data service delivery to your customers.

    Where to learn more

    The following are useful links to related efficient, effective, productive, flexible, scalable and resilient IT data center along with server storage I/O networking hardware and software that supports cloud and virtual green data centers.

    Various IT industry vendor and service provider links
    Green and Virtual Data Center: Productive Economical Efficient Effective Flexible
    Green and Virtual Data Center links
    Are large storage arrays dead at the hands of SSD?
    Closing the Green Gap
    Energy efficient technology sales depend on the pitch

    What this all means

    The result of a green and virtual data center is that of a flexible, agile, resilient, scalable information factory that is also economical, productive, efficient, productive as well as sustainable.

    Ok, nuff said (for now)

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    Green and Virtual Data Center: Productive Economical Efficient Effective Flexible

    Green and Virtual Data Center

    A Green and Virtual IT Data Center (e.g. an information factory) means an environment comprising:

    • Habitat for technology or physical infrastructure (e.g. physical data center, yours, co-lo, managed service or cloud)
    • Power, cooling, communication networks, HVAC, smoke and fire suppression, physical security
    • IT data information infrastructure (e.g. hardware, software, valueware, cloud, virtual, physical, servers, storage, network)
    • Data Center Infrastructure Management (DCIM) along with IT Service Management (ITSM) software defined management tools
    • Tools for monitoring, resource tracking and usage, reporting, diagnostics, provisioning and resource orchestration
    • Portals and service catalogs for automated, user initiated and assisted operation or access to IT resources
    • Processes, procedures, best-practices, work-flows and templates (including data protection with HA, BC, BR, DR, backup/restore, logical and physical security)
    • Metrics that matter for management insight and awareness
      People and skill sets among other items

    Green and Virtual Data Center Resources

    Click here to learn about "The Green and Virtual Data Center" book (CRC Press) for enabling efficient, productive IT data centers. This book covers cloud, virtualization, servers, storage, networks, software, facilities and associated management topics, technologies and techniques including metrics that matter. This book by industry veteran IT advisor and author Greg Schulz is the definitive guide for enabling economic efficiency and productive next generation data center strategies.

    Intel recommended reading
    Publisher: CRC Press – Taylor & Francis Group
    By Greg P. Schulz of StorageIO www.storageio.com
     ISBN-10: 1439851739 and ISBN-13: 978-1439851739
     Hardcover * 370 pages * Over 100 illustrations figures and tables

    Read more here and order your copy here. Also check out Cloud and Virtual Data Storage Networking (CRC Press) a new book by Greg Schulz.

    Productive Efficient Effective Economical Flexible Agile and Sustainable

    Green hype and green washing may be on the endangered species list and going away, however, green IT for servers, storage, networks, facilities as well as related software and management techniques that address energy efficiency including power and cooling along with e-waste, environmental health and safety related issues are topics that wont be going away anytime soon. There is a growing green gap between green hype messaging or green washing and IT pain point issues including limits on availability or rising costs of power, cooling, floor-space as well as e-waste and environmental health and safety (PCFE). To close the gap will involve addressing green messaging and rhetoric closer to where IT organizations pain points are and where budget dollars exists that can address PCFE and other green related issues as a by-product.

    The green gap will also be narrowed as awareness of broader green related topics coincide with IT data center pain points, in other words, alignment of messaging with IT issues that have or will have budget dollars allocated towards them to sustain business and economic growth via IT resource usage efficiency. Read more here.

    Where to learn more

    The following are useful links to related efficient, effective, productive, flexible, scalable and resilient IT data center along with server storage I/O networking hardware and software that supports cloud and virtual green data centers.

    Various IT industry vendor and service provider links
    Green and Virtual Data Center Primer
    Green and Virtual Data Center links
    Are large storage arrays dead at the hands of SSD?
    Closing the Green Gap
    Energy efficient technology sales depend on the pitch
    EPA Energy Star for Data Center Storage Update
    EPA Energy Star for data center storage draft 3 specification
    Green IT Confusion Continues, Opportunities Missed! 
    Green IT deferral blamed on economic recession might be result of green gap
    How much SSD do you need vs. want?
    How to reduce your Data Footprint impact (Podcast) 
    Industry trend: People plus data are aging and living longer
    In the data center or information factory, not everything is the same
    More storage and IO metrics that matter
    Optimizing storage capacity and performance to reduce your data footprint 
    Performance metrics: Evaluating your data storage efficiency
    PUE, Are you Managing Power, Energy or Productivity?
    Saving Money with Green Data Storage Technology
    Saving Money with Green IT: Time To Invest In Information Factories 
    Shifting from energy avoidance to energy efficiency
    SNIA Green Storage Knowledge Center
    Speaking of speeding up business with SSD storage
    SSD and Green IT moving beyond green washing
    Storage Efficiency and Optimization: The Other Green
    Supporting IT growth demand during economic uncertain times
    The Green and Virtual Data Center Book (CRC Press, Intel Recommended Reading)
    The new Green IT: Efficient, Effective, Smart and Productive 
    The other Green Storage: Efficiency and Optimization 
    What is the best kind of IO? The one you do not have to do

    Watch for more links and resources to be added soon.

    What this all means

    The result of a green and virtual data center is that of a flexible, agile, resilient, scalable information factory that is also economical, productive, efficient, productive as well as sustainable.

    Ok, nuff said (for now)

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    Green and Virtual Data Center Links

    Updated 10/25/2017

    Green and Virtual IT Data Center Links

    Moving beyond Green Hype and Green washing

    Green hype and green washing may be on the endangered species list and going away, however, green IT for servers, storage, networks, facilities as well as related software and management techniques that address energy efficiency including power and cooling along with e-waste, environmental health and safety related issues are topics that wont be going away anytime soon.

    There is a growing green gap between green hype messaging or green washing and IT pain point issues including limits on availability or rising costs of power, cooling, floor-space as well as e-waste and environmental health and safety (PCFE).

    To close the gap will involve addressing green messaging and rhetoric closer to where IT organizations pain points are and where budget dollars exists that can address PCFE and other green related issues as a by-product. The green gap will also be narrowed as awareness of broader green related topics coincide with IT data center pain points, in other words, alignment of messaging with IT issues that have or will have budget dollars allocated towards them to sustain business and economic growth via IT resource usage efficiency. Read more here.

    Enabling Effective Produtive Efficient Economical Flexible Scalable Resilient Information Infrastrctures

    The following are useful links to related efficient, effective, productive, flexible, scalable and resilient IT data center along with server storage I/O networking hardware and software that supports cloud and virtual green data centers.

    Various IT industry vendors and other links

    Via StorageIOblog – Happy Earth Day 2016 Eliminating Digital and Data e-Waste

    Green and Virtual Data Center Primer
    Green and Virtual Data Center: Productive Economical Efficient Effective Flexible
    Are large storage arrays dead at the hands of SSD?
    Closing the Green Gap
    Energy efficient technology sales depend on the pitch
    EPA Energy Star for Data Center Storage Update
    EPA Energy Star for data center storage draft 3 specification
    Green IT Confusion Continues, Opportunities Missed! 
    Green IT deferral blamed on economic recession might be result of green gap
    How much SSD do you need vs. want?
    How to reduce your Data Footprint impact (Podcast) 
    Industry trend: People plus data are aging and living longer
    In the data center or information factory, not everything is the same
    More storage and IO metrics that matter
    Optimizing storage capacity and performance to reduce your data footprint 
    Performance metrics: Evaluating your data storage efficiency
    PUE, Are you Managing Power, Energy or Productivity?
    Saving Money with Green Data Storage Technology
    Saving Money with Green IT: Time To Invest In Information Factories 
    Shifting from energy avoidance to energy efficiency
    SNIA Green Storage Knowledge Center
    Speaking of speeding up business with SSD storage
    SSD and Green IT moving beyond green washing
    Storage Efficiency and Optimization: The Other Green
    Supporting IT growth demand during economic uncertain times
    The Green and Virtual Data Center Book (CRC Press, Intel Recommended Reading)
    The new Green IT: Efficient, Effective, Smart and Productive 
    The other Green Storage: Efficiency and Optimization 
    What is the best kind of IO? The one you do not have to do

    Intel recommended reading
    Click here to learn about "The Green and Virtual Data Center" book (CRC Press) for enabling efficient , productive IT data centers. This book covers cloud, virtualization, servers, storage, networks, software, facilities and associated management topics, technologies and techniques including metrics that matter. This book by industry veteran IT advisor and author Greg Schulz is the definitive guide for enabling economic efficiency and productive next generation data center strategies. Read more here and order your copyhere. Also check out Cloud and Virtual Data Storage Networking (CRC Press) a new book by Greg Schulz.

    White papers, analyst reports and perspectives

    Business benefits of data footprint reduction (archiving, compression, de-dupe)
    Data center I/O and performance issues – Server I/O and storage capacity gap
    Analysis of EPA Report to Congress (Law 109-431)
    The Many Faces of MAID Storage Technology
    Achieving Energy Efficiency with FLASH based SSD
    MAID 2.0: Energy Savings without Performance Compromises

    Articles, Tips, Blogs, Webcasts and Podcasts

    AP – SNIA Green Emerald Program and measurements
    AP – Southern California heat wave strains electrical system
    Ars Technica – EPA: Power usage in data centers could double by 2011
    Ars Technica – Meet the climate savers: Major tech firms launch war on energy-inefficient PCs – Article
    Askageek.com – Buying an environmental friendly laptop – November 2008
    Baseline – Examining Energy Consumption in the Data Center
    Baseline – Burts Bees: What IT Means When You Go Green
    Bizcovering – Green architecture for the masses
    Broadstuff – Are Green 2.0 and Enterprise 2.0 Incompatible?
    Business Week – CEO Guide to Technology
    Business Week – Computers’ elusive eco factor
    Business Week – Clean Energy – Its Getting Affordable
    Byte & Switch – Keeping it Green This Summer – Don’t be "Green washed"
    Byte & Switch – IBM Sees Green in Energy Certificates
    Byte & Switch – Users Search for power solutions
    Byte & Switch – DoE issues Green Storage Warning
    CBR – The Green Light for Green IT
    CBR – Big boxes make greener data centers
    CFO – Power Scourge
    Channel Insider – A 12 Step Program to Dispose of IT Equipment
    China.org.cn – China publishes Energy paper
    CIO – Green Storage Means Money Saved on Power
    CIO – Data center designers share secrets for going green
    CIO – Best Place to Build a Data Center in North America
    CIO Insight – Clever Marketing or the Real Thing?
    Cleantechnica – Cooling Data Centers Could Prevent Massive Electrical Waste – June 2008
    Climatebiz – Carbon Calculators Yield Spectrum of Results: Study
    CNET News – Linux coders tackle power efficiency
    CNET News – Research: Old data centers can be nearly as ‘green’ as new ones
    CNET News – Congress, Greenpeace move on e-wast
    CNN Money – A Green Collar Recession
    CNN Money – IBM creates alliance with industry leaders supporting new data center standards
    Communication News – Utility bills key to greener IT
    Computerweekly – Business case for green storage
    Computerweekly – Optimising data centre operations
    Computerweekly – Green still good for IT, if it saves money
    Computerweekly – Meeting the Demands for storage
    Computerworld – Wells Fargo Free Data Center Cooling System
    Computerworld – Seven ways to get green and save money
    Computerworld – Build your data center here: The most energy-efficient locations
    Computerworld – EPA: U.S. needs more power plants to support data centers
    Computerworld – GreenIT: A marketing ploy or new technology?
    Computerworld – Gartner Criticizes Green Grid
    Computerworld – IT Skills no longer sufficient for data center execs.
    Computerworld – Meet MAID 2.0 and Intelligent Power Management
    Computerworld – Feds to offer energy ratings on servers and storage
    Computerworld – Greenpeace still hunting for truly green electronics
    Computerworld – How to benchmark data center energy costs
    ComputerworldUK – Datacenters at risk from poor governance
    ComputerworldUK – Top IT Leaders Back Green Survey
    ComputerworldMH – Lean and Green
    CTR – Strategies for enhancing energy efficiency
    CTR – Economies of Scale – Green Data Warehouse Appliances
    Datacenterknowledge – Microsoft to build Illinois datacenter
    Data Center Strategies – Storage The Next Hot Topic
    Earthtimes – Fujitsu installs hydrogen fuel cell power
    eChannelline – IBM Goes Green(er)
    Ecoearth.info – California Moves To Speed Solar, Wind Power Grid Connections
    Ecogeek – Solar power company figures they can power 90% of America
    Economist – Cool IT
    Electronic Design – How many watts in that Gigabyte
    eMazzanti – Desktop virtualization movement creeping into customer sites
    ens-Newswire – Western Governors Ask Obama for National Green Energy Plan
    Environmental Leader – Best Place to Build an Energy Efficient Data Center
    Environmental Leader – New Guide Helps Advertisers Avoid Greenwash Complaints
    Enterprise Storage Forum – Power Struggles Take Center Stage at SNW
    Enterprise Storage Forum – Pace Yourself for Storage Power & Cooling Needs
    Enterprise Storage Forum – Storage Power and Cooling Issues Heat Up – StorageIO Article
    Enterprise Storage Forum – Score Savings With A Storage Power Play
    Enterprise Storage Forum – I/O, I/O, Its off to Virtual Work I Go
    Enterprise Storage Forum – Not Just a Flash in the Pan – Various SSD options
    Enterprise Storage Forum – Closing the Green Gap – Article August 2008
    EPA Report to Congress and Public Law 109-431 – Reports & links
    eWeek – Saving Green by being Green
    eWeek – ‘No Cooling Necessary’ Data Centers Coming?
    eWeek – How the ‘Down’ Macroeconomy Will Impact the Data Storage Sector
    ExpressComputer – In defense of Green IT
    ExpressComputer – What data center crisis
    Forbes – How to Build a Quick Charging Battery
    GCN – Sun launches eco data center
    GreenerComputing – New Code of Conduct to Establish Best Practices in Green Data Centers
    GreenerComputing – Silicon valley’s green detente
    GreenerComputing – Majority of companies plan to green their data centers
    GreenerComputing – Citigroup to spend $232M on Green Data Center
    GreenerComputing – Chicago and Quincy, WA Top Green Data Center Locations
    GreenerComputing – Using airside economizers to chill data center cooling bills
    GreenerComputing – Making the most of asset disposal
    GreenerComputing – Greenpeace vendor rankings
    GreenerComputing – Four Steps to Improving Data Center Efficiency without Capital Expenditures
    GreenerComputing – Enabling a Green and Virtual Data Center
    Green-PC – Strategic Steps Down the Green Path
    Greeniewatch – BBC news chiefs attack plans for climate change campaign
    Greeniewatch – Warmest year predictions and data that has not yet been measured
    GoverenmentExecutive – Public Private Sectors Differ on "Green" Efforts
    HPC Wire – How hot is your code
    Industry Standard – Why green data centers mean partner opportunities
    InformationWeek – It could be 15 years before we know what is really green
    InformationWeek – Beyond Server Consolidaiton
    InformationWeek – Green IT Beyond Virtualization: The Case For Consolidation
    InfoWorld – Sun celebrates green datacenter innovations
    InfoWorld – Tech’s own datacenters are their green showrooms
    InfoWorld – 2007: The Year in Green
    InfoWorld – Green Grid Announces Tech Forum in Feb 2008
    InfoWorld – SPEC seeds future green-server benchmarks
    InfoWorld – Climate Savers green catalog proves un-ripe
    InfoWorld – Forester: Eco-minded activity up among IT pros
    InfoWorld – Green ventures in Silicon Valley, Mass reaped most VC cash in ’07
    InfoWorld – Congress misses chance to see green-energy growth
    InfoWorld – Unisys pushes green envelope with datacenter expansion
    InfoWorld – No easy green strategy for storage
    Internet News – Storage Technologies for a Slowing Economy
    Internet News – Economy will Force IT to Transform
    ITManagement – Green Computing, Green Revenue
    itnews – Data centre chiefs dismiss green hype
    itnews – Australian Green IT regulations could arrive this year
    IT Pro – SNIA Green storage metrics released
    ITtoolbox – MAID discussion
    Linux Power – Saving power with Linux on Intel platforms
    MSNBC – Microsoft to build data center in Ireland
    National Post – Green technology at the L.A. Auto Show
    Network World – Turning the datacenter green
    Network World – Color Interop Green
    Network World – Green not helpful word for setting environmental policies
    NewScientistEnvironment – Computer servers as bad for climate as SUVs
    Newser – Texas commission approves nation’s largest wind power project
    New Yorker – Big Foot: In measuring carbon emissions, it’s easy to confuse morality and science
    NY Times – What the Green Bubble Will Leave Behind
    PRNewswire – Al Gore and Cisco CEO John Chambers to debate climate change
    Processor – More than just monitoring
    Processor – The new data center: What’s hot in Data Center physical infrastructure:
    Processor – Liquid Cooling in the Data Center
    Processor – Curbing IT Power Usage
    Processor – Services To The Rescue – Services Available For Today’s Data Centers
    Processor – Green Initiatives: Hire A Consultant?
    Processor – Energy-Saving Initiatives
    Processor – The EPA’s Low Carbon Campaig
    Processor – Data Center Power Planning
    SAN Jose Mercury – Making Data Centers Green
    SDA-Asia – Green IT still a priority despite Credit Crunch
    SearchCIO – EPA report gives data centers little guidance
    SearchCIO – Green IT Strategies Could Lead to hefty ROIs
    SearchCIO – Green IT In the Data Center: Plenty of Talk, not much Walk
    SearchCIO – Green IT Overpitched by Vendors, CIOs beware
    SearchDataCenter – Study ranks cheapest places to build a data center
    SearchDataCenter – Green technology still ranks low for data center planners
    SearchDataCenter – Green Data Center: Energy Effiecnty Computing in the 21st Century
    SearchDataCenter – Green Data Center Advice: Is LEED Feasible
    SearchDataCenter – Green Data Centers Tackle LEED Certification
    SearchDataCenter – PG&E invests in data center effieicny
    SearchDataCenter – A solar powered datacenter
    SearchSMBStorage – Improve your storage energy efficiency
    SearchSMBStorage – SMB capacity planning: Focusing on energy conservation
    SearchSMBStorage – Data footprint reduction for SMBs
    SearchSMBStorage – MAID & other energy-saving storage technologies for SMBs
    SearchStorage – How to increase your storage energy efficiency
    SearchStorage – Is storage now top energy hog in the data center
    SearchStorage – Storage eZine: Turning Storage Green
    SearchStorage – The Green Storage Gap
    SearchStorageChannel – Green Data Storage Projects
    Silicon.com – The greening of IT: Cooling costs
    SNIA – SNIA Green Storage Overview
    SNIA – Green Storage
    SNW – Beyond Green-wash
    SNW Spring 2008 Beyond Green-wash
    State.org – Why Texas Has Its Own Power Grid
    StorageDecisions – Different Shades of Green
    Storage Magazine – Storage still lacks energy metrics
    StorageIOblog – Posts pertaining to Green, power, cooling, floor-space, EHS (PCFE)
    Storage Search – Various postings, news and topics pertaining to Green IT
    Technology Times – Revealed: the environmental impact of Google searches
    TechTarget – Data center power efficiency
    TechTarget – Tip for determining power consumption
    Techworld – Inside a green data center
    Techworld – Box reduction – Low hanging green datacenter fruit
    Techworld – Datacentere used to heat swimming pool
    Theinquirer – Spansion and Virident flash server farms
    Theinquirer – Storage firms worry about energy efficiency How green is the valley
    TheRegister – Data Centre Efficiency, the good, the bad and the way to hot
    TheRegister – Server makers snub whalesong for serious windmill abuse
    TheRegister – Green data center threat level: Not Green
    The Standard – Growing cynicism around going Green
    ThoughtPut – Energy Central
    Thoughtput – Power, Cooling, Green Storage and related industry trends
    Wallstreet Journal – Utilities Amp Up Push To Slash Energy Use
    Wallstreet Journal – The IT in Green Investing
    Wallstreet Journal – Tech’s Energy Consumption on the Rise
    Washingtonpost – Texas approves major new wind power project
    WhatPC – Green IT: It doesnt have to cost the earth
    WHIRnews – SingTel building green data center
    Wind-watch.org – Loss of wind causes Texas power grid emergency
    WyomingNews – Overcoming Greens Stereotype
    Yahoo – Washington Senate Unviel Green Job Plan
    ZDnet – Will supercomputer speeds hit a plateau?
    Are data centers causing climate change

    News and Press Releases

    Business Wire – The Green and Virtual Data Center
    Enterprise Storage Forum – Intel and HGST (Hitachi) partner on FLASH SSD
    PCworld – Intel and HP describe Green Strategy
    DoE – To Invest Approximately $1.3 Billion to Commercialize CCS Technology
    Yahoo – Shell Opens Los Angeles’ First Combined Hydrogen and Gasoline Station
    DuPont – DuPont Projects Save Enough Energy to Power 25,000 Homes
    Gartner – Users Are Becoming Increasingly Confused About the Issues and Solutions Surrounding Green IT

    Websites and Tools

    Various power, cooling, emmisions and device configuration tools and calculators
    Solar Action Alliance web site
    SNIA Emerald program
    Carbon Disclosure Project
    The Chicago Climate Exchange
    Climate Savers
    Data Center Decisions
    Electronic Industries Alliance (EIA)
    EMC – Digital Life Calculator
    Energy Star
    Energy Star Data Center Initiatives
    Greenpeace – Technology ranking website also here
    GlobalActionPlan
    KyotoPlanet
    LBNL High Tech Data centers
    Millicomputing
    RoHS & WEE News
    Storage Performance Council (SPC)
    SNIA Green Technical Working Group
    SPEC
    Transaction Processing Council (TPC)
    The Green Grid
    The Raised Floor
    Terra Pass Carbon Offset Credits – Website with CO2 calculators
    Energy Information Administration – EIA (US and International Electrical Information)
    U.S. Department of Energy and related information
    U.S. DOE Energy Efficient Industrial Programs
    U.S. EPA server and storage energy topics
    Zerofootprint – Various "Green" and environmental related links and calculators

    Vendor Centric and Marketing Website Links and tools

    Vendors and organizations have different types of calculators some with focus on power, cooling, floor space, carbon offsets or emissions,

    ROI, TCO and other IT data center infrastructure resource management. Following is an evolving list and by no means definitive even for a particular vendors as

    different manufactures may have multiple different calculators for different product lines or areas of focus.

    Brocade – Green website
    Cisco – Green and Environmental websites here, here and here
    Dell – Green website
    EMC – EMC Energy, Power and Cooling Related Website
    HDS – How to be green – HDS Positioning White Paper
    HP – HP Green Website
    IBM – Green Data Center – IBM Positioning White Paper
    IBM – Green Data Center for Education – IBM Positioning White Paper
    Intel – What is an Efficient Data Center and how do I measure it?
    LSI – Green site and white paper
    NetApp – Press Release and related information
    Sun – Various articles and links
    Symantec – Global 2000 Struggle to Adopt "Green" Data Centers – Announcement of Survey results
    ACTON
    Adinfa
    APC
    Australian Conservation Foundation
    Avocent
    BBC
    Brocade
    Carbon Credit Calculator UK
    Carbon Footprint Site
    Carbon Planet
    Carbonify
    CarbonZero
    Cassatt
    CO2 Stats Site
    Copan
    Dell
    DirectGov UK Acton
    Diesel Service & Supply Power Calculator & Converter
    Eaton Powerware
    Ecobusinesslinks
    Ecoscale
    EMC Power Calculator
    EMC Web Power Calculator
    EMC Digital Life Calculator
    EPA Power Profiler
    EPA Related Tools
    EPEAT
    Google UK Green Footprint
    Green Grid Calculator
    HP and more here
    HVAC Calculator
    IBM
    Logicalis
    Kohler Power (Business and Residential)
    Micron
    MSN Carbon Footprint Calculator
    National Wildlife Foundation
    NEF UK
    NetApp
    Rackwise
    Platespin
    Safecom
    Sterling Planet
    Sun and more here and here and here
    Tandberg
    TechRepublic
    TerraPass Carbon Offset Credits
    Thomas Kreen AG
    Toronto Hydro Calculator
    80 Plus Calculator
    VMware
    42u Green Grid PUE DCiE calculator
    42u energy calculator

    Green and Virtual Tools

    What’s your power, cooling, floor space, energy, environmental or green story?

    What’s your power, cooling, floor space, energy, environmental or green story? Do you have questions or want to learn more about

    energy issues pertaining to IT data center and data infrastructure topics? Do you have a solution or technology or a success story that you would like to share

    with us pertaining to data storage and server I/O energy optimization strategies?  Do you need assistance in developing, validating or reviewing your strategy

    or story? Contact us at: info@storageio.com or 651-275-1563 to learn more about green data storage and server I/O or to

    schedule a briefing to tell us about your energy efficiency and effectiveness story pertaining to IT data centers and data infrastructures.

    Disclaimer and note:  URL’s submitted for inclusion on this site will be reviewed for consideration and to be

    in generally accepted good taste in regards to the theme of this site.  Best effort has been made to validate and verify the URLs that appear on this page and

    website however they are subject to change. The author and/or maintainer’s) of this page and web site make no endorsement to and assume no responsibility for the

    URLs and their content that are listed on this page.

    Green and Virtual Metrics

    Chapter 5 "Measurement, Metrics, and Management of IT Resources" in the book "The Green and Virtual Data Center" (CRC Press) takes a look at the importance of being able to measure and monitor to enable effective management and utilization of IT resources across servers, storage, I/O networks, software, hardware and facilities.

    There are many different points of interest for collecting metrics in an IT data center for servers, storage, networking and facilities along with various points of interest or perspectives. Data center personal have varied interest from a facilities to a resource (server, storage, networking) usage and effectiveness perspective for normal use as well as planning purposes or comparison when evaluating new technology. Vendors have different uses for metrics during R&D, Q/A testing and marketing or sales campaigns as well as on-going service and support. Industry trade groups including 80 Plus, SNIA and the green grid along with government groups including the EPA Energy Star are working to define and establish applicable metrics pertinent for Green and Virtual data centers.

    Acronym

    Description

    Comment

    DCiE

    Data center Efficiency = (IT equipment / Total facility power) * 100

    Shows a ratio of how well a data center is consuming power

    DCPE

    Data center Performance Efficiency = Effective IT workload / total facility power

    Shows how effective data center is consuming power to produce a given level of service or work such as energy per transaction or energy per business function performed

    PUE

    Power usage effectiveness = Total facility power / IT equipment power

    Inverse of DCE

    Kilowatts (kw)

    Watts / 1,000

    One thousand watts

    Annual kWh

    kWh x 24 x 365

    kWh used in on year

    Megawatts (mw)

    kW / 1,000

    One thousand kW

    BTU/hour

    watts x 3.413

    Heat generated in an hour from using energy in British Thermal Units. 12,000 BTU/hour can equate to 1 Ton of cooling.

    kWh

    1,000 watt hours

    The number of watts used in one hour

    Watts

    Amps x Volts (e.g. 12 amps * 12 volts = 144 watts)

    Unit of electrical energy power

    Watts

    BTU/hour x 0.293

    Convert BTU/hr to watts

    Volts

    Watts / Amps (e.g. 144 watts / 12 amps = 12 volts)

    The amount of force on electrons

    Amps

    Watts / Volts (e.g. 144 watts / 12 volts = 12 amps)

    The flow rate of electricity

    Volt-Amperes (VA)

    Volts x Amps

    Sometimes power expressed in Volt-Ampres

    kVA

    Volts x Amp / 1000

    Number of kilovolt-ampres

    kW

    kVA x power-factor

    Power factor is the efficiency of a piece of equipments use of power

    kVA

    kW / power-factor

    Killovolt-Ampres

    U

    1U = 1.75”

    EIA metric describing height of equipment in racks.

     

    Activity / Watt Amount of work accomplished per unit of energy consumed. This could be IOPS, Transactions or Bandwidth per watt. Indicator how much work and how efficient energy is being used to accomplish useful work. This metric applies to active workloads or actively used and frequently accessed storage and data. Examples would be IOPS per watt, Bandwidth per watt, Transactions per watt, Users or streams per watt. Activity per watt should also be used in conjunction with another metric such as how much capacity is supported per watt and total watts consumed for a representative picture.

    IOPS / Watt

    Number of I/O operations (or transactions) / energy (watts)

    Indicator of how effectively energy is being used to perform a given amount of work. The work could be I/Os, transactions, throughput or other indicator of application activity. For example SPC-1 / Watt, SPEC / Watt, TPC / Watt, transaction / watt,  IOP / Watt.

    Bandwidth / Watt GBPS or TBPS or PBPS / Watt Amount of data transferred or moved per second and energy used. Often confused with Capacity per watt This indicates how much data is moved or accessed per second or time interval per unit of energy consumed. This is often confused with capacity per watt given that both bandwidth and capacity reference GByte, TByte, PByte.

    Capacity / Watt

    GB or TB or PB (storage capacity space / watt

    Indicator of how much capacity (space) or bandwidth supported in a given configuration or footprint per watt of energy. For inactive data or off-line and archive data, capacity per watt can be an effective measurement gauge however for active workloads and applications activity per watt also needs to be looked at to get a representative indicator of how energy is being used

    Mhz / Watt

    Processor performance / energy (watts)

    Indicator of how effectively energy is being used by a CPU or processor.

    Carbon Credit

    Carbon offset credit

    Offset credits that can be bought and sold to offset your CO2 emissions

    CO2 Emission

    Average 1.341 lbs per kWh of electricity generated

    The amount of average carbon dioxide (CO2) emissions from generating an average kWh of electricity

    Various power, cooling, floor space and green storage or IT  related metrics

    Metrics include Data center Efficiency (DCiE) via the greengrid which is the indicator ratio of a IT data center energy efficiency defined as IT equipment (servers, disk and tape storage, networking switches, routers, printers, etc) / Total facility power x 100 (for percentage). For example, if the sum of all IT equipment energy usage resulted in 1,500 kilowatt hours (kWh) per month yet the total facility power including UPS, energy switching, power conversation and filtering, cooling and associated infrastructure costs as well as IT equipment resulting in 3,500 kWh, the DCiE would be (1,500 / 3,500) x 100 = 43%. DCiE can be used as a ratio for example to show in the above scenario that IT equipment accounts for about 43% of energy consumed by the data center with in this scenario 57% of electrical energy being consumed by cooling, conversion and conditioning or lighting.

    Power usage effectiveness (PUE) is the indicator ratio of total energy being consumed by the data center to energy being used to operate IT equipment. PUE is defined as total facility power / IT equipment energy consumption. Using the above scenario PUE = 2.333 (3,500 / 1,500) which means that a server requiring 100 watts of power would actually require (2.333 * 100) 233.3 watts of energy that includes both direct power and cooling costs. Similarly a storage system that required 1,500 kWh of energy to power would require (1,500*2.333) 3,499.5 kWh of electrical power including cooling.

    Another metric that has the potential to have meaning is Data center Performance Efficiency (DCPE) that takes into consideration how much useful and effective work is performed by the IT equipment and data center per energy consumed. DCPE is defined as useful work / total facility power with an example being some number of transactions processed using servers, networks and storage divided by energy for the data center to power and cool the equipment. An relatively easy and straightforward implementation of DCPE is an IOPs per watt measurement that looks at how many IOPs can be performed (regardless of size or type such as reads or writes) per unit of energy in this case watts.

    DCPE = Useful work / Total facility power, for example IOPS per watt of energy used

    DCiE = IT equipment energy / Total facility power = 1 / PUE

    PUE = Total facility energy / IT equipment energy

    IOPS per Watt = Number of IOPs (or bandwidth) / energy used by the storage system

    The importance of these numbers and metrics is to focus on the larger impact of a piece of IT equipment that includes its cost and energy consumption that factors in cooling and other hosting or site environmental costs. Naturally energy costs and CO2 (carbon offsets) will vary by geography and region along with type of electrical power being used (Coal, Natural Gas, Nuclear, Wind, Thermo, Solar, etc) and other factors that should be kept in perspective as part of the big picture. Learn more in Chapter 5 "Measurement, Metrics, and Management of IT Resources" in the book "The Green and Virtual Data Center" (CRC) and in the book Cloud and Virtual Data Storage Networking (CRC).

    Disclaimer and notes

    Disclaimer and note:  URL’s submitted for inclusion on this site will be reviewed for consideration and to be in generally accepted good taste in regards to the theme of this site.  Best effort has been made to validate and verify the URLs that appear on this page and web site however they are subject to change. The author and/or maintainer’s) of this page and web site make no endorsement to and assume no responsibility for the URLs and their content that are listed on this page.

    What this all means

    The result of a green and virtual data center is that of a flexible, agile, resilient, scalable information factory that is also economical, productive, efficient, productive as well as sustainable.

    Ok, nuff said (for now)

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    January 2015 Server StorageIO Industry Trends Newsletter

    Volume 15, Issue I

    Hello and welcome to this January 2015 Server and StorageIO update newsletter. Its 2015 and the new year is off and running picking up where 2014 left off. January is typically a relatively quiet month when it comes to technology announcements and other industry activity. However January is also time where there is a lot going on behind the scenes. This means that there are many things to watch for in the coming months, weeks or perhaps even days.

    Commentary In The News

    StorageIO news

    Following are some Server and StorageIO industry trends perspectives comments that have appeared in various venues. In case you missed it, Box recently did their IPO and here are some perspectives over at SaaS In the Enterprise prior to the IPO.

    Over at Enterprise Storage Forum I have some perspectives on High Performance Compute (HPC) aka High Productivity Compute along with big data and object storage in the Lustre buying guide.

    Also over at Enterprise Storage Forum some tips and comments on data storage benchmarking guide. Meanwhile over at  InfoStor check see 9 Storage Startups to Watch. Search SolidState Storage has some perspectives on NexGen Storage ioControl following SanDisk spinout and over at Processor some comments on avoiding common mistakes with virtualization. View more trends comments here

    Tips and Articles

    Cloud storage: Is It All About Cost?

    Is cloud storage all about removing cost, cost cutting, free storage? Or perhaps even getting something else in addition to free storage?

    You might ask: what type of cloud storage am I referring to? That’s a great question. After all, there are many types or categories of public cloud storage services, not to mention private and hybrid options. There are cloud storage services for consumers to save and share their photos, videos, music and other documents to. Then there is business and enterprise file, document, object and collaboration cloud storage options. Read the entire article here.

    View recent as well as past tips and articles here

    Server StorageIOblog posts

    Recent StorageIOblog posts include:

    View other recent as well as past blog posts here

    In This Issue

  • Industry Trends Perspectives
  • Commentary in the news
  • Server StorageIO Tips and Articles
  • Server StorageIO blog posts
  • Events & Activities

    May 4-6, 2015 EMCworld Las Vegas
    April 29, 2015 Interop Las Vegas
    April 12 -13, 2015 NAB Las Vegas
    March 3, 2015 – TBA (St. Paul)
    Feb 18, 2015 Usenix FAST Santa Clara

    View other recent and upcoming events here

    Webinars

    December 11, 2014 – BrightTalk
    Server & Storage I/O Performance
    December 10, 2014 – BrightTalk
    Server & Storage I/O Decision Making
    December 9, 2014 – BrightTalk
    Virtual Server and Storage Decision Making
    December 3, 2014 – BrightTalk
    Data Protection Modernization
    November 13 9AM PT – BrightTalk
    Software Defined Storage

    Videos and Podcasts

    StorageIO podcasts are also available via and at StorageIO.tv

    From Server StorageIO Labs

    Research, Reviews and Reports

    Intel NUC nick knack notes and review

    Intel nuc server storage I/O
    Intel nuc server storage I/O ports
    Intel Nuc

    This Server StorageIO lab review looks at  Intel NUC for virtual, physical and software defined storage networking. Read more about Intel Nuc here.

    View other StorageIO lab and reports here.

    Resources and Links

    Check out these useful links and pages:
    storageio.com/links
    objectstoragecenter.com
    storageioblog.com/data-protection-diaries-main/
    storageio.com/raid
    storageio.com/ssd

    Enjoy this edition of the Server and StorageIO update newsletter and watch for new tips, articles, StorageIO lab report reviews, blog posts, videos and podcasts along with in the news commentary appearing soon.

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved