Tag: cmg

Posted on

Backup, Big data, Big Data Protection, CMG & More with Tom Becchetti Podcast

server storage I/O trends

In this Server StorageIO podcast episode, I am joined by Tom Becchetti (@tbecchetti) for a Friday afternoon conversation recorded live at Meisters in Scandia Minnesota (thanks to the Meisters crew!).

Tom Becchetti

For those of you who may not know Tom, he has been in the IT, data center, data infrastructure, server and storage (as well as data protection) industry for many years (ok decades) as a customer and vendor in various roles. Not surprising our data infrastructure discussion involves server, software, storage, big data, backup, data protection, big data protection, CMG (Computer Measurement Group @mspcmg), copy data management, cloud, containers, fundamental tradecraft skills among other related topics.

Check out Tom on twitter @tbecchetti and @mspcmg as well as his new website www.storagegodfather.com. Listen to the podcast discussion here (42 minutes) as well as on iTunes.

Also available on 

Ok, nuff said for now…

Cheers
Gs

Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert (and vSAN). Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier) and twitter @storageio. Watch for the spring 2017 release of his new book Software-Defined Data Infrastructure Essentials (CRC Press).

Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2023 Server StorageIO(R) and UnlimitedIO. All Rights Reserved.

>

Posted on

Six plus data center software defined management dashboards tools

Software defined data infrastructure management insight tools

server storage I/O trends

Updated 1/17/2018

Managing data infrastructures involves using software defined management dashboards tools. Recently I found in my inbox a link to a piece 6 Dashboards for Managing Every Modern Data Center that caught my attention. I was hoping to see who the six different datacenter technologies, dashboard solutions tools were instead of finding list of dashboard considerations for modern data centers and data infrastructures.

Turns out the piece was nothing more than a list of six items featured as part of the vendors (Sunbird) piece about what to look for in a dashboard (e.g. their product). Sure there were some of the usual key performance indicator (KPI) associated with or related to IT Service Management (ITSM), Data Center Infrastructure (Insight/Information) Management (DCIM), Configuration and Change management databases (CMDB), availability, capacity and Performance Management Databases (PMDB) among others.

  • Space
  • Inventory
  • Connectivity
  • Change
  • Environment
  • Power

Dashboard Discussions

Keep in mind however that there are many different types of dashboards (and consoles), some are active along with analytics including correlation, others are passive simply displaying. The focus area also various from physical data center facilities, to applications, to data infrastructures or components such as servers, storage, I/O networks, clouds, virtual, containers among others modern data centers.

Data Infrastructures and SDDI, SDDC, SDI
Data Infrastructures (hardware, software, services, servers, storage, I/O and networks)

This is where some context comes into play as there are different types of dashboards for various audience, technology and focus areas (e.g. domains) across data infrastructure (and other entities). For example do a google search of “dashboard” and see what appears, or “IT dashboard”, “data center dashboard” vs. “datacenter dashboard” among others.

Additional KPIs include:

  • Performance, availability, Capacity and Economic (PACE) attributes
  • Service Level Objectives (SLO), Service Level Agreements (SLAs)
  • Recovery Time Objectives (RTO), Recovery Point Objectives (SLO)
  • IT Service Management (ITSM) and Data Center Infrastructure Management (DCIM)
  • Configuration and Change Management (e.g. things part of CMDB)
  • Performance, availability and capacity (e.g. things part of PMDB)
  • Various focus and layers, cross domain functionality views
  • Costs management including subscriptions, licenses and others

IT Data Center and Data Infrastructure Dashboard Options

For those of you who have made it this far, while not a comprehensive list, the following are some examples of vendors, services or solutions that either are, or have an association with data center, as well as data infrastructure management. Some dashboards or tools are homogenous in that they only work within a given area of focus such as particular cloud, service provider, vendor or solution set. Others are heterogeneous or federated working across different services, solutions, vendors and domain focus areas. Think of these as software defined management (SDM), or, software defined data infrastructure (SDDI) management, software defined data center (SDDC) management among other variations for the modern information factory.

There is a mix of tools that run on site (e.g. on premise) or via cloud services (e.g. manager your on site from the cloud). Likewise, some are for fee, others subscription and some are open source. In addition some of the tools are turnkey while others are do it yourself (DiY) or allow you to customize. Also keep in mind that depending on what your tradecraft (skills, experience, expertise) interest area is, these may or may not be applicable to you, while relevant to others. For example some such as Spiceworks tend to be more helpdesk focused while others on other data center or data infrastructure areas.

There are dashboards for or from AWS, Canonical (Ubuntu), Dell including EMC, Google, HPE, IBM, Microsoft System Center and Azure, NetApp, OpenStack, Oracle, Rackspace, Redhat, Rightscale, Servicenow, Softlayer, Suse and VMware among others.

Blue Medora (various data infrastructure monitoring)
Cloudkitty (open source cloud rating and chargeback)
Collectd (data infrastructure collection and monitoring)
cPanel and whm (web and hosting dashboards)
data infrastructure sddi cpanel

Dashbuilder (customize your dashboard)
Datadog (super easy to get access, download, install, configure and use)
Domo (various data infrastructure monitoring tools)
Extrahop (still waiting to be able to download and try their bits vs. watching a demo)
Firescope (data infrastructure insight and awareness)
Freezer (open source dashboard tools)
Komprise (interesting solution, would like try, however lots of gated material)
Nagios (data infrastructure monitoring)
Openit (data infrastructure tracking, report, monitoring)
Opvizor (data infrastructure monitoring and reporting)

storageio datadog dashboard

Panorama9 (various data infrastructure monitoring and reporting)
Quest (various tools)
Redhat Cloudforms (openstack and cloud management)
Rrdtools (data collection, logging and display)
Sisense (insight and awareness tools)
Solarwinds Server Application Monitor (SAM) among other tools
Teamquest (various monitoring, management, capacity planning tools)
Turbomomic (software defined data infrastructure insight tools)
Virtual Instruments (various monitoring and insight awareness along with analytics)

In addition to the above, there are tools such as Splunk among others that also provide insight and awareness to help avoid flying blind while managing your data center or data infrastructure.

Where to learn more

Learn more via the following links.

  • Data Infrastructure Primer and Overview (Its Whats Inside The Data Center)
  • E2E Awareness and insight for IT environments
  • Server and Storage I/O Benchmarking and Performance Resources
  • Data Center Infrastructure Management (DCIM) and IRM
  • The Value of Infrastructure Insight – Enabling Informed Decision Making
  • More storage and IO metrics that matter
  • Whats a data infrastructure?

    • Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What this all means

    Without insight and awareness you are flying blind, how can you make informed decisions about your information factory, data infrastructures, data center along with applications. There are different focus areas for various audiences up and down the stack layers in data infrastructures and data centers. Key is having insight and awareness including knowing what are some different tool options.

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Posted on

    Storage Effiency and Optimizaiton – Balancing Time and Space

    Storage I/O trends

    Here’s a link to the presentation I recently delivered at the Spring 2009 Minneapolis/St. Paul area CMG (Computer Measurement Group – CMG) March 20th, 2009 hosted by Nexus Information Systems and organized by Tom Becchetti. The theme of the event was "Is your storage efficient? There are many ways to rate your storage, how does yours stack up?". Tom organized a great event as usual with a diverse set of speakers for the well attended event graciously hosted by Keith Norbie of Nexus at their Minnetonka facility. The title of my presentation was "Storage Efficiency: Mirror Mirror On The Wall, Who or What is The Most Efficient of Them All? Finding the Correct Balance" that looked at balancing the need to reduce (or maximize) space (utilization) with time (performance) to meet different requirements including maintaining quality of service, response time and availability.

    Keeping in mind that there is no such thing as a data or I/O performance recession, there is a common myth that storage optimization or efficiency is all about driving up storage space capacity utilization which can be true for some environments, applications, data or storage types. However there is also the need to maintain or boost performance, reduce response time and latency, doing more work in a more productive and efficieny manner. Not all data or storage can be consolidated to boost utilization without concern for degrading or in any other way penalizing performance, response time or availability.

    Thus it is about time and space, that is, balancing data movement and processing rates with storage space capacity utilization and that sometimes, more is not better for performance when it comes to ratios or the number of components in a solution.

    Likewise there is the need to balance energy avoidance with energy efficient, balancing the need to store more data in a smaller footprint using less energy and the need to process more data in less time efficiently for productivity.

    These and other related themes are expanded on in more detail in my book "The Green and Virtual Data Center" (CRC). These and other related themes will covered in one of my upcoming presentations (The Other Green — Storage Efficiency and Optimization) at StorageDecisions in Chicago the week of June 1st, 2009, as well as in various seminars and events that I will be involved in the coming weeks and months.

    Thanks to all those who helped organize, support, sponsored, presented and attended the recent CMG event, look forward to seeing or hearing from you all again soon.

    Ok, nuff said.

    Ok, nuff said.

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    Posted on

    March and Mileage Mania Wrap-up

    Today’s flight to Santa Ana (SNA) Orange County California for an 18 hour visit marks my 3rd trip to the left coast in the past four weeks that started out with a trip to Los Angeles. The purpose of today’s trip is to deliver a talk around Business Continuance (BC) and Disaster recovery (DR) topics for virtual server and storage environments along with related data transformation topics themes, part of a series of on-going events.

    Planned flight path from MSP to SNA, note upper midwest snow storms. Thanks to Northwest Airlines, now part of Delta!
    Planned flight path from MSP to SNA courtesy of Northwest Airlines, now part of Delta

    This is a short trip to southern California in that I have to be back in Minneapolis for a Wednesday afternoon meeting followed by keynoting at an IT Infrastructure Optimization Seminar downtown Minneapolis Thursday morning. Right after Thursday morning session, its off to the other coast for some Friday morning and early afternoon sessions in the Boston area, the results of which I hope to be able to share with you in a not so distant future posting.

    Where has March gone? Its been a busy and fun month out on the road with in-person seminars, vendor and user group events in Minneapolis, Los Angles, Las Vegas, Milwaukee, Atlanta, St. Louis, Birmingham, Minneapolis for CMG user group, Cincinnati and Orange County not to mention some other meetings and consulting engagements elsewhere including participating in a couple of webcast and virtual conference/seminars while on the road. Coverage and discussion around my new book "The Green and Virtual Data Center" (CRC) continues expand, read here to see what’s being said.

    What has made the month fun in addition to traveling around the country is the interaction with the hundreds of IT professionals from organizations of all size hearing what they are encountering, what their challenges are, what they are thinking, and in general what’s on their mind.

    Some of the common themes include:

  • There’s no such thing as a data recession, however the result is doing more with less, or, with what you have
  • Confusion abounds around green hype including carbon footprints vs. core IT and business issues
  • There is life beyond consolidation for server and storage virtualization to enable business agility
  • Security and encryption remain popular topic as does heterogeneous and affordable key management
  • End to end IT resource management for virtual environments is needed that is scalable and affordable
  • Performance and quality of service can not be sacrificed in the quest to drive up storage utilization
  • Clouds, SSD (FLASH), Dedupe, FCoE and Thin Provisioning among others are on the watch list
  • Tape continues to be used complimenting disks in tiered storage environments along with VTLs
  • Dedupe continues to be deployed and we are just seeing the very tip of the ice-berg of opportunity
  • Software licensing cost savings or reallocation should be a next step focus for virtual environments

    • Now, for a bit of irony and humor, overheard was a server sales person talking to a storage sales person comparing notes on how they are missing their forecasts as their customers are buying fewer servers and storage now that they are consolidating with virtualization, or using disk dedupe to eliminate disk drives. Doh!!!

    Now if those sales people can get their marketing folks to get them the play book for virtualization for business agility, improving performance and enabling business growth in an optimized, transformed environment, they might be able to talk a different story with their customers for new opportunities…

    What’s on deck for April? More of the same, however also watch and listen for some additional web based content including interviews quotes and perspectives on industry happenings, articles, tips and columns, reports, blogs, videos, podcasts, webcasts and twitter activity as well as appearances at events in Boston, Chicago, New Jersey and Providence among other venues.

    To all of those who came out to the various events in March, thank you very much and look forward to future follow-up conversations as well as seeing you at some of the upcoming future events.

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press, 2011), The Green and Virtual Data Center (CRC Press, 2009), and Resilient Storage Networks (Elsevier, 2004)

    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2012 StorageIO and UnlimitedIO All Rights Reserved

    Posted on

    Out and About Update

    As part of the continuing on the road theme and series, this post is being done while traveling for this weeks adventures and events including stops in Atlanta, St. Louis and wrapping up the week in Minneapolis at the local CMG quarterly meeting event. At both last weeks events in Las Vegas and Milwaukee as well as this weeks events talking with IT professionals from various organizations, a consistent theme is that there is no data or I/O recession, however there is the need to do more with less while enabling business sustainability.

    While VMware remains the dominant server virtualization platform, I’m hearing of more organizations using Citrix or other Xensource based technologies along with some Microsoft HyperV adopters in part to leverage lower cost of ownership compared to VMware in instances where not all of the feature functionality of the robust VMware technology is needed. This will be an interesting scenario to keep an eye on in the weeks and months to come to see if there are any shifting patterns on the server virtualization front while trying to stretch IT dollars further to do more.

    On the Merger & Acquisition (M&A) scene, coverage of on again, off-again and recently rekindled rumored of IBM buying Sun is rampant from the Wall Street Journal to twitter and most points in between. There have been many storm clouds around Sun the past several years from a business and technology perspective, and perhaps the best thing is for Sun and IBM to combine forces and resources, bridging the gap between old physical worlds and new virtual cloud enabled worlds so to speak. Personally, I like the idea for many different reasons and think that some shape or form of an IBM and Sun deal either in entirety, or pieces is far more likely to occur and sooner, than seeing funds returned from either AIG or Bernard Madoff, the other top news items this week, nuf said for now about IBM and Sun.

    Also this week, other activity included Cisco announcing that they are testing the waters to enter into the server market space to help jumpstart the converged networking space with some of my initial comments here and here. Check out StorageIO in the news page here for other comments on various IT industry trends, technologies and related activities including a recent piece by Drew Robb about The State of the Data Storage Job Market.

    Lets see how this plays out with more to say later, thanks again for everyone who came out for last weeks as well as this weeks events, look forward to seeing and talking with you again soon I hope.

    Cheers – gs

    Technorati tags: Recession, Sustainability, Wall Street Journal, Data Center Bottlenecks, Performance, Capacity, Networking, Telephone, Data Center, Consolidation, Virtualization, VMware, Server, Storage, Software, Sun, IBM, Las Vegas, Milwaukee, St. Louis, Atlanta, CMG, AIG, Bernard Madoff, Cisco

    Posted on

    CMG, Enabling “The Green and Virtual Data Center”

    Storage I/O trends

    Last week I was invited to by Tom Becchetti and the Minneapolis CMG folks to keynote at their session hosted at the Brocade facity in Minneapolis along with other speakers from Brocade, IBM, Teamquest and Sun.

    The theme of my talk was “The Green and Virtual Data Center and The Importance of Metrics” which can be downloaded here.

    I have been a member of CMG for many years as a former performance and capacity planning analyst when I worked in IT organizations and having presented at many CMG events around the world. While CMG has been around for many decades and has seen its share of ups and downs. With a current focus on boosting use, maximizing resource usage, improving service delivery and performance while using less energy in smaller footprints, now is the perfect opportunity for CMG to re-invent itself and show relevance as the organization that knows how to measure, watch, model and manage resource usage and service delivery effectiveness across different technology domains including servers, storage, networks, applications, operating systems and facilities. There is a golden opportunity for CMG members to step up and leverage their skills across different technology domains working with others to establish metrics, models and baselines.

    In my new book, “The Green and Virtual Data Center” (Auerbach) I include a chapter on metrics and measurement as well as many other topics and themes that tie into the notion of effective and efficient data centers need to carry out Infrastructure Resource Management (IRM) which is also a chapter in the book, that includes performance and capacity planning across technology domains.

    Watch for more on this topic.

    Ok, nuff said.

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    Posted on

    Power, Cooling, Floor-space, Environmental (PCFE) and Green Metrics

    The Metrics and Measurement page on www.greendatastorage.com has been updated along with other pages covering IT data center PCFE and green topics for servers, storage, networks and facilities. Have a look.

    Ok, nuff said.

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    Posted on

    Do Disk based VTLs draw less power than Tape?

    The tape is dead debates rage on as they have for a decades which make for good press and discussion or debate during slow times, similar to coverage of what Britney Spears or Paris Hilton are or are not wearing.

    In the on-going debates and Greenwashing of what technology or vendor is greener to prevent global warming, some recent tape is dead flare-ups have occurred including one hinting that tape libraries can draw more power than a disk based VTL with de-dupe are discussed over on Tony Pearson of IBM fame blog site as well as Beth Pariseau of TechTarget StorageSoup site.

    I posted some comments on those sites along along with a link to a StorageIO Industry Trends and Perspective report titled “Energy Savings without Performance Compromise” as an example (look for an updated version of the comparison charts in the report in the not so distant future). The report looks at how different storage tiers including on-line disk, MAID, MAID 2.0 and tape libraries vary to address different PCFE (power, cooling, floor-space, environment) issues while supporting various service levels including performance, availability, capacity and energy use.

    Additional related material can be found at www.storageio.com and www.greendatastorage.com including the Industry Trends and Perspective Report Business “Benefits of Data Footprint Reduction in general covering archiving, compression (on-line and off-line) along with de-duplication

    Ok, nuff said.

    Cheers gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved