VMware vSAN 6.6 hyper-converged (HCI) software defined data infrastructure

server storage I/O trends

VMware vSAN 6.6 hyper-converged (HCI) software defined data infrastructure

In case you missed it, VMware announced vSAN v6.6 hyper-converged infrastructure (HCI) software defined data infrastructure solution. This is the first of a five-part series about VMware vSAN V6.6. Part II (just the speeds feeds please) is located here, part III (reducing cost and complexity) located here, part IV (scaling ROBO and data centers today) found here, as well as part V here (VMware vSAN evolution, where to learn more and summary).

VMware vSAN 6.6
Image via VMware

For those who are not aware, vSAN is a VMware virtual Storage Area Network (e.g. vSAN) that is software-defined, part of being a software-defined data infrastructure (SDDI) and software-defined data center (SDDC). Besides being software-defined vSAN is HCI combining compute (server), I/O networking, storage (space and I/O) along with hypervisors, management, and other tools.

Software-defined data infrastructure

Excuse Me, What is vSAN and who is if for

Some might find it odd having to explain what vSAN is, on the other hand, not everybody is dialed into the VMware world ecosystem, so let’s give them some help, for everybody else, and feel free to jump ahead.

For those not familiar, VMware vSAN is an HCI software-defined storage solution that converges compute (hypervisors and server) with storage space capacity and I/O performance along with networking. Being HCI means that with vSAN as you scale compute, storage space capacity and I/O performance also increases in an aggregated fashion. Likewise, increase storage space capacity and server I/O performance you also get more compute capabilities (along with memory).

For VMware-centric environments looking to go CI or HCI, vSAN offers compelling value proposition leveraging known VMware tools and staff skills (knowledge, experience, tradecraft). Another benefit of vSAN is the ability to select your hardware platform from different vendors, a trend that other CI/HCI vendors have started to offer as well.

CI and HCI data infrastructure

Keep in mind that fast applications need a fast server, I/O and storage, as well as server storage I/O needs CPU along with memory to generate I/O operations (IOPs) or move data. What this all means is that HCI solutions such as VMware vSAN combine or converge the server compute, hypervisors, storage file system, storage devices, I/O and networking along with other functionality into an easy to deploy (and management) turnkey solution.

Learn more about CI and HCI along with who some other vendors are as well as considerations at www.storageio.com/converge. Also, visit VMware sites to find out more about vSphere ESXi hypervisors, vSAN, NSX (Software Defined Networking), vCenter, vRealize along with other tools for enabling SDDC and SDDI.

Give Me the Quick Elevator Pitch Summary

VMware has enhanced vSAN with version 6.6 (V6.6) enabling new functionality, supporting new hardware platforms along with partners, while reducing costs, improving scalability and resiliency for SDDC and SDDI environments. This includes from small medium business (SMB) to mid-market to small medium enterprise (SME) as well as workgroup, departmental along with Remote Office Branch Office (ROBO).

Being a HCI solution, management functions of the server, storage, I/O, networking, hypervisor, hardware, and software are converged to improve management productivity. Also, vSAN integrated with VMware vSphere among other tools enable modern, robust data infrastructure that serves, protect, preserve, secure and stores data along with their associated applications.

Where to Learn More

The following are additional resources to learn more about vSAN and related technologies.

What this all means

Overall a good set of enhancements as vSAN continues its evolution looking back just a few years ago, to where it is today and will be in the future. If you have not looked at vSAN recently, take some time beyond reading this piece to learn some more.

Continue reading more about VMware vSAN 6.6 in part II (just the speeds feeds please) is located here, part III (reducing cost and complexity) located here, part IV (scaling ROBO and data centers today) located here, as well as part V here (VMware vSAN evolution, where to learn more and summary).

Ok, nuff said (for now…).

Cheers
Gs

Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert (and vSAN). Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Watch for the spring 2017 release of his new book “Software-Defined Data Infrastructure Essentials” (CRC Press).

Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2023 Server StorageIO(R) and UnlimitedIO. All Rights Reserved.

VMware vSAN V6.6 Part II (just the speeds feeds features please)

server storage I/O trends

VMware vSAN v6.6 Part II (just the speeds feeds features please)

In case you missed it, VMware announced vSAN v6.6 hyper-converged infrastructure (HCI) software defined data infrastructure solution. This is the second of a five-part series about VMware vSAN V6.6. View Part I here, part III (reducing cost and complexity) located here, part IV (scaling ROBO and data centers today) found here, as well as part V here (VMware vSAN evolution, where to learn more and summary).

VMware vSAN 6.6
Image via VMware

For those who are not aware, vSAN is a VMware virtual Storage Area Network (e.g. vSAN) that is software-defined, part of being a software-defined data infrastructure (SDDI) and software-defined data center (SDDC). Besides being software-defined vSAN is HCI combining compute (server), I/O networking, storage (space and I/O) along with hypervisors, management, and other tools.

Just the Speeds and Feeds Please

For those who just want to see the list of what’s new with vSAN V6.6, here you go:

  • Native encryption for data-at-rest
  • Compliance certifications
  • Resilient management independent of vCenter
  • Degraded Disk Handling v2.0 (DDHv2)
  • Smart repairs and enhanced rebalancing
  • Intelligent rebuilds using partial repairs
  • Certified file service & data protection solutions
  • Stretched clusters with local failure protection
  • Site affinity for stretched clusters
  • 1-click witness change for Stretched Cluster
  • vSAN Management Pack for vRealize
  • Enhanced vSAN SDK and PowerCLI
  • Simple networking with Unicast
  • vSAN Cloud Analytics with real-time support notification and recommendations
  • vSAN ConfigAssist with 1-click hardware lifecycle management
  • Extended vSAN Health Services
  • vSAN Easy Install with 1-click fixes
  • Up to 50% greater IOPS for all-flash with optimized checksum and dedupe
  • Support for new next-gen workloads
  • vSAN for Photon in Photon Platform 1.1
  • Day 0 support for latest flash technologies
  • Expanded caching tier choice
  • Docker Volume Driver 1.1

What’s New and Value Proposition of vSAN 6.6

Let’s take a closer look beyond the bullet list of what’s new with vSAN 6.6, as well as perspectives of those features to address different needs. The VMware vSAN proposition is to evolve and enable modernizing data infrastructures with HCI powered by vSphere along with vSAN.

Three main themes or characteristics (and benefits) of vSAN 6.6 include addressing (or enabling):

  • Reducing risk while scaling
  • Reducing cost and complexity
  • Scaling for today and tomorrow

VMware vSAN 6.6 summary
Image via VMware

Reducing risk while scaling

Reducing (or removing) risk while evolving your data infrastructure with HCI including flexibility of choosing among five support hardware vendors along with native security. This includes native security, availability and resiliency enhancements (including intelligent rebuilds) without sacrificing storage efficiency (capacity) or effectiveness (performance productivity), management and choice.

VMware vSAN DaRE
Image via VMware

Dat level Data at Rest Encryption (DaRE) of all vSAN dat objects that are enabled at a cluster level. The new functionality supports hybrid along with all flash SSD as well as stretched clusters. The VMware vSAN DaRE implementation is an alternative to using self-encrypting drives (SEDs) reducing cost, complexity and management activity. All vSAN features including data footprint reduction (DFR) features such as compression and deduplication are supported. For security, vSAN DaRE integrations with compliance key management technologies including those from SafeNet, Hytrust, Thales and Vormetric among others.

VMware vSAN management
Image via VMware

ESXi HTML 5 based host client, along with CLI via ESXCLI for administering vSAN clusters as an alternative in case your vCenter server(s) are offline. Management capabilities include monitoring of critical health and status details along with configuration changes.

VMware vSAN health management
Image via VMware

Health monitoring enhancements include handling of degraded vSAN devices with intelligence proactively detecting impending device failures. As part of the functionality, if a replica of the failing (or possible soon to fail) device exists, vSAN can take action to maintain data availability.

Where to Learn More

The following are additional resources to find out more about vSAN and related technologies.

What this all means

With each new release, vSAN is increasing its feature, functionality, resiliency and extensiveness associated with traditional storage and non-CI or HCI solutions. Continue reading more about VMware vSAN 6.6 in Part I here, part III (reducing cost and complexity) located here, part IV (scaling ROBO and data centers today) found here, as well as part V here (VMware vSAN evolution, where to learn more and summary).

Ok, nuff said (for now…).

Cheers
Gs

Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert (and vSAN). Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Watch for the Spring 2017 release of his new book “Software-Defined Data Infrastructure Essentials” (CRC Press).

Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2023 Server StorageIO(R) and UnlimitedIO. All Rights Reserved.

VMware vSAN V6.6 Part III (reducing costs complexity)

server storage I/O trends

VMware vSAN V6.6 Part III (Reducing costs complexity)

In case you missed it, VMware announced vSAN v6.6 hyper-converged infrastructure (HCI) software defined data infrastructure solution. This is the third of a five-part series about VMware vSAN V6.6. View Part I here, Part II (just the speeds feeds please) is located here, part IV (scaling ROBO and data centers today) found here, as well as part V here (VMware vSAN evolution, where to learn more and summary).

VMware vSAN 6.6
Image via VMware

For those who are not aware, vSAN is a VMware virtual Storage Area Network (e.g. vSAN) that is software-defined, part of being a software-defined data infrastructure (SDDI) and software-defined data center (SDDC). Besides being software-defined vSAN is HCI combining compute (server), I/O networking, storage (space and I/O) along with hypervisors, management, and other tools.

Reducing cost and complexity

Reducing your total cost of ownership (TCO) including lower capital expenditures (CapEx) and operating (OPEX). VMware is claiming CapEx and OpEx reduced TCO of 50%. Keep in mind that solutions such as vSAN also can help drive return on investment (ROI) as well as return on innovation (the other ROI) via improved productivity, effectiveness, as well as efficiencies (savings). Another aspect of addressing TCO and ROI includes flexibility leveraging stretched clusters to address HA, BR, BC and DR Availability needs cost effectively. These enhancements include efficiency (and effectiveness e.g. productivity) at scale, proactive cloud analytics, and intelligent operations.

VMware vSAN stretch cluster
Image via VMware

Low cost (or cost-effective) Local, Remote Resiliency and Data Protection with Stretched Clusters across sites. Upon a site failure, vSAN maintains availability is leveraging surviving site redundancy. For performance and productivity effectiveness, I/O traffic is kept local where possible and practical, reducing cross-site network workload. Bear in mind that the best I/O is the one you do not have to do, the second is the one with the least impact.

This means if you can address I/Os as close to the application as possible (e.g. locality of reference), that is a better I/O. On the other hand, when data is not local, then the best I/O is the one involving a local or remote site with least overhead impact to applications, as well as server storage I/O (including networks) resources. Also keep in mind that with vSAN you can fine tune availability, resiliency and data protection to meet various needs by adjusting fault tolerant mode (FTM) to address a different number of failures to tolerate.

server storage I/O locality of reference

Network and cloud friendly Unicast Communication enhancements. To improve performance, availability, and capacity (CPU demand reduction) multicast communications are no longer used making for easier, simplified single site and stretched cluster configurations. When vSAN clusters upgrade to V6.6 unicast is enabled.

VMware vSAN unicast
Image via VMware

Gaining insight, awareness, adding intelligence to avoid flying blind, introducing vSAN Cloud Analytics and Proactive Guidance. Part of a VMware customer, experience improvement program, leverages cloud-based health checks for easy online known issue detection along with relevant knowledge bases pieces as well as other support notices. Whether you choose to refer to this feature as advanced analytics, artificial intelligence (AI), proactive rules enabled management problem isolation, solving resolution I will leave that up to you.

VMware vSAN cloud analytics
Image via VMware

Part of the new tools analytics capabilities and prescriptive problem resolution (hmm, some might call that AI or advanced analytics, just saying), health check issues are identified, notifications along with suggested remediation. Another feature is the ability to leverage continuous proactive updates for advance remediation vs. waiting for subsequent vSAN releases. Net result and benefit are reducing time, the complexity of troubleshooting converged data infrastructure issues spanning servers, storage, I/O networking, hardware, software, cloud, and configuration. In other words, enable you more time to be productive vs. finding and fixing problems leveraging informed awareness for smart decision-making.

Where to Learn More

The following are additional resources to find out more about vSAN and related technologies.

What this all means

Continue reading more about VMware vSAN 6.6 in part I here, part II (just the speeds feeds please) located here, part IV (scaling ROBO and data centers today) found here, as well as part V here (VMware vSAN evolution, where to learn more and summary).

Ok, nuff said (for now…).

Cheers
Gs

Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert (and vSAN). Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Watch for the spring 2017 release of his new book “Software-Defined Data Infrastructure Essentials” (CRC Press).

Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2023 Server StorageIO(R) and UnlimitedIO. All Rights Reserved.

VMware vSAN V6.6 Part IV (HCI scaling ROBO and data centers today)

server storage I/O trends

VMware vSAN V6.6 Part IV (HCI scaling ROBO and data centers today)

In case you missed it, VMware announced vSAN v6.6 hyper-converged infrastructure (HCI) software defined data infrastructure solution. This is the fourth of a five-part series about VMware vSAN V6.6. View Part I here, Part II (just the speeds feeds please) is located here, part III (reducing cost and complexity) located here, as well as part V here (VMware vSAN evolution, where to learn more and summary).

VMware vSAN 6.6
Image via VMware

For those who are not aware, vSAN is a VMware virtual Storage Area Network (e.g. vSAN) that is software-defined, part of being a software-defined data infrastructure (SDDI) and software-defined data center (SDDC). Besides being software-defined vSAN is HCI combining compute (server), I/O networking, storage (space and I/O) along with hypervisors, management, and other tools.

Scaling HCI for ROBO and data centers today and for tomorrow

Scaling with stability for today and tomorrow. This includes addressing your applications Performance, Availability, Capacity and Economics (PACE) workload requirements today and for the future. By scaling with stability means boosting performance, availability (data protection, security, resiliency, durable, FTT), effective capacity without one of those attributes compromising another.

VMware vSAN data center scaling
Image via VMware

Scaling today for tomorrow also means adapting to today’s needs while also flexible to evolve with new application workloads, hardware as well as a cloud (public, private, hybrid, inter and intra-cloud). As part of continued performance improvements, enhancements to optimize for higher performance flash SSD including NVMe based devices.

VMware vSAN cloud analytics
Image via VMware

Part of scaling with stability means enhancing performance (as well as productivity) or the effectiveness of a solution. Keep in mind that efficiency is often associated with storage (or server or network) space capacity savings or reductions. In that context then effectiveness means performance and productivity or how much work can be done with least overhead impact. With vSAN, V6.6 performance enhancements include reduced checksum overhead, enhanced compression, and deduplication, along with destaging optimizations.

Other enhancements that help collectively contribute to vSAN performance improvements include VMware object handling (not to be confused with cloud or object storage S3 or Swift objects) as well as faster iSCSI for vSAN. Also improved are more accurate refined cache sizing guidelines. Keep in mind that a little bit of NAND flash SSD or SCM in the right place can have a significant benefit, while a lot of flash cache costs much cash.

Part of enabling and leveraging new technology today includes support for larger capacity 1.6TB flash SSD drives for cache, as well as lower read latency with 3D XPoint and NVMe drives such as those from Intel among others. Refer to the VMware vSAN HCL for current supported devices which continue evolve along with the partner ecosystem. Future proofing is also enabled where you can grow from today to tomorrow as new storage class memories (SCM) among other flash SSD as well as NVMe enhanced storage among other technologies are introduced into the market as well as VMware vSAN HCL.

VMware vSAN and data center class applications
Image via VMware

Traditional CI and in particular many HCI solutions have been optimized or focused on smaller application workloads including VDI resulting in the perception that HCI, in general, is only for smaller environments, or larger environment non-mission critical workloads. With vSAN V6.6 VMware is addressing and enabling larger environment mission critical applications including Intersystem Cache medical health management software among others. Other application workload extensions including support for higher performance demanding Hadoop big data analytics, a well as extending virtual desktop infrastructure (VDI) workspace with XenDesktop/XenApp, along with Photon 1.1 container support.

What about VMware vSAN 6.6. Packaging and License Options

As part of vSAN 6.6 VMware several solution bundle packaged options for the data center as well as smaller ROBO environment. Contact your VMware representative or partner to learn more about specific details.

VMware vSAN cloud analytics
Image via VMware

VMware vSAN cloud analytics
Image via VMware

Where to Learn More

The following are additional resources to find out more about vSAN and related technologies.

What this all means

Continue reading more about VMware vSAN 6.6 in part I here, part II (just the speeds feeds please) is located here, part III (reducing cost and complexity) located here as well as part V here (VMware vSAN evolution, where to learn more and summary).

Ok, nuff said (for now…).

Cheers
Gs

Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert (and vSAN). Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Watch for the Spring 2017 release of his new book “Software-Defined Data Infrastructure Essentials” (CRC Press).

Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2023 Server StorageIO(R) and UnlimitedIO. All Rights Reserved.

VMware vSAN V6.6 Part V (vSAN evolution and summary)

server storage I/O trends

VMware vSAN V6.6 Part V (vSAN evolution and summary)

In case you missed it, VMware announced vSAN v6.6 hyper-converged infrastructure (HCI) software defined data infrastructure solution. This is the fifth of a five-part series about VMware vSAN V6.6. View Part I here, Part II (just the speeds feeds please) is located here, part III (reducing cost and complexity) found here, part IV (scaling ROBO and data centers today) located here.

VMware vSAN 6.6
Image via VMware

For those who are not aware, vSAN is a VMware virtual Storage Area Network (e.g. vSAN) that is software-defined, part of being a software-defined data infrastructure (SDDI) and software-defined data center (SDDC). Besides being software-defined vSAN is HCI combining compute (server), I/O networking, storage (space and I/O) along with hypervisors, management, and other tools.

How has vSAN (formerly referred to as VSAN) Evolved

A quick recap of the VMware vSAN progression which first appeared as part of vSphere 5.5. (e.g. vSAN 5.5 can be thought of 1.0 in some ways) consists of several releases. Since vSAN is tightly integrated with VMware vSphere along with associated management tools, there is a correlation between enhancements to the underlying hypervisor, and added vSAN functionality. Keep in mind sometimes by seeing where something has been, helps to view where going.

Previous vSAN enhancements include:

  • 5.5 Hybrid (mixed HDD and flash)
  • 6.2 (2016) All flash (e.g. AFA) versions included data footprint reduction (DFR) technologies such as compression and dedupe along with performance Quality of Service (QoS) enhancements.
  • 6.5 Cross Cloud functionality including the announcement of container support, cloud-native apps, as well as upcoming vSphere, vSAN, NSX and other VMware software-defined data center (SDDC) and software-defined data infrastructure (SDDI) technology running natively on AWS (not on EC2) cloud infrastructure.
  • 6.6 Modern data infrastructure flexibility, scalability, resiliency, extensibility including performance, availability, capacity and economics (PACE).

V5.5

  • Distributed RAID
  • Per-VM SPBM
  • Set and change FTT via policy
  • In-kernel hyper-convergence engine
  • RVC and Observer

V6.0

  • All-flash architecture
  • Perf improvements (4xIOPS)
  • 64-node support
  • High-density storage blades
  • Fault domain awareness
  • Scalable snapshots and clones
  • Disk enclosure management

V6.1

  • Windows Failover Clustering
  • Oracle RAC support
  • HW checksum and encryption
  • 2-node ROBO mode
  • UltraDIMM and NVMe support
  • Stretch clusters
  • 5 min RPO (vSphere Rep)
  • SMP-FT support
  • Health Check, vROps, Log Insight

V6.2

  • IPv6 support
  • Software checksum
  • Nearline dedupe and compression on all-flash
  • Erasure coding on all-flash
  • QoS IOPS limits
  • Performance monitoring service

V6.5

  • iSCSI
  • 2-Node direct connect
  • PowerCLI
  • Public APIs and SDK
  • 512e support
  • All-Flash to all editions

Where to Learn More

The following are additional resources to find out more about vSAN and related technologies.

What this all means, wrap up and summary

VMware continues to extend the software-defined data center (SDDC) and Software-Defined Data Infrastructure (SDDI) ecosystem with vSAN to address the needs from smaller SMB and ROBO environments to larger SME and enterprise workloads. To me a theme with V6.6 is expanding resiliency, scalability with stability to expand vSAN upmarket as well as into new workloads similar to how vSphere has evolved.

With each new release, vSAN is increasing its feature, functionality, resiliency and extensiveness associated with traditional storage and non-CI or HCI solutions. Overall a good set of enhancements as vSAN continues its evolution looking back just a few years ago, to where it is today and will be in the future. If you have not looked at vSAN recently, take some time beyond reading this piece to learn some more.

Ok, nuff said (for now…).

Cheers
Gs

Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert (and vSAN). Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Watch for the Spring 2017 release of his new book “Software-Defined Data Infrastructure Essentials” (CRC Press).

Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2023 Server StorageIO(R) and UnlimitedIO. All Rights Reserved.

March 2017 Server StorageIO Data Infrastructure Update Newsletter

Volume 17, Issue III

Hello and welcome to the March 2017 issue of the Server StorageIO update newsletter.

First a reminder world backup (and recovery) day is on March 31. Following up from the February Server StorageIO update newsletter that had a focus on data protection this edition includes some additional posts, articles, tips and commentary below.

Other data infrastructure (and tradecraft) topics in this edition include cloud, virtual, server, storage and I/O including NVMe as well as networks. Industry trends include new technology and services announcements, cloud services, HPE buying Nimble among other activity. Check out the Converged Infrastructure (CI), Hyper-Converged (HCI) and Cluster in Box (or Cloud in Box) coverage including a recent SNIA webinar I was invited to be the guest presenter for, along with companion post below.

In This Issue

Enjoy this edition of the Server StorageIO update newsletter.

Cheers GS

Data Infrastructure and IT Industry Activity Trends

Some recent Industry Activities, Trends, News and Announcements include:

Dell EMC has discontinued the NVMe direct attached shared DSSD D5 all flash array has been discontinued. At about the same time Dell EMC is shutting down the DSSD D5 product, it has also signaled they will leverage the various technologies including NVMe across their broad server storage portfolio in different ways moving forward. While Dell EMC is shutting down DSSD D5, they are also bringing additional NVMe solutions to the market including those they have been shipping for years (e.g. on the server-side). Learn more about DSSD D5 here and here including perspectives of how it could have been used (plays for playbooks).

Meanwhile NVMe industry activity continues to expand with different solutions from startups such as E8, Excelero, Everspin, Intel, Mellanox, Micron, Samsung and WD SANdisk among others. Also keep in mind, if the answer is NVMe, then what were and are the questions to ask, as well as what are some easy to use benchmark scripts (using fio, diskspd, vdbench, iometer).

Speaking of NVMe, flash and SSDs, Amazon Web Services (AWS) have added new Elastic Cloud Compute (EC2) storage and I/O optimized i3 instances. These new instances are available in various configurations with different amounts of vCPU (cores or logical processors), memory and NVMe SSD capacities (and quantity) along with price.

Note that the price per i3 instance varies not only by its configuration, also for image and region deployed in. The flash SSD capacities range from an entry-level (i3.large) with 2 vCPU (logical processors), 15.25GB of RAM and a single 475GB NVMe SSD that for example in the US East Region was recently priced at $0.156 per hour. At the high-end there is the i3.16xlarge with 64 vCPU (logical processors), 488GB RAM and 8 x 1900GB NVMe SSDs with a recent US East Region price of $4.992 per hour. Note that the vCPU refers to the available number of logical processors available and not necessarily cores or sockets.

Also note that your performance will vary, and while NVMe protocol tends to use less CPU per I/O, if generating a large number of I/Os you will need some CPU. What this means is that if you find your performance limited compared to expectations with the lower end i3 instances, move up to a larger instance and see what happens. If you have a Windows-based environment, you can use a tool such as Diskspd to see what happens with I/O performance as you decrease the number of CPUs used.

Chelsio has announced they are now Microsoft Azure Stack Certified with their iWARP RDMA host adapter solutions, as well as for converged infrastructure (CI), hyper-converged (HCI) and legacy server storage deployments. As part of the announcement, Chelsio is also offering a 30 day no cost trial of their adapters for Microsoft Azure Stack, Windows Server 2016 and Windows 10 client environments. Learn more about the Chelsio trial offer here.

Everspin (the MRAM Spintorque, persistent RAM folks) have announced a new Storage Class Memory (SCM) NVMe accessible family (nvNITRO) of storage accelerator devices (PCIe AiC, U.2). Whats interesting about Everspin is that they are using NVMe for accessing their persistent RAM (e.g. MRAM) making it easily plug compatible with existing operating systems or hypervisors. This means using standard out of the box NVMe drivers where the Everspin SCM appears as a block device (for compatibility) functioning as a low latency, high performance persistent write cache.

Something else interesting besides making the new memory compatible with existing servers CPU complex via PCIe, is how Everspin is demonstrating that NVMe as a general access protocol is not just exclusive to nand flash-based SSDs. What this means is that instead of using non-persistent DRAM, or slower NAND flash (or 3D XPoint SCM), Everspin nvNITRO enables high endurance write cache with persistent to compliment existing NAND flash as well as emerging 3D XPoint based storage. Keep an eye on Everspin as they are doing some interesting things for future discussions.

Google Cloud Services has added additional regions (cloud locations) and other enhancements.

HPE continued buying into server storage I/O data infrastructure technologies announcing an all cash (e.g. no stock) acquisition of Nimble Storage (NMBL). The cash acquisition for a little over $1B USD amounts to $12.50 USD per Nimble share, double what it had traded at. As a refresh, or overview, Nimble is an all flash shared storage system leverage NAND flash solid storage device (SSD) performance. Note that Nimble also partners with Cisco and Lenovo platforms that compete with HPE servers for converged systems.View additional perspectives here.

Riverbed has announced the release of Steelfusion 5 which while its name implies physical hardware metal, the solution is available as tin wrapped (e.g. hardware appliance) software. However the solution is also available for deployment as a VMware virtual appliance for remote office branch office (ROBO) among others. Enhancements include converged functionality such as NAS support along with network latency as well as bandwidth among other features.

Check out other industry news, comments, trends perspectives here.

Server StorageIOblog Posts

Recent and popular Server StorageIOblog posts include:

View other recent as well as past StorageIOblog posts here

Server StorageIO Commentary in the news

Recent Server StorageIO industry trends perspectives commentary in the news.

Via InfoStor: 8 Big Enterprise SSD Trends to Expect in 2017
Watch for increased capacities at lower cost, differentiation awareness of high-capacity, low-cost and lower performing SSDs versus improved durability and performance along with cost capacity enhancements for active SSD (read and write optimized). You can also expect increased support for NVMe both as a back-end storage device with different form factors (e.g., M.2 gum sticks, U.2 8639 drives, PCIe cards) as well as front-end (e.g., storage systems that are NVMe-attached) including local direct-attached and fiber-attached. This means more awareness around NVMe both as front-end and back-end deployment options.

Via SearchITOperations: Storage performance bottlenecks
Sometimes it takes more than an aspirin to cure a headache. There may be a bottleneck somewhere else, in hardware, software, storage system architecture or something else.

Via SearchDNS: Parsing through the software-defined storage hype
Beyond scalability, SDS technology aims for freedom from the limits of proprietary hardware.

Via InfoStor: Data Storage Industry Braces for AI and Machine Learning
AI could also lead to untapped hidden or unknown value in existing data that has no or little perceived value

Via SearchDataCenter: New options to evolve data backup recovery

View more Server, Storage and I/O trends and perspectives comments here

Various Tips, Tools, Technology and Tradecraft Topics

Recent Data Infrastructure Tradecraft Articles, Tips, Tools, Tricks and related topics.

Via ComputerWeekly: Time to restore from backup: Do you know where your data is?
Via IDG/NetworkWorld: Ensure your data infrastructure remains available and resilient
Via IDG/NetworkWorld: Whats a data infrastructure?

Check out Scott Lowe @Scott_Lowe of VMware fame who while having a virtual networking focus has a nice roundup of related data infrastructure topics cloud, open source among others.

Want to take a break from reading or listening to tech talk, check out some of the fun videos including aerial drone (and some technology topics) at www.storageio.tv.

View more tips and articles here

Events and Activities

Recent and upcoming event activities.

May 8-10, 2017 – Dell EMCworld – Las Vegas

April 3-7, 2017 – Seminars – Dutch workshop seminar series – Nijkerk Netherlands

March 15, 2017 – Webinar – SNIA/BrightTalkHyperConverged and Storage – 10AM PT

January 26 2017 – Seminar – Presenting at Wipro SDx Summit London UK

See more webinars and activities on the Server StorageIO Events page here.


Cheers
Gs

Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert (and vSAN). Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier) and twitter @storageio. Watch for the spring 2017 release of his new book Software-Defined Data Infrastructure Essentials(CRC Press).

Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2023 Server StorageIO(R) and UnlimitedIO. All Rights Reserved.

Backup, Big data, Big Data Protection, CMG & More with Tom Becchetti Podcast

server storage I/O trends

In this Server StorageIO podcast episode, I am joined by Tom Becchetti (@tbecchetti) for a Friday afternoon conversation recorded live at Meisters in Scandia Minnesota (thanks to the Meisters crew!).

Tom Becchetti

For those of you who may not know Tom, he has been in the IT, data center, data infrastructure, server and storage (as well as data protection) industry for many years (ok decades) as a customer and vendor in various roles. Not surprising our data infrastructure discussion involves server, software, storage, big data, backup, data protection, big data protection, CMG (Computer Measurement Group @mspcmg), copy data management, cloud, containers, fundamental tradecraft skills among other related topics.

Check out Tom on twitter @tbecchetti and @mspcmg as well as his new website www.storagegodfather.com. Listen to the podcast discussion here (42 minutes) as well as on iTunes.

Also available on 

Ok, nuff said for now…

Cheers
Gs

Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert (and vSAN). Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier) and twitter @storageio. Watch for the spring 2017 release of his new book Software-Defined Data Infrastructure Essentials (CRC Press).

Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2023 Server StorageIO(R) and UnlimitedIO. All Rights Reserved.

>

HPE Continues Buying Into Server Storage I/O Data Infrastructures

Storage I/O Data Infrastructures trends
Updated 1/16/2018

HPE expanded its Storage I/O Data Infrastructures portfolio buying into server storage I/O data infrastructure technologies announcing an all cash (e.g. no stock) acquisition of Nimble Storage (NMBL). The cash acquisition for a little over $1B USD amounts to $12.50 USD per Nimble share, double what it had traded at. As a refresh, or overview, Nimble is an all flash shared storage system leverage NAND flash solid storage device (SSD) performance. Note that Nimble also partners with Cisco and Lenovo platforms that compete with HPE servers for converged systems.

Earlier this year (keep in mind its only mid-March) HPE also announced acquisition of server storage Hyper-Converged Infrastructure (HCI) vendor Simplivity (about $650M USD cash). In another investment this year HPE joined other investors as part of scale out and software defined storage startups Hedvig latest funding round (more on that later). These acquisitions are in addition to smaller ones such as last years buying of SGI, not to mention various divestitures.

Data Infrastructures

What Are Server Storage I/O Data Infrastructures Resources

Data Infrastructures exists to support business, cloud and information technology (IT) among other applications that transform data into information or services. The fundamental role of data infrastructures is to give a platform environment for applications and data that is resilient, flexible, scalable, agile, efficient as well as cost-effective.

Technologies that make up data infrastructures include hardware, software, cloud or managed services, servers, storage, I/O and networking along with people, processes, policies along with various tools spanning legacy, software-defined virtual, containers and cloud.

HPE and Server Storage Acquisitions

HPE and its predecessor HP (e.g. before the split that resulted in HPE) was familiar with expanding its data infrastructure portfolio spanning servers, storage, I/O networking, hardware, software and services. These range from Compaq who acquired DEC which gave them the StorageWorks brand and product line up (e.g. recall EVA and its predecessors), Lefthand, 3PAR, IBRIX, Polyserve, Autonomy, EDS and others that I’m guessing some at HPE (along with customers and partners) might not want to remember.

In addition to their own in-house including via technology acquisition, HPE also partners for its entry-level and volume low-end MSA (Modular Storage Array) series with DotHill who was acquired by Seagate a year or so ago. In addition to the MSA, other HPE OEMs for storage include Hitachi Ltd. (e.g. parent of Hitachi Data Systems aka HDS) reselling their high-end enterprise class storage system as the XP7, as well as various other partner arrangements.

Keep in mind that HPE has a large server business from low to high-end, spanning towers to dense blades to dual, quad and cluster in box (CiB) configurations with various processor architectures. Some of these servers are used as platforms for not only HPE, also other vendors software defined storage, as well as tin wrapped software solutions, appliances and systems. HPE is also one of a handful of partners working with Microsoft to bring the software defined private (and hybrid) Azure Stack cloud stack as an appliance to market.

HPE acquisitions Dejavu or Something New?

For some people there may be a sense of Dejavu of what HPE and its predecessors have previously acquired, developed, sold and supported into the market over years (and decades in some cases). What will be interesting to see is how the 3PAR (StoreServ) and Lefthand based (StoreVirtual) as well as ConvergedSystem 250-HC product lines are realigned to make way for Nimble and Simplivity.

Likewise what will HPE do with MSA at the low-end, continue to leverage it for low-end and high-volume basic storage similar to Dell with the Netapp/Engenio powered MD series? Or will HPE try to move the Nimble down market and displace the MDS? What about in the mid-market, will Nimble be unleashed to replace StoreVirtual (e.g. Lefthand), or will they fence it in (e.g. being restricted to certain scenarios?
Will the Nimble solution be allowed to move up market into the low-end of where 3PAR has been positioned, perhaps even higher up given its all flash capabilities. Or, will there be a 3PAR everywhere approach?

Then there is Simplivity as the solution is effectively software running on an HPE server (or with other partners Cisco and Lenovo) along with a PCIe offload card (with Simplivity data services acceleration). Note that Simplivity leverages PCIe offload cards for some of their functionality, this too is familiar ground for HPE given its ASIC use by 3PAR.

Simplivity has the potential to disrupt some low to mid-range, perhaps even larger opportunities that are looking to go to a converged infrastructure (CI) or HCI deployment as part of their data infrastructure needs. One can speculate that Simplivity after repackaging will be positioned along current HPE CI and HCI solutions.

This will be interesting to watch to see if the HPE server and storage groups can converge not only from a technology point, also sales, marketing, service, and support perspective. With the Simplivity solution, HPE has an opportunity to move the industry thinking or perception that HCI is only for small environments defined by what some products can do.

What I mean by this is that HPE with its enterprise and SMB along with SME and cloud managed service provider experience as well as servers can bring hyper-scale out (and up) converged to the market. In other words, start addressing the concern I hear from larger organizations that most CI or HCI solutions (or packaging) are just for smaller environments. HPE has the servers, they have the storage from MSAs to other modules and core data infrastructure building blocks along with the robustness of the Simplivity software to enable hyper-scale out CI.

What about bulk, object, scale-out storage

HPE has a robust tape business, yes I know tape is dead, however tell that to the customers who keep buying products providing revenue along with margin to HPE (and others). Likewise HPE has VTLs as well as other solutions for addressing bulk data (e.g. big data, backups, protection copies, archives, high volume, and large quantity, what goes on tape or object). For example HPE has the StoreOnce solution.

However where is the HPE object storage story?

Otoh, does HPE its own object storage software, simply partner with others? HPE can continue to provide servers along with underlying storage for other vendors bulk, cloud and object storage systems, and where needed, meet in the channel among other arrangements.

On the other hand, this is where similar to Polyserve and Ibrix among others in the past have come into play, with HPE via its pathfinder (investment group) joining others in putting some money into Hedvig. HPE gets access to Hedvig for their scale out storage that can be used for bulk as well as other deployments including CI, HCI and CIB (e.g. something to sell HPE servers and storage with).

HPE can continue to partner with other software providers and software-defined storage stacks. Keep in mind that Milan Shetti (CTO, Data Center Infrastructure Group HPE) is no stranger to these waters given his past at Ibrix among others.

What About Hedvig

Time to get back to Hedvig which is a storage startup whose software can run on various server storage platforms, as well as in different topologies. Different topologies include in a CI or HCI, Cloud, as well as scale out with various access including block, file and object. In addition to block, file and object access, Hedvig has interesting management tools, data services, along with support for VMware, Docker, and OpenStack among others.

Recently Hedvig landed another $21.5M USD in funding bringing their total to about $52M USD. HPE via its investment arm, joins other investors (note HPE was part of the $21.5M, that was not the amount they invested) including Vertex, Atlantic Bridge, Redpoint, edbi and true ventures.

What does this mean for HPE and Hedvig among others? Tough to say however easy to imagine how Hedvig could be leveraged as a partner using HPE servers, as well as for HPE to have an addition to their bulk, scale-out, cloud and object storage portfolio.

Where to Learn More

View more material on HPE, data infrastructure and related topics with the following links.

  • Cloud and Object storage are in your future, what are some questions?
  • PCIe Server Storage I/O Network Fundamentals
  • If NVMe is the answer, what are the questions?
  • Fixing the Microsoft Windows 10 1709 post upgrade restart loop
  • Data Infrastructure server storage I/O network Recommended Reading
  • Introducing Windows Subsystem for Linux WSL Overview
  • IT transformation Serverless Life Beyond DevOps with New York Times CTO Nick Rockwell Podcast
  • HPE Announces AMD Powered Gen 10 ProLiant DL385 For Software Defined Workloads
  • AWS Announces New S3 Cloud Storage Security Encryption Features
  • NVM Non Volatile Memory Express NVMe Place
  • Data Infrastructure Primer and Overview (Its Whats Inside The Data Center)
  • January 2017 Server StorageIO Update Newsletter
  • September and October 2016 Server StorageIO Update Newsletter
  • HP Buys one of the seven networking dwarfs and gets a bargain
  • Did HP respond to EMC and Cisco VCE with Microsoft Hyper-V bundle?
  • Give HP storage some love and short strokin
  • While HP and Dell make counter bids, exclusive interview with 3PAR CEO David Scott
  • Data Protection Fundamental Topics Tools Techniques Technologies Tips
  • Hewlett-Packard beats Dell, pays $2.35 billion for 3PAR
  • HP Moonshot 1500 software defined capable compute servers
  • What Does Converged (CI) and Hyper converged (HCI) Mean to Storage I/O?
  • What’s a data infrastructure?
  • Ensure your data infrastructure remains available and resilient
  • Object Storage Center, The SSD place and The NVMe place
  • Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What this all means

    Generally speaking I think this is a good series of moves for HPE (and their customers) as long as they can execute in all dimensions.

    Let’s see how they execute, and by this, I mean more than simply executing or terminating staff from recently acquired or earlier acquisitions. How will HPE craft go to the market message that leverages the portfolio to compete and hold or take share from other vendors, vs. cannibalize across its own lines (e.g. revenue prevention)? With that strategy and message, how will HPE assure existing customers will be taken care, be given a definite upgrade and migration path vs. giving them a reason to go elsewhere.

    Hopefully HPE unleashes the full potential of Simplivity and Nimble along with 3PAR, XP7 where needed, along with MSA at low-end (or as part of volume scale-out with servers for software defined), to mention sever portfolio. For now, this tells me that HPE is still interested in maintaining, expanding their data infrastructure business vs. simply retrenching selling off assets. Thus this looks like HPE is interested in continuing to invest in data infrastructure technologies including buying into server, storage I/O network, hardware, software solutions, while not simply clinging to what they already have, or previously bought.

    Everything is not the same in data centers and across data infrastructure, so why have a one size fits all approach for organization as large, diverse as HPE.

    Congratulations and best wishes to the folks at Hedvig, Nimble, Simplivity.

    Now, lets see how this all plays out.

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Software Defined, Bulk, Cloud, Scale Out, Object Storage Fundamentals

    Cloud, Bulk, Scale-Out, Object Storage Fundamentals

    data infrastructure sddc object storage fundamentals

    Updated 1/21/2018

    Welcome to the Cloud, Big Data, Software Defined, scale-out, Bulk and Object Storage Fundamentals page.

    This page contains various resources, tips, essential topics pertaining to Software Defined, scale-out, Cloud, Bulk and Object Storage Fundamentals. Other resources pertaining to Software Defined, scale-out, Cloud, Bulk and Object Storage include:

  • www.objectstoragecenter.com
  • Software Defined Data Infrastructure Essentials book (CRC Press)
  • Cloud, Software Defined, Scale-Out, Object Storage News Trends
  • There are various types of cloud, bulk and object storage including public services such as Amazon Web Services (AWS) Simple Storage Service (S3), Google, Microsoft Microsoft Azure, IBM Softlayer, Rackspace among many others. There are also solutions for hybrid and private deployment from Cisco, Cloudian, Fujifilm, DDN, Dell EMC, Fujitsu, HDS, HPE, IBM, NetApp, Noobaa, OpenStack, Quantum, Rackspace, Scality, Seagate, Spectra, Storpool, Suse, Swift and WD among others.

    Cloud products and services among others, along with associated data infrastructures including object storage, file systems, repositories and access methods are at the center of bulk, big data, big bandwidth and little data initiatives on a public, private, hybrid and community basis. After all, not everything is the same in cloud, virtual and traditional data centers or information factories from active data to in-active deep digital archiving.

    Cloud Object Storage Fundamentals Access and Architectures

    There are many facets to object storage including technology implementation, products, services, access and architectures for various applications and use scenarios.

    • Project or Account – Top of the hierarchy that can represent the owner or billing information for a service that where buckets are also attached.
    • Region – Location where data is stored that can include one or more data centers also known as Availability Zones.
    • AWS S3 Cross region replication
      Moving and Replicating Buckets/Containers, Subfolders and Objects

    • Availability Zone (AZ) or data center or server that implement durability and accessibility for availability within a region.
    • AWS Regions and Availability Zones AZs
      Example of Regions and Availability Zones (AZs)

    • Bucket or Container – Where objects or sub-folders containing objects are attached and accessed.
    • Object storage fundamentals sddc and cloud software defined

    • Sub-folder – While object storage can be located in a flat namespace for commonality and organization some solutions and service support the notion of sub-folder that resemble traditional directory hierarchy.
    • Object – Byte (or bit) stream that can be as small as one byte to as large as several Tbytes (some solutions and services support up to 5TByte sized objects). The object contains whatever data in any organization along with metadata. Different solutions and services support from a couple hundred KBytes of meta-data to Mbytes worth of meta-data. Regarding what can be stored in an object, anything from files, videos, images, virtual disks (VMDKs, VHDX), ZIP or tar files, backup and archive save sets, executable images or ISO’s, anything you want.
    • End-point – Where or what your software, application or tool and utilities along with gateways attach to for accessing buckets and objects.
    • object storage fundamentals, sddc and cloud storage example

      A common theme for object storage is flexibility, along with scaling (performance, availability, capacity, economics) along with extensibility without compromise or complexity. From those basics, there are many themes and variations from how data is protected (RAID or no RAID, hardware or software), deployed as a service or as tin wrapped software (an appliance), optimized for archiving or video serving or other applications.

      Many facets of cloud and object storage access

      One aspect of object and cloud storage is accessing or using object methods including application programming interfaces (API’s) vs. traditional block (LUN) or NAS (file) based approaches. Keep in mind that many object storage systems, software, and services support NAS file-based access including NFS, CIFS, HDFS  among others for compatibility and ease of use.

      Likewise various API’s can be found across different object solutions, software or services including Amazon Web Services (AWS) Simple Storage Service (S3) HTTP REST based, among others. Other API’s will vary by specific vendor or product however can include IOS (e.g. Apple iPhone and iPad), WebDav, FTP, JSON, XML, XAM, CDMI, SOAP, and DICOM among others. Another aspect of object and cloud storage are expanded  and dynamic metadata.

      While traditional file systems and NAS have simple or fixed metadata, object and cloud storage systems, services and solutions along with some scale-out file systems have ability to support user defined metadata. Specific systems, solutions, software, and services will vary on the amount of metadata that could range on the low-end from 100s of KBytes  to tens or more Mbytes.

      cloud object storage

      Where to learn more

      The following resources provide additional information about big data, bulk, software defined, cloud and object storage.

      Click here to view software defined, bulk, cloud and object storage trend news.


      StorageIO Founder Greg Schulz: File Services on Object Storage with HyperFile

      Via InfoStor: Object Storage Is In Your Future
      Via FujiFilm IT Summit: Software Defined Data Infrastructures (SDDI) and Hybrid Clouds
      Via StorageIOblog: AWS EFS Elastic File System (Cloud NAS) First Preview Look
      Via InfoStor: Cloud Storage Concerns, Considerations and Trends
      Via InfoStor: Object Storage Is In Your Future
      Via Server StorageIO: April 2015 Newsletter Focus on Cloud and Object storage
      Via StorageIOblog: AWS S3 Cross Region Replication storage enhancements
      Cloud conversations: AWS EBS, Glacier and S3 overview
      AWS (Amazon) storage gateway, first, second and third impressions
      Cloud and Virtual Data Storage Networking (CRC Book)
      Via ChannelPartnersOnline: Selling Software-Defined Storage: Not All File Systems Are the Same
      Via ITProPortal: IBM kills off its first cloud storage platform
      Via ITBusinessEdge: Time to Rein in Cloud Storage
      Via SerchCloudStorge: Ctera Networks’ file-sharing services gain intelligent cache
      Via StorageIOblog: Who Will Be At Top Of Storage World Next Decade?

      Videos and podcasts at storageio.tv also available via Applie iTunes.

      Human Face of Big Data
      Human Face of Big Data (Book review)

      Seven Databases in Seven weeks
      Seven Databases in Seven Weeks (Book review)

      Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

      Software Defined Data Infrastructure Essentials Book SDDC

      Wrap up and summary

      Object and cloud storage are in your future, the questions are when, where, with what and how among others.

      Watch for more content and links to be added here soon to this object storage center page including posts, presentations, pod casts, polls, perspectives along with services and product solutions profiles.

      Ok, nuff said, for now.

      Gs

      Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

      All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Kevin Closson discusses SLOB Server CPU I/O Database Performance benchmarks

    Slilly Little Oracle Benchmark (SLOB) Database Server I/O Podcast

    server storage I/O trends

    In this Server StorageIO podcast episode, I am joined by @Kevinclosson who is an Oracle (along with other Databases) performance expert and creator of the Silly Little Oracle Benchmark (SLOB) tool. Not surprising our data infrastructure discussion involves server CPU, software, I/O, storage, performance, software, tools, best practices, fundamental tradecraft skills among other items.

    server storage I/O performance

    Kevin has been involved in database performance (and porting) optimization for decades which means CPU server, memory, I/O and storage issues, resources and tuning. Part of server, storage I/O a tuning is understanding the workloads, also the demands of software such as databases along with how they use CPU and its impact on resources. This means that somewhere in the technology stack, server CPUs are still needed, even in serverless environments.

    We also discuss metrics, gaining insight to resources uses, what they mean including how CPU wait may be costing your lost productivity with overhead, as well as benchmarks, simulations, and related themes. Check out Kevins website www.kevinclosson.net to learn more about Oracle, Databases, SLOB, tools and other content. Listen to the podcast discussion here (42 minutes) as well as on iTunes.

    Where to learn more

    Learn more about Oracle, Database Performance, Benchmarking along with other tools via the following links:

    What this all means and wrap-up

    Check out my discussion here with Kevin Closson where you may have some Dejavu, or learn something new on server, storage I/O, database performance, software, benchmark workloads as well as much more. Also available on 

    Ok, nuff said for now…

    Cheers
    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert (and vSAN). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2023 Server StorageIO(R) and UnlimitedIO All Rights Reserved

    February 2017 Server StorageIO Update Newsletter

    Server and StorageIO Update Newsletter

    Volume 17, Issue II

    Hello and welcome to the February 2017 issue of the Server StorageIO update newsletter.

    With world backup (and recovery) day coming up on March 31, it makes sense to plan, review, assess, remediate, test and prepare in advance, to avoid or prevent a disaster later. Some of the themes in this months newsletter thus have a data protection angle which includes availability, resiliency, security, and backup/restore along with associated topics. Keep in mind that there are many aspects to data protection, along with various tools, technologies, techniques along with tradecraft skills (experience).

    Speaking of tradecraft, the tips section has been expanded with more content to help refresh, or expand your fundamental data infrastructure skills and experiences. Watch for more about trade craft in future newsletters as well as elsewhere.

    Speaking of data protection, if you had not heard or forgot, some recent events included the Australian Tax Office (ATO) whose resiliency solution appears to not have been configured for, well, availability, resiliency along with durability. You can read more about the ATO, lessons learned as well as fall out doing a Google search such as "australian tax office disaster". Another recent disaster or disruption was Gitlab (not to be confused with Github) that lost around 300GB of data. Google something like "gitlab disaster" to see more.
    In the case of Gitlab, it seems that a DevOp admin accidentally did something like a rm -rf (e.g. recursive and force) that if you know what that means, you know it might not be good.

    As is the case with many disasters or near disasters and disruptions, they are usually the result of a chain of events, thus the mantra or isolate, contain faults to prevent snowballing into something worse. What’s concerning about Gitlab is that there are decades of lessons to be learned, known and preventable.

    Hopefully Gitlabs experiences will prompt others in or moving to so-called platform 3 or new DevOps environment to use things in new ways, as well as prevent old problems using known tradecraft skills, lessons, experiences.
    Also keep in mind that while technology can and will fail, hardware and software including clouds are defined by people, and when people are involved, human error is also present.

    In This Issue

  • Server StorageIO News Commentary
  • Trade craft Articles, Tips & Tricks Topics
  • Server StorageIOblog posts
  • Various Events and Webinars
  • IT Industry Activity Trends
  • Industry Resources and Links
  • Connect and Converse With Us
  • About Us
  • Enjoy this edition of the Server StorageIO update newsletter.

    Cheers GS

    Data Infrastructure and IT Industry Activity Trends

    Some recent Industry Activities, Trends Announcements

    Cloud and object storage vendor Cloudian announced a new appliance (e.g. tin-wrapped software) that they claim give high density low (cloud service like) pricing.

    Check out iosafe who has a line of fire (and water) proof NAS and Windows Servers as part of availability data protection that can compliment clouds. For those of you who are also Synology fans (or users) take a look at what iosafe is doing for consumer, SOHO, ROBO, workgroup, SMB among other environments.

    Speaking of data protection, how are you going about wiping or digital bleaching your storage including nand flash SSDs? Particularly are you doing deep cleaning including those hard to reach persistent non-volatile memory (NVM) cell locations in SSDs? Check out what Blancco is doing for deep cleaning to wipe or digital bleach your storage including SSDs. Another aspect of data protection includes after your physical assets have been wiped clean (e.g. digital bleach), how will you safely dispose of the items? That’s where various vendors such as OceanTech among others come into play.

    Server StorageIOblog Posts

    Recent and popular Server StorageIOblog posts include:

    View other recent as well as past StorageIOblog posts here

    Server StorageIO Commentary in the news

    Recent Server StorageIO industry trends perspectives commentary in the news.

    Via SearchDataCenter: New options to evolve your data backup and recovery plan
    Via SmallBusinessComputing: Easy Storage for the Little Guy: Has the Time Come?
    Via InfoStor: 10 More Top Data Storage Applications
    Via Infostor: 10 Top Data Storage Applications

    View more Server, Storage and I/O trends and perspectives comments here

    Various Tips, Tools, Technology and Tradecraft Topics

    Recent Data Infrastructure Tradecraft Articles, Tips, Tools, Tricks and related topics.

    Via IDG/NetworkWorld:  Whats a data infrastructure?
    Via Computerweekly:  NVMe: What to use, PCIe card vs U.2 and M.2
    Via InfoStor:  Cloud Storage Concerns, Considerations and Trends
    Via InfoStor:  SSD Trends, Tips and Topics

    Check out Neil Anderson(@flackboxtv) flackbox.com site to view various video and tutorials about NetApp, Cisco along with VMware among others. Sharpen your data infrastructure server storage I/O tradecraft skills with the various labs and simulators that Neil has covered.

    Speaking of tradecraft skills and experience development, check out VMware Staff Architect William Lam (@lamw) virtuallyghetto.com site for a news software defined data center (SDDC) lab. This new lab focuses on automated deployment for vSphere 6.0u2 along with vSphere 6.5. In other related news, VMware has made generally available (GA) vSphere 6.0 Update 3 including enhancements to vSAN and vCenter. View more details here at Duncan Epping (@DuncanYB) of VMware Yellow Bricks site.

    If you are interested in Microsoft Azure, check out this piece on SQL Server failover clustering, along with other Windows Server, Hyper-V, Nano, Powershell and related topics here. Want to build a software defined data center (SDDC) or software-defined data infrastructure (SDDI) based on Microsoft Windows Server, Hyper-V and related technologies, check out this Github lab as well as this one for S2D among others.

    View more tips and articles here

    Events and Activities

    Recent and upcoming event activities.

    April 3-7, 2017 – Seminars – Dutch workshop seminar series – Nijkerk Netherlands

    March 15, 2017 – Webinar – SNIA/BrightTalkHyperConverged and Storage – 10AM PT

    January 26 2017 – Seminar – Presenting at Wipro SDx Summit London UK

    January 11, 2017 Webinar – Redmond Magazine
    Dell Software – Presenting – Tailor Your Backup Data Repositories to Fit Your Needs

    See more webinars and activities on the Server StorageIO Events page here.

    Server StorageIO Industry Resources and Links

    Useful links and pages:
    Microsoft TechNet – Various Microsoft related from Azure to Docker to Windows
    storageio.com/links – Various industry links (over 1,000 with more to be added soon)
    objectstoragecenter.com – Cloud and object storage topics, tips and news items
    OpenStack.org – Various OpenStack related items
    storageio.com/protect – Various data protection items and topics
    thenvmeplace.com – Focus on NVMe trends and technologies
    thessdplace.com – NVM and Solid State Disk topics, tips and techniques
    storageio.com/performance – Various server, storage and I/O benchmark and tools
    VMware Technical Network – Various VMware related items

    Ok, nuff said

    Cheers
    Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO LLC All Rights Reserved

    Data Infrastructure Server Storage I/O Tradecraft Trends

    Data Infrastructure Server Storage I/O Tradecraft Trends

    Updated 1/17/2018

    Data Infrastructure trends include server storage I/O network and associated tradecraft are your skills, experiences, insight as well as tricks of the trade, profession and job function (read more about what is a data infrastructure here).

    This is the second of a two-part series exploring data infrastructure along with serve storage I/O and related tradecraft. Read part one of this series here.

    Data Infrastructures
    Data Infrastructure and IT Infrastructure Layers

    As a refresher from part one, data infrastructure encompasses servers, storage, I/O and networking along with associated hardware, software, services and management tasks including data protection among others. Tradecraft is knowing about tools, technologies, and trends in your primary domain as well as adjacent focus areas. However, tradecraft is also about knowing how and when to use different technologies, tools with various techniques to address different scenarios.

    Tradecraft Trends
    Trends involving tradecraft include capturing existing experiences and skills from those who are about to retire or simply move on to something else, as well as learning for those new to IT or servers, storage, I/O, and data infrastructure hardware, software, and services. This means being able to find a balance of old and new tools, techniques, and technologies, including using things in new ways for different situations.

    Part of expanding your tradecraft skill set is knowing when to use different tools, techniques, and technologies from proprietary and closed to open solutions, from tightly integrated to loosely integrated, to bundled and converged, or to a la carte or unbundled components, with do-it-yourself (DIY) integration.

    Tradecraft also means being able to balance when to make a change of technology, tool, or technique for the sake of change vs. clinging to something comfortable or known, vs. leveraging old and new in new ways while enabling change without disrupting the data infrastructure environment or users of its services.

    A couple of other trends include the convergence of people and positions within organizations that may have been in different silos or focus areas in the past. One example is the rise of Development Operations (also known as DevOps), where instead of separate development, administration, and operations areas, they are a combined entity. This might be déja vu for some of you who grew up and gained your tradecraft in similar types of organizations decades ago; for others, it may be something new.

    Regarding fundamental tradecraft skills, if you are a hardware person it is wise to learn software; if you are a software person, it is advisable to acquire some hardware experience. Also, don’t be afraid to say “I do not know” or “it depends on on” when asked a question. This also means learning how information technology supports the needs of the business, as well as learning the technology the business uses.

    Put another way, in addition to learning server storage I/O hardware and software tradecraft, also learn the basic tradecraft of the business your information systems are supporting. After all, the fundamental role of IT is to protect, preserve, and serve information that enables the company or organization; no business exists just to support IT.

    Data Infrastructure Tool Box

    How to develop tradecraft?
    There are many ways, including reading this book along with the companion websites as well as other books, attending seminars and webinars, participating in forums and user groups, as well as having a test lab to learn and try things. Also, find a mentor you can learn from to help capture some of his or her tradecrafts, and if you are experienced, become a mentor to help others develop their tradecraft.

    Toolbox tips, reminders, and recommendations:

    • Create a virtual, software-defined, and physical toolbox.
    • Include tip sheets, notes, hints, tricks, and shortcuts.
    • Leverage books, blogs, websites, tutorials, and related information.
    • Implement a lab or sandbox to try things out
    • Do some proof of concepts (POC) and gain more experience

    Tradecraft Tips
    Get some hands-on, behind-the-wheel time with various technologies to gain insight, perspective, and appreciation of what others are doing, as well as what is needed to make informed decisions about other areas. This also means learning from looking at demos, trying out software, tools, services, or using other ways to understand the solution. Knowing about the tools and technology is important; however, so too is knowing how to use a tool (techniques) and when along with where or for what. This means knowing the tools in your toolbox, but also knowing when, where, why, and how to use a given tool (or technology), along with techniques to use that tool by itself or with multiple other tools.

    Additional tips and considerations include:

    • Expand your social and technical network into adjacent areas.
    • Get involved in user groups, forums, and other venues to learn and give back.
    • Listen, learn, and comprehend vs. only memorizing to pass a test.
    • Find a mentor to help guide you, and become a mentor to help others.
    • Collaborate, share, respect and be respected; the accolades will follow.
    • Evolve from focus on certificates or credentials to expansion of experiences.
    • Connect with others to expand your network

    Where to learn more

    Continue reading more and expanding your tradecraft experiences with the following among other resources:

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What this means

    Remember that tradecraft is skills, experiences, tricks, and techniques along with knowing what as well as how to use various related tools as part of what it is that you are doing. Your data infrastructure tradecraft is (or should be):

    • Essential skills and experiences spanning different technologies and focus areas
    • Knowing various techniques to use new and old things in new as well as hybrid ways
    • Expanding awareness into adjacent areas around your current focus or interest areas
    • Leveraging comprehension, understanding application of what you know
    • Evolving with new knowledge, experiences, and insight about tools and techniques
    • Hardware, software, services, processes, practices, and management
    • From legacy to software-defined, cloud, virtual, and containers

    Part of server storage I/O data infrastructure tradecraft is understanding what tools to use when, where, and why, not to mention knowing how to adapt with those tools, find new ones, or create your own.

    Remember, if all you have is a hammer, everything starts to look like a nail. On the other hand, if you have more tools than you know what to do with, or how to use them, perhaps fewer tools are needed along with learning how to use them by enhancing your skillset and tradecraft.

    In-between the known data infrastructure server, storage, I/O network, converged infrastructure (CI), hyper-converged infrastructure (HCI), Docker and other containers, cloud, hardware software-defined known, and unknown is your tradecraft. The narrow the gap between the known and the unknown as well as how to apply your experience is the diversity of your tradecraft.

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Server Storage I/O network Data Infrastructure Tradecraft Overview

    Server Storage I/O network Data Infrastructure Tradecraft Overview

    Updated 1/17/2018

    Data Infrastructure Tradecraft includes server storage I/O network and associated technology, technique, skills, experiences. Tradecraft includes insight as well as tricks of the trade, profession and job function (read more about what is a data infrastructure here). This is the first of a two-part series exploring data infrastructure along with serve storage I/O and related tradecraft. Read part two of this series here.

    Data Infrastructures Tradecraft Overview
    Data Infrastructure and IT Infrastructure Layers

    Data infrastructure encompasses servers, storage, I/O and networking along with associated hardware, software, services and management tasks including data protection among others. Tradecraft is knowing about tools, technologies, and trends in your primary domain as well as adjacent focus areas. However, tradecraft is also about knowing how and when to use different technologies, tools with various techniques to address different scenarios.

    What Is Your Tradecraft
    An example of expanding tradecraft is, for instance, an automobile technician who has learned how to change oil, check tire air pressure, or other essential entry-level functions. On the other hand, a master mechanic knows how to do more involved tasks, from the engine to transmission repair or rebuilding, bodywork, along with troubleshooting. A master mechanic not only knows what buttons, knobs, tools, and techniques to use for different tasks, he also knows how to diagnose problems, as well as what usually causes those problems to occur.

    There are many other examples, including salespeople who have the tradecraft of selling, including account as well as relationship building along with the ability to learn new tradecraft related to the trade or items they are or will be selling. Moreover, then there are pre-sales and systems engineers, technical marketing, product and program management, test and development, R&D engineering, IT and technology architects, among many others.
    IT Data Infrastructure Professionals

    Another example is engineers and architects (non-IT) who have basic design along with engineering discipline tradecraft, as well as specialties such as mechanical, electrical, heating ventilation air condition (HVAC), or environmental, among others. They can leverage their basic tradecraft while extending and enhancing it by gaining insight as well as experience in adjacent areas of focus.

    For IT and data infrastructure tradecraft this means expanding from basic tasks to being able to do more advanced things. For example, developing tradecraft from knowing the different hardware, software, and services resources as well as tools, to what to use when, where, why, and how. Another dimension of expanding data infrastructure tradecraft skills is gaining the experience and insight to troubleshoot problems, gain insight awareness with dashboard or monitoring tools, as well as how to design and manage to cut or reduce the chance of things going wrong.

    From Tools and Technologies to Techniques and Tricks of the Trade
    Expanding your awareness of new technologies along with how they work is important, so too is understanding application and organization needs. Developing your tradecraft means balancing the focus on new and old technologies, tools, and techniques with business or organizational application functionality.

    This is where using various tools that themselves are applications to gain insight into how your data infrastructure is configured and being used, along with the applications they support, is important.

    Data Infrastructure Tool Box

    Learning the Talk and Walking the Talk
    For some people their tradecraft is only learning the talk, so that they can talk the talk of trends, techniques, technology buzzwords to do their job (or get a job) and fit in. The next step is comprehending the talk, gaining more insight and experience ability of what to do (and not do) by walking the talk. Sometimes this means learning from mistakes (yours or others) to prevent them in the future.

    Expanding your tradecraft means learning the talk as well as how to walk the talk for adjacent areas. This can mean new skills, ability, tools, and technologies along with proper terminology. For your data infrastructure tradecraft, you need to acquire competencies in these different yet related areas.

    Even if your focus is to be a hardware or software or services person, there are opportunities to expand your tradecraft. For example extend into physical, virtualization, cloud, container, networking, storage, performance, data protection, or security, among others. This also means comprehending how the pieces work together to support the business applications, as well as the impact on each other (e.g. cause and effect).

    Part of tradecraft is also understanding that various terms and acronyms have different context meaning. For example, SAS can mean big data statistical analysis software or Serial Attached SCSI among others. What this means is as your tradecraft expands, so too does awareness that different terms have various meaning along with the importance of asking for context.

    Another example of understanding context is Fabric. Fabric can also have different context and meaning. It can refer to a network of switches, directors, and routers tying together servers, storage, bridges, gateways, and other devices, but it can also be associated with higher-level application functions, or a cluster of servers or services, as well as data. Keep context in mind about fabric: whether it is referring to lower-level physical and logical networks, or applications and data, among others.

    Yet another context example includes that client can have different meanings, including software or applications that communicate with a server or service, local or in the cloud. A variation of client can also be a type of device, such as a tablet, laptop, mobile device or phone, as well as a workstation with varying software for accessing different data infrastructure as well as applications. Another context for client is the user, person, or thing such as IoT that accesses and interacts with client software or server and services of application or data resources. Yet another context for client is a consumer of lower-level data infrastructure resources or higher-level applications services.

    Where To Learn More

    View additional Data Infrastructure and tradecraft related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure SDDC Data Infrastructure Tradecraft Overview

    What this means

    Remember that tradecraft is skills, experiences, tricks, and techniques along with knowing what as well as how to use various related tools as part of what it is that you are doing.  Continue reading more about data infrastructure along with server storage I/O network hardware software as well as associated management tradecraft in part two of this series here.

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.