Data Protection Diaries Fundamentals Walking The Data Protection Talk

Data Protection Diaries Walking The Data Protection Talk

Companion to Software Defined Data Infrastructure Essentials – Cloud, Converged, Virtual Fundamental Server Storage I/O Tradecraft ( CRC Press 2017)

server storage I/O data infrastructure trends

By Greg Schulzwww.storageioblog.com November 26, 2017

This is Part 8 of a multi-part series on Data Protection fundamental tools topics techniques terms technologies trends tradecraft tips as a follow-up to my Data Protection Diaries series, as well as a companion to my new book Software Defined Data Infrastructure Essentials – Cloud, Converged, Virtual Server Storage I/O Fundamental tradecraft (CRC Press 2017).

Software Defined Data Infrastructure Essentials Book SDDC

Click here to view the previous post Data Protection Tools, Technologies, Toolbox, Buzzword Bingo Trends, and click here to view the next post who’s Doing What ( Toolbox Technology Tools).

Post in the series includes excerpts from Software Defined Data Infrastructure (SDDI) pertaining to data protection for legacy along with software defined data centers ( SDDC), data infrastructures in general along with related topics. In addition to excerpts, the posts also contain links to articles, tips, posts, videos, webinars, events and other companion material. Note that figure numbers in this series are those from the SDDI book and not in the order that they appear in the posts.

In this post the focus is around what I (and Server StorageIO) does for Data Protection besides just talking the talk and is a work in progress that is being updated over time with additional insights.

Walking The Data Protection Talk What I Do

A couple of years back I did the first post as part of the Data Protection Diaries series ( view here), that included the following image showing some data protection needs and requirements, as well as what being done, along with areas for improvement. Part of what I and Server StorageIO does involves consulting (strategy, design, assessment), advising and other influencers activities (e.g. blog, write articles, create reports, webinars, seminars, videos, podcasts) pertaining to data Infrastructure topics as well as data protection.

What this means is knowing about the trends, tools, technologies, what’s old and new, who’s doing what, what should be in the data protection toolbox, as well as how to use those for different scenarios. Its one thing to talk the talk, however I also prefer to walk the talk including eating my own dog food applying various techniques, approaches, tools and technologies discussed.

The following are from a previous Data Protection Diaries post where I discuss my data protection needs (and wants) some of which have evolved since then. Note the image on the left is my Livescribe Echo digital pen and paper tablet. On the right is an example of the digital image created and imported into my computer from the Livescribe. In other words, Im able to protect my hand written notes, diagrams and figures.

Data Protection Diaries Data Protection Diaries Walking The Talk
Via my Livescribe Echo digital pen ( get your Livescribe here at Amazon.com)

My Environment and data protection is always evolving, some based on changing projects, others that are more stable. Likewise the applications along with data are varied after all, everything is not the same. My data protection includes snapshots, replication, mirror, sync, versions, backup, archive, RAID, erasure code among others technologies, tools, and techniques.

Applications range from desktop, office, email, documents, spreadsheets, presentations, video, audio and related items in support of day-to-day activities. Then there are items part of various projects that range from physical to virtual, cloud and container leveraging various tools. This means having protection copies (sync, backup, snapshots, consistency points) of virtual machines, physical machine instances, applications and databases such as SQL Server among many others. Other application workloads include web, word press blog and email among others.

The Server StorageIO environment consists of a mix of legacy on-premises technologies from servers, storage, hardware, software, networks, tools as well as software defined virtual (e.g. VMware, Hyper-V, Docker among others), as well as cloud. The StorageIO data Infrastructure environment consists of dedicated private server (DPS) that I have had for several years now that supports this blog as well as other sites and activity. I also have a passive standby site used for testing of the WordPress based blog on an AWS Lightsail server. I use tools such as Updraft Plus Premium to routinely create a complete data protection view (database, plugins, templates, settings, configuration, core) of my WordPress site (runs on DPS) that is stored in various locations, including at AWS.

Data Protection Diaries Walking The Talk
Some of my past data protection requirements (they have evolved)

Currently the Lightsail Virtual Private Server (VPS) is in passive mode, however plans are to enable it as a warm or active standby fail over site for some of the DPS functions. One of the tools I have for monitoring and insight besides those in WordPress and the DPS are AWS Route 53 alerts that I have set up to monitor endpoints. AWS Route 53 is a handy resource for monitoring your endpoints such as a website, blog among other things and have it notify you, or take action including facilitating DNS fail over if needed. For now, Im simply using Route 53 besides as a secondary DNS as a notification tool.

Speaking of AWS, I have compute instances in Elastic Cloud Compute (EC2) along with associated Elastic Block Storage (EBS) volumes as well as their snapshots. I also have AWS S3 buckets in different regions that are on various tiers from standard to infrequent access (IA), as well as some data on Glacier. Data from my DPS at Bluehost gets protected to a AWS S3 bucket that I can access from AWS EC2, as well as via other locations including Microsoft Azure as needed.

Some on-premises data also gets protected to AWS S3 (as well as to elsewhere) using various tools, for different granularity, frequency, access and retention. After all, everything is not the same, why treat it the same. Some of the data protected to AWS S3 buckets is in native format (e.g. they appear as objects to S3 or object enabled applications), as well as file to file based applications with appropriate tools.

Other data that is also protected to AWS S3 from different data protection or backup tools are stored in vendor neutral or vendor specific save set, zip, tar ball or other formats. In other words, I need the tool or compatible tool that knows the format of the saved data to retrieve individual data files, items or objects. Note that this is similar to storing data on tape, HDDs, SSD or other media in native format vs. in some type of encapsulate save set or other format.

In addition to protecting data to AWS, I also have data at Microsoft Azure among other locations. Other locations include non-cloud based off-site where encrypted removable media is periodically taken to a safe secure place as a master, gold in case of major emergency, ransomeware copy.

Why not just rely on cloud copies?

Simple, I can pull individual files or relatively small amounts of data back from the cloud sometimes faster (or easier) than from on-site copies, let alone my off-site, off-line, air gap copies. On the other hand, if I need to restore large amounts of data, without a fast network, it can be quicker to get the air gap off-line, off-site copy, do the large restore, then apply incremental or changed data via cloud. In other a hybrid approach.

Now a common question I get is why not just do one or the other and save some money. Good point, I would save some money, however by doing the above among other things, they are part of being able to test, try new and different things, gain insight, experience not to mention walk the talk vs. simply talking the talk.

Of course Im always looking for ways to streamline to make my data protection more efficient, as well as effective (along with remove complexity and costs).

  • Everything is not the same, so why treat it all the same with common SLO, RTO, RPO and retention?
  • Likewise why treat and store all data the same way, on the same tiers of technology
  • Gain insight and awareness into environment, applications, workloads, PACE needs
  • Applications, data, systems or devices are protected with different granularity and frequency
  • Apply applicable technology and tools to the task at hand
  • Any data I have in cloud has a copy elsewhere, likewise, any data on-premises has a copy in the cloud or elsewhere
  • I implement the 4 3 2 1 rule by having multiple copies, versions, data in different locations, on and off-line including cloud
  • From a security standpoint, many different things are implemented on a logical as well as physical basis including encryption
  • Ability to restore data as well as applications or image instances locally as well as into cloud environments
  • Leverage different insight and awareness, reporting, analytics and monitoring tools
  • Mix of local storage configured with different RAID and other protection
  • Test, find, fix, remediate improve the environment including leveraging lessons learned

Where To Learn More

Continue reading additional posts in this series of Data Infrastructure Data Protection fundamentals and companion to Software Defined Data Infrastructure Essentials (CRC Press 2017) book, as well as the following links covering technology, trends, tools, techniques, tradecraft and tips.

Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

Software Defined Data Infrastructure Essentials Book SDDC

What This All Means

Everything is not the same, thats why in my environment I use different technologies, tools and techniques to protect my data. This also means having different RTO, RPO across various applications, data and systems as well as devices. Data that is more important has more copies, versions in different locations as well as occurring more frequently as part of 4 3 2 1 data protection. Other data that does not change as frequently, or time sensitive have alternate RTO and RPO along with corresponding frequency of protection.

Get your copy of Software Defined Data Infrastructure Essentials here at Amazon.com, at CRC Press among other locations and learn more here. Meanwhile, continue reading with the next post in this series Part 9 who’s Doing What (Toolbox Technology Tools).

Ok, nuff said, for now.

Gs

Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

Data Protection Diaries Fundamentals Who Is Doing What Toolbox Technology Tools

Data Protection Toolbox Whos Doing What Technology Tools

Updated 1/17/2018

Data protection toolbox is a companion to Software Defined Data Infrastructure Essentials – Cloud, Converged, Virtual Fundamental Server Storage I/O Tradecraft ( CRC Press 2017)

server storage I/O data infrastructure trends

By Greg Schulzwww.storageioblog.com November 26, 2017

This is Part 9 of a multi-part series on Data Protection fundamental tools topics techniques terms technologies trends tradecraft tips as a follow-up to my Data Protection Diaries series, as well as a companion to my new book Software Defined Data Infrastructure Essentials – Cloud, Converged, Virtual Server Storage I/O Fundamental tradecraft (CRC Press 2017).

Software Defined Data Infrastructure Essentials Book SDDC

Click here to view the previous post Part 8 Walking The Data Protection Talk, and click here to view the next post Part 10 Data Protection Resources Where to Learn More.

Post in the series includes excerpts from Software Defined Data Infrastructure (SDDI) pertaining to data protection for legacy along with software defined data centers ( SDDC), data infrastructures in general along with related topics. In addition to excerpts, the posts also contain links to articles, tips, posts, videos, webinars, events and other companion material. Note that figure numbers in this series are those from the SDDI book and not in the order that they appear in the posts.

In this post the focus is around Data Protection who’s Doing What ( Toolbox Technology Tools).

SDDC, SDI, SDDI data infrastructure
Figure 1.5 Data Infrastructures and other IT Infrastructure Layers

who’s Doing What (Toolbox Technology Tools)

SDDC SDDI data center data protection toolbox
Data Protection Toolbox

Note that this post is evolving with additional tools, technologies, techniques, hardware, software, services being added over time along with applicable industry links.

The following are a sampling of some hardware, software, solution and component vendors along with service providers involved with data protection from RAID, Erasure Codes (EC) to snapshots, backup, BC, BR, DR, archive, security, cloud, bulk object storage, HDDs, SSD, tape among others including buzzword (and buzz term trends) bingo. Acronis, Actifio, Arcserve, ATTO, AWS, Backblaze, Barracuda, Broadcom, Caringo, Chelsio (offload), Code42/Crashplan, Cray, Ceph, Cisco, Cloudian, Cohesity, Compuverde, Commvault, Datadog, Datrium, Datos IO, DDN, Dell EMC, Druva, E8, Elastifile, Exagrid, Excelero, Fujifilm, Fujutsu, Google, HPE, Huawei, Hedvig, IBM, Intel, Iomega, Iron Mountain, IBM, Jungledisk, Kinetic key value drives (Seagate), Lenovo, LTO organization, Mangstor, Maxta, Mellanox (offload), Micron, Microsoft (Azure, Windows, Storage Spaces), Microsemi, Nakivo, NetApp, NooBaa, Nexsan, Nutanix, OpenIO, OpenStack (Swift), Oracle, Panasas, Panzura, Promise, Pure, Quantum, Quest, Qumulo, Retrospect, Riverbed, Rozo, Rubrik, Samsung, Scale, Scality, Seagate (DotHill), Sony, Solarwinds, Spectralogic, Starwind, Storpool, Strongbox, Sureline, Swiftstack, Synology, Toshiba, Tintri, Turbonomics, Unitrends, Unix and Linux platforms, Vantara, Veeam, VMware, Western Digital (Amplidata, Tegile and others), WekaIO, X-IO, Zadara and Zmanda among many others.

Note if you dont see yours, or your favorite, preferred or clients listed above or in the data Infrastructure industry related links send us a note for consideration to be included in future updates, or having a link, or sponsor spot pointing to your site added. Feel free to add a non sales marketing pitch to courteous comments to the comment section below.

View additional IT, data center and data Infrastructure along with data protection related vendors, services, tools, technologies links here.

Where To Learn More

Continue reading additional posts in this series of Data Infrastructure Data Protection fundamentals and companion to Software Defined Data Infrastructure Essentials (CRC Press 2017) book, as well as the following links covering technology, trends, tools, techniques, tradecraft and tips.

Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

Software Defined Data Infrastructure Essentials Book SDDC

What This All Means

Part of modernizing data protection for various data center and data infrastructure environments is to know the tools, technologies and trends that are part of your data protection toolbox. The other part of modernizing data is protection is knowing the techniques of how to use different tools, technologies to meet various application workload performance, availability, capacity economic (PACE) needs.

Also keep in mind that information services requires applications (e.g. programs) and that programs are a combination of algorithms (code, rules, policies) and data structures (e.g. data and how it is organized including unstructured). What this means is that data protection needs to address not only data, also the applications, configuration settings, metadata as well as protecting the protection tools and its data.

Get your copy of Software Defined Data Infrastructure Essentials here at Amazon.com, at CRC Press among other locations and learn more here. Meanwhile, continue reading with the next post in this series, Part 10 Data Protection Fundamental Resources Where to Learn More.

Ok, nuff said, for now.

Gs

Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

Data Protection Diaries Fundamental Resources Where to Learn More

Data Protection Diaries Fundamental Resources Where to Learn More

Companion to Software Defined Data Infrastructure Essentials – Cloud, Converged, Virtual Fundamental Server Storage I/O Tradecraft ( CRC Press 2017)

server storage I/O data infrastructure trends

By Greg Schulzwww.storageioblog.com November 26, 2017

This is the last in a multi-part series on Data Protection fundamental tools topics techniques terms technologies trends tradecraft tips as a follow-up to my Data Protection Diaries series, as well as a companion to my new book Software Defined Data Infrastructure Essentials – Cloud, Converged, Virtual Server Storage I/O Fundamental tradecraft (CRC Press 2017).

Click here to view the previous post Part 9 – who’s Doing What ( Toolbox Technology Tools).

Software Defined Data Infrastructure Essentials Book SDDC

Post in the series includes excerpts from Software Defined Data Infrastructure (SDDI) pertaining to data protection for legacy along with software defined data centers ( SDDC), data infrastructures in general along with related topics. In addition to excerpts, the posts also contain links to articles, tips, posts, videos, webinars, events and other companion material. Note that figure numbers in this series are those from the SDDI book and not in the order that they appear in the posts.

In this post the focus is around Data Protection Resources Where to Learn More.

SDDC, SDI, SDDI data infrastructure
Figure 1.5 Data Infrastructures and other IT Infrastructure Layers

Software Defined Data Infrastructure Essentials Table of Contents (TOC)

Here is a link (PDF) to the table of contents (TOC) for Software Defined Data Infrastructure Essentials.

The following is a Software Defined Data Infrastructure Essentials book TOC summary:

Chapter 1: Server Storage I/O and Data Infrastructure Fundamentals
Chapter 2: Application and IT Environments
Chapter 3: Bits, Bytes, Blobs, and Software-Defined Building Blocks
Chapter 4: Servers: Physical, Virtual, Cloud, and Containers
Chapter 5: Server I/O and Networking
Chapter 6: Servers and Storage-Defined Networking
Chapter 7: Storage Mediums and Component Devices
Chapter 8: Data Infrastructure Services: Access and Performance
Chapter 9: Data Infrastructure Services: Availability, RAS, and RAID
Chapter 10: Data Infrastructure Services: Availability, Recovery-Point Objective, and Security
Chapter 11: Data Infrastructure Services: Capacity and Data Reduction
Chapter 12: Storage Systems and Solutions (Products and Cloud)
Chapter 13: Data Infrastructure and Software-Defined Management
Chapter 14: Data Infrastructure Deployment Considerations
Chapter 15: Software-Defined Data Infrastructure Futures, Wrap-up, and Summary
Appendix A: Learning Experiences
Appendix B: Additional Learning, Tools, and tradecraft Tricks
Appendix C: Frequently Asked Questions
Appendix D: Book Shelf and Recommended Reading
Appendix E: Tools and Technologies Used in Support of This Book
Appendix F: How to Use This Book for Various Audiences
Appendix G: Companion Website and Where to Learn More
Glossary
Index

Click here to view (PDF) table of contents (TOC).

Data Protection Resources Where To Learn More

Learn more about Data Infrastructure and Data Protection related technology, trends, tools, techniques, tradecraft and tips with the following links.

The following are the various posts that are part of this data protection series:

  • Part 1Data Infrastructure Data Protection Fundamentals
  • Part 2 – Reliability, Availability, Serviceability ( RAS) Data Protection Fundamentals
  • Part 3 – Data Protection Access Availability RAID Erasure Codes ( EC) including LRC
  • Part 4 – Data Protection Recovery Points (Archive, Backup, Snapshots, Versions)
  • Part 5 – Point In Time Data Protection Granularity Points of Interest
  • Part 6 – Data Protection Security Logical Physical Software Defined
  • Part 7 – Data Protection Tools, Technologies, Toolbox, Buzzword Bingo Trends
  • Part 8 – Data Protection Diaries Walking Data Protection Talk
  • Part 9 – who’s Doing What ( Toolbox Technology Tools)
  • Part 10Data Protection Resources Where to Learn More

  • The following are various data protection blog posts:

  • Welcome to the Data Protection Diaries
  • Until the focus expands to data protection, backup is staying alive!
  • The blame game, Does cloud storage result in data loss?
  • Loss of data access vs. data loss
  • Revisiting RAID storage remains relevant and resources
  • Only you can prevent cloud (or other) data loss
  • Data protection is a shared responsibility
  • Time for CDP (Commonsense Data Protection)?
  • Data Infrastructure Server Storage I/O Tradecraft Trends (skills, experiences, knowledge)
  • My copies were corrupted: The [4] 3-2-1 rule and more about 4 3 2 1 as well as 3 2 1 here and here
  • The following are various data protection tips and articles:

  • Via Infostor Cloud Storage Concerns, Considerations and Trends
  • Via Network World What’s a data infrastructure?
  • Via Infostor Data Protection Gaps, Some Good, Some Not So Good
  • Via Infostor Object Storage is in your future
  • Via Iron Mountain Preventing Unexpected Disasters
  • Via InfoStor – The Many Variations of RAID Storage
  • Via InfoStor – RAID Remains Relevant, Really!
  • Via WservNews Cloud Storage Considerations (Microsoft Azure)
  • Via ComputerWeekly Time to restore from backup: Do you know where your data is?
  • Via Network World Ensure your data infrastructure remains available and resilient
  • The following are various data protection related webinars and events:

  • BrightTalk Webinar Data Protection Modernization – Protect, Preserve and Serve you Information
  • BrightTalk Webinar BCDR and Cloud Backup Protect Preserve and Secure Your Data Infrastructure
  • TechAdvisor Webinar (Free with registration) All You Need To Know about ROBO data protection
  • TechAdvisor Webinar (Free with registration) Tips for Moving from Backup to Full Disaster Recovery
  • The following are various data protection tools, technologies, services, vendor and industry resource links:

  • Various Data Infrastructure related news commentary, events, tips and articles
  • Data Center and Data Infrastructure industry links (vendors, services, tools, technologies, hardware, software)
  • Data Infrastructure server storage I/O network Recommended Reading List Book Shelf
  • Software Defined Data Infrastructure Essentials (CRC 2017) Book
  • Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    What This All Means

    Everything is not the same across environments, data centers, data infrastructures including SDDC, SDX and SDDI as well as applications along with their data.

    Likewise everything is and does not have to be the same when it comes to Data Protection.

    Since everything is not the same, various data protection approaches are needed to address various application performance, availability, capacity economic (PACE) needs, as well as SLO and SLAs.

    Data protection encompasses many different hardware, software, services including cloud technologies, tools, techniques, best practices, policies and tradecraft experience skills (e.g. knowing what to use when, where, why and how).

    Software Defined Data Infrastructure Essentials Book SDDC

    Context is important as different terms have various meanings depending on what they are being discussed with. Likewise different technologies and topics such as object, blob, backup, replication, RAID, erasure code (EC), mirroring, gaps (good, bad, ugly), snapshot, checkpoint, availability, durability among others have various meanings depending on context, as well as implementation approach.

    In most cases there is no bad technology or tool, granted there are some poor or bad (even ugly) implementations, as well as deployment or configuration decisions. What this means is the best technology or approach for your needs may be different from somebody else’s and vice versa.

    Some other points include there is no such thing as an information recession with more data generated every day, granted, how that data is transformed or stored can be in a smaller footprint. Likewise there is an increase in the size of data including unstructured big data, as well as the volume (how much data), as well as velocity (speed at which it is created, moved, processed, stored). This also means there is an increased dependency on data being available, accessible and intact with consistency. Thus the fundamental role of data Infrastructures (e.g. what’s inside the data center or cloud) is to combine resources, technologies, tools, techniques, best practices, policies, people skill set, experiences (e.g. tradecraft) to protect, preserve, secure and serve information (applications and data).

    modernizing data protection including backup, availability and related topics means more than swapping out one hardware, software, service or cloud for whatever is new, and then using it in old ways.

    What this means is to start using new (and old) things in new ways, for example move beyond using SSD or HDDs like tape as targets for backup or other data protection approaches. Instead use SSD, HDDs or cloud as a tier, yet also to enable faster protection and recovery by stepping back and rethinking what to protect, when, where, why, how and apply applicable techniques, tools and technologies. Find a balance between knowing all about the tools and trends while not understanding how to use those toolbox items, as well as knowing all about the techniques of how to use the tools, yet not knowing what the tools are.

    Want to learn more, have questions about specific tools, technologies, trends, vendors, products, services or techniques discussed in this series, send a note (info at storageio dot com) or via our contact page. We can set up a time to discuss your questions or needs pertaining to Data Protection as well as data infrastructures related topics from legacy to software defined virtual, cloud, container among others. For example consulting, advisory services, architecture strategy design, technology selection and acquisition coaching, education knowledge transfer sessions, seminars, webinars, special projects, test drive lab reviews or audits, content generation, videos, podcasts, custom content, chapter excerpts, demand generation among many other things.

    Get your copy of Software Defined Data Infrastructure Essentials here at Amazon.com, at CRC Press among other locations and learn more here.

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Data Infrastructure Industry Trends WekaIO Matrix Software Defined Storage SDS

    WekaIO Matrix Scale Out Software Defined Storage SDS

    server storage I/O trends

    Updated 2/11/2018

    WekaIO Matrix is a scale out software defined solution (SDS).

    WekaIO Matrix software defined scale out storage SDS

    This Server StorageIO Industry Trends Perspective report looks at common issues, trends, and how to address different application server storage I/O challenges. In this report, we look at WekaIO Matrix, an elastic, flexible, highly scalable easy to use (and manage) software defined (e.g. software based) storage solution. WekaIO Matrix enables flexible elastic scaling with stability and without compromise.

    Matrix is a new scale out software defined storage solution that:

    • Installs on bare metal, virtual or cloud servers
    • Has POSIX, NFS, SMB, and HDFS storage access
    • Adaptable performance for little and big data
    • Tiering of flash SSD and cloud object storage
    • Distributed resilience without compromise
    • Removes complexity of traditional storage
    • Deploys on bare metal, virtual and cloud environments

    Where To Learn More

    View additional SDS and related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    Read more about WekaIO Matrix in this (free, no registration required) Server StorageIO Industry Trends Perspective (ITP) Report compliments of WekaIO.

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    AWS S3 Storage Gateway Revisited (Part I)

    server storage I/O trends

    AWS S3 Storage Gateway Revisited (Part I)

    This Amazon Web Service (AWS) Storage Gateway Revisited posts is a follow-up to the AWS Storage Gateway test drive and review I did a few years ago (thus why it’s called revisited). As part of a two-part series, the first post looks at what AWS Storage Gateway is, how it has improved since my last review of AWS Storage Gateway along with deployment options. The second post in the series looks at a sample test drive deployment and use.

    If you need an AWS primer and overview of various services such as Elastic Cloud Compute (EC2), Elastic Block Storage (EBS), Elastic File Service (EFS), Simple Storage Service (S3), Availability Zones (AZ), Regions and other items check this multi-part series (Cloud conversations: AWS EBS, Glacier and S3 overview (Part I) ).

    AWS

    As a quick refresher, S3 is the AWS bulk, high-capacity unstructured and object storage service along with its companion deep cold (e.g. inactive) Glacier. There are various S3 storage service classes including standard, reduced redundancy storage (RRS) along with infrequent access (IA) that have different availability durability, performance, service level and cost attributes.

    Note that S3 IA is not Glacier as your data always remains on-line accessible while Glacier data can be off-line. AWS S3 can be accessed via its API, as well as via HTTP rest calls, AWS tools along with those from third-party’s. Third party tools include NAS file access such as S3FS for Linux that I use for my Ubuntu systems to mount S3 buckets and use similar to other mount points. Other tools include Cloudberry, S3 Motion, S3 Browser as well as plug-ins available in most data protection (backup, snapshot, archive) software tools and storage systems today.

    AWS S3 Storage Gateway and What’s New

    The Storage Gateway is the AWS tool that you can use for accessing S3 buckets and objects via your block volume, NAS file or tape based applications. The Storage Gateway is intended to give S3 bucket and object access to on-premises applications and data infrastructures functions including data protection (backup/restore, business continuance (BC), business resiliency (BR), disaster recovery (DR) and archiving), along with storage tiering to cloud.

    Some of the things that have evolved with the S3 Storage Gateway include:

    • Easier, streamlined download, installation, deployment
    • Enhanced Virtual Tape Library (VTL) and Virtual Tape support
    • File serving and sharing (not to be confused with Elastic File Services (EFS))
    • Ability to define your own bucket and associated parameters
    • Bucket options including Infrequent Access (IA) or standard
    • Options for AWS EC2 hosted, or on-premises VMware as well as Hyper-V gateways (file only supports VMware and EC2)

    AWS Storage Gateway Three Functions

    AWS Storage Gateway can be deployed for three basic functions:

      AWS Storage Gateway File Architecture via AWS.com

    • File Gateway (NFS NAS) – Files, folders, objects and other items are stored in AWS S3 with a local cache for low latency access to most recently used data. With this option, you can create folders and subdirectory similar to a regular file system or NAS device as well as configure various security, permissions, access control policies. Data is stored in S3 buckets that you specify policies such as standard or Infrequent Access (IA) among other options. AWS hosted via EC2 as well as VMware Virtual Machine (VM) for on-premises file gateway.

      Also, note that AWS cautions on multiple concurrent writers to S3 buckets with Storage Gateway so check the AWS FAQs which may have changed by the time you read this. Current file share limits (subject to change) include 1 file gateway share per S3 bucket (e.g. a one to one mapping between file share and a bucket). There can be 10 file shares per gateway (e.g. multiple shares each with its own bucket per gateway) and a maximum file size of 5TB (same as maximum S3 object size). Note that you might hear about object storage systems supporting unlimited size objects which some may do, however generally there are some constraints either on their API front-end, or what is currently tested. View current AWS Storage Gateway resource and specification limits here.

    • AWS Storage Gateway Non-Cached Volume Architecture via AWS.com

      AWS Storage Gateway Cached Volume Architecture via AWS.com

    • Volume Gateway (Block iSCSI) – Leverages S3 with a point in time backup as an AWS EBS snapshot. Two options exist including Cached volumes with low-latency access to most recently used data (e.g. data is stored in AWS, with a local cache copy on disk or SSD). The other option is Stored Volumes (e.g. non-cached) where primary copy is local and periodic snapshot backups are sent to AWS. AWS provides EC2 hosted, as well as VMs for VMware and various Hyper-V Windows Server based VMs.

      Current Storage Gateway volume limits (subject to change) include maximum size of a cached volume 32TB, maximum size of a stored volume 16TB. Note that snapshots of cached volumes larger than 16TB can only be restored to a storage gateway volume, they can not be restored as an EBS volume (via EC2). There are a maximum of 32 volumes for a gateway with total size of all volumes for a gateway (cached) of 1,024TB (e.g. 1PB). The total size of all volumes for a gateway (stored volume) is 512TB. View current AWS Storage Gateway resource and specification limits here.

    • AWS Storage Gateway VTL Architecture via AWS.com

    • Virtual Tape Library Gateway (VTL) – Supports saving your data for backup/BC/DR/archiving into S3 and Glacier storage tiers. Being a Virtual Tape Library (e.g. VTL) you can specify emulation of tapes for compatibility with your existing backup, archiving and data protection software, management tools and processes.

      Storage Gateway limits for tape include minimum size of a virtual tape 100GB, maximum size of a virtual tape 2.5TB, maximum number of virtual tapes for a VTL is 1,500 and total size of all tapes in a VTL is 1PB. Note that the maximum number of virtual tapes in an archive is unlimited and total size of all tapes in an archive is also unlimited. View current AWS Storage Gateway resource and specification limits here.

      AWS

    Where To Learn More

    What This All Means

    As to which gateway function and mode (cached or non-cached for Volumes) depends on what it is that you are trying to do. Likewise choosing between EC2 (cloud hosted) or on-premises Hyper-V and VMware VMs depends on what your data infrastructure support requirements are. Overall I like the progress that AWS has put into evolving the Storage Gateway, granted it might not be applicable for all usage cases. Continue reading more and view images from the AWS Storage Gateway Revisited test drive in part two located here.

    Ok, nuff said (for now…).

    Cheers
    Gs

    Greg Schulz – Multi-year Microsoft MVP Cloud and Data Center Management, VMware vExpert (and vSAN). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio.

    Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2023 Server StorageIO(R) and UnlimitedIO. All Rights Reserved.

    Data Infrastructure IT Industry Related Resource Links A to E

    Data Infrastructure IT Industry Related Resource Links A to E

    IT Data Center and Data Infrastructure Industry Resources

    Updated 2/20/2018

    Following are some useful Data Infrastructure IT Industry Resource Links A to E to cloud, virtual and traditional IT data infrastructure related web sites. The data infrastructure environment (servers, storage, IO and networking, hardware, software, services, virtual, container and cloud) is rapidly changing. You may encounter a missing URL, or a URL that has changed. This list is updated on a regular basis to reflect changes (additions, changes, and retirement).

    Disclaimer and note: URL’s submitted for inclusion on this site will be reviewed for consideration and to be in generally accepted good taste in regards to the theme of this site.

    Best effort has been made to validate and verify the data infrastructure URLs that appear on this page and web site however they are subject to change. The author and/or maintainer(s) of this page and web site make no endorsement to and assume no responsibility for the URLs and their content that are listed on this page.

    Software Defined Data Infrastructure Essentials Book SDDC

    Send an email note to info at storageio dot com that includes company name, URL, contact name, title and phone number along with a brief 40 character description to be considered for addition to the above data infrastructure list, or, to be removed. Note that Server StorageIO and UnlimitedIO LLC (e.g. StorageIO) does not sell, trade, barter, borrow or share your contact information per our Privacy and Disclosure policy. View related data infrastructure Server StorageIO content here, and signup for our free newsletter here.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    • A3Cube    Computer I/O solution startup
    • AAPT   AAPT    AWS connect partner, Hosting/cloud/access services
    • abiquo.com    Cloud development and management tools
    • Above.net/Zayo Group    AWS connect parter, Hosting/cloud/access services
    • abrevity.com    eDiscovery, search, indexing, classification
    • accellion.com    File transfer tools
    • accessopt.com    Holographic storage
    • acinion.com    Video solutions
    • acopia.com    NAS aggregation and global name space (bought by F5)
    • acronis.com    Backup and data protection tools
    • acsacs.com    Value added reseller (VAR)
    • acs-inc.com    Hosting, outsourcing and managed services (Bought by Xerox)
    • actifio.com    Data protection solutions
    • active-circle.com    Data archiving and storage solutions
    • activestate.com    Stackato PaaS for cloud tools
    • adaptec.com    Adapters, iSCSI storage, data backup solutions (See PMC)
    • adesto.com    CBRAM startup
    • addonics.com    SSD storage solutions
    • adic.com    Backup, Dedupe and data protection solutions (Bought by Quantum)
    • adinfa.com        Energy and resource management tools
    • AdRem Netcrunch        Monitoring of Networks, Systems and Applications, DCIM
    • Adtran    Datacom and networking solutions
    • advancedvault.com    Business continuity solutions
    • advaoptical.com    Optical networking
    • afcom.com    Data center industry user group
    • aforesolutions.com    Cloud storage and infrasture management tools
    • agami.com    High performance NAS storage (Shutdown)
    • agilent.com    Host adapters and test equipment
    • agility.com    Optical solutions and components
    • agilysys.com    VAR
    • aiim.com    Archiving and records management trade group
    • ait.com    Cloud and web hosting
    • Ajubeo    Cloud and management solutions
    • akamai.com    Content distribution network (CDN)
    • akitio.com    Storage systems
    • akorri.com    Storage resource and capacity management
    • alacritech.com    Storage networking adapters for iSCSI
    • alacritus.com    Data Protection Software
    • alcatel.com    Networking and storage networking equipment
    • alliance-it.com    Value added reseller (VAR)
    • allstorage.nl    Storage services solution provider
    • amazon.com    Cloud compute and storage services
    • AmberPoint.com    SOA management tools
    • amcc.com    Storage networking components (aka JNI & 3ware Bought by LSI)
    • amd.com    Server and processor chips
    • americanfibersystems.com    Metropolitan storage networks and fiber bandwidth
    • amphenol.com    Storage Networking connectors and cables
    • Amplidata.com    Object and wide area based storage
    • ancot.com    Storage networking testing equipment
    • anixter.com    Networking components
    • Anobit.com    Memory components
    • ansi.org    American National Standards Institute
    • Anstor64.com    iSCSI storage software
    • anuesystems.com    SONET’/SDH and network test equipment
    • apc.com    Environmental and power systems and DCIM solutoins
    • apcon.com    Physical cabling and management
    • aperture.com    Data center tools including CMDB (Bought by Emerson)
    • appassue.com    SQL server and data protection tools (Bought by Dell)
    • Appcore    Cloud management tools
    • Appfirst    IT Ops, Development and DCIM monitoring and PKI metrics
    • appiq.com    Storage Management Software (Bought by HP)
    • appirio.com    Cloud and content tools and services
    • apple.com    Server and storage
    • apprenda.com    Grid and data management tools
    • Apprenda   Platform as a service tools
    • aprius.com    PCIe Server I/O virtualization (IOV) technology
    • aptare.com    Data protection management and backup reporting
    • arasan.com    IP Networking components
    • Archivas.com    Archiving and data management software (Bought by HDS)
    • arcmail.com    Email archiving
    • Arcplace    Data management archiving
    • arcsight.com    Compliance solutions
    • argent.com    Data center management and CMDB tools
    • ariodata.com    Scalable data storage and blade storage systems
    • aristanetworks.com    Networking technologies
    • aristoslogic.com    Storage controller technology (Bought by Adaptec)
    • Arkeia.com    Backup and data protection software (Bought by WD)
    • arkivio.com    Storage management and ILM software
    • arm.com    Microprocessor producer
    • armor247.com    SMB focused data protection solutions
    • arrow.com    Distributor
    • arsenaldigital.com    Managed backup service (Bought by IBM)
    • arxscan.com    SRM and file reporting software
    • asankya.com    Application delivery and cloud access
    • asciitable.com    Site containing the ASCII character set table
    • ashare.org    HVAC Engineers Association
    • asigra.com    Backup and data protection solutions
    • asnp.org    Association Storage Networking Professionals
    • asperasoft.com    High speed file and data transfer tools
    • astaro.com    Security tools
    • astutenetworks.com    iSCSI storage optimized for VMware
    • atempo.com    Backup Software
    • Atlantic Metro Communications    AWS connect parter, Hosting/cloud/access services
    • Atlantiscomputing    ILIO VDI and I/O optimization, cache tools
    • atmforum.com    ATM trade association
    • atrato.com    Storage systems
    • attachmate.com    IT management tools (bought Novell)
    • attotech.com    Storage networking adapters and gateways
    • Attunesystems.com    NAS and file virtualization (Assets bought by F5)
    • attunity.com    File and data movement tools
    • autonomy.com    Data management and cloud services (Bought by HP) –
    • autovirt.com    Storage automation tiering tools
    • avagotech.com    Semiconductor technologies
    • availl.com    Data movement and replication solutions
    • avamar.com    Dedupe, Backup and Restoration Solutions (Bought by EMC)
    • avanade.com    Var
    • avaya.com    Networking and communications
    • averesystems.com    NAS caching and automated tiering
    • avg.com    Security and anti-virus software
    • avnet.com    Distributor
    • www.avocent.com    Infrastructure resource management tools
    • axcient.com    Cloud data protection solutions
    • axiossystems.com    IRM and service management tools
    • axsone.com    Records and document management
    • axxana.com    Data protection and replication tools
    • Backblaze    Online and cloud backup storage
    • BackupAssist    Backup and Recovery software
    • backupify.com    Backup for google apps
    • BUMI    Backup and data protection tools
    • backupright.com    Online and cloud backup
    • Backula    Opensource Backup and data protection
    • bakbone.com    Backup Software (Bought by Quest bought by Dell)
    • balesio.com    File compression solutions
    • barracudanetworks.com    Networking devices, backup software
    • basho.com    NOSQL Database and object storage technology –
    • batblue.com    Cloud, application delivery networking services
    • Bestel   Bestel    AWS connect parter, Hosting/cloud/access services
    • Beyondtust    Vulnerability assessment and detection
    • bigswitch.com    Openflow based network switches
    • BitArmor.com    Data security software
    • bitcasa.com    Cloud storage and backup
    • Bitcentral    Video management solutions
    • Bitmicro    Solid state devices and other solutions
    • Blackbox    Data center infrastructure, DCIM, KVM and other solutions
    • BlackMESH    FedRAMP and DevOPs hosting
    • blade.org    Trade group for blade servers
    • bladelogic.com    Server management and discovery software
    • BladeNetwork.net    Server and storage blades (Bought by IBM)
    • Bladeroom    Data center and hosting
    • bladesystems.org    Industry trade group for blade servers and storage
    • bladetechnologies.net    Networking technologies
    • blockbridge.com    Elastic Storage Software and Tools
    • bluearc.com    High performance NAS enterprise class storage (Bought by HDS)
    • bluecoat.com    WAN optimization
    • bluecorenetworks.com    Networking infrastructure solutions
    • Bluehost    Web hosting, dedicated and virtual private servers
    • bluelock.com    Hosting, managed service and cloud provider
    • BlueOSS    Cloud and business inteligence solutions
    • www.bluestripe.com     Software for managing virtual data centers
    • bmc.com    Storage management software
    • bocada.com    Backup and management software
    • bowindustries.com    Tape media cleaning tools
    • box.net    Internet/web/cloud storage services
    • bphx.com    Legacy application transformation
    • bridgestor.com    Data reduction and storage optimization
    • Bridghead.com    Storage management software
    • broadband.com    Portal site for finding network bandwidth services
    • broadbandreports.com    Portal site for finding high speed internet access
    • broadcom.com    Storage networking component supplier
    • brocade.com    Switches, WAN gateways, software
    • brouwerconsultancy.com    Storage consultancy service
    • bswd.com    Brian Berg’s Storage Cornucopia web site
    • btiphotonics.com    WDM and Optical networking technologies
    • buffalotech.com    SMB and SOHO NAS storage
    • bustech.com    IBM Mainframe to open systems gateways (Bought by EMC)
    • bycast.com    Grid based fixed content, archive and object storage (Bought by NetApp)
    • c2c.com    Email archiving solutions
    • c2esoft.com    Data center operations and insight management tools
    • ca.com    Data management software
    • Computer Associates    Various data center, DCIM, data protection and other solution tools
    • call-recall.com    Optical storage
    • Canonical   Ubuntu Linux
    • carbonite.com    Cloud storage and backup
    • caringo.com    CAS archiving and object storage tools
    • casecentral.com    Cloud ediscovery
    • cassandra.apache.org    Data management and database alternative software
    • Apache Cassandra    NOSql Data Management tools
    • cassat.com    IRM management tools (Bought by CA)
    • Catalogic Software    Data protection and management tools
    • cataphora.com    Data management tools
    • catbird.com    VM security tools
    • caviumnetworks.com    Networking processors and chip technologies
    • cdproject.net    Carbon Disclosure Project
    • cdrive.com    VAR
    • cdw.com    VAR
    • celion.com    Network services for storage over distance
    • celona.com    Data migration tools
    • cemaphore.com    Messaging solutions
    • centos.org    Cluster Storage
    • centrepath.com    Storage management solutions (formerly Giant Loop)
    • centrify.com    Digital rights management for cloud, virtual, server, desktop and storage
    • Tier3/CenturyLink   Cloud, hosting and managed services
    • Centurylinkg/Savvis    Cloud and hosting solutions
    • Ceph   Cloud and object storage solutions
    • cert.org    Internet Security information
    • certesnetworks.com    Cloud security tools
    • certon.com    VAR
    • CFN Services    AWS connect parter, Hosting/cloud/access services
    • chelsio.com    High speed Ethernet adapters
    • chicorporation.com    Data protection, cloud and storage VAR
    • ciena.com    Optical networking
    • Cinenet    AWS connect parter, Hosting/cloud/access services
    • ciphermax.com    Data Storage Encryption Tools
    • cipheroptics.com    Storage networking security
    • ciprico.com    Storage systems (Bought by DotHill)
    • cirrustore.com    Backup data protection tools
    • cirtas.com    Cloud Storage Appliance – Added 6/9/10
    • cisco.com    Switches, WAN and Optical networking
    • Citrix.com    Virtualization solutions
    • ClearDB.com/.com    Local and distributed (GEO) MySQL database software and service
    • clearpace.com/.com    Large scale archive and data management tools
    • CleverSafe.com    Distributed object/esrasure storage
    • climatesaverscomputing.com    Green computing industry trade group
    • Clonix   Data cloning, duplication and protection tools
    • CloudByte   Scale-out and cloud storage
    • cloudera.com    Hadoop data storage and analytics tools
    • CloudFlare   CDN and Web Cache solutions
    • cloudfuzion.com    High performance servers
    • Cloudian   Cloud and object storage tools
    • Cloudphysics   Big data and virtualization tools
    • cloudreplica.com    Cloud data protection tools
    • cloudscaling.com    Open cloud platforms
    • Apache CloudStack   Open Source Cloud tools
    • cloudtp.com    Open cloud deployment solutions
    • CloudVelocity   Hybrid Cloud and data protection management solutins
    • cloverleafcomm.com    Storage Virtualization tools (Bought by DotHill)
    • clustrix.com    Storage software startup
    • cmg.org    Computer Measurement Group
    • cnt.com    Switches, WAN gateways, software (Bought by McData bought by Brocade)
    • Cobalt Iron   Data protection tools
    • code42.com    Cloud storage and backup aka Crashplan
    • Codenomicon.com    Data and security tools
    • cofio.com    Backup and data protection tools
    • CohesiveFT   Cloud solution and management tools
    • colliercomputing.com    VAR
    • colo-america.com    Co-location and hosting services

    • communities.vmware.com    VMware community
    • commvault.com    Data management software
    • comodo.com    Encryption tools
    • Comparitech    Consumer tech reviews
    • compellent.com    SMB Storage sub-systems and software – (Bought by Dell)
    • comptia.org    Computer and Technology Industry Association
    • compucom.com    VAR
    • computergamedesign.org    Computer game design
    • compuverde.com    Big data management tools and object storage
    • compuware.com    IT management and performance tools
    • condre.com    VAR/distributor
    • Condusiv   Data and storage management tools including Diskeeper
    • XO Communications    AWS connect parter, Hosting/cloud/access services
    • Connected Cloud    Cloud management tools
    • connectwise.com    IT automation tools
    • conres.com    Value added reseller (VAR)
    • consiliant.com    VAR
    • ConstantData.com    Real time data replication and mirroring
    • continuitysoftware.com    Replication and Snapshot data protection management
    • convirture.com    Cloud and virtualization tools
    • copansys.com    Secondary storage for backup and archiving (Assets Bought by SGI)
    • coraid.com    SATA over Ethernet storage
    • CoreSite    AWS connect parter, Hosting/cloud/access services
    • corevault.com    Cloud services
    • Cormant    DCIM and data center and infrastructure management tools
    • corning.com    Fiber optic cabling
    • corsair.com    SSD
    • corvis.com    Networking solutions
    • cPanel    Web, cloud and hosting management tools
    • crashplan.com    Cloud storage and backup aka Code42
    • creekpath.com    Storage management software
    • www.critical-links.com    Office in a box
    • crossroads.com    Storage routers and data protection management tools
    • Crosswalkinc.com    Clustered NAS storage (Ceased Operations)
    • crucial.com    Memory and SSD solutions
    • cru-dataport.com    Data Archive solutions
    • Crypto.com    Crypto resource site
    • www.ctera.com    Cloud storage appliance
    • Cumulus Networks    Open networking
    • curtisssd.com    SSD solution provider
    • cya.com    Document management and data protection
    • cyber-ark.com    Security data protection tools
    • cypress.com    Storage and networking components
    • dantz.com    Data protection and backup solutions (Aka Retrospect Bought by EMC, EMC sold off)
    • datacentertechnologies.com    Data management solutions (Bought by Symantec)
    • datacore.com    Storage management software
    • datadepositbox.com    Online backup and data protection
    • datadirectnetworks.com    Aka DDN Storage systems, SAN, NAS, Object and cloud
    • datadomain.com    Data Deduplication System (Bought by EMC)
    • Data Dynamics Inc    StorageX Data Movement, Migration and management
    • datafort.com    Online cloud backup
    • dataglobal.com    Data and storage management
    • Data Gravity    Big Data solutions
    • datagres.com    Cloud and application caching acceleration
    • dataguise.com/    Data security solutions
    • datalink.com    VAR
    • datallegro.com    Data warehouse storage solution (Bought by Microsoft)
    • datamirror.com    Data replication solutions
    • DataON Storage    Storage solutions
    • Datapipe    AWS connect parter, Hosting/cloud/access services
    • dataprotection.com    Vaultlogix data protection tools for cloud
    • DataRAM.com    SSD solutions
    • Data sales    Storage systems sales and leasing
    • dataslide.com    Hard rectangular disk (HRD)
    • datastor.com    Windows based backup data protection
    • datcollaborative.org    Data collaboration group and DAPL material
    • datoptic.com    Storage VAR
    • daymarksi.com    Value added reseller (VAR)
    • DBR360    AWS connect parter, Hosting/cloud/access services
    • ddifrontline.com    Security and access control
    • debian.org    Open source operating system
    • Debriefing software    Storage SRM tools
    • decru.com    Storage networking security solutions (Bought by NetApp)
    • Asempra.com    Data protection bought by Dell via Quest
    • dell.com    Storage networking equipment
    • Delphix    Storage, data management and data protection tools
    • demandtechnology.com    Demand technology software (performance software)
    • Denodo    Data virtualization tools
    • dexrexgear .com    Social media cloud storage
    • www.dey-sys.com    Open source software based sotrage
    • www.dh2i.com    Database virtualization software tools
    • digidata.com    Storage solutions
    • digistoresolutions.com    Archiving and data protection solutions
    • Digitalocular.com     Video data management tools
    • digitalreefinc.com    eDiscovery and compliance tools
    • digitiliti.com    Cloud and managed service backup
    • diligent.com    Virtual Tape Library (VTL) and Dedupe (Bought by IBM)
    • dimensiondata.com    VAR
    • Dimension Data    Hosting and managed services
    • dincloud.com    Cloud virtual desktop
    • directtextbook.com    Online book venue
    • discoverybox.net    Data protection for legal hold and compliance
    • diskkeeper.com    File and disk storage defragmentation (Condusiv)
    • Disklace.com    Disk storage optimization tools
    • dlink.com    Storage, network and cloud technologies
    • dmtf.org    Distributed Management Task Force
    • dnfstorage.com    iSCSI and hybrid storage (formerly Stonefly)
    • dothill.com    Distributed storage solutions
    • Doubletake.com    Data replication software
    • driveoncloud.com    Cloud drive online storage
    • drivesaversdatarecovery.com    Data protection and recovery
    • drobo.com    SMB and SOHO NAS storage
    • dropbox.com    Cloud storage and file sharing
    • druva.com    Backup, Storage, network and cloud technologies
    • dsireusa.org    Database of State Incentives and Renewable Energy
    • Dundas    Data Visualization and mobile dashboards
    • dvs.de    Digital video systems and storage
    • dynamicsolutions.com    Storage and data protection VAR
    • EaseUS    Backup, data protection and cloning tools
    • ecctek.com    Rugged data storage components
    • econnectix.com    Data and storage management solutions
    • eds.com    Data outsourcing and cloud provider (Bought by HP)
    • eere.energy.gov     U.S. Department of Energy (DoE) web site
    • egenera.com    Blade server and server virtualization management software
    • eginnovations.com    Application and infrastructure monitoring
    • egnyte.com    Cloud backup and data protection
    • eia.doe.gov/fuelelectric.html    Portal for electrical power generation, use and costs
    • emc.com    Storage sub-systems software
    • Emerson.com    DCIM IT Data center power, cooling and environmental management tools
    • Empired FlexScale    IT and business cloud solutions
    • emprisanetworks.com    Network management solutions (Bought by BMC)
    • emulex.com    Host bus adapters and embedded switches
    • enclarity.com    Healthcare CRM and analysis tools
    • encryptstick.com    USB based encryption device
    • enduradata.com    Data distribution and protection
    • energycenter.org    California Center for Sustainable Energy
    • energyshop.com    Portal for energy pricing and options
    • energystar.gov    United States EPA Energy Star web site
    • Enhance-tech.com    Storage VAR
    • enmotus.com    SSD storage tiering technology
    • Ensim   IT and cloud provisioning/management tools
    • enstratus.com    Amazon cloud computing management tools (Bought by Dell)
    • enterprisedb.com    Enterprise Database tools
    • epeat.net    Site for comparing desktop and related products
    • epic.com    Medical Information Technology software
    • equallogic.com    iSCSI storage systems (Bought by Dell)
    • Equinix, Inc.    AWS connect parter, Hosting/cloud/access services
    • equivio.com    Email data protection and retention
    • ericom.com    Desktop and VDI tools
    • esilicon.com    ASIC and custom silicon development
    • essextec.com    VAR
    • Eucalyptus    Open source cloud solutions
    • Evault.com    aka i365 – Remote (Cloud) backup service provider (Bought by Seagate)
    • Everspin Technologies    MRAM memories
    • evolvingsol.com    VAR
    • evostor.com    Storage startup
    • exablade.com    High performance application acceleration
    • Exablox    SMB storage solutions
    • Exabyte.com    Removable tape and robotics
    • exagrid.com    Backup Storage
    • exanet.com    Clustered NAS Storage (Bought by Dell aka FluidFileSystem)
    • exar.com    Server, Storage and Networking components
    • exavio.com    HD and SD data capture
    • exludus.com    Multi core optimize
    • Expand.com    Network and WAN optimization
    • Expertanalyticalsystems.com    Storage analysis tools
    • Exponential-e Ltd.    AWS connect parter, Hosting/cloud/access services
    • expresscomputersystems.com    Storage solutions VAR
    • extremenetworks.com    Networking switches

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    Visit the following additional data infrastructure and IT data center related links.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Data Infrastructure IT Industry Related Resource Links F to J

    Data Infrastructure IT Industry Related Resource Links F to J

    IT Data Center and Data Infrastructure Industry Resources

    Updated 2/20/2018

    Following are some useful Data Infrastructure IT Industry Resource Links F to J to cloud, virtual and traditional IT data infrastructure related web sites. The data infrastructure environment (servers, storage, IO and networking, hardware, software, services, virtual, container and cloud) is rapidly changing. You may encounter a missing URL, or a URL that has changed. This list is updated on a regular basis to reflect changes (additions, changes, and retirement).

    Disclaimer and note: URL’s submitted for inclusion on this site will be reviewed for consideration and to be in generally accepted good taste in regards to the theme of this site.

    Best effort has been made to validate and verify the data infrastructure URLs that appear on this page and web site however they are subject to change. The author and/or maintainer(s) of this page and web site make no endorsement to and assume no responsibility for the URLs and their content that are listed on this page.

    Software Defined Data Infrastructure Essentials Book SDDC

    Send an email note to info at storageio dot com that includes company name, URL, contact name, title and phone number along with a brief 40 character description to be considered for addition to the above data infrastructure list, or, to be removed. Note that Server StorageIO and UnlimitedIO LLC (e.g. StorageIO) does not sell, trade, barter, borrow or share your contact information per our Privacy and Disclosure policy. View related data infrastructure Server StorageIO content here, and signup for our free newsletter here.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    • f5.com    Networking solutions
    • fabric7.com    High speed networking
    • falconstor.com    Storage management software
    • FarStone.com    Backup and data protection software
    • fcoe.com    Web site pertaining to Fibre Channel over Ethernet (FCoE)
    • fdr.com    Aka Innovation data protection tools
    • fedoraproject.org    Linux based operating system
    • Fiber Internet Center    AWS connect parter, Hosting/cloud/access services
    • FiberLight    AWS connect parter, Hosting/cloud/access services
    • fibrechannel.org    Fibre Channel Trade Group
    • filenet.com    File Management Solutions
    • FilesX.com    Backup and data protection software (Bought by IBM)
    • filetek.com    Data management solutions (Bought by SGI)
    • finisar.com    Test, Diagnostic, and Optic Transceivers
    • firescope.com    DCIM, IRM, PMDB, CMDB data solutions
    • First Communications    AWS connect parter, Hosting/cloud/access services
    • Firewall Technical    AWS Desktop, Server and Network Support
    • flashsoft.com    SSD cache software (Bought by SANdisk)
    • Flexiant    Cloud management tools
    • flexstar.com    Hardware testing equipment
    • FNT Software    Data Center and DCIM software tools
    • Folder Sizes    Disk Space Management software tools
    • force10.com    High speed networking (Bought by Dell)
    • forsythe.com    VAR
    • foundrynetworks.com    Networking switches (Bought by Brocade)
    • FreeNAS    ZFS based NAS storage software
    • frety.com    Site with links to various technologies
    • fueleconomy.gov    US Government site for energy efficiency
    • fujifilm.com    Data storage tape media
    • Fujitsu.com    Computers, disks, storage
    • fujitsu-siemens.com    Storage, VTL, storage management solutions
    • fulcrummicro.com    10Gb and high performance chips and cross bars
    • fusionio.com    PCIe based NAND/FLASH local SSD for internal server attachment
    • ioturbine.com    IO optimization driver software (Bought by FusionIO)
    • fusionstorm.com    Value added reseller (VAR)
    • FutureMark    PC Benchmarking and testing tools (PCMark and others)
    • gear6.com    Data performance acceleration NAS caching appliance (Bought by Violin)
    • Geist Global    Data Center and DCIM tools
    • geminare.com    Cloud and application migration and recovery tools
    • genie-soft.com    Backup and data protection tools
    • genstor.com    Storage solutions
    • gfi.com    SMB Email security and data protection
    • gigaspace.com    Grid application and data management middle ware
    • gladinet.com    Cloud storage access software
    • Global Capacity    AWS connect parter, Hosting/cloud/access services
    • globalstor.com    Data storage solutions
    • glodynetechnoserve.com    IT Management tools
    • gluster.com    Open source clustered file system (Bought by Redhat)
    • gogrid.com    Cloud IaaS and hosting services
    • goldengate.com    Data protection and management software (Bought by Oracle)
    • goodsync.com    Data protection solutions
    • Google    Various cloud services including Google Drive, Documents and others
    • graudata.com    Archive software tools
    • Gravitant    Cloud brokerage and management tools
    • green-bytes.com    ZFS based storage management solutions
    • Greenfield Software    DCIM software tools
    • greenliant.com    Nand flash SSD for embedded solutions
    • greenplum.com    Data warehouse storage solutions (Bought by EMC)
    • greenracksystems.com    VAR
    • gresham-storage.com    Virtual tape solutions (VTL sold to Tributary)
    • GridGain    in memory computing
    • gridironsystems.com    Big data and high performance appliance storage
    • gridstore.com    Clustered NAS storage
    • Global Telecom Technology, Inc. (GTT)    AWS connect parter, Hosting/cloud/access services
    • Apache Hadoop    Hadoop Big Data Tools
    • hastorage.com    Value added reseller (VAR)
    • www.hddfiresafe.com    Fire proof and water resistant storage systems
    • hds.com    Storage sub-systems and software
    • hermes-softlab.com    IT and virtualization software
    • Hibernia Atlantic    AWS connect parter, Hosting/cloud/access services
    • hifn.com    Optimization technology (Bought by Exar)
    • high-rely.com    Removable storage solutions
    • hi-stor.com    VAR
    • hitachigst.com    Hitachi Global Storage Technologies – Disk drives (Bought by WD)
    • Hotlink    Data protection, cloud and virtualization management tools
    • hp.com    Storage networking hardware and software
    • htch.com    Hutchinson technologies – disk drive components
    • huawei.com    Networking technologies
    • hydrastor.com    Multi-tenant clustered storage (NEC)
    • hyper9.com    Virtualization management tools (aka Inovawave)
    • hyperio.com    Storage and I/O performance monitoring for Windows
    • hytrust.com    Virtual infrastructure security tools
    • Hyve Solutions   Open Compute Project Servers and Storage
    • i365.com    Online cloud backup (Bought by Seagate e.g. Evault)

    • i3-groep.nl    Dutch ICT VAR
    • iarchive.com    Value added reseller (VAR)
    • iBackup    Online and cloud backup service
    • ibm.com    Storage networking hardware and software
    • Ibrix.com    Clustered and cloud storage software (Bought by HP)
    • Iceweb.com    Data storage solutions
    • icorps.com    IT outsourcing and consulting services
    • IDRIVE    Cloud storage backup
    • idt.com    Server, storage, memory, networking components
    • ieee.org    Institute of Electrical and Electronics Engineers
    • ietf.org    Internet Engineering Task Force
    • iland    Cloud and virtualization services tools
    • illumita.com    IT Cloud solutions
    • Imation.com    Removable media, primary and archive storage (Bought Nexsan)
    • imperva.com    Data protection tools
    • imtpartners.com    Storage TCO modeling tool
    • Inboxer.com    Email and compliance risk management tools
    • Incentra.com    VAR (Bought by Datalink)
    • incipient.com    Storage management and virtualization (Assets bought by TMS)
    • indexengines.com    eDiscovery, search, indexing, classification
    • infineta.com    WAN optimization
    • infinibandta.org    InfiniBand Trade Organization
    • infinicon.com    InfiniBand Technology
    • Infinio    VMware NAS I/O acceleration cache
    • infinityio.com    Storage networking training
    • infocachecorp.com    Data discovery solutions VAR
    • InfoGuard.com    Data security solutions
    • infology.net    eDiscovery
    • Infortrend.com    RAID controllers
    • infostor.com    Magazine focused on storage and storage networking
    • infostreet.com    Cloud Desktop tools
    • Inktank    Ceph services
    • inmage.com    Data protection appliance
    • innovationdp.com    Data management software
    • inoc.com    Network Operations Center (NOC) service
    • Inovawave.com    Virtualization management tools (aka Hyper9)
    • Inphase-technologies.com    Holographic storage
    • inquinox.com    Data, dedupe and data protection management tools
    • inrange.com    Storage Networking Formerly Dataswitch (Bought by CNT Bought by McData Bought by Brocade)
    • insight.com    Value Added Reseller (VAR)
    • insynchq.com    Cloud storage, document sharing
    • intel.com    Host adapters and chips
    • intelipathsolutions.com    Virtual network connectivity (Aka Onpath)
    • intellimagic.net    Server performance, resource management software
    • IntelliProp    SAS and SATA storage
    • InterCloud    AWS connect parter, Hosting/cloud/access services
    • intermedia.net.com    Exchange email hosting service
    • Intermine.com    Storage management software
    • Internap.com    Cloud, managed services, hosting and colo
    • interscapetech.com    Cloud and storage tools / services
    • InterSOC.com    Security management tools
    • intersystems.com    Medical Information Technology software
    • intradyn.com    Storage and data protection for SMB (Part of Sony)
    • intransa.com    iSCSI storage
    • Intronis.com    Online, managed and cloud backup solutions
    • iolo.com    Desktop tuneup, protection tools
    • iomega.com    SMB iSCSI, NAS and other storage (Bought by EMC, Partnering with Lenovo)
    • iometer.org    Iometer performance benchmarking tool
    • Ion Computer    Server, storage and data center solutions
    • iosafe.com    Rugged and fire proof, water proof storage
    • IP Fabrics    SDN switch
    • iphouse.com    MSP, hosting and cloud services
    • iqstor.com    Storage for SMB environments
    • iri.com    Big data management tools
    • CoSort Company IRI    Data management and protection tools
    • ironmountain.com    Data archive, managed and cloud services
    • ironspeed.com    Mobile database tools
    • iSecure    Internet security and forensics services
    • isilon.com    Shared storage – (Bought by EMC)
    • iso.org    International Standards Organizations
    • iStor.com    iSCSI storage
    • IT-ERNITY    Data center and hosting services
    • ivivity.com    Storage virtualization technology
    • iwavesoftware.com    Heterogeneous storage automation software
    • ixia.com    Fibre Channel test equipment
    • IX Reach    AWS connect parter, Hosting/cloud/access services
    • ixsight.com    IT and IRM/SRA insight and data migration
    • JAM Software    Treesize SRM including for NAS
    • jdsu.com    Storage networking optics
    • Jeda Networks    Software defined network and storage management
    • jedec.org    Joint Electron Device Engineering Council
    • jmr.com    Storage systems
    • jni.com    Host bus adapters
    • joyent.com    Cloud infrasture tools
    • jumpbox.com    VM virtual appliance hosting
    • jumpbox.com    Virtualization solutions
    • jungledisk.com    Cloud storage, backup file sharing
    • juniper.net    Networking technologies

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    Visit the following additional data infrastructure and IT data center related links.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Data Infrastructure IT Industry Related Resource Links K to O

    Data Infrastructure IT Industry Related Resource Links K to O

    IT Data Center and Data Infrastructure Industry Resources

    Updated 2/20/2018

    Following are some useful Data Infrastructure IT Industry Resource Links K to O to cloud, virtual and traditional IT data infrastructure related web sites. The data infrastructure environment (servers, storage, IO and networking, hardware, software, services, virtual, container and cloud) is rapidly changing. You may encounter a missing URL, or a URL that has changed. This list is updated on a regular basis to reflect changes (additions, changes, and retirement).

    Disclaimer and note: URL’s submitted for inclusion on this site will be reviewed for consideration and to be in generally accepted good taste in regards to the theme of this site.

    Best effort has been made to validate and verify the data infrastructure URLs that appear on this page and web site however they are subject to change. The author and/or maintainer(s) of this page and web site make no endorsement to and assume no responsibility for the URLs and their content that are listed on this page.

    Software Defined Data Infrastructure Essentials Book SDDC

    Send an email note to info at storageio dot com that includes company name, URL, contact name, title and phone number along with a brief 40 character description to be considered for addition to the above data infrastructure list, or, to be removed. Note that Server StorageIO and UnlimitedIO LLC (e.g. StorageIO) does not sell, trade, barter, borrow or share your contact information per our Privacy and Disclosure policy. View related data infrastructure Server StorageIO content here, and signup for our free newsletter here.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    • kaminario.com    Scale out high performance database server
    • kanbox.com    Chineese cloud provider
    • kaseya.com    IT Infrastructure resource management tools
    • kashya.com    Data Protection Solutions (Bought by EMC)
    • kastenchase.com    Data and information security solutions
    • kazeon.com    eDiscovery, search, indexing, classification (Bought by EMC)
    • kcura.com    eDiscovery tools
    • Kerstor.com    Cloud storage
    • kickfire.com    Business analytics tools
    • kineticd.com    Storage and data protection solutions
    • Kingston.com    Memory manufacturer
    • KLSecurity.com    Data protection solutions
    • komnetworks.com    Archiving solutions
    • k-par.com    Archiving solutions
    • ksplice.com    Linux management tools
    • Kubisys.com    Virtualization management tools
    • KVH Co. Ltd.    AWS connect parter, Hosting/cloud/access services
    • kvsinc.com    Email archiving and compliance software
    • lacie.com    Consumer, SOHO and SMB NAS and DAS storage (Bought by Seagate)
    • laconicsecurity.com    Cloud security and storage
    • lampertz.com    Environmental and data center protection
    • laurustech.com    Managed services provider
    • lecroy.com    Analyzers, probes and diagnostics
    • lefthandnetworks.com    iSCSI clustered storage (Bought by HP)
    • legato.com    Storage management software (Bought by EMC)
    • Lenovo   Servers, storage, workstations
    • Level 3 Communications    AWS connect parter, Hosting/cloud/access services
    • lexar.com    Flash memory
    • liebert.com    Data center power and cooling systems (Bought by Emerson)
    • Lightower    AWS connect parter, Hosting/cloud/access services
    • lightsand.com    SAN connectivity
    • likewise.com    Open backup software for macs/Linux/windows
    • liquidcomputing.com    High density servers
    • liquidcoolsolutions.com    Liquid cooled servers
    • Liquidware Labs   Desktop management solutions
    • livedrive.com    Cloud storage and backup
    • www.liveoffice.com    Cloud and Email hosting
    • LiveVault.com    Online cloud backup service (Bought by IronMountain)
    • locknet-inc.com    Security and network management
    • Lockstep.com    Backup and data protection tools
    • logicube.com    Hard drive copy tools
    • LoginVSI   VDI Testing solutions
    • losttapes.org    Portal pertaining to lost magnetic tape information
    • lsi.com    Storage and networking chips and controllers (Bought by Avago)
    • lto-technology.com    Information about LTO tape media
    • lucent.com    Networking components
    • lumigent.com    Compliance management tools
    • luminex.com    S390 IBM Mainframe to open systems gateways
    • luxtera.com    High speed network and storage interconnects
    • m5data.com    VAR
    • MagePlace Backup    Backup and data protection solutions
    • Maginatics.com    Storage for virtual environments
    • magma.com    PCIe and storage solutions
    • mainline.com    VAR
    • Maintech    Infrastructure services
    • maintech.com    IT Servers and solutions
    • Maldivica    Cloud and object storage gateway
    • ManageEngine    DCIM, data center and networking management
    • maponics.com    Mapping data solutions
    • MAPR   Hadoop and Big Data Tools

    • maranti.com    Storage systems
    • marconi.com    Networking equipment
    • marvell.com    Data storage components
    • Masergy    AWS connect parter, Hosting/cloud/access services
    • Mathon.com    eDiscovery
    • maxava.com    HA tools for IBM iSeries
    • maxell.com    Data storage media
    • maxim-ic.com    Data storage components and solutions
    • maxiscale.com    Web infrastructure scale out file system
    • Maxta   Virtualization storage
    • maxtor.com    Disk drives (Bought by Seagate)
    • maxxan.com    Storage systems (Now Ciphermax)
    • mcdata.com    Switches, WAN gateways, software (Bought by Brocade)
    • mediagateusa.com    HD Video streaming appliance
    • Meditech.com    Medical information technology software
    • Megaport    AWS connect parter, Hosting/cloud/access services
    • mellanox.com    Ethernet and InfiniBand technology
    • Memeo.com    Data and content management tools
    • Mendocino.com    CDP and data protection (Missing in Action)
    • metalogix.net    Sharepoint archiving solutions
    • methode.com    Storage networking transceivers
    • mezeo.com    Cloud storage management tools
    • micron.com    SSD storage solutions
    • micronet.com    Storage solutions
    • microsoft.com    Hyper-V virtualizaiton, Windows Storage Server, Azure Cloud, Storsimple, SkyDrive (aka OneDrive) and more
    • midwave.com    Var
    • Mimecast email management including archiving
    • Mimosasystems.com    Email protection and archiving (Bought by Iron Mountain)
    • mindtree.com    Testing services
    • Mirantis    OpenStack tools, downloads, service and support
    • Miray HDClone    Storage clone and data protection tools
    • mirra.com    SMB storage sharing
    • mobiuspartners.com    VAR
    • Modius    DCIM power, cooling and monitoring
    • moka5.com    VDI tools
    • MongoDB    Open source document optimized database
    • Monitis.com    IT Monitoring and services (applications, systems, clouds and more)
    • Monosphere.com    Storage planning and usage software (Bought by Quest)
    • moonwalk.com    HSM, ILM and data management software
    • morphlabs.com    Dense converged server platforms
    • mosaictec.com    Value added reseller (VAR)
    • mosys.com    High density memory components
    • mpstor.com    Cloud storage and orchestration software
    • msiinet.com    VAR
    • mti.com    European VAR
    • mtron.net    Solid state storage devices
    • My Digital SSD    SSD solutions
    • NAKIVO    Backup and data protection tools
    • napatech.com    Network tools and analysis
    • naspa.org    System administrator’s user group
    • nasuni.com    Cloud storage access appliance
    • ncino.com    Banking and financial deployment platform
    • ncipher.com    Data protection and security solutions (Bought by Thales)
    • ncompass-inc.com    VAR and services firm
    • ncr.com    Servers and storage solutions
    • ndci.com    Data conversion services
    • ndmp.org    Trade organization for NDMP backup protocol
    • neartek.com    VTL software (Bought by EMC)
    • nebulassolutions.com    Security and data protection
    • NEC.com    Servers and storage
    • neopathnetworks.com    Network file management solutions (Bought by Cisco)
    • neoscale.com    Storage networking security (Assets Bought by nCipher)
    • nephoscale.com    Cloud and object storage
    • NeptunesCloud.net    Cloud IaaS solutions
    • www.neptuny.com    Performance and capacity planning tools
    • nerc.com    North American Electrical Reliability Council
    • netcelera.com    WAN File system caching and acceleration
    • netcomm.com.au    Broadband service provider
    • netdirectsystems.com    VAR
    • neterion.com    High performance iSCSI and Ethernet 10Gb technology Bought by Exar)
    • netex.com    IP compression and channel extension
    • netezza.com    Big Data – Data warehouse storage solutions (Bought by IBM)
    • Netgear.com    SOHO and SMB storage and networking
    • NetIQ    Data center, security, identify and data protection management
    • netlist.com    Memory solutions
    • netoptics.com    Network monitoring
    • netronome.com    Network and I/O optimization technology
    • netspi.com    Network security and digital forensics
    • networkappliance.com    Storage sub-systems, management software
    • networkgeneral.com    Network and application monitoring
    • networkinstruments.com    Network test and diagnostic and performance monitoring
    • netwrix.com    Enterprise systems management tools
    • netxen.com    High performance 10Gb Ethernet chips and NICs
    • neuwingenergy.com    Energy management organization
    • neuxpower.com    File compression and data reduction
    • Neverfailgroup.com    HA software
    • nevex.com    Caching and application acceleration
    • newboundary.com    IT policy management and IRM tools
    • newisys.com    Storage enclosures
    • newrelic.com    Web, cloud and application management
    • nexenta.com    ZFS based storage management solutions
    • nexgenstorage.com    Storage with PCIe flash card
    • nexsan.com    SAS/SATA and MAID storage subsystems (Bought by Imaiton)
    • nextio.com    SSD and application acceleration solutions
    • NexusMN / Computex    VAR (e.g. Formerly Nexus MN and Stratos – now Computex)
    • nfpa.org    National Fire Protection Association
    • nicira.com    Software defined networking and IOV (Bought by VMware)
    • nimblestorage.com    Converged iSCSI SAN, backup and DR
    • nimbula.com    Cloud and application orchestration management tools
    • Nimbusdata.com    iSCSI storage
    • nirvanix.com    Cloud storage provider (Ceased operations)
    • njvc.com    Cloud and technology service provider
    • Nylte    DCIM software tools
    • noggin.intel.com/rr/    Intel Recommended Reading List
    • noliosoft.com    Cloud application management tools
    • Norlight.com    Data communications and services
    • nortel.com    Networking products
    • nortelnetworks.com    Optical networking
    • northernsoft.com    Medical software
    • novastor.com    Backup and cloud data protection tools
    • Novell.com    Server software vendor (Bought by Attachmate)
    • Novuscg.com    Storage management and services (Bought by IBM)
    • Nomura Research Institute (NRI)    AWS connect parter, Hosting/cloud/access services
    • nsic.org    National Storage Industry Consortium
    • ntp.com    Storage Management Software
    • NTT Communications Corporation    AWS connect parter, Hosting/cloud/access services
    • numarasoftware.com    IT Resource management, asset tracking tools
    • numonyx.com    SSD memory solutions
    • nutanix.com    Converged server and storage VM platform
    • nvelo.com    Caching IO performance tools
    • nvidia.com    Graphics and visualization tools
    • ocarinanetworks.com    Data reduction and compression tools (Bought by Dell)
    • ocztechnology.com    SSD drives and PCIe cards (Bought by Toshiba after bankruptcy)
    • offsitebackups.com    Online and cloud backup solutions
    • olixir.com    Removable storage for backup and data protection
    • omneon.com    Archiving and fixed content storage solutions
    • onapp.com    Cloud, CDN and storage tools
    • onaro.com    Storage and Storage Network Management (Bought by NetApp)
    • onlinebackupsearch.com    Various online backup reviews
    • oblinecourses.com    Various online education courses for various topics
    • onpathtech.com    Physical layer networking
    • onstor.com    Clustered NAS storage including NAS gateways (Bought by LSI)
    • Ontrack.com    Email and data protection software
    • OO Software   Windows management and data protection tools
    • opalis.com    Virtual data center management tools
    • OpenCompute   OpenCompute consortium
    • opendatacenteralliance.org    Open Data Center Alliance
    • open-e.com    iSCSI and NAS storage
    • Open.IO    Application aware object and bulk scale out software defined storage
    • openfabrics.org    Open Fabric Alliance
    • OpenNebula    Open source cloud software
    • opennetworking.org    Open Networking Foundation
    • OpensourceSystems.com    Data storage solutions
    • OpenStack   Open source cloud compute and storage software
    • opnet.com    Application and network performance management
    • Opsware.com    Network and storage management (HP)
    • Optica Tech.    Server and storage connectivity including FICON
    • opticatech.com    Mainframe and ESCON encryption
    • oracle.com    Data management software, hardware and services (Bought Sun/STK and others)
    • Ortera.com    Performance monitoring and management
    • OSNEXUS   Quantstor ZFS based Storage management solutions
    • Outsource Data Recovery   Data Recovery services
    • overlandstorage.com    Tape and backup, data retention, NAS solutions
    • owncloud.org    Cloud infrastructure tools

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    Visit the following additional data infrastructure and IT data center related links.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Data Infrastructure IT Industry Related Resource Links P to T

    Data Infrastructure IT Industry Related Resource Links P to T

    IT Data Center and Data Infrastructure Industry Resources

    Updated 6/13/2018

    Following are some useful Data Infrastructure IT Industry Resource Links P to T to cloud, virtual and traditional IT data infrastructure related web sites. The data infrastructure environment (servers, storage, IO and networking, hardware, software, services, virtual, container and cloud) is rapidly changing. You may encounter a missing URL, or a URL that has changed. This list is updated on a regular basis to reflect changes (additions, changes, and retirement).

    Disclaimer and note: URL’s submitted for inclusion on this site will be reviewed for consideration and to be in generally accepted good taste in regards to the theme of this site.

    Best effort has been made to validate and verify the data infrastructure URLs that appear on this page and web site however they are subject to change. The author and/or maintainer(s) of this page and web site make no endorsement to and assume no responsibility for the URLs and their content that are listed on this page.

    Software Defined Data Infrastructure Essentials Book SDDC

    Send an email note to info at storageio dot com that includes company name, URL, contact name, title and phone number along with a brief 40 character description to be considered for addition to the above data infrastructure list, or, to be removed. Note that Server StorageIO and UnlimitedIO LLC (e.g. StorageIO) does not sell, trade, barter, borrow or share your contact information per our Privacy and Disclosure policy. View related data infrastructure Server StorageIO content here, and signup for our free newsletter here.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    • Packeteer.com    WAFS and networking solutions (Bought Tacit)
    • packetlight.com    CWDM and DWDM networking solutions
    • Panasas.com    Clustered storage solution
    • pancetera.com    Virtual machine backup software (Bought by Quantum)
    • Panduit.com    Networking and cable management
    • panzura.com    Cloud storage access software
    • paraccel.com     Business and data analytics
    • paragon-software.com    Storage management and backup tools
    • parallels.com    VDI and desktop virtualization and cloud tools
    • parascale.com     Clustered and cloud storage software
    • pcisig.com    PCI trade group (PCI, PCI-X, PCI-Express/PCIe)
    • penguincomputing.com    HPC servers, storage and hosting
    • pergamumsystems.com    Archive solutions (Stealth)
    • Permabit.com    Data archiving solutions
    • Pernixdata    Server and storage I/O cache optimization for virtual servers
    • perotsystems.com    Hosting and managed service provider (Bought by Dell)
    • pgp.com    Security tools (Bought by Symantec)
    • PHDvirtual    Data protection tools
    • Pillardata.com    Data storage solutions – (Bought by Oracle)
    • pineapp.com    Email, archive solutions, web and data protection
    • Piviot3.com    IP Storage
    • Pivotal Labs    Big Data, PaaS development tools, EMC/VMware spinout
    • plasmon.com    (Now called Alliance Storage Technologies) Optical Storage Solutions
    • plextoramericas.com    SSD and other storage solutions
    • plianttechnology.com    Solid state storage devices (SSD) – (Bought by SANdisk)
    • Pluribus Networks    Converged and software defined network management
    • pmc-serria.com    Storage networking component supplier
    • pny.com    Memory componets and technology
    • Pogoplug    Cloud storage
    • PolyServe.com    Clustered storage solutions (Sold to HP)
    • Polargy    Data Center facilaties, HVAC and DCIM solutions
    • power.org    Power Processor trade group
    • Mushkin   SSD Solutions
    • Peak Cloud    Cloud and storage services
    • PowerFile.com    Data archiving solutions
    • powerware.com    UPS and power conditioning systems
    • procedo.com    Archiving and migration solutions
    • proceedtechnologies.com    SAP consulting
    • profusionbackups.com    Cloud and managed backup service solution
    • progeny.net    VAR and specialized IT systems
    • prolexic.com    Distributed denial of service tools
    • promise.com    RAID storage systems
    • Prostorsystems.com    Removable disk storage (See RDX Alliance)
    • Proxim.com    Wireless networking
    • proximaldata.com    SSD caching and tiering software
    • pt.com    Communications hardware and software
    • puresi.com aka Puresilicon    SSD storage solutions
    • purestorage.com    SSD based storage
    • Puppet Labs    IT Automation and DCIM tools for physical, Cloud and Virtual

    • qlogic.com    Host bus adapters and switches
    • qsantechnology.com    iSCSI IP storage
    • Qstart Technologies    Data protection storage including LTFS based systems
    • Quadric Software    Data protection software
    • qualstar.com    Tape backup and archive solutions (Aka Qstar)
    • quantum.com    Tape drives and libraries
    • quest.com    IT and data management solution tools (Bought by Dell)
    • Qumulo    Stealth storage startup
    • qwest.com    (Century Link) Telephone and data networking, managed services provider
    • racemi.com    Repurposing management tools
    • Rackable.com    Now SGI
    • Rackspace.com    Managed services and hosting
    • www.rackwise.com    Data center management tools
    • raidinc.com    Storage systems
    • raidundant.com    Storage systems
    • Rainfinity.com    File virtualization (Bought by EMC)
    • rainstor.com    Big data management tools
    • rapidio.org    RapidIO Trade Group
    • Raritan    Data center and DCIM tools
    • rasilient.com    Storage subsystem vendor
    • Ravello    VMware optimization and management tools
    • Raxco    Data, storage and systems management tools
    • rebit.com    Backup and data protection solutions
    • RecordNation    Digital Data Storage and Records Management
    • redbend.com    Mobile device and application management
    • redbooks.ibm.com    IBM Red books and Red pieces technical articles
    • Redhat.com    Linux provider (Bought Gluster)
    • Reduxio    Hybrid storage with data services
    • reflexphotonics.com    Optical connectivity solutions
    • Reldata.com    Storage systems (Renamed Starboard)
    • remote-backup.com    Remote backup software
    • renewdata.com    Data management and compliance tools
    • repliweb.com    Web and content distribution
    • Retrospect    Data Protection Software Tools
    • revivio.com    Data Protection Software (Assets Bought by Symantec)
    • rightscale.com    Amazon cloud computing management tools
    • rimage.com    CD/DVD production technologies
    • risingtidesystems.com    VAR
    • Ritek.com    Storage solutions
    • rittal.com    Enclosures and cabinets
    • riverbed.com    Wide area file access acceleration solution
    • rjssoftware.com    Document capture and management
    • rmsource.com    Cloud backup solutions
    • rnanetworks.com    Virtual memory management solutions (Bought by Dell)
    • rocketdivision.com    iSCSI technologies
    • rorke.com    VAR
    • rpath.com    Data center automation
    • rsa.com    Security division of EMC
    • safemediacorp.com    Internet security and intrusion detection tools
    • safenet-inc.com    Data protection focused VAR
    • Sagecloud   Cloud storage, deep cold archive
    • samsung.com    Various technologies including SSD memory
    • sanblaze.com    Embedded storage and emulation solutions
    • SANbolic.com    Storage, server and cloud management tools
    • sand-chip.com    Chip design
    • SANDforce.com    SSD storage solutions – (Bought by LSI)
    • sandial.com    Defunct SAN startup
    • SANdisk.com    SSD memory components
    • sandpiperdata.com    Data migration services
    • sanmina-sci.com    Contract manufacturer (Virtual Factory) for various OEM/VARs
    • sanovi.com    Disaster recovery management tools
    • sanpulse.com    SRA and automation tools
    • sanrad.com    Storage networking routers (Bought by OCZ)
    • sans.org    Security related web site
    • sansdigital.com    VAR
    • sap.com    Information management tools and applications
    • sas.com    Statistical analysis software
    • sata-io.org    Serial ATA trade organization
    • SavageIO   High performance storage solutions
    • savvis.com    Cloud, managed service provider and hosting (Bought by Centurylink)
    • sbbwg.org    Storage Bridge Bay Working Group
    • scalable-systems.com    Data warehouse consulting and tools
    • scalecomputing.com    Clustered storage management software
    • scalemp.com    Virtualization technology for scale out computing
    • scalent.com    Virtual IT data center management tools
    • scality.com    Email and sharepoint cloud storage
    • schoonerinfotech.com    SSD based database management solutions
    • scsita.org    SCSI and SAS trade group
    • seagate.com    Disk drives
    • Sealpath   Data and information protection tools
    • seanodes.com    Distributed storage
    • sec.gov    Site about compliance items including CFR 17a-4
    • securedatainnovations.com    Data protection and security tools
    • sentilla.com    Data center performance management tools
    • sepaton.com    Disk based backup solutions
    • serialata.org    Serial ATA trade association
    • servicemesh.com    Cloud, datacenter transformation and devops tools
    • servicenow.com    ITIL data center management tools
    • 1servosity.com    Cloud data protection
    • servoy.com    Cloud development tools
    • ServPath.com    Hosting services
    • seven10storage.com    Disaster recovery and archiving software
    • sgi.com    Storage, server and data management hardware, software, tools
    • sherpasoftware.com    Email archiving
    • shop.bellmicro.com    Distributor (Bought by Avnet)
    • siber.com    Data protection and security tools
    • sidusdata.com    Managed service and cloud provider
    • siemon.com    Storage networking infrastructure items
    • sigmasol.com    Value added reseller (VAR)
    • Signiant.com    Data management tools
    • silexamerica.com    Mobile device and server connectivity
    • SiliconImage.com    Digital Video components
    • SiliconStor.com    Storage networking silicon
    • siliconvalleypr.com    IT technologies press/media and analyst relations firm
    • silveradotech.com    VAR
    • silver-peak.com    Wide area data and file services (WAFS, WADM, WADS)
    • SilverSky    Cloud security
    • simpletech.com    Storage solutions including USB portable devices
    • simplivity.com    Convergence and virtualization solutions
    • simplycontinuous.net    Data protection and cloud backup
    • siriuscom.com    VAR
    • site-vault.com    On-line backup server provider (BSP) managed service provider (MSP)
    • skyera.com    SSD storage solutions
    • skytap.com    Public and private cloud application development tools
    • Smart421   Smart421    AWS connect parter, Hosting/cloud/access services
    • smartm.com    PC card and other memory module components
    • smc.com    Storage and networking components
    • smithmicro.com    Mobile data management tools
    • smmdirect.com    Memory devices
    • snapappliances.com    NAS Storage solutions (Now Adaptec)
    • snia.org    Storage Networking Industry Association
    • snseurope.com    U.K. & European Storage Networking News
    • snwusa.com    SNIA and Computerworld conference
    • softek.com    Storage management solutions (formerly Fujitsu Softek, Sold to IBM)
    • softlayer.com    Cloud infrastructure services (IaaS) (Bought by IBM)
    • softnas.com    ZFS based opensource NAS solutions
    • softricity.com    Virtualization management tools (Bought by Microsoft)
    • Sogeti.com    Data management tools
    • solarflare.com    10Gb Ethernet networking
    • solarwinds.com    IT management tools (Bought TekTools, Hyper9 and others)
    • solidaccess.com    Solid state storage (SSD) solutions
    • soliddata.com    Solid State Disk solutions
    • solidfire.com    iSCSI SSD optimized for hosting and cloud providers
    • Solix.com    Database archiving software
    • solutiontechnology.co.uk    Storage networking training
    • sonasoft.com    Email archiving, backup and data protection
    • sonnettech.com    External storage solutions
    • sony.com    Storage devices
    • sophos.com    Data protection and security tools
    • sorrento.com    Optical networking
    • sparebackup.com    Backup data protection solutions
    • sparkweave.com    Private cloud archive and file sharing
    • spec.org    SPEC benchmarks
    • spectralogic.com    Tape library and disk based backup solutions
    • spiceworks.com    Online community and management software tools
    • spirent.com    Storage networking test equipment
    • Spiron.com  Data discovery, classification, lifecycle management (formerly Identity Finder)
    • Splice Communications   Splice Communications    AWS connect parter, Hosting/cloud/access services
    • splunk.com    DCIM and log management tools
    • spotcloud.com    Cloud services clearing house
    • spraycool.com    IT Data center and component cooling
    • springsoft.com    Bought by Synopsys
    • spsoftglobal.com    Software development
    • spyrus.com    Security tools
    • ssswg.org    IEEE Storage Systems Standards Work Group
    • starboardstorage.com    Unified storage solutions (Formerly Reldata, now ceased operations)
    • startech.com    IT/AV technolgie equipment from enclosures to KVM and more
    • starwindsoftware.com    iSCSI storage management solutions
    • stcroixsolutions.com    VAR
    • stec-inc.com    SSD storage (Bought by WD)
    • Steeleye.com    HA software
    • Stellar    Data Protection tools
    • storagetek.com    Disk, tape, data management software (Bought by Sun)
    • stonebranch.com    File transfer tools
    • stonefly.com    Storage networking routers (Aka DNF)
    • storability.com    Storage management software (Bought by STK)
    • storactive.com    Data protection solutions
    • storagecraft.com    Data protection tools
    • storagefusion.com    Storage resource analysis (SRA) tools
    • storageio.net    Alternate URL for the StorageIO Group
    • storageiogroup.com    Alternate URL for the StorageIO Group
    • storagemadeeasy.com    Hybrid and personal cloud management tools and dashboards
    • Storagemonkeys.com    Storage community site
    • storagenetworking.org    Storage Networking Users Groups also known as SNUGs
    • storageperformance.org    Storage Performance Council information
    • www.storagesearch.com    Venue for information about various storage and related topics
    • storcase.com    Data Archive solutions (Bought by Crudata)
    • store-age.com    Storage management software (Bought by LSI)
    • storediq.com    eDiscovery, search, indexing, classification (Bought by IBM)
    • Storewize.com    Real time data compression (Bought by IBM)
    • Storix.com    Data backup solutions
    • storlife.com    CAS object archive storage
    • stormagic.com    Storage virtualization and data movement software
    • storserver.com    Backup and data protection solutions
    • storsimple.com    Cloud storage access solutions (Bought by Microsoft)
    • storspeed.com    NAS/NFS optimization solutions (Missing in action)
    • stratascale.com    Cloud, hosting and management solutions
    • stratus.com    High availability storage and servers
    • sugarsync.com    Backup and data protection solutions
    • sun.com    Storage networking hardware and software (Bought by Oracle)
    • sunbeltsoftware.com    End point data protection security tools
    • sungard.com    Data protection and cloud services
    • superlumin.com    Application caching tools
    • supermicro.com    Server and storage solutions
    • surdoc.com    Cloud storage and backup
    • surgient.com    Cloud computing solutions
    • svlg.net    Silicon Valley Leadership Group
    • Swiftstack    Private cloud solutions
    • swifttest.com    NFS and CIFS storage testing solutions
    • sybase.com    Database solutions
    • sycamorenetworks.com    Networking solutions
    • Symantec.com    Data and storage management software
    • symbolicio.com    stealth startup
    • symform.com    Cloud storage and backup
    • syncsort.com    Information Management tools
    • synnex.com    Distributor
    • Synnex   IT Solutions
    • synology.com    SMB storage solutions
    • synopsys.com    Computer technology development and manufacturing
    • SysAid    Data center, DCIM and ITSM tools
    • t10.orgscsi-3.htm    ANSI T10 (SCSI information) site
    • t11.org    ANSI T11 page for Fibre Channel information
    • t3media.com    Cloud storage and video platform tools
    • tableausoftware.com    Data analytics software tools
    • tacit.com    WAN file system accelerator (Bought by Packeteer)
    • tacitnetworks.com    Wide area file access acceleration solution (Bought by Packeteer)
    • tandberg.com    Data management solutions (Bought by Cisco)
    • tapeandmedia.com    Information about magnetic tape media
    • tapepower.com    Site for tape topics
    • tarmin.com        Archiving solutions
    • teamdrive.com    Cloud storage
    • teamquest.com    IRM management and capacity management tools
    • TeamViewer.com    Remote support and Online meeting software
    • techdata.com    Distributor
    • tegile.com    Storage system solutions
    • tehutinetworks.net    High speed iSCSI adapters
    • tek-tools.com    SRM storage management software (Bought by Solarwinds)
    • TelecityGroup    AWS connect parter, Hosting/cloud/access services
    • tellabs.com    Networking components
    • Telx    AWS connect parter, Hosting/cloud/access services
    • teneros.com    Email archiving and management solutions
    • teracloud.com    Capacity planning and resource management software
    • teradata.com    Large scale database and data warehouse systems
    • teradici.com    PC over IP technologies
    • teranetics.com    Ethernet chips
    • Terascala    Data analytics and management solutions
    • ter.de    Optical storage libraries
    • terracloudinc.com    Cloud services
    • TerraScale.com    Scalable storage and server solutions
    • Verizon/Terremark   Cloud, hosting and managed services
    • Tevron   Application Response Time Monitoring
    • texmemsys.com    Solid State Disk storage
    • thebci.org    Business Continuity Institute
    • thecus.com    Multi-protocol storage
    • thegreengrid.org    Industry Trade Group
    • The Padcaster    Apple iPad tools
    • thepluggllc.com    Data center energy efficient floor tiles
    • theq3.com    Data storage security solutions
    • thinkaheadit.com aka Ahead    Value added reseller
    • thinkaheadit.com    Value added reseller (VAR)
    • thirdbrigade.com    Intrusion detection security tools (Bought by Trend Micro)
    • thirdio.com    SSD solutions
    • tiaonline.org    Telecommunications Industry Association
    • tidalsoftware.com    IT Management software tools (Bought by Cisco)
    • timespring.com    Continuous data protection solutions
    • tintri.com    NFS and NAS storage optimized for VMware
    • tivoli.com    Data management software
    • Softbank Telecom Corp.    AWS connect parter, Hosting/cloud/access services
    • Primary Data and Tonian    Stealth data virtualization startup
    • topgun-tech.com    Data Infrastructure Resource (Server, Storage, SANs)
    • top500.org    Top 500 super compute sites
    • topio.com    Data protection software (Bought by NetApp)
    • topspin.com    InfiniBand Technology (Bought by Cisco)(
    • Toshiba.com    Server and storage solutions
    • tpc.org    Transaction processing performance council
    • translattice.com    Distributed and elastic database and automation tools
    • Tredent.com    WAN optimization solutions
    • TrendMicro.com    Security and anti virus tools
    • trianz.com    VAR
    • tributary.com   Datra protection soultion tools including virtual, disk and tape-
    • trilogytechnologies.ie    Managed services provider
    • tritondata.com    IT services and VAR
    • trunkbow.com    Cloud, mobile and networking services
    • trustedcomputinggroup.org    Trusted computing industry trade group
    • trusteddatasolutions.com    VAR
    • trustedid.com    ID theft protection
    • trustware.com    Internet and data protection security tools
    • turnkeylinux.org   Turnkey Linux appliance –
    • tusc.com    VAR
    • twinstrata.com    BC/DR analysis and cloud access software
    • tw telecom   tw telecom    AWS connect parter, Hosting/cloud/access services
    • TSO logic    DCIM and data center power energy management tools
    • tzolkin.com    DNS and High Availability solutions

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    Visit the following additional data infrastructure and IT data center related links.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Data Infrastructure IT Industry Related Resource Links U to Z

    Data Infrastructure IT Industry Related Resource Links U to Z

    IT Data Center and Data Infrastructure Industry Resources

    Updated 2/20/2018

    Following are some useful Data Infrastructure IT Industry Resource Links U to Z to cloud, virtual and traditional IT data infrastructure related web sites. The data infrastructure environment (servers, storage, IO and networking, hardware, software, services, virtual, container and cloud) is rapidly changing. You may encounter a missing URL, or a URL that has changed. This list is updated on a regular basis to reflect changes (additions, changes, and retirement).

    Disclaimer and note: URL’s submitted for inclusion on this site will be reviewed for consideration and to be in generally accepted good taste in regards to the theme of this site.

    Best effort has been made to validate and verify the data infrastructure URLs that appear on this page and web site however they are subject to change. The author and/or maintainer(s) of this page and web site make no endorsement to and assume no responsibility for the URLs and their content that are listed on this page.

    Software Defined Data Infrastructure Essentials Book SDDC

    Send an email note to info at storageio dot com that includes company name, URL, contact name, title and phone number along with a brief 40 character description to be considered for addition to the above data infrastructure list, or, to be removed. Note that Server StorageIO and UnlimitedIO LLC (e.g. StorageIO) does not sell, trade, barter, borrow or share your contact information per our Privacy and Disclosure policy. View related data infrastructure Server StorageIO content here, and signup for our free newsletter here.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    • ubuntu.com    Opensource Linux software and cloud tools
    • unisys.com    Server, storage and managed services
    • unitedlayer.com    Collocation and hosting services
    • unitrends.com    Data protection solutions
    • updraftplus.com/    WordPress Updraft Cloud Backup Plugin
    • uptimeinstitute.org    Uptime Institute
    • uptimesoftware.com    Capacity management tools
    • Logicalis   IT solutions and managed services
    • us.logicalis.com    Cloud, managed and data center services
    • usb.org    USB trade association
    • uscolo.com    Co-location facility and hosting service
    • usenix.org    LISA and data center forums
    • usgbc.org    United States Green Building Council
    • v3sys.com    VDI and desktop cloud solutions
    • vadiumtech.com    Security and encryption tools
    • varonis.com    Unstructured data management and protection
    • vaultive.com    Cloud encryption for hosted exchange
    • vaultize.com    Cloud backup, file and data sharing
    • vaultstor.com    Data protection and cloud storage services
    • vaultus.com   Cloud, colo and manged service hosting –
    • vbridges.com    Virtual desktop management tools
    • vce.com    Converged infrastructure solutions
    • vdbench     vdbench storage testing/workload generation tool
    • veeam.com    Virtual server data protection, reporting, monitoring, cap planning
    • vellosystems.com   Cloud infrastructure technology solutoins –
    • velobit.com    SSD cache software (Bought by WD)
    • veloxum.com   VM performance management tools Added 11/30/10
    • vembu.com    Backup data protection tools
    • Venus   Venus    AWS connect parter, Hosting/cloud/access services
    • venyu.com    Cloud hosting
    • verari.com    Blade servers and blade storage
    • verdiem.com    Infrastructure Resource Management (IRM) and energy reporting tools
    • vericept.com    Network monitoring software
    • Veritest.com    Third party testing service

    • verity.com    Data search, discovery, classification
    • versant.com    Object database management solutions
    • vertinsys.com    Server I/O virtualization
    • Vibe    AWS connect parter, Hosting/cloud/access services
    • victorinox.com    Swiss army knife and USB thumb drive
    • viewfinity.com    Rights management, audit and compliance
    • vigitrust.com    Security management tools
    • vikingmodular.com    FLASH SSD storage solutions
    • violin-memory.com    FLASH SSD storage solutions
    • vion.com    Value added reseller
    • vipreantivirus.com    Security, data loss, data leak prevention
    • virident.com    SSD based database management solutions (Bought by WD)
    • viridity.com    Data center and infrastructure resource management (IRM) tools
    • virsto.com    Server virtualization management tools (Bought by VMware)
    • virtensys.com    Virtual I/O and I/O virtualization (IOV)
    • virtualinstruments.com    SAN probes/analyzers (Formerly Finisar Analyzer tools)
    • VirtualIron.com    Server virtualization (Bought by Oracle)
    • VirtunetSystems    Storage I/O acceleration and cache tools for VMware
    • virtuon-inc.com    Cloud, virtualization IT consulting and staffing
    • visi.com    Managed service provider, cloud and hosting service
    • VisionSolutions.com    BC, DR and data protection solutions
    • visualstorageintelligence.com    Cross vendor cloud storage reporting and srmprovider
    • vitesse.com    Storage networking component supplier
    • vivisimo.com    eDiscovery and search
    • vizoncore.com    Virtualization tools and data protection for virtual servers
    • vizrt.com    Video management software tools
    • vkernel.com    VM performance tools (Bought by Quest, bought by Dell)
    • vmc.com    Cloud consulting and outsourcing
    • vmturbo.com    Cloud and virtualization workload management
    • vmware.com    Server virtualization software (Bought by EMC)
    • Vocus   Vocus    AWS connect parter, Hosting/cloud/access services
    • voltaire.com    InfiniBand Technology
    • vontu.com    Data loss prevention tools (Bought by Symantec)
    • Vormetric   Data security solutions
    • votela.com    Specialized network service provider
    • vscalesystems.com    Virtual and converged networking and consulting
    • vssmonitoring.com    Network monitoring
    • vwsolutions.com    Backup and data protection solutions
    • vyatta.com    Cloud and virtual networking, IOV
    • wanova.com    Desktop management solutions
    • wasabisystems.com    iSCSI storage
    • wdc.com    Western Digital Disk drives
    • WedgeNetworks.com    Security solutions
    • whiptailtech.com    Flash SSD solutions (Bought by Cisco)
    • Microsoft Skydrive   Cloud storage
    • windspring.com    Data management and DFR for mobile access
    • wipro.com    Business services
    • workscomputing.com    VAR
    • wovensystems.com    High speed networking switches
    • wwt.com    VAR/Systems integrator
    • wysdm.com    SRA and DPM management tools (Bought by EMC)
    • Xencode.com    Various open tools
    • XenData   Digital Archive solutions
    • xenos.com    Archive and data footprint reduction solutions
    • xfpmsa.org    10Gb multi-source trade group
    • xiotech.com    Renamed XIO: Storage sub-systems and software
    • xirin.com    Storage adapter (iSCSI) and chip vendor
    • xosoft.com    BC/DR and data protection replication tools (Bought by CA)
    • xsigo.com    I/O virtualization and service oriented connectivity – (Bought by Oracle)
    • xtreemfs.org    scaleout filesystem
    • xtremio.com    SSD startup – Bought by EMC
    • xyratex.com    Storage enclosures, subsystems, test equipmen, Lustre software (Bought by Seagate)t
    • xyxel.com    Networking technologies for cloud and consumer
    • yorktel.com    video solutions
    • Yosemitetech.com    Backup software (Bought by Barracuda)
    • yousendit.com    Cloud backup, storage and file sharing
    • zadarastorage.com    iSCSI cloud storage
    • zenoss.com    Converged, Virtual systems and cloud monitoring, DCIM
    • Zentera   Private cloud and IaaS solutions
    • zerto.com    Data protection for virtual environments
    • Zetera.com    Storage over IP alternative to iSCSI
    • zetta.net    Cloud storage solutions
    • zettapoint.com    Database management tools
    • zintrus.com    Systems development
    • zirtu.com    VDI management tools and platform
    • zlti.com    Email archive and management solutions
    • zmanda.com    Open source data backup
    • zoho.com    Online and cloud management solutions
    • zyrion.com    Network and systems monitoring and management

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    Visit the following additional data infrastructure and IT data center related links.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Data Infrastructure IT Industry Related Resource Links to Others

    Data Infrastructure IT Industry Related Resource Links to Others

    IT Data Center and Data Infrastructure Industry Resources

    Updated 2/20/2018

    Following are some useful Data Infrastructure IT Industry Resource Links to cloud, virtual and traditional IT data infrastructure related web sites. The data infrastructure environment (servers, storage, IO and networking, hardware, software, services, virtual, container and cloud) is rapidly changing. You may encounter a missing URL, or a URL that has changed. This list is updated on a regular basis to reflect changes (additions, changes, and retirement).

    Disclaimer and note: URL’s submitted for inclusion on this site will be reviewed for consideration and to be in generally accepted good taste in regards to the theme of this site.

    Best effort has been made to validate and verify the data infrastructure URLs that appear on this page and web site however they are subject to change. The author and/or maintainer(s) of this page and web site make no endorsement to and assume no responsibility for the URLs and their content that are listed on this page.

    Software Defined Data Infrastructure Essentials Book SDDC

    Send an email note to info at storageio dot com that includes company name, URL, contact name, title and phone number along with a brief 40 character description to be considered for addition to the above data infrastructure list, or, to be removed. Note that Server StorageIO and UnlimitedIO LLC (e.g. StorageIO) does not sell, trade, barter, borrow or share your contact information per our Privacy and Disclosure policy. View related data infrastructure Server StorageIO content here, and signup for our free newsletter here.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    • www.10gea.org    10Gb Ethernet industry trade organization
    • www.1394ta.org    1394 (Firewire) trade association
    • www.3com.com    Networking equipment (Bought by HP)
    • www.3leafnetworks.com    I/O virtualization
    • www.3par.com    Clustered storage systems (Bought by HP)
    • www.3tera.com    IT Cloud management tools (Bought by CA)
    • www.4blox.com    Data center design services
    • www.4blox.com    Linux iSCSI target optimization stack
    • www.4bridgeworks.com aka Bridgeworks    SAN networking and connectivity solutions
    • www.80plus.org    Energy efficient power supply trade group

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    Visit the following additional data infrastructure and IT data center related links.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    2016 Going Dutch Cloud Virtualization Server Storage I/O Seminars

    2016 Going Dutch Cloud Virtualization Server Storage I/O Seminars

    server storage I/O trends

    In June 2016 Brouwer Storage Consultancy is organizing their yearly spring seminar workshops in Nijkerk Holland (south of Amsterdam, near Utrecht and Amersfoort) with myself among others presenting.

    Brouwer Consultancy

    Cloud Virtualization Server Storage I/O Seminars

    For this series of seminar workshops, there are four sessions, two being presented by myself, and two others in conjunction with Reduxio as well as Fujitsu & SJ Solutions.

    Brouwer and Server StorageIO Seminar Sessions

    Agenda, How To Register and Where To Learn More

    The vendor sponsored sessions will consist of about 50% content being independent presented by myself and Gert Brouwer, the balance by the event sponsors as well as their partners. All presentation and associated content including handouts will be in English.

    There will be 4 seminar workshop sessions, two of those are paid sessions dedicated to Greg Schulz and the other two are free (sponsored) sessions where 50% of the content is sponsored (Reduxio, FujitsuSJ Solutions) and the other 50% will be independent (Greg Schulz & Gert Brouwer).

    Thursday June 9th – Server StorageIO Trends and Updates

    Server Storage I/O Fundamental Trends V2.016 and Updates. What’s New, What’s the buzz, what you need to know about. From Speeds and Feeds, Slots and Watts to Who’s doing what. Event Location: Golden Tulip Ampt van Nijkerk Hotel, Berencamperweg 4, 3861MC, Nijkerk. Learn more here (PDF abstract and topics to be covered).

    Thursday June 10th – Converged Day

    Converged Day – Moving beyond Hyper-Converged Hype and Server Storage I/O Decision Making Strategies. Event Location: Golden Tulip Ampt van Nijkerk Hotel, Berencamperweg 4, 3861MC, Nijkerk. Learn more here (PDF abstract and topics to be covered).

    Brouwer and Server StorageIO Seminar Sessions De Roode Schuur

    Tuesday June 14th – Round Table Vendor Session with Reduxio

    Symposium Workshop – Round Table Vendor Session with Reduxio – Are some solutions really ‘a Paradigm shift’ or ‘new and revolutionary” as they claim to be, or is it just more of the same (e.g. evolutionary)? – Presentations and discussions led by Greg Schulz (StorageIO), Reduxio and Brouwer Storage Consultancy. (Free, sponsored Session, Access for end-users only). Event Location: Hotel & Gasterij De Roode Schuur, Oude Barneveldseweg 98, 3862PS Nijkerk. Learn more here (PDF abstract and topics to be covered).

    Wednesday June 15th – Software Defined Data Center Symposium Workshop

    Software Defined Data Center Symposium Workshop – Round Table Vendor Session with Fujitsu & SJ Solutions
    With subjects like Openstack, Ceph, distributed object storage, Bigdata, Hyper-Converged Infrastructure (HCI), Converged Infrastructure (CI), Software defined storage (SDS) and Network (SDN and NFV), this round table format workshop seminars explores these and other related topics including what to use when, where, why and how. Presentations by Greg Schulz (StorageIO), SJ Solutions & Fujitsu and Brouwer Storage Consultancy. Event Location: Hotel & Gasterij De Roode Schuur, Oude Barneveldseweg 98, 3862PS Nijkerk. Learn more here (PDF abstract and topics to be covered).

    For more information, abstracts/agenda, registration and the specific locations for all the above events click here.

    Brouwer and Server StorageIO Sessions Ampt van Nijkerk

    What This All Means

    There is a lot of things occurring in the IT industry from physical to software defined clouds, containers and virtualization, nonvolatile memory (NVM) including flash SSD among others. These series of interactive educational workshop seminars converge on Nijkerk Holland combing content discussions from strategy, planning decision making, to what’s new (and old) that can be used in new ways, as well as some trends, speeds and feeds along with practicality for your environment.

    Brouwer Consultancy

    I Look forward to seeing you in Nijkerk and Europe during June 2016, in the meantime, contact Brouwer Storage Consultancy for more information on the above sessions as well as to arrange private discussions or meetings.

    Ok, nuff said, for now…

    Cheers
    Gs

    Greg Schulz – Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press) and Resilient Storage Networks (Elsevier)
    twitter @storageio

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2023 Server StorageIO(R) and UnlimitedIO All Rights Reserved

    Big Files Lots of Little File Processing Benchmarking with Vdbench

    Big Files Lots of Little File Processing Benchmarking with Vdbench


    server storage data infrastructure i/o File Processing Benchmarking with Vdbench

    Updated 2/10/2018

    Need to test a server, storage I/O networking, hardware, software, services, cloud, virtual, physical or other environment that is either doing some form of file processing, or, that you simply want to have some extra workload running in the background for what ever reason? An option is File Processing Benchmarking with Vdbench.

    I/O performance

    Getting Started


    Here’s a quick and relatively easy way to do it with Vdbench (Free from Oracle). Granted there are other tools, both for free and for fee that can similar things, however we will leave those for another day and post. Here’s the con to this approach, there is no Uui Gui like what you have available with some other tools Here’s the pro to this approach, its free, flexible and limited by your creative, amount of storage space, server memory and I/O capacity.

    If you need a background on Vdbench and benchmarking, check out the series of related posts here (e.g. www.storageio.com/performance).

    Get and Install the Vdbench Bits and Bytes


    If you do not already have Vdbench installed, get a copy from the Oracle or Source Forge site (now points to Oracle here).

    Vdbench is free, you simply sign-up and accept the free license, select the version down load (it is a single, common distribution for all OS) the bits as well as documentation.

    Installation particular on Windows is really easy, basically follow the instructions in the documentation by copying the contents of the download folder to a specified directory, set up any environment variables, and make sure that you have Java installed.

    Here is a hint and tip for Windows Servers, if you get an error message about counters, open a command prompt with Administrator rights, and type the command:

    $ lodctr /r


    The above command will reset your I/O counters. Note however that command will also overwrite counters if enabled so only use it if you have to.

    Likewise *nix install is also easy, copy the files, make sure to copy the applicable *nix shell script (they are in the download folder), and verify Java is installed and working.

    You can do a vdbench -t (windows) or ./vdbench -t (*nix) to verify that it is working.

    Vdbench File Processing

    There are many options with Vdbench as it has a very robust command and scripting language including ability to set up for loops among other things. We are only going to touch the surface here using its file processing capabilities. Likewise, Vdbench can run from a single server accessing multiple storage systems or file systems, as well as running from multiple servers to a single file system. For simplicity, we will stick with the basics in the following examples to exercise a local file system. The limits on the number of files and file size are limited by server memory and storage space.

    You can specify number and depth of directories to put files into for processing. One of the parameters is the anchor point for the file processing, in the following examples =S:\SIOTEMP\FS1 is used as the anchor point. Other parameters include the I/O size, percent reads, number of threads, run time and sample interval as well as output folder name for the result files. Note that unlike some tools, Vdbench does not create a single file of results, rather a folder with several files including summary, totals, parameters, histograms, CSV among others.


    Simple Vdbench File Processing Commands

    For flexibility and ease of use I put the following three Vdbench commands into a simple text file that is then called with parameters on the command line.
    fsd=fsd1,anchor=!fanchor,depth=!dirdep,width=!dirwid,files=!numfiles,size=!filesize

    fwd=fwd1,fsd=fsd1,rdpct=!filrdpct,xfersize=!fxfersize,fileselect=random,fileio=random,threads=!thrds

    rd=rd1,fwd=fwd1,fwdrate=max,format=yes,elapsed=!etime,interval=!itime

    Simple Vdbench script

    # SIO_vdbench_filesystest.txt
    #
    # Example Vdbench script for file processing
    #
    # fanchor = file system place where directories and files will be created
    # dirwid = how wide should the directories be (e.g. how many directories wide)
    # numfiles = how many files per directory
    # filesize = size in in k, m, g e.g. 16k = 16KBytes
    # fxfersize = file I/O transfer size in kbytes
    # thrds = how many threads or workers
    # etime = how long to run in minutes (m) or hours (h)
    # itime = interval sample time e.g. 30 seconds
    # dirdep = how deep the directory tree
    # filrdpct = percent of reads e.g. 90 = 90 percent reads
    # -p processnumber = optional specify a process number, only needed if running multiple vdbenchs at same time, number should be unique
    # -o output file that describes what being done and some config info
    #
    # Sample command line shown for Windows, for *nix add ./
    #
    # The real Vdbench script with command line parameters indicated by !=
    #

    fsd=fsd1,anchor=!fanchor,depth=!dirdep,width=!dirwid,files=!numfiles,size=!filesize

    fwd=fwd1,fsd=fsd1,rdpct=!filrdpct,xfersize=!fxfersize,fileselect=random,fileio=random,threads=!thrds

    rd=rd1,fwd=fwd1,fwdrate=max,format=yes,elapsed=!etime,interval=!itime

    Big Files Processing Script


    With the above script file defined, for Big Files I specify a command line such as the following.
    $ vdbench -f SIO_vdbench_filesystest.txt fanchor=S:\SIOTemp\FS1 dirwid=1 numfiles=60 filesize=5G fxfersize=128k thrds=64 etime=10h itime=30 numdir=1 dirdep=1 filrdpct=90 -p 5576 -o SIOWS2012R220_NOFUZE_5Gx60_BigFiles_64TH_STX1200_020116

    Big Files Processing Example Results


    The following is one of the result files from the folder of results created via the above command for Big File processing showing totals.


    Run totals

    21:09:36.001 Starting RD=format_for_rd1

    Feb 01, 2016 .Interval. .ReqstdOps.. ...cpu%... read ....read.... ...write.... ..mb/sec... mb/sec .xfer.. ...mkdir... ...rmdir... ..create... ...open.... ...close... ..delete...
    rate resp total sys pct rate resp rate resp read write total size rate resp rate resp rate resp rate resp rate resp rate resp
    21:23:34.101 avg_2-28 2848.2 2.70 8.8 8.32 0.0 0.0 0.00 2848.2 2.70 0.00 356.0 356.02 131071 0.0 0.00 0.0 0.00 0.1 109176 0.1 0.55 0.1 2006 0.0 0.00

    21:23:35.009 Starting RD=rd1; elapsed=36000; fwdrate=max. For loops: None

    07:23:35.000 avg_2-1200 4939.5 1.62 18.5 17.3 90.0 4445.8 1.79 493.7 0.07 555.7 61.72 617.44 131071 0.0 0.00 0.0 0.00 0.0 0.00 0.1 0.03 0.1 2.95 0.0 0.00


    Lots of Little Files Processing Script


    For lots of little files, the following is used.


    $ vdbench -f SIO_vdbench_filesystest.txt fanchor=S:\SIOTEMP\FS1 dirwid=64 numfiles=25600 filesize=16k fxfersize=1k thrds=64 etime=10h itime=30 dirdep=1 filrdpct=90 -p 5576 -o SIOWS2012R220_NOFUZE_SmallFiles_64TH_STX1200_020116

    Lots of Little Files Processing Example Results


    The following is one of the result files from the folder of results created via the above command for Big File processing showing totals.
    Run totals

    09:17:38.001 Starting RD=format_for_rd1

    Feb 02, 2016 .Interval. .ReqstdOps.. ...cpu%... read ....read.... ...write.... ..mb/sec... mb/sec .xfer.. ...mkdir... ...rmdir... ..create... ...open.... ...close... ..delete...
    rate resp total sys pct rate resp rate resp read write total size rate resp rate resp rate resp rate resp rate resp rate resp
    09:19:48.016 avg_2-5 10138 0.14 75.7 64.6 0.0 0.0 0.00 10138 0.14 0.00 158.4 158.42 16384 0.0 0.00 0.0 0.00 10138 0.65 10138 0.43 10138 0.05 0.0 0.00

    09:19:49.000 Starting RD=rd1; elapsed=36000; fwdrate=max. For loops: None

    19:19:49.001 avg_2-1200 113049 0.41 67.0 55.0 90.0 101747 0.19 11302 2.42 99.36 11.04 110.40 1023 0.0 0.00 0.0 0.00 0.0 0.00 7065 0.85 7065 1.60 0.0 0.00


    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    The above examples can easily be modified to do different things particular if you read the Vdbench documentation on how to setup multi-host, multi-storage system, multiple job streams to do different types of processing. This means you can benchmark a storage systems, server or converged and hyper-converged platform, or simply put a workload on it as part of other testing. There are even options for handling data footprint reduction such as compression and dedupe.

    Ok, nuff said, for now.

    Gs

    Greg Schulz - Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.