Tag: erasure code

Posted on

Data Protection Diaries Fundamentals Who Is Doing What Toolbox Technology Tools

Data Protection Toolbox Whos Doing What Technology Tools

Updated 1/17/2018

Data protection toolbox is a companion to Software Defined Data Infrastructure Essentials – Cloud, Converged, Virtual Fundamental Server Storage I/O Tradecraft ( CRC Press 2017)

server storage I/O data infrastructure trends

By Greg Schulz – www.storageioblog.com November 26, 2017

This is Part 9 of a multi-part series on Data Protection fundamental tools topics techniques terms technologies trends tradecraft tips as a follow-up to my Data Protection Diaries series, as well as a companion to my new book Software Defined Data Infrastructure Essentials – Cloud, Converged, Virtual Server Storage I/O Fundamental tradecraft (CRC Press 2017).

Software Defined Data Infrastructure Essentials Book SDDC

Click here to view the previous post Part 8 Walking The Data Protection Talk, and click here to view the next post Part 10 Data Protection Resources Where to Learn More.

Post in the series includes excerpts from Software Defined Data Infrastructure (SDDI) pertaining to data protection for legacy along with software defined data centers ( SDDC), data infrastructures in general along with related topics. In addition to excerpts, the posts also contain links to articles, tips, posts, videos, webinars, events and other companion material. Note that figure numbers in this series are those from the SDDI book and not in the order that they appear in the posts.

In this post the focus is around Data Protection who’s Doing What ( Toolbox Technology Tools).

SDDC, SDI, SDDI data infrastructure
Figure 1.5 Data Infrastructures and other IT Infrastructure Layers

who’s Doing What (Toolbox Technology Tools)

SDDC SDDI data center data protection toolbox
Data Protection Toolbox

Note that this post is evolving with additional tools, technologies, techniques, hardware, software, services being added over time along with applicable industry links.

The following are a sampling of some hardware, software, solution and component vendors along with service providers involved with data protection from RAID, Erasure Codes (EC) to snapshots, backup, BC, BR, DR, archive, security, cloud, bulk object storage, HDDs, SSD, tape among others including buzzword (and buzz term trends) bingo. Acronis, Actifio, Arcserve, ATTO, AWS, Backblaze, Barracuda, Broadcom, Caringo, Chelsio (offload), Code42/Crashplan, Cray, Ceph, Cisco, Cloudian, Cohesity, Compuverde, Commvault, Datadog, Datrium, Datos IO, DDN, Dell EMC, Druva, E8, Elastifile, Exagrid, Excelero, Fujifilm, Fujutsu, Google, HPE, Huawei, Hedvig, IBM, Intel, Iomega, Iron Mountain, IBM, Jungledisk, Kinetic key value drives (Seagate), Lenovo, LTO organization, Mangstor, Maxta, Mellanox (offload), Micron, Microsoft (Azure, Windows, Storage Spaces), Microsemi, Nakivo, NetApp, NooBaa, Nexsan, Nutanix, OpenIO, OpenStack (Swift), Oracle, Panasas, Panzura, Promise, Pure, Quantum, Quest, Qumulo, Retrospect, Riverbed, Rozo, Rubrik, Samsung, Scale, Scality, Seagate (DotHill), Sony, Solarwinds, Spectralogic, Starwind, Storpool, Strongbox, Sureline, Swiftstack, Synology, Toshiba, Tintri, Turbonomics, Unitrends, Unix and Linux platforms, Vantara, Veeam, VMware, Western Digital (Amplidata, Tegile and others), WekaIO, X-IO, Zadara and Zmanda among many others.

Note if you dont see yours, or your favorite, preferred or clients listed above or in the data Infrastructure industry related links send us a note for consideration to be included in future updates, or having a link, or sponsor spot pointing to your site added. Feel free to add a non sales marketing pitch to courteous comments to the comment section below.

View additional IT, data center and data Infrastructure along with data protection related vendors, services, tools, technologies links here.

Where To Learn More

Continue reading additional posts in this series of Data Infrastructure Data Protection fundamentals and companion to Software Defined Data Infrastructure Essentials (CRC Press 2017) book, as well as the following links covering technology, trends, tools, techniques, tradecraft and tips.

Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

Software Defined Data Infrastructure Essentials Book SDDC

What This All Means

Part of modernizing data protection for various data center and data infrastructure environments is to know the tools, technologies and trends that are part of your data protection toolbox. The other part of modernizing data is protection is knowing the techniques of how to use different tools, technologies to meet various application workload performance, availability, capacity economic (PACE) needs.

Also keep in mind that information services requires applications (e.g. programs) and that programs are a combination of algorithms (code, rules, policies) and data structures (e.g. data and how it is organized including unstructured). What this means is that data protection needs to address not only data, also the applications, configuration settings, metadata as well as protecting the protection tools and its data.

Get your copy of Software Defined Data Infrastructure Essentials here at Amazon.com, at CRC Press among other locations and learn more here. Meanwhile, continue reading with the next post in this series, Part 10 Data Protection Fundamental Resources Where to Learn More.

Ok, nuff said, for now.

Gs

Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

Posted on

Data Protection Diaries Fundamental Resources Where to Learn More

Data Protection Diaries Fundamental Resources Where to Learn More

Companion to Software Defined Data Infrastructure Essentials – Cloud, Converged, Virtual Fundamental Server Storage I/O Tradecraft ( CRC Press 2017)

server storage I/O data infrastructure trends

By Greg Schulz – www.storageioblog.com November 26, 2017

This is the last in a multi-part series on Data Protection fundamental tools topics techniques terms technologies trends tradecraft tips as a follow-up to my Data Protection Diaries series, as well as a companion to my new book Software Defined Data Infrastructure Essentials – Cloud, Converged, Virtual Server Storage I/O Fundamental tradecraft (CRC Press 2017).

Click here to view the previous post Part 9 – who’s Doing What ( Toolbox Technology Tools).

Software Defined Data Infrastructure Essentials Book SDDC

Post in the series includes excerpts from Software Defined Data Infrastructure (SDDI) pertaining to data protection for legacy along with software defined data centers ( SDDC), data infrastructures in general along with related topics. In addition to excerpts, the posts also contain links to articles, tips, posts, videos, webinars, events and other companion material. Note that figure numbers in this series are those from the SDDI book and not in the order that they appear in the posts.

In this post the focus is around Data Protection Resources Where to Learn More.

SDDC, SDI, SDDI data infrastructure
Figure 1.5 Data Infrastructures and other IT Infrastructure Layers

Software Defined Data Infrastructure Essentials Table of Contents (TOC)

Here is a link (PDF) to the table of contents (TOC) for Software Defined Data Infrastructure Essentials.

The following is a Software Defined Data Infrastructure Essentials book TOC summary:

Chapter 1: Server Storage I/O and Data Infrastructure Fundamentals
Chapter 2: Application and IT Environments
Chapter 3: Bits, Bytes, Blobs, and Software-Defined Building Blocks
Chapter 4: Servers: Physical, Virtual, Cloud, and Containers
Chapter 5: Server I/O and Networking
Chapter 6: Servers and Storage-Defined Networking
Chapter 7: Storage Mediums and Component Devices
Chapter 8: Data Infrastructure Services: Access and Performance
Chapter 9: Data Infrastructure Services: Availability, RAS, and RAID
Chapter 10: Data Infrastructure Services: Availability, Recovery-Point Objective, and Security
Chapter 11: Data Infrastructure Services: Capacity and Data Reduction
Chapter 12: Storage Systems and Solutions (Products and Cloud)
Chapter 13: Data Infrastructure and Software-Defined Management
Chapter 14: Data Infrastructure Deployment Considerations
Chapter 15: Software-Defined Data Infrastructure Futures, Wrap-up, and Summary
Appendix A: Learning Experiences
Appendix B: Additional Learning, Tools, and tradecraft Tricks
Appendix C: Frequently Asked Questions
Appendix D: Book Shelf and Recommended Reading
Appendix E: Tools and Technologies Used in Support of This Book
Appendix F: How to Use This Book for Various Audiences
Appendix G: Companion Website and Where to Learn More
Glossary
Index

Click here to view (PDF) table of contents (TOC).

Data Protection Resources Where To Learn More

Learn more about Data Infrastructure and Data Protection related technology, trends, tools, techniques, tradecraft and tips with the following links.

The following are the various posts that are part of this data protection series:

  • Part 1 – Data Infrastructure Data Protection Fundamentals
  • Part 2 – Reliability, Availability, Serviceability ( RAS) Data Protection Fundamentals
  • Part 3 – Data Protection Access Availability RAID Erasure Codes ( EC) including LRC
  • Part 4 – Data Protection Recovery Points (Archive, Backup, Snapshots, Versions)
  • Part 5 – Point In Time Data Protection Granularity Points of Interest
  • Part 6 – Data Protection Security Logical Physical Software Defined
  • Part 7 – Data Protection Tools, Technologies, Toolbox, Buzzword Bingo Trends
  • Part 8 – Data Protection Diaries Walking Data Protection Talk
  • Part 9 – who’s Doing What ( Toolbox Technology Tools)
  • Part 10 – Data Protection Resources Where to Learn More


    • The following are various data protection blog posts:

  • Welcome to the Data Protection Diaries
  • Until the focus expands to data protection, backup is staying alive!
  • The blame game, Does cloud storage result in data loss?
  • Loss of data access vs. data loss
  • Revisiting RAID storage remains relevant and resources
  • Only you can prevent cloud (or other) data loss
  • Data protection is a shared responsibility
  • Time for CDP (Commonsense Data Protection)?
  • Data Infrastructure Server Storage I/O Tradecraft Trends (skills, experiences, knowledge)
  • My copies were corrupted: The [4] 3-2-1 rule and more about 4 3 2 1 as well as 3 2 1 here and here

    • The following are various data protection tips and articles:

  • Via Infostor Cloud Storage Concerns, Considerations and Trends
  • Via Network World What’s a data infrastructure?
  • Via Infostor Data Protection Gaps, Some Good, Some Not So Good
  • Via Infostor Object Storage is in your future
  • Via Iron Mountain Preventing Unexpected Disasters
  • Via InfoStor – The Many Variations of RAID Storage
  • Via InfoStor – RAID Remains Relevant, Really!
  • Via WservNews Cloud Storage Considerations (Microsoft Azure)
  • Via ComputerWeekly Time to restore from backup: Do you know where your data is?
  • Via Network World Ensure your data infrastructure remains available and resilient

    • The following are various data protection related webinars and events:

  • BrightTalk Webinar Data Protection Modernization – Protect, Preserve and Serve you Information
  • BrightTalk Webinar BCDR and Cloud Backup Protect Preserve and Secure Your Data Infrastructure
  • TechAdvisor Webinar (Free with registration) All You Need To Know about ROBO data protection
  • TechAdvisor Webinar (Free with registration) Tips for Moving from Backup to Full Disaster Recovery

    • The following are various data protection tools, technologies, services, vendor and industry resource links:

  • Various Data Infrastructure related news commentary, events, tips and articles
  • Data Center and Data Infrastructure industry links (vendors, services, tools, technologies, hardware, software)
  • Data Infrastructure server storage I/O network Recommended Reading List Book Shelf
  • Software Defined Data Infrastructure Essentials (CRC 2017) Book

    • Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    What This All Means

    Everything is not the same across environments, data centers, data infrastructures including SDDC, SDX and SDDI as well as applications along with their data.

    Likewise everything is and does not have to be the same when it comes to Data Protection.

    Since everything is not the same, various data protection approaches are needed to address various application performance, availability, capacity economic (PACE) needs, as well as SLO and SLAs.

    Data protection encompasses many different hardware, software, services including cloud technologies, tools, techniques, best practices, policies and tradecraft experience skills (e.g. knowing what to use when, where, why and how).

    Software Defined Data Infrastructure Essentials Book SDDC

    Context is important as different terms have various meanings depending on what they are being discussed with. Likewise different technologies and topics such as object, blob, backup, replication, RAID, erasure code (EC), mirroring, gaps (good, bad, ugly), snapshot, checkpoint, availability, durability among others have various meanings depending on context, as well as implementation approach.

    In most cases there is no bad technology or tool, granted there are some poor or bad (even ugly) implementations, as well as deployment or configuration decisions. What this means is the best technology or approach for your needs may be different from somebody else’s and vice versa.

    Some other points include there is no such thing as an information recession with more data generated every day, granted, how that data is transformed or stored can be in a smaller footprint. Likewise there is an increase in the size of data including unstructured big data, as well as the volume (how much data), as well as velocity (speed at which it is created, moved, processed, stored). This also means there is an increased dependency on data being available, accessible and intact with consistency. Thus the fundamental role of data Infrastructures (e.g. what’s inside the data center or cloud) is to combine resources, technologies, tools, techniques, best practices, policies, people skill set, experiences (e.g. tradecraft) to protect, preserve, secure and serve information (applications and data).

    modernizing data protection including backup, availability and related topics means more than swapping out one hardware, software, service or cloud for whatever is new, and then using it in old ways.

    What this means is to start using new (and old) things in new ways, for example move beyond using SSD or HDDs like tape as targets for backup or other data protection approaches. Instead use SSD, HDDs or cloud as a tier, yet also to enable faster protection and recovery by stepping back and rethinking what to protect, when, where, why, how and apply applicable techniques, tools and technologies. Find a balance between knowing all about the tools and trends while not understanding how to use those toolbox items, as well as knowing all about the techniques of how to use the tools, yet not knowing what the tools are.

    Want to learn more, have questions about specific tools, technologies, trends, vendors, products, services or techniques discussed in this series, send a note (info at storageio dot com) or via our contact page. We can set up a time to discuss your questions or needs pertaining to Data Protection as well as data infrastructures related topics from legacy to software defined virtual, cloud, container among others. For example consulting, advisory services, architecture strategy design, technology selection and acquisition coaching, education knowledge transfer sessions, seminars, webinars, special projects, test drive lab reviews or audits, content generation, videos, podcasts, custom content, chapter excerpts, demand generation among many other things.

    Get your copy of Software Defined Data Infrastructure Essentials here at Amazon.com, at CRC Press among other locations and learn more here.

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Posted on

    Announcing Software Defined Data Infrastructure Essentials Book by Greg Schulz

    New SDDI Essentials Book by Greg Schulz of Server StorageIO

    Cloud, Converged, Virtual Fundamental Server Storage I/O Tradecraft

    server storage I/O data infrastructure trends

    Update 1/21/2018

    Over the past several months I have posted, commenting, presenting and discussing more about Software Defined Data Infrastructure Essentials aka SDDI or SDDC and SDI. Now it is time to announce my new book (my 4th solo project), Software Defined Data Infrastructure Essentials Book (CRC Press). Software Defined Data Infrastructure Essentials is now generally available at various global venues in hardcopy, hardback print as well as various electronic versions including via Amazon and CRC Press among others. For those attending VMworld 2017 in Las Vegas, I will be doing a book signing, meet and greet at 1PM Tuesday August 29 in the VMworld book store, as well as presenting at various other fall industry events.

    Software Defined Data Infrastructure Essentials Book Announcement

    (Via Businesswire) Stillwater, Minnesota – August 23, 2017  – Server StorageIO, a leading independent IT industry advisory and consultancy firm, in conjunction with publisher CRC Press, a Taylor and Francis imprint, announced the release and general availability of “Software-Defined Data Infrastructure Essentials,” a new book by Greg Schulz, noted author and Server StorageIO founder.

    Software Defined Data Infrastructure Essentials

    The Software Defined Data Infrastructure Essentials book covers physical, cloud, converged (and hyper-converged), container, and virtual server storage I/O networking technologies, revealing trends, tools, techniques, and tradecraft skills.

    Data Infrastructures Protect Preserve Secure and Serve Information
    Various IT and Cloud Infrastructure Layers including Data Infrastructures

    From cloud web scale to enterprise and small environments, IoT to database, software-defined data center (SDDC) to converged and container servers, flash solid state devices (SSD) to storage and I/O networking,, the book helps develop or refine hardware, software, services and management experiences, providing real-world examples for those involved with or looking to expand their data infrastructure education knowledge and tradecraft skills.

    Software Defined Data Infrastructure Essentials book topics include:

    • Cloud, Converged, Container, and Virtual Server Storage I/O networking
    • Data protection (archive, availability, backup, BC/DR, snapshot, security)
    • Block, file, object, structured, unstructured and data value
    • Analytics, monitoring, reporting, and management metrics
    • Industry trends, tools, techniques, decision making
    • Local, remote server, storage and network I/O troubleshooting
    • Performance, availability, capacity and  economics (PACE)

    Where To Purchase Your Copy

    Order via Amazon.com and CRC Press along with Google Books among other global venues.

    What People Are Saying About Software Defined Data Infrastructure Essentials Book

    “From CIOs to operations, sales to engineering, this book is a comprehensive reference, a must-read for IT infrastructure professionals, beginners to seasoned experts,” said Tom Becchetti, advisory systems engineer.

    "We had a front row seat watching Greg present live in our education workshop seminar sessions for ITC professionals in the Netherlands material that is in this book. We recommend this amazing book to expand your converged and data infrastructure knowledge from beginners to industry veterans."

    Gert and Frank Brouwer – Brouwer Storage Consultancy

    "Software-Defined Data Infrastructures provides the foundational building blocks to improve your craft in several areas including applications, clouds, legacy, and more.  IT professionals, as well as sales professionals and support personal, stand to gain a great deal by reading this book."

    Mark McSherry- Oracle Regional Sales Manager

    "Greg Schulz has provided a complete ‘toolkit’ for storage management along with the background and framework for the storage or data infrastructure professional (or those aspiring to become one)."
    Greg Brunton – Experienced Storage and Data Management Professional

    “Software-defined data infrastructures are where hardware, software, server, storage, I/O networking and related services converge inside data centers or clouds to protect, preserve, secure and serve applications and data,” said Schulz.  “Both readers who are new to data infrastructures and seasoned pros will find this indispensable for gaining and expanding their knowledge.”

    SDDI and SDDC components

    More About Software Defined Data Infrastructure Essentials
    Software Defined Data Infrastructures (SDDI) Essentials provides fundamental coverage of physical, cloud, converged, and virtual server storage I/O networking technologies, trends, tools, techniques, and tradecraft skills. From webscale, software-defined, containers, database, key-value store, cloud, and enterprise to small or medium-size business, the book is filled with techniques, and tips to help develop or refine your server storage I/O hardware, software, Software Defined Data Centers (SDDC), Software Data Infrastructures (SDI) or Software Defined Anything (SDx) and services skills. Whether you are new to data infrastructures or a seasoned pro, you will find this comprehensive reference indispensable for gaining as well as expanding experience with technologies, tools, techniques, and trends.

    Software Defined Data Infrastructure Essentials SDDI SDDC content

    This book is the definitive source providing comprehensive coverage about IT and cloud Data Infrastructures for experienced industry experts to beginners. Coverage of topics spans from higher level applications down to components (hardware, software, networks, and services) that get defined to create data infrastructures that support business, web, and other information services. This includes Servers, Storage, I/O Networks, Hardware, Software, Management Tools, Physical, Software Defined Virtual, Cloud, Docker, Containers (Docker and others) as well as Bulk, Block, File, Object, Cloud, Virtual and software defined storage.

    Additional topics include Data protection (Availability, Archiving, Resiliency, HA, BC, BR, DR, Backup), Performance and Capacity Planning, Converged Infrastructure (CI), Hyper-Converged, NVM and NVMe Flash SSD, Storage Class Memory (SCM), NVMe over Fabrics, Benchmarking (including metrics matter along with tools), Performance Capacity Planning and much more including whos doing what, how things work, what to use when, where, why along with current and emerging trends.

    Book Features

    ISBN-13: 978-1498738156
    ISBN-10: 149873815X
    Hardcover: 672 pages
    (Available in Kindle and other electronic formats)
    Over 200 illustrations and 70 plus tables
    Frequently asked Questions (and answers) along with many tips
    Various learning exercises, extensive glossary and appendices
    Publisher: Auerbach/CRC Press Publications; 1 edition (June 19, 2017)
    Language: English

    SDDI and SDDC toolbox

    Where To Learn More

    Learn more about related technology, trends, tools, techniques, and tips with the following links.

    Data Infrastructures Protect Preserve Secure and Serve Information
    Various IT and Cloud Infrastructure Layers including Data Infrastructures

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    Data Infrastructures exist to protect, preserve, secure and serve information along with the applications and data they depend on. With more data being created at a faster rate, along with the size of data becoming larger, increased application functionality to transform data into information means more demands on data infrastructures and their underlying resources.

    Software-Defined Data Infrastructure Essentials: Cloud, Converged, and Virtual Fundamental Server Storage I/O Tradecraft is for people who are currently involved with or looking to expand their knowledge and tradecraft skills (experience) of data infrastructures. Software-defined data centers (SDDC), software data infrastructures (SDI), software-defined data infrastructure (SDDI) and traditional data infrastructures are made up of software, hardware, services, and best practices and tools spanning servers, I/O networking, and storage from physical to software-defined virtual, container, and clouds. The role of data infrastructures is to enable and support information technology (IT) and organizational information applications.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    Everything is not the same in business, organizations, IT, and in particular servers, storage, and I/O. This means that there are different audiences who will benefit from reading this book. Because everything and everybody is not the same when it comes to server and storage I/O along with associated IT environments and applications, different readers may want to focus on various sections or chapters of this book.

    If you are looking to expand your knowledge into an adjacent area or to understand whats under the hood, from converged, hyper-converged to traditional data infrastructures topics, this book is for you. For experienced storage, server, and networking professionals, this book connects the dots as well as provides coverage of virtualization, cloud, and other convergence themes and topics.

    This book is also for those who are new or need to learn more about data infrastructure, server, storage, I/O networking, hardware, software, and services. Another audience for this book is experienced IT professionals who are now responsible for or working with data infrastructure components, technologies, tools, and techniques.

    Learn more here about Software Defined Data Infrastructure (SDDI) Essentials book along with cloud, converged, and virtual fundamental server storage I/O tradecraft topics, order your copy from Amazon.com or CRC Press here, and thank you in advance for learning more about SDDI and related topics.

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Posted on

    Data Infrastructure Industry Trends WekaIO Matrix Software Defined Storage SDS

    WekaIO Matrix Scale Out Software Defined Storage SDS

    server storage I/O trends

    Updated 2/11/2018

    WekaIO Matrix is a scale out software defined solution (SDS).

    WekaIO Matrix software defined scale out storage SDS

    This Server StorageIO Industry Trends Perspective report looks at common issues, trends, and how to address different application server storage I/O challenges. In this report, we look at WekaIO Matrix, an elastic, flexible, highly scalable easy to use (and manage) software defined (e.g. software based) storage solution. WekaIO Matrix enables flexible elastic scaling with stability and without compromise.

    Matrix is a new scale out software defined storage solution that:

    • Installs on bare metal, virtual or cloud servers
    • Has POSIX, NFS, SMB, and HDFS storage access
    • Adaptable performance for little and big data
    • Tiering of flash SSD and cloud object storage
    • Distributed resilience without compromise
    • Removes complexity of traditional storage
    • Deploys on bare metal, virtual and cloud environments

    Where To Learn More

    View additional SDS and related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    Read more about WekaIO Matrix in this (free, no registration required) Server StorageIO Industry Trends Perspective (ITP) Report compliments of WekaIO.

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Posted on

    Broadcom aka Avago aka LSI announces SAS SATA NVMe Adapters with RAID

    server storage I/O trends

    Broadcom aka Avago aka LSI announces SAS SATA NVMe Adapters with RAID

    In case you missed it, Broadcom formerly known as Avago who bought the LSI adapter and RAID card business announced shipping new SAS, SATA and NVMe devices.

    While SAS and SATA are well established continuing to be deployed for both HDD as well as flash SSD, NVMe continues to evolve with a bright future. Likewise, while there is a focus on software-defined storage (SDS), software defined data centers (SDDC) and software defined data infrastructures (SDDI) along with advanced parity RAID including erasure codes, object storage among other technologies, there is still a need for adapter cards including traditional RAID.

    Keep in mind that while probably not meeting the definition of some software-defined aficionados, the many different variations, permutations along with derivatives of RAID from mirror and replication to basic parity to advanced erasure codes (some based on Reed Solomon aka RAID 2) rely on software. Granted, some of that software is run on regular primary server processors, some on packaged in silicon via ASICs or FPGAs, or System on Chips (SOC), RAID on Chip (RoC) as well as BIOS, firmware, drivers as well as management tools.

    SAS, SATA and NVMe adapters

    For some environments cards such as those announced by Broadcom are used in passthru mode effectively as adapters for attaching SAS, SATA and NVMe storage devices to servers. Those servers may be deployed as converged infrastructures (CI), hyper-converged infrastructures (HCI), Cluster or Cloud in Box (CiB) among other variations. To name names you might find the above (or in the not so distant future) in VMware vSAN or regular vSphere based environments, Microsoft Windows Server, Storage Spaces Direct (S2D) or Azure Stack, OpenStack among other deployments (check your vendors Hardware Compatibility Lists aka HCLs). In some cases these cards may be adapters in passthru mode, or using their RAID (support various by different software stacks). Meanwhile in other environments, the more traditional RAID features are still used spanning Windows to Linux among others.

    Who Is Broadcom?

    Some of you may know of Broadcom having been around for many years with a focus on networking related technologies. However some may not realize that Avago bought Broadcom and changed their name to Broadcom. Here is a history that includes more recent acquisitions such as Brocade, PLX, Emulex as well as LSI. Some of you may recall Avago buying LSI (the SAS, SATA, PCIe HBA, RAID and components) business not sold to NetApp as part of Engenio. Also recall that Avago sold the LSI flash SSD business unit to Seagate a couple of years ago as part of its streamlining. That’s how we get to where we are at today with Broadcom aka formerly known as Avago who bought the LSI adapter and RAID business announcing new SAS, SATA, NVMe cards.

    What Was Announced?

    Broadcom has announced cards that are multi-protocol supporting Serial Attached SCSI (SAS), SATA/AHCI as well as NVM Express (NVMe) as basic adapters for attaching storage (HDD, SSD, storage systems) along with optional RAID as well as cache support. These cards can be used in application servers for traditional, as well as virtualized SDDC environments, as well as storage systems or appliances for software-defined storage among other uses. The basic functionality of these cards is to provide high performance (IOPs and other activity, as well as bandwidth) along with low latency combined with data protection as well as dense connectivity.

    Specific features include:

    • Broadcom’s Tri-Mode SerDes Technology enables the operation of NVMe, SAS or SATA devices in a single drive bay, allowing for endless design flexibility.
    • Management software including LSI Storage Authority (LSA), StorCLI, HII (UEFI)
    • Optional CacheVault(R) flash cache protection
    • Physical dimension Low Profile 6.127” x 2.712”
    • Host bus type x8 lane PCIe Express 3.1
    • Data transfer rates SAS-3 12Gbs; NVMe up to 8 GT/s PCIe Gen 3
    • Various OS and hypervisors host platform support
    • Warranty 3 yrs, free 5×8 phone support, advanced replacement option
    • RAID levels 0, 1, 5, 6, 10, 50, and 60

    Note that some of the specific feature functionality may be available at a later date, check with your preferred vendors HCL

    Specification

    9480 8i8e

    9440 8i

    9460 8i

    9460 16i

    Image

    Internal Ports

    8

     

    8

    16

    Internal Connectors

    2 x Mini-SAS HD x4 SFF-8643

    2 x Mini-SAS HD x4 SFF-8643

    2 x Mini-SAS HD x4 SFF-8643

    4 Mini-SAS HD x4
    SFF-8643

    External Ports

    8

     

     

     

    External Connectors

    2 x Mini-SAS HD SFF8644

     

     

     

    Cache Protection

    CacheVault CVPM05

     

    CacheVault CVPM05

    CacheVault CVPM05

    Cache Memory

    2GB 2133 MHz DDR4 SDRAM

     

    2GB 2133 MHz DDR4 SDRAM

    4GB 2133 MHz DDR4 SDRAM

    Devices Supported

    SAS/SATA: 255, NVMe: 4 x4, up to 24 x2 or x4*

    SAS/SATA: 63, NVMe: 4 x4, up to 24 x2 or x4*

    SAS/SATA: 255, NVMe: 4 x4, up to 24 x2 or x4*

    SAS/SATA: 255, NVMe: 4 x4, up to 24 x2 or x4*

    I/O Processors (SAS Controller)

    SAS3516 dual-core RAID-on-Chip (ROC)

    SAS3408 I/O controller (IOC)

    SAS3508 dual-core RAID-on-Chip (ROC)

    SAS3516 dual-core RAID-on-Chip (ROC)

    In case you need a refresher on SFF cable types, click on the following two images which take you to Amazon.com where you can learn more, as well as order various cable options. PC Pit Stop has a good selection of cables (See other SFF types), connectors and other accessories that I have used, along with those from Amazon.com and others.

    Available via Amazon.com sff 8644 8643 sas mini hd cable
    Left: SFF 8644 Mini SAS HD (External), Right SFF-8643 Mini SAS HD (internal) Image via Amazon.com

    Available via Amazon.com sff 8644 8642 sas mini hd cable
    Left: SFF 8643 Mini SAS HD (Internal), Right SFF-8642 SATA with power (internal) Image via Amazon.com

    Wait, Doesnt NVMe use PCIe

    For those who are not familiar with NVMe and in particular U.2 aka SFF 8639 based devices, physically they look the same (almost) as a SAS device connector. The slight variation is if you look at a SAS drive, there is a small tab to prevent plugging into a SATA port (recall you can plug SATA into SAS. For SAS drives that tab is blank, however on the NVMe 8639 aka U.2 drives (below left) that tab has several connectors which are PCIe x4 (single or dual path).

    What this means is that the PCIe x4 bus electrical signals are transferred via a connector, to backplane chassis to 8639 drive slot to the drive. Those same 8639 drive slots can also have a SAS SATA connection using their traditional connectors enabling a converged or hybrid drive slot so to speak. Learn more about NVMe here (If the Answer is NVMe, then what were and are the questions?) as well as at www.thenvmeplace.com.

    NVMe U.2 8639 driveNVMe U.2 8639 sas sata nvme drive
    Left NVMe U.2 drive showing PCIe x4 connectors, right, NVMe U.2 8639 connector

    Who Is This For?

    These cards are applicable for general purpose IT and other data infrastructure environments in traditional servers among others uses. They are also applicable for systems builders, integrators and OEMs whom you may be buying your current systems from, or future ones.

    Where to Learn More

    The following are additional resources to learn more about vSAN and related technologies.

    What this all means

    Even as the industry continues to talk and move towards more software-defined focus, even for environments that are serverless, there is still need for hardware somewhere. These adapters are a good sign of the continued maturing cycle of NVMe to be well positioned into the next decade and beyond, while also being relevant today. Likewise, even though the future involves NVMe, there is a still a place for SAS along with SATA to coexist in many environments. For some environment there is a need for traditional RAID while for others simply the need for attachment of SAS, SATA and NVMe devices. Overall, a good set of updates, enhancements and new technology for today and tomorrow, now, when do I get some to play with? ;).

    Ok, nuff said (for now…).

    Cheers
    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert (and vSAN). Author Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Watch for the spring 2017 release of his new book "Software-Defined Data Infrastructure Essentials" (CRC Press).

    Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2023 Server StorageIO(R) and UnlimitedIO. All Rights Reserved.

    Posted on

    Data Infrastructure IT Industry Related Resource Links A to E

    Data Infrastructure IT Industry Related Resource Links A to E

    IT Data Center and Data Infrastructure Industry Resources

    Updated 2/20/2018

    Following are some useful Data Infrastructure IT Industry Resource Links A to E to cloud, virtual and traditional IT data infrastructure related web sites. The data infrastructure environment (servers, storage, IO and networking, hardware, software, services, virtual, container and cloud) is rapidly changing. You may encounter a missing URL, or a URL that has changed. This list is updated on a regular basis to reflect changes (additions, changes, and retirement).

    Disclaimer and note: URL’s submitted for inclusion on this site will be reviewed for consideration and to be in generally accepted good taste in regards to the theme of this site.

    Best effort has been made to validate and verify the data infrastructure URLs that appear on this page and web site however they are subject to change. The author and/or maintainer(s) of this page and web site make no endorsement to and assume no responsibility for the URLs and their content that are listed on this page.

    Software Defined Data Infrastructure Essentials Book SDDC

    Send an email note to info at storageio dot com that includes company name, URL, contact name, title and phone number along with a brief 40 character description to be considered for addition to the above data infrastructure list, or, to be removed. Note that Server StorageIO and UnlimitedIO LLC (e.g. StorageIO) does not sell, trade, barter, borrow or share your contact information per our Privacy and Disclosure policy. View related data infrastructure Server StorageIO content here, and signup for our free newsletter here.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    • A3Cube    Computer I/O solution startup
    • AAPT   AAPT    AWS connect partner, Hosting/cloud/access services
    • abiquo.com    Cloud development and management tools
    • Above.net/Zayo Group    AWS connect parter, Hosting/cloud/access services
    • abrevity.com    eDiscovery, search, indexing, classification
    • accellion.com    File transfer tools
    • accessopt.com    Holographic storage
    • acinion.com    Video solutions
    • acopia.com    NAS aggregation and global name space (bought by F5)
    • acronis.com    Backup and data protection tools
    • acsacs.com    Value added reseller (VAR)
    • acs-inc.com    Hosting, outsourcing and managed services (Bought by Xerox)
    • actifio.com    Data protection solutions
    • active-circle.com    Data archiving and storage solutions
    • activestate.com    Stackato PaaS for cloud tools
    • adaptec.com    Adapters, iSCSI storage, data backup solutions (See PMC)
    • adesto.com    CBRAM startup
    • addonics.com    SSD storage solutions
    • adic.com    Backup, Dedupe and data protection solutions (Bought by Quantum)
    • adinfa.com        Energy and resource management tools
    • AdRem Netcrunch        Monitoring of Networks, Systems and Applications, DCIM
    • Adtran    Datacom and networking solutions
    • advancedvault.com    Business continuity solutions
    • advaoptical.com    Optical networking
    • afcom.com    Data center industry user group
    • aforesolutions.com    Cloud storage and infrasture management tools
    • agami.com    High performance NAS storage (Shutdown)
    • agilent.com    Host adapters and test equipment
    • agility.com    Optical solutions and components
    • agilysys.com    VAR
    • aiim.com    Archiving and records management trade group
    • ait.com    Cloud and web hosting
    • Ajubeo    Cloud and management solutions
    • akamai.com    Content distribution network (CDN)
    • akitio.com    Storage systems
    • akorri.com    Storage resource and capacity management
    • alacritech.com    Storage networking adapters for iSCSI
    • alacritus.com    Data Protection Software
    • alcatel.com    Networking and storage networking equipment
    • alliance-it.com    Value added reseller (VAR)
    • allstorage.nl    Storage services solution provider
    • amazon.com    Cloud compute and storage services
    • AmberPoint.com    SOA management tools
    • amcc.com    Storage networking components (aka JNI & 3ware Bought by LSI)
    • amd.com    Server and processor chips
    • americanfibersystems.com    Metropolitan storage networks and fiber bandwidth
    • amphenol.com    Storage Networking connectors and cables
    • Amplidata.com    Object and wide area based storage
    • ancot.com    Storage networking testing equipment
    • anixter.com    Networking components
    • Anobit.com    Memory components
    • ansi.org    American National Standards Institute
    • Anstor64.com    iSCSI storage software
    • anuesystems.com    SONET’/SDH and network test equipment
    • apc.com    Environmental and power systems and DCIM solutoins
    • apcon.com    Physical cabling and management
    • aperture.com    Data center tools including CMDB (Bought by Emerson)
    • appassue.com    SQL server and data protection tools (Bought by Dell)
    • Appcore    Cloud management tools
    • Appfirst    IT Ops, Development and DCIM monitoring and PKI metrics
    • appiq.com    Storage Management Software (Bought by HP)
    • appirio.com    Cloud and content tools and services
    • apple.com    Server and storage
    • apprenda.com    Grid and data management tools
    • Apprenda   Platform as a service tools
    • aprius.com    PCIe Server I/O virtualization (IOV) technology
    • aptare.com    Data protection management and backup reporting
    • arasan.com    IP Networking components
    • Archivas.com    Archiving and data management software (Bought by HDS)
    • arcmail.com    Email archiving
    • Arcplace    Data management archiving
    • arcsight.com    Compliance solutions
    • argent.com    Data center management and CMDB tools
    • ariodata.com    Scalable data storage and blade storage systems
    • aristanetworks.com    Networking technologies
    • aristoslogic.com    Storage controller technology (Bought by Adaptec)
    • Arkeia.com    Backup and data protection software (Bought by WD)
    • arkivio.com    Storage management and ILM software
    • arm.com    Microprocessor producer
    • armor247.com    SMB focused data protection solutions
    • arrow.com    Distributor
    • arsenaldigital.com    Managed backup service (Bought by IBM)
    • arxscan.com    SRM and file reporting software
    • asankya.com    Application delivery and cloud access
    • asciitable.com    Site containing the ASCII character set table
    • ashare.org    HVAC Engineers Association
    • asigra.com    Backup and data protection solutions
    • asnp.org    Association Storage Networking Professionals
    • asperasoft.com    High speed file and data transfer tools
    • astaro.com    Security tools
    • astutenetworks.com    iSCSI storage optimized for VMware
    • atempo.com    Backup Software
    • Atlantic Metro Communications    AWS connect parter, Hosting/cloud/access services
    • Atlantiscomputing    ILIO VDI and I/O optimization, cache tools
    • atmforum.com    ATM trade association
    • atrato.com    Storage systems
    • attachmate.com    IT management tools (bought Novell)
    • attotech.com    Storage networking adapters and gateways
    • Attunesystems.com    NAS and file virtualization (Assets bought by F5)
    • attunity.com    File and data movement tools
    • autonomy.com    Data management and cloud services (Bought by HP) –
    • autovirt.com    Storage automation tiering tools
    • avagotech.com    Semiconductor technologies
    • availl.com    Data movement and replication solutions
    • avamar.com    Dedupe, Backup and Restoration Solutions (Bought by EMC)
    • avanade.com    Var
    • avaya.com    Networking and communications
    • averesystems.com    NAS caching and automated tiering
    • avg.com    Security and anti-virus software
    • avnet.com    Distributor
    • www.avocent.com    Infrastructure resource management tools
    • axcient.com    Cloud data protection solutions
    • axiossystems.com    IRM and service management tools
    • axsone.com    Records and document management
    • axxana.com    Data protection and replication tools
    • Backblaze    Online and cloud backup storage
    • BackupAssist    Backup and Recovery software
    • backupify.com    Backup for google apps
    • BUMI    Backup and data protection tools
    • backupright.com    Online and cloud backup
    • Backula    Opensource Backup and data protection
    • bakbone.com    Backup Software (Bought by Quest bought by Dell)
    • balesio.com    File compression solutions
    • barracudanetworks.com    Networking devices, backup software
    • basho.com    NOSQL Database and object storage technology –
    • batblue.com    Cloud, application delivery networking services
    • Bestel   Bestel    AWS connect parter, Hosting/cloud/access services
    • Beyondtust    Vulnerability assessment and detection
    • bigswitch.com    Openflow based network switches
    • BitArmor.com    Data security software
    • bitcasa.com    Cloud storage and backup
    • Bitcentral    Video management solutions
    • Bitmicro    Solid state devices and other solutions
    • Blackbox    Data center infrastructure, DCIM, KVM and other solutions
    • BlackMESH    FedRAMP and DevOPs hosting
    • blade.org    Trade group for blade servers
    • bladelogic.com    Server management and discovery software
    • BladeNetwork.net    Server and storage blades (Bought by IBM)
    • Bladeroom    Data center and hosting
    • bladesystems.org    Industry trade group for blade servers and storage
    • bladetechnologies.net    Networking technologies
    • blockbridge.com    Elastic Storage Software and Tools
    • bluearc.com    High performance NAS enterprise class storage (Bought by HDS)
    • bluecoat.com    WAN optimization
    • bluecorenetworks.com    Networking infrastructure solutions
    • Bluehost    Web hosting, dedicated and virtual private servers
    • bluelock.com    Hosting, managed service and cloud provider
    • BlueOSS    Cloud and business inteligence solutions
    • www.bluestripe.com     Software for managing virtual data centers
    • bmc.com    Storage management software
    • bocada.com    Backup and management software
    • bowindustries.com    Tape media cleaning tools
    • box.net    Internet/web/cloud storage services
    • bphx.com    Legacy application transformation
    • bridgestor.com    Data reduction and storage optimization
    • Bridghead.com    Storage management software
    • broadband.com    Portal site for finding network bandwidth services
    • broadbandreports.com    Portal site for finding high speed internet access
    • broadcom.com    Storage networking component supplier
    • brocade.com    Switches, WAN gateways, software
    • brouwerconsultancy.com    Storage consultancy service
    • bswd.com    Brian Berg’s Storage Cornucopia web site
    • btiphotonics.com    WDM and Optical networking technologies
    • buffalotech.com    SMB and SOHO NAS storage
    • bustech.com    IBM Mainframe to open systems gateways (Bought by EMC)
    • bycast.com    Grid based fixed content, archive and object storage (Bought by NetApp)
    • c2c.com    Email archiving solutions
    • c2esoft.com    Data center operations and insight management tools
    • ca.com    Data management software
    • Computer Associates    Various data center, DCIM, data protection and other solution tools
    • call-recall.com    Optical storage
    • Canonical   Ubuntu Linux
    • carbonite.com    Cloud storage and backup
    • caringo.com    CAS archiving and object storage tools
    • casecentral.com    Cloud ediscovery
    • cassandra.apache.org    Data management and database alternative software
    • Apache Cassandra    NOSql Data Management tools
    • cassat.com    IRM management tools (Bought by CA)
    • Catalogic Software    Data protection and management tools
    • cataphora.com    Data management tools
    • catbird.com    VM security tools
    • caviumnetworks.com    Networking processors and chip technologies
    • cdproject.net    Carbon Disclosure Project
    • cdrive.com    VAR
    • cdw.com    VAR
    • celion.com    Network services for storage over distance
    • celona.com    Data migration tools
    • cemaphore.com    Messaging solutions
    • centos.org    Cluster Storage
    • centrepath.com    Storage management solutions (formerly Giant Loop)
    • centrify.com    Digital rights management for cloud, virtual, server, desktop and storage
    • Tier3/CenturyLink   Cloud, hosting and managed services
    • Centurylinkg/Savvis    Cloud and hosting solutions
    • Ceph   Cloud and object storage solutions
    • cert.org    Internet Security information
    • certesnetworks.com    Cloud security tools
    • certon.com    VAR
    • CFN Services    AWS connect parter, Hosting/cloud/access services
    • chelsio.com    High speed Ethernet adapters
    • chicorporation.com    Data protection, cloud and storage VAR
    • ciena.com    Optical networking
    • Cinenet    AWS connect parter, Hosting/cloud/access services
    • ciphermax.com    Data Storage Encryption Tools
    • cipheroptics.com    Storage networking security
    • ciprico.com    Storage systems (Bought by DotHill)
    • cirrustore.com    Backup data protection tools
    • cirtas.com    Cloud Storage Appliance – Added 6/9/10
    • cisco.com    Switches, WAN and Optical networking
    • Citrix.com    Virtualization solutions
    • ClearDB.com/.com    Local and distributed (GEO) MySQL database software and service
    • clearpace.com/.com    Large scale archive and data management tools
    • CleverSafe.com    Distributed object/esrasure storage
    • climatesaverscomputing.com    Green computing industry trade group
    • Clonix   Data cloning, duplication and protection tools
    • CloudByte   Scale-out and cloud storage
    • cloudera.com    Hadoop data storage and analytics tools
    • CloudFlare   CDN and Web Cache solutions
    • cloudfuzion.com    High performance servers
    • Cloudian   Cloud and object storage tools
    • Cloudphysics   Big data and virtualization tools
    • cloudreplica.com    Cloud data protection tools
    • cloudscaling.com    Open cloud platforms
    • Apache CloudStack   Open Source Cloud tools
    • cloudtp.com    Open cloud deployment solutions
    • CloudVelocity   Hybrid Cloud and data protection management solutins
    • cloverleafcomm.com    Storage Virtualization tools (Bought by DotHill)
    • clustrix.com    Storage software startup
    • cmg.org    Computer Measurement Group
    • cnt.com    Switches, WAN gateways, software (Bought by McData bought by Brocade)
    • Cobalt Iron   Data protection tools
    • code42.com    Cloud storage and backup aka Crashplan
    • Codenomicon.com    Data and security tools
    • cofio.com    Backup and data protection tools
    • CohesiveFT   Cloud solution and management tools
    • colliercomputing.com    VAR
    • colo-america.com    Co-location and hosting services

    • communities.vmware.com    VMware community
    • commvault.com    Data management software
    • comodo.com    Encryption tools
    • Comparitech    Consumer tech reviews
    • compellent.com    SMB Storage sub-systems and software – (Bought by Dell)
    • comptia.org    Computer and Technology Industry Association
    • compucom.com    VAR
    • computergamedesign.org    Computer game design
    • compuverde.com    Big data management tools and object storage
    • compuware.com    IT management and performance tools
    • condre.com    VAR/distributor
    • Condusiv   Data and storage management tools including Diskeeper
    • XO Communications    AWS connect parter, Hosting/cloud/access services
    • Connected Cloud    Cloud management tools
    • connectwise.com    IT automation tools
    • conres.com    Value added reseller (VAR)
    • consiliant.com    VAR
    • ConstantData.com    Real time data replication and mirroring
    • continuitysoftware.com    Replication and Snapshot data protection management
    • convirture.com    Cloud and virtualization tools
    • copansys.com    Secondary storage for backup and archiving (Assets Bought by SGI)
    • coraid.com    SATA over Ethernet storage
    • CoreSite    AWS connect parter, Hosting/cloud/access services
    • corevault.com    Cloud services
    • Cormant    DCIM and data center and infrastructure management tools
    • corning.com    Fiber optic cabling
    • corsair.com    SSD
    • corvis.com    Networking solutions
    • cPanel    Web, cloud and hosting management tools
    • crashplan.com    Cloud storage and backup aka Code42
    • creekpath.com    Storage management software
    • www.critical-links.com    Office in a box
    • crossroads.com    Storage routers and data protection management tools
    • Crosswalkinc.com    Clustered NAS storage (Ceased Operations)
    • crucial.com    Memory and SSD solutions
    • cru-dataport.com    Data Archive solutions
    • Crypto.com    Crypto resource site
    • www.ctera.com    Cloud storage appliance
    • Cumulus Networks    Open networking
    • curtisssd.com    SSD solution provider
    • cya.com    Document management and data protection
    • cyber-ark.com    Security data protection tools
    • cypress.com    Storage and networking components
    • dantz.com    Data protection and backup solutions (Aka Retrospect Bought by EMC, EMC sold off)
    • datacentertechnologies.com    Data management solutions (Bought by Symantec)
    • datacore.com    Storage management software
    • datadepositbox.com    Online backup and data protection
    • datadirectnetworks.com    Aka DDN Storage systems, SAN, NAS, Object and cloud
    • datadomain.com    Data Deduplication System (Bought by EMC)
    • Data Dynamics Inc    StorageX Data Movement, Migration and management
    • datafort.com    Online cloud backup
    • dataglobal.com    Data and storage management
    • Data Gravity    Big Data solutions
    • datagres.com    Cloud and application caching acceleration
    • dataguise.com/    Data security solutions
    • datalink.com    VAR
    • datallegro.com    Data warehouse storage solution (Bought by Microsoft)
    • datamirror.com    Data replication solutions
    • DataON Storage    Storage solutions
    • Datapipe    AWS connect parter, Hosting/cloud/access services
    • dataprotection.com    Vaultlogix data protection tools for cloud
    • DataRAM.com    SSD solutions
    • Data sales    Storage systems sales and leasing
    • dataslide.com    Hard rectangular disk (HRD)
    • datastor.com    Windows based backup data protection
    • datcollaborative.org    Data collaboration group and DAPL material
    • datoptic.com    Storage VAR
    • daymarksi.com    Value added reseller (VAR)
    • DBR360    AWS connect parter, Hosting/cloud/access services
    • ddifrontline.com    Security and access control
    • debian.org    Open source operating system
    • Debriefing software    Storage SRM tools
    • decru.com    Storage networking security solutions (Bought by NetApp)
    • Asempra.com    Data protection bought by Dell via Quest
    • dell.com    Storage networking equipment
    • Delphix    Storage, data management and data protection tools
    • demandtechnology.com    Demand technology software (performance software)
    • Denodo    Data virtualization tools
    • dexrexgear .com    Social media cloud storage
    • www.dey-sys.com    Open source software based sotrage
    • www.dh2i.com    Database virtualization software tools
    • digidata.com    Storage solutions
    • digistoresolutions.com    Archiving and data protection solutions
    • Digitalocular.com     Video data management tools
    • digitalreefinc.com    eDiscovery and compliance tools
    • digitiliti.com    Cloud and managed service backup
    • diligent.com    Virtual Tape Library (VTL) and Dedupe (Bought by IBM)
    • dimensiondata.com    VAR
    • Dimension Data    Hosting and managed services
    • dincloud.com    Cloud virtual desktop
    • directtextbook.com    Online book venue
    • discoverybox.net    Data protection for legal hold and compliance
    • diskkeeper.com    File and disk storage defragmentation (Condusiv)
    • Disklace.com    Disk storage optimization tools
    • dlink.com    Storage, network and cloud technologies
    • dmtf.org    Distributed Management Task Force
    • dnfstorage.com    iSCSI and hybrid storage (formerly Stonefly)
    • dothill.com    Distributed storage solutions
    • Doubletake.com    Data replication software
    • driveoncloud.com    Cloud drive online storage
    • drivesaversdatarecovery.com    Data protection and recovery
    • drobo.com    SMB and SOHO NAS storage
    • dropbox.com    Cloud storage and file sharing
    • druva.com    Backup, Storage, network and cloud technologies
    • dsireusa.org    Database of State Incentives and Renewable Energy
    • Dundas    Data Visualization and mobile dashboards
    • dvs.de    Digital video systems and storage
    • dynamicsolutions.com    Storage and data protection VAR
    • EaseUS    Backup, data protection and cloning tools
    • ecctek.com    Rugged data storage components
    • econnectix.com    Data and storage management solutions
    • eds.com    Data outsourcing and cloud provider (Bought by HP)
    • eere.energy.gov     U.S. Department of Energy (DoE) web site
    • egenera.com    Blade server and server virtualization management software
    • eginnovations.com    Application and infrastructure monitoring
    • egnyte.com    Cloud backup and data protection
    • eia.doe.gov/fuelelectric.html    Portal for electrical power generation, use and costs
    • emc.com    Storage sub-systems software
    • Emerson.com    DCIM IT Data center power, cooling and environmental management tools
    • Empired FlexScale    IT and business cloud solutions
    • emprisanetworks.com    Network management solutions (Bought by BMC)
    • emulex.com    Host bus adapters and embedded switches
    • enclarity.com    Healthcare CRM and analysis tools
    • encryptstick.com    USB based encryption device
    • enduradata.com    Data distribution and protection
    • energycenter.org    California Center for Sustainable Energy
    • energyshop.com    Portal for energy pricing and options
    • energystar.gov    United States EPA Energy Star web site
    • Enhance-tech.com    Storage VAR
    • enmotus.com    SSD storage tiering technology
    • Ensim   IT and cloud provisioning/management tools
    • enstratus.com    Amazon cloud computing management tools (Bought by Dell)
    • enterprisedb.com    Enterprise Database tools
    • epeat.net    Site for comparing desktop and related products
    • epic.com    Medical Information Technology software
    • equallogic.com    iSCSI storage systems (Bought by Dell)
    • Equinix, Inc.    AWS connect parter, Hosting/cloud/access services
    • equivio.com    Email data protection and retention
    • ericom.com    Desktop and VDI tools
    • esilicon.com    ASIC and custom silicon development
    • essextec.com    VAR
    • Eucalyptus    Open source cloud solutions
    • Evault.com    aka i365 – Remote (Cloud) backup service provider (Bought by Seagate)
    • Everspin Technologies    MRAM memories
    • evolvingsol.com    VAR
    • evostor.com    Storage startup
    • exablade.com    High performance application acceleration
    • Exablox    SMB storage solutions
    • Exabyte.com    Removable tape and robotics
    • exagrid.com    Backup Storage
    • exanet.com    Clustered NAS Storage (Bought by Dell aka FluidFileSystem)
    • exar.com    Server, Storage and Networking components
    • exavio.com    HD and SD data capture
    • exludus.com    Multi core optimize
    • Expand.com    Network and WAN optimization
    • Expertanalyticalsystems.com    Storage analysis tools
    • Exponential-e Ltd.    AWS connect parter, Hosting/cloud/access services
    • expresscomputersystems.com    Storage solutions VAR
    • extremenetworks.com    Networking switches

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    Visit the following additional data infrastructure and IT data center related links.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Posted on

    Data Infrastructure IT Industry Related Resource Links F to J

    Data Infrastructure IT Industry Related Resource Links F to J

    IT Data Center and Data Infrastructure Industry Resources

    Updated 2/20/2018

    Following are some useful Data Infrastructure IT Industry Resource Links F to J to cloud, virtual and traditional IT data infrastructure related web sites. The data infrastructure environment (servers, storage, IO and networking, hardware, software, services, virtual, container and cloud) is rapidly changing. You may encounter a missing URL, or a URL that has changed. This list is updated on a regular basis to reflect changes (additions, changes, and retirement).

    Disclaimer and note: URL’s submitted for inclusion on this site will be reviewed for consideration and to be in generally accepted good taste in regards to the theme of this site.

    Best effort has been made to validate and verify the data infrastructure URLs that appear on this page and web site however they are subject to change. The author and/or maintainer(s) of this page and web site make no endorsement to and assume no responsibility for the URLs and their content that are listed on this page.

    Software Defined Data Infrastructure Essentials Book SDDC

    Send an email note to info at storageio dot com that includes company name, URL, contact name, title and phone number along with a brief 40 character description to be considered for addition to the above data infrastructure list, or, to be removed. Note that Server StorageIO and UnlimitedIO LLC (e.g. StorageIO) does not sell, trade, barter, borrow or share your contact information per our Privacy and Disclosure policy. View related data infrastructure Server StorageIO content here, and signup for our free newsletter here.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    • f5.com    Networking solutions
    • fabric7.com    High speed networking
    • falconstor.com    Storage management software
    • FarStone.com    Backup and data protection software
    • fcoe.com    Web site pertaining to Fibre Channel over Ethernet (FCoE)
    • fdr.com    Aka Innovation data protection tools
    • fedoraproject.org    Linux based operating system
    • Fiber Internet Center    AWS connect parter, Hosting/cloud/access services
    • FiberLight    AWS connect parter, Hosting/cloud/access services
    • fibrechannel.org    Fibre Channel Trade Group
    • filenet.com    File Management Solutions
    • FilesX.com    Backup and data protection software (Bought by IBM)
    • filetek.com    Data management solutions (Bought by SGI)
    • finisar.com    Test, Diagnostic, and Optic Transceivers
    • firescope.com    DCIM, IRM, PMDB, CMDB data solutions
    • First Communications    AWS connect parter, Hosting/cloud/access services
    • Firewall Technical    AWS Desktop, Server and Network Support
    • flashsoft.com    SSD cache software (Bought by SANdisk)
    • Flexiant    Cloud management tools
    • flexstar.com    Hardware testing equipment
    • FNT Software    Data Center and DCIM software tools
    • Folder Sizes    Disk Space Management software tools
    • force10.com    High speed networking (Bought by Dell)
    • forsythe.com    VAR
    • foundrynetworks.com    Networking switches (Bought by Brocade)
    • FreeNAS    ZFS based NAS storage software
    • frety.com    Site with links to various technologies
    • fueleconomy.gov    US Government site for energy efficiency
    • fujifilm.com    Data storage tape media
    • Fujitsu.com    Computers, disks, storage
    • fujitsu-siemens.com    Storage, VTL, storage management solutions
    • fulcrummicro.com    10Gb and high performance chips and cross bars
    • fusionio.com    PCIe based NAND/FLASH local SSD for internal server attachment
    • ioturbine.com    IO optimization driver software (Bought by FusionIO)
    • fusionstorm.com    Value added reseller (VAR)
    • FutureMark    PC Benchmarking and testing tools (PCMark and others)
    • gear6.com    Data performance acceleration NAS caching appliance (Bought by Violin)
    • Geist Global    Data Center and DCIM tools
    • geminare.com    Cloud and application migration and recovery tools
    • genie-soft.com    Backup and data protection tools
    • genstor.com    Storage solutions
    • gfi.com    SMB Email security and data protection
    • gigaspace.com    Grid application and data management middle ware
    • gladinet.com    Cloud storage access software
    • Global Capacity    AWS connect parter, Hosting/cloud/access services
    • globalstor.com    Data storage solutions
    • glodynetechnoserve.com    IT Management tools
    • gluster.com    Open source clustered file system (Bought by Redhat)
    • gogrid.com    Cloud IaaS and hosting services
    • goldengate.com    Data protection and management software (Bought by Oracle)
    • goodsync.com    Data protection solutions
    • Google    Various cloud services including Google Drive, Documents and others
    • graudata.com    Archive software tools
    • Gravitant    Cloud brokerage and management tools
    • green-bytes.com    ZFS based storage management solutions
    • Greenfield Software    DCIM software tools
    • greenliant.com    Nand flash SSD for embedded solutions
    • greenplum.com    Data warehouse storage solutions (Bought by EMC)
    • greenracksystems.com    VAR
    • gresham-storage.com    Virtual tape solutions (VTL sold to Tributary)
    • GridGain    in memory computing
    • gridironsystems.com    Big data and high performance appliance storage
    • gridstore.com    Clustered NAS storage
    • Global Telecom Technology, Inc. (GTT)    AWS connect parter, Hosting/cloud/access services
    • Apache Hadoop    Hadoop Big Data Tools
    • hastorage.com    Value added reseller (VAR)
    • www.hddfiresafe.com    Fire proof and water resistant storage systems
    • hds.com    Storage sub-systems and software
    • hermes-softlab.com    IT and virtualization software
    • Hibernia Atlantic    AWS connect parter, Hosting/cloud/access services
    • hifn.com    Optimization technology (Bought by Exar)
    • high-rely.com    Removable storage solutions
    • hi-stor.com    VAR
    • hitachigst.com    Hitachi Global Storage Technologies – Disk drives (Bought by WD)
    • Hotlink    Data protection, cloud and virtualization management tools
    • hp.com    Storage networking hardware and software
    • htch.com    Hutchinson technologies – disk drive components
    • huawei.com    Networking technologies
    • hydrastor.com    Multi-tenant clustered storage (NEC)
    • hyper9.com    Virtualization management tools (aka Inovawave)
    • hyperio.com    Storage and I/O performance monitoring for Windows
    • hytrust.com    Virtual infrastructure security tools
    • Hyve Solutions   Open Compute Project Servers and Storage
    • i365.com    Online cloud backup (Bought by Seagate e.g. Evault)

    • i3-groep.nl    Dutch ICT VAR
    • iarchive.com    Value added reseller (VAR)
    • iBackup    Online and cloud backup service
    • ibm.com    Storage networking hardware and software
    • Ibrix.com    Clustered and cloud storage software (Bought by HP)
    • Iceweb.com    Data storage solutions
    • icorps.com    IT outsourcing and consulting services
    • IDRIVE    Cloud storage backup
    • idt.com    Server, storage, memory, networking components
    • ieee.org    Institute of Electrical and Electronics Engineers
    • ietf.org    Internet Engineering Task Force
    • iland    Cloud and virtualization services tools
    • illumita.com    IT Cloud solutions
    • Imation.com    Removable media, primary and archive storage (Bought Nexsan)
    • imperva.com    Data protection tools
    • imtpartners.com    Storage TCO modeling tool
    • Inboxer.com    Email and compliance risk management tools
    • Incentra.com    VAR (Bought by Datalink)
    • incipient.com    Storage management and virtualization (Assets bought by TMS)
    • indexengines.com    eDiscovery, search, indexing, classification
    • infineta.com    WAN optimization
    • infinibandta.org    InfiniBand Trade Organization
    • infinicon.com    InfiniBand Technology
    • Infinio    VMware NAS I/O acceleration cache
    • infinityio.com    Storage networking training
    • infocachecorp.com    Data discovery solutions VAR
    • InfoGuard.com    Data security solutions
    • infology.net    eDiscovery
    • Infortrend.com    RAID controllers
    • infostor.com    Magazine focused on storage and storage networking
    • infostreet.com    Cloud Desktop tools
    • Inktank    Ceph services
    • inmage.com    Data protection appliance
    • innovationdp.com    Data management software
    • inoc.com    Network Operations Center (NOC) service
    • Inovawave.com    Virtualization management tools (aka Hyper9)
    • Inphase-technologies.com    Holographic storage
    • inquinox.com    Data, dedupe and data protection management tools
    • inrange.com    Storage Networking Formerly Dataswitch (Bought by CNT Bought by McData Bought by Brocade)
    • insight.com    Value Added Reseller (VAR)
    • insynchq.com    Cloud storage, document sharing
    • intel.com    Host adapters and chips
    • intelipathsolutions.com    Virtual network connectivity (Aka Onpath)
    • intellimagic.net    Server performance, resource management software
    • IntelliProp    SAS and SATA storage
    • InterCloud    AWS connect parter, Hosting/cloud/access services
    • intermedia.net.com    Exchange email hosting service
    • Intermine.com    Storage management software
    • Internap.com    Cloud, managed services, hosting and colo
    • interscapetech.com    Cloud and storage tools / services
    • InterSOC.com    Security management tools
    • intersystems.com    Medical Information Technology software
    • intradyn.com    Storage and data protection for SMB (Part of Sony)
    • intransa.com    iSCSI storage
    • Intronis.com    Online, managed and cloud backup solutions
    • iolo.com    Desktop tuneup, protection tools
    • iomega.com    SMB iSCSI, NAS and other storage (Bought by EMC, Partnering with Lenovo)
    • iometer.org    Iometer performance benchmarking tool
    • Ion Computer    Server, storage and data center solutions
    • iosafe.com    Rugged and fire proof, water proof storage
    • IP Fabrics    SDN switch
    • iphouse.com    MSP, hosting and cloud services
    • iqstor.com    Storage for SMB environments
    • iri.com    Big data management tools
    • CoSort Company IRI    Data management and protection tools
    • ironmountain.com    Data archive, managed and cloud services
    • ironspeed.com    Mobile database tools
    • iSecure    Internet security and forensics services
    • isilon.com    Shared storage – (Bought by EMC)
    • iso.org    International Standards Organizations
    • iStor.com    iSCSI storage
    • IT-ERNITY    Data center and hosting services
    • ivivity.com    Storage virtualization technology
    • iwavesoftware.com    Heterogeneous storage automation software
    • ixia.com    Fibre Channel test equipment
    • IX Reach    AWS connect parter, Hosting/cloud/access services
    • ixsight.com    IT and IRM/SRA insight and data migration
    • JAM Software    Treesize SRM including for NAS
    • jdsu.com    Storage networking optics
    • Jeda Networks    Software defined network and storage management
    • jedec.org    Joint Electron Device Engineering Council
    • jmr.com    Storage systems
    • jni.com    Host bus adapters
    • joyent.com    Cloud infrasture tools
    • jumpbox.com    VM virtual appliance hosting
    • jumpbox.com    Virtualization solutions
    • jungledisk.com    Cloud storage, backup file sharing
    • juniper.net    Networking technologies

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    Visit the following additional data infrastructure and IT data center related links.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Posted on

    Data Infrastructure IT Industry Related Resource Links K to O

    Data Infrastructure IT Industry Related Resource Links K to O

    IT Data Center and Data Infrastructure Industry Resources

    Updated 2/20/2018

    Following are some useful Data Infrastructure IT Industry Resource Links K to O to cloud, virtual and traditional IT data infrastructure related web sites. The data infrastructure environment (servers, storage, IO and networking, hardware, software, services, virtual, container and cloud) is rapidly changing. You may encounter a missing URL, or a URL that has changed. This list is updated on a regular basis to reflect changes (additions, changes, and retirement).

    Disclaimer and note: URL’s submitted for inclusion on this site will be reviewed for consideration and to be in generally accepted good taste in regards to the theme of this site.

    Best effort has been made to validate and verify the data infrastructure URLs that appear on this page and web site however they are subject to change. The author and/or maintainer(s) of this page and web site make no endorsement to and assume no responsibility for the URLs and their content that are listed on this page.

    Software Defined Data Infrastructure Essentials Book SDDC

    Send an email note to info at storageio dot com that includes company name, URL, contact name, title and phone number along with a brief 40 character description to be considered for addition to the above data infrastructure list, or, to be removed. Note that Server StorageIO and UnlimitedIO LLC (e.g. StorageIO) does not sell, trade, barter, borrow or share your contact information per our Privacy and Disclosure policy. View related data infrastructure Server StorageIO content here, and signup for our free newsletter here.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    • kaminario.com    Scale out high performance database server
    • kanbox.com    Chineese cloud provider
    • kaseya.com    IT Infrastructure resource management tools
    • kashya.com    Data Protection Solutions (Bought by EMC)
    • kastenchase.com    Data and information security solutions
    • kazeon.com    eDiscovery, search, indexing, classification (Bought by EMC)
    • kcura.com    eDiscovery tools
    • Kerstor.com    Cloud storage
    • kickfire.com    Business analytics tools
    • kineticd.com    Storage and data protection solutions
    • Kingston.com    Memory manufacturer
    • KLSecurity.com    Data protection solutions
    • komnetworks.com    Archiving solutions
    • k-par.com    Archiving solutions
    • ksplice.com    Linux management tools
    • Kubisys.com    Virtualization management tools
    • KVH Co. Ltd.    AWS connect parter, Hosting/cloud/access services
    • kvsinc.com    Email archiving and compliance software
    • lacie.com    Consumer, SOHO and SMB NAS and DAS storage (Bought by Seagate)
    • laconicsecurity.com    Cloud security and storage
    • lampertz.com    Environmental and data center protection
    • laurustech.com    Managed services provider
    • lecroy.com    Analyzers, probes and diagnostics
    • lefthandnetworks.com    iSCSI clustered storage (Bought by HP)
    • legato.com    Storage management software (Bought by EMC)
    • Lenovo   Servers, storage, workstations
    • Level 3 Communications    AWS connect parter, Hosting/cloud/access services
    • lexar.com    Flash memory
    • liebert.com    Data center power and cooling systems (Bought by Emerson)
    • Lightower    AWS connect parter, Hosting/cloud/access services
    • lightsand.com    SAN connectivity
    • likewise.com    Open backup software for macs/Linux/windows
    • liquidcomputing.com    High density servers
    • liquidcoolsolutions.com    Liquid cooled servers
    • Liquidware Labs   Desktop management solutions
    • livedrive.com    Cloud storage and backup
    • www.liveoffice.com    Cloud and Email hosting
    • LiveVault.com    Online cloud backup service (Bought by IronMountain)
    • locknet-inc.com    Security and network management
    • Lockstep.com    Backup and data protection tools
    • logicube.com    Hard drive copy tools
    • LoginVSI   VDI Testing solutions
    • losttapes.org    Portal pertaining to lost magnetic tape information
    • lsi.com    Storage and networking chips and controllers (Bought by Avago)
    • lto-technology.com    Information about LTO tape media
    • lucent.com    Networking components
    • lumigent.com    Compliance management tools
    • luminex.com    S390 IBM Mainframe to open systems gateways
    • luxtera.com    High speed network and storage interconnects
    • m5data.com    VAR
    • MagePlace Backup    Backup and data protection solutions
    • Maginatics.com    Storage for virtual environments
    • magma.com    PCIe and storage solutions
    • mainline.com    VAR
    • Maintech    Infrastructure services
    • maintech.com    IT Servers and solutions
    • Maldivica    Cloud and object storage gateway
    • ManageEngine    DCIM, data center and networking management
    • maponics.com    Mapping data solutions
    • MAPR   Hadoop and Big Data Tools

    • maranti.com    Storage systems
    • marconi.com    Networking equipment
    • marvell.com    Data storage components
    • Masergy    AWS connect parter, Hosting/cloud/access services
    • Mathon.com    eDiscovery
    • maxava.com    HA tools for IBM iSeries
    • maxell.com    Data storage media
    • maxim-ic.com    Data storage components and solutions
    • maxiscale.com    Web infrastructure scale out file system
    • Maxta   Virtualization storage
    • maxtor.com    Disk drives (Bought by Seagate)
    • maxxan.com    Storage systems (Now Ciphermax)
    • mcdata.com    Switches, WAN gateways, software (Bought by Brocade)
    • mediagateusa.com    HD Video streaming appliance
    • Meditech.com    Medical information technology software
    • Megaport    AWS connect parter, Hosting/cloud/access services
    • mellanox.com    Ethernet and InfiniBand technology
    • Memeo.com    Data and content management tools
    • Mendocino.com    CDP and data protection (Missing in Action)
    • metalogix.net    Sharepoint archiving solutions
    • methode.com    Storage networking transceivers
    • mezeo.com    Cloud storage management tools
    • micron.com    SSD storage solutions
    • micronet.com    Storage solutions
    • microsoft.com    Hyper-V virtualizaiton, Windows Storage Server, Azure Cloud, Storsimple, SkyDrive (aka OneDrive) and more
    • midwave.com    Var
    • Mimecast email management including archiving
    • Mimosasystems.com    Email protection and archiving (Bought by Iron Mountain)
    • mindtree.com    Testing services
    • Mirantis    OpenStack tools, downloads, service and support
    • Miray HDClone    Storage clone and data protection tools
    • mirra.com    SMB storage sharing
    • mobiuspartners.com    VAR
    • Modius    DCIM power, cooling and monitoring
    • moka5.com    VDI tools
    • MongoDB    Open source document optimized database
    • Monitis.com    IT Monitoring and services (applications, systems, clouds and more)
    • Monosphere.com    Storage planning and usage software (Bought by Quest)
    • moonwalk.com    HSM, ILM and data management software
    • morphlabs.com    Dense converged server platforms
    • mosaictec.com    Value added reseller (VAR)
    • mosys.com    High density memory components
    • mpstor.com    Cloud storage and orchestration software
    • msiinet.com    VAR
    • mti.com    European VAR
    • mtron.net    Solid state storage devices
    • My Digital SSD    SSD solutions
    • NAKIVO    Backup and data protection tools
    • napatech.com    Network tools and analysis
    • naspa.org    System administrator’s user group
    • nasuni.com    Cloud storage access appliance
    • ncino.com    Banking and financial deployment platform
    • ncipher.com    Data protection and security solutions (Bought by Thales)
    • ncompass-inc.com    VAR and services firm
    • ncr.com    Servers and storage solutions
    • ndci.com    Data conversion services
    • ndmp.org    Trade organization for NDMP backup protocol
    • neartek.com    VTL software (Bought by EMC)
    • nebulassolutions.com    Security and data protection
    • NEC.com    Servers and storage
    • neopathnetworks.com    Network file management solutions (Bought by Cisco)
    • neoscale.com    Storage networking security (Assets Bought by nCipher)
    • nephoscale.com    Cloud and object storage
    • NeptunesCloud.net    Cloud IaaS solutions
    • www.neptuny.com    Performance and capacity planning tools
    • nerc.com    North American Electrical Reliability Council
    • netcelera.com    WAN File system caching and acceleration
    • netcomm.com.au    Broadband service provider
    • netdirectsystems.com    VAR
    • neterion.com    High performance iSCSI and Ethernet 10Gb technology Bought by Exar)
    • netex.com    IP compression and channel extension
    • netezza.com    Big Data – Data warehouse storage solutions (Bought by IBM)
    • Netgear.com    SOHO and SMB storage and networking
    • NetIQ    Data center, security, identify and data protection management
    • netlist.com    Memory solutions
    • netoptics.com    Network monitoring
    • netronome.com    Network and I/O optimization technology
    • netspi.com    Network security and digital forensics
    • networkappliance.com    Storage sub-systems, management software
    • networkgeneral.com    Network and application monitoring
    • networkinstruments.com    Network test and diagnostic and performance monitoring
    • netwrix.com    Enterprise systems management tools
    • netxen.com    High performance 10Gb Ethernet chips and NICs
    • neuwingenergy.com    Energy management organization
    • neuxpower.com    File compression and data reduction
    • Neverfailgroup.com    HA software
    • nevex.com    Caching and application acceleration
    • newboundary.com    IT policy management and IRM tools
    • newisys.com    Storage enclosures
    • newrelic.com    Web, cloud and application management
    • nexenta.com    ZFS based storage management solutions
    • nexgenstorage.com    Storage with PCIe flash card
    • nexsan.com    SAS/SATA and MAID storage subsystems (Bought by Imaiton)
    • nextio.com    SSD and application acceleration solutions
    • NexusMN / Computex    VAR (e.g. Formerly Nexus MN and Stratos – now Computex)
    • nfpa.org    National Fire Protection Association
    • nicira.com    Software defined networking and IOV (Bought by VMware)
    • nimblestorage.com    Converged iSCSI SAN, backup and DR
    • nimbula.com    Cloud and application orchestration management tools
    • Nimbusdata.com    iSCSI storage
    • nirvanix.com    Cloud storage provider (Ceased operations)
    • njvc.com    Cloud and technology service provider
    • Nylte    DCIM software tools
    • noggin.intel.com/rr/    Intel Recommended Reading List
    • noliosoft.com    Cloud application management tools
    • Norlight.com    Data communications and services
    • nortel.com    Networking products
    • nortelnetworks.com    Optical networking
    • northernsoft.com    Medical software
    • novastor.com    Backup and cloud data protection tools
    • Novell.com    Server software vendor (Bought by Attachmate)
    • Novuscg.com    Storage management and services (Bought by IBM)
    • Nomura Research Institute (NRI)    AWS connect parter, Hosting/cloud/access services
    • nsic.org    National Storage Industry Consortium
    • ntp.com    Storage Management Software
    • NTT Communications Corporation    AWS connect parter, Hosting/cloud/access services
    • numarasoftware.com    IT Resource management, asset tracking tools
    • numonyx.com    SSD memory solutions
    • nutanix.com    Converged server and storage VM platform
    • nvelo.com    Caching IO performance tools
    • nvidia.com    Graphics and visualization tools
    • ocarinanetworks.com    Data reduction and compression tools (Bought by Dell)
    • ocztechnology.com    SSD drives and PCIe cards (Bought by Toshiba after bankruptcy)
    • offsitebackups.com    Online and cloud backup solutions
    • olixir.com    Removable storage for backup and data protection
    • omneon.com    Archiving and fixed content storage solutions
    • onapp.com    Cloud, CDN and storage tools
    • onaro.com    Storage and Storage Network Management (Bought by NetApp)
    • onlinebackupsearch.com    Various online backup reviews
    • oblinecourses.com    Various online education courses for various topics
    • onpathtech.com    Physical layer networking
    • onstor.com    Clustered NAS storage including NAS gateways (Bought by LSI)
    • Ontrack.com    Email and data protection software
    • OO Software   Windows management and data protection tools
    • opalis.com    Virtual data center management tools
    • OpenCompute   OpenCompute consortium
    • opendatacenteralliance.org    Open Data Center Alliance
    • open-e.com    iSCSI and NAS storage
    • Open.IO    Application aware object and bulk scale out software defined storage
    • openfabrics.org    Open Fabric Alliance
    • OpenNebula    Open source cloud software
    • opennetworking.org    Open Networking Foundation
    • OpensourceSystems.com    Data storage solutions
    • OpenStack   Open source cloud compute and storage software
    • opnet.com    Application and network performance management
    • Opsware.com    Network and storage management (HP)
    • Optica Tech.    Server and storage connectivity including FICON
    • opticatech.com    Mainframe and ESCON encryption
    • oracle.com    Data management software, hardware and services (Bought Sun/STK and others)
    • Ortera.com    Performance monitoring and management
    • OSNEXUS   Quantstor ZFS based Storage management solutions
    • Outsource Data Recovery   Data Recovery services
    • overlandstorage.com    Tape and backup, data retention, NAS solutions
    • owncloud.org    Cloud infrastructure tools

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    Visit the following additional data infrastructure and IT data center related links.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Posted on

    Data Infrastructure IT Industry Related Resource Links P to T

    Data Infrastructure IT Industry Related Resource Links P to T

    IT Data Center and Data Infrastructure Industry Resources

    Updated 6/13/2018

    Following are some useful Data Infrastructure IT Industry Resource Links P to T to cloud, virtual and traditional IT data infrastructure related web sites. The data infrastructure environment (servers, storage, IO and networking, hardware, software, services, virtual, container and cloud) is rapidly changing. You may encounter a missing URL, or a URL that has changed. This list is updated on a regular basis to reflect changes (additions, changes, and retirement).

    Disclaimer and note: URL’s submitted for inclusion on this site will be reviewed for consideration and to be in generally accepted good taste in regards to the theme of this site.

    Best effort has been made to validate and verify the data infrastructure URLs that appear on this page and web site however they are subject to change. The author and/or maintainer(s) of this page and web site make no endorsement to and assume no responsibility for the URLs and their content that are listed on this page.

    Software Defined Data Infrastructure Essentials Book SDDC

    Send an email note to info at storageio dot com that includes company name, URL, contact name, title and phone number along with a brief 40 character description to be considered for addition to the above data infrastructure list, or, to be removed. Note that Server StorageIO and UnlimitedIO LLC (e.g. StorageIO) does not sell, trade, barter, borrow or share your contact information per our Privacy and Disclosure policy. View related data infrastructure Server StorageIO content here, and signup for our free newsletter here.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    • Packeteer.com    WAFS and networking solutions (Bought Tacit)
    • packetlight.com    CWDM and DWDM networking solutions
    • Panasas.com    Clustered storage solution
    • pancetera.com    Virtual machine backup software (Bought by Quantum)
    • Panduit.com    Networking and cable management
    • panzura.com    Cloud storage access software
    • paraccel.com     Business and data analytics
    • paragon-software.com    Storage management and backup tools
    • parallels.com    VDI and desktop virtualization and cloud tools
    • parascale.com     Clustered and cloud storage software
    • pcisig.com    PCI trade group (PCI, PCI-X, PCI-Express/PCIe)
    • penguincomputing.com    HPC servers, storage and hosting
    • pergamumsystems.com    Archive solutions (Stealth)
    • Permabit.com    Data archiving solutions
    • Pernixdata    Server and storage I/O cache optimization for virtual servers
    • perotsystems.com    Hosting and managed service provider (Bought by Dell)
    • pgp.com    Security tools (Bought by Symantec)
    • PHDvirtual    Data protection tools
    • Pillardata.com    Data storage solutions – (Bought by Oracle)
    • pineapp.com    Email, archive solutions, web and data protection
    • Piviot3.com    IP Storage
    • Pivotal Labs    Big Data, PaaS development tools, EMC/VMware spinout
    • plasmon.com    (Now called Alliance Storage Technologies) Optical Storage Solutions
    • plextoramericas.com    SSD and other storage solutions
    • plianttechnology.com    Solid state storage devices (SSD) – (Bought by SANdisk)
    • Pluribus Networks    Converged and software defined network management
    • pmc-serria.com    Storage networking component supplier
    • pny.com    Memory componets and technology
    • Pogoplug    Cloud storage
    • PolyServe.com    Clustered storage solutions (Sold to HP)
    • Polargy    Data Center facilaties, HVAC and DCIM solutions
    • power.org    Power Processor trade group
    • Mushkin   SSD Solutions
    • Peak Cloud    Cloud and storage services
    • PowerFile.com    Data archiving solutions
    • powerware.com    UPS and power conditioning systems
    • procedo.com    Archiving and migration solutions
    • proceedtechnologies.com    SAP consulting
    • profusionbackups.com    Cloud and managed backup service solution
    • progeny.net    VAR and specialized IT systems
    • prolexic.com    Distributed denial of service tools
    • promise.com    RAID storage systems
    • Prostorsystems.com    Removable disk storage (See RDX Alliance)
    • Proxim.com    Wireless networking
    • proximaldata.com    SSD caching and tiering software
    • pt.com    Communications hardware and software
    • puresi.com aka Puresilicon    SSD storage solutions
    • purestorage.com    SSD based storage
    • Puppet Labs    IT Automation and DCIM tools for physical, Cloud and Virtual

    • qlogic.com    Host bus adapters and switches
    • qsantechnology.com    iSCSI IP storage
    • Qstart Technologies    Data protection storage including LTFS based systems
    • Quadric Software    Data protection software
    • qualstar.com    Tape backup and archive solutions (Aka Qstar)
    • quantum.com    Tape drives and libraries
    • quest.com    IT and data management solution tools (Bought by Dell)
    • Qumulo    Stealth storage startup
    • qwest.com    (Century Link) Telephone and data networking, managed services provider
    • racemi.com    Repurposing management tools
    • Rackable.com    Now SGI
    • Rackspace.com    Managed services and hosting
    • www.rackwise.com    Data center management tools
    • raidinc.com    Storage systems
    • raidundant.com    Storage systems
    • Rainfinity.com    File virtualization (Bought by EMC)
    • rainstor.com    Big data management tools
    • rapidio.org    RapidIO Trade Group
    • Raritan    Data center and DCIM tools
    • rasilient.com    Storage subsystem vendor
    • Ravello    VMware optimization and management tools
    • Raxco    Data, storage and systems management tools
    • rebit.com    Backup and data protection solutions
    • RecordNation    Digital Data Storage and Records Management
    • redbend.com    Mobile device and application management
    • redbooks.ibm.com    IBM Red books and Red pieces technical articles
    • Redhat.com    Linux provider (Bought Gluster)
    • Reduxio    Hybrid storage with data services
    • reflexphotonics.com    Optical connectivity solutions
    • Reldata.com    Storage systems (Renamed Starboard)
    • remote-backup.com    Remote backup software
    • renewdata.com    Data management and compliance tools
    • repliweb.com    Web and content distribution
    • Retrospect    Data Protection Software Tools
    • revivio.com    Data Protection Software (Assets Bought by Symantec)
    • rightscale.com    Amazon cloud computing management tools
    • rimage.com    CD/DVD production technologies
    • risingtidesystems.com    VAR
    • Ritek.com    Storage solutions
    • rittal.com    Enclosures and cabinets
    • riverbed.com    Wide area file access acceleration solution
    • rjssoftware.com    Document capture and management
    • rmsource.com    Cloud backup solutions
    • rnanetworks.com    Virtual memory management solutions (Bought by Dell)
    • rocketdivision.com    iSCSI technologies
    • rorke.com    VAR
    • rpath.com    Data center automation
    • rsa.com    Security division of EMC
    • safemediacorp.com    Internet security and intrusion detection tools
    • safenet-inc.com    Data protection focused VAR
    • Sagecloud   Cloud storage, deep cold archive
    • samsung.com    Various technologies including SSD memory
    • sanblaze.com    Embedded storage and emulation solutions
    • SANbolic.com    Storage, server and cloud management tools
    • sand-chip.com    Chip design
    • SANDforce.com    SSD storage solutions – (Bought by LSI)
    • sandial.com    Defunct SAN startup
    • SANdisk.com    SSD memory components
    • sandpiperdata.com    Data migration services
    • sanmina-sci.com    Contract manufacturer (Virtual Factory) for various OEM/VARs
    • sanovi.com    Disaster recovery management tools
    • sanpulse.com    SRA and automation tools
    • sanrad.com    Storage networking routers (Bought by OCZ)
    • sans.org    Security related web site
    • sansdigital.com    VAR
    • sap.com    Information management tools and applications
    • sas.com    Statistical analysis software
    • sata-io.org    Serial ATA trade organization
    • SavageIO   High performance storage solutions
    • savvis.com    Cloud, managed service provider and hosting (Bought by Centurylink)
    • sbbwg.org    Storage Bridge Bay Working Group
    • scalable-systems.com    Data warehouse consulting and tools
    • scalecomputing.com    Clustered storage management software
    • scalemp.com    Virtualization technology for scale out computing
    • scalent.com    Virtual IT data center management tools
    • scality.com    Email and sharepoint cloud storage
    • schoonerinfotech.com    SSD based database management solutions
    • scsita.org    SCSI and SAS trade group
    • seagate.com    Disk drives
    • Sealpath   Data and information protection tools
    • seanodes.com    Distributed storage
    • sec.gov    Site about compliance items including CFR 17a-4
    • securedatainnovations.com    Data protection and security tools
    • sentilla.com    Data center performance management tools
    • sepaton.com    Disk based backup solutions
    • serialata.org    Serial ATA trade association
    • servicemesh.com    Cloud, datacenter transformation and devops tools
    • servicenow.com    ITIL data center management tools
    • 1servosity.com    Cloud data protection
    • servoy.com    Cloud development tools
    • ServPath.com    Hosting services
    • seven10storage.com    Disaster recovery and archiving software
    • sgi.com    Storage, server and data management hardware, software, tools
    • sherpasoftware.com    Email archiving
    • shop.bellmicro.com    Distributor (Bought by Avnet)
    • siber.com    Data protection and security tools
    • sidusdata.com    Managed service and cloud provider
    • siemon.com    Storage networking infrastructure items
    • sigmasol.com    Value added reseller (VAR)
    • Signiant.com    Data management tools
    • silexamerica.com    Mobile device and server connectivity
    • SiliconImage.com    Digital Video components
    • SiliconStor.com    Storage networking silicon
    • siliconvalleypr.com    IT technologies press/media and analyst relations firm
    • silveradotech.com    VAR
    • silver-peak.com    Wide area data and file services (WAFS, WADM, WADS)
    • SilverSky    Cloud security
    • simpletech.com    Storage solutions including USB portable devices
    • simplivity.com    Convergence and virtualization solutions
    • simplycontinuous.net    Data protection and cloud backup
    • siriuscom.com    VAR
    • site-vault.com    On-line backup server provider (BSP) managed service provider (MSP)
    • skyera.com    SSD storage solutions
    • skytap.com    Public and private cloud application development tools
    • Smart421   Smart421    AWS connect parter, Hosting/cloud/access services
    • smartm.com    PC card and other memory module components
    • smc.com    Storage and networking components
    • smithmicro.com    Mobile data management tools
    • smmdirect.com    Memory devices
    • snapappliances.com    NAS Storage solutions (Now Adaptec)
    • snia.org    Storage Networking Industry Association
    • snseurope.com    U.K. & European Storage Networking News
    • snwusa.com    SNIA and Computerworld conference
    • softek.com    Storage management solutions (formerly Fujitsu Softek, Sold to IBM)
    • softlayer.com    Cloud infrastructure services (IaaS) (Bought by IBM)
    • softnas.com    ZFS based opensource NAS solutions
    • softricity.com    Virtualization management tools (Bought by Microsoft)
    • Sogeti.com    Data management tools
    • solarflare.com    10Gb Ethernet networking
    • solarwinds.com    IT management tools (Bought TekTools, Hyper9 and others)
    • solidaccess.com    Solid state storage (SSD) solutions
    • soliddata.com    Solid State Disk solutions
    • solidfire.com    iSCSI SSD optimized for hosting and cloud providers
    • Solix.com    Database archiving software
    • solutiontechnology.co.uk    Storage networking training
    • sonasoft.com    Email archiving, backup and data protection
    • sonnettech.com    External storage solutions
    • sony.com    Storage devices
    • sophos.com    Data protection and security tools
    • sorrento.com    Optical networking
    • sparebackup.com    Backup data protection solutions
    • sparkweave.com    Private cloud archive and file sharing
    • spec.org    SPEC benchmarks
    • spectralogic.com    Tape library and disk based backup solutions
    • spiceworks.com    Online community and management software tools
    • spirent.com    Storage networking test equipment
    • Spiron.com  Data discovery, classification, lifecycle management (formerly Identity Finder)
    • Splice Communications   Splice Communications    AWS connect parter, Hosting/cloud/access services
    • splunk.com    DCIM and log management tools
    • spotcloud.com    Cloud services clearing house
    • spraycool.com    IT Data center and component cooling
    • springsoft.com    Bought by Synopsys
    • spsoftglobal.com    Software development
    • spyrus.com    Security tools
    • ssswg.org    IEEE Storage Systems Standards Work Group
    • starboardstorage.com    Unified storage solutions (Formerly Reldata, now ceased operations)
    • startech.com    IT/AV technolgie equipment from enclosures to KVM and more
    • starwindsoftware.com    iSCSI storage management solutions
    • stcroixsolutions.com    VAR
    • stec-inc.com    SSD storage (Bought by WD)
    • Steeleye.com    HA software
    • Stellar    Data Protection tools
    • storagetek.com    Disk, tape, data management software (Bought by Sun)
    • stonebranch.com    File transfer tools
    • stonefly.com    Storage networking routers (Aka DNF)
    • storability.com    Storage management software (Bought by STK)
    • storactive.com    Data protection solutions
    • storagecraft.com    Data protection tools
    • storagefusion.com    Storage resource analysis (SRA) tools
    • storageio.net    Alternate URL for the StorageIO Group
    • storageiogroup.com    Alternate URL for the StorageIO Group
    • storagemadeeasy.com    Hybrid and personal cloud management tools and dashboards
    • Storagemonkeys.com    Storage community site
    • storagenetworking.org    Storage Networking Users Groups also known as SNUGs
    • storageperformance.org    Storage Performance Council information
    • www.storagesearch.com    Venue for information about various storage and related topics
    • storcase.com    Data Archive solutions (Bought by Crudata)
    • store-age.com    Storage management software (Bought by LSI)
    • storediq.com    eDiscovery, search, indexing, classification (Bought by IBM)
    • Storewize.com    Real time data compression (Bought by IBM)
    • Storix.com    Data backup solutions
    • storlife.com    CAS object archive storage
    • stormagic.com    Storage virtualization and data movement software
    • storserver.com    Backup and data protection solutions
    • storsimple.com    Cloud storage access solutions (Bought by Microsoft)
    • storspeed.com    NAS/NFS optimization solutions (Missing in action)
    • stratascale.com    Cloud, hosting and management solutions
    • stratus.com    High availability storage and servers
    • sugarsync.com    Backup and data protection solutions
    • sun.com    Storage networking hardware and software (Bought by Oracle)
    • sunbeltsoftware.com    End point data protection security tools
    • sungard.com    Data protection and cloud services
    • superlumin.com    Application caching tools
    • supermicro.com    Server and storage solutions
    • surdoc.com    Cloud storage and backup
    • surgient.com    Cloud computing solutions
    • svlg.net    Silicon Valley Leadership Group
    • Swiftstack    Private cloud solutions
    • swifttest.com    NFS and CIFS storage testing solutions
    • sybase.com    Database solutions
    • sycamorenetworks.com    Networking solutions
    • Symantec.com    Data and storage management software
    • symbolicio.com    stealth startup
    • symform.com    Cloud storage and backup
    • syncsort.com    Information Management tools
    • synnex.com    Distributor
    • Synnex   IT Solutions
    • synology.com    SMB storage solutions
    • synopsys.com    Computer technology development and manufacturing
    • SysAid    Data center, DCIM and ITSM tools
    • t10.orgscsi-3.htm    ANSI T10 (SCSI information) site
    • t11.org    ANSI T11 page for Fibre Channel information
    • t3media.com    Cloud storage and video platform tools
    • tableausoftware.com    Data analytics software tools
    • tacit.com    WAN file system accelerator (Bought by Packeteer)
    • tacitnetworks.com    Wide area file access acceleration solution (Bought by Packeteer)
    • tandberg.com    Data management solutions (Bought by Cisco)
    • tapeandmedia.com    Information about magnetic tape media
    • tapepower.com    Site for tape topics
    • tarmin.com        Archiving solutions
    • teamdrive.com    Cloud storage
    • teamquest.com    IRM management and capacity management tools
    • TeamViewer.com    Remote support and Online meeting software
    • techdata.com    Distributor
    • tegile.com    Storage system solutions
    • tehutinetworks.net    High speed iSCSI adapters
    • tek-tools.com    SRM storage management software (Bought by Solarwinds)
    • TelecityGroup    AWS connect parter, Hosting/cloud/access services
    • tellabs.com    Networking components
    • Telx    AWS connect parter, Hosting/cloud/access services
    • teneros.com    Email archiving and management solutions
    • teracloud.com    Capacity planning and resource management software
    • teradata.com    Large scale database and data warehouse systems
    • teradici.com    PC over IP technologies
    • teranetics.com    Ethernet chips
    • Terascala    Data analytics and management solutions
    • ter.de    Optical storage libraries
    • terracloudinc.com    Cloud services
    • TerraScale.com    Scalable storage and server solutions
    • Verizon/Terremark   Cloud, hosting and managed services
    • Tevron   Application Response Time Monitoring
    • texmemsys.com    Solid State Disk storage
    • thebci.org    Business Continuity Institute
    • thecus.com    Multi-protocol storage
    • thegreengrid.org    Industry Trade Group
    • The Padcaster    Apple iPad tools
    • thepluggllc.com    Data center energy efficient floor tiles
    • theq3.com    Data storage security solutions
    • thinkaheadit.com aka Ahead    Value added reseller
    • thinkaheadit.com    Value added reseller (VAR)
    • thirdbrigade.com    Intrusion detection security tools (Bought by Trend Micro)
    • thirdio.com    SSD solutions
    • tiaonline.org    Telecommunications Industry Association
    • tidalsoftware.com    IT Management software tools (Bought by Cisco)
    • timespring.com    Continuous data protection solutions
    • tintri.com    NFS and NAS storage optimized for VMware
    • tivoli.com    Data management software
    • Softbank Telecom Corp.    AWS connect parter, Hosting/cloud/access services
    • Primary Data and Tonian    Stealth data virtualization startup

    • topgun-tech.com    Data Infrastructure Resource (Server, Storage, SANs)

    • top500.org    Top 500 super compute sites
    • topio.com    Data protection software (Bought by NetApp)
    • topspin.com    InfiniBand Technology (Bought by Cisco)(
    • Toshiba.com    Server and storage solutions
    • tpc.org    Transaction processing performance council
    • translattice.com    Distributed and elastic database and automation tools
    • Tredent.com    WAN optimization solutions
    • TrendMicro.com    Security and anti virus tools
    • trianz.com    VAR
    • tributary.com   Datra protection soultion tools including virtual, disk and tape-
    • trilogytechnologies.ie    Managed services provider
    • tritondata.com    IT services and VAR
    • trunkbow.com    Cloud, mobile and networking services
    • trustedcomputinggroup.org    Trusted computing industry trade group
    • trusteddatasolutions.com    VAR
    • trustedid.com    ID theft protection
    • trustware.com    Internet and data protection security tools
    • turnkeylinux.org   Turnkey Linux appliance –
    • tusc.com    VAR
    • twinstrata.com    BC/DR analysis and cloud access software
    • tw telecom   tw telecom    AWS connect parter, Hosting/cloud/access services
    • TSO logic    DCIM and data center power energy management tools
    • tzolkin.com    DNS and High Availability solutions

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    Visit the following additional data infrastructure and IT data center related links.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Posted on

    Data Infrastructure IT Industry Related Resource Links U to Z

    Data Infrastructure IT Industry Related Resource Links U to Z

    IT Data Center and Data Infrastructure Industry Resources

    Updated 2/20/2018

    Following are some useful Data Infrastructure IT Industry Resource Links U to Z to cloud, virtual and traditional IT data infrastructure related web sites. The data infrastructure environment (servers, storage, IO and networking, hardware, software, services, virtual, container and cloud) is rapidly changing. You may encounter a missing URL, or a URL that has changed. This list is updated on a regular basis to reflect changes (additions, changes, and retirement).

    Disclaimer and note: URL’s submitted for inclusion on this site will be reviewed for consideration and to be in generally accepted good taste in regards to the theme of this site.

    Best effort has been made to validate and verify the data infrastructure URLs that appear on this page and web site however they are subject to change. The author and/or maintainer(s) of this page and web site make no endorsement to and assume no responsibility for the URLs and their content that are listed on this page.

    Software Defined Data Infrastructure Essentials Book SDDC

    Send an email note to info at storageio dot com that includes company name, URL, contact name, title and phone number along with a brief 40 character description to be considered for addition to the above data infrastructure list, or, to be removed. Note that Server StorageIO and UnlimitedIO LLC (e.g. StorageIO) does not sell, trade, barter, borrow or share your contact information per our Privacy and Disclosure policy. View related data infrastructure Server StorageIO content here, and signup for our free newsletter here.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    • ubuntu.com    Opensource Linux software and cloud tools
    • unisys.com    Server, storage and managed services
    • unitedlayer.com    Collocation and hosting services
    • unitrends.com    Data protection solutions
    • updraftplus.com/    WordPress Updraft Cloud Backup Plugin
    • uptimeinstitute.org    Uptime Institute
    • uptimesoftware.com    Capacity management tools
    • Logicalis   IT solutions and managed services
    • us.logicalis.com    Cloud, managed and data center services
    • usb.org    USB trade association
    • uscolo.com    Co-location facility and hosting service
    • usenix.org    LISA and data center forums
    • usgbc.org    United States Green Building Council
    • v3sys.com    VDI and desktop cloud solutions
    • vadiumtech.com    Security and encryption tools
    • varonis.com    Unstructured data management and protection
    • vaultive.com    Cloud encryption for hosted exchange
    • vaultize.com    Cloud backup, file and data sharing
    • vaultstor.com    Data protection and cloud storage services
    • vaultus.com   Cloud, colo and manged service hosting –
    • vbridges.com    Virtual desktop management tools
    • vce.com    Converged infrastructure solutions
    • vdbench     vdbench storage testing/workload generation tool
    • veeam.com    Virtual server data protection, reporting, monitoring, cap planning
    • vellosystems.com   Cloud infrastructure technology solutoins –
    • velobit.com    SSD cache software (Bought by WD)
    • veloxum.com   VM performance management tools Added 11/30/10
    • vembu.com    Backup data protection tools
    • Venus   Venus    AWS connect parter, Hosting/cloud/access services
    • venyu.com    Cloud hosting
    • verari.com    Blade servers and blade storage
    • verdiem.com    Infrastructure Resource Management (IRM) and energy reporting tools
    • vericept.com    Network monitoring software
    • Veritest.com    Third party testing service

    • verity.com    Data search, discovery, classification
    • versant.com    Object database management solutions
    • vertinsys.com    Server I/O virtualization
    • Vibe    AWS connect parter, Hosting/cloud/access services
    • victorinox.com    Swiss army knife and USB thumb drive
    • viewfinity.com    Rights management, audit and compliance
    • vigitrust.com    Security management tools
    • vikingmodular.com    FLASH SSD storage solutions
    • violin-memory.com    FLASH SSD storage solutions
    • vion.com    Value added reseller
    • vipreantivirus.com    Security, data loss, data leak prevention
    • virident.com    SSD based database management solutions (Bought by WD)
    • viridity.com    Data center and infrastructure resource management (IRM) tools
    • virsto.com    Server virtualization management tools (Bought by VMware)
    • virtensys.com    Virtual I/O and I/O virtualization (IOV)
    • virtualinstruments.com    SAN probes/analyzers (Formerly Finisar Analyzer tools)
    • VirtualIron.com    Server virtualization (Bought by Oracle)
    • VirtunetSystems    Storage I/O acceleration and cache tools for VMware
    • virtuon-inc.com    Cloud, virtualization IT consulting and staffing
    • visi.com    Managed service provider, cloud and hosting service
    • VisionSolutions.com    BC, DR and data protection solutions
    • visualstorageintelligence.com    Cross vendor cloud storage reporting and srmprovider
    • vitesse.com    Storage networking component supplier
    • vivisimo.com    eDiscovery and search
    • vizoncore.com    Virtualization tools and data protection for virtual servers
    • vizrt.com    Video management software tools
    • vkernel.com    VM performance tools (Bought by Quest, bought by Dell)
    • vmc.com    Cloud consulting and outsourcing
    • vmturbo.com    Cloud and virtualization workload management
    • vmware.com    Server virtualization software (Bought by EMC)
    • Vocus   Vocus    AWS connect parter, Hosting/cloud/access services
    • voltaire.com    InfiniBand Technology
    • vontu.com    Data loss prevention tools (Bought by Symantec)
    • Vormetric   Data security solutions
    • votela.com    Specialized network service provider
    • vscalesystems.com    Virtual and converged networking and consulting
    • vssmonitoring.com    Network monitoring
    • vwsolutions.com    Backup and data protection solutions
    • vyatta.com    Cloud and virtual networking, IOV
    • wanova.com    Desktop management solutions
    • wasabisystems.com    iSCSI storage
    • wdc.com    Western Digital Disk drives
    • WedgeNetworks.com    Security solutions
    • whiptailtech.com    Flash SSD solutions (Bought by Cisco)
    • Microsoft Skydrive   Cloud storage
    • windspring.com    Data management and DFR for mobile access
    • wipro.com    Business services
    • workscomputing.com    VAR
    • wovensystems.com    High speed networking switches
    • wwt.com    VAR/Systems integrator
    • wysdm.com    SRA and DPM management tools (Bought by EMC)
    • Xencode.com    Various open tools
    • XenData   Digital Archive solutions
    • xenos.com    Archive and data footprint reduction solutions
    • xfpmsa.org    10Gb multi-source trade group
    • xiotech.com    Renamed XIO: Storage sub-systems and software
    • xirin.com    Storage adapter (iSCSI) and chip vendor
    • xosoft.com    BC/DR and data protection replication tools (Bought by CA)
    • xsigo.com    I/O virtualization and service oriented connectivity – (Bought by Oracle)
    • xtreemfs.org    scaleout filesystem
    • xtremio.com    SSD startup – Bought by EMC
    • xyratex.com    Storage enclosures, subsystems, test equipmen, Lustre software (Bought by Seagate)t
    • xyxel.com    Networking technologies for cloud and consumer
    • yorktel.com    video solutions
    • Yosemitetech.com    Backup software (Bought by Barracuda)
    • yousendit.com    Cloud backup, storage and file sharing
    • zadarastorage.com    iSCSI cloud storage
    • zenoss.com    Converged, Virtual systems and cloud monitoring, DCIM
    • Zentera   Private cloud and IaaS solutions
    • zerto.com    Data protection for virtual environments
    • Zetera.com    Storage over IP alternative to iSCSI
    • zetta.net    Cloud storage solutions
    • zettapoint.com    Database management tools
    • zintrus.com    Systems development
    • zirtu.com    VDI management tools and platform
    • zlti.com    Email archive and management solutions
    • zmanda.com    Open source data backup
    • zoho.com    Online and cloud management solutions
    • zyrion.com    Network and systems monitoring and management

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    Visit the following additional data infrastructure and IT data center related links.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Posted on

    Data Infrastructure IT Industry Related Resource Links to Others

    Data Infrastructure IT Industry Related Resource Links to Others

    IT Data Center and Data Infrastructure Industry Resources

    Updated 2/20/2018

    Following are some useful Data Infrastructure IT Industry Resource Links to cloud, virtual and traditional IT data infrastructure related web sites. The data infrastructure environment (servers, storage, IO and networking, hardware, software, services, virtual, container and cloud) is rapidly changing. You may encounter a missing URL, or a URL that has changed. This list is updated on a regular basis to reflect changes (additions, changes, and retirement).

    Disclaimer and note: URL’s submitted for inclusion on this site will be reviewed for consideration and to be in generally accepted good taste in regards to the theme of this site.

    Best effort has been made to validate and verify the data infrastructure URLs that appear on this page and web site however they are subject to change. The author and/or maintainer(s) of this page and web site make no endorsement to and assume no responsibility for the URLs and their content that are listed on this page.

    Software Defined Data Infrastructure Essentials Book SDDC

    Send an email note to info at storageio dot com that includes company name, URL, contact name, title and phone number along with a brief 40 character description to be considered for addition to the above data infrastructure list, or, to be removed. Note that Server StorageIO and UnlimitedIO LLC (e.g. StorageIO) does not sell, trade, barter, borrow or share your contact information per our Privacy and Disclosure policy. View related data infrastructure Server StorageIO content here, and signup for our free newsletter here.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    • www.10gea.org    10Gb Ethernet industry trade organization
    • www.1394ta.org    1394 (Firewire) trade association
    • www.3com.com    Networking equipment (Bought by HP)
    • www.3leafnetworks.com    I/O virtualization
    • www.3par.com    Clustered storage systems (Bought by HP)
    • www.3tera.com    IT Cloud management tools (Bought by CA)
    • www.4blox.com    Data center design services
    • www.4blox.com    Linux iSCSI target optimization stack
    • www.4bridgeworks.com aka Bridgeworks    SAN networking and connectivity solutions
    • www.80plus.org    Energy efficient power supply trade group

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    Visit the following additional data infrastructure and IT data center related links.

    Links A-E
    Links F-J
    Links K-O
    Links P-T
    Links U-Z
    Other Links

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Posted on

    Big Files Lots of Little File Processing Benchmarking with Vdbench

    Big Files Lots of Little File Processing Benchmarking with Vdbench


    server storage data infrastructure i/o File Processing Benchmarking with Vdbench

    Updated 2/10/2018

    Need to test a server, storage I/O networking, hardware, software, services, cloud, virtual, physical or other environment that is either doing some form of file processing, or, that you simply want to have some extra workload running in the background for what ever reason? An option is File Processing Benchmarking with Vdbench.

    I/O performance

    Getting Started


    Here’s a quick and relatively easy way to do it with Vdbench (Free from Oracle). Granted there are other tools, both for free and for fee that can similar things, however we will leave those for another day and post. Here’s the con to this approach, there is no Uui Gui like what you have available with some other tools Here’s the pro to this approach, its free, flexible and limited by your creative, amount of storage space, server memory and I/O capacity.

    If you need a background on Vdbench and benchmarking, check out the series of related posts here (e.g. www.storageio.com/performance).

    Get and Install the Vdbench Bits and Bytes


    If you do not already have Vdbench installed, get a copy from the Oracle or Source Forge site (now points to Oracle here).

    Vdbench is free, you simply sign-up and accept the free license, select the version down load (it is a single, common distribution for all OS) the bits as well as documentation.

    Installation particular on Windows is really easy, basically follow the instructions in the documentation by copying the contents of the download folder to a specified directory, set up any environment variables, and make sure that you have Java installed.

    Here is a hint and tip for Windows Servers, if you get an error message about counters, open a command prompt with Administrator rights, and type the command:

    $ lodctr /r


    The above command will reset your I/O counters. Note however that command will also overwrite counters if enabled so only use it if you have to.

    Likewise *nix install is also easy, copy the files, make sure to copy the applicable *nix shell script (they are in the download folder), and verify Java is installed and working.

    You can do a vdbench -t (windows) or ./vdbench -t (*nix) to verify that it is working.

    Vdbench File Processing

    There are many options with Vdbench as it has a very robust command and scripting language including ability to set up for loops among other things. We are only going to touch the surface here using its file processing capabilities. Likewise, Vdbench can run from a single server accessing multiple storage systems or file systems, as well as running from multiple servers to a single file system. For simplicity, we will stick with the basics in the following examples to exercise a local file system. The limits on the number of files and file size are limited by server memory and storage space.

    You can specify number and depth of directories to put files into for processing. One of the parameters is the anchor point for the file processing, in the following examples =S:\SIOTEMP\FS1 is used as the anchor point. Other parameters include the I/O size, percent reads, number of threads, run time and sample interval as well as output folder name for the result files. Note that unlike some tools, Vdbench does not create a single file of results, rather a folder with several files including summary, totals, parameters, histograms, CSV among others.


    Simple Vdbench File Processing Commands

    For flexibility and ease of use I put the following three Vdbench commands into a simple text file that is then called with parameters on the command line.
    fsd=fsd1,anchor=!fanchor,depth=!dirdep,width=!dirwid,files=!numfiles,size=!filesize

    fwd=fwd1,fsd=fsd1,rdpct=!filrdpct,xfersize=!fxfersize,fileselect=random,fileio=random,threads=!thrds

    rd=rd1,fwd=fwd1,fwdrate=max,format=yes,elapsed=!etime,interval=!itime

    Simple Vdbench script

    # SIO_vdbench_filesystest.txt
    
#
    
# Example Vdbench script for file processing
    
#
    
# fanchor = file system place  where directories and files will be created
    
# dirwid = how wide should the directories be (e.g. how many directories wide)
    
# numfiles = how many files per directory
    
# filesize = size in in k, m, g e.g. 16k = 16KBytes
    
# fxfersize = file I/O transfer size in kbytes
    
# thrds = how many threads or workers
    
# etime = how long to run in minutes (m) or hours (h)
    
# itime = interval sample time e.g. 30 seconds
    
# dirdep = how deep the directory tree
    
# filrdpct = percent of reads e.g. 90 = 90 percent reads
    
# -p processnumber = optional specify a process number, only needed if running multiple vdbenchs at same time, number should be unique
    
# -o output file that describes what being done and some config info
    
#
    
# Sample command line shown for Windows, for *nix add ./
    
#
    
# The real Vdbench script with command line parameters indicated by !=
    
#
    

    fsd=fsd1,anchor=!fanchor,depth=!dirdep,width=!dirwid,files=!numfiles,size=!filesize
    

    fwd=fwd1,fsd=fsd1,rdpct=!filrdpct,xfersize=!fxfersize,fileselect=random,fileio=random,threads=!thrds
    

    rd=rd1,fwd=fwd1,fwdrate=max,format=yes,elapsed=!etime,interval=!itime

    Big Files Processing Script


    With the above script file defined, for Big Files I specify a command line such as the following.
    $ vdbench -f SIO_vdbench_filesystest.txt fanchor=S:\SIOTemp\FS1 dirwid=1 numfiles=60 filesize=5G fxfersize=128k thrds=64 etime=10h itime=30 numdir=1 dirdep=1 filrdpct=90 -p 5576 -o SIOWS2012R220_NOFUZE_5Gx60_BigFiles_64TH_STX1200_020116

    Big Files Processing Example Results


    The following is one of the result files from the folder of results created via the above command for Big File processing showing totals.


    
Run totals
    

    21:09:36.001 Starting RD=format_for_rd1
    

    Feb 01, 2016 .Interval. .ReqstdOps.. ...cpu%...  read ....read.... ...write.... ..mb/sec... mb/sec .xfer.. ...mkdir... ...rmdir... ..create... ...open.... ...close... ..delete...
    
                          rate  resp total  sys   pct   rate  resp   rate  resp  read write  total    size  rate  resp  rate  resp  rate  resp  rate  resp  rate  resp  rate  resp
    
21:23:34.101   avg_2-28 2848.2  2.70   8.8 8.32   0.0    0.0  0.00 2848.2  2.70  0.00 356.0 356.02  131071   0.0  0.00   0.0  0.00   0.1 109176   0.1  0.55   0.1  2006   0.0  0.00
    

    21:23:35.009 Starting RD=rd1; elapsed=36000; fwdrate=max. For loops: None
    

    07:23:35.000 avg_2-1200 4939.5  1.62  18.5 17.3  90.0 4445.8  1.79  493.7  0.07 555.7 61.72 617.44  131071   0.0  0.00   0.0  0.00   0.0  0.00   0.1  0.03   0.1  2.95   0.0  0.00

    Lots of Little Files Processing Script


    For lots of little files, the following is used.


    
$ vdbench -f SIO_vdbench_filesystest.txt fanchor=S:\SIOTEMP\FS1 dirwid=64 numfiles=25600 filesize=16k fxfersize=1k thrds=64 etime=10h itime=30 dirdep=1 filrdpct=90 -p 5576 -o SIOWS2012R220_NOFUZE_SmallFiles_64TH_STX1200_020116

    Lots of Little Files Processing Example Results


    The following is one of the result files from the folder of results created via the above command for Big File processing showing totals.
    Run totals
    

    09:17:38.001 Starting RD=format_for_rd1
    

    Feb 02, 2016 .Interval. .ReqstdOps.. ...cpu%...  read ....read.... ...write.... ..mb/sec... mb/sec .xfer.. ...mkdir... ...rmdir... ..create... ...open.... ...close... ..delete...
    
                          rate  resp total  sys   pct   rate  resp   rate  resp  read write  total    size  rate  resp  rate  resp  rate  resp  rate  resp  rate  resp  rate  resp
    
09:19:48.016    avg_2-5  10138  0.14  75.7 64.6   0.0    0.0  0.00  10138  0.14  0.00 158.4 158.42   16384   0.0  0.00   0.0  0.00 10138  0.65 10138  0.43 10138  0.05   0.0  0.00
    

    09:19:49.000 Starting RD=rd1; elapsed=36000; fwdrate=max. For loops: None
    

    19:19:49.001 avg_2-1200 113049  0.41  67.0 55.0  90.0 101747  0.19  11302  2.42 99.36 11.04 110.40    1023   0.0  0.00   0.0  0.00   0.0  0.00  7065  0.85  7065  1.60   0.0  0.00

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    The above examples can easily be modified to do different things particular if you read the Vdbench documentation on how to setup multi-host, multi-storage system, multiple job streams to do different types of processing. This means you can benchmark a storage systems, server or converged and hyper-converged platform, or simply put a workload on it as part of other testing. There are even options for handling data footprint reduction such as compression and dedupe.

    Ok, nuff said, for now.

    Gs

    Greg Schulz - Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Posted on

    How to test your HDD SSD or all flash array (AFA) storage fundamentals

    How to test your HDD SSD AFA Hybrid or cloud storage

    server storage data infrastructure i/o hdd ssd all flash array afa fundamentals

    Updated 2/14/2018

    Over at BizTech Magazine I have a new article 4 Ways to Performance Test Your New HDD or SSD that provides a quick guide to verifying or learning what the speed characteristic of your new storage device are capable of.

    An out-take from the article used by BizTech as a "tease" is:

    These four steps will help you evaluate new storage drives. And … psst … we included the metrics that matter.

    Building off the basics, server storage I/O benchmark fundamentals

    The four basic steps in the article are:

    • Plan what and how you are going to test (what’s applicable for you)
    • Decide on a benchmarking tool (learn about various tools here)
    • Test the test (find bugs, errors before a long running test)
    • Focus on metrics that matter (what’s important for your environment)

    Server Storage I/O performance

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    To some the above (read the full article here) may seem like common sense tips and things everybody should know otoh there are many people who are new to servers storage I/O networking hardware software cloud virtual along with various applications, not to mention different tools.

    Thus the above is a refresher for some (e.g. Dejavu) while for others it might be new and revolutionary or simply helpful. Interested in HDD’s, SSD’s as well as other server storage I/O performance along with benchmarking tools, techniques and trends check out the collection of links here (Server and Storage I/O Benchmarking and Performance Resources).

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.

    Posted on

    I/O, I/O how well do you know good bad ugly server storage I/O iops?

    How well do you know good bad ugly I/O iops?

    server storage i/o iops activity data infrastructure trends

    Updated 2/10/2018

    There are many different types of server storage I/O iops associated with various environments, applications and workloads. Some I/Os activity are iops, others are transactions per second (TPS), files or messages per time (hour, minute, second), gets, puts or other operations. The best IO is one you do not have to do.

    What about all the cloud, virtual, software defined and legacy based application that still need to do I/O?

    If no IO operation is the best IO, then the second best IO is the one that can be done as close to the application and processor as possible with the best locality of reference.

    Also keep in mind that aggregation (e.g. consolidation) can cause aggravation (server storage I/O performance bottlenecks).

    aggregation causes aggravation
    Example of aggregation (consolidation) causing aggravation (server storage i/o blender bottlenecks)

    And the third best?

    It’s the one that can be done in less time or at least cost or effect to the requesting application, which means moving further down the memory and storage stack.

    solving server storage i/o blender and other bottlenecks
    Leveraging flash SSD and cache technologies to find and fix server storage I/O bottlenecks

    On the other hand, any IOP regardless of if for block, file or object storage that involves some context is better than those without, particular involving metrics that matter (here, here and here [webinar] )

    Server Storage I/O optimization and effectiveness

    The problem with IO’s is that they are a basic operations to get data into and out of a computer or processor, so there’s no way to avoid all of them, unless you have a very large budget. Even if you have a large budget that can afford an all flash SSD solution, you may still meet bottlenecks or other barriers.

    IO’s require CPU or processor time and memory to set up and then process the results as well as IO and networking resources to move data too their destination or retrieve them from where they are stored. While IO’s cannot be eliminated, their impact can be greatly improved or optimized by, among other techniques, doing fewer of them via caching and by grouping reads or writes (pre-fetch, write-behind).

    server storage I/O STI and SUT

    Think of it this way: Instead of going on multiple errands, sometimes you can group multiple destinations together making for a shorter, more efficient trip. However, that optimization may also mean your drive will take longer. So, sometimes it makes sense to go on a couple of quick, short, low-latency trips instead of one larger one that takes half a day even as it accomplishes many tasks. Of course, how far you have to go on those trips (i.e., their locality) makes a difference about how many you can do in a given amount of time.

    Locality of reference (or proximity)

    What is locality of reference?

    This refers to how close (i.e., its place) data exists to where it is needed (being referenced) for use. For example, the best locality of reference in a computer would be registers in the processor core, ready to be acted on immediately. This would be followed by levels 1, 2, and 3 (L1, L2, and L3) onboard caches, followed by main memory, or DRAM. After that comes solid-state memory typically NAND flash either on PCIe cards or accessible on a direct attached storage (DAS), SAN, or NAS device. 

    server storage I/O locality of reference

    Even though a PCIe NAND flash card is close to the processor, there still remains the overhead of traversing the PCIe bus and associated drivers. To help offset that impact, PCIe cards use DRAM as cache or buffers for data along with meta or control information to further optimize and improve locality of reference. In other words, this information is used to help with cache hits, cache use, and cache effectiveness vs. simply boosting cache use.

    SSD to the rescue?

    What can you do the cut the impact of IO’s?

    There are many steps one can take, starting with establishing baseline performance and availability metrics.

    The metrics that matter include IOP’s, latency, bandwidth, and availability. Then, leverage metrics to gain insight into your application’s performance.

    Understand that IO’s are a fact of applications doing work (storing, retrieving, managing data) no matter whether systems are virtual, physical, or running up in the cloud. But it’s important to understand just what a bad IO is, along with its impact on performance. Try to identify those that are bad, and then find and fix the problem, either with software, application, or database changes. Perhaps you need to throw more software caching tools, hypervisors, or hardware at the problem. Hardware may include faster processors with more DRAM and faster internal busses.

    Leveraging local PCIe flash SSD cards for caching or as targets is another option.

    You may want to use storage systems or appliances that rely on intelligent caching and storage optimization capabilities to help with performance, availability, and capacity.

    Where to gain insight into your server storage I/O environment

    There are many tools that you can be used to gain insight into your server storage I/O environment across cloud, virtual, software defined and legacy as well as from different layers (e.g. applications, database, file systems, operating systems, hypervisors, server, storage, I/O networking). Many applications along with databases have either built-in or optional tools from their provider, third-party, or via other sources that can give information about work activity being done. Likewise there are tools to dig down deeper into the various data information infrastructure to see what is happening at the various layers as shown in the following figures.

    application storage I/O performance
    Gaining application and operating system level performance insight via different tools

    windows and linux storage I/O performance
    Insight and awareness via operating system tools on Windows and Linux

    In the above example, Spotlight on Windows (SoW) which you can download for free from Dell here along with Ubuntu utilities are shown, You could also use other tools to look at server storage I/O performance including Windows Perfmon among others.

    vmware server storage I/O
    Hypervisor performance using VMware ESXi / vsphere built-in tools

    vmware server storage I/O performance
    Using Visual ESXtop to dig deeper into virtual server storage I/O performance

    vmware server storage i/o cache
    Gaining insight into virtual server storage I/O cache performance

    Wrap up and summary

    There are many approaches to address (e.g. find and fix) vs. simply move or mask data center and server storage I/O bottlenecks. Having insight and awareness into how your environment along with applications is important to know to focus resources. Also keep in mind that a bit of flash SSD or DRAM cache in the applicable place can go along way while a lot of cache will also cost you cash. Even if you cant eliminate I/Os, look for ways to decrease their impact on your applications and systems.

    Where To Learn More

    View additional NAS, NVMe, SSD, NVM, SCM, Data Infrastructure and HDD related topics via the following links.

    Additional learning experiences along with common questions (and answers), as well as tips can be found in Software Defined Data Infrastructure Essentials book.

    Software Defined Data Infrastructure Essentials Book SDDC

    What This All Means

    >Keep in mind: SSD including flash and DRAM among others are in your future, the question is where, when, with what, how much and whose technology or packaging.

    Ok, nuff said, for now.

    Gs

    Greg Schulz – Microsoft MVP Cloud and Data Center Management, VMware vExpert 2010-2017 (vSAN and vCloud). Author of Software Defined Data Infrastructure Essentials (CRC Press), as well as Cloud and Virtual Data Storage Networking (CRC Press), The Green and Virtual Data Center (CRC Press), Resilient Storage Networks (Elsevier) and twitter @storageio. Courteous comments are welcome for consideration. First published on https://storageioblog.com any reproduction in whole, in part, with changes to content, without source attribution under title or without permission is forbidden.

    All Comments, (C) and (TM) belong to their owners/posters, Other content (C) Copyright 2006-2024 Server StorageIO and UnlimitedIO. All Rights Reserved. StorageIO is a registered Trade Mark (TM) of Server StorageIO.