{"id":1521,"date":"2021-07-15T08:00:01","date_gmt":"2021-07-15T15:00:01","guid":{"rendered":"http:\/\/www.pogostorage.com\/blog\/?p=781"},"modified":"2022-06-07T11:56:55","modified_gmt":"2022-06-07T18:56:55","slug":"why-ceph-storage-cluster-data-center-cloud-edge-computing","status":"publish","type":"post","link":"https:\/\/www.pogolinux.com\/blog\/why-ceph-storage-cluster-data-center-cloud-edge-computing\/","title":{"rendered":"Data Center Trends: Why You Need a Ceph Storage Cluster in the Data Center, on the Cloud and at the Edge"},"content":{"rendered":"<p><strong><span style=\"font-weight: 400;\"><span style=\"font-weight: normal;\">By 2025, IT analyst Garter predicts that 75% of all data will be produced at the edge or places other than on-premises, citing the rise of artificial intelligence (AI) and 5G as accelerating the trend. <\/span><\/span><\/strong><strong><span style=\"font-weight: 400;\"><span style=\"font-weight: normal;\">To run the critical containerized applications, or AI and data analytics workloads required to support geographically distributed users, data center administrators need high-performing and scalable open architecture solutions at regional and worldwide locations.<\/span><\/span><\/strong><\/p>\n<p><strong><span style=\"font-weight: 400;\"><span style=\"font-weight: normal;\">As the amount of data created outside the data center continues to grow, more compute and storage capabilities will be needed closer to where the data is created and applications are accessed, such as a microsite at the base of a 5G tower or manufacturing floor, or media streaming server<\/span><\/span><\/strong>.<\/p>\n<p><em>Researching Ceph storage cluster solutions to achieve new levels of performance and efficiency? Here&#8217;s what data center administrators need to know to evaluate <a href=\"https:\/\/www.pogolinux.com\/products\/osnexus\/overview\" target=\"_blank\" rel=\"noopener noreferrer\">OSNEXUS object storage solutions<\/a>. Questions? Drop us an email at <a href=\"mailto:sales@www.pogolinux.com\">sales@www.pogolinux.com<\/a><\/em><em> or <a href=\"https:\/\/www.pogolinux.com\/blog\/book-meeting\/\">book a meeting<\/a> with a sales advisor.<\/em><\/p>\n<p><a href=\"https:\/\/www.brighttalk.com\/webcast\/12587\/545266\" target=\"_blank\" rel=\"noopener noreferrer nofollow\"><img loading=\"lazy\" decoding=\"async\" class=\"alignright wp-image-5941 size-full\" src=\"https:\/\/www.pogolinux.com\/blog\/wp-content\/uploads\/2022\/04\/storage-events_22-Q2-webinar-multi-tenant-architecture-object-storage.jpg\" alt=\"\" width=\"725\" height=\"300\"><\/a><\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_89 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.pogolinux.com\/blog\/why-ceph-storage-cluster-data-center-cloud-edge-computing\/#%F0%9F%92%A6_Ceph_%E2%80%93_An_Open_Solution_to_Data_Deluge\" >&#x1f4a6; Ceph \u2013 An Open Solution to Data Deluge<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.pogolinux.com\/blog\/why-ceph-storage-cluster-data-center-cloud-edge-computing\/#%E2%9A%A1_Introducing_OSNEXUS_QuantaStor\" >&#x26a1; Introducing OSNEXUS QuantaStor<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.pogolinux.com\/blog\/why-ceph-storage-cluster-data-center-cloud-edge-computing\/#%E2%9A%A1_Ceph_Solutions_powered_by_QuantaStor\" >&#x26a1; Ceph Solutions powered by QuantaStor<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.pogolinux.com\/blog\/why-ceph-storage-cluster-data-center-cloud-edge-computing\/#Choosing_an_Ceph_Storage_Cluster_Management_Solution\" >Choosing an Ceph Storage Cluster Management Solution<\/a><\/li><\/ul><\/nav><\/div>\n<h3 style=\"font-size: 22px; line-height: 175%;\"><span class=\"ez-toc-section\" id=\"%F0%9F%92%A6_Ceph_%E2%80%93_An_Open_Solution_to_Data_Deluge\"><\/span><span style=\"color: #000000;\">&#x1f4a6; Ceph \u2013 An Open Solution to Data Deluge<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p style=\"margin-bottom: 10px;\">To keep pace with exponential data growth \u2013 on-premises, on public and private clouds, and at the edge \u2013 more enterprise and mid-sized data centers are migrating to Ceph to address increasingly distributed environments with open source instead of expensive proprietary options. With a production-proven architecture, Ceph was initially aimed at hyperscaler and HPC environments. However, in recent years its advanced storage technology has appealed to any organization that would benefit from a unified cluster system that supports high-growth file and block storage, S3 object stores and data lakes.<\/p>\n<p style=\"margin-bottom: 10px;\">Due to its federated data management and modular architecture, Ceph scales horizontally exceptionally well, in both performance-built and unbound-capacity infrastructure requirements. As the number of nodes in the cluster increases, Ceph performance improves with the ability to scale into the tens of petabytes and exabyte levels \u2013 ideal for multi-cluster sites with asynchronous replication and disaster recovery requirements.<\/p>\n<p><strong>Also Ceph: Management Complexities<\/strong><\/p>\n<p>Building a massive Ceph storage cluster infrastructure takes a high-level of IT expertise \u2013 skills that only hyperscalers, HPC or Tier 1 service providers tend to posses in-house. Additionally, as object storage demands continue to grow, data center operators will want to leverage Ceph&#8217;s hyperscale capabilities to employ hybrid cloud strategies to reduce public cloud costs. Unfortunately, many enterprises and mid-sized organizations don\u2019t have the experienced IT professionals on staff to deploy, manage and support the complex Ceph environments necessary to run AI, analytics, and containerized workloads.<\/p>\n<h3 style=\"font-size: 22px; line-height: 175%;\"><span class=\"ez-toc-section\" id=\"%E2%9A%A1_Introducing_OSNEXUS_QuantaStor\"><\/span><span style=\"color: #000000;\">&#x26a1; Introducing OSNEXUS QuantaStor<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p style=\"margin-bottom: 10px;\">For organizations without hyperscaler expertise, OSNEXUS has designed the QuantaStor software-defined storage (SDS) platform based on standard Ceph (Naultilus) and CentOS Linux distribution to allow everyday data center users the ability to set-up, manage and maintain large-scale, multi-site Ceph storage cluster environments.<\/p>\n<p><strong>No in-house Ceph knowledge, no problem!<\/strong><\/p>\n<p>With little or no knowledge of Ceph utilities or architecture, QuantaStor users can create storage pools for file, block, and object storage in minutes. QuantaStor enables a quick setup and easy configuration of a cluster node. In addition, QuantaStor&#8217;s powerful web-based configuration, monitoring and management features make it easy to setup large and complex configurations without using CLI and console tools.<\/p>\n<p>QuantaStor integrates with and extends Ceph and ZFS storage technologies to deliver an elastic and highly-available SDS platform that can deploy, manage and expand file (NFS\/SMB\/CephFS), block (iSCSI\/FC\/CephRBD) and Amazon S3-compatible object storage via REST based protocols.<\/p>\n<p><strong>The secret sauce? OSNEXUS Storage Grid<\/strong><\/p>\n<p>In addition to deep integration with Ceph, OSNEXUS built-in storage grid technology unifies the management of storage nodes and clusters across public and private clouds. The QuantaStor storage grid manages the underlying Ceph technology end-to-end, automating best-practices within the platform, to ensure that deployments are set-up correctly without the need for Ceph-deploy or one-way ansible configuration tools.<\/p>\n<p>From a small three system configuration to a hyper-scale, multi-cluster environment, QuantaStor delivers the comprehensive storage capabilities that are critical for organizations seeking to expand distributed environments.<\/p>\n<p><center><iframe loading=\"lazy\" src=\"https:\/\/www.youtube.com\/embed\/VqFXk0AqdJ8\" width=\"560\" height=\"315\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><span data-mce-type=\"bookmark\" style=\"display: inline-block; width: 0px; overflow: hidden; line-height: 0;\" class=\"mce_SELRES_start\">\ufeff<\/span><\/iframe><\/center>Up to 20x individual Ceph storage clusters can be managed within the storage grid. Users can actively manage their entire Ceph infrastructure \u2013 on-premises, in the cloud or at the edge \u2013 as an comprehensive enterprise storage system. This simplifies management for data center operators who can manage multiple sites or setup replication schedules from a single, web-based dashboard.<\/p>\n<h3 style=\"font-size: 22px; line-height: 175%;\"><span class=\"ez-toc-section\" id=\"%E2%9A%A1_Ceph_Solutions_powered_by_QuantaStor\"><\/span><span style=\"color: #000000;\">&#x26a1; Ceph Solutions powered by QuantaStor<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p>To accelerate the adoption of Ceph, QuantaStor is designed to install on bare-metal or virtual machine environments. Quickly deploy highly-scalable, high-performance Ceph cluster solutions and expansion nodes on industry-standard hardware within minutes! Powered by QuantaStor, the task-optimized <a href=\"https:\/\/www.pogolinux.com\/products\/osnexus\/overview\">Pogo Linux StorageDirector appliance<\/a> delivers a turn-key unified cluster management solution that&#8217;s optimized for Ceph and features deep hardware integration with Intel or AMD processors and Western Digital NVMe SSDs and NVMe-oF technologies.<\/p>\n<p><strong>High-Available with Erasure-Coding &amp; Replication<\/strong><\/p>\n<p>The StorageDirector can be configured for high-availability using three (or more) QuantaStor appliances in a storage layout that&#8217;s designed to support erasure-coding. While Ceph replicates data to make it fault-tolerant for migration purposes, QuantaStor\u2019s integrated hardware management actively-monitors key Pogo Linux hardware elements, including HDD and flash storage health, power supply, fans and thermal temperature.<\/p>\n<p><em>In our <a href=\"https:\/\/www.pogolinux.com\/blog\/ceph-storage-cluster-scale-up-versus-scale-out\/\">next article,<\/a> we&#8217;ll explain how a single QuantaStor cluster deployment supports both scale-up file and block storage (SAN\/NAS) focused on capacity, and scale-out object storage (S3) focused on performance and unbound capacity.<\/em><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Choosing_an_Ceph_Storage_Cluster_Management_Solution\"><\/span>Choosing an Ceph Storage Cluster Management Solution<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\"><span style=\"font-weight: normal;\">Low latency or high transfer rates are of little benefit if they swamp the target application. <\/span><\/span><span style=\"font-weight: 400;\"><span style=\"font-weight: normal;\">While these systems generate IOPS approaching the millions, the reality is that there are very few workloads that require more than the performance of these systems. <\/span><\/span>However, there is an emerging class of workloads that can take advantage of all the performance and low latency of an end-to-end NVMe system.<\/p>\n<p>If you&#8217;d like to learn more about how to maximize your data center infrastructure by up to 90% while minimizing its footprint, give us a call at <strong>(888) 828-7646<\/strong>, email us at <a href=\"mailto:sales@www.pogolinux.com\">sales@www.pogolinux.com<\/a> or <a href=\"https:\/\/www.pogolinux.com\/blog\/book-meeting\/\">book a time calendar<\/a> to speak. We&#8217;ve helped organizations of all sizes deploy composable solutions for just about every IT budget.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-5603 size-full alignleft\" src=\"https:\/\/www.pogolinux.com\/blog\/wp-content\/uploads\/2020\/12\/blog-article-footer_osnexus-quantastor-object-storage.jpg\" alt=\"\" width=\"725\" height=\"200\"><\/p>\n","protected":false},"excerpt":{"rendered":"<p>By 2025, IT analyst Garter predicts that 75% of all data will be produced at the edge or places other than on-premises, citing the rise of artificial intelligence (AI) and 5G as accelerating the trend. To run the critical containerized applications, or AI and data analytics workloads required to support geographically distributed users, data center&#8230;<\/p>\n","protected":false},"author":6,"featured_media":4956,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"content-type":"","footnotes":""},"categories":[105,240],"tags":[],"class_list":["post-1521","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-object-storage","category-osnexus"],"_links":{"self":[{"href":"https:\/\/www.pogolinux.com\/blog\/wp-json\/wp\/v2\/posts\/1521","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.pogolinux.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.pogolinux.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.pogolinux.com\/blog\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/www.pogolinux.com\/blog\/wp-json\/wp\/v2\/comments?post=1521"}],"version-history":[{"count":15,"href":"https:\/\/www.pogolinux.com\/blog\/wp-json\/wp\/v2\/posts\/1521\/revisions"}],"predecessor-version":[{"id":5946,"href":"https:\/\/www.pogolinux.com\/blog\/wp-json\/wp\/v2\/posts\/1521\/revisions\/5946"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.pogolinux.com\/blog\/wp-json\/wp\/v2\/media\/4956"}],"wp:attachment":[{"href":"https:\/\/www.pogolinux.com\/blog\/wp-json\/wp\/v2\/media?parent=1521"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.pogolinux.com\/blog\/wp-json\/wp\/v2\/categories?post=1521"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.pogolinux.com\/blog\/wp-json\/wp\/v2\/tags?post=1521"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}