Automatic Operation Bot for Ceph - You Ji

•

0 likes•99 views

The document discusses an automatic operation bot for Ceph clusters at eBay. It describes monitoring the clusters with tools like Prometheus and node-exporter. When issues arise, over 95% are due to failed disks, which the bot would automatically remove and replace. It would record failures and perform remediation steps like removing OSDs, offline disks, and lighting indicator LEDs. The bot design includes components for monitoring, alerting, a task queue, and executor to automate common operations and reduce manual work.

Automatic
Operation
Bot
for
Ceph
You,
Ji
youji@ebay.com

• Ceph
in
eBay
• Ops
for
Ceph
Cluster
• Automatic
opertion
Bot

Cluster Capacit
y
Node
s
Disks SSD
pool
Raw
Usage
Provisi
on
Usage
Used IOPS
(Avg/Max)
LVS01 1.4PB 18 400 0 4.6% 13% 1.10K/7.5K
LVS02 3.24PB 54 950 3.3T 12.7% 60.7% 11.5K/24K
PHX02 3.49PB 55 1000 6.6T 8.8% 41.9% 9K/16K
SLC07 3.77PB 58 1100 6T 12.5% 36.4% 14K/41.3K
CAL
CephFS
18T 36 36 18T 19.19% 29.6% 3K/5K
3
copies
for
all
cluster

0
2
4
6
8
10
12
14
Total
Summary
Raw Capacity Provisioned Size Raw Usage
All
the
size
has
multiplied
3
PB

foreman
puppet

code
repo
puppet

config
repo
git

server
...
...
Deploy
• Use
code
to
deploy
• Differences
kept
in
Config
Repo
• puppet
auto
add
free
disks
• NO auto
weight
for
new
OSD

Monitoring
&
Alerts
node-‐exporter
ceph
node
CPU Mem Disk Net
admin-‐sockets
megacli
iostat
ceph-‐exporter
pool
usage
cluster
reliability
cluster
availability
PG
status
ceph
admin
node
Prometheus
local
disk Prometheus
remote
disk
AlertManager Grafana

Remediation
• ~ 95%
warning/error
caused
by
bad
disks.
• ~3%
caused
by
host
down
• ~2%
other
errors,
such
as
network,
electric
power,
human
error

Percentage
Error Disk Host Down net/power/human error

• Handbook
for
operation
• Interactive
chat
bot
• Automatic
operation
bot
How
to
build
a
automatic
bot?

ceph
pg
dump
|
grep
inconsistent
1 2
pg
id
3
osd.1 osd.2 osd.3
4
5
6
Swap
Disk
$
remove
OSD.2
from
ceph
$
Offline
disk
from
HW
$
Light
LED
on
the
Disk.

Write
operations
on
the
doc.
• Record
every
failure
of
disks/node
and
related
docs.

node-‐exporter
ceph
node
CPU Mem Disk Net
admin-‐sockets
megacli
iostat
ceph-‐exporter
pool
usage
cluster
reliability
cluster
availability
PG
status
ceph
admin
node
Prometheus
local
disk
AlertManager

The University of Alabama at Birmingham gives scientists and researchers a massive, on-demand, virtual storage cloud using OpenStack and Ceph for less than $0.41 per gigabyte. This is a session at the OpenStack summit given by Kamesh Pemmaraju at Dell and John Paul at University of Alabama. This will detail how the university IT staff deployed a private storage cloud infrastructure using the Dell OpenStack cloud solution with Dell servers, storage, networking and OpenStack, and Inktank Ceph. After assessing a number of traditional storage scenarios, the University partnered with Dell and Inktank to architect a centralized cloud storage platform that was capable of scaling seamlessly and rapidly, was cost-effective, and that could leverage a single hardware infrastructure for the OpenStack compute and storage environment.

Tuning the Kernel for Varnish Cache

Per Buer

Ceph Day Beijing - Our journey to high performance large scale Ceph cluster a...

Danielle Womboldt

MySQL Head-to-Head

Patrick McGarry

Scaling Apache Pulsar to 10 Petabytes/Day

ScyllaDB

Pulsar is used by a portfolio of products at Splunk for stream processing of different types of data, including metrics and logs. In this talk, Karthik Ramasamy will share how Splunk helped a flagship customer scale a Pulsar deployment to handle 10 PB/day in a single cluster. He will talk about the journey, the challenges faced, and the trade-offs made to scale Pulsar and operate it reliably and stably in Google Cloud Platform (GCP).

OSv presentation from Linux Foundation Collaboration Summit

Don Marti

QCT Ceph Solution - Design Consideration and Reference Architecture

Patrick McGarry

ceph-barcelona-v-1.2Ranga Swami Reddy Muthumula

Ceph barcelona-v-1.2

Ranga Swami Reddy Muthumula

What's hot

Erasure Code at Scale - Thomas William Byrne

Ceph Community

Accelerating Ceph with iWARP RDMA over Ethernet - Brien Porter, Haodong Tang

Ceph Community

Ceph Goes on Online at Qihoo 360 - Xuehan Xu

Ceph Community

Making Ceph awesome on Kubernetes with Rook - Bassam Tabbara

Ceph Community

Common Support Issues And How To Troubleshoot Them - Michael Hackett, Vikhyat...

Ceph Community

RBD: What will the future bring? - Jason Dillaman

Ceph Community

AF Ceph: Ceph Performance Analysis and Improvement on Flash

Ceph Community

RADOS improvements and roadmap - Greg Farnum, Josh Durgin, Kefu Chai

Ceph Community

Ceph on All Flash Storage -- Breaking Performance Barriers

Ceph Community

Build a High Available NFS Cluster Based on CephFS - Shangzhong Zhu

Ceph Community

Ceph Performance Profiling and Reporting

Ceph Community

Ceph Day Beijing - Ceph RDMA Update

Danielle Womboldt

Basic and Advanced Analysis of Ceph Volume Backend Driver in Cinder - John Haan

Ceph Community

OpenStack and Ceph case study at the University of Alabama

Kamesh Pemmaraju

Tuning the Kernel for Varnish Cache

Per Buer

Ceph Day Beijing - Our journey to high performance large scale Ceph cluster a...

Danielle Womboldt

MySQL Head-to-Head

Patrick McGarry

Scaling Apache Pulsar to 10 Petabytes/Day

ScyllaDB

OSv presentation from Linux Foundation Collaboration Summit

Don Marti

QCT Ceph Solution - Design Consideration and Reference Architecture

Patrick McGarry

What's hot (20)

Erasure Code at Scale - Thomas William Byrne

Accelerating Ceph with iWARP RDMA over Ethernet - Brien Porter, Haodong Tang

Ceph Goes on Online at Qihoo 360 - Xuehan Xu

Making Ceph awesome on Kubernetes with Rook - Bassam Tabbara

Common Support Issues And How To Troubleshoot Them - Michael Hackett, Vikhyat...

RBD: What will the future bring? - Jason Dillaman

AF Ceph: Ceph Performance Analysis and Improvement on Flash

RADOS improvements and roadmap - Greg Farnum, Josh Durgin, Kefu Chai

Ceph on All Flash Storage -- Breaking Performance Barriers

Build a High Available NFS Cluster Based on CephFS - Shangzhong Zhu

Ceph Performance Profiling and Reporting

Ceph Day Beijing - Ceph RDMA Update

Basic and Advanced Analysis of Ceph Volume Backend Driver in Cinder - John Haan

OpenStack and Ceph case study at the University of Alabama

Tuning the Kernel for Varnish Cache

Ceph Day Beijing - Our journey to high performance large scale Ceph cluster a...

MySQL Head-to-Head

Scaling Apache Pulsar to 10 Petabytes/Day

OSv presentation from Linux Foundation Collaboration Summit

QCT Ceph Solution - Design Consideration and Reference Architecture

Similar to Automatic Operation Bot for Ceph - You Ji

ceph-barcelona-v-1.2Ranga Swami Reddy Muthumula

Ceph barcelona-v-1.2

Ranga Swami Reddy Muthumula

Micro control idsecconf2010

idsecconf

Emulating With JavaScript

alexanderdickson

Oracle Performance On Linux X86 systems Baruch Osoveskiy

Performance

Christophe Marchal

QCon London.pdf

Monica Beckwith

Nick Fisk - low latency Ceph

ShapeBlue

Introduction to Apache Kafka

Shiao-An Yuan

Couchbase live 2016

Pierre Mavro

Tips from Support: Always Carry a Towel and Don’t Panic!

Perforce

Build an High-Performance and High-Durable Block Storage Service Based on Ceph

Rongze Zhu

Your 1st Ceph cluster

Mirantis

[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화

OpenStack Korea Community

XPDS14 - Scaling Xen's Aggregate Storage Performance - Felipe Franciosi, Citrix

The Linux Foundation

Storage systems continue to deliver better performance year after year. High performance solutions are now available off-the-shelf, allowing users to boost their servers with drives capable of achieving several GB/s worth of throughput per host. To fully utilise such devices, workloads with large queue depths are often necessary. In virtual environments, this translates into aggregate workloads coming from multiple virtual machines. Having previously addressed the impact of low latency devices in virtualised platforms, we are now aiming at optimising aggregate workloads. We will discuss the existing memory grant technologies available in Xen and compare trade-offs and performance implications of each: grant mapping, persistent grants and grant copy. For the first time, we will present grant copy as an alternative and show measurements over 7 GB/s, maxing out a set of local SSDs.

php & performance

simon8410

(WEB401) Optimizing Your Web Server on AWS | AWS re:Invent 2014

Amazon Web Services

Tuning your EC2 web server will help you to improve application server throughput and cost-efficiency as well as reduce request latency. In this session we will walk through tactics to identify bottlenecks using tools such as CloudWatch in order to drive the appropriate allocation of EC2 and EBS resources. In addition, we will also be reviewing some performance optimizations and best practices for popular web servers such as Nginx and Apache in order to take advantage of the latest EC2 capabilities.

3.INTEL.Optane_on_ceph_v2.pdf

hellobank1

Ceph Day Beijing - Optimizing Ceph Performance by Leveraging Intel Optane and...

Danielle Womboldt

Ceph Day Beijing - Optimizing Ceph performance by leveraging Intel Optane and...

Ceph Community

Similar to Automatic Operation Bot for Ceph - You Ji (20)

ceph-barcelona-v-1.2

Ceph barcelona-v-1.2

Micro control idsecconf2010

Emulating With JavaScript

Oracle Performance On Linux X86 systems

Performance

QCon London.pdf

Nick Fisk - low latency Ceph

Introduction to Apache Kafka

Couchbase live 2016

Tips from Support: Always Carry a Towel and Don’t Panic!

Build an High-Performance and High-Durable Block Storage Service Based on Ceph

Your 1st Ceph cluster

[OpenStack Days Korea 2016] Track1 - All flash CEPH 구성 및 최적화

XPDS14 - Scaling Xen's Aggregate Storage Performance - Felipe Franciosi, Citrix

php & performance

(WEB401) Optimizing Your Web Server on AWS | AWS re:Invent 2014

3.INTEL.Optane_on_ceph_v2.pdf

Ceph Day Beijing - Optimizing Ceph Performance by Leveraging Intel Optane and...

Ceph Day Beijing - Optimizing Ceph performance by leveraging Intel Optane and...

Recently uploaded

Key Trends Shaping the Future of Infrastructure.pdf

Cheryl Hung

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

FIDO Alliance

Knowledge engineering: from people to machines and back

Elena Simperl

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality

Inflectra

In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring. Learn about: • The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks. • Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective. • Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification. • Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process. Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

UiPathCommunity

💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™: See how to accelerate model training and optimize model performance with active learning Learn about the latest enhancements to out-of-the-box document processing – with little to no training required Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath. Speakers: 👨‍🏫 Andras Palfi, Senior Product Manager, UiPath 👩‍🏫 Lenka Dulovicova, Product Program Manager, UiPath

DevOps and Testing slides at DASA Connect

Kari Kakkonen

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

Prayukth K V

The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development. The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers: State of global ICS asset and network exposure Sectoral targets and attacks as well as the cost of ransom Global APT activity, AI usage, actor and tactic profiles, and implications Rise in volumes of AI-powered cyberattacks Major cyber events in 2024 Malware and malicious payload trends Cyberattack types and targets Vulnerability exploit attempts on CVEs Attacks on counties – USA Expansion of bot farms – how, where, and why In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East Why are attacks on smart factories rising? Cyber risk predictions Axis of attacks – Europe Systemic attacks in the Middle East Download the full report from here: https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance

Mission to Decommission: Importance of Decommissioning Products to Increase E...

Product School

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Tobias Schneck

As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other? Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

FIDO Alliance

Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...

Jeffrey Haguewood

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams. Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

FIDO Alliance Osaka Seminar: Overview.pdf

FIDO Alliance

Leading Change strategies and insights for effective change management pdf 1.pdf

OnBoard

GraphRAG is All You need? LLM & Knowledge Graph

Guy Korland

Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs. 1. Unifying Large Language Models and Knowledge Graphs: A Roadmap. https://arxiv.org/abs/2306.08302 2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs: https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Product School

Connector Corner: Automate dynamic content and events by pushing a button

DianaGray10

Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to: Create a campaign using Mailchimp with merge tags/fields Send an interactive Slack channel message (using buttons) Have the message received by managers and peers along with a test email for review But there’s more: In a second workflow supporting the same use case, you’ll see: Your campaign sent to target colleagues for approval If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team But—if the “Reject” button is pushed, colleagues will be alerted via Slack message Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors. And... Speakers: Akshay Agnihotri, Product Manager Charlie Greenberg, Host

Essentials of Automations: Optimizing FME Workflows with Parameters

Safe Software

Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place. Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects. Here’s what you’ll gain: - Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows. - Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy. - Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency. - Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity. We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic. Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.

UiPath Test Automation using UiPath Test Suite series, part 4

DianaGray10

Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap. The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies. Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques What will you get from this session? 1. Insights into SAP testing best practices 2. Heatmap utilization for testing 3. Optimization of testing processes 4. Demo Topics covered: Execution from the test manager Orchestrator execution result Defect reporting SAP heatmap example with demo Speaker: Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

FIDO Alliance

Recently uploaded (20)

Key Trends Shaping the Future of Infrastructure.pdf

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

Knowledge engineering: from people to machines and back

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality

Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...

DevOps and Testing slides at DASA Connect

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

Mission to Decommission: Importance of Decommissioning Products to Increase E...

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...

FIDO Alliance Osaka Seminar: Overview.pdf

Leading Change strategies and insights for effective change management pdf 1.pdf

GraphRAG is All You need? LLM & Knowledge Graph

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Connector Corner: Automate dynamic content and events by pushing a button

Essentials of Automations: Optimizing FME Workflows with Parameters

UiPath Test Automation using UiPath Test Suite series, part 4

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

Automatic Operation Bot for Ceph - You Ji

1. Automatic Operation Bot for Ceph You, Ji youji@ebay.com

2. • Ceph in eBay • Ops for Ceph Cluster • Automatic opertion Bot

3. Cluster Capacit y Node s Disks SSD pool Raw Usage Provisi on Usage Used IOPS (Avg/Max) LVS01 1.4PB 18 400 0 4.6% 13% 1.10K/7.5K LVS02 3.24PB 54 950 3.3T 12.7% 60.7% 11.5K/24K PHX02 3.49PB 55 1000 6.6T 8.8% 41.9% 9K/16K SLC07 3.77PB 58 1100 6T 12.5% 36.4% 14K/41.3K CAL CephFS 18T 36 36 18T 19.19% 29.6% 3K/5K 3 copies for all cluster

4. 0 2 4 6 8 10 12 14 Total Summary Raw Capacity Provisioned Size Raw Usage All the size has multiplied 3 PB

5. • Ceph in eBay • Ops for Ceph Cluster • Automatic opertion Bot

6. foreman puppet code repo puppet config repo git server ... ... Deploy • Use code to deploy • Differences kept in Config Repo • puppet auto add free disks • NO auto weight for new OSD

7. Monitoring & Alerts node-‐exporter ceph node CPU Mem Disk Net admin-‐sockets megacli iostat ceph-‐exporter pool usage cluster reliability cluster availability PG status ceph admin node Prometheus local disk Prometheus remote disk AlertManager Grafana

8. Remediation • ~ 95% warning/error caused by bad disks. • ~3% caused by host down • ~2% other errors, such as network, electric power, human error Percentage Error Disk Host Down net/power/human error

9. • Ceph in eBay • Ops for Ceph Cluster • Automatic opertion Bot

10. • Handbook for operation • Interactive chat bot • Automatic operation bot How to build a automatic bot?

11. ceph pg dump | grep inconsistent 1 2 pg id 3 osd.1 osd.2 osd.3 4 5 6 Swap Disk $ remove OSD.2 from ceph $ Offline disk from HW $ Light LED on the Disk.

12. Write operations on the doc. • Record every failure of disks/node and related docs.

13. • Handbook for operation • Interactive chat bot • Automatic operation bot How to build a automatic bot?

14. Monitoring & Alerts node-‐exporter ceph node CPU Mem Disk Net admin-‐sockets megacli iostat ceph-‐exporter pool usage cluster reliability cluster availability PG status ceph admin node Prometheus local disk AlertManager

15. Demo

16. • Handbook for operation • Interactive chat bot • Automatic operation bot How to build a automatic bot?

17. node-‐exporter ceph node CPU Mem Disk Net admin-‐sockets megacli iostat ceph-‐exporter pool usage cluster reliability cluster availability PG status ceph admin node Prometheus local disk AlertManager

18. node-‐exporter ceph node CPU Mem Disk Net admin-‐sockets megacli iostat ceph-‐exporter pool usage cluster reliability cluster availability PG status ceph admin node Prometheus local disk AlertManager Task Queue Executor

19. Q & A Thanks youji@ebay.com

Automatic Operation Bot for Ceph - You Ji

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Automatic Operation Bot for Ceph - You Ji

Similar to Automatic Operation Bot for Ceph - You Ji (20)

Recently uploaded

Recently uploaded (20)

Automatic Operation Bot for Ceph - You Ji