Serf@devops pune

Rahul Khengare
Rahul KhengareCloud Engineer | DevOps | Containers | Technology Enthusiast | Blogger | Open Source Software at Motifworks
SERF@DEVOPS PUNE
RAHUL KHENGARE
Agenda
 What is Serf
 Installation
 Get Used To
 Use Cases
 Demo
 Limitations
Target Audience
 Having some knowledge of cluster environment
 Managed Clusters environment
 Eager to Learn SERF
SERF (By Hashicorp)
 OPEN SOURCE
 Decentralized
 Fault-tolerant
 Highly Available
 Uses Gossip Protocol to communicate with nodes
 Extremely Light Weight (5-10 MB Memory Footprint)
 Available for Linux, Mac OS X, and Windows
SERF USED FOR
 Cluster Membership Management
 Failure Detection and Recovery
 Event Propagation
 Orchestration
Installation
 Download SERF from https://www.serfdom.io/downloads.html
 Unzip and put binary in /usr/local/bin or /usr/bin folder (in LINUX)
SERF AGENT
 Core process
 Maintains membership information
 Propagates events
 Invokes event handlers
 Detects failures
 Run on every node that is part of cluster
RUN SERF AGENT
 SERF AGENT
Cluster Membership Management
 JOIN CLUSTER
 CLUSTER STATUS
 LEAVE CLUSTER
 CLUSTER STATUS
Failure Detection and Recovery
 MEMBER FAILED
 RECOVER MEMBER
Custom Event Propagation
 Dispatches a custom user event
 Nodes in the cluster listen custom events
 Reacts to them
 Execute Event Handlers
 Doesn’t send response back to originator
Event Handler Script
Custom Event Propagation
 Event Handler Execution
 Dispatch Custom User Event
SERVICE ORCHESTRATION
 Dispatches a query
 Nodes in the cluster listen query
 Reacts to them
 Execute Event Handlers
 Send response back
 Gathering Responses at originator
USE CASES
 Webservers and load balancers
 Memcached and Redis clusters
 Triggering deployments
 Updating DNS records
 Simple Observability
 A Building Block for Service Discovery
DEMO
 Setting up high availability configuration(Webserver)
Serf1
eth0
172.26.126.82
VIP
172.26.126.84
Apache
Serf2
eth0
172.26.126.74
SERF AGENT SERF AGENT
Apache
GOSSIP PROTOCOL
Limitations
 Under heavy development
 Events are eventually consistent
 Payload size is limited
 Queries may not be delivered to all nodes
 Responses and acknowledgements may not be receive by query originator
ANY QUESTIONS?
Thank You!!!
1 of 19

More Related Content

Viewers also liked(6)

#UNselfie Toolkit AUS#UNselfie Toolkit AUS
#UNselfie Toolkit AUS
Connecting Up435 views
Digital media & Your Job SearchDigital media & Your Job Search
Digital media & Your Job Search
Phil Buckley362 views
Rocce, minerali e pigmentiRocce, minerali e pigmenti
Rocce, minerali e pigmenti
Marcello Brancaccio2K views
Gettysburg addressGettysburg address
Gettysburg address
Mike Allen16.2K views
]Plano nacional de educação 2014 2024]Plano nacional de educação 2014 2024
]Plano nacional de educação 2014 2024
Lucimara Foloni4.1K views
Sanguinaria canadensis (Bloodroot)Sanguinaria canadensis (Bloodroot)
Sanguinaria canadensis (Bloodroot)
Arslan Tahir2.6K views

Similar to Serf@devops pune

Cl116Cl116
Cl116Juliette Ponnet
1.3K views47 slides
Cl306Cl306
Cl306Juliette Ponnet
837 views49 slides

Similar to Serf@devops pune(20)

OpenSolaris IntroductionOpenSolaris Introduction
OpenSolaris Introduction
satyajit_t1.2K views
Cl116Cl116
Cl116
Juliette Ponnet1.3K views
Lichtenberg bosc2010 wordseekerLichtenberg bosc2010 wordseeker
Lichtenberg bosc2010 wordseeker
BOSC 2010456 views
Centralized logging with FlumeCentralized logging with Flume
Centralized logging with Flume
Ratnakar Pawar905 views
Cl306Cl306
Cl306
Juliette Ponnet837 views
Effect of Virtualization on OS InterferenceEffect of Virtualization on OS Interference
Effect of Virtualization on OS Interference
Eric Van Hensbergen375 views
Linux26 New FeaturesLinux26 New Features
Linux26 New Features
guest491c691.1K views
Distributed file systemsDistributed file systems
Distributed file systems
Sri Prasanna1.7K views
RHCE (RED HAT CERTIFIED ENGINEERING)RHCE (RED HAT CERTIFIED ENGINEERING)
RHCE (RED HAT CERTIFIED ENGINEERING)
Sumant Garg3.2K views
Presentation on nfs,afs,vfsPresentation on nfs,afs,vfs
Presentation on nfs,afs,vfs
Prakriti Dubey6.6K views
Ceh v5 module 18 linux hackingCeh v5 module 18 linux hacking
Ceh v5 module 18 linux hacking
Vi Tính Hoàng Nam1.4K views
testtest
test
Abhishek Singh996 views
HeartBeatHeartBeat
HeartBeat
Abhishek Kumar Singh3.9K views
Linux worldLinux world
Linux world
Frik khechoomian274 views
Maven OverviewMaven Overview
Maven Overview
FastConnect8.5K views

More from Rahul Khengare(6)

AzurePolicy DevOps Pune Feb23AzurePolicy DevOps Pune Feb23
AzurePolicy DevOps Pune Feb23
Rahul Khengare44 views
CIS Security BenchmarkCIS Security Benchmark
CIS Security Benchmark
Rahul Khengare582 views
You2.0You2.0
You2.0
Rahul Khengare104 views
DPI2012DPI2012
DPI2012
Rahul Khengare141 views

Recently uploaded(20)

Green Leaf Consulting: Capabilities DeckGreen Leaf Consulting: Capabilities Deck
Green Leaf Consulting: Capabilities Deck
GreenLeafConsulting177 views
METHOD AND SYSTEM FOR PREDICTING OPTIMAL LOAD FOR WHICH THE YIELD IS MAXIMUM ...METHOD AND SYSTEM FOR PREDICTING OPTIMAL LOAD FOR WHICH THE YIELD IS MAXIMUM ...
METHOD AND SYSTEM FOR PREDICTING OPTIMAL LOAD FOR WHICH THE YIELD IS MAXIMUM ...
Prity Khastgir IPR Strategic India Patent Attorney Amplify Innovation24 views
ChatGPT and AI for Web DevelopersChatGPT and AI for Web Developers
ChatGPT and AI for Web Developers
Maximiliano Firtman161 views
CXL at OCPCXL at OCP
CXL at OCP
CXL Forum203 views

Serf@devops pune

  • 2. Agenda  What is Serf  Installation  Get Used To  Use Cases  Demo  Limitations
  • 3. Target Audience  Having some knowledge of cluster environment  Managed Clusters environment  Eager to Learn SERF
  • 4. SERF (By Hashicorp)  OPEN SOURCE  Decentralized  Fault-tolerant  Highly Available  Uses Gossip Protocol to communicate with nodes  Extremely Light Weight (5-10 MB Memory Footprint)  Available for Linux, Mac OS X, and Windows
  • 5. SERF USED FOR  Cluster Membership Management  Failure Detection and Recovery  Event Propagation  Orchestration
  • 6. Installation  Download SERF from https://www.serfdom.io/downloads.html  Unzip and put binary in /usr/local/bin or /usr/bin folder (in LINUX)
  • 7. SERF AGENT  Core process  Maintains membership information  Propagates events  Invokes event handlers  Detects failures  Run on every node that is part of cluster
  • 8. RUN SERF AGENT  SERF AGENT
  • 9. Cluster Membership Management  JOIN CLUSTER  CLUSTER STATUS  LEAVE CLUSTER  CLUSTER STATUS
  • 10. Failure Detection and Recovery  MEMBER FAILED  RECOVER MEMBER
  • 11. Custom Event Propagation  Dispatches a custom user event  Nodes in the cluster listen custom events  Reacts to them  Execute Event Handlers  Doesn’t send response back to originator
  • 13. Custom Event Propagation  Event Handler Execution  Dispatch Custom User Event
  • 14. SERVICE ORCHESTRATION  Dispatches a query  Nodes in the cluster listen query  Reacts to them  Execute Event Handlers  Send response back  Gathering Responses at originator
  • 15. USE CASES  Webservers and load balancers  Memcached and Redis clusters  Triggering deployments  Updating DNS records  Simple Observability  A Building Block for Service Discovery
  • 16. DEMO  Setting up high availability configuration(Webserver) Serf1 eth0 172.26.126.82 VIP 172.26.126.84 Apache Serf2 eth0 172.26.126.74 SERF AGENT SERF AGENT Apache GOSSIP PROTOCOL
  • 17. Limitations  Under heavy development  Events are eventually consistent  Payload size is limited  Queries may not be delivered to all nodes  Responses and acknowledgements may not be receive by query originator