SlideShare a Scribd company logo
1 of 13
Instrumenting Open vSwitch with Monitoring
Capabilities: Designs and Challenges
Zili Zha1
, An Wang1
, Yang Guo2
, Doug Montgomery2
, Songqing Chen1
Presented by:
Ajay Kharat(2019H1030011G)
BITS Pilani
• Network measurement is essential for various management tasks such as
network traffic engineering, anomaly detection, QoS.
• Existing measurement frameworks
- Inflexible and non-programmable
• Urgent needs of flexible and programmable measurement frameworks
Challenges:
I. Minimal implementation complexity
II. Trade-offs between resource consumption and
measurement accuracy
III. Minimal interferences with the forwarding path
Motivation
Problem Statement
UMON Architecture
Challenge I:
Minimal
implementation
complexity
Monitoring API’s
[DstIP=A, Output(0)]
[DstIP=B, Output(1)]
Install Flow Rules
user space
kernel space
Upcall
Fine-grained Kernel Flow Cache
[SrcIP=C, DstIP=A, DstPort=80, Output(0)]
[SrcIP=C, DstIP=A, DstPort=22, Output(0)]
[SrcIP=D, DstIP=B, DstPort=80, Output(1)]
[SrcIP=D, DstIP=B, DstPort=22, Output(1)]
Combining forwarding rule with
monitoring rule.
[SrcIP=C,
DstPort=80, count]
[SrcIP=D,
DstPort=80, count]
[DstPort=80,
Counts(‘SrcIP’)]
Kernel Flow Cache gets bloated during peak traffic
+
Handlers and Revalidators gets heavily loaded
Approach and Solution
On-Path FCAP/SMON
Architecture
Custo
m n-
tuple
table
[DstPort=80]
Challenge II:
Resource-Accuracy
Trade-offs
n-tuple flow stats
FCAP
f1
f2
Flow XOR-ed n-tuple + stats
SMON iBLT
Challenge III:
Minimal interferences
with Forwarding path
sample_collector
thread
Off-Path FCAP/SMON
Architecture
Evaluation of the Solution
CPU Utilisation
• Testbed Setup
- Intel Xeon 4-Core 3.20 GHz CPU;
4GB memory
- Host and OVS connected with 10 Gbps
cables
- Ryu SDN Controller
• Total CPU utilisation of all
related threads
- 2 handlers + 2 revalidators
- collector thread in the user space
- Custom sample_collector thread in the
kernel module
CPU Overhead (packet rate = 160 Kpps)
CPU Overhead (packet rate = 80 Kpps)
UMON incurs highest
CPU utilisation
FCAP incurs less CPU
overhead than SMON
Memory Consumption and Monitoring Accuracy
• Off-path introduces less forwarding delay, same measurement accuracy with higher
memory.
• SMON incurs higher latency than FCAP with acceptable measurement accuracy loss.
Comparison of different monitoring designs
Memory usage (MB) (packet rate = 160 Kpps)
SMON is the most
memory efficient
while UMON incurs
the highest memory
consumption
Switching Throughput and Latency
Throughput Latency
UMON achieves lowest
throughput and highest latency
Off-path achieves higher throughput
and lower latency than on-path designs
• UMON: least implementation efforts, highest CPU overhead, highest
memory consumption
• Off-path designs: outperform on-path designs in terms of switching
performance, higher memory usage
• Hash table: more efficient than sketch, lower computational cost.
Overall Comparison and Insights
Comparison of different frameworks
Related Work
• Traditional hardware based solutions to collect the IP network traffic used tools such
as:
- Netflow, Sflow, IPFIX
• With the advancement of SDN and NFV techniques a series of work was proposed:
- OpenSketch, DREAM, FlowRadar, Trumpet
Drawbacks:
Expensive to deploy
Do not provide enough programmability for network management task
Future Scope
• Hybrid solution that balances the tradeoff between FCAP (higher accuracy) and
SMON (less memory)
• Alternative data structure to Ring Buffer that would consume less memory
• Achieve a design of integration that has the minimal forwarding-monitoring function
interference, optimal code sharing and efficient CPU/Memory resource usage

More Related Content

What's hot

Parallel processing using image processing
Parallel processing using image processingParallel processing using image processing
Parallel processing using image processingvishali bairam
 
Open Programmable Architecture for Java-enabled Network Devices
Open Programmable Architecture for Java-enabled Network DevicesOpen Programmable Architecture for Java-enabled Network Devices
Open Programmable Architecture for Java-enabled Network DevicesTal Lavian Ph.D.
 
Memory management based on MCA
Memory management  based on MCAMemory management  based on MCA
Memory management based on MCAAbhiSaxena16
 
GSM UMTS LTE Site Commissioning software
GSM UMTS LTE Site Commissioning softwareGSM UMTS LTE Site Commissioning software
GSM UMTS LTE Site Commissioning softwareAhmet Ozturk
 
Memory and Performance Isolation for a Multi-tenant Function-based Data-plane
Memory and Performance Isolation for a Multi-tenant Function-based Data-planeMemory and Performance Isolation for a Multi-tenant Function-based Data-plane
Memory and Performance Isolation for a Multi-tenant Function-based Data-plane AJAY KHARAT
 
246174 LDAV 2016_Poster_FNL_hi-res(1)
246174 LDAV 2016_Poster_FNL_hi-res(1)246174 LDAV 2016_Poster_FNL_hi-res(1)
246174 LDAV 2016_Poster_FNL_hi-res(1)Jie Jiang
 
ACTRESS: Domain-Specific Modeling of Self-Adaptive Software Architectures
ACTRESS: Domain-Specific Modeling of Self-Adaptive Software ArchitecturesACTRESS: Domain-Specific Modeling of Self-Adaptive Software Architectures
ACTRESS: Domain-Specific Modeling of Self-Adaptive Software ArchitecturesFilip Krikava
 
Improving Passive Packet Capture : Beyond Device Polling
Improving Passive Packet Capture : Beyond Device PollingImproving Passive Packet Capture : Beyond Device Polling
Improving Passive Packet Capture : Beyond Device PollingHargyo T. Nugroho
 
HTTP Adaptive Streaming State of the Art and Challenges Ahead
HTTP Adaptive StreamingState of the Art and Challenges AheadHTTP Adaptive StreamingState of the Art and Challenges Ahead
HTTP Adaptive Streaming State of the Art and Challenges AheadAlpen-Adria-Universität
 
A QoS-Adaptive Framework for Screen Sharing Over Internet
A QoS-Adaptive Framework for Screen Sharing Over InternetA QoS-Adaptive Framework for Screen Sharing Over Internet
A QoS-Adaptive Framework for Screen Sharing Over InternetDuc Nguyen
 
Customizable point of-interest queries in road networks
Customizable point of-interest queries in road networksCustomizable point of-interest queries in road networks
Customizable point of-interest queries in road networksieeepondy
 
PLNOG 3: John Evans - Best Practices in Network Planning
PLNOG 3: John Evans - Best Practices in Network PlanningPLNOG 3: John Evans - Best Practices in Network Planning
PLNOG 3: John Evans - Best Practices in Network PlanningPROIDEA
 

What's hot (14)

Parallel processing using image processing
Parallel processing using image processingParallel processing using image processing
Parallel processing using image processing
 
Open Programmable Architecture for Java-enabled Network Devices
Open Programmable Architecture for Java-enabled Network DevicesOpen Programmable Architecture for Java-enabled Network Devices
Open Programmable Architecture for Java-enabled Network Devices
 
Memory management based on MCA
Memory management  based on MCAMemory management  based on MCA
Memory management based on MCA
 
GSM UMTS LTE Site Commissioning software
GSM UMTS LTE Site Commissioning softwareGSM UMTS LTE Site Commissioning software
GSM UMTS LTE Site Commissioning software
 
Memory and Performance Isolation for a Multi-tenant Function-based Data-plane
Memory and Performance Isolation for a Multi-tenant Function-based Data-planeMemory and Performance Isolation for a Multi-tenant Function-based Data-plane
Memory and Performance Isolation for a Multi-tenant Function-based Data-plane
 
L1803027588
L1803027588L1803027588
L1803027588
 
246174 LDAV 2016_Poster_FNL_hi-res(1)
246174 LDAV 2016_Poster_FNL_hi-res(1)246174 LDAV 2016_Poster_FNL_hi-res(1)
246174 LDAV 2016_Poster_FNL_hi-res(1)
 
ACTRESS: Domain-Specific Modeling of Self-Adaptive Software Architectures
ACTRESS: Domain-Specific Modeling of Self-Adaptive Software ArchitecturesACTRESS: Domain-Specific Modeling of Self-Adaptive Software Architectures
ACTRESS: Domain-Specific Modeling of Self-Adaptive Software Architectures
 
Improving Passive Packet Capture : Beyond Device Polling
Improving Passive Packet Capture : Beyond Device PollingImproving Passive Packet Capture : Beyond Device Polling
Improving Passive Packet Capture : Beyond Device Polling
 
VNM_3.PPT
VNM_3.PPTVNM_3.PPT
VNM_3.PPT
 
HTTP Adaptive Streaming State of the Art and Challenges Ahead
HTTP Adaptive StreamingState of the Art and Challenges AheadHTTP Adaptive StreamingState of the Art and Challenges Ahead
HTTP Adaptive Streaming State of the Art and Challenges Ahead
 
A QoS-Adaptive Framework for Screen Sharing Over Internet
A QoS-Adaptive Framework for Screen Sharing Over InternetA QoS-Adaptive Framework for Screen Sharing Over Internet
A QoS-Adaptive Framework for Screen Sharing Over Internet
 
Customizable point of-interest queries in road networks
Customizable point of-interest queries in road networksCustomizable point of-interest queries in road networks
Customizable point of-interest queries in road networks
 
PLNOG 3: John Evans - Best Practices in Network Planning
PLNOG 3: John Evans - Best Practices in Network PlanningPLNOG 3: John Evans - Best Practices in Network Planning
PLNOG 3: John Evans - Best Practices in Network Planning
 

Similar to Instrumenting Open vSwitch with Monitoring Capabilities: Designs and Challenges

Tutorial-on-DNN-09A-Co-design-Sparsity.pdf
Tutorial-on-DNN-09A-Co-design-Sparsity.pdfTutorial-on-DNN-09A-Co-design-Sparsity.pdf
Tutorial-on-DNN-09A-Co-design-Sparsity.pdfDuy-Hieu Bui
 
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERSROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERSDeepak Shankar
 
Application Profiling at the HPCAC High Performance Center
Application Profiling at the HPCAC High Performance CenterApplication Profiling at the HPCAC High Performance Center
Application Profiling at the HPCAC High Performance Centerinside-BigData.com
 
AIST Super Green Cloud: lessons learned from the operation and the performanc...
AIST Super Green Cloud: lessons learned from the operation and the performanc...AIST Super Green Cloud: lessons learned from the operation and the performanc...
AIST Super Green Cloud: lessons learned from the operation and the performanc...Ryousei Takano
 
NoC simulators presentation
NoC simulators presentationNoC simulators presentation
NoC simulators presentationHossam Hassan
 
Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...balmanme
 
The Need for Complex Analytics from Forwarding Pipelines
The Need for Complex Analytics from Forwarding Pipelines The Need for Complex Analytics from Forwarding Pipelines
The Need for Complex Analytics from Forwarding Pipelines Netronome
 
Transport SDN Overview and Standards Update: Industry Perspectives
Transport SDN Overview and Standards Update: Industry PerspectivesTransport SDN Overview and Standards Update: Industry Perspectives
Transport SDN Overview and Standards Update: Industry PerspectivesInfinera
 
Early-stage topological and technological choices for TSN-based communication...
Early-stage topological and technological choices for TSN-based communication...Early-stage topological and technological choices for TSN-based communication...
Early-stage topological and technological choices for TSN-based communication...RealTime-at-Work (RTaW)
 
RECAP: The Simulation Approach
RECAP: The Simulation ApproachRECAP: The Simulation Approach
RECAP: The Simulation ApproachRECAP Project
 
Cost-Efficient Rule Management and Traffic Engineering for Software Defined N...
Cost-Efficient Rule Management and Traffic Engineering for Software Defined N...Cost-Efficient Rule Management and Traffic Engineering for Software Defined N...
Cost-Efficient Rule Management and Traffic Engineering for Software Defined N...Huawei Huang
 
Introduction to SDN
Introduction to SDNIntroduction to SDN
Introduction to SDNNetCraftsmen
 
TechTalk_Cloud Performance Testing_0.6
TechTalk_Cloud Performance Testing_0.6TechTalk_Cloud Performance Testing_0.6
TechTalk_Cloud Performance Testing_0.6Sravanthi N
 
Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)Vincenzo Gulisano
 
Carrier Strategies for Backbone Traffic Engineering and QoS
Carrier Strategies for Backbone Traffic Engineering and QoSCarrier Strategies for Backbone Traffic Engineering and QoS
Carrier Strategies for Backbone Traffic Engineering and QoSVishal Sharma, Ph.D.
 

Similar to Instrumenting Open vSwitch with Monitoring Capabilities: Designs and Challenges (20)

Tutorial-on-DNN-09A-Co-design-Sparsity.pdf
Tutorial-on-DNN-09A-Co-design-Sparsity.pdfTutorial-on-DNN-09A-Co-design-Sparsity.pdf
Tutorial-on-DNN-09A-Co-design-Sparsity.pdf
 
computer architecture.
computer architecture.computer architecture.
computer architecture.
 
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERSROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
ROLE OF DIGITAL SIMULATION IN CONFIGURING NETWORK PARAMETERS
 
Application Profiling at the HPCAC High Performance Center
Application Profiling at the HPCAC High Performance CenterApplication Profiling at the HPCAC High Performance Center
Application Profiling at the HPCAC High Performance Center
 
AIST Super Green Cloud: lessons learned from the operation and the performanc...
AIST Super Green Cloud: lessons learned from the operation and the performanc...AIST Super Green Cloud: lessons learned from the operation and the performanc...
AIST Super Green Cloud: lessons learned from the operation and the performanc...
 
NoC simulators presentation
NoC simulators presentationNoC simulators presentation
NoC simulators presentation
 
Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...Network-aware Data Management for Large Scale Distributed Applications, IBM R...
Network-aware Data Management for Large Scale Distributed Applications, IBM R...
 
Решения WANDL и NorthStar для операторов
Решения WANDL и NorthStar для операторовРешения WANDL и NorthStar для операторов
Решения WANDL и NorthStar для операторов
 
The Need for Complex Analytics from Forwarding Pipelines
The Need for Complex Analytics from Forwarding Pipelines The Need for Complex Analytics from Forwarding Pipelines
The Need for Complex Analytics from Forwarding Pipelines
 
INT_Ch17.pptx
INT_Ch17.pptxINT_Ch17.pptx
INT_Ch17.pptx
 
Transport SDN Overview and Standards Update: Industry Perspectives
Transport SDN Overview and Standards Update: Industry PerspectivesTransport SDN Overview and Standards Update: Industry Perspectives
Transport SDN Overview and Standards Update: Industry Perspectives
 
Early-stage topological and technological choices for TSN-based communication...
Early-stage topological and technological choices for TSN-based communication...Early-stage topological and technological choices for TSN-based communication...
Early-stage topological and technological choices for TSN-based communication...
 
RECAP: The Simulation Approach
RECAP: The Simulation ApproachRECAP: The Simulation Approach
RECAP: The Simulation Approach
 
Cost-Efficient Rule Management and Traffic Engineering for Software Defined N...
Cost-Efficient Rule Management and Traffic Engineering for Software Defined N...Cost-Efficient Rule Management and Traffic Engineering for Software Defined N...
Cost-Efficient Rule Management and Traffic Engineering for Software Defined N...
 
Introduction to SDN
Introduction to SDNIntroduction to SDN
Introduction to SDN
 
Soc.pptx
Soc.pptxSoc.pptx
Soc.pptx
 
TechTalk_Cloud Performance Testing_0.6
TechTalk_Cloud Performance Testing_0.6TechTalk_Cloud Performance Testing_0.6
TechTalk_Cloud Performance Testing_0.6
 
Routing simulator
Routing simulatorRouting simulator
Routing simulator
 
Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)Crash course on data streaming (with examples using Apache Flink)
Crash course on data streaming (with examples using Apache Flink)
 
Carrier Strategies for Backbone Traffic Engineering and QoS
Carrier Strategies for Backbone Traffic Engineering and QoSCarrier Strategies for Backbone Traffic Engineering and QoS
Carrier Strategies for Backbone Traffic Engineering and QoS
 

More from AJAY KHARAT

Uncovering Bugs in P4 Programs with Assertion-based Verification
Uncovering Bugs in P4 Programs with Assertion-based VerificationUncovering Bugs in P4 Programs with Assertion-based Verification
Uncovering Bugs in P4 Programs with Assertion-based VerificationAJAY KHARAT
 
SDPROBER: A SOFTWARE DEFINED PROBER FOR SDN
SDPROBER: A SOFTWARE DEFINED PROBER FOR SDNSDPROBER: A SOFTWARE DEFINED PROBER FOR SDN
SDPROBER: A SOFTWARE DEFINED PROBER FOR SDNAJAY KHARAT
 
NS4: Enabling Programmable Data Plane Simulation
NS4: Enabling Programmable Data Plane SimulationNS4: Enabling Programmable Data Plane Simulation
NS4: Enabling Programmable Data Plane SimulationAJAY KHARAT
 
YATES: Rapid Prototyping for Traffic Engineering Systems
YATES: Rapid Prototyping forTraffic Engineering SystemsYATES: Rapid Prototyping forTraffic Engineering Systems
YATES: Rapid Prototyping for Traffic Engineering SystemsAJAY KHARAT
 
Life in the Fast Lane: A Line-Rate Linear Road
Life in the Fast Lane: A Line-Rate Linear RoadLife in the Fast Lane: A Line-Rate Linear Road
Life in the Fast Lane: A Line-Rate Linear RoadAJAY KHARAT
 
How to implement complex policies on existing network infrastructure
How to implement complex policies on existing network infrastructure How to implement complex policies on existing network infrastructure
How to implement complex policies on existing network infrastructure AJAY KHARAT
 
Network-Wide Heavy-Hitter Detection with Commodity Switches
Network-Wide Heavy-Hitter Detection with Commodity SwitchesNetwork-Wide Heavy-Hitter Detection with Commodity Switches
Network-Wide Heavy-Hitter Detection with Commodity SwitchesAJAY KHARAT
 
p4pktgen: Automated Test Case Generation for P4 Programs
p4pktgen:  Automated Test Case  Generation for P4 Programsp4pktgen:  Automated Test Case  Generation for P4 Programs
p4pktgen: Automated Test Case Generation for P4 ProgramsAJAY KHARAT
 
Mutual exclusion in distributed systems
Mutual exclusion in distributed systemsMutual exclusion in distributed systems
Mutual exclusion in distributed systemsAJAY KHARAT
 
virtual memory management in multi processor mach os
virtual memory management in multi processor mach osvirtual memory management in multi processor mach os
virtual memory management in multi processor mach osAJAY KHARAT
 
Solutions to byzantine agreement problem
Solutions to byzantine agreement problem Solutions to byzantine agreement problem
Solutions to byzantine agreement problem AJAY KHARAT
 

More from AJAY KHARAT (11)

Uncovering Bugs in P4 Programs with Assertion-based Verification
Uncovering Bugs in P4 Programs with Assertion-based VerificationUncovering Bugs in P4 Programs with Assertion-based Verification
Uncovering Bugs in P4 Programs with Assertion-based Verification
 
SDPROBER: A SOFTWARE DEFINED PROBER FOR SDN
SDPROBER: A SOFTWARE DEFINED PROBER FOR SDNSDPROBER: A SOFTWARE DEFINED PROBER FOR SDN
SDPROBER: A SOFTWARE DEFINED PROBER FOR SDN
 
NS4: Enabling Programmable Data Plane Simulation
NS4: Enabling Programmable Data Plane SimulationNS4: Enabling Programmable Data Plane Simulation
NS4: Enabling Programmable Data Plane Simulation
 
YATES: Rapid Prototyping for Traffic Engineering Systems
YATES: Rapid Prototyping forTraffic Engineering SystemsYATES: Rapid Prototyping forTraffic Engineering Systems
YATES: Rapid Prototyping for Traffic Engineering Systems
 
Life in the Fast Lane: A Line-Rate Linear Road
Life in the Fast Lane: A Line-Rate Linear RoadLife in the Fast Lane: A Line-Rate Linear Road
Life in the Fast Lane: A Line-Rate Linear Road
 
How to implement complex policies on existing network infrastructure
How to implement complex policies on existing network infrastructure How to implement complex policies on existing network infrastructure
How to implement complex policies on existing network infrastructure
 
Network-Wide Heavy-Hitter Detection with Commodity Switches
Network-Wide Heavy-Hitter Detection with Commodity SwitchesNetwork-Wide Heavy-Hitter Detection with Commodity Switches
Network-Wide Heavy-Hitter Detection with Commodity Switches
 
p4pktgen: Automated Test Case Generation for P4 Programs
p4pktgen:  Automated Test Case  Generation for P4 Programsp4pktgen:  Automated Test Case  Generation for P4 Programs
p4pktgen: Automated Test Case Generation for P4 Programs
 
Mutual exclusion in distributed systems
Mutual exclusion in distributed systemsMutual exclusion in distributed systems
Mutual exclusion in distributed systems
 
virtual memory management in multi processor mach os
virtual memory management in multi processor mach osvirtual memory management in multi processor mach os
virtual memory management in multi processor mach os
 
Solutions to byzantine agreement problem
Solutions to byzantine agreement problem Solutions to byzantine agreement problem
Solutions to byzantine agreement problem
 

Recently uploaded

EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityNeo4j
 
How to Track Employee Performance A Comprehensive Guide.pdf
How to Track Employee Performance A Comprehensive Guide.pdfHow to Track Employee Performance A Comprehensive Guide.pdf
How to Track Employee Performance A Comprehensive Guide.pdfLivetecs LLC
 
Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...Velvetech LLC
 
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024StefanoLambiase
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfAlina Yurenko
 
Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Andreas Granig
 
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...OnePlan Solutions
 
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxKnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxTier1 app
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio, Inc.
 
React Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaReact Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaHanief Utama
 
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEBATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEOrtus Solutions, Corp
 
Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)
Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)
Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)jennyeacort
 
Unveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsUnveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsAhmed Mohamed
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin
 
MYjobs Presentation Django-based project
MYjobs Presentation Django-based projectMYjobs Presentation Django-based project
MYjobs Presentation Django-based projectAnoyGreter
 
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样umasea
 
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...soniya singh
 
Folding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesFolding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesPhilip Schwarz
 
CRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. SalesforceCRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. SalesforceBrainSell Technologies
 

Recently uploaded (20)

EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
 
How to Track Employee Performance A Comprehensive Guide.pdf
How to Track Employee Performance A Comprehensive Guide.pdfHow to Track Employee Performance A Comprehensive Guide.pdf
How to Track Employee Performance A Comprehensive Guide.pdf
 
Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...
 
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
 
Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service
Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort ServiceHot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service
Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
 
Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024
 
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
 
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxKnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
 
React Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaReact Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief Utama
 
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEBATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
 
Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)
Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)
Call Us🔝>༒+91-9711147426⇛Call In girls karol bagh (Delhi)
 
Unveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsUnveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML Diagrams
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
 
MYjobs Presentation Django-based project
MYjobs Presentation Django-based projectMYjobs Presentation Django-based project
MYjobs Presentation Django-based project
 
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
 
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
 
Folding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesFolding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a series
 
CRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. SalesforceCRM Contender Series: HubSpot vs. Salesforce
CRM Contender Series: HubSpot vs. Salesforce
 

Instrumenting Open vSwitch with Monitoring Capabilities: Designs and Challenges

  • 1. Instrumenting Open vSwitch with Monitoring Capabilities: Designs and Challenges Zili Zha1 , An Wang1 , Yang Guo2 , Doug Montgomery2 , Songqing Chen1 Presented by: Ajay Kharat(2019H1030011G) BITS Pilani
  • 2. • Network measurement is essential for various management tasks such as network traffic engineering, anomaly detection, QoS. • Existing measurement frameworks - Inflexible and non-programmable • Urgent needs of flexible and programmable measurement frameworks Challenges: I. Minimal implementation complexity II. Trade-offs between resource consumption and measurement accuracy III. Minimal interferences with the forwarding path Motivation
  • 4. UMON Architecture Challenge I: Minimal implementation complexity Monitoring API’s [DstIP=A, Output(0)] [DstIP=B, Output(1)] Install Flow Rules user space kernel space Upcall Fine-grained Kernel Flow Cache [SrcIP=C, DstIP=A, DstPort=80, Output(0)] [SrcIP=C, DstIP=A, DstPort=22, Output(0)] [SrcIP=D, DstIP=B, DstPort=80, Output(1)] [SrcIP=D, DstIP=B, DstPort=22, Output(1)] Combining forwarding rule with monitoring rule. [SrcIP=C, DstPort=80, count] [SrcIP=D, DstPort=80, count] [DstPort=80, Counts(‘SrcIP’)] Kernel Flow Cache gets bloated during peak traffic + Handlers and Revalidators gets heavily loaded
  • 6. On-Path FCAP/SMON Architecture Custo m n- tuple table [DstPort=80] Challenge II: Resource-Accuracy Trade-offs n-tuple flow stats FCAP f1 f2 Flow XOR-ed n-tuple + stats SMON iBLT
  • 7. Challenge III: Minimal interferences with Forwarding path sample_collector thread Off-Path FCAP/SMON Architecture
  • 8. Evaluation of the Solution
  • 9. CPU Utilisation • Testbed Setup - Intel Xeon 4-Core 3.20 GHz CPU; 4GB memory - Host and OVS connected with 10 Gbps cables - Ryu SDN Controller • Total CPU utilisation of all related threads - 2 handlers + 2 revalidators - collector thread in the user space - Custom sample_collector thread in the kernel module CPU Overhead (packet rate = 160 Kpps) CPU Overhead (packet rate = 80 Kpps) UMON incurs highest CPU utilisation FCAP incurs less CPU overhead than SMON
  • 10. Memory Consumption and Monitoring Accuracy • Off-path introduces less forwarding delay, same measurement accuracy with higher memory. • SMON incurs higher latency than FCAP with acceptable measurement accuracy loss. Comparison of different monitoring designs Memory usage (MB) (packet rate = 160 Kpps) SMON is the most memory efficient while UMON incurs the highest memory consumption
  • 11. Switching Throughput and Latency Throughput Latency UMON achieves lowest throughput and highest latency Off-path achieves higher throughput and lower latency than on-path designs
  • 12. • UMON: least implementation efforts, highest CPU overhead, highest memory consumption • Off-path designs: outperform on-path designs in terms of switching performance, higher memory usage • Hash table: more efficient than sketch, lower computational cost. Overall Comparison and Insights Comparison of different frameworks
  • 13. Related Work • Traditional hardware based solutions to collect the IP network traffic used tools such as: - Netflow, Sflow, IPFIX • With the advancement of SDN and NFV techniques a series of work was proposed: - OpenSketch, DREAM, FlowRadar, Trumpet Drawbacks: Expensive to deploy Do not provide enough programmability for network management task Future Scope • Hybrid solution that balances the tradeoff between FCAP (higher accuracy) and SMON (less memory) • Alternative data structure to Ring Buffer that would consume less memory • Achieve a design of integration that has the minimal forwarding-monitoring function interference, optimal code sharing and efficient CPU/Memory resource usage