Downloaded 57 times
Uploaded byTaku Fukushima
MidoNet deep dive
The document outlines a comprehensive agenda for a deep dive into Midonet, covering key components, particularly Midolman, and foundational technologies used in its architecture. It details the upcall lifecycle in packet processing, including stages such as input, processing, and output, while emphasizing the management of virtual resources and state. Additionally, it includes prerequisites for coding and building Midonet, along with recommendations for development environments.
More Related Content
MidoNet deep dive
- 1.
- 2. Agenda 1. MidoNet components(revisited) 2. Midolman deep dive 3. Getting started with coding 4. Wrap-up
- 3.
- 4. NSDB NSDB NSDB Open vSwitchDatapath IF IF Interfaces on the host IF VM VM VM Midolman (MidoNet agent) Network Flow Table MidoNet APINova API Horizon MidoNet CLI Watch/modify Add/remove flows Neutron API MidoNet Plugin Host Cache + local state Store virtual topology information Clients / Users Nova compute
- 5. Midolman (MidoNet agent) NSDBNSDB NSDB Open vSwitch Datapath IF IF Interfaces on the host IF VM VM VM Midolman (MidoNet agent) Network Flow Table Watch/modify Add/remove flows Host Cache + local state Store virtual topology information Nova compute
- 6.
- 7. Foundations • Java andScala • Java 8 migration is coming • Guava and Guice • Akka Actor • Future and RxJava • Jackson → Protocol Buffer • Disruptor
- 8. Upcall Lifecycle 1. Inputstage • Get upcalls with packets from the datapath 2. Packet processing stage 1. Deduplicate and queue packets 2. Simulate packets on the virtual topology 3. Deal with the wildcard flows 4. Determine the egress physical port 3. Output stage • Emit packets and install flows based on the sims
- 9.
- 10.
- 11. F PacketsEntryPoint NetlinkCallback Dispatcher DeduplicationActor PacketWorkflow UpcallDatapath ConnectionManager One-to-Man One-to-On HTB Supended Packets Waiting Room (NetlinkInputChannel) NetlinkChannel Fast Path State Management OpenvSwitch Datapath Flow Table UpcallPacket 1. Input stage Select Loop
- 12. Datapath Controller Flow Controller PacketsEntryPoint NetlinkCallback Dispatcher DeduplicationActor PacketWorkflow UpcallDatapath ConnectionManager One-to-Many One-to-One HTB Supended Packets Waiting Room (NetlinkInputChannel) NetlinkChannel (NetlinkOutputChannel) DatapathChannel ment path Open WildcardFlow Pa WildcardFlows Flow Managem 2. Packet processing stage PacketContext PacketContextPacketContext PacketContext PacketContext PacketContext Routing by hashing with FlowKey
- 13. Datapath Controller Flow Controller PacketsEntryPoint RoutingManager Actor DatapathReady VirtualTopology Actor VirtualTo PhysicalMapper DeduplicationActor PacketWorkflow atapath nManager NSDB NSD NSDB Disrupto RingBuff putChannel) (NetlinkOutputChannel) DatapathReady WildcardFlow Flow Invalidation by Tag Virtual Topolog State data / Mess Wildcard Flows DatapathReady Datapath port operations Flow Management 2. Packet processing stage Retrieve virtual resources Virtual Resource Virtual Resource Virtual Resource Future • Completed • NotYetException
- 14. Datapath Controller Flow Controller PacketsEntryPoint RoutingManager Actor DatapathReady VirtualTopology Actor VirtualTo PhysicalMapper DeduplicationActor UpcallDatapath nnectionManager NS etlinkInputChannel) (NetlinkOutputChannel) DatapathReady WildcardFlow FlowInvalidation by Tag Virt State Wildcard Flows DatapathReady Datap oper Flow Management 2. Packet processing stage Manage virtual to local and physical mapping • Interface name to UUID • UUID to local port number • Which host has the interface • …
- 15. Datapath Controller Flow Controller PacketsEntryPoint NetlinkCallback Dispatcher DeduplicationActor PacketWorkflow UpcallDatapath ConnectionManager One-to-Many One-to-One HTB Supended Packets Waiting Room (NetlinkInputChannel) NetlinkChannel (NetlinkOutputChannel) DatapathChannel ment path Open WildcardFlow Pa WildcardFlows Flow Managem 2. Packet processing stage PacketContextPacketContext PacketContext PacketContext PacketContext PacketContext Simulation
- 16. Datapath Controller Flow Controller PacketsEntryPoint VirtualTo PhysicalMapper DeduplicationActor PacketWorkflow Disruptor Ring Buffer Supended Packets Waiting Room el)(NetlinkOutputChannel) DatapathChannel Flow Table DatapathReady WildcardFlow validation y Tag Virtual Topology State data / Messages Packet Flow Wildcard Flows DatapathReady Datapath port operations Flow Management 2. Packet processing stage Local datapath management • Create local datapath ports • Track UUID to port # mapping • Manage overlay tunnels PacketContext
- 17. Datapath Controller Flow Controller PacketsEntryPoint VirtualTo PhysicalMapper DeduplicationActor PacketWorkflow Disruptor Ring Buffer Supended Packets Waiting Room (NetlinkOutputChannel) DatapathChannel FlowTable DatapathReady WildcardFlow n Virtual Topology State data / Messages Packet Flow Wildcard Flows DatapathReady Datapath port operations Flow Management 2. Packet processing stage Flow Flow Flow Flow Query statistics Invalidate flows PacketContext
- 18. Datapath Controller Flow Controller PacketsEntryPoint NetlinkCallback Dispatcher DeduplicationActor PacketWorkflow One-to-Many One-to-One B Disruptor Ring Buffer Supended Packets Waiting Room (NetlinkOutputChannel) DatapathChannel OpenvSwitch Datapath Flow Table WildcardFlow Virtual Topology State data / Messages Packet Flow Wildcard Flows Datapath port operations Flow Management 3. Output stage Select Loop
- 20.
- 21.
- 22. Prerequisites • JDK7 • JDK8is coming • protoc (Protocol Buffer >= 2.6.0) ! • build-essential (for packaging deb packages) • rpm (for packaging RPM packages) • fpm (for packaging)
- 23. Dev environment (recommended) •JDK 7 (required) • JDK8 is coming • Protocol Buffers >= 2.6.0 (required) • IntelliJ IDEA 14 community edition (OSS!) (optional) • Scala plugin + protoc plugin • Nice displays and keyboards
- 24.
- 25.
- 26.
- 30.
- 31. Midolman deep dive •Upcall lifecycle 1. Input stage 2. Packet processing stage 3. Output stage • Fast path and state management • Read the docs • Getting started with coding
- 32. The end ofslides. Any Questions?