The document discusses the Open Data Plane (ODP) project, which aims to create an open source framework for data plane applications. ODP provides a standardized API to enable networking applications across different architectures like ARM, Intel and PowerPC. It is based on the Event Machine model of work-driven processing. ODP implementations optimize the API for different hardware platforms while providing application portability. The project aims to support functions like dynamic load balancing, power management, and virtual switch integration.
Learn more about the tremendous value Open Data Plane brings to NFV
Bob Monkman, Networking Segment Marketing Manager, ARM
Bill Fischofer, Senior Software Engineer, Linaro Networking Group
Moderator:
Brandon Lewis, OpenSystems Media
HKG15-110: ODP Project Update
---------------------------------------------------
Speaker: Bill Fischofer
Date: February 9, 2015
---------------------------------------------------
★ Session Summary ★
This session provides a summary of ODP activities since LCU ‰Û÷14 and highlights the main features of ODP v1.0 for applications as well as the validations used by conforming ODP implementation.
--------------------------------------------------
★ Resources ★
Pathable: https://hkg15.pathable.com/meetings/250771
Video: https://www.youtube.com/watch?v=xABcGPOCOuU
Etherpad: http://pad.linaro.org/p/hkg15-110
---------------------------------------------------
★ Event Details ★
Linaro Connect Hong Kong 2015 - #HKG15
February 9-13th, 2015
Regal Airport Hotel Hong Kong Airport
---------------------------------------------------
http://www.linaro.org
http://connect.linaro.org
HKG15-301: OVS implemented via ODP & vendor SDKsLinaro
HKG15-301: OVS implemented via ODP & vendor SDKs
---------------------------------------------------
Speaker: Ciprian Barbu, Zoltan Kiss
Date: February 11, 2015
---------------------------------------------------
★ Session Summary ★
Comparison of OVS implemented via ODP & vendor SDKs. Contrasting ODP linux-generic with the native Intel DPDK SDK and ODP implemented using the DPDK SDK on X86. Additionally comparing ODP linux-generic with ODP implemented using the Texas Instruments SDK on A15 ARM
--------------------------------------------------
★ Resources ★
Pathable: https://hkg15.pathable.com/meetings/250805
Video: N/A
Etherpad: N/A
---------------------------------------------------
★ Event Details ★
Linaro Connect Hong Kong 2015 - #HKG15
February 9-13th, 2015
Regal Airport Hotel Hong Kong Airport
---------------------------------------------------
http://www.linaro.org
http://connect.linaro.org
OpenDataPlane provides a portable framework for data plane programming that has been implemented across a wide variety of networking SoCs and traditional server platforms. This talk provides a quick introduction to ODP, its goals and component structure, as well as the governance structure that guides the evolution of ODP.
The overall volume of Internet traffic has been growing in a tremendous rate day-by-day which also contains unwanted malicious traffic. It has been a continuous challenge for the network operators to effectively identify the threats from line rate traffic. Hyperscan is a pattern (in terms of regular expression) matching software ideal for applications such as intrusion prevention/detection system, antivirus, unified threat management, deep packet inspection systems, etc.
Hyperscan works in two phases. At first, the customer patterns are parsed and compiled into databases in terms of bytecode. During runtime, these bytecode are used to search for patterns against blocks/streams data. Hyperscan library runs entirely in software and scales with IA processors to provide the maximum throughput of 293 Gbps.
Ed Warnicke's talk at Open Networking Summit.
All Open Source Networking project depend on having access to a Universal Dataplane that is:
Able to they deployment models: Bare Metal/Embedded/Cloud/Containers/NFVi/VNFs
High performance
Feature Rich
Open with Broad Community support/participation
FD.io provides all of this and more. Come learn more about FD.io and how you can begin using it.
Learn more about the tremendous value Open Data Plane brings to NFV
Bob Monkman, Networking Segment Marketing Manager, ARM
Bill Fischofer, Senior Software Engineer, Linaro Networking Group
Moderator:
Brandon Lewis, OpenSystems Media
HKG15-110: ODP Project Update
---------------------------------------------------
Speaker: Bill Fischofer
Date: February 9, 2015
---------------------------------------------------
★ Session Summary ★
This session provides a summary of ODP activities since LCU ‰Û÷14 and highlights the main features of ODP v1.0 for applications as well as the validations used by conforming ODP implementation.
--------------------------------------------------
★ Resources ★
Pathable: https://hkg15.pathable.com/meetings/250771
Video: https://www.youtube.com/watch?v=xABcGPOCOuU
Etherpad: http://pad.linaro.org/p/hkg15-110
---------------------------------------------------
★ Event Details ★
Linaro Connect Hong Kong 2015 - #HKG15
February 9-13th, 2015
Regal Airport Hotel Hong Kong Airport
---------------------------------------------------
http://www.linaro.org
http://connect.linaro.org
HKG15-301: OVS implemented via ODP & vendor SDKsLinaro
HKG15-301: OVS implemented via ODP & vendor SDKs
---------------------------------------------------
Speaker: Ciprian Barbu, Zoltan Kiss
Date: February 11, 2015
---------------------------------------------------
★ Session Summary ★
Comparison of OVS implemented via ODP & vendor SDKs. Contrasting ODP linux-generic with the native Intel DPDK SDK and ODP implemented using the DPDK SDK on X86. Additionally comparing ODP linux-generic with ODP implemented using the Texas Instruments SDK on A15 ARM
--------------------------------------------------
★ Resources ★
Pathable: https://hkg15.pathable.com/meetings/250805
Video: N/A
Etherpad: N/A
---------------------------------------------------
★ Event Details ★
Linaro Connect Hong Kong 2015 - #HKG15
February 9-13th, 2015
Regal Airport Hotel Hong Kong Airport
---------------------------------------------------
http://www.linaro.org
http://connect.linaro.org
OpenDataPlane provides a portable framework for data plane programming that has been implemented across a wide variety of networking SoCs and traditional server platforms. This talk provides a quick introduction to ODP, its goals and component structure, as well as the governance structure that guides the evolution of ODP.
The overall volume of Internet traffic has been growing in a tremendous rate day-by-day which also contains unwanted malicious traffic. It has been a continuous challenge for the network operators to effectively identify the threats from line rate traffic. Hyperscan is a pattern (in terms of regular expression) matching software ideal for applications such as intrusion prevention/detection system, antivirus, unified threat management, deep packet inspection systems, etc.
Hyperscan works in two phases. At first, the customer patterns are parsed and compiled into databases in terms of bytecode. During runtime, these bytecode are used to search for patterns against blocks/streams data. Hyperscan library runs entirely in software and scales with IA processors to provide the maximum throughput of 293 Gbps.
Ed Warnicke's talk at Open Networking Summit.
All Open Source Networking project depend on having access to a Universal Dataplane that is:
Able to they deployment models: Bare Metal/Embedded/Cloud/Containers/NFVi/VNFs
High performance
Feature Rich
Open with Broad Community support/participation
FD.io provides all of this and more. Come learn more about FD.io and how you can begin using it.
This presentation covers various partners and collaborators who are currently working with OpenPOWER foundation ,Use cases of OpenPOWER systems in multiple Industries , OpenPOWER Workgroups and OpenCAPI features .
The current Hadoop ecosystem is challenged and slowed by fragmented and duplicated efforts.
An industry standard is required that translates to immediate benefits that will increase stability, capabilities and compatibility among Hadoop distributions. Its also important to include an open data management core with emphasis on making it enterprise focused.
The ODPi is a shared industry effort focused on build such standards and also promoting and advancing the state of Big Data technologies. Linaro is actively involved in this effort and also to make sure ODPi is ARM compatible.
This talk will go over some of specifications defined, Linaro's contributions, Roadmap and a quick demo
The Libre-SOC Project aims to create an entirely Libre-Licensed, transparently-developed fully auditable Hybrid 3D CPU-GPU-VPU, using the Supercomputer-class OpenPOWER ISA as the foundation.
Our first test ASIC is a 180nm "Fixed-Point" Power ISA v3.0B processor, 5.1mm x 5.9mm, as a proof-of-concept for the team, whose primary expertise is in Software Engineering. Software Engineering training brings a radically different approach to Hardware development: extensive unit tests, source code revision control, automated development tools are normal. Libre Project Management brings even more: bug trackers, mailing lists, auditable IRC logs and a wiki are standard fare for Libre Projects that are simply not normal Industry-Standard practice.
This talk therefore goes through the workflow, from the original HDL through to the GDS-II layout, showing how we were able to keep track of the development that led to the IMEC 180nm tape-out in July 2021. In particular, by following a parallel development process involving "Real" and "Symbolic" Cell Libraries, developed by Chips4Makers, will be shown how our developers did not need to sign a Foundry NDA, but were still able to work side-by-side with a University that did. With this parallel development process, the University upheld their NDA obligations, and Libre-SOC were simultaneously able to honour its Transparency Objectives.
Session ID: SFO17-509
Session Name: Deep Learning on ARM Platforms
- SFO17-509
Speaker: Jammy Zhou
Track:
★ Session Summary ★
A new era of deep learning is coming with algorithm evolvement, powerful computing platforms and large dataset availability. This session will focus on existing and potential heterogeneous accelerator solutions (GPU, FPGA, DSP, and etc) for ARM platforms and the work ahead from platform perspective.
---------------------------------------------------
★ Resources ★
Event Page: http://connect.linaro.org/resource/sfo17/sfo17-509/
Presentation:
Video:
---------------------------------------------------
★ Event Details ★
Linaro Connect San Francisco 2017 (SFO17)
25-29 September 2017
Hyatt Regency San Francisco Airport
---------------------------------------------------
Keyword:
http://www.linaro.org
http://connect.linaro.org
---------------------------------------------------
Follow us on Social Media
https://www.facebook.com/LinaroOrg
https://twitter.com/linaroorg
https://www.youtube.com/user/linaroorg?sub_confirmation=1
https://www.linkedin.com/company/1026961
Deep Learning Neural Network Acceleration at the Edge - Andrea GalloLinaro
Short
The growing amount of data captured by sensors and the real time constraints imply that not only big data analytics but also Machine Learning (ML) inference shall be executed at the edge. The multiple options for neural network acceleration in Arm-based platforms provide an unprecedented opportunity for new intelligent devices. It also raises the risk of fragmentation and duplication of efforts when multiple frameworks shall support multiple accelerators.
Andrea Gallo, Linaro VP of Segment Groups, will summarise the existing NN frameworks, accelerator solutions, and will describe the efforts underway in the Arm ecosystem.
Abstract
The dramatically growing amount of data captured by sensors and the ever more stringent requirements for latency and real time constraints are paving the way for edge computing, and this implies that not only big data analytics but also Machine Learning (ML) inference shall be executed at the edge. The multiple options for neural network acceleration in recent Arm-based platforms provides an unprecedented opportunity for new intelligent devices with ML inference. It also raises the risk of fragmentation and duplication of efforts when multiple frameworks shall support multiple accelerators.
Andrea Gallo, Linaro VP of Segment Groups, will summarise the existing NN frameworks, model description formats, accelerator solutions, low cost development boards and will describe the efforts underway to identify the best technologies to improve the consolidation and enable the competitive innovative advantage from all vendors.
Audience
The session will be useful for executives to engineers. Executives will gain a deeper understanding of the issues and opportunities. Engineers at NN acceleration IP design houses will take away ideas for how to collaborate in the open source community on their area of expertise, how to evaluate the performance and accelerate multiple NN frameworks without modifying them for each new IP, whether it be targeting edge computing gateways, smart devices or simple microcontrollers.
Benefits to the Ecosystem
The AI deep learning neural network ecosystem is starting just now and it has similar implications with open source as GPU and video accelerators had in the early days with user space drivers, binary blobs, proprietary APIs and all possible ways to protect their IPs. The session will outline a proposal for a collaborative ecosystem effort to create a common framework to manage multiple NN accelerators while at the same time avoiding to modify deep learning frameworks with multiple forks.
Tech Talk by John Casey (CTO) CPLANE_NETWORKS : High Performance OpenStack Ne...nvirters
OpenStack is HOT! No doubt about it. A recent survey by The New Stack and The Linux Foundation shows OpenStack as the most popular open source project ahead of other hot projects like Docker and KVM. OpenStack is now taking its rightful place as the open source cloud solution for enterprises and service providers.
To date OpenStack networking has not yet achieved the performance, scalability and reliability that many large enterprises demand. CPLANE NETWORKS solves that problem by delivering secure multi-tenant virtual networking that overcomes the limitations of the standard Neutron networking service. By making all networking services local to the compute node and achieving near line-rate throughput, CPLANE NETWORKS Dynamic Virtual Networks (DVN) delivers mega-scale networking for the most demanding application environments.
In this session John Casey will cover the basics of DVN and explain how CPLANE NETWORKS achieves "at scale" network performance within and across data centers.
About John Casey
John Casey has over 20 years of deep technology leadership. His proven success with a variety of technical leadership roles in Telecom, Enterprise and Government and in software design and development provide the foundation for the system architecture and engineering team.
Previously John led worldwide deployment teams for both IBM’s Software Group and Narus, Inc. His work in large scale, high performance system design at Transarc Labs and Walker Interactive Systems brings leadership to the CPLANE NETWORKS product suite.
Platform Independent Packet Processing with ODLOPNFV
The Open Dataplane (ODP) provides a platform-independent API and framework for packet processing applications. Especially, it enables applications to use the special packet processing capabilities of system-on-chips without being tied to a specific hardware implementation. This makes ODP a key ingredient in the OPNFV projects that are focusing on Dataplane Acceleration (DPACC) and OPNFV on ARM.
This talk will introduce the Open Dataplane project with examples, and why it is important in Network Function Virtualization use cases.
OpenPOWER Acceleration of HPCC SystemsHPCC Systems
JT Kellington, IBM and Allan Cantle, Nallatech present at the 2015 HPCC Systems Engineering Summit Community Day about porting HPCC Systems to the POWER8-based ppc64el architecture.
Jan Lindblad's presentation at Layer123 SDN and OpenFlow World Congress in Bad Homburg, Germany. Focusing on a multi-vendor SDN deployment at a Tier 1 Service Provider in Asia.
Tail-f Network Control System (NCS) use case:
• Dynamic control of L3-L7 devices using service- oriented network API
• Service chaining using OpenFlow
• Virtualized appliances
These slides were presented at the 2013 Linux Plumbers Conference in New Orleans by myself and Vina Ermagan. We are doing work to enable LISP and NSH in Open vSwitch, and these slides gave some background on both of these protocols as well as detail on what we've accomplished and future directions.
Tech Tutorial by Vikram Dham: Let's build MPLS router using SDNnvirters
Synopsis
We will start with MPLS 101 and then look into MPLS related OpenFlow actions. In the second half we will delve into RouteFlow architecture and extend it to enable Label Distribution Protocol (LDP) and MPLS routing. We will conclude with a mini-net based test bed switching traffic using MPLS labels instead of IP addresses.
This will be a hands on workshop. VM Images for Virtual Box will be provided. Attendees are expected to bring their laptops loaded with Virtual Box.
About Vikram Dham
Vikram is the CTO and co-founder of Kamboi Technologies, LLC where he advises networking companies, switch vendors and early adopters on SDN technology and distributed software development. Also, he is the founder of Bay Area Network Virtualization (BANV) meet-up group, that brings together technologists in the SDN/NFV/NV domain for technical talks, workshops and creates a truly "open" platform for sharing knowledge.
He has used SDN technologies for building software related to traffic engineering, security and routing. In the past, he was the Principal Engineer at Slingbox where he architected & built the distributed networking software for peer to peer connectivity of millions of end points. He holds MS degree in EE with a specialization in Computer Networks from Virginia Tech and has worked on research projects with companies like ECI Telecom, Raytheon and Avaya Research Labs.
Parser is an integration project in OPNFV and one of the candidate projects of OPNFV B Release. ETSI NFV offers a rich set of descriptors and deployment templates on different levels, thus it is vital for OPNFV as a platform to provide the capability of utilizing different templates for developers to work on. At its core, Parser provides such translation tooling that developers won't care too much about writing a "correct" script. They could write their templates/scripts in TOSCA or YANG or whatever they desire, and Parser would enable OPNFV to natively support all these types of scripts by translate them to the one that the main platform would use.
In this presentation the core team member of the Parser project, Howard Huang, Victor Hu, Vinayak Ram and Julien Zhang will share with you what and how we do in Parser project, and what nice features you would expect in the coming releases.
This presentation covers various partners and collaborators who are currently working with OpenPOWER foundation ,Use cases of OpenPOWER systems in multiple Industries , OpenPOWER Workgroups and OpenCAPI features .
The current Hadoop ecosystem is challenged and slowed by fragmented and duplicated efforts.
An industry standard is required that translates to immediate benefits that will increase stability, capabilities and compatibility among Hadoop distributions. Its also important to include an open data management core with emphasis on making it enterprise focused.
The ODPi is a shared industry effort focused on build such standards and also promoting and advancing the state of Big Data technologies. Linaro is actively involved in this effort and also to make sure ODPi is ARM compatible.
This talk will go over some of specifications defined, Linaro's contributions, Roadmap and a quick demo
The Libre-SOC Project aims to create an entirely Libre-Licensed, transparently-developed fully auditable Hybrid 3D CPU-GPU-VPU, using the Supercomputer-class OpenPOWER ISA as the foundation.
Our first test ASIC is a 180nm "Fixed-Point" Power ISA v3.0B processor, 5.1mm x 5.9mm, as a proof-of-concept for the team, whose primary expertise is in Software Engineering. Software Engineering training brings a radically different approach to Hardware development: extensive unit tests, source code revision control, automated development tools are normal. Libre Project Management brings even more: bug trackers, mailing lists, auditable IRC logs and a wiki are standard fare for Libre Projects that are simply not normal Industry-Standard practice.
This talk therefore goes through the workflow, from the original HDL through to the GDS-II layout, showing how we were able to keep track of the development that led to the IMEC 180nm tape-out in July 2021. In particular, by following a parallel development process involving "Real" and "Symbolic" Cell Libraries, developed by Chips4Makers, will be shown how our developers did not need to sign a Foundry NDA, but were still able to work side-by-side with a University that did. With this parallel development process, the University upheld their NDA obligations, and Libre-SOC were simultaneously able to honour its Transparency Objectives.
Session ID: SFO17-509
Session Name: Deep Learning on ARM Platforms
- SFO17-509
Speaker: Jammy Zhou
Track:
★ Session Summary ★
A new era of deep learning is coming with algorithm evolvement, powerful computing platforms and large dataset availability. This session will focus on existing and potential heterogeneous accelerator solutions (GPU, FPGA, DSP, and etc) for ARM platforms and the work ahead from platform perspective.
---------------------------------------------------
★ Resources ★
Event Page: http://connect.linaro.org/resource/sfo17/sfo17-509/
Presentation:
Video:
---------------------------------------------------
★ Event Details ★
Linaro Connect San Francisco 2017 (SFO17)
25-29 September 2017
Hyatt Regency San Francisco Airport
---------------------------------------------------
Keyword:
http://www.linaro.org
http://connect.linaro.org
---------------------------------------------------
Follow us on Social Media
https://www.facebook.com/LinaroOrg
https://twitter.com/linaroorg
https://www.youtube.com/user/linaroorg?sub_confirmation=1
https://www.linkedin.com/company/1026961
Deep Learning Neural Network Acceleration at the Edge - Andrea GalloLinaro
Short
The growing amount of data captured by sensors and the real time constraints imply that not only big data analytics but also Machine Learning (ML) inference shall be executed at the edge. The multiple options for neural network acceleration in Arm-based platforms provide an unprecedented opportunity for new intelligent devices. It also raises the risk of fragmentation and duplication of efforts when multiple frameworks shall support multiple accelerators.
Andrea Gallo, Linaro VP of Segment Groups, will summarise the existing NN frameworks, accelerator solutions, and will describe the efforts underway in the Arm ecosystem.
Abstract
The dramatically growing amount of data captured by sensors and the ever more stringent requirements for latency and real time constraints are paving the way for edge computing, and this implies that not only big data analytics but also Machine Learning (ML) inference shall be executed at the edge. The multiple options for neural network acceleration in recent Arm-based platforms provides an unprecedented opportunity for new intelligent devices with ML inference. It also raises the risk of fragmentation and duplication of efforts when multiple frameworks shall support multiple accelerators.
Andrea Gallo, Linaro VP of Segment Groups, will summarise the existing NN frameworks, model description formats, accelerator solutions, low cost development boards and will describe the efforts underway to identify the best technologies to improve the consolidation and enable the competitive innovative advantage from all vendors.
Audience
The session will be useful for executives to engineers. Executives will gain a deeper understanding of the issues and opportunities. Engineers at NN acceleration IP design houses will take away ideas for how to collaborate in the open source community on their area of expertise, how to evaluate the performance and accelerate multiple NN frameworks without modifying them for each new IP, whether it be targeting edge computing gateways, smart devices or simple microcontrollers.
Benefits to the Ecosystem
The AI deep learning neural network ecosystem is starting just now and it has similar implications with open source as GPU and video accelerators had in the early days with user space drivers, binary blobs, proprietary APIs and all possible ways to protect their IPs. The session will outline a proposal for a collaborative ecosystem effort to create a common framework to manage multiple NN accelerators while at the same time avoiding to modify deep learning frameworks with multiple forks.
Tech Talk by John Casey (CTO) CPLANE_NETWORKS : High Performance OpenStack Ne...nvirters
OpenStack is HOT! No doubt about it. A recent survey by The New Stack and The Linux Foundation shows OpenStack as the most popular open source project ahead of other hot projects like Docker and KVM. OpenStack is now taking its rightful place as the open source cloud solution for enterprises and service providers.
To date OpenStack networking has not yet achieved the performance, scalability and reliability that many large enterprises demand. CPLANE NETWORKS solves that problem by delivering secure multi-tenant virtual networking that overcomes the limitations of the standard Neutron networking service. By making all networking services local to the compute node and achieving near line-rate throughput, CPLANE NETWORKS Dynamic Virtual Networks (DVN) delivers mega-scale networking for the most demanding application environments.
In this session John Casey will cover the basics of DVN and explain how CPLANE NETWORKS achieves "at scale" network performance within and across data centers.
About John Casey
John Casey has over 20 years of deep technology leadership. His proven success with a variety of technical leadership roles in Telecom, Enterprise and Government and in software design and development provide the foundation for the system architecture and engineering team.
Previously John led worldwide deployment teams for both IBM’s Software Group and Narus, Inc. His work in large scale, high performance system design at Transarc Labs and Walker Interactive Systems brings leadership to the CPLANE NETWORKS product suite.
Platform Independent Packet Processing with ODLOPNFV
The Open Dataplane (ODP) provides a platform-independent API and framework for packet processing applications. Especially, it enables applications to use the special packet processing capabilities of system-on-chips without being tied to a specific hardware implementation. This makes ODP a key ingredient in the OPNFV projects that are focusing on Dataplane Acceleration (DPACC) and OPNFV on ARM.
This talk will introduce the Open Dataplane project with examples, and why it is important in Network Function Virtualization use cases.
OpenPOWER Acceleration of HPCC SystemsHPCC Systems
JT Kellington, IBM and Allan Cantle, Nallatech present at the 2015 HPCC Systems Engineering Summit Community Day about porting HPCC Systems to the POWER8-based ppc64el architecture.
Jan Lindblad's presentation at Layer123 SDN and OpenFlow World Congress in Bad Homburg, Germany. Focusing on a multi-vendor SDN deployment at a Tier 1 Service Provider in Asia.
Tail-f Network Control System (NCS) use case:
• Dynamic control of L3-L7 devices using service- oriented network API
• Service chaining using OpenFlow
• Virtualized appliances
These slides were presented at the 2013 Linux Plumbers Conference in New Orleans by myself and Vina Ermagan. We are doing work to enable LISP and NSH in Open vSwitch, and these slides gave some background on both of these protocols as well as detail on what we've accomplished and future directions.
Tech Tutorial by Vikram Dham: Let's build MPLS router using SDNnvirters
Synopsis
We will start with MPLS 101 and then look into MPLS related OpenFlow actions. In the second half we will delve into RouteFlow architecture and extend it to enable Label Distribution Protocol (LDP) and MPLS routing. We will conclude with a mini-net based test bed switching traffic using MPLS labels instead of IP addresses.
This will be a hands on workshop. VM Images for Virtual Box will be provided. Attendees are expected to bring their laptops loaded with Virtual Box.
About Vikram Dham
Vikram is the CTO and co-founder of Kamboi Technologies, LLC where he advises networking companies, switch vendors and early adopters on SDN technology and distributed software development. Also, he is the founder of Bay Area Network Virtualization (BANV) meet-up group, that brings together technologists in the SDN/NFV/NV domain for technical talks, workshops and creates a truly "open" platform for sharing knowledge.
He has used SDN technologies for building software related to traffic engineering, security and routing. In the past, he was the Principal Engineer at Slingbox where he architected & built the distributed networking software for peer to peer connectivity of millions of end points. He holds MS degree in EE with a specialization in Computer Networks from Virginia Tech and has worked on research projects with companies like ECI Telecom, Raytheon and Avaya Research Labs.
Parser is an integration project in OPNFV and one of the candidate projects of OPNFV B Release. ETSI NFV offers a rich set of descriptors and deployment templates on different levels, thus it is vital for OPNFV as a platform to provide the capability of utilizing different templates for developers to work on. At its core, Parser provides such translation tooling that developers won't care too much about writing a "correct" script. They could write their templates/scripts in TOSCA or YANG or whatever they desire, and Parser would enable OPNFV to natively support all these types of scripts by translate them to the one that the main platform would use.
In this presentation the core team member of the Parser project, Howard Huang, Victor Hu, Vinayak Ram and Julien Zhang will share with you what and how we do in Parser project, and what nice features you would expect in the coming releases.
SDN 101: Software Defined Networking Course - Sameh Zaghloul/IBM - 2014SAMeh Zaghloul
Sameh Zaghloul
Technology Manager @ IBM
+2 0100 6066012
zaghloul@eg.ibm.com
SDN: Technology that enables data center team to use software to efficiently control network resources
SDN Overview
SDN Standards
NFV – Network Function Virtualization
SDN Scenarios and Use Cases
SDN Sample Research Projects
SDN Technology Survey
SDN Case Study
SDN Online Courses
SDN Lab SW Tools
- OpenStack Framework
- OpenDayLighyt – SDN Controller
- FloodLight – SDN Controller
- Open vSwitch – Virtual Switch
- MiniNet – Virtual Network: OpenFlow Switches, SDN Controllers, and Servers/Hosts
- OMNet++ Network Simulator
- Avior – Sample FloodLight Java Application
- netem - Network Emulation
- NOX/POX - C++/ Python OpenFlow API for building network control applications
- Pyretic = Python + Frenetic - Enables network programmers and operators to write modular network applications by providing powerful abstractions
- Resonance - Event-Driven Control for Software-Defined Networks (written in Pyretic)
SDN Project
Madhu Rangarajan will provide an overview of Networking trends they are seeing in Cloud, various network topologies and tradeoffs, and trends in the acceleration of packet processing workloads. They will also talk about some of the work going on in Intel to address these trends, including FPGAs in the datacenter.
Accelerate Big Data Processing with High-Performance Computing TechnologiesIntel® Software
Learn about opportunities and challenges for accelerating big data middleware on modern high-performance computing (HPC) clusters by exploiting HPC technologies.
Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storageMayaData Inc
Webinar Session - https://youtu.be/_5MfGMf8PG4
In this webinar, we share how the Container Attached Storage pattern makes performance tuning more tractable, by giving each workload its own storage system, thereby decreasing the variables needed to understand and tune performance.
We then introduce MayaStor, a breakthrough in the use of containers and Kubernetes as a data plane. MayaStor is the first containerized data engine available that delivers near the theoretical maximum performance of underlying systems. MayaStor performance scales with the underlying hardware and has been shown, for example, to deliver in excess of 10 million IOPS in a particular environment.
OSMC 2019 | Monitoring Alerts and Metrics on Large Power Systems Clusters by ...NETWAYS
In this talk we’ll introduce an open source project being used to monitor large Power Systems clusters, such as in the IBM collaboration with Oak Ridge and Lawrence Livermore laboratories for the Summit project, a large deployment of custom AC922 Power Systems nodes augmented by GPUs that work in tandem to implement the (currently) largest Supercomputer in the world.
Data is collected out-of-band directly from the firmware layer and then redistributed to various components using an open source component called Crassd. In addition, in-band operating-system and service level metrics, logs and alerts can also be collected and used to enrich the visualization dashboards. Open source components such as the Elastic Stack (Elasticsearch, Logstash, Kibana and select Beats) and Netdata are used for monitoring scenarios appropriate to each tool’s strengths, with other components such as Prometheus and Grafana in the process of being implemented. We’ll briefly discuss our experience to put these components together, and the decisions we had to make in order to automate their deployment and configuration for our goals. Finally, we lay out collaboration possibilities and future directions to enhance our project as a convenient starting point for others in the open source community to easily monitor their own Power Systems environments.
HPC and cloud distributed computing, as a journeyPeter Clapham
Introducing an internal cloud brings new paradigms, tools and infrastructure management. When placed alongside traditional HPC the new opportunities are significant But getting to the new world with micro-services, autoscaling and autodialing is a journey that cannot be achieved in a single step.
Dr. Christos Kolias – Senior Research Scientist
Keynote Title: “NFV: Empowering the Network”
Keynote Abstract: Network Functions Virtualization (NFV) envisions and promises to change the service provider landscape and has emerged as one of one of today’s significant trends. Although less than two years old, NFV has garnered the industry’s full attention and support. Moving swiftly, a number of key accomplishments have already taken place, and a lot more work is currently under way within ETSI NFV while we are embarking on its future phase. Various proofs-of-concepts (ranging from vEPC to vCPE, vIMS and vCDN) are being developed while issues such as open source and SDN are becoming key ingredients as the can play a pivotal role.
Dr. Christos Kolias' Bio: Christos Kolias is a senior research scientist at Orange Silicon Valley (a subsidiary of Orange). Christos is a co-founder of the ETSI NFV group and had led the formation of ONF’s Wireless & Mobile working group. He has lectured on NFV and SDN at several events. Christos has more than 15 years of experience in networking, he is the originator of Virtual Output Queueing (VOQ) used in packet switching. He holds a Ph.D. in Computer Science from UCLA.
---------------------------------------------------
★ Resources ★
Zerista: http://lcu14.zerista.com/event/member/137765
Google Event: https://plus.google.com/u/0/events/cpeksim4hr4ghhuufv5ic4viirs
Video: https://www.youtube.com/watch?v=tFDnj_342n4&list=UUIVqQKxCyQLJS6xvSmfndLA
Etherpad: http://pad.linaro.org/p/lcu14-400a
---------------------------------------------------
★ Event Details ★
Linaro Connect USA - #LCU14
September 15-19th, 2014
Hyatt Regency San Francisco Airport
---------------------------------------------------
http://www.linaro.org
http://connect.linaro.org
Marcelo Perazolo, Lead Software Architect, IBM Corporation - Monitoring a Pow...Nagios
Marcelo Perazolo, Lead Software Architect, IBM Corporation - In this session, Marcelo will describe how Nagios can be
integrated and extended for the monitoring of a typical
power-based converged infrastructure, and how it interfaces with existing element managers to provide a single point of integration for passive and active monitoring purposes.
PLNOG 17 - Andrzej Jeruzal - Dell Networking OS10: sieciowy system operacyjny...PROIDEA
W trakcie tej sesji zostaną przedstawione założenia, które stały u podstaw zbudowania przez firmę Dell rewolucyjnego i otwartego sieciowego systemu operacyjnego znanego pod kryptonimem OS10. Omówina zostanie jego architektura, funkcjonalności oraz praktyczne zastosowania. System OS10 to nastepny krok w promowanej od 2 lat przez firmę Dell idei otwartej sieciowości (Dell Open Networking) rozdzialając i standaryzując obecnie już nawet warstwy w samym sieciowym systemie operacyjnym !
1. Here Now - an Open Source Project Near
You
The Linaro LNG Open Data Plane Initiative
Mike Christofferson, Enea
In conjunction with Ola Liljedahl, Arm
2. FOUNDED
1968
TEN OFFICES
IN NORTH
AMERICA,
EUROPE AND
ASIA
REVENUE
~70 M
USD
NO. OF
EMPLOYEES
426
Increasing data traffic in communication devices
require new and innovative software solutions to
handle bandwidth, performance, and power
requirements, as well as scalable systems
management and availability solutions
A robust product portfolio
Enea operating systems software is heavily
used in wireless Infrastructure (Macro, small
cell), gateway, etc. Enea Solutions run in
more than 50% of the world’s 8.2M radio
base stations.
Enea provides a commercial Linux
distribution, built by Yocto, with focus on real-
time
Proven, mature middleware solutions for over
10 years – High Availability, Systems
Management, and real-time database
Global presence, global development, and
headquartered in Stockholm, Sweden
Enea - Powering Distributed, Connected Systems
3. 0
20
40
60
80
100
120
140
160
1995 2000 2005 2010 2015 2020 2025 2030
• Super-linear growth in:
– Number of users
– Number of connected devices
– Number of over the top (OTT)
applications and protocols
– Number of (standard)
protocols (RFC’s)
– Bandwidth usage
– Power consumption of
network infrastructure
What Is Happening
Logos and trademarks are used for illustration only and remain the property of their respective owners.
4. • Increasing and varying QoS requirements
– Realtime (e.g. VoIP, video conferencing, gaming)
– Streaming (e.g. music, video)
– Messaging (e.g. IM, Ajax, M2M/IoT)
– Bulk (web data, file sharing, OTA updates)
• More functionality and services implemented in the
network
– Web caching
– Content delivery (CDN)
– Intrusion detection and prevention (IDS/IPS)
– User-specific service level agreements (SLA)
Increasing Diversity and Functionality
5. Consequences
• Need flexibility of software and programmable hardware
– Trend towards software-realised networking - function defined by
software
• Need familiar programming environments with robust tools
– For TimeToMarket-driven development of new protocols and
services
• Need portability
– Move functionality and applications between hardware platforms
optimised for different power/performance/cost points
• Need high abstraction
– To enable innovation in efficient implementations
– E.g. OpenGL/OpenMAX
• Need efficient support for virtualization
– Decouple functionality (SW) from capacity (HW)
– Dynamic partitioning of common HW for different functions
– Simple, robust and incremental deployment of new services
6. Solution – HW/OS
Develop and deploy networking applications on general
purpose processors/architectures
• Increasingly ARM and x86
• Users and partners are drawn to the big ecosystems around these architectures
Networking applications running in Linux user space
Develop, debug and deploy using standard Linux tools
• Robust user space access to networking HW resources
Linux enhanced to provide bare metal-like environment
Bare Metal Linux
Avoid TLB misses, interrupts, context switches, system calls, thread migration
Direct HW access from user space
Applications run isolated in user space on dedicated cores, unaffected by the Linux
kernel and other applications
Optional real-time support
As needed by some wireless subsystems (<10μs interrupt response time)
7. What Is Open Data Plane?
• ODP is an open source cross-platform framework
for data plane applications
• Common API for application portability
• Multiple implementations tuned to different
platforms for performance
• Result: Easy app portability and performance
Application Environment
• Applications run in Linux user space with
essentially zero system overhead
Open Data Plane Overview
8. Open Data Plane: The Time has Come
• Networking silicon vendors have evolved data plane SDKs for years
– No cross-industry group has sanctioned any common interface on diverse
silicon
• The Linaro Networking Working Group - a consortium of 12 networking
stakeholders surveyed the open source landscape
– Consensus: No ideal “one-size fits all”, implementation for diverse
hardware/software approaches
• A truly open source & open contribution & cross-platform data plane interface,
driven by a cross section of stakeholders, is needed
• Based on the OpenGL model: A software API at a higher level of abstraction,
that could offer flexibility of implementations underneath that suit diverse
needs.
– The Linaro non-profit open source software engineering organization is launching
just such a collaboration…
• So Linaro created…OpenDataPlane(ODP).org with charter contributors…
9. Open Data Plane API
• Standardized data plane API to enable Linux-based
networking applications across any architecture
– Open support for ARM, Intel, MIPS & PowerPC !
• Structured to enable future innovation
– Lightweight abstraction preserves performance without
prescribing lower –level processing structure
– Access and management of HW accelerators
– Supports optional schedulers to provision easy
management and traffic load balancing
• Proprietary SDKs sit underneath for OEM/operator
software platform simplification (e.g. Supports
DPDK on x86, USDPAA on QorIQ, etc)
9
Enabling an efficient, truly cross-platform standardized
data plane processing model
Application and
services
portability
across a choice
of hardware
platforms
10. ODP Foundational Principles
Event Machine
– Work-driven many core data plane processing
SoC Abstraction
– Portable API’s for access to HW/SoC resources
Bare Metal Linux (a.k.a. Bear Metal Linux)
– Minimal overhead and deterministic execution in Linux user
space
EM
SoCA
BML
Application
11. ODP Foundational Principles (2)
• A data plane/networking API and runtime
– Loosely based on the NSN Event Machine
– Event/work-driven and polled programming models
– Portable API’s for accelerators and offloads
– Runs in user space under Bare Metal Linux for best performance and
determinism
• Common API, optimised implementations
– Separately owned and maintained API (e.g. OpenGL)
– Generic portable reference implementation from Linaro
– HW-optimised (possibly proprietary) implementations from
networking SoC vendors
– Linaro maintains ODP for x86/DPDK
12. API and Concepts
• ODP loosely based on Event Machine, originally developed by
NSN
– Generic framework for scalable multi-core programming, not limited
to packet processing
• Event based abstraction and programming model for handling
IO
– Supports packet flows, physical and virtual network interfaces,
accelerators, SW endpoints, etc.
– Events represent different types of data: packets, timers, baseband
data, HW notifications, SW messages...
• Supports scheduler based programming model (both HW &
SW)
– Scheduling of IO events using different algorithms and knowledge of
work in progress
– Implicit synchronisation and mutual exclusion between threads
• Supports different IO load balancing approaches
– Chose best configuration for traffic profile, latency/throughput
requirements, and HW characteristics without changing the
application
• Proven, already half a dozen HW-specific EM implementations
13. EM Basic Concepts
Queue groups
Queues with
events
Scheduler
Cores/threads associated
with queue groups
Idle
core
Queues can be
dynamically created
and added to and
removed from queue
groups
Cores can be
dynamically added to
and removed from
queue groups
Event handlers associated
with queues
IP-fwd
NAT
GTP-U
DPI
RoHC
14. Work Scheduling
• Actual scheduling algorithms implementation dependent
• Scheduler can enforce ordering/mutual exclusion
– Parallel, parallel/ordered and atomic queues
– Application doesn’t need software mutex for protecting per-flow state
• Logical flows/queues mapped to hardware queues (if available)
‘Pull’ work, on
demand scheduling
Clusters/Cores/ThreadsLogical flows/queues
thousands to millions
Flows/
QoS classes WRR
SP
Scheduling algorithms
WRR - Weighted Round Robin
SP - Strict Priority
Work
Scheduler
Processing packet
from flow A
Processing packet
from flow B
Idle (power-gated)
because of low load
15. Dynamic vs. Static Load Balancing
• Networking SoC’s have hardware
suitable for dynamic load balancing
– Queues associated with producer
– Queue and buffer mgmt in hardware
• Server NICs designed for termination
– Static load sharing (based on hashing)
– Queues associated with consumer
– Queue and buffer management in
software/shared memory
• Static increases average and worst case
latency and buffer space
– OK for ~8 cores… but not many-core ready
(some networking SoC’s already have 30+
cores/HW-threads)
• Static makes core elasticity very
difficult (per-core state with application
level seamless/lossless handovers)
– Limits opportunity for power scaling
0
20
40
60
80
100
120
140
1 2 4 8 16 32 64 128
Averagelatency/uS
Number of cores
Static load-
sharing
Dynamic load-
balancing
0
0,1
0,2
0,3
0,4
0,5
0,6
0,7
0,8
0,9
1
0% 20% 40% 60% 80% 100%
Power
% Load
Static Load Sharing
with typical DVFS
Dynamic Load
Balancing Power
gating + DVFS
16. Elasticity and Multi-core Load Balancing
Issues
– Traffic load and pattern varies over time
– Industry trend is to use more cores and more power-efficient cores
– To hit the sweet spot PPA (Power/Performance/Area)
– Enabled by inherent parallelism in networking
– Ideally use as many (or few) cores as traffic load and SLA’s require and use them
efficiently
ODP
Supports hardware scheduler and dynamic load balancing
Cores can be added and removed
No fixed allocation of cores for specific application
Enables power or clock gating of idle cores
Cores can share load dynamically
Increased throughput,
Decreased packet latencies,
Increased core utilization
17. Scalable and Elastic Timer Support
Issues
• Many protocols need timers, often several timers per
flow/connection
– Millions of flows in core network means millions of timers
• Timers, like packets, are associated with flows/connections
– Need mutual exclusion of flow context when processing a timer event
ODP
ODP schedules timers together with packets
Timers and packets can be synchronized and load balanced together
18. Power and Performance Management
Issues
• Traffic load varies
– Daily variation and intermittent bursts
• Use as many or as few cores needed to meet bandwidth and QoS
requirements
– Add and remove worker threads/cores
– Adjust clock frequency of active cores
– Power or clock gate inactive cores
ODP
Supports power/performance management
Provides API for observing queue lengths
Idle worker threads may yield to OS for background tasks or power down core
Application can monitor traffic load and quickly react to increasing load
19. vSwitch Integration
Issues
• Efficient and robust integration with software or hardware-accelerated
vSwitch
• No loss of performance for virtualised networking applications using
the dataplane API
ODP
ODP’s queue-based I/O hides actual device implementation
A queue may represent an actual network interface, a vSwitch port, a
pipeline of further processing stages (e.g. for encryption or
encapsulation) etc.
Allows for HW to copy packets between application and vSwitch
No shared memory between application and vSwitch
20. Openness and Cross-platform
ODP provides:
Support for multiple architectures and platforms (e.g., ARM,
x86, and MIPS)
Open source and an open collaboration
Not controlled by any single company
Anyone may join in
Reference implementations are open source
Based on the Event Machine which currently is implemented
on a number of different HW targets (using
ARM/MIPS/PPC/x86 processors)
Proven cross-platform support
21. Status Core API Definitions
API Component Description Status
BUFFER Shared memory, buffer pools, buffer types and access
functions
Preliminary done, but still
work in progress
CLASSIFICATION Ingress packet classification Preliminary work underway,
CRYPTO Algorithmic and protocol offload for crypto, hashing, RNG Proposal being implemented
IPC Inter-process communication control plane/data plane TBD
PACKET I/O Network interface abstraction Done
QUEUE Buffer queue management Done
TIMER Protocol timers, periodic ticks Done
SCHEDULER Ingress scheduling and distribution to threads/cores Done
Version 0.2. of the API spec available now
Version 1.0 by year end 2014
22. Status Implementations
Platform Description Status
linux-generic Generic, portable reference implementation, uses Linux
facilities (e.g. NetMap, crypto)
Implements
BUFFER/CRYPTO/PACKET-
IO/QUEUE/TIMER/SCHEDULE
R
linux-dpdk Implementation for x86 using DPDK as the acceleration
layer.
Just started
linux-keystone2 HW-accelerated implementation for TI Keystone2 Tracking linux-generic
linux-qoriq HW-accelerated implementation for FSL DPAA In progress
Other implementations outside LNG also in progress...
23. • Cisco will demonstrate real app running on multiple HW-
implementations of ODP
– Usage of API’s
– Usage of HW acceleration through ODP API’s (e.g. ordered and atomic
scheduling, crypto)
– Portability
• NSN has had early influence on general architecture and APIs
• Huawei is promoting ODP in public presentations and
expressing their support in meetings
• Ericsson’s new influence in this project
Demos at Linaro Connect USA in Sep’ 14
Contributions and Interest from Major TEMs
The ODP API Specification can be influenced by anyone in the open
community
24. What’s next?
• Adding more members to the ODP team
– Several companies in discussions, e.g. Aricent, Juniper & others
downloading and commenting on ODP
• Developing NFV PoCs with ARM ecosystem partners, building
on ODP
– Hardening and optimizing the performance of ODP implementations
• Developing liaisons with OpenDayLight, Open Networking
Foundation, NFV Working Group
– Additionally, a new open source initiative to integrate open NFV
building blocks with ODP
• Evangelizing ODP in the broad community
25. Thanks for Attending
For more….
Visit us in booth #201
Go to
opendataplane.org
linaro.org/projects/networking