The document discusses TiNA, an integrated network analyzer developed by SK Telecom to provide unified network monitoring and operation for software-defined data centers. TiNA includes systems for network packet brokering, probing, analysis, visualization, and service-centric monitoring. It provides both packet-level and flow-level network analytics using open source software and the T-CAP, an open converged network appliance developed by SKT that integrates switching and server functions. The document outlines TiNA's capabilities and provides examples of its use for traffic engineering, cloud data center multi-tenancy monitoring, and LTE network monitoring.
본 발표에서는 OCP 하드웨어 및 소프트웨어에 대한 소개를 진행할 예정이다. 특히 페이스북에서 제공한 Wedge ToR 스위치, Open Network Linux, FBOSS, Indigo OpenFlow agent 를 갖고 삽질한 지난 두달 간의 경험을 공유할 예정이다.
Opensample: A Low-latency, Sampling-based Measurement Platform for Software D...Junho Suh
In this paper we propose, implement and evaluate OpenSample: a low-latency, sampling-based network measure- ment platform targeted at building faster control loops for software-defined networks. OpenSample leverages sFlow packet sampling to provide near–real-time measurements of both net- work load and individual flows. While OpenSample is useful in any context, it is particularly useful in an SDN environment where a network controller can quickly take action based on the data it provides. Using sampling for network monitoring allows OpenSample to have a 100 millisecond control loop rather than the 1–5 second control loop of prior polling-based approaches. We implement OpenSample in the Floodlight OpenFlow controller and evaluate it both in simulation and on a testbed comprised of commodity switches. When used to inform traffic engineering, OpenSample provides up to a 150% throughput improvement over both static equal-cost multi-path routing and a polling-based solution with a one second control loop.
Pulsar is used by a portfolio of products at Splunk for stream processing of different types of data, including metrics and logs. In this talk, Karthik Ramasamy will share how Splunk helped a flagship customer scale a Pulsar deployment to handle 10 PB/day in a single cluster. He will talk about the journey, the challenges faced, and the trade-offs made to scale Pulsar and operate it reliably and stably in Google Cloud Platform (GCP).
At Microsoft’s annual developers conference, Microsoft Azure CTO Mark Russinovich disclosed major advances in Microsoft’s hyperscale deployment of Intel field programmable gate arrays (FPGAs). These advances have resulted in the industry’s fastest public cloud network, and new technology for acceleration of Deep Neural Networks (DNNs) that replicate “thinking” in a manner that’s conceptually similar to that of the human brain.
Watch the video: http://wp.me/p3RLHQ-gNu
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
Paper describes optimization of bandwidth using dynamic creation and deletion of MPLS LSPs all managed by the router.
Builds on a unique concept to automatically manage and elastically grow and contract LSPs
본 발표에서는 OCP 하드웨어 및 소프트웨어에 대한 소개를 진행할 예정이다. 특히 페이스북에서 제공한 Wedge ToR 스위치, Open Network Linux, FBOSS, Indigo OpenFlow agent 를 갖고 삽질한 지난 두달 간의 경험을 공유할 예정이다.
Opensample: A Low-latency, Sampling-based Measurement Platform for Software D...Junho Suh
In this paper we propose, implement and evaluate OpenSample: a low-latency, sampling-based network measure- ment platform targeted at building faster control loops for software-defined networks. OpenSample leverages sFlow packet sampling to provide near–real-time measurements of both net- work load and individual flows. While OpenSample is useful in any context, it is particularly useful in an SDN environment where a network controller can quickly take action based on the data it provides. Using sampling for network monitoring allows OpenSample to have a 100 millisecond control loop rather than the 1–5 second control loop of prior polling-based approaches. We implement OpenSample in the Floodlight OpenFlow controller and evaluate it both in simulation and on a testbed comprised of commodity switches. When used to inform traffic engineering, OpenSample provides up to a 150% throughput improvement over both static equal-cost multi-path routing and a polling-based solution with a one second control loop.
Pulsar is used by a portfolio of products at Splunk for stream processing of different types of data, including metrics and logs. In this talk, Karthik Ramasamy will share how Splunk helped a flagship customer scale a Pulsar deployment to handle 10 PB/day in a single cluster. He will talk about the journey, the challenges faced, and the trade-offs made to scale Pulsar and operate it reliably and stably in Google Cloud Platform (GCP).
At Microsoft’s annual developers conference, Microsoft Azure CTO Mark Russinovich disclosed major advances in Microsoft’s hyperscale deployment of Intel field programmable gate arrays (FPGAs). These advances have resulted in the industry’s fastest public cloud network, and new technology for acceleration of Deep Neural Networks (DNNs) that replicate “thinking” in a manner that’s conceptually similar to that of the human brain.
Watch the video: http://wp.me/p3RLHQ-gNu
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
Paper describes optimization of bandwidth using dynamic creation and deletion of MPLS LSPs all managed by the router.
Builds on a unique concept to automatically manage and elastically grow and contract LSPs
DPDK Summit 2015 - Sprint - Arun RajagopalJim St. Leger
DPDK Summit 2015 in San Francisco.
Presentation by Arun Rajagopal, Sprint, and Sameh Gobriel, Intel.
For additional details and the video recording please visit www.dpdksummit.com.
These slides were presented at the 2013 Linux Plumbers Conference in New Orleans by myself and Vina Ermagan. We are doing work to enable LISP and NSH in Open vSwitch, and these slides gave some background on both of these protocols as well as detail on what we've accomplished and future directions.
What architectures are best suited for today’s date center network? And how does Cumulus Networks make it easier to build networks? Dinesh Dutt (@ddcumulus), Chief Scientist at Cumulus Networks goes on to answer these questions in an entertaining and lively presentation. Customers need simple building blocks with simple L2 networking (MLAG) and L3 Clos. Cumulus Linux supports both, it supports additional functionality to simplify configuration (ex. PTM, IP unnumbered, L2 & L3 automation) and it is a platform that people can innovate on top of.
This presentation will walk through the values and benefits of using service chaining technologies in OPNFV for service composition. The presentation will talk through and demonstrate, in real time, platform service chaining features and capabilities
Reduce Redundant Producers from Partitioned Producer - Pulsar Summit NA 2021StreamNative
Yahoo Japan Corporation has been using Apache Pulsar as a centralized messaging platform.
Recently, we have found an efficiency issue caused by an unspecified number of producers. More specifically, in some situations partitioned producer doesn't need to connect to all partitions.
A couple of cases as below:
1. different rate producers
- we should set the number of partitions according to the highest-rate producer
- however, this number is excessively large for low-rate producers
2. SinglePartition routing mode
- each producer uses only one partition
Currently we are planning to make partitioned producer able to connect to not only all partitions, but also part of partitions. We expect that this feature allows us to use system resources more efficiently.
In this session we will explain more detail and some experimental results.
The presentation will provide a brief overview of Tungsten Fabric, and the new features in the recent 5.0 release. A demo of Tungsten Fabric will follow, with an overview of core functionality, and newly released features.
Speaker: Nick Davey, Cloud - SDN Product Manager
There is growing interest in running Apache Spark natively on Kubernetes. lan Filonenko explains the design idioms, architecture and internal mechanics of Spark orchestrations over Kubernetes. Since data for Spark analytics is often stored in HDFS, Ilan will also explain how to make Spark on Kubernetes work seamlessly with HDFS by addressing challenges such as data locality and security through the use of Kubernetes constructs such as secrets and RBAC rules
Elastify Cloud-Native Spark Application with Persistent MemoryDatabricks
Cloud native deployment has become one of the major trends for large scale Big Data analytics. Compared to on-premise data center, cloud offers much stronger scalability and higher elasticity to Big Data applications. However, cloud is also considered to be less performance than on-premise alternatives due to virtualization and cluster resource disaggregation. We present a new cloud native Spark application architecture backed by persistent memory technology. The key ingredient of this architecture is a novel acceleration engine that uses Intel's 3DXPoint technology as external memory. We discuss how the performance of multiple aspects of data processing can be improved using this new architecture. As a key takeaway, audience will gain understanding on the benefits of latest persistent memory technology, and how such new technology could be leveraged in cloud data processing architecture.
DPDK Summit 2015 - Aspera - Charles ShiflettJim St. Leger
DPDK Summit 2015 in San Francisco.
Presentation by Charles Shiflett, Aspera.
For additional details and the video recording please visit www.dpdksummit.com.
Network Automation (Bay Area Juniper Networks Meetup)Alejandro Salinas
Network Automation Presentation at the Bay Area Juniper Networks Meetup. Here I present three stories with regards to network automation at Groupon, increasing in complexity as we go through and also touching on some of the process/management challenges.
Real-Time Machine Learning with Pulsar Functions - Pulsar Summit NA 2021StreamNative
In this talk I will present a technique for deploying machine learning models to provide real-time predictions using Apache Pulsar Functions. In order to provide a prediction in real-time, the model usually receives a single data point from the caller, and is expected to provide an accurate prediction within a few milliseconds.
Throughout this talk, I will demonstrate the steps required to deploy a fully-trained ML that predicts the delivery time for a food delivery service based upon real-time traffic information, the customer's location, and the restaurant that will be fulfilling the order.
Accelerate Service Function Chaining Vertical Solution with DPDKOPNFV
Service Function Chaining (SFC) is one of top 5 NFV use case. Supporting SFC in provider and enterprise networks requires performance assurance. Specifically, the Classifier and the Service Function Forwarder which are typically implemented in software such as virtual switches need to match line rate requirement. DPDK (Data Plane Development Kit) is an open source project comprising a set of libraries and drivers for fast packet processing. In this presentation, we will discuss our experiences accelerating SFC with DPDK. In addition, Telco and Datacenter carriers demands dynamic SFC that requires new SFC wire protocols (e.g. VxLAN-GPE and NSH) support in both data and control planes. We intend to share our experiences and future works of a high performance, NSH-aware SFC vertical solution with open-source ingredients: Openstack, Opendaylight, OpenvSwitch with DPDK acceleration.
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a MonthNicolas Brousse
TubeMogul grew from few servers to over two thousands servers and handling over one trillion http requests a month, processed in less than 50ms each. To keep up with the fast growth, the SRE team had to implement an efficient Continuous Delivery infrastructure that allowed to do over 10,000 puppet deployment and 8,500 application deployment in 2014. In this presentation, we will cover the nuts and bolts of the TubeMogul operations engineering team and how they overcome challenges.
Enhancing Network Visibility Based On Open Converged Network ApplianceOpen Networking Summit
Dr. Dongheon Lee' and Dr. Junho Suh's presentation from the 2017 Open Networking Summit.
As the mobile traffic carried by cellular networks has been growing rapidly and the networks gets bigger and more complex, network operators have been forced to search for solutions to substantially enhance network visibility. This talk introduces SKT integrated Network Analyzer (TiNA) and Converged Appliance Platform (T-CAP) which help us improving the efficiency of network operation, troubleshooting, and analyzing traffic. TiNA is composed of virtual network packet broker, flow analyzer, high speed packet dump system, connection performance analyzer, and 3D-based network management system. T-CAP is an open architecture of a server-switch type hardware. We will review how to implement those TiNA functions based on open source (e.g., DPDK, Spark Streaming) and T-CAP. Finally, we will also discuss about the use-cases of TiNA and T-CAP for the private cloud & telco network infrastructure.
DPDK Summit 2015 - Sprint - Arun RajagopalJim St. Leger
DPDK Summit 2015 in San Francisco.
Presentation by Arun Rajagopal, Sprint, and Sameh Gobriel, Intel.
For additional details and the video recording please visit www.dpdksummit.com.
These slides were presented at the 2013 Linux Plumbers Conference in New Orleans by myself and Vina Ermagan. We are doing work to enable LISP and NSH in Open vSwitch, and these slides gave some background on both of these protocols as well as detail on what we've accomplished and future directions.
What architectures are best suited for today’s date center network? And how does Cumulus Networks make it easier to build networks? Dinesh Dutt (@ddcumulus), Chief Scientist at Cumulus Networks goes on to answer these questions in an entertaining and lively presentation. Customers need simple building blocks with simple L2 networking (MLAG) and L3 Clos. Cumulus Linux supports both, it supports additional functionality to simplify configuration (ex. PTM, IP unnumbered, L2 & L3 automation) and it is a platform that people can innovate on top of.
This presentation will walk through the values and benefits of using service chaining technologies in OPNFV for service composition. The presentation will talk through and demonstrate, in real time, platform service chaining features and capabilities
Reduce Redundant Producers from Partitioned Producer - Pulsar Summit NA 2021StreamNative
Yahoo Japan Corporation has been using Apache Pulsar as a centralized messaging platform.
Recently, we have found an efficiency issue caused by an unspecified number of producers. More specifically, in some situations partitioned producer doesn't need to connect to all partitions.
A couple of cases as below:
1. different rate producers
- we should set the number of partitions according to the highest-rate producer
- however, this number is excessively large for low-rate producers
2. SinglePartition routing mode
- each producer uses only one partition
Currently we are planning to make partitioned producer able to connect to not only all partitions, but also part of partitions. We expect that this feature allows us to use system resources more efficiently.
In this session we will explain more detail and some experimental results.
The presentation will provide a brief overview of Tungsten Fabric, and the new features in the recent 5.0 release. A demo of Tungsten Fabric will follow, with an overview of core functionality, and newly released features.
Speaker: Nick Davey, Cloud - SDN Product Manager
There is growing interest in running Apache Spark natively on Kubernetes. lan Filonenko explains the design idioms, architecture and internal mechanics of Spark orchestrations over Kubernetes. Since data for Spark analytics is often stored in HDFS, Ilan will also explain how to make Spark on Kubernetes work seamlessly with HDFS by addressing challenges such as data locality and security through the use of Kubernetes constructs such as secrets and RBAC rules
Elastify Cloud-Native Spark Application with Persistent MemoryDatabricks
Cloud native deployment has become one of the major trends for large scale Big Data analytics. Compared to on-premise data center, cloud offers much stronger scalability and higher elasticity to Big Data applications. However, cloud is also considered to be less performance than on-premise alternatives due to virtualization and cluster resource disaggregation. We present a new cloud native Spark application architecture backed by persistent memory technology. The key ingredient of this architecture is a novel acceleration engine that uses Intel's 3DXPoint technology as external memory. We discuss how the performance of multiple aspects of data processing can be improved using this new architecture. As a key takeaway, audience will gain understanding on the benefits of latest persistent memory technology, and how such new technology could be leveraged in cloud data processing architecture.
DPDK Summit 2015 - Aspera - Charles ShiflettJim St. Leger
DPDK Summit 2015 in San Francisco.
Presentation by Charles Shiflett, Aspera.
For additional details and the video recording please visit www.dpdksummit.com.
Network Automation (Bay Area Juniper Networks Meetup)Alejandro Salinas
Network Automation Presentation at the Bay Area Juniper Networks Meetup. Here I present three stories with regards to network automation at Groupon, increasing in complexity as we go through and also touching on some of the process/management challenges.
Real-Time Machine Learning with Pulsar Functions - Pulsar Summit NA 2021StreamNative
In this talk I will present a technique for deploying machine learning models to provide real-time predictions using Apache Pulsar Functions. In order to provide a prediction in real-time, the model usually receives a single data point from the caller, and is expected to provide an accurate prediction within a few milliseconds.
Throughout this talk, I will demonstrate the steps required to deploy a fully-trained ML that predicts the delivery time for a food delivery service based upon real-time traffic information, the customer's location, and the restaurant that will be fulfilling the order.
Accelerate Service Function Chaining Vertical Solution with DPDKOPNFV
Service Function Chaining (SFC) is one of top 5 NFV use case. Supporting SFC in provider and enterprise networks requires performance assurance. Specifically, the Classifier and the Service Function Forwarder which are typically implemented in software such as virtual switches need to match line rate requirement. DPDK (Data Plane Development Kit) is an open source project comprising a set of libraries and drivers for fast packet processing. In this presentation, we will discuss our experiences accelerating SFC with DPDK. In addition, Telco and Datacenter carriers demands dynamic SFC that requires new SFC wire protocols (e.g. VxLAN-GPE and NSH) support in both data and control planes. We intend to share our experiences and future works of a high performance, NSH-aware SFC vertical solution with open-source ingredients: Openstack, Opendaylight, OpenvSwitch with DPDK acceleration.
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a MonthNicolas Brousse
TubeMogul grew from few servers to over two thousands servers and handling over one trillion http requests a month, processed in less than 50ms each. To keep up with the fast growth, the SRE team had to implement an efficient Continuous Delivery infrastructure that allowed to do over 10,000 puppet deployment and 8,500 application deployment in 2014. In this presentation, we will cover the nuts and bolts of the TubeMogul operations engineering team and how they overcome challenges.
Enhancing Network Visibility Based On Open Converged Network ApplianceOpen Networking Summit
Dr. Dongheon Lee' and Dr. Junho Suh's presentation from the 2017 Open Networking Summit.
As the mobile traffic carried by cellular networks has been growing rapidly and the networks gets bigger and more complex, network operators have been forced to search for solutions to substantially enhance network visibility. This talk introduces SKT integrated Network Analyzer (TiNA) and Converged Appliance Platform (T-CAP) which help us improving the efficiency of network operation, troubleshooting, and analyzing traffic. TiNA is composed of virtual network packet broker, flow analyzer, high speed packet dump system, connection performance analyzer, and 3D-based network management system. T-CAP is an open architecture of a server-switch type hardware. We will review how to implement those TiNA functions based on open source (e.g., DPDK, Spark Streaming) and T-CAP. Finally, we will also discuss about the use-cases of TiNA and T-CAP for the private cloud & telco network infrastructure.
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...Tal Lavian Ph.D.
The new architecture is proposed for data intensive enabled by next generation dynamic optical networks
Encapsulates “optical network resources” into a service framework to support dynamically provisioned and advanced data-intensive transport services
Provides a generalized framework for high performance applications over next generation networks, not necessary optical end-to-end
Supports both on-demand and scheduled data retrieval
Supports a meshed wavelength switched network capable of establishing an end-to-end lightpath in seconds
Supports bulk data-transfer facilities using lambda-switched networks
Supports out-of-band tools for adaptive placement of data replicas
Offers network resources as Grid services for Grid computing
Joint presentation on behalf of the Society of Cable Telecommunications Engineers (SCTE) between Cox Communications (Mazen Khaddem) and Cisco Systems (Dr. Loukas Paraschis). Presentation covers different SDN categories, NFV examples in business services, and use cases for WAN SDN.
The Corsa DP2000 series is an open programmable switching and routing platform that delivers 10G and 100G subscriber-level networking, on-demand services and real-time network tuning. The Corsa DP2000 allows network architects and operators to dynamically partition hardware into independent virtual SDN switches or routers operating at line-rate.
In this presentation, you'll learn how to get started with bandwidth monitoring tool, NetFlow Analyzer.
Topics covered:
1. Configuring flow export from network devices
2. Traffic group
3. Application mapping
4. In-depth traffic visibility
5. Threshold-based alerting
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...Tal Lavian Ph.D.
Dynamic High-Performance Networks :
Support data-intensive Grid applications
Gives adequate and uncontested bandwidth to an application’s burst
Employs circuit-switching of large flows of data to avoid overheads in breaking flows into small packets and delays routing
Is capable of automatic end-to-end path provisioning
Is capable of automatic wavelength switching
Provides a set of protocols for managing dynamically provisioned wavelengths
DWDM-RAM :
Encapsulates “optical network resources” into a service framework to support dynamically provisioned and advanced data-intensive transport services
Offers network resources as Grid services for Grid computing
Allows cooperation of distributed resources
Provides a generalized framework for high performance applications over next generation networks, not necessary optical end-to-end
Yields good overall utilization of network resources
Intelligent Network Services through Active Flow ManipulationTal Lavian Ph.D.
Active Flow Manipulation Abstractions:
Aggregate data into traffic flows
Flows whose characteristics can be identified in real-time
E.g., “all UDP packets to a particular service”, “all TCP packets from a particular machine”.
Actions to be performed in the traffic flows
Actions that can be performed in real-time
E.g., “Change the priority of all traffic destined to a particular service on a particular machine”, “Stop all traffic out of a particular link of a router”.
Platforms for Accelerating the Software Defined and Virtual Infrastructure6WIND
As network infrastructures evolve and selected elements shift from physical systems to virtual functions a new class of network appliance is required that provides high performance processing, balanced I/O and hardware or software acceleration. Such a platform must combine standard server technology and modular systems that can be configured to support line rate performance with network interfaces up to 100Gbit/s.
This webinar will discuss a class of network appliance that offers performance levels previously requiring more complex and costly architectures while integrating seamlessly with standard software frameworks such as Linux, Open vSwitch (OVS) and Intel® Data Plane Development Kit (DPDK).
Master Class : TCP/IP Mechanics from Scratch to ExpertAbhishek Sagar
This is Master Class course on TCP/IP protocol - Transmission Control Protocol. Since it is Master Class course, this course discusses the internal design and functioning of complex transport layer protocol - TCP.
Almost all traffic on internet today is transported by TCP protocol. TCP, as where it stands today, mature and solid, is the result of over 25 yrs of research by network gurus. TCP is complicated and difficult to understand, therefore i have paid utmost attention to present the concept in most simplest way as possible without any loss of information.
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)MdTanvirMahtab2
This presentation is about the working procedure of Shahjalal Fertilizer Company Limited (SFCL). A Govt. owned Company of Bangladesh Chemical Industries Corporation under Ministry of Industries.
Hierarchical Digital Twin of a Naval Power SystemKerry Sado
A hierarchical digital twin of a Naval DC power system has been developed and experimentally verified. Similar to other state-of-the-art digital twins, this technology creates a digital replica of the physical system executed in real-time or faster, which can modify hardware controls. However, its advantage stems from distributing computational efforts by utilizing a hierarchical structure composed of lower-level digital twin blocks and a higher-level system digital twin. Each digital twin block is associated with a physical subsystem of the hardware and communicates with a singular system digital twin, which creates a system-level response. By extracting information from each level of the hierarchy, power system controls of the hardware were reconfigured autonomously. This hierarchical digital twin development offers several advantages over other digital twins, particularly in the field of naval power systems. The hierarchical structure allows for greater computational efficiency and scalability while the ability to autonomously reconfigure hardware controls offers increased flexibility and responsiveness. The hierarchical decomposition and models utilized were well aligned with the physical twin, as indicated by the maximum deviations between the developed digital twin hierarchy and the hardware.
Overview of the fundamental roles in Hydropower generation and the components involved in wider Electrical Engineering.
This paper presents the design and construction of hydroelectric dams from the hydrologist’s survey of the valley before construction, all aspects and involved disciplines, fluid dynamics, structural engineering, generation and mains frequency regulation to the very transmission of power through the network in the United Kingdom.
Author: Robbie Edward Sayers
Collaborators and co editors: Charlie Sims and Connor Healey.
(C) 2024 Robbie E. Sayers
Immunizing Image Classifiers Against Localized Adversary Attacksgerogepatton
This paper addresses the vulnerability of deep learning models, particularly convolutional neural networks
(CNN)s, to adversarial attacks and presents a proactive training technique designed to counter them. We
introduce a novel volumization algorithm, which transforms 2D images into 3D volumetric representations.
When combined with 3D convolution and deep curriculum learning optimization (CLO), itsignificantly improves
the immunity of models against localized universal attacks by up to 40%. We evaluate our proposed approach
using contemporary CNN architectures and the modified Canadian Institute for Advanced Research (CIFAR-10
and CIFAR-100) and ImageNet Large Scale Visual Recognition Challenge (ILSVRC12) datasets, showcasing
accuracy improvements over previous techniques. The results indicate that the combination of the volumetric
input and curriculum learning holds significant promise for mitigating adversarial attacks without necessitating
adversary training.
Final project report on grocery store management system..pdfKamal Acharya
In today’s fast-changing business environment, it’s extremely important to be able to respond to client needs in the most effective and timely manner. If your customers wish to see your business online and have instant access to your products or services.
Online Grocery Store is an e-commerce website, which retails various grocery products. This project allows viewing various products available enables registered users to purchase desired products instantly using Paytm, UPI payment processor (Instant Pay) and also can place order by using Cash on Delivery (Pay Later) option. This project provides an easy access to Administrators and Managers to view orders placed using Pay Later and Instant Pay options.
In order to develop an e-commerce website, a number of Technologies must be studied and understood. These include multi-tiered architecture, server and client-side scripting techniques, implementation technologies, programming language (such as PHP, HTML, CSS, JavaScript) and MySQL relational databases. This is a project with the objective to develop a basic website where a consumer is provided with a shopping cart website and also to know about the technologies used to develop such a website.
This document will discuss each of the underlying technologies to create and implement an e- commerce website.
3. Telco Services
§ Software-Defined Infrastructure
§ Open Hardware and Software
§ Universal Platform for Diverse Applications
§ Software-Defined RAN
§ Network & Service Slicing
§ Next-Generation OSS (TANGO)
§ Ultra High Data Rate
§ Low Latency
§ Massive Connectivity
ATSCALE: Scalable, Cognitive, Automated, Lean, E2E
COSMOS: Composable, Open, Scalable, Mission-critical Optimized System
All-IT Infrastructure
4. Operational Intelligence
§ E2E monitoring and analytics for global orchestration and
management
§ Disaster prediction and recovery
§ Security
Bandwidth-on-demand service
§ Data center interconnection - stretching SDN coverage to the
transport layer
§ Data center backup and virtual machine migration
Performance and reliability
§ Open source software performance and reliability
§ Provisioning and live migration speed
§ SDN controller and switch performance
Static Dynamic
Manual Automated
Cloud Core
Cloud RAN/Core
New RAT
On-Demand
Virtual Network Slice
Mobile Traffic Explosion
All-IT Network Architecture and Challenges
5. TiNA for COSMOS Network Monitoring
TiNA: SKT integrated Network Analyzer
§ Unified network monitoring and operating
solution for software-defined data center
You Can't Manage What You Can't See
Network visibility is extremely important
to network providers for managing All-IT
Infra.
§ Troubleshooting application performance
issues
§ Monitoring application performance and
reliability
§ Ensuring network scalability
§ Protecting and securing the network
§ Managing complex network infrastructure
Network Visibility
6. TiNA: SKT integrated Network Analyzer
Unified network monitoring and operating solution
which includes essential systems and tools for network health monitoring, traffic
monitoring, packet analysis, session analysis, and troubleshooting.
Tennant traffic monitoring Physical/virtual network visualization
End-to-end flow monitoring
Pakcet-Level: Packet into flow aggregation Connection performance analysis
Flow-Level: Tennant traffic classification Top-N conversations E2E Flow Path Calculation
On-demand packet brokering
w/ filtering/replication/aggregation
SNMP
sFlow, NetFlow
Flow-aware high speed
packet dump
Fast Packet Processing
DPDK based I/O, support L2-L4, VXLAN, ERSPAN, ….
Service-Centric Network Monitor 3D Network Visualizer
Network Analyzer
Network Probe Network Packet Broker Packet Capture Appliance
X86
Commodity
Servers
7. T-CAP is a converged network appliance,
which integrates high performance Xeon server with data center switch
T-CAP: SKT-Converged Appliance Platform
8. Developed by using open source and open hardware
TiNA & T-CAP Development
9. TiNA Overview
TiNA consists of 6 systems in which each system can be deployed as a standalone
appliance or systems can be bundled together according to the use-case.
§ Network Packet Broker
ü Brokering network traffic from multiple mirror or taps according to the demand of multiple monitoring devices
§ Network Probe
ü Supporting network and traffic monitoring protocol such as SNMP and sFlow
§ Network Analyzer
ü Packet-level: Aggregates packets into flows and measures various TCP statistics
ü Flow-level: Tennant traffic classification, Top-N Conversations, E2E flow path calculation
§ Packet Capture & Analysis Appliance
ü High speed packet capture appliance supporting up to 40Gbps traffic
§ 3D-Based Network Visualizer
ü Supporting intuitive network monitoring and operation by efficiently visualizing complex network topology and traffic flow
§ Service Centric Network Monitor
ü Classifying tenant traffic and collecting various network traffic statistics of cloud data center
10. Flow-level network analyzer
§ support analyzing millions of information of nodes, links, and traffic flows by using spark streaming engine
Packet-level network analyzer
§ TCP connection analyzer support up to 1million TCP flows
§ Packet into Flow Aggregation : support up to 200K new flow arrivals per second
Network Packet Broker
§ Virtual and physical NPB, vNPB supports 40Gbps packet filtering & forwarding performance
Packet Capture Appliance
§ 40Gbps packet capture system with 24 HDDs
Low Cost
§ implemented on x86 commodity hardware by leveraging DPDK fast packet processing framework
TiNA Specifications
12. Connection Analyzer
Packet into Flow Aggregation
TCP Connection Analysis
Packet-Level
Network Analyzer
Network Probe
Packet-Level
Network Analyzer
Network Probe
NPB
NPB Controller
NPB Fabric
x86
vNPB
SNMP/sFlow Collector
Packet into Flow Aggregation
TCP Connection Analysis
SNMP/sFlow Collector
Virtual network packet broker
OpenFlow based packet
broker
T-CAP
T-CAP
Commodity Server
Packet-Flow Analysis with T-CAP
13. TCP Connection Performance Analysis
§ TCP Connection Setup Time, Connection per Sec, SYN/FIN Count, Retransmission
Rate, Zero Window, App Response Time
§ Determine whether the network problem is the application or the network
Packet-Level Network Analyzer:
Connection Analyzer
15. Network
Interface
Network
Interface
PMD
PMD
Writer
Writer
Writer
Writer
High Speed Packet Capture and Retrieval System
§ Essential tool for troubleshooting and network forensics
§ Pipelined parallel packet processing based on DPDK
§ Support both packet and flow-based capture
Specifications
§ 20 cores (Intel Xeon CPU E5-2650 v3 @ 2.30 GHz, 2ea)
§ 128 GB RAM (DDR4 16 GB DIMM 2,133 MHz, 8ea)
§ 192 TB HDD (SATA 6 Gb/s 3.5” 7.2K RPM 8 TB ENT HDD, 24ea)
§ Support 40Gbps line rate packet capture to disk
§ With 192 TB storage
• 40 Gbps * 11 hour
• 10 Gbps * 43 hour
• 1 Gbps * 427 hour
Packet Capture Appliance
16. Elephant Flows
SONA: Simplified Overlay Network Architecture presented in ONS ‘16
§ Consolidated physical/virtual network based on real-time flow stats
§ L3-based leaf-spine networking to maximize link utilization
OpenStack
Neutron
SONA
Compute Nodes G/W Nodes Physical Switches
SONA Fabric
Packet-Level
Network Analyzer
Use-Case: Traffic Engineering
with TiNA and SONA
18. Cloud Data Center Multi-Tenancy
Spine
Leaf
...
VM VM VM
VM VM VM
VM VM
VM VM
VM
VM
VM VM VM
VM VM VM
Baremetal
Baremetal
Tenant A Tenant B Tenant C Tenant D
§ Cloud needs to be managed and
monitored based on application
§ Per-tenant traffic monitoring for SLA
management and pricing
§ Classifying tenant traffic based on IP
flow, VLAN, VXLAN
Service-Centric Network Monitor
§ Service traffic statistics monitoring per-tenant
§ Per service/host/flow traffic statistics, Top-N conversations
19. Flow Analysis and Network Monitor
Packet Mirror
/ sFlow
Service-Centric
Network Monitor
Aggregating packets into flows
JSON format conversion
Flow-Level
Network Analyzer
Classifying flows into tenants
Flow path discovery
Flow deduplication
Register tenants and hosts
Monitor tenant traffic
TiNA Multi-Tenant Traffic Monitoring & 3D-Based Network Visualization System
3D
Network
Visualizer
Visualize network topology
Device, link, traffic stats
Flow path between hosts
Packet-Level
Network Analyzer
20. Visualizing real-time network analysis results
§ Collect and analyze millions of information of nodes, links,
and traffic flows by using spark streaming engine
§ Diagnose network events with game animation within a few
seconds
§ End-to-end traffic flow path visualization
3D UI/UX
§ Display physical/logical/virtual network topology efficiently
§ Drill down from a global datacenter to a traffic flow in one
second
§ Support Android, Windows Client
Efficiently visualize multi-layer network topology
providing intuitive and interactive user interface
TiNA 3D-Based Network Monitor
23. DU
Pool
AS
AR(PE)
AR : Aggregation Router
AS : Access Switch
CO : Central Office
CO
PE PE SGW PGW
MME HSS
EPC Core )
IP Backhaul
AS
IP/MPLS Backhaul
Packet Capture
NPB
Network Analyzer
3D/WEB UI
Packet Capture
NPB
Network Analyzer
3D/WEB UI
EPC Core
3rd party monitoring tool
NAT
IMS
Internet
GTP-U
MirrorTap
60Gbps
3rd party monitoring tool
§ Subscriber and tunnel end-point based packet filtering
§ VoLTE Traffic Analysis: throughputs, packet loss, jitter, latency
§ H/W NPB Time-stamping by T-CAP S/W silicon
§ GTP Correlation
LTE Network Monitoring
and Troubleshooting
24. T-CAP is a converged network appliance,
which integrates high performance Xeon server with data center switch
T-CAP: SKT-Converged Appliance Platform
27. T-CAP Hardware Specification
§ Dual Intel Xeon E5-2600 v3 CPU (Haswell)
§ Up to 512GB memory
§ 4X 2.5` SATA SSD
§ 1+1 Redundant PSU (Power Supply Unit)
§ Front Loading Switch Port Module
ü 10G 12 Port
ü 10G 4 Port + 40G 2 Port
http://files.opencompute.org/oc/public.php?service=files&t=6a542c4983c8180f5c6f6e7da198e60a
28. T-CAP Software Stack
Linux Kernel
fm10k
SFP/QSFP+ LED PWD Sensors
i2c
fm10kDevice
Networking Stack
QuaggaOVS
Linux
Bridge
3rd
Party
Net Device
Unified Network Config. Data Model & API (e.g., OpenConfig)
T-O&M
SKT’s Op. & Mgmt. Tool
SONA Fabric
SKT’s NW Fabric Auto. Tool
Platform
Manager
Legend
FOSS
SKT
maintained
Intel
proprietary
SKT
projects
SwitchD
IES SDK
29. Real deployment requirements for a single cluster
§ Performance for packet filtering and actions
ü~ # of policy rules
ü~ # of vantage points
§ Low Latency ~ 400ns
T-CAP Software Stack
for Hardware Network Packet Broker
Aggregated Mirrored Traffic
NPB OF Controller
Feature
Required
Description
Packet
Filtering
L2 Filter(src/dst mac, ip, vlan id, eth type …), L3 Filter(src/dst ip, ip protocol
ToS …), L4 Filter (src/dst Port, VNI)
Action Forwarding, Aggregation, Replication, Load Balancing, Drop
Source Port
Labeling
Tagging source port number in packet headers
Header
Stripping
Strip unnecessary packet headers to analyze traffic such as VLAN
Tagging/VXLAN,MPLS
Packet
Slicing
Trim packets
HW
Timestamp
Time synchronization between analysis server farms and NPB H/Ws through
PTP
Tunneling Transfer to remote branch
RRC based
L1~L4 Filtering and
Forwarding w/ OpenFlow
OpenFlow
30. Build and Package Management From
Kernel to Applications
Yocto Project (DIY/Roll-Your-Own Linux Distro.)
CPP board
(Intel x86)
ONIE image
31. SKT T-CAP Test Lab
Mininet extension to support feature
validation test for physical switches
§ Scalability test for control-plane protocols
support on multiple physical hosts or cloud
§ Reusable test scenario regardless of vendors
§ Interop test between multiple NOS vendors by
plugins implemented
Host1 Host2
Mininet
Other NOS
Plugins
SKT NOS
Plugin
Wrapper Module
TCAP NOS
TCAP + OcN
OS
SW2
L2
Test
Scripts
L3
Test
Scripts
Other
Test
Scripts
…
32. Work Flow for NetDevOps
OpenSource
ori repo
SKT
repo
1. branch & sync
Local Devs
2. clone
Code Review
3. push
4. merge
Jenkins
5. build
Test Framework
6. test pass or fail
7. notification if failed
6. code quality check
SonarQube
NEXUS
8. release if pass
Production
Site
9. update noti.
&
package update
33. WAN
End-to-end Network Orchestration
Local NFV Orchestrator Transport Infra Orchestrator
Unified-O
Edge DC Central DC
Open & Programmable H/W
Resource Abstraction Layer
Open & Programmable H/W
Virtualized Network Functions
Fronthaul
L1/L2
RF
Remote Unit
4G
5G
SDRAN
RNF ESF
vCore
CNF CSF OSF
Transport Infrastructure
Transport
Open H/W
POTN
Network Service Functions
TNF
uCTN
Mobile Connectivity Functions
uCTN
Service Orchestration and Exposure
Low Latency Service
Immersive Media
Telco Service
Virtualized Network Slice #1
#2
#N
NG-OSS
(E2EResourceMgmt.,Cognitive&IntelligentAutomation)
SKT New Infra Architecture for 5G and Beyond
COSMOS – All-IT Undelay Architecture