Automated Management using SDN/NFV
DevNet 1114
Casimer DeCusatis, Ph.D., Assistant Professor, Marist College
@Dr_Casimer casimer.decusatis@marist.edu
• How can we use SDN/NFV to create automated,
dynamically provisioned networks within and
between cloud data centers ?
• Results from the New York State Center for Cloud
Computing & Analytics (CCAC) Open SDN Test Bed
Agenda - Automation
The New York State Cloud Computing & Analytics Center
at Marist College, Poughkeepsie, NY
Cisco white paper, “Simplify and Automate for Enhanced Service Agility”
5
An Unsustainable Operations Model
Fixed Wavelengths Are Under-utilized
Uniform node-to-node traffic
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
00:00
01:00
02:00
03:00
04:00
05:00
06:00
07:00
08:00
09:00
10:00
11:00
12:00
13:00
14:00
15:00
16:00
17:00
18:00
19:00
20:00
21:00
22:00
23:00
NetworkUtilization
Time
base
traffic
excess
traffic
Currently, enterprises must contract for over-provisioned fixed
capacity to meet the multi-gigabit peaks, which results in costly,
underutilized capacity during sustained quiescent periods
N node ring
7
Application Aware Network Orchestration
Daytime Config:
Workload balanced across sites Nighttime Config:
Backup jobs between selected sites
Disaster Alert !
Emergency Recovery between sites
C. DeCusatis, T. Bundy, R. Cannistra, “Dynamic software-defined networking (SDN) testbed”,
Proc. 2013 Internet2 Annual Meeting, Arlington, VA (April 2013)
Use Case: Never Enough Static Bandwidth
Hypervisor
Platforms
Policy Management API
Cloud Orchestration
Load
Balancing
Firewall
IDS/IPS
Other
Application
Security &
Authentication
Congress
Content
Delivery
Configuration
Cinder
drivers
Nova
Compute
drivers
storage
Storage
Servers
drivers
Network
Neutron
Virtual
Overlay
Control Plane
Physical
Flow Control
Plane
Storage
Virtualization
Platforms
Network
Zone 1
Forwarding
Layer
Application
Managem
entLayer
Services
Managem
entLayer
Adaptation
Layer
Network
Zone 2
Virtual
Overlay
Control Plane
Physical
Flow Control
Plane
Zone Controller
SDN VE
Storage
VM Cluster
IBM V7000
Storage
single 10G
IBM G8264
OF Switch
SDN
Controller (VM)
ADVA Network
Hypervisor (VM)
Site A
IBM G8264
OF Switch
ADVA XG210
Storage
dual 10G
IBM G8264
OF Switch
Site C Storage
dual 10G
IBM G8264
OF Switch
Site B
ADVA XG210
CCM-40-8
2-14
8ROADM
2-10
8ROADM
2-3
8ROADM
2-6
2WCA
2WCA
2WCA
CCM-40-8
2-14
8ROADM
2-10
8ROADM
2-3
8ROADM
2-6
2WCA
2WCA
2WCA
CCM-40-8
2-14
8ROADM
2-10
8ROADM
2-3
8ROADM
2-6
2WCA
2WCA
2WCA
ADVA XG210
ADVA FSP 3000
NMS
single 10G
DCN
Link Utilization Monitor, Traffic Generator, PRO-NID VM (NFV)
SDN Network Automation Configuration
Demo – Automation using REST
APIs with Open Daylight
Service Provider Business Transformation
Automated
Management
Orchestration
Policy
Applications
Physical &
Virtual
Infrastructure
Evolved Services Platform (ESP)
Service Broker
Catalog of Physical
& Virtual Functions
Service
Profiles
Evolved Programmable Network (EPN)
VNFs with network compute, storage
Orchestration
Engine
Mobility Enterprise Consumer Video
Service Provider Business Transformation
Automated
Management
Orchestration
Policy
Applications
Physical &
Virtual
Infrastructure
Evolved Services Platform (ESP)
Service Broker
Catalog of Physical
& Virtual Functions
Service
Profiles
Evolved Programmable Network (EPN)
VNFs with network compute, storage
Orchestration
Engine
Mobility Enterprise Consumer Video
APIC, VTSAPIC-EM ML-SDN, WAE,
EPNM
Network Service Orchestrator
Telefonica – A Multi-Layer, Mulit-Domain SDN
Network Control Architecture
Optimization Visibility
Multi-Layer App Platform (MAP)
Orchestrator
ML Controller ControllerController
HuaweiCienaInfineraCisco
Spain
What-If analysis
USA
China
Multi-layer, multi-domain SDN with Telefonica
Juan Pedro Frenandez-Palacios, OFC 2015
Job Roles Are Shifting for the Network Practitioner
17
Do LESS of… Do MORE of…
• Device configurations
• Continuous operations
• Problem resolution
• Hardware deployments
• Monitoring and reporting
• CLI entries and scripting
• Hands-on repairs/deployments
• Reactive management tasks
• Business/IT innovation
• Architectural (End-to-End) design
• Network analytics & optimization
• Programming – API versus CLI
• Software administration
• Comprehensive policy mgmt
• Systems Integration/validation
• Proactive management tasks
• Details of the migration
methods used in some
commercial products are not
readily available
• Typical values:
– Minimum 1028 MB per VM
– 4 KB per memory page
– Sustainable 1 Gbps
• Migration algorithms can be
highly nonlinear; application
awareness is key
Predictive Analytics Driving SDN
Page Dirty Rate (pages/second)
VMmigrationtime(seconds)
Security Intelligence
Real-time Processing
• Real-time data correlation
• Anomaly detection
• Event and flow normalization
• Security context & enrichment
• Distributed architecture
Security Operations
• Pre-defined rules and reports
• Offense scoring & prioritization
• Activity and event graphing
• Compliance reporting
• Workflow management
Big Data Warehouse
• Long-term, multi storage
• Unstructured and structured
• Distributed infrastructure
• Preservation of raw data
• Hadoop-based backend
Big Data
Analytics and Forensics
• Advanced visuals and interaction
• Predictive & decision modeling
• Ad hoc queries
• Spreadsheet UI for analysts
• Collaborative sharing tools
• Pluggable UI
Security
Intelligence
with
Big Data
Creative,
exploratory,
intuitive
Structured,
analytical,
repeatable
• Dynamic, Automated Provisioning
• 1 minute vs days or weeks, without manual intervention
• Multi-Layer (IP and Optical) using Open Daylight
• Potential response to cloud bursts & other real time events
• Bbandwidth monitoring for QoS
• Enabling next generation functions
• Analytics for Load Balancing, Security, OPNFV
Key Results
Thank you
Follow @Dr_Casimer
or http://www.ofcconference.org/en-us/home/about/ofc-blog/
• C. DeCusatis, J. Ziskin, T. Bundy, “The rise of SDN optical networks; has automated provisioning arrived?“, invited
presentation, Pacific Telecom Conference, Honolulu, Hawaii (January 2014)
• C. DeCusatis, R. Cannistra, B. Carle, M. Johnson, J. Kapadia, Z. Meath, M. Miller, D. Young, T. Bundy , G. Zussman,
K. Bergman, A. Carranza, C. Sher-DeCusatis, A. Pletch, R. Ransom, “Dynamic orchestration test bed for SDN and
NFV at the New York State Center for Cloud Computing & Analytics”, OFC 2014 annual meeting, San Francisco, CA
(accepted & to be published, March 2014)
• C. DeCusatis et.al., “Developing a software defined networking curriculum through industry partnership”, Proc. ASEE
Annual Meeting, Hartford, CT (April 3-5, 2014) ** named among top 10 conference papers ** http://asee-
ne.org/proceedings/2014/index.htm
• Internet2 Global Summit, April 6-10, 2014, Denver, Colorado
http://meetings.internet2.edu/2014-global-summit/detail/10003109/
• C. DeCusatis, “SDN, NFV, and the cloud disruption: the next generation open data center interoperable network
(ODIN)”, BrightTalk webinar, April 17, 2014 https://www.brighttalk.com/search?q=DeCusatis
• C. DeCusatis, R. Cannistra, T. Bundy, “Software Defined Environments and Next Generation Networks: a tutorial”,
Proc. Keystone Initiative for Network Based Education and Research (KINBER) 2014 annual meeting (an Internet2
affiliate), Harrisburg, PA, April 23-25, 2014
• C. DeCusatis and L. Miano, “Cloud computing and software defined environments”, Pace University college of
computer science and engineering seminar series, April 30, 2014
• C. DeCusatis and R. Cannistra, “Dynamic management and provisioning of software defined cloud data centers”, Proc.
NSF Enterprise Computing Conference (ECC), paper SC3101, June 8-10, Marist College, Poughkeepsie, NY (2014)
Recent Research Publications from the Marist CCAC

DEVNET-1114 Automated Management Using SDN/NFV

  • 2.
    Automated Management usingSDN/NFV DevNet 1114 Casimer DeCusatis, Ph.D., Assistant Professor, Marist College @Dr_Casimer casimer.decusatis@marist.edu
  • 3.
    • How canwe use SDN/NFV to create automated, dynamically provisioned networks within and between cloud data centers ? • Results from the New York State Center for Cloud Computing & Analytics (CCAC) Open SDN Test Bed Agenda - Automation
  • 4.
    The New YorkState Cloud Computing & Analytics Center at Marist College, Poughkeepsie, NY
  • 5.
    Cisco white paper,“Simplify and Automate for Enhanced Service Agility” 5 An Unsustainable Operations Model
  • 6.
    Fixed Wavelengths AreUnder-utilized Uniform node-to-node traffic 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% 00:00 01:00 02:00 03:00 04:00 05:00 06:00 07:00 08:00 09:00 10:00 11:00 12:00 13:00 14:00 15:00 16:00 17:00 18:00 19:00 20:00 21:00 22:00 23:00 NetworkUtilization Time base traffic excess traffic Currently, enterprises must contract for over-provisioned fixed capacity to meet the multi-gigabit peaks, which results in costly, underutilized capacity during sustained quiescent periods N node ring
  • 7.
    7 Application Aware NetworkOrchestration Daytime Config: Workload balanced across sites Nighttime Config: Backup jobs between selected sites Disaster Alert ! Emergency Recovery between sites C. DeCusatis, T. Bundy, R. Cannistra, “Dynamic software-defined networking (SDN) testbed”, Proc. 2013 Internet2 Annual Meeting, Arlington, VA (April 2013)
  • 8.
    Use Case: NeverEnough Static Bandwidth
  • 9.
    Hypervisor Platforms Policy Management API CloudOrchestration Load Balancing Firewall IDS/IPS Other Application Security & Authentication Congress Content Delivery Configuration Cinder drivers Nova Compute drivers storage Storage Servers drivers Network Neutron Virtual Overlay Control Plane Physical Flow Control Plane Storage Virtualization Platforms Network Zone 1 Forwarding Layer Application Managem entLayer Services Managem entLayer Adaptation Layer Network Zone 2 Virtual Overlay Control Plane Physical Flow Control Plane Zone Controller SDN VE
  • 10.
    Storage VM Cluster IBM V7000 Storage single10G IBM G8264 OF Switch SDN Controller (VM) ADVA Network Hypervisor (VM) Site A IBM G8264 OF Switch ADVA XG210 Storage dual 10G IBM G8264 OF Switch Site C Storage dual 10G IBM G8264 OF Switch Site B ADVA XG210 CCM-40-8 2-14 8ROADM 2-10 8ROADM 2-3 8ROADM 2-6 2WCA 2WCA 2WCA CCM-40-8 2-14 8ROADM 2-10 8ROADM 2-3 8ROADM 2-6 2WCA 2WCA 2WCA CCM-40-8 2-14 8ROADM 2-10 8ROADM 2-3 8ROADM 2-6 2WCA 2WCA 2WCA ADVA XG210 ADVA FSP 3000 NMS single 10G DCN Link Utilization Monitor, Traffic Generator, PRO-NID VM (NFV) SDN Network Automation Configuration
  • 11.
    Demo – Automationusing REST APIs with Open Daylight
  • 12.
    Service Provider BusinessTransformation Automated Management Orchestration Policy Applications Physical & Virtual Infrastructure Evolved Services Platform (ESP) Service Broker Catalog of Physical & Virtual Functions Service Profiles Evolved Programmable Network (EPN) VNFs with network compute, storage Orchestration Engine Mobility Enterprise Consumer Video
  • 13.
    Service Provider BusinessTransformation Automated Management Orchestration Policy Applications Physical & Virtual Infrastructure Evolved Services Platform (ESP) Service Broker Catalog of Physical & Virtual Functions Service Profiles Evolved Programmable Network (EPN) VNFs with network compute, storage Orchestration Engine Mobility Enterprise Consumer Video APIC, VTSAPIC-EM ML-SDN, WAE, EPNM Network Service Orchestrator
  • 16.
    Telefonica – AMulti-Layer, Mulit-Domain SDN Network Control Architecture Optimization Visibility Multi-Layer App Platform (MAP) Orchestrator ML Controller ControllerController HuaweiCienaInfineraCisco Spain What-If analysis USA China Multi-layer, multi-domain SDN with Telefonica Juan Pedro Frenandez-Palacios, OFC 2015
  • 17.
    Job Roles AreShifting for the Network Practitioner 17 Do LESS of… Do MORE of… • Device configurations • Continuous operations • Problem resolution • Hardware deployments • Monitoring and reporting • CLI entries and scripting • Hands-on repairs/deployments • Reactive management tasks • Business/IT innovation • Architectural (End-to-End) design • Network analytics & optimization • Programming – API versus CLI • Software administration • Comprehensive policy mgmt • Systems Integration/validation • Proactive management tasks
  • 18.
    • Details ofthe migration methods used in some commercial products are not readily available • Typical values: – Minimum 1028 MB per VM – 4 KB per memory page – Sustainable 1 Gbps • Migration algorithms can be highly nonlinear; application awareness is key Predictive Analytics Driving SDN Page Dirty Rate (pages/second) VMmigrationtime(seconds)
  • 19.
    Security Intelligence Real-time Processing •Real-time data correlation • Anomaly detection • Event and flow normalization • Security context & enrichment • Distributed architecture Security Operations • Pre-defined rules and reports • Offense scoring & prioritization • Activity and event graphing • Compliance reporting • Workflow management Big Data Warehouse • Long-term, multi storage • Unstructured and structured • Distributed infrastructure • Preservation of raw data • Hadoop-based backend Big Data Analytics and Forensics • Advanced visuals and interaction • Predictive & decision modeling • Ad hoc queries • Spreadsheet UI for analysts • Collaborative sharing tools • Pluggable UI Security Intelligence with Big Data Creative, exploratory, intuitive Structured, analytical, repeatable
  • 20.
    • Dynamic, AutomatedProvisioning • 1 minute vs days or weeks, without manual intervention • Multi-Layer (IP and Optical) using Open Daylight • Potential response to cloud bursts & other real time events • Bbandwidth monitoring for QoS • Enabling next generation functions • Analytics for Load Balancing, Security, OPNFV Key Results
  • 21.
    Thank you Follow @Dr_Casimer orhttp://www.ofcconference.org/en-us/home/about/ofc-blog/
  • 22.
    • C. DeCusatis,J. Ziskin, T. Bundy, “The rise of SDN optical networks; has automated provisioning arrived?“, invited presentation, Pacific Telecom Conference, Honolulu, Hawaii (January 2014) • C. DeCusatis, R. Cannistra, B. Carle, M. Johnson, J. Kapadia, Z. Meath, M. Miller, D. Young, T. Bundy , G. Zussman, K. Bergman, A. Carranza, C. Sher-DeCusatis, A. Pletch, R. Ransom, “Dynamic orchestration test bed for SDN and NFV at the New York State Center for Cloud Computing & Analytics”, OFC 2014 annual meeting, San Francisco, CA (accepted & to be published, March 2014) • C. DeCusatis et.al., “Developing a software defined networking curriculum through industry partnership”, Proc. ASEE Annual Meeting, Hartford, CT (April 3-5, 2014) ** named among top 10 conference papers ** http://asee- ne.org/proceedings/2014/index.htm • Internet2 Global Summit, April 6-10, 2014, Denver, Colorado http://meetings.internet2.edu/2014-global-summit/detail/10003109/ • C. DeCusatis, “SDN, NFV, and the cloud disruption: the next generation open data center interoperable network (ODIN)”, BrightTalk webinar, April 17, 2014 https://www.brighttalk.com/search?q=DeCusatis • C. DeCusatis, R. Cannistra, T. Bundy, “Software Defined Environments and Next Generation Networks: a tutorial”, Proc. Keystone Initiative for Network Based Education and Research (KINBER) 2014 annual meeting (an Internet2 affiliate), Harrisburg, PA, April 23-25, 2014 • C. DeCusatis and L. Miano, “Cloud computing and software defined environments”, Pace University college of computer science and engineering seminar series, April 30, 2014 • C. DeCusatis and R. Cannistra, “Dynamic management and provisioning of software defined cloud data centers”, Proc. NSF Enterprise Computing Conference (ECC), paper SC3101, June 8-10, Marist College, Poughkeepsie, NY (2014) Recent Research Publications from the Marist CCAC

Editor's Notes

  • #3 Former IBM DE, 24 years industry experience
  • #5 History of Marist: Marist Poll & NCAA Women Bball, founded 1905 (national historic landmarks), privatizes 60 years ago, 6000 undergrads, 1000 grads, Forbes top schools for high value education
  • #7 Todd
  • #9 Storage Bursts create the need for 45% growth in bandwidth costs per year. customers will need a better solution for storage back-up. Next Slide: Lets look at the different solutions for sync mirroring
  • #13 REST APIs to third party application ecosystems Configuration (modeled with NSO/Tail-F) Netconf/YANG Service models, Device models, Service to Device Mapping Extensble, Multi-Vendor Intelligence (powered by WAE) Path Computation and Optimization, Failure Analysis Restoration, Planning IP and Optical MPLS, BGP, Segment Routing (Open SDN, ODL Compliant) Physical (DWDM) or Virtual Infrastructure Cisco hybrid architecture (map to my slide of Marist stack) Application layer – Cisco or 3rd party SW apps Orchestration between domain controllers Unified ML control, vendor and layer agnostic Ip, OTN, DWDM elements
  • #14 REST APIs to third party application ecosystems Configuration (modeled with NSO/Tail-F) Tail f manages/orchestrates multi-vendor environments fix OSS Netconf/YANG Service models, Device models, Service to Device Mapping Extensble, Multi-Vendor Intelligence (powered by WAE) Path Computation and Optimization, Failure Analysis Restoration, Planning IP and Optical MPLS, BGP, Segment Routing (Open SDN, ODL Compliant) Physical (DWDM) or Virtual Infrastructure