DWDM-RAM is an architecture designed to meet the networking challenges of extremely large scale Grid applications by providing dynamic optical networking capabilities. It includes data management services, intelligent middleware, and dynamic lightpath provisioning services using state-of-the-art photonic technologies. These capabilities are being demonstrated on OMNInet, a wide-area photonic testbed, to enable high-performance data transfers for applications through on-demand lightpaths.
An Architecture for Data Intensive Service Enabled by Next Generation Optical...Tal Lavian Ph.D.
DWDM-RAM - An architecture for data intensive Grids enabled by next generation dynamic optical networks, incorporating new methods for lightpath provisioning.
DWDM-RAM: An architecture designed to meet the
networking challenges of extremely large scale Grid applications.
Traditional network infrastructure cannot meet these demands,
especially, requirements for intensive data flows
DWDM-RAM Components Include:
Data management services
Intelligent middleware
Dynamic lightpath provisioning
State-of-the-art photonic technologies
Wide-area photonic testbed implementation
Grid optical network service architecture for data intensive applicationsTal Lavian Ph.D.
Integrated SW System Provide the “Glue”
Dynamic optical network as a fundamental Grid service in data-intensive Grid application, to be scheduled, to be managed and coordinated to support collaborative operations
From Super-computer to Super-network
In the past, computer processors were the fastest part
peripheral bottlenecks
In the future optical networks will be the fastest part
Computer, processor, storage, visualization, and instrumentation - slower "peripherals”
eScience Cyber-infrastructure focuses on computation, storage, data, analysis, Work Flow.
The network is vital for better eScience
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...Tal Lavian Ph.D.
Dynamic High-Performance Networks :
Support data-intensive Grid applications
Gives adequate and uncontested bandwidth to an application’s burst
Employs circuit-switching of large flows of data to avoid overheads in breaking flows into small packets and delays routing
Is capable of automatic end-to-end path provisioning
Is capable of automatic wavelength switching
Provides a set of protocols for managing dynamically provisioned wavelengths
DWDM-RAM :
Encapsulates “optical network resources” into a service framework to support dynamically provisioned and advanced data-intensive transport services
Offers network resources as Grid services for Grid computing
Allows cooperation of distributed resources
Provides a generalized framework for high performance applications over next generation networks, not necessary optical end-to-end
Yields good overall utilization of network resources
Network-aware Data Management for Large Scale Distributed Applications, IBM R...balmanme
IBM Research – Talk – June 24, 2015
Title:
Network-aware Data Management for Large Scale Distributed Applications
Abstract:
As current technology enables faster storage devices and larger interconnect bandwidth, there is a substantial need for novel system design and middleware architecture to address increasing latency, scalability, and throughput requirements. In this talk, I will outline network-aware data management and present solutions based on my past experience in large-scale data migration between remote repositories.
I will first describe my experience in the initial evaluation of 100Gbps network as a part of the Advance Network Initiative project. We needed intense fine-tuning in network, storage, and application layers, to take advantage of the higher network capacity. End-system bottlenecks and system performance play an important role especially in many-core platforms. I will introduce a special data movement prototype, successfully tested in one of the first 100Gbps demonstrations, in which applications map memory blocks for remote data, in contrast to the send/receive semantics. This prototype was used to stream climate data over wide-area for in-memory application processing and visualization.
Within this scope, I will introduce a flexible network reservation algorithm for on-demand bandwidth guaranteed virtual circuit services. Flexible reservations find best path in a time-dependent dynamic network topology to support predictable application performance. I will then present a data-scheduling model with advance provisioning, in which data movement operations are defined with earliest start and latest completion times.
I will conclude my talk with a very brief overview of my other related projects on performance engineering, hyper-converged virtual storage, and optimization in control and data path for virtualized environments.
PACK: Prediction-Based Cloud Bandwidth and Cost Reduction System
To get this project in ONLINE or through TRAINING Sessions, Contact:JP INFOTECH, Old No.31, New No.86, 1st Floor, 1st Avenue, Ashok Pillar, Chennai -83.
Landmark: Next to Kotak Mahendra Bank.
Pondicherry Office: JP INFOTECH, #45, Kamaraj Salai, Thattanchavady, Puducherry -9.
Landmark: Next to VVP Nagar Arch.
Mobile: (0) 9952649690 , Email: jpinfotechprojects@gmail.com, web: www.jpinfotech.org
Blog: www.jpinfotech.blogspot.com
Network is an integral part to Grids
Network resources guarantee Grid resource sharing
Networks resource allocation needed to effectively enable distributed virtual organizations (VOs)
Networks are heterogeneous in nature
Different kinds of devices and vendors
Domain-specific clouds in separate administrative domains
Unknown number of network layers and elements in a p2p connection
Networks have their own standards and evolution curve, not necessarily grid savvy
Standards and architectures defined in IEEE, IETF, ITU and others
Data plane, control plane, and management plane protocols
Network services provided for management and control
An Architecture for Data Intensive Service Enabled by Next Generation Optical...Tal Lavian Ph.D.
DWDM-RAM - An architecture for data intensive Grids enabled by next generation dynamic optical networks, incorporating new methods for lightpath provisioning.
DWDM-RAM: An architecture designed to meet the
networking challenges of extremely large scale Grid applications.
Traditional network infrastructure cannot meet these demands,
especially, requirements for intensive data flows
DWDM-RAM Components Include:
Data management services
Intelligent middleware
Dynamic lightpath provisioning
State-of-the-art photonic technologies
Wide-area photonic testbed implementation
Grid optical network service architecture for data intensive applicationsTal Lavian Ph.D.
Integrated SW System Provide the “Glue”
Dynamic optical network as a fundamental Grid service in data-intensive Grid application, to be scheduled, to be managed and coordinated to support collaborative operations
From Super-computer to Super-network
In the past, computer processors were the fastest part
peripheral bottlenecks
In the future optical networks will be the fastest part
Computer, processor, storage, visualization, and instrumentation - slower "peripherals”
eScience Cyber-infrastructure focuses on computation, storage, data, analysis, Work Flow.
The network is vital for better eScience
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...Tal Lavian Ph.D.
Dynamic High-Performance Networks :
Support data-intensive Grid applications
Gives adequate and uncontested bandwidth to an application’s burst
Employs circuit-switching of large flows of data to avoid overheads in breaking flows into small packets and delays routing
Is capable of automatic end-to-end path provisioning
Is capable of automatic wavelength switching
Provides a set of protocols for managing dynamically provisioned wavelengths
DWDM-RAM :
Encapsulates “optical network resources” into a service framework to support dynamically provisioned and advanced data-intensive transport services
Offers network resources as Grid services for Grid computing
Allows cooperation of distributed resources
Provides a generalized framework for high performance applications over next generation networks, not necessary optical end-to-end
Yields good overall utilization of network resources
Network-aware Data Management for Large Scale Distributed Applications, IBM R...balmanme
IBM Research – Talk – June 24, 2015
Title:
Network-aware Data Management for Large Scale Distributed Applications
Abstract:
As current technology enables faster storage devices and larger interconnect bandwidth, there is a substantial need for novel system design and middleware architecture to address increasing latency, scalability, and throughput requirements. In this talk, I will outline network-aware data management and present solutions based on my past experience in large-scale data migration between remote repositories.
I will first describe my experience in the initial evaluation of 100Gbps network as a part of the Advance Network Initiative project. We needed intense fine-tuning in network, storage, and application layers, to take advantage of the higher network capacity. End-system bottlenecks and system performance play an important role especially in many-core platforms. I will introduce a special data movement prototype, successfully tested in one of the first 100Gbps demonstrations, in which applications map memory blocks for remote data, in contrast to the send/receive semantics. This prototype was used to stream climate data over wide-area for in-memory application processing and visualization.
Within this scope, I will introduce a flexible network reservation algorithm for on-demand bandwidth guaranteed virtual circuit services. Flexible reservations find best path in a time-dependent dynamic network topology to support predictable application performance. I will then present a data-scheduling model with advance provisioning, in which data movement operations are defined with earliest start and latest completion times.
I will conclude my talk with a very brief overview of my other related projects on performance engineering, hyper-converged virtual storage, and optimization in control and data path for virtualized environments.
PACK: Prediction-Based Cloud Bandwidth and Cost Reduction System
To get this project in ONLINE or through TRAINING Sessions, Contact:JP INFOTECH, Old No.31, New No.86, 1st Floor, 1st Avenue, Ashok Pillar, Chennai -83.
Landmark: Next to Kotak Mahendra Bank.
Pondicherry Office: JP INFOTECH, #45, Kamaraj Salai, Thattanchavady, Puducherry -9.
Landmark: Next to VVP Nagar Arch.
Mobile: (0) 9952649690 , Email: jpinfotechprojects@gmail.com, web: www.jpinfotech.org
Blog: www.jpinfotech.blogspot.com
Network is an integral part to Grids
Network resources guarantee Grid resource sharing
Networks resource allocation needed to effectively enable distributed virtual organizations (VOs)
Networks are heterogeneous in nature
Different kinds of devices and vendors
Domain-specific clouds in separate administrative domains
Unknown number of network layers and elements in a p2p connection
Networks have their own standards and evolution curve, not necessarily grid savvy
Standards and architectures defined in IEEE, IETF, ITU and others
Data plane, control plane, and management plane protocols
Network services provided for management and control
Multi port network ethernet performance improvement techniquesIJARIIT
An Ethernet has its own importance and space in network subsystem. In today’s resource-intensive engineering the
applications need to deal with the real-time data processing, server virtualization, and high-volume data transactions. The realtime
technologies such as video on demand and Voice over IP operations demand the network devices with efficient network
data processing as well as better networking bandwidth. The performance is the major issues with the multi-port network
devices. It requires the sufficient network bandwidth and CPU processing speed to process the real-time data at the context.
And this demand is goes on increasing. The new multi-port hardware technologies can help to improvements in the
performance of the virtualized server environments. But, these hardware technologies having their own limitations in terms of
CPU utilization levels and power consumption. It also impacts on latency and the overall system cost. This thesis will provide
the insights to some of the key configuration decisions at hardware as well as software designs in order to facilitate multi-port
network devices performance improvement over the existing infrastructure. This thesis will also discuss the solutions such as
Virtual LAN and balanced or symmetric network to reduce the cost and hardware dependency to improve the multi-port
network system performance significantly over the currently existing infrastructure. This performance improvement includes
CPU utilization and bandwidth in the heavy network loads.
Provisioning Bandwidth and Logical Circuits With Fiber ManagerSSP Innovations
Provisioning Bandwidth and Logical Circuits With Fiber Manager
Explore how Tri-State G&T is customizing Fiber Manager to manage the logical network in addition to the physical infrastructure. These customizations make it possible to manage bandwidth allocation as users traverse the physical facilities. The future of Fiber Manager may be closer than you think!
Active Network is a novel approach of networking to mobile users in which the nodes are programmed to perform custom operations on the messages that pass through the node. It provides an architectural support for dynamically deploying new protocols in an existing network topology. The routers in an active network can download and execute code that is contained in the packets passing through them, thus rendering the node recognized and run totally new protocols without making any changes to the architecture of the network. Because the network's behavior can be altered at any time, active networks could be used to provide dynamic quality of service (QoS) or to support dynamic solutions to traffic congestion. This research implements and tests such specialized Active Networks security service known as the firewall and the ping service in Active Network. Active Network environment will be implemented on a small scale test scenario in order to study the performance and characteristics of active networks
Cloud computing and Software defined networkingsaigandham1
This is my Graduate defense presentation. I have interest in various topics like cloud computing and software defined networking. This slides includes the research of various researchers on cloud computing and SDN, presented their work as my comprehensive exam.
Linac Coherent Light Source (LCLS) Data Transfer Requirementsinside-BigData.com
In this deck from the Stanford HPC Conference, Les Cottrell from the SLAC National Accelerator Laboratory, at Stanford University presents: Linac Coherent Light Source (LCLS) Data Transfer Requirements.
"Funded by the U.S. Department of Energy (DOE) the LCLS is the world’s first hard X-ray free-electron laser. Its strobe-like pulses are just a few millionths of a billionth of a second long, and a billion times brighter than previous X-ray sources. Scientists use LCLS to take crisp pictures of atomic motions, watch chemical reactions unfold, probe the properties of materials and explore fundamental processes in living things.
Its performance to date, over the first few years of operation, has already provided a breathtaking array of world-leading results, published in the most prestigious academic journals and has inspired other XFEL facilities to be commissioned around the world.
LCLS-II will build from the success of LCLS to ensure that the U.S. maintains a world-leading capability for advanced research in chemistry, materials, biology and energy. It is planned to see first light in 2020.
LCLS-II will provide a major jump in capability – moving from 120 pulses per second to 1 million pulses per second. This will enable researchers to perform experiments in a wide range of fields that are now impossible. The unique capabilities of LCLS-II will yield a host of discoveries to advance technology, new energy solutions and our quality of life.
Analysis of the data will require transporting huge amounts of data from SLAC to supercomputers at other sites to provide near real-time analysis results and feedback to the experiments.
The talk will introduce LCLS and LCLS-II with a short video, discuss its data reduction, collection, data transfer needs and current progress in meeting these needs."
Watch the video: https://youtu.be/LkwwGh7YdPI
Learn more: https://www6.slac.stanford.edu/
and
http://hpcadvisorycouncil.com
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
An ethernet based_approach_for_tm_data_analysis_v2Priyasloka Arya
Testing and performance evaluation of flight vehicles largely depends on the data gathered through telemetry. Tele-metered data describes the internal story of device under test. As the tele-metered data is transmitted to ground receiving stations through radio frequency and Inter Range Instrumentation Group (IRIG) standard data format are well known, anybody who is tuned to transmitted frequency, can receive data and minimal information about the format can reveal the total information of device under test. To deal with this situation, current trend is to encrypt the mission critical information on board before transmitting. In this paper, the authors have discussed the advantage of Local Area Network (LAN) based Telemetry base band system which provides scalability, modularity, and flexibility to the user for the analysis of encrypted data.
Enabling Active Flow Manipulation In Silicon-based Network Forwarding EnginesTal Lavian Ph.D.
Great Active Nets Community Solutions:
Active networks (AN) approach opens an exciting opportunity for individual applications to define the service provided by the network through programmability.
Active Networks technologies expose a novel approach that allows customer value-added services to be introduced to the network “on-the-fly”.
Active Nets program has produced a new network platform flexible and extensible at runtime to accommodate the rapid evolution and deployment of network technologies.
The exciting opportunity exists for network service providers and third parties, not just the network device providers, to program the network infrastructure and services.
Multi port network ethernet performance improvement techniquesIJARIIT
An Ethernet has its own importance and space in network subsystem. In today’s resource-intensive engineering the
applications need to deal with the real-time data processing, server virtualization, and high-volume data transactions. The realtime
technologies such as video on demand and Voice over IP operations demand the network devices with efficient network
data processing as well as better networking bandwidth. The performance is the major issues with the multi-port network
devices. It requires the sufficient network bandwidth and CPU processing speed to process the real-time data at the context.
And this demand is goes on increasing. The new multi-port hardware technologies can help to improvements in the
performance of the virtualized server environments. But, these hardware technologies having their own limitations in terms of
CPU utilization levels and power consumption. It also impacts on latency and the overall system cost. This thesis will provide
the insights to some of the key configuration decisions at hardware as well as software designs in order to facilitate multi-port
network devices performance improvement over the existing infrastructure. This thesis will also discuss the solutions such as
Virtual LAN and balanced or symmetric network to reduce the cost and hardware dependency to improve the multi-port
network system performance significantly over the currently existing infrastructure. This performance improvement includes
CPU utilization and bandwidth in the heavy network loads.
Provisioning Bandwidth and Logical Circuits With Fiber ManagerSSP Innovations
Provisioning Bandwidth and Logical Circuits With Fiber Manager
Explore how Tri-State G&T is customizing Fiber Manager to manage the logical network in addition to the physical infrastructure. These customizations make it possible to manage bandwidth allocation as users traverse the physical facilities. The future of Fiber Manager may be closer than you think!
Active Network is a novel approach of networking to mobile users in which the nodes are programmed to perform custom operations on the messages that pass through the node. It provides an architectural support for dynamically deploying new protocols in an existing network topology. The routers in an active network can download and execute code that is contained in the packets passing through them, thus rendering the node recognized and run totally new protocols without making any changes to the architecture of the network. Because the network's behavior can be altered at any time, active networks could be used to provide dynamic quality of service (QoS) or to support dynamic solutions to traffic congestion. This research implements and tests such specialized Active Networks security service known as the firewall and the ping service in Active Network. Active Network environment will be implemented on a small scale test scenario in order to study the performance and characteristics of active networks
Cloud computing and Software defined networkingsaigandham1
This is my Graduate defense presentation. I have interest in various topics like cloud computing and software defined networking. This slides includes the research of various researchers on cloud computing and SDN, presented their work as my comprehensive exam.
Linac Coherent Light Source (LCLS) Data Transfer Requirementsinside-BigData.com
In this deck from the Stanford HPC Conference, Les Cottrell from the SLAC National Accelerator Laboratory, at Stanford University presents: Linac Coherent Light Source (LCLS) Data Transfer Requirements.
"Funded by the U.S. Department of Energy (DOE) the LCLS is the world’s first hard X-ray free-electron laser. Its strobe-like pulses are just a few millionths of a billionth of a second long, and a billion times brighter than previous X-ray sources. Scientists use LCLS to take crisp pictures of atomic motions, watch chemical reactions unfold, probe the properties of materials and explore fundamental processes in living things.
Its performance to date, over the first few years of operation, has already provided a breathtaking array of world-leading results, published in the most prestigious academic journals and has inspired other XFEL facilities to be commissioned around the world.
LCLS-II will build from the success of LCLS to ensure that the U.S. maintains a world-leading capability for advanced research in chemistry, materials, biology and energy. It is planned to see first light in 2020.
LCLS-II will provide a major jump in capability – moving from 120 pulses per second to 1 million pulses per second. This will enable researchers to perform experiments in a wide range of fields that are now impossible. The unique capabilities of LCLS-II will yield a host of discoveries to advance technology, new energy solutions and our quality of life.
Analysis of the data will require transporting huge amounts of data from SLAC to supercomputers at other sites to provide near real-time analysis results and feedback to the experiments.
The talk will introduce LCLS and LCLS-II with a short video, discuss its data reduction, collection, data transfer needs and current progress in meeting these needs."
Watch the video: https://youtu.be/LkwwGh7YdPI
Learn more: https://www6.slac.stanford.edu/
and
http://hpcadvisorycouncil.com
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
An ethernet based_approach_for_tm_data_analysis_v2Priyasloka Arya
Testing and performance evaluation of flight vehicles largely depends on the data gathered through telemetry. Tele-metered data describes the internal story of device under test. As the tele-metered data is transmitted to ground receiving stations through radio frequency and Inter Range Instrumentation Group (IRIG) standard data format are well known, anybody who is tuned to transmitted frequency, can receive data and minimal information about the format can reveal the total information of device under test. To deal with this situation, current trend is to encrypt the mission critical information on board before transmitting. In this paper, the authors have discussed the advantage of Local Area Network (LAN) based Telemetry base band system which provides scalability, modularity, and flexibility to the user for the analysis of encrypted data.
Enabling Active Flow Manipulation In Silicon-based Network Forwarding EnginesTal Lavian Ph.D.
Great Active Nets Community Solutions:
Active networks (AN) approach opens an exciting opportunity for individual applications to define the service provided by the network through programmability.
Active Networks technologies expose a novel approach that allows customer value-added services to be introduced to the network “on-the-fly”.
Active Nets program has produced a new network platform flexible and extensible at runtime to accommodate the rapid evolution and deployment of network technologies.
The exciting opportunity exists for network service providers and third parties, not just the network device providers, to program the network infrastructure and services.
Dynamic assignment of traffic classes to a priority queue in a packet forward...Tal Lavian Ph.D.
An apparatus and method for dynamic assignment of classes of traffic to a priority queue. Bandwidth consumption by one or more types of packet traffic received in the packet forwarding device is monitored to determine whether the bandwidth consumption exceeds a threshold. If the bandwidth consumption exceeds the threshold, assignment of at least one type of packet traffic of the one or more types of packet traffic is changed from a queue having a first priority to a queue having a second priority.
https://www.google.com/patents/US8619793?dq=US+8619793&hl=en&sa=X&ei=XrVXVLWLHIzkuQSvqYLgAQ&ved=0CB8Q6AEwAA
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...Tal Lavian Ph.D.
DWDM-RAM: An architecture designed to meet the
networking challenges of extremely large scale Grid applications.
Traditional network infrastructure cannot meet these demands,
especially, requirements for intensive data flows
DWDM-RAM Components Include:
Data management services
Intelligent middleware
Dynamic lightpath provisioning
State-of-the-art photonic technologies
Wide-area photonic testbed implementation
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...Tal Lavian Ph.D.
DWDM-RAM
An architecture for data intensive Grids enabled by next generation dynamic optical networks, incorporating
new methods for lightpath provisioning. DWDM-RAM is designed to meet the networking challenges of
extremely large scale Grid applications. Traditional network infrastructure cannot meet these demands,
especially, requirements for intensive data flows.
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...Tal Lavian Ph.D.
The DWDM-RAM architecture identifies two distinct planes over the dynamic
underlying optical network:
the Data Grid Plane that speaks for the diverse requirements of a data-intensive application by providing generic data-intensive interfaces and services and
2) the Network Grid Plane that marshals the raw bandwidth of the underlying optical
network into network services, within the OGSI framework, and that matches the complex requirements specified by the Data Grid Plane.
At the application middleware layer, the Data Transfer Service (DTS) presents an interface between the system and an application. It receives high-level client requests, policy-and-access filtered, to transfer specific named blocks of data with specific advance scheduling constraints.
The network resource middleware layer consists of three services: the Data Handler Service (DHS), the Network Resource Service (NRS) and the Dynamic Lambda Grid Service (DLGS). Services of this layer initiate and control sharing of resources.
DWDM-RAM:Enabling Grid Services with Dynamic Optical NetworksTal Lavian Ph.D.
Packet-switching technology
Great solution for small-burst communication, such as email, telnet, etc.
Data-intensive grid applications
Involves moving massive amounts of data
Requires high and sustained bandwidth
DWDM
Basically circuit switching
Enable QoS at the Physical Layer
Provide
High bandwidth
Sustained bandwidth
DWDM based on dynamic wavelength switching
Enable dedicated optical paths to be allocated dynamically
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...Tal Lavian Ph.D.
The new architecture is proposed for data intensive enabled by next generation dynamic optical networks
Encapsulates “optical network resources” into a service framework to support dynamically provisioned and advanced data-intensive transport services
Provides a generalized framework for high performance applications over next generation networks, not necessary optical end-to-end
Supports both on-demand and scheduled data retrieval
Supports a meshed wavelength switched network capable of establishing an end-to-end lightpath in seconds
Supports bulk data-transfer facilities using lambda-switched networks
Supports out-of-band tools for adaptive placement of data replicas
Offers network resources as Grid services for Grid computing
Business Models for Dynamically Provisioned Optical NetworksTal Lavian Ph.D.
Low latency, high bandwidth services (>1Gb/s) are emerging requirements for business, medical, education, government and industry
New applications development and business models could be stimulated by affordable and easily accessible high bandwidth in both local and wide area networks
High bandwidth connections are typically full period today but full period 7x24 bandwidth is not always needed.
Technologies are now available that suggest plausible new business model options to offer time slots for high bandwidth services
Dynamic provisioning of lambda and sub-lambda time slots
Periodically scheduled (N time slots per day, per week) or ad hoc
A Platform for Data Intensive Services Enabled by Next Generation Dynamic Opt...Tal Lavian Ph.D.
The new architecture is proposed for data intensive enabled by next generation dynamic optical networks
Offers a Lambda scheduling service over Lambda Grids
Supports both on-demand and scheduled data retrieval
Supports bulk data-transfer facilities using lambda-switched networks
Provides a generalized framework for high performance applications over next generation networks, not necessary optical end-to-end
Supports out-of-band tools for adaptive placement of data replicas
DWDM-RAM: a data intensive Grid service architecture enabled by dynamic optic...Tal Lavian Ph.D.
Next generation applications and architectures (for example, Grids) are driving radical changes in the nature of traffic, service models, technology, and cost, creating opportunities for an advanced communications infrastructure to tackle next generation data services. To take advantage of these trends and opportunities, research communities are creating new architectures, such as the Open Grid Service Architecture (OGSA), which are being implemented in new prototype advanced infrastructures.
The DWDM-RAM project, funded by DARPA, is actively addressing the challenges of next generation applications. DWDM-RAM is an architecture for data- intensive services enabled by next generation dynamic optical networks. It develops and demonstrates a novel architecture for new data communication services, within the OGSA context, that allows for managing extremely large sets of distributed data. Novel features move network services beyond notions of the network as a managed resource, for example, by including capabilities for dynamic on-demand provisioning and advance scheduling. DWDM-RAM encapsulates optical network resources (Lambdas, lightpaths) into a Grid Service and integrates their management within the Open Grid Service Architecture. Migration to emerging standards such as WS-Resource Framework (WS-RF) should be staright forward.
DWDM-RAM: Enabling Grid Services with Dynamic Optical NetworksTal Lavian Ph.D.
Advances in Grid technology enable the deployment of data-intensive distributed applications, which require moving Terabytes or even Petabytes of data
between data banks. The current underlying networks cannot provide dedicated links with adequate end-to-end sustained bandwidth to support the requirements of these Grid applications. DWDM-RAM1 is a novel service-oriented architecture, which harnesses the enormous bandwidth potential of optical networks and demonstrates their on-demand nsage on the OMNlnet. Preliminary experiments suggest that dynamic optical networks, such as the OMNlnet, are the ideal option for transferring such massive amounts of data. DWDM-RAM incorporates an OGSI/OGSA compliant service interface and will promote greater convergence between dynamic optical networks and data intensive Grid computing.
A Grid Computing Platform where Communication Function is in Balance with Computation and Storage.
Lambda Data Grid Service architecture interacts with Cyber-infrastructure, and overcomes data limitations efficiently & effectively by:
treating the “network” as a primary resource just like “storage” and “computation”
treating the “network” as a “scheduled resource”
relying upon a massive, dynamic transport infrastructure: Dynamic Optical Network
Project DRAC: Creating an applications-aware networkTal Lavian Ph.D.
Intelligent networking and the ability for applications to more effectively use all of the network’s capability, rather than just the transport “pipe,” have been elusive. Until now. Nortel has developed a proof-of-concept software capability — service-mediation “middleware” called the Dynamic Resource Allocation Controller (DRAC) — that runs on any Java platform and opens up the network to applications with proper credentials,making available all of the properties of a converged network, including service topology, time-of-day reservations, and interdomain connectivity options. With a more open network, applications can directly provision and invoke services, with no need for operator involvement or point-and click sessions. In its first real-world demonstrations in large research networks, DRAC is showing it can improve user satisfaction while reducing network operations and investment costs.
DWDM-RAM: An Architecture for Data Intensive Service Enabled by Next Generati...Tal Lavian Ph.D.
An architecture is proposed for data-intensive services enabled by next generation dynamic optical networks. The architecture supports new data communication services that allow for coordinating extremely large sets of distributed data. The architecture allows for novel features including algorithms for optimizing and scheduling data transfers,methods for allocating and scheduling network resources, and an intelligent middleware platform that is capable of interfacing application level services to the underlying optical technologies. The significance of the architecture is twofold: 1) it encapsulates “optical network resources” into a service framework to support dynamically provisioned and advance scheduled data-intensive transport services, and 2) it establishes a generalized enabling framework for intelligent services and applications over next generation networks, not necessarily optical end-to-end. DWDM-RAM1 is an implementation version of the architecture, which is conceptual as well as experimental. This architecture has been implemented in prototype on OMNInet, which is an advanced experimental metro area optical testbed that is based on novel architecture, protocols, control plane services (Optical Dynamic Intelligent Network-ODIN2), and advanced photonic components. This paper presents the concepts behind the DWDM-RAM architecture and its design. The paper also describes an application scenario using the architecture’s data transfer service and network resource services over the agile OMNInet testbed.
A Platform for Large-Scale Grid Data Service on Dynamic High-Performance Netw...Tal Lavian Ph.D.
Data intensive Grid applications often deal with multiple terabytes and even petabytes of data. For them to be effectively deployed over distances, it is crucial that Grid infrastructures learn how to best exploit high-performance networks
(such as agile optical networks). The network footprint of these Grid applications show pronounced peaks and valleys in utilization, prompting for a radical overhaul of traditional network provisioning styles such as peak-provisioning, point-and-click or operator-assisted provisioning. A Grid stack must become capable to dynamically orchestrate a complex set of variables related to application requirements, data services, and network provisioning services, all within a rapidly and continually changing environment. Presented here is a platform that addresses some of these issues. This service platform closely integrates a set of large-scale data services with those for dynamic bandwidth allocation, through a network resource middleware service, using an OGSA-compliant interface allowing direct access by external applications. Recently, this platform has been implemented as an experimental research prototype on a unique wide area optical networking testbed incorporating state-of-the-art photonic
components. The paper, which presents initial results of research conducted on this prototype, indicates that these methods have the potential to address multiple major challenges related to data intensive applications. Given the complexities of this topic, especially where scheduling is required, only selected aspects of this platform are considered in this paper.
At the Society of Cable Telecommunications Engineers Expo 2014, Andy Smith of Juniper Networks presented Juniper’s vision and architecture for a cable oriented packet optical core and metro transport system. Access insights and network diagrams in his presentation and learn more in his blog post: http://juni.pr/1rwapCG.
Similar to DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advanced Optical Networks (20)
A system for providing ultra low phase noise frequency synthesizers using Fractional-N PLL (Phase Lock Loop), Sampling Reference PLL and DDS (Direct Digital Synthesizer). Modern day advanced communication systems comprise frequency synthesizers that provide a frequency output signal to other parts of the transmitter and receiver so as to enable the system to operate at the set frequency band. The performance of the frequency synthesizer determines the performance of the communication link. Current days advanced communication systems comprises single loop Frequency synthesizers which are not completely able to provide lower phase deviations for errors (For 256 QAM the practical phase deviation for no errors is 0.4-0.5°) which would enable users to receive high data rate. This proposed system overcomes deficiencies of current generation state of the art communication systems by providing much lower level of phase deviation error which would result in much higher modulation schemes and high data rate.
A system for providing ultra low phase noise frequency synthesizers using Fractional-N PLL (Phase Lock Loop), Sampling Reference PLL and DDS (Direct Digital Synthesizer). Modern day advanced communication systems comprise frequency synthesizers that provide a frequency output signal to other parts of the transmitter and receiver so as to enable the system to operate at the set frequency band. The performance of the frequency synthesizer determines the performance of the communication link. Current days advanced communication systems comprises single loop Frequency synthesizers which are not completely able to provide lower phase deviations for errors (For 256 QAM the practical phase deviation for no errors is 0.4-0.5°) which would enable users to receive high data rate. This proposed system overcomes deficiencies of current generation state of the art communication systems by providing much lower level of phase deviation error which would result in much higher modulation schemes and high data rate.
Embodiments of the present invention present a method and apparatus for photonic line sharing for high-speed routers. Photonic switches receive high-speed optical data streams and produce the data streams to a router operating according to routing logic and produce optical data streams according to destination addresses stored in the data packets. Each photonic switch can be configured as one of a 1:N multiplexer or an M:N cross-connect switch. In one embodiment, optical data is converted to electrical data prior to routing, while an alternate embodiment routes only optical data. Another embodiment transfers large volumes of high-speed data through an optical bypass line in a circuit switched network to bypass the switch fabric thereby routing the data packets directly to the destination. An edge device selects one of the packet switched network or the circuit switched network. The bypass resources are released when the large volume of high-speed data is transferred.
Systems and methods to support sharing and exchanging in a networkTal Lavian Ph.D.
Embodiments of the invention provide for providing support for sharing and exchanging in a network. The system includes a memory coupled to a processor. The memory includes a database comprising information corresponding to first users and the second users. Each of the first users and the second users are facilitated for sharing or exchanging activity, service or product, based on one or more conditions corresponding thereto. Further, the memory includes one or more instructions executable by the processor to match each of the first users to at least one of the second users. Furthermore, the instructions may inform each of the first users about the match with the at least one of the second users when all the conditions are met by the at least one second user based on the information corresponding to each of the second users.
Systems and methods for visual presentation and selection of IVR menuTal Lavian Ph.D.
Embodiments of the invention provide a system for generating an Interactive Voice Response (IVR) database, the system comprising a processor and a memory coupled to the processor. The memory comprising a list of telephone numbers associated with one or more destinations implementing IVR menus, wherein the one or more destinations are grouped based on a plurality of categories of the IVR menus. Further the memory includes instructions executable by said processor for automatically communicating with the one of more destinations, and receiving at least one customization record from said at least one destination to store in the IVR database.
Various embodiments allow Grid applications to access resources shared in communication network domains. Grid Proxy Architecture for Network Resources (GPAN) bridges Grid services serving user applications and network services controlling network devices through proxy functions. At times, GPAN employs distributed network service peers (NSP) in network domains to discover, negotiate and allocate network resources for Grid applications. An elected master NSP is the unique Grid node that runs GPAN and represents the whole network to share network resources to Grids without Grid involvement of network devices. GPAN provides the Grid Proxy service (GPS) to interface with Grid services and applications, and the Grid Delegation service (GDS) to interface with network services to utilize network resources. In some cases, resource-based XML messaging can be employed for the GPAN proxy communication.
A system for providing ultra low phase noise frequency synthesizers using Fractional-N PLL (Phase Lock Loop), Sampling Reference PLL and DDS (Direct Digital Synthesizer). Modern day advanced communication systems comprise frequency synthesizers that provide a frequency output signal to other parts of the transmitter and receiver so as to enable the system to operate at the set frequency band. The performance of the frequency synthesizer determines the performance of the communication link. Current days advanced communication systems comprises single loop Frequency synthesizers which are not completely able to provide lower phase deviations for errors (For 256 QAM the practical phase deviation for no errors is 0.4-0.5°) which would enable users to receive high data rate. This proposed system overcomes deficiencies of current generation state of the art communication systems by providing much lower level of phase deviation error which would result in much higher modulation schemes and high data rate.
Systems and methods for electronic communicationsTal Lavian Ph.D.
Embodiments of the invention provide a system for enhancing user interaction with the Internet of Things. The system includes a processor, and a memory coupled to the processor. The memory includes a database having one or more options corresponding to each of the Internet of Things. The memory further includes instructions executable by the processor to share at least one of the one or more options with one or more users of the things. Further, the instructions receive information corresponding to selection of the at least one option by the one or more users. Additionally, the instructions update the database based on the selection of the at least one option by the one or more users. Further, a device for enhancing interaction with the things is also disclosed.
A system for providing ultra low phase noise frequency synthesizers using Fractional-N PLL (Phase Lock Loop), Sampling Reference PLL and DDS (Direct Digital Synthesizer). Modern day advanced communication systems comprise frequency synthesizers that provide a frequency output signal to other parts of the transmitter and receiver so as to enable the system to operate at the set frequency band. The performance of the frequency synthesizer determines the performance of the communication link. Current days advanced communication systems comprises single loop Frequency synthesizers which are not completely able to provide lower phase deviations for errors (For 256 QAM the practical phase deviation for no errors is 0.4-0.5°) which would enable users to receive high data rate. This proposed system overcomes deficiencies of current generation state of the art communication systems by providing much lower level of phase deviation error which would result in much higher modulation schemes and high data rate.
A system for providing ultra low phase noise frequency synthesizers using Fractional-N PLL (Phase Lock Loop), Sampling Reference PLL and DDS (Direct Digital Synthesizer). Modern day advanced communication systems comprise frequency synthesizers that provide a frequency output signal to other parts of the transmitter and receiver so as to enable the system to operate at the set frequency band. The performance of the frequency synthesizer determines the performance of the communication link. Current days advanced communication systems comprises single loop Frequency synthesizers which are not completely able to provide lower phase deviations for errors (For 256 QAM the practical phase deviation for no errors is 0.4-0.5°) which would enable users to receive high data rate. This proposed system overcomes deficiencies of current generation state of the art communication systems by providing much lower level of phase deviation error which would result in much higher modulation schemes and high data rate.
Radar target detection system for autonomous vehicles with ultra-low phase no...Tal Lavian Ph.D.
An object detection system for autonomous vehicle, comprising a radar unit and at least one ultra-low phase noise frequency synthesizer, is provided. The radar unit configured for detecting the presence and characteristics of one or more objects in various directions. The radar unit may include a transmitter for transmitting at least one radio signal; and a receiver for receiving the at least one radio signal returned from the one or more objects. The ultra-low phase noise frequency synthesizer may utilize Clocking device, Sampling Reference PLL, at least one fixed frequency divider, DDS and main PLL to reduce phase noise from the returned radio signal. This proposed system overcomes deficiencies of current generation state of the art Radar Systems by providing much lower level of phase noise which would result in improved performance of the radar system in terms of target detection, characterization etc. Further, a method for autonomous vehicle is also disclosed.
Various embodiments allow Grid applications to access resources shared in communication network domains. Grid Proxy Architecture for Network Resources (GPAN) bridges Grid services serving user applications and network services controlling network devices through proxy functions. At times, GPAN employs distributed network service peers (NSP) in network domains to discover, negotiate and allocate network resources for Grid applications. An elected master NSP is the unique Grid node that runs GPAN and represents the whole network to share network resources to Grids without Grid involvement of network devices. GPAN provides the Grid Proxy service (GPS) to interface with Grid services and applications, and the Grid Delegation service (GDS) to interface with network services to utilize network resources. In some cases, resource-based XML messaging can be employed for the GPAN proxy communication.
Method and apparatus for scheduling resources on a switched underlay networkTal Lavian Ph.D.
A method and apparatus for resource scheduling on a switched underlay network (18) enables coordination, scheduling, and scheduling optimization to take place taking into account the availability of the data and the network resources comprising the switched underlay network (18). Requested transfers may be fulfilled by assessing the requested transfer parameters, the availability of the network resources required to fulfill the request, the availability of the data to be transferred, the availability of sufficient storage resources to receive the data, and other potentially conflicting requested transfers. In one embodiment, the requests are under-constrained to enable transfer scheduling optimization to occur. The under-constrained nature of the requests enable transfer scheduling optimization to occur. The under-constrained nature of the requests enables requests to be scheduled taking into account factors such as transfer priority, transfer duration, the amount of time it has been since the transfer request was submitted, and many other factors.
Dynamic assignment of traffic classes to a priority queue in a packet forward...Tal Lavian Ph.D.
An apparatus and method for dynamic assignment of classes of traffic to a priority queue. Bandwidth consumption by one or more types of packet traffic received in the packet forwarding device is monitored to determine whether the bandwidth consumption exceeds a threshold. If the bandwidth consumption exceeds the threshold, assignment of at least one type of packet traffic of the one or more types of packet traffic is changed from a queue having a first priority to a queue having a second priority.
Method and apparatus for using a command design pattern to access and configu...Tal Lavian Ph.D.
An XML accessible network device is capable of performing functions in response to an XML encoded request transmitted over a network. It includes a network data transfer service, coupled to a network, that is capable of receiving XML encoded requests from a client also connected to the network. A service engine is capable of understanding and parsing the XML encoded requests according to a corresponding DTD. The service engine further instantiates a service using parameters provided in the XML encoded request and launches the service for execution on the network device in accordance with a command design parameter. A set of device APIs interacts with hardware and software on the network device for executing the requested service on the network device. If necessary, a response is further collected from the device and provided to the client in a response message.
Embodiments of the invention provide means to the users of the system to provide ratings and corresponding feedback for enhancing the genuineness in the ratings. The system includes a memory coupled to a processor. The memory includes one or more instructions executable by the processor to enable the users of the system to rate each other based on at least one of sharing, exchanging, and selling one of activity, service or product. The system may provide a mechanism to encourage genuineness in ratings provided by the users. Furthermore, the instructions facilitate the rating receivers to provide feedbacks corresponding to the received ratings. The feedback includes accepting or objecting to a particular rating. Moreover, the memory includes instructions executable by the processor to enable the system to determine genuineness of an objection raised by a rating receiver.
Embodiments of the present invention provide a system for enhancing reliability in computation of ratings provided by a user over a social network. The system comprises of a processor and a memory coupled to the processor. The memory further comprises a rater score database, a satisfaction database, a social network registration database, a user profile database, and a plurality of instruction executable by the processor. Said instructions in the memory are enabled to accept a message from at least one user wherein said message comprises a satisfaction score associated with at least one service provider and to retrieve a rater score associated with said at least one user from said rater score database. Further, the memory includes instructions in order to compute a new satisfaction score based on said rater score and said satisfaction score and update said satisfaction database to include said new satisfaction score. In a similar manner, the new satisfaction score can be computed based upon the information stored in the social network registration database and user profile database.
Systems and methods for visual presentation and selection of ivr menuTal Lavian Ph.D.
Embodiments of the invention provide a system for generating an Interactive Voice Response (IVR) database, the system comprising a processor and a memory coupled to the processor. The memory comprising a list of telephone numbers associated with one or more destinations implementing IVR menus, wherein the one or more destinations are grouped based on a plurality of categories of the IVR menus. Further the memory includes instructions executable by said processor for automatically communicating with the one of more destinations, and receiving at least one customization record from said at least one destination to store in the IVR database.
A system for providing ultra low phase noise frequency synthesizers using Fractional-N PLL (Phase Lock Loop), Sampling Reference PLL and DDS (Direct Digital Synthesizer). Modern day advanced communication systems comprise frequency synthesizers that provide a frequency output signal to other parts of the transmitter and receiver so as to enable the system to operate at the set frequency band. The performance of the frequency synthesizer determines the performance of the communication link. Current days advanced communication systems comprises single loop Frequency synthesizers which are not completely able to provide lower phase deviations for errors (For 256 QAM the practical phase deviation for no errors is 0.4-0.5°) which would enable users to receive high data rate. This proposed system overcomes deficiencies of current generation state of the art communication systems by providing much lower level of phase deviation error which would result in much higher modulation schemes and high data rate.
A system for providing ultra low phase noise frequency synthesizers using Fractional-N PLL (Phase Lock Loop), Sampling Reference PLL and DDS (Direct Digital Synthesizer). Modern day advanced communication systems comprise frequency synthesizers that provide a frequency output signal to other parts of the transmitter and receiver so as to enable the system to operate at the set frequency band. The performance of the frequency synthesizer determines the performance of the communication link. Current days advanced communication systems comprises single loop Frequency synthesizers which are not completely able to provide lower phase deviations for errors (For 256 QAM the practical phase deviation for no errors is 0.4-0.5°) which would enable users to receive high data rate. This proposed system overcomes deficiencies of current generation state of the art communication systems by providing much lower level of phase deviation error which would result in much higher modulation schemes and high data rate.
MATHEMATICS BRIDGE COURSE (TEN DAYS PLANNER) (FOR CLASS XI STUDENTS GOING TO ...PinkySharma900491
Class khatm kaam kaam karne kk kabhi uske kk innings evening karni nnod ennu Tak add djdhejs a Nissan s isme sniff kaam GCC bagg GB g ghan HD smart karmathtaa Niven ken many bhej kaam karne Nissan kaam kaam Karo kaam lal mam cell pal xoxo
NO1 Uk Amil Baba In Lahore Kala Jadu In Lahore Best Amil In Lahore Amil In La...Amil baba
Contact with Dawood Bhai Just call on +92322-6382012 and we'll help you. We'll solve all your problems within 12 to 24 hours and with 101% guarantee and with astrology systematic. If you want to take any personal or professional advice then also you can call us on +92322-6382012 , ONLINE LOVE PROBLEM & Other all types of Daily Life Problem's.Then CALL or WHATSAPP us on +92322-6382012 and Get all these problems solutions here by Amil Baba DAWOOD BANGALI
#vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore#blackmagicformarriage #aamilbaba #kalajadu #kalailam #taweez #wazifaexpert #jadumantar #vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore #blackmagicforlove #blackmagicformarriage #aamilbaba #kalajadu #kalailam #taweez #wazifaexpert #jadumantar #vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore #Amilbabainuk #amilbabainspain #amilbabaindubai #Amilbabainnorway #amilbabainkrachi #amilbabainlahore #amilbabaingujranwalan #amilbabainislamabad
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advanced Optical Networks
1. DWDM-RAM:
DARPA-Sponsored Research for Data Intensive
Service-on-Demand
Advanced Optical Networks
DWDM-RAM demonstration sponsored by
Nortel Networks and iCAIR/Northwestern University
Dates Monday Oct 6 at 4pm & 6pm
& Tuesday Oct 7 at 12Noon, 2pm & 4pm
Times: Wednesday Oct 8 at 10am & 12Noon
2. SLAC Agenda
• DWDM-RAM Overview
– The Problem
– Our Architecture & Approach
• Discussion with HEP Community
3. Problem: More Data Than Network
Application-level network scheduling
Application must see dedicated bandwidth as a managed
resource
Advance scheduling of network from application
Optimization is important
Rescheduling with under-constrained requests
Data transfers require service model
Scheduled network and host data services combined
Co-reservation of storage, data, and network
Requires scheduling
4. Optical Networks Change the Current Pyramid
George Stix,
Scientific American,
January 2001
x10
DWDM- fundamental misbalance between computation and communication
5. Radical mismatch: L1 – L3
• Radical mismatch between the optical transmission world and
the electrical forwarding/routing world.
• Currently, a single strand of optical fiber can transmit more
bandwidth than the entire Internet core
• Current L3 architecture can’t effectively transmit PetaBytes or
100s of TeraBytes
• Current L1-L0 limitations: Manual allocation, takes 6-12
months - Static.
– Static means: not dynamic, no end-point connection, no service
architecture, no glue layers, no applications underlay routing
6. Growth of Data-Intensive Applications
• IP data transfer: 1.5TB (1012) , 1.5KB packets
– Routing decisions: 1 Billion times (109)
– Over every hop
• Web, Telnet, email – small files
• Fundamental limitations with data-intensive
applications
– multi TeraBytes or PetaBytes of data
– Moving 10KB and 10GB (or 10TB) are
different (x106, x109)
– 1Mbs & 10Gbs are different (x106)
7. Challenge: Emerging data intensive applications require:
Extremely high performance, long term data flows
Scalability for data volume and global reach
Adjustability to unpredictable traffic behavior
Integration with multiple Grid resources
Response: DWDM-RAM - An architecture for data intensive
Grids enabled by next generation dynamic optical networks,
incorporating new methods for lightpath provisioning
8. Architecture
Applications
DTS NRM Other
Replication,
Disk, Accounting,
Authentication,
Etc.
ftp, GridFTP,
Sabul, fast,
etc
Architecture, Page
2
OGSI provided for
all application layer
interfaces
Svcs
DMS
Other
dwdm …
ODIN
omninet
l’s l’s
9. Data Management Services
OGSA/OGSI compliant
Capable of receiving and understanding application requests
Has complete knowledge of network resources
Transmits signals to intelligent middleware
Understands communications from Grid infrastructure
Adjusts to changing requirements
Understands edge resources
On-demand or scheduled processing
Supports various models for scheduling, priority setting,
event synchronization
10. Intelligent Middleware for Adaptive Optical Networking
OGSA/OGSI compliant
Integrated with Globus
Receives requests from data services
Knowledgeable about Grid resources
Has complete understanding of dynamic lightpath provisioning
Communicates to optical network services layer
Can be integrated with GRAM for co-management
Architecture is flexible and extensible
11. Dynamic Lightpath Provisioning Services
Optical Dynamic Intelligent Networking (ODIN)
OGSA/OGSI compliant
Receives requests from middleware services
Knowledgeable about optical network resources
Provides dynamic lightpath provisioning
Communicates to optical network protocol layer
Precise wavelength control
Intradomain as well as interdomain
Contains mechanisms for extending lightpaths through
E-Paths - electronic paths
12. DWDM-RAM Service
Control Architecture
GRID Service
Request
Network Service Request
ODIN OmniNet Control Plane
Optical
Control
Network
Optical
Control
Network
UNI-N
Data Transmission Plane
ODIN
UNI-N
Connection
Control
L3 router
L2 switch
Service
Control
Data
Path
Control
Data
storage
switch
Data
Path
Control
DDAATTAA G GRRIDID S SEERRVVICICEE P PLLAANNEE
l1 ln
Data
Center
l1
ln
l1
ln
Data
Path
Data
Center
Service
Control
NNEETTWWOORRKK S SEERRVVICICEE P PLLAANNEE
13. Design for Scheduling
Network and Data Transfers scheduled
Data Management schedule coordinates network, retrieval,
and sourcing services (using their schedulers)
Network Management has own schedule
Variety of request models
Fixed – at a specific time, for specific duration
Under-constrained – e.g. ASAP, or within a window
Auto-rescheduling for optimization
Facilitated by under-constrained requests
Data Management reschedules
for its own requests
request of Network Management
DWDM-RAM October 2003 Architecture Page 4
14. New Concepts
• Many-to-Many vs. Few-to-Few
• Apps optimized to waste bandwidth
• Network as a Grid service
• Network as a scheduled service
• New transport concept
• New control plane
• Cloud bypass
15. Summary
Next generation optical networking provides significant
new capabilities for Grid applications and services,
especially for high performance data intensive processes
DWDM-RAM architecture provides a framework for
exploiting these new capabilities
These conclusions are not only conceptual – they are being
proven and demonstrated on OMNInet –
a wide-area metro advanced photonic testbed
17. Key Terms
DTS – Data Transfer Service
Effects transfers
NRM – Network Resource Management
Interface to multiple physical/logical network types
Consolidation, topology discovery, path allocation, scheduler, etc.
DMS – Data Management Service
Topology discovery, route creation, path allocation
Scheduler/optimizer
Other Services
Replication, Disk, Accounting, Authentication, Security, etc.
18. Possible Extensions
Authentication/Security
Multi-domain environments
Replication for optimization
May help refine current Grid file system models
May Use existing replica location services
Priority models
Rule-based referees
Allow local and policy-based management
Add domain specific constraints
DWDM-RAM October 2003 Architecture Page 5
19. Extending Grid Services
OGSI interfaces
Web Service implemented using SOAP and JAX-RPC
Non-OGSI clients also supported
GARA and GRAM extensions
Network scheduling is new dimension
Under-constrained (conditional) requests
Elective rescheduling/renegotiation
Scheduled data resource reservation service (“Provide 2 TB
storage between 14:00 and 18:00 tomorrow”)
DWDM-RAM October 2003 Architecture Page 6
20. DWDM-RAM: An architecture designed to meet the
networking challenges of extremely large scale Grid applications.
Traditional network infrastructure cannot meet these demands,
especially, requirements for intensive data flows
DWDM-RAM Components Include:
Data management services
Intelligent middleware
Dynamic lightpath provisioning
State-of-the-art photonic technologies
Wide-area photonic testbed implementation
21. Current Implementation
ft p
Client Application
DTS DMS NRM
ODIN
OMNInet
l’s
OGSI provided for
network allocation
interfaces
22. NRM OGSA Compliance
OGSI interface
GridService PortType with two application-oriented methods:
allocatePath(fromHost, toHost,...)
deallocatePath(allocationID)
Usable by a variety of Grid applications
Java-oriented SOAP implementation using the Globus Toolkit 3.0
23. NRM Web Services Compliance
Accessible as Web Service for non-OGSI callers
Fits Web Service model:
- Single-location always-on service
- Atomic message-oriented transactions
- State preserved where necessary at the application level
No OGSI extensions, such as service data and service factories
24. Data Management Service
Uses standard ftp (jakarta
commons ftp client)
Implemented in Java
Uses OGSI calls to request
network resources
Currently uses Java RMI for
other remote interfaces
Uses NRM to allocate lambdas
Designed for future scheduling
Data Receiver λ Data Source
FTP client FTP server
DMS NRM
Client App
25. Network Resource Manager
• Presents application-oriented OGSI / Web Services interfaces
for network resource (lightpath) allocation
• Hides network details from applications
•Implemented in Java
Items in blue are planned
26. Network Resource Manager
Network
Using Application
End-to-End-Oriented
Allocation Interface
Scheduling / Optimizing
Resource Manager
(DMS)
Omninet Data
Interpreter
Omninet Network
Manager (Odin)
Application
Segment-Oriented Topology
and Allocation Interface
Network-Specific
Network Manager
Network-Specific
Network Manager
Network-Specific
Data Interpreter
Network-Specific
Data Interpreter
Items in blue are
planned
27. Lightpath Services
Enabling High Performance Support for
Data-Intensive Services With On-Demand Lightpaths Created By
Dynamic Lambda Provisioning, Supported by Advanced Photonic
Technologies
OGSA/OGSI Compliant Service
Optical Service Layer: Optical Dynamic Intelligent Network
(ODIN) Services
Incorporates Specialized Signaling
Utilizes Provisioning Tool: IETF GMPLS
New Photonic Protocols
28. ODIN
Optical Dynamic Intelligent Networking Services:
An Architecture Specifically Designed to Support Large Scale,
Data Intensive, Extremely High Performance, Long-Term Flows
OGSA/OGSI Compliant Service
Dynamic Lambda Provisioning Based on DWDM
Beyond Traditional Static DWDM Provisioning
Scales to Gbps, Terabits Data Flows with
Flexible, With Fine-Grained Control
Lightpaths: Multiple Integrated Linked Lambdas, Including
One to Many and Many to One, Intradomain/Interdomain
29. Terms
ODIN Server – A server software that accepts and fulfills
requests (eg, allocates and manages routes, paths)
Resource – A host or other hardware that provides a service
over the optical network, OGSA/OGSI compliant
Resource Server – Server software running on a Resource
that provides the service
Resource Config. Server – Server software that receives
route configuration data from the ODIN Server
Client – A host connecting to a Resource through the optical
network, in this demonstration, Grid clusters
Network Resource – Dynamically allocated network
resource, in this demonstration, Lightpaths
30. Lightpath Provisioning Processes
Specialized Signaling
Request Characterization, Resource Characterization,
Optimization, Performance, and Survival/Protection,
Restoration, Characterization
Basic Processes Are Directed at Lightpath/l Management:
Create, Delete, Change, Swap, Reserve
And Related Processes:
Discover, Reserve, Bundle, Reallocate, etc.
IETF GMPLS As Wavelength Implementation Tools
Utilizes New Photonic Network Protocols
31. Core Processes
O-UNI, Specialized Interfaces, eg, APIs, CLIs
Wavelength Distribution Protocol
Auto-Discovery of Optical Resources
Self-Inventorying
Constraint Based Routing
Options for Path Protection, Restoration
Options for Optical Service Definitions
32. Addressing and Identification
Options for Interface Addressing
Options for VPN IDs
Port, Channel, Sub-channel IDs
Routing Algorithm Based on Differentiated Services
Options for Bi-directional Optical Lightpaths, and
Optical Lightpath Groups
Optical VPNs
33. Northwestern U
4x10G
E
Optical
Switching
Platform
Passport
8600
Application
Cluster
UIC
8x1GE 4x10GE
Application
Cluster
Application
Cluster
Optical
Switching
Platform
Optical
Switching
Platform
Passport
8600
OPTera
Metro
5200
StarLight
Passport
8600
4x10GE
CA*net3--Chicago
Optical
Switching
Platform
Passport
8600
• A four-node multi-site optical metro testbed network in Chicago -- the first 10GE service trial!
• A test bed for all-optical switching and advanced high-speed services
• OMNInet testbed Partners: SBC, Nortel, iCAIR at Northwestern, EVL, CANARIE, ANL
Closed loop
8x1GE 4x10GE
8x1GE
8x1GE Loop
OMNInet Core Nodes
34. Fiber
Span Length
KM MI
NWUEN
Link
1* 35.3 22.0
2 10.3 6.4
3* 12.4 7.7
4 7.2 4.5
5 24.1 15.0
6 24.1 15.0
7* 24.9 15.5
8 6.7 4.2
9 5.3 3.3
CAMPUS
FIBER (16)
CAMPUS
FIBER (4)
Grid
OMNInet
W Taylor Sheridan
1
l
l
l
10 GE
1
l
l
l
10/100/ Clusters
GIGE
10 GE
10 GE
To Ca*Net 4
Lake Shore
5200 OFA
l
2
3
Optera 5200 OFA
Photonic
Node
5200 OFA
NWUEN-8 NWUEN-9
S. Federal
Photonic
Node
Photonic
Node 10/100/
GIGE
10/100/
GIGE
10/100/
GIGE
10 GE
Optera
5200
10Gb/s
TSPR
Photonic
Node
l4
PP
8600
10 GE
PP
8600
PP
8600
2
3
4
l
l
l
1
Optera
5200
10Gb/s
TSPR
10 GE
Optera
5200
10Gb/s
TSPR
2
3
4
l
10 GE
Optera
5200
10Gb/s
TSPR
1
l
l
l
2
3
4
l
1310 nm 10 GbE
WAN PHY interfaces
10 GE
PP
8600
…
EVL/UIC
OM5200
INITIAL
CONFIG:
10 LAMBDA
(all GIGE)
LAC/UIC
OM5200
StarLight
Interconnect
with other
research
networks
10GE LAN PHY (Dec 03)
TECH/NU-E
OM5200
CAMPUS
FIBER (4)
INITIAL
CONFIG:
10 LAMBDAS
(ALL GIGE)
Optera Metro 5200 OFA
NWUEN-1
NWUEN-5
NWUEN-2 NWUEN-6
NWUEN-3
NWUEN-4
NWUEN-7
Fiber in use
Fiber not in use
5200 OFA
• 8x8x8l Scalable photonic switch
• Trunk side – 10 G WDM
• OFA on all trunks
35. OMNInet Control Plane Overlay Network
To
Management
Network ATM
switch port
10/100 BT
Overlay Management Network (Current)
BayStack 350
Photonic
Switch
OPTera
5200 OLA
Passport
8600
SBC
10/100 BT OC-12 Ring
Local
Management
Station
NAP
OC-3
•MREN
Part of StarTap
• Uses ATM PVC with 2 Mb/s CIR from existing network (MREN + OC12)
• Hub and spoke network from 710 Lakeshore Dr.
Evanstan
710 Lakeshore Dr.
Univ. IL 600/700 S. Federal
MREN= Metropolitan Research
And Education Network
36. OMNInet Optical Grid Clusters
Northwestern
Leverone Hall Data Com Center
10GE
WAN/LAN
PHY to
OMNInet
iCAIR Clusters at Northwestern
Technological Institute
Clusters
For Telecom2003 Demo
~20m
Up to 16xGE
(SMF LX)
DWDM on
Dedicated
~20m Fiber
4-fibers
~1km
PP8600 OM5200 OM5200
DWDM Between Cluster Site and OMNInet Core Node at iCAIR sites at Northwestern in Evanston
• The implementation is lambdas (unprotected).
• Installed shelf capacity and common equipment permits expansion of up to 16 lambdas through
deployment of additional OCLD, and OCI modules.
• A fully expanded OM5200 system is capable of supporting 64 lambdas (unprotected) over the same 4-
fiber span.
37. Fiber power
Relative
Relative
l power
code
Tone
Physical Layer Optical Monitoring and Adjustment
Fault isolation
Set
point DSP Algorithms
A/D
Management & OSC Routing
PPS Control Middleware
D/A
FLIP
Rapid
Detect
OSC cct
PhotoDetector PhotoDetector
OFA tap
D/A
VOA
Power measurement
switch
Switch
Control
AWG Temp.
Control alg.
+ -
D/A
A/D
Heater
AWG
& Measurement
tap
Drivers/data
translation
Connection
verification
Path ID Corr.
Gain
l Leveling Controller
Transient
compensator
Power
Corr.
+ -
LOS
+ -
Photonics
Database
100FX
PHY/MAC
Splitter
Photonic H/W
38. Application level measurements
Path allocation: 48.7 secs
Data transfer setup time: 0.141 secs
FTP transfer time: 464.624 secs
Effective transfer rate: 156 Mbits/sec
Path tear down time: 11.3 secs
File size: 10 GB
40. Path Allocation Overhead as a
% of the Total Transfer Time
• Knee point shows the file size
for which overhead is
insignificant
Setup time = 2 sec, Bandwidth=100 Mbps
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
0.1 1 10 100 1000 10000
File Size (MBytes)
Setup time / Total Transfer Time
1GB
Setup time = 2 sec, Bandwidth=300 Mbps
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
0.1 1 10 100 1000 10000
File Size (MBytes)
Setup time / Total Transfer Time
5GB
Setup time = 48 sec, Bandwidth=920 Mbps
0%
100 1000 10000 100000 1000000 10000000
File Size (MBytes)
Setup time / Total Transfer Time
500GB
41. Packet Switched vs Lambda Network
Setup time tradeoffs (Optical path setup time = 2 sec)
5000.0
4500.0
4000.0
3500.0
3000.0
2500.0
2000.0
1500.0
1000.0
500.0
250.0
200.0
150.0
100.0
50.0
0.0
0.0 1.0 2.0 3.0 4.0 5.0 6.0 7.0
Time (s)
Data Transferred (MB)
Packet sw itched (300 Mbps)
Lambda switched (500 Mbps)
Lambda switched (750 Mbps)
Lambda switched (1 Gbps)
Lambda switched (10Gbps)
Packet Switched vs Lambda Network
Setup time tradeoffs (Optical path setup time = 48 sec)
0.0
0.0 20.0 40.0 60.0 80.0 100.0 120.0
Time (s)
Data Transferred (MB)
Packet switched (300 Mbps)
Lambda switched (500 Mbps)
Lambda switched (750 Mbps)
Lambda switched (1 Gbps)
Lambda switched (10Gbps)
43. File Transfer Times
35
30
25
20
15
10
5
0
Max bandwidth
900+ Mb/s
100 Gb 200 Gb 300 Gb 400 Gb
msec
Max bandwidth
900+ Mb/s
44. Optical level measurements
Time to set up an individual X-connect: secs
UNI-N processing time for request: secs
Time taken by the routing card to send
secs
command to control card:
Time taken by the routing card to forwarding
request to next hop in control plane:
secs
Time taken by the control card to
drive the switch card :
secs
End-to-end light path setup : secs
45. Enhanced Optical Dynamic Intelligent Network Services
Additional OGSA/OGSI development
Enhanced signaling
Enhanced integration with optical component addressing methods
Extension of capabilities for receiving information from
L1 process monitors
Enhanced capabilities for establishing optical VPNs
New adaptive response processes for dynamic conditions
Explicit segment specification
46. Enhanced Middleware Services
Enhanced integration with data services layer
Enhanced understanding of L3-L7 requirements
Awareness of high performance L3/L4 protocols
Enhanced integration with edge resources
Middleware process performance monitoring and analysis
New capabilities for scheduling
Security
47. Expanded Data Management Service
New methods for scheduling
New methods of priority setting
Enhance awareness of network resources
Technique for forecasting demand and preparing responses
Replication services
Integration with metadata processes
Integration with adaptive storage services
Enhanced policy mechanisms
48. Photonic Testbed - OMNInet
Implementation of RSVP methods
Experiments with parallel wavelengths
Experiments with new types of flow aggregation
Experiments with multiple 10 Gbps parallel flows
Enhancement of control plane mechanisms
Additional experiments with interdomain integration
Enhanced integration with clusters and storage devices
49. Additional Topics
Enhanced security methods
Optimization heuristics
Integration with data derivation methods
Extended path protection
Restoration algorithms
Failure prediction and fault protection
Performance metrics, analysis and reporting
Enhanced integration of optical network information flows
with L1 process monitoring