SlideShare a Scribd company logo
2004 IEEE International Symposium on Cluster Computing and the Grid 
DWDM-RAM: Enabling Grid Services with Dynamic Optical Networks 
S. Figueira', S. Naiksata", H. Cohen', D. Cutrell', P. Daspit', D. Gutierrez3, D. B. Hoang4, 
T. Lavian', J. Mambretd, S. Merrill', F. Travostino'. 
'Santa Clara University, 'Nortel Networks Labs,' 'Stanford University, 
University of Technology, Sydney, 'iCAIR and Northwestern University. 
{sfgueira, snaiksatam] @scu.edu, {hcohen, dcutrell, pduspit, tlavian, smerrill, 
tra vos) @ Tiortelnetworks. com, degm @ stanford. edu, dhoang @ it. uts. edu. au, 
j-mambretti@northwestt?m.edu. 
4 
Abstract 
Advances in Grid technology enable the deployment 
of data-intensive distributed applications, which 
require moving Terabytes or even Petabytes of data 
between data banks. The current underlying 
nehvorks cannut provide dedicated links with 
adequate end-to-end sustained bandwidth to support 
ihe requirements of these Grid applications. DWDM-RAM' 
is a novel service-oriented architecture, which 
harnesses the enormous bandwidth potential of 
optical nefivorks and demonstrates their on-demand 
nsage on the OMNlner. Preliminary experiments 
suggest that dynamic optical networks, such as the 
OMNlnet, are the ideal option for transferring such 
massive amounts of data. DWDM-RAM incorporates 
an OGSI/OGSA compliant service interface and will 
promote greater convergence between dynamic 
optical networks and data intensive Grid computing. 
1. Introduction 
DWDM-RAM is a DARPA [IO] funded research 
experiment established to design and implement in 
prototype a new type of Grid service architecture that 
is optimized to support data intensive Grid 
applications through advanced optical networking. 
DWDM-RAM closely integrates Grid data services 
and optical networking services. 
One of the goals of Grid architecture development 
is to enable efficient support for data-intensive 
applications, which may require moving - without 
prior notice - Terabytes or even Petabytes of data 
' DWDM-RAM research was made possible with suppon from 
DARPA. award NO. ~3116nz-98.z-11194. 
0-7803-8430-W04/$20.000 2004 IEEE 
among multiple sites. One of the harriers to achieve 
this goal is the fact that traditional technology used in 
currently deployed networks limits at many levels the 
transfer of massive amounts of data. Although 
availability of sufficient bandwidth is an issue, access 
to resources that provides this bandwidth solves only 
one part of the problem. The complete solution is a 
new network architecture with the ability to 
orchestrate data flows with many different types of 
characteristics, including those requiring 
exceptionally high bandwidth for sustained periods 
of time. In the DWDM-RAM model, these high 
performance data flows are provided by dedicated 
optical paths, which are dynamically allocated. State 
of the art DWDM technology based on dynamic 
wavelength switching enables the creation of Grid 
services that allocate and release these paths either 
on-demand or by advance reservation. 
Grid applications typically need to allocate and 
reserve multiple types of resources, such as 
computational. data, instrumentation, and networks, 
at distributed sites. Services such as the Globus 
Resource Allocation Manager (GRAM) job scheduler 
[8] have been developed to coordinate and schedule 
the computational and data resources needed by Grid 
applications. In [U] ,th e authors propose G A M , the 
General Purpose Architecture for Reservation and 
Allocation, which enables the construction of 
application-level co-reservation and co-allocation 
libraries that applications can use to dynamically 
schedule collections of resources. In GAM, the 
network is treated as a primary resource, which can 
be allocated and reserved as well, and a service 
provides this resource. 
To enable the efficient use of optical networks as 
a primary resource, a novel architecture for the 
reservation and dynamic allocation of individual 
707 
Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.
2004 IEEE International Symposium on Cluster Computing and the Grid 
wavelengths is required. This architecture relies on a 
new network service, which provides options for 
allocating dedicated network resources. This service 
must discover the nctwork topology and both explore 
the availability and optimize the schedule of the 
optical network resources. It should also present a 
standardized, high-level and network-accessible 
interface. A natursl choice for implementing this 
interface is the Open Grid Service Interface (OGSI) 
[27]. Such interfaces are compliant with the GGFs 
OGSA specification [I31 and, in addition, conform to 
widely used Web Services standards (WSDL, SOAP, 
and XML). 
In addition to presenting an OGSI-compliant 
interface, the network service should have a standard 
way of representing wavelength resources for 
communicating with clients. No such standard 
currently exists, For the Grid community, a 
promising approach would he to extend the XML 
form of the Resource Specification Language (RSL) 
[16]. This RSL schema is currently used by GRAM 
for other resources. Adding optical network 
extensions to RSL would make it possible to enhance 
GRAM to handle optical network resources. 
This paper presents an implementation of the 
aforementioned concepts as a part of the DWDM-RAM 
research project. This project encompasses the 
development of two services, the Data Transfer 
Scheduling (DTS) service and the Network Resource 
Scheduling (NRS) service. The DTS service's goal is 
to provide scheduled data transfer between data 
banks. The NRS service's goal is to provide dynamic 
dedicated wavelength, both on demand and by 
advance reservation. The DTS uses the NRS service 
to provide the user application with an optimized 
utilization of the optical network. A preliminary 
implementation of this architecture was first 
demonstrated during the 9' Global Grid Forum, in 
Chicago, October 2003 and then at the 
Supercomputing Conference, in Phoenix, November 
2003. Other results of experiments with dynamic 
wavelength on advanced optical networks 
provisioning for data-intensive Grid applications 
have been recently published [22]. 
This paper is organized as follows: Section 2 
describes dynamic optical networks and their 
features, Section 3 introduces the DWDM-RAM 
architecture, Section 4 presents the interface created 
to allocate wavelengths dynamically, Section 5 
describes the testhed used in the implementation and 
presents initial results, and Section 6 concludes and 
discusses future work. 
2. Optical Networks 
Bulk data transfer oriented grid computing requires 
quality of service, in particular, guaranteed minimum 
bandwidth and minimized packet loss, which are not 
easily achievable in packet switching networks. 
Recently, Grid developers have been using IntServ 
[6] and DiffServ [4] approaches to obtain QoS in 
packet switching networks ([I 11[121[151[211[251). 
IntServ and DiffServ may help in some special cases, 
but they arc far from perfect solutions. Optical 
networks have the potential to change the way 
networks are used in Grid computing. Optical 
networks based on wavelength switching can easily 
provide guaranteed bandwidth and performance in 
terms of low hit error rates. In fact, based on the 
same assumption, other groups have also been 
focusing on providing optical networks to the Grid 
community [26][29]. 
A main concern about wavelength switched 
optical networks is the overhead incurred during the 
end-to-end path setup. However, it should he noted 
that the time taken in the transfer of the huge 
amounts of data generated by Grid applicarions 
amortizes the time spent in the setup. The graph in 
Figure 1 illustrates this fact. It shows the amount of 
time spent in the path setup as a percentage of the 
total transfer time versus data transfers of different 
sizes. These numbers were generated synthetically in 
order to motivate the usage of optical networks in 
different scenarios. We indicate in the graph the 
threshold at which the setup time is about 5% of the 
total time, i.e., the overhead is amortized and 
becomes insignificant. 
100% 
80% 
t 40% 500GB 
30% 
2 20% 
2 10% 
0% 
1w ,ow 10000 100000 l O w w 0 lWoOW0 
File Size (ME) 
Figure 1: Overhead is insignificant at 500 GB 
In Figure I , we assume a setup time of 48 sec and 
a bandwidth of 920 Mhps, in which case the 
threshold is 500 GB. Since Grid applications usually 
708 
Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.
2004 IEEE International Symposium on Cluster Computing and the Grid 
transfer huge data sets, it is clear that the time for the 
path setup is negligible in Grid computing. 
Note that 48 sec is the currently observed average 
upper-bound time for the path setup, and 920 Mbps is 
the currently observed maximum throughput (see 
Section 5). Of equal importance is the time required 
to deallocate resources to enable subsequent usage, 
once the data transfer is complete. This has been 
observed to be around llsec (see Section 5) and is 
also insignificant in comparison to the data transfer 
time. 
3. The DWDM-RAM Architecture 
The DWDM-RAM architecture shown in Figure 2 
closely fits the Grid Architecture described in [14]. 
This architecture also leverages the Globus Toolkit 
3’s functionality. The main modules are explained 
below. 
Fabric: OMNInet and ODIN 
The OMNInet photonic testhed network [3] 
implemented across a metro area constitutes the 
shared resource in the DWDM-RAM architecture. 
Optical Dynamic Intelligent Network* (ODIN) 
1.17][18][22] is the software suite that controls the 
OMNInet through various lower-level API calls 
presented in Section 5. ODIN has been designed for 
extremely high performance, long term Terabit data 
Ilows with flexible and fine grained control. It is a 
stateless server implementation, which includes a 
simple API to provide path provisioning and 
monitoring to the higher layers. 
Connectivity: TCP/IP, HTTP, SOAP, JAX-RPC 
Currently, the DWDM-RAM system uses standard 
off-the-shelf communication protocol suites to 
communicate requests and responses between 
application clients and DWDM-RAM services and 
also among DWDM-RAM components. Requests 
and responses conform to OGSI and Web Services 
specifications, i.e., they are SOAP messages, carried 
in HTTP envelopes and transported over TCPflP 
connections. The SOAP messages are encoded using 
IAX-RPC to facilitate interoperability between 
existing Java-based Globus toolkit and the DWDM-RAM 
components. 
Figure 2: The DWDM-RAM architecture 
Resource: DWDM-RAM Network Resource 
Scheduling (NRS) Service 
The Resource and Connectivity protocol layers form 
the neck of our “hourglass model” [23] based 
architecture. The NRS is essentially a resource 
management service, which supports protocols that 
offer advance reservations and QoS. It maintains 
schedules and provisions resources in accordance 
with the schedule. It provides an OGSMOGSI 
compliant interface to request the optical network 
resources. It has complete understanding of dynamic 
lightpath provisioning and communicates these 
requests to the Fabric layer entities. In our 
architecture, the NRS can stand alone without the 
DTS (see Collective layer). GARA integration is an 
important avenue for future development. A key 
feature is the ability to reschedule reservations, 
which satisfy under-constrained scheduling requests, 
in order to accommodate new requests and changes 
in resource availability. Requests may be under-constrained 
through specification of a target 
reservation window, which is larger than the 
requested duration, through open-ended 
specifications, such as “ASAP”, or through more 
sophisticated request specifications, such as client-provided 
utility functions for evaluating scheduling 
’ODIN research was made passible with suppan from the National 
Science Foundation: awwd - ANI-0123399 
709 
Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.
2004 IEEE International Symposium on Cluster Computing and the Grid 
costs. Models for priorities and accounting can also 
be incorporated into the scheduling algorithms. 
Collective: DWDM-RAM Data Transfer 
Scheduling (DTS) Service 
The DTS service is a direct extension of the NRS 
service. The DTS shares the same hackend 
scheduling engine and resides on the same host. It 
provides a higher-level functionality that allows 
applications to schedule advance reservations for 
data transfers without the need to directly schedule 
path reservations with the NRS service. The DTS 
service requires additional infrastructure in the form 
of services living at the data transfer endpoints. 
These services perform the actual data transfer 
operations once the network resources are allocated. 
As with the NRS, the DTS has an OGSI interface, 
and GARA integration is a planned avenue for future 
development. As an extension of the NRS, the DTS 
also employs under-constrained scheduling requests 
in order to accommodate new requests and changes 
in resource availability. 
It is important to note that, in the DWDM-RAM 
design, the application at the endpoints drives the 
statc and decisions by DTS, NRS, and ODIN, thus in 
full compliance with the end-to-end argument [24]. 
These intervening layers never attempt to re-construct 
nor second-guess an application's intent 
from traffic. Instead, they follow the explicit 
command and control from the application. These 
layers are best positioned to appreciate both 
application's commands and network status, while 
bridging meaningfully between the two. 
Also, we plan to have DWDM-RAM comply with 
the so-called fate-sharing principle [7].T his design 
principle argues that it is acceptable to lose the state 
information associated with an entity if, at the same 
time, the entity itself is lost. In this case, DTS, NRS, 
and ODD4 will make a point of reclaiming resources 
once an application is terminated, or is found to he 
non-responsive for a configurable time interval. 
4. Dynamically Allocating Bandwidth 
On-Demand 
For wavelength switching to be useful for Grid 
applications, a network service with an application 
level interface is required to request, release and 
manage the underlying network resources. Previous 
work has been done in defining an OGSNOGSI 
based network service interface to network resources. 
In 1121, for example, the authors describe a service 
that provides allocation of bandwidth in IntServ 
networks. Our approach follows their model but 
develops a more comprehensive schedule and 
reservation based Network Resource Scheduling 
(NRS) service, which provides user applications with 
access to underlying optical network resources. This 
service should guarantee dedicated access to the 
optical links, which may be requested on-demand or 
by advance reservation. Advance reservation requests 
can he under-constrained, which means the request 
can be satisfied by more than one possible time slot. 
This allows the service to reschedule reservations as 
needed to satisfy future requests and changing 
conditions. 
The NRS also attempts to provide an interface 
with different levels of detail. Some coordinating and 
scheduling clients may need only high-level facilities 
like those for individual applications. For these 
applications, the interface should allow the request of 
light paths, hut these clients do not need to have 
knowledge of the details of the underlying network 
topology or management protocols. However, clients 
that attempt to optimize network resources use may 
need a richer interface, e.g., they may need to be able 
to schedule individual optical segments. For these 
clients, the interface should allow the request of 
individual segments. Although these clients may 
need knowledge of the network topology, they 
should still be insulated from the network 
management protocols. 
We have started by implementing a network 
service with a simple application-level interface. This 
service is able to allocate dynamically dedicated end-to- 
end light paths requested on demand. The 
following were the goals for this initial interface: 
It should be usable by Grid applications. 
It should be network-accessible from any 
authorized host. 
It should be standards-based and not require any 
proprietary technology. 
It should allow the application to specify 
parameters of the desired optical path that are 
relevant at the application level. 
It should hide the details of the underlying 
network topology and network management 
protocols. 
It should support the immediate allocation of 
bandwidth, but should be easy to extend in order 
to incorporate future scheduling. 
At the highest level, the interface described here is 
wrapped in a Java implementation that shields the 
caller from the details of the application-level 
protocols, which are needed to communicate with the 
710 
Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.
2004 IEEE International Symposium on Cluster Computing and the Grid 
service. The service itself hides various lower level 
network topology and management protocols from 
the caller. 
This current interface exposes two methods to the 
user: allocateNetworkPath and 
deallocateNetworkPath. The method 
allocateNetworkPath requests a path between 
the end hosts. The path allocated should meet the 
criteria specified in the parameter object passed to the 
method. These parameters include the network 
addresses of the hosts to he connected, the minimum 
and maximum acceptable bandwidths, and the 
maximum duration of the allocation. The 
allocateNetworkPath method returns to the 
caller an object containing descriptive information on 
the path that was allocated. This object also serves as 
a handle for the deallocateNetworkPath 
rcquest. By adding parameters representing earliest 
and latest acccptable start times, this interface can he 
extended to accommodate under-constrained advance 
reservations. 
The NRS interface suggests likely properties for a 
service that may implement this interface. Such a 
service can he implemented in a way that does not 
maintain any session or context information for any 
particular client between calls. The only necessary 
context information is the allocated path identifier, 
which the client is required to supply in order to 
deallocate a path. The service must maintain this 
information ahout these allocated paths so, in this 
sense, it is not “stateless,” but each client call can he 
treated as a self-contained unit and processed entirely 
in a single-message exchange. Thus, the interface 
tits the service oriented architecture of Web Services 
[5] quite closely. 
At the same time, we believe that it is important to 
conForm to the emerging Open Grid Services 
Architecture (OGSA) Grid standard to be accessible 
to Grid applications that use this architecture. Hence 
the NRS interface also conforms to the Open Grid 
Services Infrastructure (OGSI) interface for services. 
This interface, in its basic form, is a Web Service 
interface with some additional conventions from the 
OGSI standard. Although client access is via a 
normal Java interface as described above. internally, 
the client-service interface is an OGSI Web Service 
implemented using SOAP and the JAX-RPC API. 
The OGSI implementation is quite lean (no SDEs), 
and therefore the conversion to new specifications 
like the WS-Resource Framework (WS-RF) [301 will 
be a somewhat mechanical process. In fact, the 
DWDM-RAM architecture builds the concept of a 
Network Service from the ground up and is fairly 
well insulated from either OGSI, or WS-RF, or any 
other emerging specification that may prevail. In any 
case, the user of the NRS service is spared any direct 
contact with the underlying middleware. 
5. Testbed, Experiments and Result 
The testbed for the DWDM-RAM system is provided 
by a next-generation large-scale MetroLAN dynamic 
optical network extent called the OMNInet [3], 
operational since 2001. OMNInet uses metro dark 
fiber infrastructure, which has been provided by SBC 
to connect locations sponsored by Northwestern 
University, and a mix of product and rcsearch 
equipmcnt from Nortel Networks. OMNInet has been 
deployed at four locations in the Chicago metro area 
and is configured in a partial-mesh IOGE DWDM 
network. Each location has a MEMS based 8 x 8 
DWDM photonic switch interfaced with a Nortel 
Passport 8600 Ethernet Routing Switch, providing 4 
x lOGE line interfaces and up to 32 x IGE client 
interfaces. The OMNInet configuration is shown in 
Figure 3. 
Univ oflllinois, Chiraxo Northwestern Unir 
uu 
Figure 3 OMNlnet core nodes 
The dynamic light path provisioning of the 
OMNlnet is provided by the Optical Dynamic 
Intelligent Network (ODIN) services module, which 
manages the optical network control plane and 
resource provisioning including path allocation, 
deletion, and setting of attributes. ODIN uses an O F 
UNI 1.0 [28] compliant UN1 library to interface with 
the OMNInet unified control plane. The control plane 
is orchestrated by a GMPLS [20] based CR-LDP [ I ] 
implementation, which is used to establish the label 
forwarding state along the routes computed by an 
enhanced OSPF (constraint-based routing) 
71 1 
Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.
2004 IEEE International Symposium on Cluster Computing and the Grid 
algorithm5. (Note: An RSVP-TE [2] implementation 
to support advance reservations is also in the process 
of being deployed.) The technological breakthrough 
in the design of the OMNInet photonic switches, 
coupled with the tight integration of the control 
software, brings down the provisioning time from 
months to a few seconds. This is the critical enabling 
factor in on-demand provisioning, which makes 
dynamic optical networks an important technology 
for data-intensive Grid computing. 
Figure 4 compares the efficiency of packet 
switching with lambda switching, executing with 
different amounts of bandwidth, by plotting the 
amount of data transferred against the time taken in 
seconds. This graph was generated synthetically. The 
path setup takes 48 sec which was recorded in 
experiments (explained in detail later). The path 
setup time includes the time required to request a 
path, allocate the path, configure the layer I and 2 
components of the network and update the relevant 
tables. It is important to note that only a miniscule 
fraction (approximately 20 milliseconds) of this delay 
is actually due to the setting up of the path within the 
optical switch. A part of the setup delay is also due to 
the propagation of state information through the 
photonic nodes and optical paths. The major portion 
of the delay is introduced by switches at the edge of 
the optical network, which switch the data to and 
from the end hosts. This is an artifact of the current 
network setup, and with fairly simple optimizations, 
we expect to bring this 48 sec delay down 
significantly. 
amshed 
ISW M W 1 GbW 
5000 
45W -PlhkBI 
mdtcned 
4oW 1% M W 
--Lamu 
I1oGbpSl 
e g - 
35W 3oW 
$ =W 
Imched 
I750 Mbw) 
rwhed (l 
moo 
15W 
1000 
5w 
0 
0 20 40 60 80 1W 120 
rim (S) 
Figure 4: Packed Switched.vs. Lambda Network -- 
Setup time tradeoffs. 
For the OMNlnet metro photonic networking research, the 
GMPLS. 0-UNI. LMP smdards we implemented as Nortel 
Networks proprietary Wavelength Routing and Distribution 
Protocol (WRDP) optical control plane software suite. 
The important information obtained by this graph 
is the crossover points at which the optical network 
becomes a better option than the packet switched 
network. Note that when the path setup takes 48 sec, 
the crossover point can he with files as small as 1.9 
GB and up to 4.5 GB. The graph affirms the 
enormous advantage of the DWDM-RAM system 
over other packet switching systems when 
transferring large data sets and presents an exciting 
option for the Grid community. 
Note that, for transferring smaller amounts of 
data, the packet switching traditional approach may 
be a better option. The appropriate network to use, in 
each case, should bc decided by co-allocation 
services, as defined in [9][ 121. These co-allocation 
scheduling services use information about the 
resource's capabilities and the application's 
requirements to allocate a performance-efticient set 
of resources for the application. 
Figure S presents a throughput graph for a 30 GB 
memory-to-memory transfer. The smooth curve is the 
average effective data-transfer rate, including the 
startup cost of allocating the lightpath. The jagged 
curve, averaging around 440 Mbps, is the 
instantaneous throughput, measured in 0.1 sec 
intervals on the receiving machine. Note that the 
throughput periodically jumped to about 530 Mhps 
for a sustained period of about 100 seconds, a 
phenomenon under investigation. For this 30 GB data 
transfer, we can see that the startup costs begin to be 
amortized after about 230 sec or 12.2 GB. 
. . . . ... . 
. ' . . . 
Figure 5: Instantaneous and average throughput for a 
30 GB memoly-to-memory transfer over OMNlnet 
using TCP as transport protocol. 
The above experiment was run on dual PIII 
997MHz machines with S12MB memory, 1GB swap 
space, running on Red Hat Linux 7.3 (Kernel: 2.4.18- 
3") and using I GigE NIC cards. Note that we 
used the Linux networking protocol stack with no 
performance tuning. 
71 2 
Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.
PO04 IEEE International Symposium on Cluster Computing and the Grid 
of the channel. Currently, the default UDT protocol 
values are being used, namely, UDT buffer size of 
40,960,000 bytes, UDP send buffer of 64KB. UDP 
receive buffer of 4 MB, and flow window size of 
25600. We believe that tuning these parameters to the 
OMNInet testhed will yield a higher throughput. 
Table 1: Auplication level measurements recorded for 
.. 
a 20GB file transfer I Event I Seconds 
Start : File transfer request arrives 1 0.0 
Path Allocation request I 0.5 
ODIN server processing 
When performing file transfer in the above setup 
we observed large oscillations in the instantaneous 
throughput, which resulted in significantly lower 
average throughput. We suspected that this was an 
artifact of using standard TCP. This prompted us to 
experiment using UDT [ 191, a high performance data 
transfer protocol. Figure 6 shows a 15 GB memory-to- 
memory data transfer using UDT as the underlying 
transport protocol. The throughput has been sampled 
at 0.1 sec intervals. The maximum and the average 
throughput recorded were 920 Mhps and-680 Mbps, 
respectively. 
2.6 
Network reconfiguration 
Data transfer 
Path deallocation request 
45 
622 
0.3 
T-1-1 r&ource accessed through a Grid service, which is 
necessary for data-intensive applications. The 
Figure 6: Instantaneous throughput recorded for a 15 DWDM-RAM system presented here addresses 
GB memory-to-memory transfer over OMNlnet using limitations of traditional implementations and 
UDT a s transport protocol. facilitates on demand optical channel (lightpath) 
The numbers in Figure 6 show a better 
performance than those in Figure 5, reinforcing our 
initial suspicion that TCP was affecting the 
throughput. We also performed file transfer 
experiments using UDT. For a 20 GB tile transfer, 
the maximum and the average throughput recorded 
were 376 Mbps and 272 Mbps respectively. These 
are significantly lower than those seen in Figure 6, 
leading us to believe that issues like disk YO on both 
ends of the data pipe, buffering, and similar factors 
impact the average throughput in the disk-to-disk file 
transfers. 
Table 1 shows a breakup of the total end-to-end 
time required for the above file transfer operation to 
complete. It is important to note that the lightpath 
used to transfer data in the experiment described was 
dynamically allocated and dedicated to the file 
transfer. 
While UDT does seem to have had a favorable 
impact on the average throughput, it is evident from 
the graph of Figure 6, that there are still oscillations 
in the instantaneous throughput. Also, the average 
throughput is less than the maximum 1 Gbps capacity 
- . 
provisioning. We have also presented an 
OGSAJOGSI compliant interface developed to ease 
the usage of the OMNInet by Grid applications. 
The interface presented meets the needs of many 
applications, hut it should be extended to include 
features that may be necessary or desirable in other 
circumstances. One of our main goals is to make the 
interface G A M compliant and able to provide a 
comprehensive, re-schedulable and window-based, 
network service as discussed in Section 3. 
We are currently exploring UDT and other high 
performance transport protocols which can help to 
achieve a uniform throughput close to the maximum 
limits. This, coupled with the facility to aggregate 
several channels to transfer one large tile, will 
dramatically impact the data transfer time perceived 
by the user. 
While a photonic switched network like OMNInet 
may be ideal for a DWDM-RAM-like architecture, 
our experiments suggest that DWDM-RAM could 
also he implemented on a traditional optical-electrical- 
optical (OEO) network. Providing a solid 
interface to such optical networks is a key step in 
enabling its usage by the Grid community. Our initial 
71 3 
Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.
2004 IEEE International Symposium on Cluster Computing and the Grid 
experiments have been extremely promising, and we Integration,” Open Grid Service Infrastructure WG, 
are continuing to improve the network service 
Acknowledgements 
The authors would like to thank Aaron Johnson, Fei 
Yeh, Jeremy Weinberger, Jim Chen, and David 
Lilithun from ICAIR, and Ramesh Durairaj, Inder 
Monga, and Phil Wang from Nortel Networks, for 
their invaluable contributions. 
References 
[I] P. Ashwood-Smith (Ed) and L. Berger (Ed), 
“Generalized Multi-Protocol Label Switching 
(GMPLS) Signaling Constraint-based Label 
Distribution Protocol (CR-LDP) Extensions,” RFC 
3472, January 2003. 
121 D. Awduche et al., “RSVP-TE: Extensions to RSVP 
for LSP Tunnels,” RFC 3209, December 2001. 
[3] E. Bernier et al., “OMNlnet: A Metropolitan 10Gh/s 
DWDM Photonic Switched Network Trial.” 
Submitted for OFC 2004, Feb 22 - 27, 2004. (In 
YPYi_PW..), 
[4] S. Blake et al., “An Architecture for Differentiated 
Services,’’ IETF RFC 2475. 
[SI D. Booth, et al., “Web Services Architecture,” 
http://www.w3.org/TR/2003/WBws-arch- 
20030808/wsa.pdf 
[61 R. Braden et al., RFC 1633: Integrated Services in the 
Internet Architecture: an Overview, Inremet RFC 
1633, July 1994. 
[7] D. Clark, ‘The design philosophy of the DARPA 
Internet protocols,” in Proceedings of ACM 
SICCOMM, Stanford. CA, pp. 106--114, August 
1988. 
[XI K. Czajkowski et al., “A Resource Management 
Architecture for Metacomputing Systems,” in 
Proceedings of IPPYSPDP ‘98 Workshop on Job 
Scheduling Strategies for Purullel Processing, pp. 62- 
82, 1998. 
[9] K. Czajkowski et al., “Resource Co-Allocation in 
Computational Grids,” Proceedings of the Eighrh 
IEEE Internarional Symposium on High Per/ormunce 
Distributed Computing (HPDC-8I, pp. 219-228, 1999. 
[IO] Department of Defense Advanced Research Projects 
Agency (http://www.darpa.miV) 
[ I l l 1. Foster et al., “End-to-End Quality of Service for 
High-end Applications,” Computer Communicurions, 
Speciul Issue on Network Supporr for Grid 
Computing, 2002. 
[I21 1. Foster et al., “A Distributed Resource Management 
Architecture that Supports Advance Reservations and 
Co-Allocation,” Inremotional Workshop on Qualify of 
Service, 1999. 
[I31 1. Foster et al., ‘The Physiology of the Grid An Open 
Grid Services Architecture for Distributed Systems 
Global Grid Forum, June 2002. 
[I41 1. Foster et al., ‘The Anatomy of the Grid Enabling 
Scalable Virtual Organizations.” lnremationul Joumal 
of Superrompurer Applications, 15(3), 2001. 
[IS] 1. Foster et al., “A Quality of Service Architecture that 
Combines Resource Reservation and Application 
Adaptation,” 8th International Workshop on Qualiy 
of Service, 2000. 
[I61 “The Globus Resource Specification Language RSL 
VI.O ,” http://www.globus.org/gram/rsI_specl .html. 
[I71 R. Grossman et al., “Experimental Studies Using 
Photonic Data Services at Grid 2002.” Joumal of 
Future Computer Systems. Elsevier Press, pp.945-956, 
August 2003. 
[IS] R. Grossman et al., “Photonic Data Services: 
Integrating Path, Network and Data Services to 
Support Next Generation Data Mining Applications,” 
NGDMM, Proceedings, November 2002. 
[I91 Y. Gu and R. Grossman, “End-to-End Congestion 
Control for High Performance Data Transfer.” 
submitted to IEEWACM Transactions on Networking. 
[ZO] L. Berger (Ed), “Generalized Multi-Protocol Label 
Switching (GMPLS) Signaling Functional 
Description.” RFC 3471, January 2003. 
[211 G. Hoo et al., “QoS as Middleware: Bandwidth 
Reservation System Design,’’ Proceedings of rhe 8th 
IEEE Symposium on High Perfurmunce Distributed 
Computing, pp. 345-346, 1999. 
[22] I. Mambretti et al., “The Photonic TeraStream: 
Enabling Next Generation Applications Through 
Intelligent Optical Networking at Grid 2002,” Joumul 
of Future Computer Systems, Elsevier Press. August 
2003, pp.897-908. 
[23] “Realizing the Information Future: The Internet and 
Beyond,” National Academy Press, 1994, 
http://www.nap.edu/readingroom/books/rti 
[24] I. Saltzer et al., “End-to-end arguments in system 
design,” ACM Transactions on Computer Systems, pp. 
277-288, 1984. 
[ZS] V. Sander et al.. “A Differentiated Services 
Implementation for High-Performance TCP Flows,” 
Elsevier Computer Networks, 34915-929.2000. 
[26] L. Smarr et al., ‘The OptlPuter,” Communications of 
the ACM, Vol. 46, No. 1 I, pp. 58-67, November 2003. 
[271 S. Tuecke et al., “Open Grid Services Infrastructure 
(OGSI) Version 1.0,” Global Grid Forum Draft 
Recommendation, June 2003. 
[28] “User Network Interface (UNI) 1.0 Signaling 
Specification,” http://www.oiforum.com/public/docu 
ments/O1F-UNI-01 .O.pdf 
[29] D. Vanderster, ‘The Return of Circuit Switching: A 
Review of User-Controlled Lightpaths for Grid 
Computing,” Technical Report, University of 
Victoria, Canada, August 2003. 
[301 “WS-Resource Framework,” http://www-fp. 
globus.org/wsrt/ 
71 4 
Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.

More Related Content

What's hot

International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)
IJERD Editor
 
HYBRID OPTICAL AND ELECTRICAL NETWORK FLOWS SCHEDULING IN CLOUD DATA CENTRES
HYBRID OPTICAL AND ELECTRICAL NETWORK FLOWS SCHEDULING IN CLOUD DATA CENTRESHYBRID OPTICAL AND ELECTRICAL NETWORK FLOWS SCHEDULING IN CLOUD DATA CENTRES
HYBRID OPTICAL AND ELECTRICAL NETWORK FLOWS SCHEDULING IN CLOUD DATA CENTRES
ijcsit
 
A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...
A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...
A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...
IJCNCJournal
 
Crosslayertermpaper
CrosslayertermpaperCrosslayertermpaper
Crosslayertermpaper
B.T.L.I.T
 
A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...
A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...
A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...
IJCNCJournal
 
Dual-resource TCPAQM for Processing-constrained Networks
Dual-resource TCPAQM for Processing-constrained NetworksDual-resource TCPAQM for Processing-constrained Networks
Dual-resource TCPAQM for Processing-constrained Networks
ambitlick
 
Iaetsd survey on wireless sensor networks routing
Iaetsd survey on wireless sensor networks routingIaetsd survey on wireless sensor networks routing
Iaetsd survey on wireless sensor networks routingIaetsd Iaetsd
 
Clustering effects on wireless mobile ad hoc networks performances
Clustering effects on wireless mobile ad hoc networks performancesClustering effects on wireless mobile ad hoc networks performances
Clustering effects on wireless mobile ad hoc networks performances
ijcsit
 
ADAPTIVE RANDOM SPATIAL BASED CHANNEL ESTIMATION (ARSCE) FOR MILLIMETER WAVE ...
ADAPTIVE RANDOM SPATIAL BASED CHANNEL ESTIMATION (ARSCE) FOR MILLIMETER WAVE ...ADAPTIVE RANDOM SPATIAL BASED CHANNEL ESTIMATION (ARSCE) FOR MILLIMETER WAVE ...
ADAPTIVE RANDOM SPATIAL BASED CHANNEL ESTIMATION (ARSCE) FOR MILLIMETER WAVE ...
IJCNCJournal
 
A novel cache resolution technique for cooperative caching in wireless mobile...
A novel cache resolution technique for cooperative caching in wireless mobile...A novel cache resolution technique for cooperative caching in wireless mobile...
A novel cache resolution technique for cooperative caching in wireless mobile...
csandit
 
A comparative analysis on qos multicast routing protocols in MANETs
A comparative analysis on qos multicast routing protocols in MANETsA comparative analysis on qos multicast routing protocols in MANETs
A comparative analysis on qos multicast routing protocols in MANETs
IOSR Journals
 
A smart clustering based approach to
A smart clustering based approach toA smart clustering based approach to
A smart clustering based approach to
IJCNCJournal
 
A Cooperative Cache Management Scheme for IEEE802.15.4 based Wireless Sensor ...
A Cooperative Cache Management Scheme for IEEE802.15.4 based Wireless Sensor ...A Cooperative Cache Management Scheme for IEEE802.15.4 based Wireless Sensor ...
A Cooperative Cache Management Scheme for IEEE802.15.4 based Wireless Sensor ...
IJECEIAES
 
DYNAMIC HYBRID CHANNEL (WMN) FOR BANDWIDTH GUARANTEES IN AD_HOC NETWORKS
DYNAMIC HYBRID CHANNEL (WMN) FOR BANDWIDTH GUARANTEES IN AD_HOC NETWORKSDYNAMIC HYBRID CHANNEL (WMN) FOR BANDWIDTH GUARANTEES IN AD_HOC NETWORKS
DYNAMIC HYBRID CHANNEL (WMN) FOR BANDWIDTH GUARANTEES IN AD_HOC NETWORKS
pharmaindexing
 
Dynamic Hybrid Topology Design for Integrated Traffic Support in WDM Mesh Net...
Dynamic Hybrid Topology Design for Integrated Traffic Support in WDM Mesh Net...Dynamic Hybrid Topology Design for Integrated Traffic Support in WDM Mesh Net...
Dynamic Hybrid Topology Design for Integrated Traffic Support in WDM Mesh Net...
CSCJournals
 
ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...
ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...
ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...
IJCNCJournal
 
Performance evaluation of qos in
Performance evaluation of qos inPerformance evaluation of qos in
Performance evaluation of qos in
caijjournal
 
Congestion control, routing, and scheduling 2015
Congestion control, routing, and scheduling 2015Congestion control, routing, and scheduling 2015
Congestion control, routing, and scheduling 2015
parry prabhu
 
Efficient Design of p-Cycles for Survivability of WDM Networks Through Distri...
Efficient Design of p-Cycles for Survivability of WDM Networks Through Distri...Efficient Design of p-Cycles for Survivability of WDM Networks Through Distri...
Efficient Design of p-Cycles for Survivability of WDM Networks Through Distri...
CSCJournals
 

What's hot (19)

International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)
 
HYBRID OPTICAL AND ELECTRICAL NETWORK FLOWS SCHEDULING IN CLOUD DATA CENTRES
HYBRID OPTICAL AND ELECTRICAL NETWORK FLOWS SCHEDULING IN CLOUD DATA CENTRESHYBRID OPTICAL AND ELECTRICAL NETWORK FLOWS SCHEDULING IN CLOUD DATA CENTRES
HYBRID OPTICAL AND ELECTRICAL NETWORK FLOWS SCHEDULING IN CLOUD DATA CENTRES
 
A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...
A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...
A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...
 
Crosslayertermpaper
CrosslayertermpaperCrosslayertermpaper
Crosslayertermpaper
 
A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...
A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...
A Novel Routing Strategy Towards Achieving Ultra-Low End-to-End Latency in 6G...
 
Dual-resource TCPAQM for Processing-constrained Networks
Dual-resource TCPAQM for Processing-constrained NetworksDual-resource TCPAQM for Processing-constrained Networks
Dual-resource TCPAQM for Processing-constrained Networks
 
Iaetsd survey on wireless sensor networks routing
Iaetsd survey on wireless sensor networks routingIaetsd survey on wireless sensor networks routing
Iaetsd survey on wireless sensor networks routing
 
Clustering effects on wireless mobile ad hoc networks performances
Clustering effects on wireless mobile ad hoc networks performancesClustering effects on wireless mobile ad hoc networks performances
Clustering effects on wireless mobile ad hoc networks performances
 
ADAPTIVE RANDOM SPATIAL BASED CHANNEL ESTIMATION (ARSCE) FOR MILLIMETER WAVE ...
ADAPTIVE RANDOM SPATIAL BASED CHANNEL ESTIMATION (ARSCE) FOR MILLIMETER WAVE ...ADAPTIVE RANDOM SPATIAL BASED CHANNEL ESTIMATION (ARSCE) FOR MILLIMETER WAVE ...
ADAPTIVE RANDOM SPATIAL BASED CHANNEL ESTIMATION (ARSCE) FOR MILLIMETER WAVE ...
 
A novel cache resolution technique for cooperative caching in wireless mobile...
A novel cache resolution technique for cooperative caching in wireless mobile...A novel cache resolution technique for cooperative caching in wireless mobile...
A novel cache resolution technique for cooperative caching in wireless mobile...
 
A comparative analysis on qos multicast routing protocols in MANETs
A comparative analysis on qos multicast routing protocols in MANETsA comparative analysis on qos multicast routing protocols in MANETs
A comparative analysis on qos multicast routing protocols in MANETs
 
A smart clustering based approach to
A smart clustering based approach toA smart clustering based approach to
A smart clustering based approach to
 
A Cooperative Cache Management Scheme for IEEE802.15.4 based Wireless Sensor ...
A Cooperative Cache Management Scheme for IEEE802.15.4 based Wireless Sensor ...A Cooperative Cache Management Scheme for IEEE802.15.4 based Wireless Sensor ...
A Cooperative Cache Management Scheme for IEEE802.15.4 based Wireless Sensor ...
 
DYNAMIC HYBRID CHANNEL (WMN) FOR BANDWIDTH GUARANTEES IN AD_HOC NETWORKS
DYNAMIC HYBRID CHANNEL (WMN) FOR BANDWIDTH GUARANTEES IN AD_HOC NETWORKSDYNAMIC HYBRID CHANNEL (WMN) FOR BANDWIDTH GUARANTEES IN AD_HOC NETWORKS
DYNAMIC HYBRID CHANNEL (WMN) FOR BANDWIDTH GUARANTEES IN AD_HOC NETWORKS
 
Dynamic Hybrid Topology Design for Integrated Traffic Support in WDM Mesh Net...
Dynamic Hybrid Topology Design for Integrated Traffic Support in WDM Mesh Net...Dynamic Hybrid Topology Design for Integrated Traffic Support in WDM Mesh Net...
Dynamic Hybrid Topology Design for Integrated Traffic Support in WDM Mesh Net...
 
ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...
ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...
ON THE PERFORMANCE OF INTRUSION DETECTION SYSTEMS WITH HIDDEN MULTILAYER NEUR...
 
Performance evaluation of qos in
Performance evaluation of qos inPerformance evaluation of qos in
Performance evaluation of qos in
 
Congestion control, routing, and scheduling 2015
Congestion control, routing, and scheduling 2015Congestion control, routing, and scheduling 2015
Congestion control, routing, and scheduling 2015
 
Efficient Design of p-Cycles for Survivability of WDM Networks Through Distri...
Efficient Design of p-Cycles for Survivability of WDM Networks Through Distri...Efficient Design of p-Cycles for Survivability of WDM Networks Through Distri...
Efficient Design of p-Cycles for Survivability of WDM Networks Through Distri...
 

Viewers also liked

Resume Sanjay D Gowda2
Resume Sanjay D Gowda2Resume Sanjay D Gowda2
Resume Sanjay D Gowda2Sanjay Gowda
 
El teatro anterior a 1936
El teatro anterior a 1936 El teatro anterior a 1936
El teatro anterior a 1936
jsaboritbasanta
 
001 MobileDayCol - MillwardBrown - James Galpin - Connecting with colombian c...
001 MobileDayCol - MillwardBrown - James Galpin - Connecting with colombian c...001 MobileDayCol - MillwardBrown - James Galpin - Connecting with colombian c...
001 MobileDayCol - MillwardBrown - James Galpin - Connecting with colombian c...
Mobile Marketing Association
 
How to put google in your classroom
How to put google in your classroomHow to put google in your classroom
How to put google in your classroom
Chris Yukna
 
Koning Boudewijn wilde André Leysen als premier
Koning Boudewijn wilde André Leysen als premierKoning Boudewijn wilde André Leysen als premier
Koning Boudewijn wilde André Leysen als premier
Thierry Debels
 
Abc da aids apresentação power point
Abc da aids   apresentação power pointAbc da aids   apresentação power point
Abc da aids apresentação power pointNilton Goulart
 
Obesidad
ObesidadObesidad
Obesidadmaik607
 
INDIAN ENGINEERING SECTOR
INDIAN ENGINEERING SECTORINDIAN ENGINEERING SECTOR
INDIAN ENGINEERING SECTOR
Sweta Leena Panda
 
IPSAS Implementation at the United Nations - Unis Valencia Williams-Baker, Un...
IPSAS Implementation at the United Nations - Unis Valencia Williams-Baker, Un...IPSAS Implementation at the United Nations - Unis Valencia Williams-Baker, Un...
IPSAS Implementation at the United Nations - Unis Valencia Williams-Baker, Un...
OECD Governance
 
La tutela dei domain names
La tutela dei domain namesLa tutela dei domain names
La tutela dei domain names
Massimo Farina
 
SENCO Restorative Practice
SENCO Restorative PracticeSENCO Restorative Practice
SENCO Restorative Practice
MoniRTLB
 
Abordagem da vitima de trauma
Abordagem da vitima de traumaAbordagem da vitima de trauma
Abordagem da vitima de traumaNilton Goulart
 
Solictud de credito
Solictud de creditoSolictud de credito
Solictud de credito
Lina Bernal
 
It's The Cause, Not the College: Expanding Content Marketing Beyond the Brand
It's The Cause, Not the College: Expanding Content Marketing Beyond the BrandIt's The Cause, Not the College: Expanding Content Marketing Beyond the Brand
It's The Cause, Not the College: Expanding Content Marketing Beyond the Brand
Gene Begin
 

Viewers also liked (20)

Resume Sanjay D Gowda2
Resume Sanjay D Gowda2Resume Sanjay D Gowda2
Resume Sanjay D Gowda2
 
Abcd aids -
Abcd   aids -Abcd   aids -
Abcd aids -
 
El teatro anterior a 1936
El teatro anterior a 1936 El teatro anterior a 1936
El teatro anterior a 1936
 
Abcd aids
Abcd   aidsAbcd   aids
Abcd aids
 
001 MobileDayCol - MillwardBrown - James Galpin - Connecting with colombian c...
001 MobileDayCol - MillwardBrown - James Galpin - Connecting with colombian c...001 MobileDayCol - MillwardBrown - James Galpin - Connecting with colombian c...
001 MobileDayCol - MillwardBrown - James Galpin - Connecting with colombian c...
 
How to put google in your classroom
How to put google in your classroomHow to put google in your classroom
How to put google in your classroom
 
Koning Boudewijn wilde André Leysen als premier
Koning Boudewijn wilde André Leysen als premierKoning Boudewijn wilde André Leysen als premier
Koning Boudewijn wilde André Leysen als premier
 
Abc da aids apresentação power point
Abc da aids   apresentação power pointAbc da aids   apresentação power point
Abc da aids apresentação power point
 
Obesidad
ObesidadObesidad
Obesidad
 
INDIAN ENGINEERING SECTOR
INDIAN ENGINEERING SECTORINDIAN ENGINEERING SECTOR
INDIAN ENGINEERING SECTOR
 
IPSAS Implementation at the United Nations - Unis Valencia Williams-Baker, Un...
IPSAS Implementation at the United Nations - Unis Valencia Williams-Baker, Un...IPSAS Implementation at the United Nations - Unis Valencia Williams-Baker, Un...
IPSAS Implementation at the United Nations - Unis Valencia Williams-Baker, Un...
 
Abandono de _rea[1]
Abandono de _rea[1]Abandono de _rea[1]
Abandono de _rea[1]
 
Abandono em edificio
Abandono em edificioAbandono em edificio
Abandono em edificio
 
La tutela dei domain names
La tutela dei domain namesLa tutela dei domain names
La tutela dei domain names
 
SENCO Restorative Practice
SENCO Restorative PracticeSENCO Restorative Practice
SENCO Restorative Practice
 
Abordagem da vitima de trauma
Abordagem da vitima de traumaAbordagem da vitima de trauma
Abordagem da vitima de trauma
 
Abandono de área
Abandono de áreaAbandono de área
Abandono de área
 
Abandono de areas
Abandono de areasAbandono de areas
Abandono de areas
 
Solictud de credito
Solictud de creditoSolictud de credito
Solictud de credito
 
It's The Cause, Not the College: Expanding Content Marketing Beyond the Brand
It's The Cause, Not the College: Expanding Content Marketing Beyond the BrandIt's The Cause, Not the College: Expanding Content Marketing Beyond the Brand
It's The Cause, Not the College: Expanding Content Marketing Beyond the Brand
 

Similar to DWDM-RAM: Enabling Grid Services with Dynamic Optical Networks

RANSlicing: Towards Multi-Tenancy in 5G Radio Access Networks
RANSlicing: Towards Multi-Tenancy in 5G Radio Access NetworksRANSlicing: Towards Multi-Tenancy in 5G Radio Access Networks
RANSlicing: Towards Multi-Tenancy in 5G Radio Access Networks
ijwmn
 
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
Tal Lavian Ph.D.
 
Tech bash'09
Tech bash'09Tech bash'09
Tech bash'09
PayPal
 
5113jgraph01
5113jgraph015113jgraph01
5113jgraph01
graphhoc
 
Project DRAC: Creating an applications-aware network
Project DRAC: Creating an applications-aware networkProject DRAC: Creating an applications-aware network
Project DRAC: Creating an applications-aware network
Tal Lavian Ph.D.
 
A Professional QoS Provisioning in the Intra Cluster Packet Level Resource Al...
A Professional QoS Provisioning in the Intra Cluster Packet Level Resource Al...A Professional QoS Provisioning in the Intra Cluster Packet Level Resource Al...
A Professional QoS Provisioning in the Intra Cluster Packet Level Resource Al...
GiselleginaGloria
 
An Insight Into The Qos Techniques
An Insight Into The Qos TechniquesAn Insight Into The Qos Techniques
An Insight Into The Qos Techniques
Katie Gulley
 
Routing protocol for hetrogeneous wireless mesh network
Routing protocol for hetrogeneous wireless mesh networkRouting protocol for hetrogeneous wireless mesh network
Routing protocol for hetrogeneous wireless mesh network
redpel dot com
 
Hardware virtualized flexible network for wireless data center optical interc...
Hardware virtualized flexible network for wireless data center optical interc...Hardware virtualized flexible network for wireless data center optical interc...
Hardware virtualized flexible network for wireless data center optical interc...
ieeepondy
 
Presentation Template.pptx for raesech paper
Presentation Template.pptx  for raesech paperPresentation Template.pptx  for raesech paper
Presentation Template.pptx for raesech paper
Hina636704
 
Measurement of end to end delays in ad hoc 802
Measurement of end to end delays in ad hoc 802Measurement of end to end delays in ad hoc 802
Measurement of end to end delays in ad hoc 802IAEME Publication
 
5 1-33-1-10-20161221 kennedy
5 1-33-1-10-20161221 kennedy5 1-33-1-10-20161221 kennedy
5 1-33-1-10-20161221 kennedy
Onyebuchi nosiri
 
Cloud Based Datacenter Network Acceleration Using FPGA for Data-Offloading
Cloud Based Datacenter Network Acceleration Using FPGA for Data-Offloading Cloud Based Datacenter Network Acceleration Using FPGA for Data-Offloading
Cloud Based Datacenter Network Acceleration Using FPGA for Data-Offloading
Onyebuchi nosiri
 
Et24912915
Et24912915Et24912915
Et24912915
IJERA Editor
 
Energy Behavior in Ad Hoc Network Minimizing the Number of Hops and Maintaini...
Energy Behavior in Ad Hoc Network Minimizing the Number of Hops and Maintaini...Energy Behavior in Ad Hoc Network Minimizing the Number of Hops and Maintaini...
Energy Behavior in Ad Hoc Network Minimizing the Number of Hops and Maintaini...
CSCJournals
 
IRJET- GMPLS based Multilayer Service Network Architecture
IRJET- GMPLS based Multilayer Service Network ArchitectureIRJET- GMPLS based Multilayer Service Network Architecture
IRJET- GMPLS based Multilayer Service Network Architecture
IRJET Journal
 
Network on Chip Architecture and Routing Techniques: A survey
Network on Chip Architecture and Routing Techniques: A surveyNetwork on Chip Architecture and Routing Techniques: A survey
Network on Chip Architecture and Routing Techniques: A survey
IJRES Journal
 
RESOURCE ALLOCATION ALGORITHMS FOR QOS OPTIMIZATION IN MOBILE WIMAX NETWORKS
RESOURCE ALLOCATION ALGORITHMS FOR QOS OPTIMIZATION IN MOBILE WIMAX NETWORKSRESOURCE ALLOCATION ALGORITHMS FOR QOS OPTIMIZATION IN MOBILE WIMAX NETWORKS
RESOURCE ALLOCATION ALGORITHMS FOR QOS OPTIMIZATION IN MOBILE WIMAX NETWORKS
ijwmn
 
Active Network Service Composition
Active Network Service CompositionActive Network Service Composition
Active Network Service Composition
IJERD Editor
 
A novel routing technique for mobile ad hoc networks (manet)
A novel routing technique for mobile ad hoc networks (manet)A novel routing technique for mobile ad hoc networks (manet)
A novel routing technique for mobile ad hoc networks (manet)
ijngnjournal
 

Similar to DWDM-RAM: Enabling Grid Services with Dynamic Optical Networks (20)

RANSlicing: Towards Multi-Tenancy in 5G Radio Access Networks
RANSlicing: Towards Multi-Tenancy in 5G Radio Access NetworksRANSlicing: Towards Multi-Tenancy in 5G Radio Access Networks
RANSlicing: Towards Multi-Tenancy in 5G Radio Access Networks
 
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advan...
 
Tech bash'09
Tech bash'09Tech bash'09
Tech bash'09
 
5113jgraph01
5113jgraph015113jgraph01
5113jgraph01
 
Project DRAC: Creating an applications-aware network
Project DRAC: Creating an applications-aware networkProject DRAC: Creating an applications-aware network
Project DRAC: Creating an applications-aware network
 
A Professional QoS Provisioning in the Intra Cluster Packet Level Resource Al...
A Professional QoS Provisioning in the Intra Cluster Packet Level Resource Al...A Professional QoS Provisioning in the Intra Cluster Packet Level Resource Al...
A Professional QoS Provisioning in the Intra Cluster Packet Level Resource Al...
 
An Insight Into The Qos Techniques
An Insight Into The Qos TechniquesAn Insight Into The Qos Techniques
An Insight Into The Qos Techniques
 
Routing protocol for hetrogeneous wireless mesh network
Routing protocol for hetrogeneous wireless mesh networkRouting protocol for hetrogeneous wireless mesh network
Routing protocol for hetrogeneous wireless mesh network
 
Hardware virtualized flexible network for wireless data center optical interc...
Hardware virtualized flexible network for wireless data center optical interc...Hardware virtualized flexible network for wireless data center optical interc...
Hardware virtualized flexible network for wireless data center optical interc...
 
Presentation Template.pptx for raesech paper
Presentation Template.pptx  for raesech paperPresentation Template.pptx  for raesech paper
Presentation Template.pptx for raesech paper
 
Measurement of end to end delays in ad hoc 802
Measurement of end to end delays in ad hoc 802Measurement of end to end delays in ad hoc 802
Measurement of end to end delays in ad hoc 802
 
5 1-33-1-10-20161221 kennedy
5 1-33-1-10-20161221 kennedy5 1-33-1-10-20161221 kennedy
5 1-33-1-10-20161221 kennedy
 
Cloud Based Datacenter Network Acceleration Using FPGA for Data-Offloading
Cloud Based Datacenter Network Acceleration Using FPGA for Data-Offloading Cloud Based Datacenter Network Acceleration Using FPGA for Data-Offloading
Cloud Based Datacenter Network Acceleration Using FPGA for Data-Offloading
 
Et24912915
Et24912915Et24912915
Et24912915
 
Energy Behavior in Ad Hoc Network Minimizing the Number of Hops and Maintaini...
Energy Behavior in Ad Hoc Network Minimizing the Number of Hops and Maintaini...Energy Behavior in Ad Hoc Network Minimizing the Number of Hops and Maintaini...
Energy Behavior in Ad Hoc Network Minimizing the Number of Hops and Maintaini...
 
IRJET- GMPLS based Multilayer Service Network Architecture
IRJET- GMPLS based Multilayer Service Network ArchitectureIRJET- GMPLS based Multilayer Service Network Architecture
IRJET- GMPLS based Multilayer Service Network Architecture
 
Network on Chip Architecture and Routing Techniques: A survey
Network on Chip Architecture and Routing Techniques: A surveyNetwork on Chip Architecture and Routing Techniques: A survey
Network on Chip Architecture and Routing Techniques: A survey
 
RESOURCE ALLOCATION ALGORITHMS FOR QOS OPTIMIZATION IN MOBILE WIMAX NETWORKS
RESOURCE ALLOCATION ALGORITHMS FOR QOS OPTIMIZATION IN MOBILE WIMAX NETWORKSRESOURCE ALLOCATION ALGORITHMS FOR QOS OPTIMIZATION IN MOBILE WIMAX NETWORKS
RESOURCE ALLOCATION ALGORITHMS FOR QOS OPTIMIZATION IN MOBILE WIMAX NETWORKS
 
Active Network Service Composition
Active Network Service CompositionActive Network Service Composition
Active Network Service Composition
 
A novel routing technique for mobile ad hoc networks (manet)
A novel routing technique for mobile ad hoc networks (manet)A novel routing technique for mobile ad hoc networks (manet)
A novel routing technique for mobile ad hoc networks (manet)
 

More from Tal Lavian Ph.D.

Ultra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizerUltra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizer
Tal Lavian Ph.D.
 
Ultra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizerUltra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizer
Tal Lavian Ph.D.
 
Photonic line sharing for high-speed routers
Photonic line sharing for high-speed routersPhotonic line sharing for high-speed routers
Photonic line sharing for high-speed routers
Tal Lavian Ph.D.
 
Systems and methods to support sharing and exchanging in a network
Systems and methods to support sharing and exchanging in a networkSystems and methods to support sharing and exchanging in a network
Systems and methods to support sharing and exchanging in a network
Tal Lavian Ph.D.
 
Systems and methods for visual presentation and selection of IVR menu
Systems and methods for visual presentation and selection of IVR menuSystems and methods for visual presentation and selection of IVR menu
Systems and methods for visual presentation and selection of IVR menu
Tal Lavian Ph.D.
 
Grid proxy architecture for network resources
Grid proxy architecture for network resourcesGrid proxy architecture for network resources
Grid proxy architecture for network resources
Tal Lavian Ph.D.
 
Ultra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizerUltra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizer
Tal Lavian Ph.D.
 
Systems and methods for electronic communications
Systems and methods for electronic communicationsSystems and methods for electronic communications
Systems and methods for electronic communications
Tal Lavian Ph.D.
 
Ultra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizerUltra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizer
Tal Lavian Ph.D.
 
Ultra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizerUltra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizer
Tal Lavian Ph.D.
 
Radar target detection system for autonomous vehicles with ultra-low phase no...
Radar target detection system for autonomous vehicles with ultra-low phase no...Radar target detection system for autonomous vehicles with ultra-low phase no...
Radar target detection system for autonomous vehicles with ultra-low phase no...
Tal Lavian Ph.D.
 
Grid proxy architecture for network resources
Grid proxy architecture for network resourcesGrid proxy architecture for network resources
Grid proxy architecture for network resources
Tal Lavian Ph.D.
 
Method and apparatus for scheduling resources on a switched underlay network
Method and apparatus for scheduling resources on a switched underlay networkMethod and apparatus for scheduling resources on a switched underlay network
Method and apparatus for scheduling resources on a switched underlay network
Tal Lavian Ph.D.
 
Dynamic assignment of traffic classes to a priority queue in a packet forward...
Dynamic assignment of traffic classes to a priority queue in a packet forward...Dynamic assignment of traffic classes to a priority queue in a packet forward...
Dynamic assignment of traffic classes to a priority queue in a packet forward...
Tal Lavian Ph.D.
 
Method and apparatus for using a command design pattern to access and configu...
Method and apparatus for using a command design pattern to access and configu...Method and apparatus for using a command design pattern to access and configu...
Method and apparatus for using a command design pattern to access and configu...
Tal Lavian Ph.D.
 
Reliable rating system and method thereof
Reliable rating system and method thereofReliable rating system and method thereof
Reliable rating system and method thereof
Tal Lavian Ph.D.
 
Time variant rating system and method thereof
Time variant rating system and method thereofTime variant rating system and method thereof
Time variant rating system and method thereof
Tal Lavian Ph.D.
 
Systems and methods for visual presentation and selection of ivr menu
Systems and methods for visual presentation and selection of ivr menuSystems and methods for visual presentation and selection of ivr menu
Systems and methods for visual presentation and selection of ivr menu
Tal Lavian Ph.D.
 
Ultra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizerUltra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizer
Tal Lavian Ph.D.
 
Ultra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizerUltra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizer
Tal Lavian Ph.D.
 

More from Tal Lavian Ph.D. (20)

Ultra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizerUltra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizer
 
Ultra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizerUltra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizer
 
Photonic line sharing for high-speed routers
Photonic line sharing for high-speed routersPhotonic line sharing for high-speed routers
Photonic line sharing for high-speed routers
 
Systems and methods to support sharing and exchanging in a network
Systems and methods to support sharing and exchanging in a networkSystems and methods to support sharing and exchanging in a network
Systems and methods to support sharing and exchanging in a network
 
Systems and methods for visual presentation and selection of IVR menu
Systems and methods for visual presentation and selection of IVR menuSystems and methods for visual presentation and selection of IVR menu
Systems and methods for visual presentation and selection of IVR menu
 
Grid proxy architecture for network resources
Grid proxy architecture for network resourcesGrid proxy architecture for network resources
Grid proxy architecture for network resources
 
Ultra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizerUltra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizer
 
Systems and methods for electronic communications
Systems and methods for electronic communicationsSystems and methods for electronic communications
Systems and methods for electronic communications
 
Ultra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizerUltra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizer
 
Ultra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizerUltra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizer
 
Radar target detection system for autonomous vehicles with ultra-low phase no...
Radar target detection system for autonomous vehicles with ultra-low phase no...Radar target detection system for autonomous vehicles with ultra-low phase no...
Radar target detection system for autonomous vehicles with ultra-low phase no...
 
Grid proxy architecture for network resources
Grid proxy architecture for network resourcesGrid proxy architecture for network resources
Grid proxy architecture for network resources
 
Method and apparatus for scheduling resources on a switched underlay network
Method and apparatus for scheduling resources on a switched underlay networkMethod and apparatus for scheduling resources on a switched underlay network
Method and apparatus for scheduling resources on a switched underlay network
 
Dynamic assignment of traffic classes to a priority queue in a packet forward...
Dynamic assignment of traffic classes to a priority queue in a packet forward...Dynamic assignment of traffic classes to a priority queue in a packet forward...
Dynamic assignment of traffic classes to a priority queue in a packet forward...
 
Method and apparatus for using a command design pattern to access and configu...
Method and apparatus for using a command design pattern to access and configu...Method and apparatus for using a command design pattern to access and configu...
Method and apparatus for using a command design pattern to access and configu...
 
Reliable rating system and method thereof
Reliable rating system and method thereofReliable rating system and method thereof
Reliable rating system and method thereof
 
Time variant rating system and method thereof
Time variant rating system and method thereofTime variant rating system and method thereof
Time variant rating system and method thereof
 
Systems and methods for visual presentation and selection of ivr menu
Systems and methods for visual presentation and selection of ivr menuSystems and methods for visual presentation and selection of ivr menu
Systems and methods for visual presentation and selection of ivr menu
 
Ultra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizerUltra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizer
 
Ultra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizerUltra low phase noise frequency synthesizer
Ultra low phase noise frequency synthesizer
 

DWDM-RAM: Enabling Grid Services with Dynamic Optical Networks

  • 1. 2004 IEEE International Symposium on Cluster Computing and the Grid DWDM-RAM: Enabling Grid Services with Dynamic Optical Networks S. Figueira', S. Naiksata", H. Cohen', D. Cutrell', P. Daspit', D. Gutierrez3, D. B. Hoang4, T. Lavian', J. Mambretd, S. Merrill', F. Travostino'. 'Santa Clara University, 'Nortel Networks Labs,' 'Stanford University, University of Technology, Sydney, 'iCAIR and Northwestern University. {sfgueira, snaiksatam] @scu.edu, {hcohen, dcutrell, pduspit, tlavian, smerrill, tra vos) @ Tiortelnetworks. com, degm @ stanford. edu, dhoang @ it. uts. edu. au, j-mambretti@northwestt?m.edu. 4 Abstract Advances in Grid technology enable the deployment of data-intensive distributed applications, which require moving Terabytes or even Petabytes of data between data banks. The current underlying nehvorks cannut provide dedicated links with adequate end-to-end sustained bandwidth to support ihe requirements of these Grid applications. DWDM-RAM' is a novel service-oriented architecture, which harnesses the enormous bandwidth potential of optical nefivorks and demonstrates their on-demand nsage on the OMNlner. Preliminary experiments suggest that dynamic optical networks, such as the OMNlnet, are the ideal option for transferring such massive amounts of data. DWDM-RAM incorporates an OGSI/OGSA compliant service interface and will promote greater convergence between dynamic optical networks and data intensive Grid computing. 1. Introduction DWDM-RAM is a DARPA [IO] funded research experiment established to design and implement in prototype a new type of Grid service architecture that is optimized to support data intensive Grid applications through advanced optical networking. DWDM-RAM closely integrates Grid data services and optical networking services. One of the goals of Grid architecture development is to enable efficient support for data-intensive applications, which may require moving - without prior notice - Terabytes or even Petabytes of data ' DWDM-RAM research was made possible with suppon from DARPA. award NO. ~3116nz-98.z-11194. 0-7803-8430-W04/$20.000 2004 IEEE among multiple sites. One of the harriers to achieve this goal is the fact that traditional technology used in currently deployed networks limits at many levels the transfer of massive amounts of data. Although availability of sufficient bandwidth is an issue, access to resources that provides this bandwidth solves only one part of the problem. The complete solution is a new network architecture with the ability to orchestrate data flows with many different types of characteristics, including those requiring exceptionally high bandwidth for sustained periods of time. In the DWDM-RAM model, these high performance data flows are provided by dedicated optical paths, which are dynamically allocated. State of the art DWDM technology based on dynamic wavelength switching enables the creation of Grid services that allocate and release these paths either on-demand or by advance reservation. Grid applications typically need to allocate and reserve multiple types of resources, such as computational. data, instrumentation, and networks, at distributed sites. Services such as the Globus Resource Allocation Manager (GRAM) job scheduler [8] have been developed to coordinate and schedule the computational and data resources needed by Grid applications. In [U] ,th e authors propose G A M , the General Purpose Architecture for Reservation and Allocation, which enables the construction of application-level co-reservation and co-allocation libraries that applications can use to dynamically schedule collections of resources. In GAM, the network is treated as a primary resource, which can be allocated and reserved as well, and a service provides this resource. To enable the efficient use of optical networks as a primary resource, a novel architecture for the reservation and dynamic allocation of individual 707 Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.
  • 2. 2004 IEEE International Symposium on Cluster Computing and the Grid wavelengths is required. This architecture relies on a new network service, which provides options for allocating dedicated network resources. This service must discover the nctwork topology and both explore the availability and optimize the schedule of the optical network resources. It should also present a standardized, high-level and network-accessible interface. A natursl choice for implementing this interface is the Open Grid Service Interface (OGSI) [27]. Such interfaces are compliant with the GGFs OGSA specification [I31 and, in addition, conform to widely used Web Services standards (WSDL, SOAP, and XML). In addition to presenting an OGSI-compliant interface, the network service should have a standard way of representing wavelength resources for communicating with clients. No such standard currently exists, For the Grid community, a promising approach would he to extend the XML form of the Resource Specification Language (RSL) [16]. This RSL schema is currently used by GRAM for other resources. Adding optical network extensions to RSL would make it possible to enhance GRAM to handle optical network resources. This paper presents an implementation of the aforementioned concepts as a part of the DWDM-RAM research project. This project encompasses the development of two services, the Data Transfer Scheduling (DTS) service and the Network Resource Scheduling (NRS) service. The DTS service's goal is to provide scheduled data transfer between data banks. The NRS service's goal is to provide dynamic dedicated wavelength, both on demand and by advance reservation. The DTS uses the NRS service to provide the user application with an optimized utilization of the optical network. A preliminary implementation of this architecture was first demonstrated during the 9' Global Grid Forum, in Chicago, October 2003 and then at the Supercomputing Conference, in Phoenix, November 2003. Other results of experiments with dynamic wavelength on advanced optical networks provisioning for data-intensive Grid applications have been recently published [22]. This paper is organized as follows: Section 2 describes dynamic optical networks and their features, Section 3 introduces the DWDM-RAM architecture, Section 4 presents the interface created to allocate wavelengths dynamically, Section 5 describes the testhed used in the implementation and presents initial results, and Section 6 concludes and discusses future work. 2. Optical Networks Bulk data transfer oriented grid computing requires quality of service, in particular, guaranteed minimum bandwidth and minimized packet loss, which are not easily achievable in packet switching networks. Recently, Grid developers have been using IntServ [6] and DiffServ [4] approaches to obtain QoS in packet switching networks ([I 11[121[151[211[251). IntServ and DiffServ may help in some special cases, but they arc far from perfect solutions. Optical networks have the potential to change the way networks are used in Grid computing. Optical networks based on wavelength switching can easily provide guaranteed bandwidth and performance in terms of low hit error rates. In fact, based on the same assumption, other groups have also been focusing on providing optical networks to the Grid community [26][29]. A main concern about wavelength switched optical networks is the overhead incurred during the end-to-end path setup. However, it should he noted that the time taken in the transfer of the huge amounts of data generated by Grid applicarions amortizes the time spent in the setup. The graph in Figure 1 illustrates this fact. It shows the amount of time spent in the path setup as a percentage of the total transfer time versus data transfers of different sizes. These numbers were generated synthetically in order to motivate the usage of optical networks in different scenarios. We indicate in the graph the threshold at which the setup time is about 5% of the total time, i.e., the overhead is amortized and becomes insignificant. 100% 80% t 40% 500GB 30% 2 20% 2 10% 0% 1w ,ow 10000 100000 l O w w 0 lWoOW0 File Size (ME) Figure 1: Overhead is insignificant at 500 GB In Figure I , we assume a setup time of 48 sec and a bandwidth of 920 Mhps, in which case the threshold is 500 GB. Since Grid applications usually 708 Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.
  • 3. 2004 IEEE International Symposium on Cluster Computing and the Grid transfer huge data sets, it is clear that the time for the path setup is negligible in Grid computing. Note that 48 sec is the currently observed average upper-bound time for the path setup, and 920 Mbps is the currently observed maximum throughput (see Section 5). Of equal importance is the time required to deallocate resources to enable subsequent usage, once the data transfer is complete. This has been observed to be around llsec (see Section 5) and is also insignificant in comparison to the data transfer time. 3. The DWDM-RAM Architecture The DWDM-RAM architecture shown in Figure 2 closely fits the Grid Architecture described in [14]. This architecture also leverages the Globus Toolkit 3’s functionality. The main modules are explained below. Fabric: OMNInet and ODIN The OMNInet photonic testhed network [3] implemented across a metro area constitutes the shared resource in the DWDM-RAM architecture. Optical Dynamic Intelligent Network* (ODIN) 1.17][18][22] is the software suite that controls the OMNInet through various lower-level API calls presented in Section 5. ODIN has been designed for extremely high performance, long term Terabit data Ilows with flexible and fine grained control. It is a stateless server implementation, which includes a simple API to provide path provisioning and monitoring to the higher layers. Connectivity: TCP/IP, HTTP, SOAP, JAX-RPC Currently, the DWDM-RAM system uses standard off-the-shelf communication protocol suites to communicate requests and responses between application clients and DWDM-RAM services and also among DWDM-RAM components. Requests and responses conform to OGSI and Web Services specifications, i.e., they are SOAP messages, carried in HTTP envelopes and transported over TCPflP connections. The SOAP messages are encoded using IAX-RPC to facilitate interoperability between existing Java-based Globus toolkit and the DWDM-RAM components. Figure 2: The DWDM-RAM architecture Resource: DWDM-RAM Network Resource Scheduling (NRS) Service The Resource and Connectivity protocol layers form the neck of our “hourglass model” [23] based architecture. The NRS is essentially a resource management service, which supports protocols that offer advance reservations and QoS. It maintains schedules and provisions resources in accordance with the schedule. It provides an OGSMOGSI compliant interface to request the optical network resources. It has complete understanding of dynamic lightpath provisioning and communicates these requests to the Fabric layer entities. In our architecture, the NRS can stand alone without the DTS (see Collective layer). GARA integration is an important avenue for future development. A key feature is the ability to reschedule reservations, which satisfy under-constrained scheduling requests, in order to accommodate new requests and changes in resource availability. Requests may be under-constrained through specification of a target reservation window, which is larger than the requested duration, through open-ended specifications, such as “ASAP”, or through more sophisticated request specifications, such as client-provided utility functions for evaluating scheduling ’ODIN research was made passible with suppan from the National Science Foundation: awwd - ANI-0123399 709 Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.
  • 4. 2004 IEEE International Symposium on Cluster Computing and the Grid costs. Models for priorities and accounting can also be incorporated into the scheduling algorithms. Collective: DWDM-RAM Data Transfer Scheduling (DTS) Service The DTS service is a direct extension of the NRS service. The DTS shares the same hackend scheduling engine and resides on the same host. It provides a higher-level functionality that allows applications to schedule advance reservations for data transfers without the need to directly schedule path reservations with the NRS service. The DTS service requires additional infrastructure in the form of services living at the data transfer endpoints. These services perform the actual data transfer operations once the network resources are allocated. As with the NRS, the DTS has an OGSI interface, and GARA integration is a planned avenue for future development. As an extension of the NRS, the DTS also employs under-constrained scheduling requests in order to accommodate new requests and changes in resource availability. It is important to note that, in the DWDM-RAM design, the application at the endpoints drives the statc and decisions by DTS, NRS, and ODIN, thus in full compliance with the end-to-end argument [24]. These intervening layers never attempt to re-construct nor second-guess an application's intent from traffic. Instead, they follow the explicit command and control from the application. These layers are best positioned to appreciate both application's commands and network status, while bridging meaningfully between the two. Also, we plan to have DWDM-RAM comply with the so-called fate-sharing principle [7].T his design principle argues that it is acceptable to lose the state information associated with an entity if, at the same time, the entity itself is lost. In this case, DTS, NRS, and ODD4 will make a point of reclaiming resources once an application is terminated, or is found to he non-responsive for a configurable time interval. 4. Dynamically Allocating Bandwidth On-Demand For wavelength switching to be useful for Grid applications, a network service with an application level interface is required to request, release and manage the underlying network resources. Previous work has been done in defining an OGSNOGSI based network service interface to network resources. In 1121, for example, the authors describe a service that provides allocation of bandwidth in IntServ networks. Our approach follows their model but develops a more comprehensive schedule and reservation based Network Resource Scheduling (NRS) service, which provides user applications with access to underlying optical network resources. This service should guarantee dedicated access to the optical links, which may be requested on-demand or by advance reservation. Advance reservation requests can he under-constrained, which means the request can be satisfied by more than one possible time slot. This allows the service to reschedule reservations as needed to satisfy future requests and changing conditions. The NRS also attempts to provide an interface with different levels of detail. Some coordinating and scheduling clients may need only high-level facilities like those for individual applications. For these applications, the interface should allow the request of light paths, hut these clients do not need to have knowledge of the details of the underlying network topology or management protocols. However, clients that attempt to optimize network resources use may need a richer interface, e.g., they may need to be able to schedule individual optical segments. For these clients, the interface should allow the request of individual segments. Although these clients may need knowledge of the network topology, they should still be insulated from the network management protocols. We have started by implementing a network service with a simple application-level interface. This service is able to allocate dynamically dedicated end-to- end light paths requested on demand. The following were the goals for this initial interface: It should be usable by Grid applications. It should be network-accessible from any authorized host. It should be standards-based and not require any proprietary technology. It should allow the application to specify parameters of the desired optical path that are relevant at the application level. It should hide the details of the underlying network topology and network management protocols. It should support the immediate allocation of bandwidth, but should be easy to extend in order to incorporate future scheduling. At the highest level, the interface described here is wrapped in a Java implementation that shields the caller from the details of the application-level protocols, which are needed to communicate with the 710 Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.
  • 5. 2004 IEEE International Symposium on Cluster Computing and the Grid service. The service itself hides various lower level network topology and management protocols from the caller. This current interface exposes two methods to the user: allocateNetworkPath and deallocateNetworkPath. The method allocateNetworkPath requests a path between the end hosts. The path allocated should meet the criteria specified in the parameter object passed to the method. These parameters include the network addresses of the hosts to he connected, the minimum and maximum acceptable bandwidths, and the maximum duration of the allocation. The allocateNetworkPath method returns to the caller an object containing descriptive information on the path that was allocated. This object also serves as a handle for the deallocateNetworkPath rcquest. By adding parameters representing earliest and latest acccptable start times, this interface can he extended to accommodate under-constrained advance reservations. The NRS interface suggests likely properties for a service that may implement this interface. Such a service can he implemented in a way that does not maintain any session or context information for any particular client between calls. The only necessary context information is the allocated path identifier, which the client is required to supply in order to deallocate a path. The service must maintain this information ahout these allocated paths so, in this sense, it is not “stateless,” but each client call can he treated as a self-contained unit and processed entirely in a single-message exchange. Thus, the interface tits the service oriented architecture of Web Services [5] quite closely. At the same time, we believe that it is important to conForm to the emerging Open Grid Services Architecture (OGSA) Grid standard to be accessible to Grid applications that use this architecture. Hence the NRS interface also conforms to the Open Grid Services Infrastructure (OGSI) interface for services. This interface, in its basic form, is a Web Service interface with some additional conventions from the OGSI standard. Although client access is via a normal Java interface as described above. internally, the client-service interface is an OGSI Web Service implemented using SOAP and the JAX-RPC API. The OGSI implementation is quite lean (no SDEs), and therefore the conversion to new specifications like the WS-Resource Framework (WS-RF) [301 will be a somewhat mechanical process. In fact, the DWDM-RAM architecture builds the concept of a Network Service from the ground up and is fairly well insulated from either OGSI, or WS-RF, or any other emerging specification that may prevail. In any case, the user of the NRS service is spared any direct contact with the underlying middleware. 5. Testbed, Experiments and Result The testbed for the DWDM-RAM system is provided by a next-generation large-scale MetroLAN dynamic optical network extent called the OMNInet [3], operational since 2001. OMNInet uses metro dark fiber infrastructure, which has been provided by SBC to connect locations sponsored by Northwestern University, and a mix of product and rcsearch equipmcnt from Nortel Networks. OMNInet has been deployed at four locations in the Chicago metro area and is configured in a partial-mesh IOGE DWDM network. Each location has a MEMS based 8 x 8 DWDM photonic switch interfaced with a Nortel Passport 8600 Ethernet Routing Switch, providing 4 x lOGE line interfaces and up to 32 x IGE client interfaces. The OMNInet configuration is shown in Figure 3. Univ oflllinois, Chiraxo Northwestern Unir uu Figure 3 OMNlnet core nodes The dynamic light path provisioning of the OMNlnet is provided by the Optical Dynamic Intelligent Network (ODIN) services module, which manages the optical network control plane and resource provisioning including path allocation, deletion, and setting of attributes. ODIN uses an O F UNI 1.0 [28] compliant UN1 library to interface with the OMNInet unified control plane. The control plane is orchestrated by a GMPLS [20] based CR-LDP [ I ] implementation, which is used to establish the label forwarding state along the routes computed by an enhanced OSPF (constraint-based routing) 71 1 Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.
  • 6. 2004 IEEE International Symposium on Cluster Computing and the Grid algorithm5. (Note: An RSVP-TE [2] implementation to support advance reservations is also in the process of being deployed.) The technological breakthrough in the design of the OMNInet photonic switches, coupled with the tight integration of the control software, brings down the provisioning time from months to a few seconds. This is the critical enabling factor in on-demand provisioning, which makes dynamic optical networks an important technology for data-intensive Grid computing. Figure 4 compares the efficiency of packet switching with lambda switching, executing with different amounts of bandwidth, by plotting the amount of data transferred against the time taken in seconds. This graph was generated synthetically. The path setup takes 48 sec which was recorded in experiments (explained in detail later). The path setup time includes the time required to request a path, allocate the path, configure the layer I and 2 components of the network and update the relevant tables. It is important to note that only a miniscule fraction (approximately 20 milliseconds) of this delay is actually due to the setting up of the path within the optical switch. A part of the setup delay is also due to the propagation of state information through the photonic nodes and optical paths. The major portion of the delay is introduced by switches at the edge of the optical network, which switch the data to and from the end hosts. This is an artifact of the current network setup, and with fairly simple optimizations, we expect to bring this 48 sec delay down significantly. amshed ISW M W 1 GbW 5000 45W -PlhkBI mdtcned 4oW 1% M W --Lamu I1oGbpSl e g - 35W 3oW $ =W Imched I750 Mbw) rwhed (l moo 15W 1000 5w 0 0 20 40 60 80 1W 120 rim (S) Figure 4: Packed Switched.vs. Lambda Network -- Setup time tradeoffs. For the OMNlnet metro photonic networking research, the GMPLS. 0-UNI. LMP smdards we implemented as Nortel Networks proprietary Wavelength Routing and Distribution Protocol (WRDP) optical control plane software suite. The important information obtained by this graph is the crossover points at which the optical network becomes a better option than the packet switched network. Note that when the path setup takes 48 sec, the crossover point can he with files as small as 1.9 GB and up to 4.5 GB. The graph affirms the enormous advantage of the DWDM-RAM system over other packet switching systems when transferring large data sets and presents an exciting option for the Grid community. Note that, for transferring smaller amounts of data, the packet switching traditional approach may be a better option. The appropriate network to use, in each case, should bc decided by co-allocation services, as defined in [9][ 121. These co-allocation scheduling services use information about the resource's capabilities and the application's requirements to allocate a performance-efticient set of resources for the application. Figure S presents a throughput graph for a 30 GB memory-to-memory transfer. The smooth curve is the average effective data-transfer rate, including the startup cost of allocating the lightpath. The jagged curve, averaging around 440 Mbps, is the instantaneous throughput, measured in 0.1 sec intervals on the receiving machine. Note that the throughput periodically jumped to about 530 Mhps for a sustained period of about 100 seconds, a phenomenon under investigation. For this 30 GB data transfer, we can see that the startup costs begin to be amortized after about 230 sec or 12.2 GB. . . . . ... . . ' . . . Figure 5: Instantaneous and average throughput for a 30 GB memoly-to-memory transfer over OMNlnet using TCP as transport protocol. The above experiment was run on dual PIII 997MHz machines with S12MB memory, 1GB swap space, running on Red Hat Linux 7.3 (Kernel: 2.4.18- 3") and using I GigE NIC cards. Note that we used the Linux networking protocol stack with no performance tuning. 71 2 Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.
  • 7. PO04 IEEE International Symposium on Cluster Computing and the Grid of the channel. Currently, the default UDT protocol values are being used, namely, UDT buffer size of 40,960,000 bytes, UDP send buffer of 64KB. UDP receive buffer of 4 MB, and flow window size of 25600. We believe that tuning these parameters to the OMNInet testhed will yield a higher throughput. Table 1: Auplication level measurements recorded for .. a 20GB file transfer I Event I Seconds Start : File transfer request arrives 1 0.0 Path Allocation request I 0.5 ODIN server processing When performing file transfer in the above setup we observed large oscillations in the instantaneous throughput, which resulted in significantly lower average throughput. We suspected that this was an artifact of using standard TCP. This prompted us to experiment using UDT [ 191, a high performance data transfer protocol. Figure 6 shows a 15 GB memory-to- memory data transfer using UDT as the underlying transport protocol. The throughput has been sampled at 0.1 sec intervals. The maximum and the average throughput recorded were 920 Mhps and-680 Mbps, respectively. 2.6 Network reconfiguration Data transfer Path deallocation request 45 622 0.3 T-1-1 r&ource accessed through a Grid service, which is necessary for data-intensive applications. The Figure 6: Instantaneous throughput recorded for a 15 DWDM-RAM system presented here addresses GB memory-to-memory transfer over OMNlnet using limitations of traditional implementations and UDT a s transport protocol. facilitates on demand optical channel (lightpath) The numbers in Figure 6 show a better performance than those in Figure 5, reinforcing our initial suspicion that TCP was affecting the throughput. We also performed file transfer experiments using UDT. For a 20 GB tile transfer, the maximum and the average throughput recorded were 376 Mbps and 272 Mbps respectively. These are significantly lower than those seen in Figure 6, leading us to believe that issues like disk YO on both ends of the data pipe, buffering, and similar factors impact the average throughput in the disk-to-disk file transfers. Table 1 shows a breakup of the total end-to-end time required for the above file transfer operation to complete. It is important to note that the lightpath used to transfer data in the experiment described was dynamically allocated and dedicated to the file transfer. While UDT does seem to have had a favorable impact on the average throughput, it is evident from the graph of Figure 6, that there are still oscillations in the instantaneous throughput. Also, the average throughput is less than the maximum 1 Gbps capacity - . provisioning. We have also presented an OGSAJOGSI compliant interface developed to ease the usage of the OMNInet by Grid applications. The interface presented meets the needs of many applications, hut it should be extended to include features that may be necessary or desirable in other circumstances. One of our main goals is to make the interface G A M compliant and able to provide a comprehensive, re-schedulable and window-based, network service as discussed in Section 3. We are currently exploring UDT and other high performance transport protocols which can help to achieve a uniform throughput close to the maximum limits. This, coupled with the facility to aggregate several channels to transfer one large tile, will dramatically impact the data transfer time perceived by the user. While a photonic switched network like OMNInet may be ideal for a DWDM-RAM-like architecture, our experiments suggest that DWDM-RAM could also he implemented on a traditional optical-electrical- optical (OEO) network. Providing a solid interface to such optical networks is a key step in enabling its usage by the Grid community. Our initial 71 3 Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.
  • 8. 2004 IEEE International Symposium on Cluster Computing and the Grid experiments have been extremely promising, and we Integration,” Open Grid Service Infrastructure WG, are continuing to improve the network service Acknowledgements The authors would like to thank Aaron Johnson, Fei Yeh, Jeremy Weinberger, Jim Chen, and David Lilithun from ICAIR, and Ramesh Durairaj, Inder Monga, and Phil Wang from Nortel Networks, for their invaluable contributions. References [I] P. Ashwood-Smith (Ed) and L. Berger (Ed), “Generalized Multi-Protocol Label Switching (GMPLS) Signaling Constraint-based Label Distribution Protocol (CR-LDP) Extensions,” RFC 3472, January 2003. 121 D. Awduche et al., “RSVP-TE: Extensions to RSVP for LSP Tunnels,” RFC 3209, December 2001. [3] E. Bernier et al., “OMNlnet: A Metropolitan 10Gh/s DWDM Photonic Switched Network Trial.” Submitted for OFC 2004, Feb 22 - 27, 2004. (In YPYi_PW..), [4] S. Blake et al., “An Architecture for Differentiated Services,’’ IETF RFC 2475. [SI D. Booth, et al., “Web Services Architecture,” http://www.w3.org/TR/2003/WBws-arch- 20030808/wsa.pdf [61 R. Braden et al., RFC 1633: Integrated Services in the Internet Architecture: an Overview, Inremet RFC 1633, July 1994. [7] D. Clark, ‘The design philosophy of the DARPA Internet protocols,” in Proceedings of ACM SICCOMM, Stanford. CA, pp. 106--114, August 1988. [XI K. Czajkowski et al., “A Resource Management Architecture for Metacomputing Systems,” in Proceedings of IPPYSPDP ‘98 Workshop on Job Scheduling Strategies for Purullel Processing, pp. 62- 82, 1998. [9] K. Czajkowski et al., “Resource Co-Allocation in Computational Grids,” Proceedings of the Eighrh IEEE Internarional Symposium on High Per/ormunce Distributed Computing (HPDC-8I, pp. 219-228, 1999. [IO] Department of Defense Advanced Research Projects Agency (http://www.darpa.miV) [ I l l 1. Foster et al., “End-to-End Quality of Service for High-end Applications,” Computer Communicurions, Speciul Issue on Network Supporr for Grid Computing, 2002. [I21 1. Foster et al., “A Distributed Resource Management Architecture that Supports Advance Reservations and Co-Allocation,” Inremotional Workshop on Qualify of Service, 1999. [I31 1. Foster et al., ‘The Physiology of the Grid An Open Grid Services Architecture for Distributed Systems Global Grid Forum, June 2002. [I41 1. Foster et al., ‘The Anatomy of the Grid Enabling Scalable Virtual Organizations.” lnremationul Joumal of Superrompurer Applications, 15(3), 2001. [IS] 1. Foster et al., “A Quality of Service Architecture that Combines Resource Reservation and Application Adaptation,” 8th International Workshop on Qualiy of Service, 2000. [I61 “The Globus Resource Specification Language RSL VI.O ,” http://www.globus.org/gram/rsI_specl .html. [I71 R. Grossman et al., “Experimental Studies Using Photonic Data Services at Grid 2002.” Joumal of Future Computer Systems. Elsevier Press, pp.945-956, August 2003. [IS] R. Grossman et al., “Photonic Data Services: Integrating Path, Network and Data Services to Support Next Generation Data Mining Applications,” NGDMM, Proceedings, November 2002. [I91 Y. Gu and R. Grossman, “End-to-End Congestion Control for High Performance Data Transfer.” submitted to IEEWACM Transactions on Networking. [ZO] L. Berger (Ed), “Generalized Multi-Protocol Label Switching (GMPLS) Signaling Functional Description.” RFC 3471, January 2003. [211 G. Hoo et al., “QoS as Middleware: Bandwidth Reservation System Design,’’ Proceedings of rhe 8th IEEE Symposium on High Perfurmunce Distributed Computing, pp. 345-346, 1999. [22] I. Mambretti et al., “The Photonic TeraStream: Enabling Next Generation Applications Through Intelligent Optical Networking at Grid 2002,” Joumul of Future Computer Systems, Elsevier Press. August 2003, pp.897-908. [23] “Realizing the Information Future: The Internet and Beyond,” National Academy Press, 1994, http://www.nap.edu/readingroom/books/rti [24] I. Saltzer et al., “End-to-end arguments in system design,” ACM Transactions on Computer Systems, pp. 277-288, 1984. [ZS] V. Sander et al.. “A Differentiated Services Implementation for High-Performance TCP Flows,” Elsevier Computer Networks, 34915-929.2000. [26] L. Smarr et al., ‘The OptlPuter,” Communications of the ACM, Vol. 46, No. 1 I, pp. 58-67, November 2003. [271 S. Tuecke et al., “Open Grid Services Infrastructure (OGSI) Version 1.0,” Global Grid Forum Draft Recommendation, June 2003. [28] “User Network Interface (UNI) 1.0 Signaling Specification,” http://www.oiforum.com/public/docu ments/O1F-UNI-01 .O.pdf [29] D. Vanderster, ‘The Return of Circuit Switching: A Review of User-Controlled Lightpaths for Grid Computing,” Technical Report, University of Victoria, Canada, August 2003. [301 “WS-Resource Framework,” http://www-fp. globus.org/wsrt/ 71 4 Authorized licensed use limited to: Tal Lavian. Downloaded on July 24, 2009 at 19:10 from IEEE Xplore. Restrictions apply.