SlideShare a Scribd company logo
1 of 8
Download to read offline
Virtualizing testbed resources to enable remote
experimentation in online telecommunications
education
Johann M. Marquez-Barja∗, Nicholas Kaminski∗, Francisco Paisana∗, Christos Tranoris‡ and Luiz A. DaSilva∗
∗CTVR / the telecommunications research centre
Trinity College Dublin, Ireland.
{marquejm,kaminskn,paisanaf,dasilval}@tcd.ie
‡University of Patras, Greece.
tranoris@ece.upatras.gr
Abstract—In this paper we present an approach towards
empowering online telecommunications engineering education by
enabling hands-on remote experimentation over Trinity College
Dublin’s wireless testbed. Moreover, in order to offer a flex-
ible testbed, capable of fulfilling the different and particular
requirements of experimenters, we have created a framework that
allows the virtualization of our testbed resources to create exper-
imentation units to be used by remote experimenters/learners.
Furthermore, we present the FORGEBox framework that offers
an environment and resources to create online material capable
to access the virtualized and physical testbed resources for incor-
porating experimentation into HTML-based online educational
material.
Keywords—virtualized testbeds, cloud computing, wireless
testbeds, research experimentation, remote experimentation, elearn-
ing.
I. INTRODUCTION
Learning is a key human activity essential for personal
well-being and ensuring a good quality of life. Learning can
take many forms, from informal learning via online resources,
workplace learning to update oneself on latest procedures
or protocols, to formal certified learning within established
educational institutions. Learning is also an important concern
when considered simply from a budgetary perspective. For ex-
ample, in 2009 the European Union (EU) budget on education
was 6.2% of the European Gross Domestic Product (GDP)1
.
Moreover, the education budget is currently being reduced in
a number of EU countries, for example in Spain and Greece,
which is an additional rationale for innovative solutions en-
abling the provisioning of cost-effective high quality learning.
Information and Communications Technologies (ICT) have
enabled a wide range of e-learning methods, technologies and
tools, varying from asynchronous assisted learning systems
to highly dynamic and interactive learning platforms. These
techniques provide new options to improve the learning expe-
rience of students under a limited budget. A step forward in
the evolution of the e-learning processes is to enhance them
by enabling experimentally-driven e-learning. To achieve this
goal two main components must come together: remote testbed
1http://epp.eurostat.ec.europa.eu/statistics explained/index.php/
Educational expenditure statistics
experimentation and online platforms capable of interacting
with those testbeds.
Experimentation is a key component of engineering ed-
ucation. However, physical experimentation is expensive, in
particular for low-budget institutions, difficult to maintain,
usually requires specific guidance during the experiment, and
the access to lab facilities are restricted beyond regular working
hours, as emphasized by Bose [1]. Physical experiments are
mandatory for most engineering education areas in order to
allow learners to fully understand design procedures, practical
limitations, and engineering tradeoffs. The experimentation
process is widely recognized as vital for developing these
skills in both undergraduate and graduate telecommunications
engineering education and research [2]. Deploying and main-
taining experimental laboratories is costly; offering a labora-
tory capable of developing cutting edge telecommunications
technologies requires massive effort and budget. Therefore,
remote laboratories can alleviate these problems by providing
external access to experiments and allowing students to access
experiments without time or location restrictions. Furthermore,
these facilities can be packaged with supporting materials that
provide the necessary guidance to students or are configured
to constrain operation according to the experimenter’s require-
ments. Remote experiments can be ready all the time, and
thus the remote laboratory concept provides a tool to sustain
a learner-centric teaching approach [3]. Moreover, several
studies demonstrate the benefits of hands-on laboratories and
learning-by-doing approaches [4], [2], [5]. Additionally, there
are programmes leveraging the wide deployment of experi-
mental platforms such as Fed4FIRE2
, Planetlab3
[6], Orbit4
and Forging Online Education through FIRE (FORGE)5
[3]
for remote experimentation with communication networks.
Testbed facilities, in order to fulfil the different users’
needs and to offer customized solutions to each user or type
of experiment, can apply virtualization techniques. Virtual-
ization of computational resources offers numerous benefits
that have been recognized in several fields. These benefits are
based on the abstraction that is fundamental to virtualization;
2http://www.fed4fire.eu
3http://www.planet-lab.org
4http://www.orbit-lab.org
5http://www.ict-forge.eu
virtualization separates operating system components from
hardware resources. The nature of this abstraction and the
additional functionality enabled depends largely on the specific
components used to compose the overall testbed.
This paper presents our initiative on enhancing engineering
education by providing an online course empowered by hands-
on experimentation on top of our high-performance testbed
that combines virtualized cloud-computing and advanced radio
hardware. This effort provides an example of the successful
integration of a virtualized wireless testbed into university
instruction.
II. RELATED WORK
Online available labs, depending on their features, have
been grouped into several categories. Depending on the meth-
ods used to access and to trigger the equipment at the back-
end facility and the technology used in the front-end graphical
interface, from three to six different categories have been
defined [7], [8], [1]. We can summarize those taxonomies into
three categories:
• Virtual labs, which are software-based laboratories,
empowered by simulation tools.
• Remote labs, based on remote experimentation on real
lab equipment.
• Hybrid labs, which combine the above two by pro-
cessing output data from real measurements into sim-
ulation tools.
As mentioned before, experimentation is required to train
students and enhance their skills in higher education pro-
grams, in particular in engineering fields. There are several
works that describe the approaches that different universities
and/or projects have applied to enable engineering-related
online laboratories. Most of the approaches rely on simulation,
providing virtual labs for teaching robotics [9], electronic
circuits [10], control systems [7] or a broad list of engineering
disciplines [1].
Nevertheless, there are particular areas that require real
experimentation, and where remote-based labs bring an added
value, as is the case of the lab presented by Fidalgo et al.
[11] for remotely designing and testing circuits in physical
equipment.
Regarding remote labs for teaching telecommunications
related content, few approaches have been publicly proposed.
Bose and Pawar [12] have proposed a remote lab for wireless
signals where students can learn about the foundations of wire-
less signal, with concepts such as antenna radiation pattern,
gain-bandwidth product of an antenna, cross polar discrimina-
tion and SNR. The architecture proposed presents a front-end
webpage to access the back-end equipment. The website is
deployed with Adobe Flash to offer the graphical interface.
The back-end equipment relies on LabView to interface to the
telecommunications equipment, including spectrum analyzers,
oscilloscopes and signal generators. This lab can be accessed
by one student at a time.
Our approach falls into the remote lab category. We have
enabled flexible radio equipment to be accessed through a
cloud-based system, allowing students to perform remote ex-
periments from different computing devices.
III. VIRTUALIZED TESTBED FOR EDUCATIONAL USE
In Trinity College Dublin (TCD) we have been successful
in deploying a wireless communications and networks labo-
ratory to support telecommunications engineering education.
Our laboratory is equipped with advanced radio hardware that
allows us to study, in a flexible manner, a wide range of
wireless technologies. Figures 1 and 2 show the computa-
tional resources and specialized radio frequency equipment,
respectively, deployed in our laboratory. The wireless network
laboratory allows us to train students on radio hardware -e.g.,
Universal Software Radio Peripheral (USRP)- that we employ
to perform complex experiments in wireless communications,
and spectrum analyzers that provide accurate measurements
across the frequency spectrum. This combination of labora-
tory resources has enabled a telecommunication ecosystem
that supports hands-on experimentation not only for TCD’s
students, but also students from around the globe, since the
laboratory can be accessed both locally and remotely through
the Internet.
Fig. 1. Wireless laboratory servers
General testbed facilities can be classified into develop-
ment, research and instructional oriented [7]. Our testbed was
initially deployed for research purposes. More recently, we
have applied our expertise in testbed development to also
support engineering education, testing and prototyping work
by industry partners, and research efforts of several institutions
throughout Europe. Targeting the educational initiative dis-
cussed here, we have designed a wireless communications and
networks course that is anchored in hands-on experimentation
using our local testbed. Our hands-on lab course relies in two
components: the testbed facilities (local and remote) and the
educational material.
Fig. 2. Wireless laboratory radio equipment
A. Testbed architecture and resources
We maintain a wireless testbed for the exploration of
Software Defined Radio (SDR) systems, focusing on providing
users the ability to customize the platform to their needs.
In pursuit of providing this custom testbed experience, our
facility is organized into experimentation units, supported by
virtual computational platforms. Experimentation units are a
logical organization of resources consisting of a computational
element, a hardware radio front-end component, and the Iris
software defined radio package [13]. Each experimentation
unit represents the minimum set of resources required by a
user to construct a radio element in TCD’s facility. Due to
the capabilities of Iris, these experimental units effectively
represent the potential to realize any arbitrary radio system
that a user may require. This organization of TCD’s testbed
facility allows users to deploy a customized radio system as
needed.
User customization is underpinned by the application of
a cloud-computing based management system. This paradigm
combines virtualized computational resources, loaded with a
highly configurable (and reconfigurable) SDR package, and
widely flexible radio hardware to support experimentation
based research. Virtualization of computational elements pro-
vides each user complete control over an isolated computa-
tional environment. Since each user controls their own virtu-
alized environment, users are free to completely individualize
their computational platform, including configuration of global
libraries or loading of additional software. Users may save
their configurations, including all details of the computational
system, for later use, at any point. The management system
streamlines coordination of virtual computers, handling the
deployment of these environments and their connection to
radio hardware at the request of the user. The result of
cloud-computing based management is that each user gets the
experience of a personal testbed, yet the resources are shared
among many separate users and projects.
Figure 3 displays the architecture of TCD’s virtualized
testbed. Each experimentation unit initially provides users with
a virtual computer running a Linux-based operating system and
loaded with the Iris SDR package. An array of servers, referred
to as host servers, provide the computational power to run
these experimentation units. Each virtual machine is connected
to a USRP mounted on our ceiling grid within our dedicated
testing space. These connections are made through dedicated
network ports; i.e., each experimentation unit is provided with
a dedicated network interface for connection to a USRP. The
front-end server coordinates and controls virtual machines,
handling the deployment of computational environments and
their connection to USRPs. The front-end server also provides
users access to experimentation units, currently through SSH.
Centralized control also allows the front-end to handle the
scheduling of user access.
Fig. 4. Support architecture
Figure 4 displays the support structure for the virtualization
management system. A gateway machine provides a central
point for remote testbed access, data access, and documenta-
tion. This gateway machine also runs the FORGEBOX user
interface, see Section III-B. The dedicated documentation
server provides users with a wealth of information on how
to use the testbed. The data server holds user data separately
from virtual machines, providing a more permanent storage lo-
Fig. 3. Testbed architecture
cation and allowing the collection of information from several
virtual machines. This support system allows users to take full
advantage of the cloud-based management structure.
B. FORGEBox framework
To deploy this course and make it available to learners
through web access, a framework called FORGEBox6
is used.
This framework technology is provided by the FORGE EU
Framework Programme 7 project, which aims to transform the
Future Internet Research and Experimentation (FIRE)7
testbed
facilities into a learning resource for higher education. FORGE
provides an educational layer over the FIRE facilities, enabling
experiment-based learning resources. FORGE specifies devel-
opment methodologies and best practices for offering testbed
experimentation facilities to learners.
This section gives a brief overview of the FORGEBox
framework technology, which is used to support interactive
courses using resources of remote labs. FORGEBox is defined
and implemented within the FORGE project. The framework
defines an architecture, user roles, core entities and necessary
components to support these courses. There are three defined
core entities:
• FORGEBox course module, which consists of course
presentation parts and interactive parts. The presenta-
tion parts contain text, images and video content. The
interactive parts contain widgets that help the learner
to interact with the underlying remote lab resources.
6http://www.forgebox.eu
7http://ict-fire.eu
• FORGEBox widgets are small web-based standalone
applications that expose the remote lab functionality
and enable a learner to perform actions on remote
resources. These can be embedded in web pages or
eBooks.
• FIRE adapter/FORGEBox services are backend ser-
vices that either support widget functionality or sup-
port a lab course assistant/designer to setup a remote
lab for a course.
The framework defines also the following main actors:
• Learner: utilizes FORGEBox tools and services, uses
different means to access the courses and manipulates
remote lab resources through widgets. The means
to access the courses include electronic books or
Learning Management System (LMS) web pages.
• Lab course designer: designs a course and imple-
ments it by using learning material (e.g., text, figures,
videos), widgets and FIRE adapters.
• Lab course assistant: responsible for the normal
execution of a course and has different responsibilities,
such as creating accounts for lab learners, scheduling
and reserving remote lab resources (if not carried
out automatically when a Learner starts a course),
delegating control, etc.
• Widget provider: develops and maintains widgets
(usually for web consumption) providing a user in-
terface for learners to manipulate the experimentation
environment.
• FIRE adapter/service provider: develops and main-
tains FIRE adapters, deployed into FORGEBox ser-
vices.
FORGEBox also defines a platform that hosts all the above
necessary artefacts to enable an interactive course. It is an ag-
gregation of services able to support all FORGE concepts and
requirements, learning widgets, and FIRE adapters/services.
FORGEBox is delivered as a middleware solution, deployed
in institutions executing courses or into a cloud infrastructure,
bridging the interfaces between learning means and FIRE tools
and facilities.
FORGEBox includes tools and services that target both
learners and lab course designers. Learners can easily access
FIRE facilities and perform small experiments through the
web enabled interface of widgets. Lab course designers have
a collection of tools to create the course content, and to
prepare and configure the target FIRE testbed that supports
the interactive course.
Figure 5 presents a detailed view of the FORGEBox
architectural framework. The figure displays also the concept
of a FORGE repository that hosts any shared published items
such as lab courses, widgets and FIRE adapters to be used by
the learning community and by other organizations hosting
a FORGEBox instantiation. At its simplest form the core
consists of services that make some tasks easier such as
creating, managing and operating lab courses and their content
as well as widgets and adapters. FORGEBox will contain a set
of managing services, a widgets layer, a FIRE adapters layer
and a local repository of hosted lab courses. FORGEBox is
implemented and provided under open source licenses. A run-
ning instance can be found at http://www.forgebox.eu/fb. The
global repository for FORGEBox artefacts sharing is called
FORGEStore and its located at http://www.forgestore.eu.
C. SSH
One of the most used means to access machines residing
in remote lab facilities is through terminal utilities. The most
known protocol is Secure Shell (SSH), since it enables an
experimenter to access a resource and fully manage it via
the command line. SSH client tools exist for almost any
operating system, either natively or via external downloaded
tools. In FORGEBox we turned to web-based SSH tech-
nology. Web-based SSH makes it possible to access SSH
servers through web clients that are based on JavaScript/Ajax
or JavaScript/WebSockets technologies. To enable web-based
SSH clients a server side web application is needed, hosted in
a server playing the role of an SSH proxy. Incoming requests
are processed on the web application server. Keyboard events
are forwarded to a secure shell client communicating with the
connected SSH server. Terminal output is either passed to the
client where it is converted into HTML via JavaScript or it
is translated into HTML by the server before it is transmitted
to the client. The SSH proxy web application can be hosted
in FORGEBox as a service. Figure 6 presents the ssh2web
widget as used inside a course.
The widget is provided by a web application written in
Java. Figure 7 displays the architecture of the widgets web
application. It shows how the communication is accomplished
from the ssh2web application towards a remote machine, via
Fig. 6. SSH2web widget embedded in HTML
private/public keys or even username/password pair. The text
provided by the SSH communication is translated from a
read/writer thread class into a web JSON object and is passed
to the websocket class, and is sent to the web browser via
a javascript web socket opened in the browser. The reverse
process is applied when the user types a command. Each
keystroke is passed as a JSON object to the websocket class,
where it is transformed again and sent through the SSH session
class to the remote machine. Finally, we can audit the session
for security purposes, for future reference, or any other kind of
measurements, by accessing the history of typed commands.
Fig. 7. SSH2web widget architecture
IV. EDUCATIONAL MATERIAL
As mentioned previously, our testbed is deployed under
the cloud-computing paradigm, having different computational
and USRP radio resources under a single managed cloud, as
shown in Figure 8. Such resources are then used to enable
specific requests on the demand of the users of the cloud. We
have deployed the tools that enable the whole infrastructure
to create the ‘experimentation units’ for educational purposes.
Moreover, Figure 9 illustrates the concept of deploying a real
network from a ‘drag and drop’ widget, where the widget
tells the front-end what resources are needed and enables such
resources to be delivered to the cloud. All of this is enabled
through the FORGEBox framework. Finally, the student can
access those resources directly in a transparent way, having
real resources for online experimentation.
The created content can be easily adapted to Massive
Online Open Courses (MOOCs) and interactive eBooks, where
Fig. 5. FORGEBox framework architecture
Fig. 8. Mapping the Widget-based experiment configuration into the testbed
resources
rich multimedia content is combined with interactive pages to
set up and run large-scale experiments on top of our wireless
testbed.
We now briefly provide an overview of a module created in
TCD, as well as the type of experimentation involved within
this module:
Title of the course
Coexistence of Small Cells in Radar Bands
Fig. 9. Mock up of the Experiment creator widget
Summary of the course
Radar spectrum is currently heavily underutilized due pri-
marily to the need to avoid interfering with sensitive measuring
equipment. Pursuit of such protection has resulted in the
creation of large exclusion zones around radar stations that
isolate them from potential interference. Due to the high degree
of radar directionality and the availability of highly capable
wireless systems, existing static exclusion zones represent
an unnecessary inefficiency. TCD has constructed a Radio
Coordinator Module using the Iris software defined radio
package and the virtualized wireless testbed that allows radios
to identify the features of a radar system and effectively operate
within that radar’s exclusion zone without causing harmful
interference. This coordinator module is a prototype for a small
cell controller, designed to open radar spectrum for use in
future cellular networks.
With this course we demonstrate the capability of Cognitive
Radios (CRs) or Secondary User (SU) systems to coexist with
radar systems, the incumbents, even when the CR is located
inside the radar exclusion zone defined by the range of its
signal through its antenna main beam. In order to do so, CRs
have to perform the following tasks:
• Estimate the parameters of the radar systems in the
radio environment, namely, their antenna radiation and
scan pattern and rotation periodicity, through spectrum
sensing.
• From the perceived radar’s rotation periodicity and
radiation and scan patterns, design a mechanism that
predicts future instances of interference from the CR
to the radar and vice-versa. To assess whether there
might be interference, the received signal strength by
the CR is compared with a pre-defined threshold.
• Schedule transmissions in such a way it avoids inter-
fering with the radar for the intervals of interference
calculated in the second step.
• Stay synchronized with the radar antenna rotation.
Online material of the course
The material for this course can be used and reused in
different elearning platforms and devices, as mentioned before
and shown in Figure 10. Moreover, the full HTML-based
course is shown in Figure 11, where different multimedia
components, such as widgets, sliders and images, are combined
to offer an enhanced hands-on remote experimentation course.
This course is being taught in the 5C2 - Wireless networks
and communications module of the Electrical and Electronic
Engineering (EEE) Master in Engineering (MAI) degree within
TCD. Moreover, it will be soon publicly available through the
aforementioned FORGEBox portal.
Fig. 10. The course material shown in different devices
V. DISCUSSION
Within the elearning community, and in particular, the
online labs community, several concerns are being considered
and discussed regarding the educational and technological
domains.
1) Education related:
• Pedagogical principles. When deploying the content
labs and designing the experimentation, several peda-
gogical aspects should be taken into account, such as
matching the curricula, inclusion, learner engagement,
innovative approaches, and effective learning, among
others.
• Learning analytics. The labs deployed should aim to
collect data and analyze the learning patterns of the
students in order to improve the labs [14].
• Evaluation. The labs should have an evaluation module
that enables the observation of the skills gained by the
students due to experimentation.
2) Technology related:
• Development methodology and tools. A methodol-
ogy should be defined when deploying online labs.
Common tools can be used to provide homogeneous
feedback about the students’ performance, enabling
cross-referenced information to enrich data for ana-
lytic purposes.
• Sustainability models. There is a concern among on-
line lab providers and developers about the sustainabil-
ity models that should be applied towards maintaining
such labs and towards improving them [8].
VI. CONCLUSIONS
We have presented our approach for enabling virtualized
cloud-computing and advanced radio hardware for educational
purposes. The use of our enhanced facilities for hands-on re-
mote experimentation and the experience of lecturing the 5C2
module allow us to attest to the benefits of blended teaching,
combining traditional lectures with hands-on experimentation
using remote high-performance facilities, and its valuable
impact on the students’ learning experience. Moreover, this
approach enables Self-Regulated Learning (SRL), allowing the
students to learn at their own pace. Nevertheless, our approach
will continue being developed to tackle the issues discussed in
the paper, to improve the learning experience of the students
and to provide feedback to instructors.
ACKNOWLEDGMENTS
This work has received funding from the European Union’s
Seventh Framework Programme for research, technological
development and demonstration under grant agreements no.
610889 (FORGE) and 258301 (CREW).
We also acknowledge support of the Fed4FIRE project
(’Federation for FIRE’), an integrated project funded by the
European Commission through the 7th ICT-Framework Pro-
gramme (318389).
REFERENCES
[1] R. Bose, “Virtual Labs Project: A Paradigm Shift in Internet-Based
Remote Experimentation,” IEEE Access, vol. 1, pp. 718–725, 2013.
[Online]. Available: http://dx.doi.org/10.1109/access.2013.2286202
[2] G. Jourjon, S. Kanhere, and J. Yao, “Impact of an e-learning Platform
on CSE Lectures,” in Proceedings of the 16th annual joint conference
on innovation and technology in computer science education, 2011, pp.
83–87.
[3] J. M. Marquez-Barja, G. Jourjon, M. Alexander, C. Tranoris,
J. Domingue, and L. A. DaSilva, “FORGE: Enhancing elearning
and research in ict through remote experimentation,” in IEEE Global
Engineering Education Conference (EDUCON), April 2014, pp. 1157–
1163.
[4] A. Sanchez, I. Moerman, S. Bouckaert, D. Willkomm, J. Hauer,
N. Michailow, G. Fettweis, L. Dasilva, J. Tallon, and S. Pollin,
“Testbed federation: An approach for experimentation-driven research
in cognitive radios and cognitive networking,” in Future Network &
Mobile Summit (FutureNetw), June 2011, pp. 1–9. [Online]. Available:
http://ieeexplore.ieee.org/xpls/abs all.jsp?arnumber=6095242
[5] N. Handigol, B. Heller, V. Jeyakumar, B. Lantz, and N. McKeown,
“Reproducible network experiments using container-based emulation,”
in Proceedings of CoNEXT, 2012.
[6] PlanetLab Consortium, “Planetlab: An open platform for develop-
ing, deploying, and accessing planetary-scale services,” http://www.
planet-lab.org/.
[7] A. Diwakar, S. Poojary, R. Rokade, S. Noronha, and K. Moudgalya,
“Control systems virtual labs: Pedagogical and technological
perspectives,” in IEEE International Conference on Control
Applications (CCA), Aug. 2013, pp. 483–488. [Online]. Available:
http://dx.doi.org/10.1109/cca.2013.6662796
[8] S. Frerich, D. Kruse, M. Petermann, and A. Kilzer, “Virtual Labs
and Remote Labs: Practical experience for everyone,” in IEEE
Global Engineering Education Conference (EDUCON), Apr. 2014, pp.
312–314. [Online]. Available: http://dx.doi.org/10.1109/educon.2014.
6826109
[9] P. Abreu, M. Romano Barbosa, and A. Mendes Lopes, “Robotics
virtual lab based on off-line robot programming software,” in 2nd
Experimenta International Conference (exp.at’13), 2013, pp. 109–113.
[Online]. Available: http://dx.doi.org/10.1109/expat.2013.6703040
[10] D. Bagchi, K. Kaushik, and B. Kapoor, “Virtual labs for electronics
engineering using cloud computing,” in 2013 3rd Interdisciplinary
Engineering Design Education Conference (IEDEC), Mar. 2013,
pp. 39–40. [Online]. Available: http://dx.doi.org/10.1109/iedec.2013.
6526757
[11] A. V. Fidalgo, G. R. Alves, M. A. Marques, M. C. Viegas, M. C.
Costa-Lobo, U. Henandez-Jayo, J. Garcia-Zubia, and I. Gustavsson,
“Adapting Remote Labs to Learning Scenarios: Case Studies
Using VISIR and RemotElectLab,” IEEE Revista Iberoamericana de
Tecnologias del Aprendizaje, vol. 9, no. 1, pp. 33–39, Feb. 2014.
[Online]. Available: http://dx.doi.org/10.1109/rita.2014.2302071
[12] R. Bose and P. Pawar, “Virtual Wireless Lab Concept, design and
implementation,” in IEEE International Conference on Technology
Enhanced Education (ICTEE), Jan. 2012, pp. 1–7. [Online]. Available:
http://dx.doi.org/10.1109/ictee.2012.6208669
[13] P. D. Sutton, J. Lotze, H. Lahlou, S. A. Fahmy, K. E. Nolan, B. Ozgul,
T. W. Rondeau, J. Noguera, and L. E. Doyle, “Iris: an architecture
for cognitive radio networking testbeds,” IEEE communications
magazine, vol. 48, no. 9, pp. 114–122, Sep. 2010. [Online]. Available:
http://dx.doi.org/10.1109/mcom.2010.5560595
[14] L. Rosniak Tibola, “A proposal of engineering education architecture:
Improve engineer’s competencies through practice labs and 3D
virtual worlds,” in 2th IEEE International Conference on Industrial
Informatics (INDIN), Jul. 2014, pp. 791–794. [Online]. Available:
http://dx.doi.org/10.1109/indin.2014.6945615
Fig. 11. The HTML-based hands-on remote experimentation based course

More Related Content

Viewers also liked

Developing interactive learning resources
Developing interactive learning resourcesDeveloping interactive learning resources
Developing interactive learning resourcesFORGE project
 
iMinds' course: Wi-Fi throughput
iMinds' course: Wi-Fi throughputiMinds' course: Wi-Fi throughput
iMinds' course: Wi-Fi throughputFORGE project
 
FORGE Methodology - CI FIRE Methodology Workshop @ NetFutures 15
FORGE Methodology - CI FIRE Methodology Workshop @ NetFutures 15FORGE Methodology - CI FIRE Methodology Workshop @ NetFutures 15
FORGE Methodology - CI FIRE Methodology Workshop @ NetFutures 15FORGE project
 
FORGE Keynote @ IT Mexicali, October 2015
FORGE Keynote @ IT Mexicali, October 2015FORGE Keynote @ IT Mexicali, October 2015
FORGE Keynote @ IT Mexicali, October 2015FORGE project
 
FORGE: Enhancing eLearning and research in ICT through remote experimentation
FORGE: Enhancing eLearning and research in ICT through remote experimentationFORGE: Enhancing eLearning and research in ICT through remote experimentation
FORGE: Enhancing eLearning and research in ICT through remote experimentationFORGE project
 
product life cycle
product life cycleproduct life cycle
product life cyclemer5712
 
About FORGE presentation
About FORGE presentationAbout FORGE presentation
About FORGE presentationFORGE project
 
FORGE: BRINGING FIRE AND THE E-LEARNING SPHERES TOGETHER
FORGE: BRINGING FIRE AND THE E-LEARNING SPHERES TOGETHERFORGE: BRINGING FIRE AND THE E-LEARNING SPHERES TOGETHER
FORGE: BRINGING FIRE AND THE E-LEARNING SPHERES TOGETHERFORGE project
 
Gdb + gdb server + socat
Gdb + gdb server + socatGdb + gdb server + socat
Gdb + gdb server + socatmozzenior
 

Viewers also liked (12)

Developing interactive learning resources
Developing interactive learning resourcesDeveloping interactive learning resources
Developing interactive learning resources
 
iMinds' course: Wi-Fi throughput
iMinds' course: Wi-Fi throughputiMinds' course: Wi-Fi throughput
iMinds' course: Wi-Fi throughput
 
FORGE Methodology - CI FIRE Methodology Workshop @ NetFutures 15
FORGE Methodology - CI FIRE Methodology Workshop @ NetFutures 15FORGE Methodology - CI FIRE Methodology Workshop @ NetFutures 15
FORGE Methodology - CI FIRE Methodology Workshop @ NetFutures 15
 
FORGE Keynote @ IT Mexicali, October 2015
FORGE Keynote @ IT Mexicali, October 2015FORGE Keynote @ IT Mexicali, October 2015
FORGE Keynote @ IT Mexicali, October 2015
 
FORGE: Enhancing eLearning and research in ICT through remote experimentation
FORGE: Enhancing eLearning and research in ICT through remote experimentationFORGE: Enhancing eLearning and research in ICT through remote experimentation
FORGE: Enhancing eLearning and research in ICT through remote experimentation
 
product life cycle
product life cycleproduct life cycle
product life cycle
 
About FORGE presentation
About FORGE presentationAbout FORGE presentation
About FORGE presentation
 
FORGE project
FORGE project FORGE project
FORGE project
 
FORGE project
FORGE projectFORGE project
FORGE project
 
FORGE: BRINGING FIRE AND THE E-LEARNING SPHERES TOGETHER
FORGE: BRINGING FIRE AND THE E-LEARNING SPHERES TOGETHERFORGE: BRINGING FIRE AND THE E-LEARNING SPHERES TOGETHER
FORGE: BRINGING FIRE AND THE E-LEARNING SPHERES TOGETHER
 
Gdb + gdb server + socat
Gdb + gdb server + socatGdb + gdb server + socat
Gdb + gdb server + socat
 
Pneumatics
PneumaticsPneumatics
Pneumatics
 

Similar to Virtualizing testbed resources to enable remote experimentation in online telecommunications education

Integration of an e-learning Platform and a Remote Laboratory for the Experim...
Integration of an e-learning Platform and a Remote Laboratory for the Experim...Integration of an e-learning Platform and a Remote Laboratory for the Experim...
Integration of an e-learning Platform and a Remote Laboratory for the Experim...Federico Lerro
 
Widget and Smart Devices. A Different Approach for Remote and Virtual labs
Widget and Smart Devices. A Different Approach for Remote and Virtual labsWidget and Smart Devices. A Different Approach for Remote and Virtual labs
Widget and Smart Devices. A Different Approach for Remote and Virtual labsUNED
 
A Wireless Communications Laboratory On Cellular Network Planning
A Wireless Communications Laboratory On Cellular Network PlanningA Wireless Communications Laboratory On Cellular Network Planning
A Wireless Communications Laboratory On Cellular Network PlanningRick Vogel
 
REMOTE REALISTIC INTERFACE EXPERIMENTATION USING THE EMONA DATEX BOARD
REMOTE REALISTIC INTERFACE EXPERIMENTATION USING THE EMONA DATEX BOARDREMOTE REALISTIC INTERFACE EXPERIMENTATION USING THE EMONA DATEX BOARD
REMOTE REALISTIC INTERFACE EXPERIMENTATION USING THE EMONA DATEX BOARDBabatunde Ishola
 
Virtual classroom overview
Virtual classroom overviewVirtual classroom overview
Virtual classroom overviewkhalid adam
 
Electronic Instrumentation Virtual Laboratory
Electronic Instrumentation Virtual LaboratoryElectronic Instrumentation Virtual Laboratory
Electronic Instrumentation Virtual Laboratorygmeneses23
 
EDUCON2018_P1876_Saliah-Hassane_Final.pptx
EDUCON2018_P1876_Saliah-Hassane_Final.pptxEDUCON2018_P1876_Saliah-Hassane_Final.pptx
EDUCON2018_P1876_Saliah-Hassane_Final.pptxfelipezapata51
 
Online instrument systems in reality for remote wiring and measurement of ele...
Online instrument systems in reality for remote wiring and measurement of ele...Online instrument systems in reality for remote wiring and measurement of ele...
Online instrument systems in reality for remote wiring and measurement of ele...IJECEIAES
 
Remote Experimentation from Research to Education: A European Roadmap
Remote Experimentation from Research to Education: A European RoadmapRemote Experimentation from Research to Education: A European Roadmap
Remote Experimentation from Research to Education: A European RoadmapJohann Marquez-Barja
 
Curriculum Vitae
Curriculum VitaeCurriculum Vitae
Curriculum VitaeAndy Nisbet
 
ACHIEVING SEAMLESS MIGRATION TO PRIVATECLOUD INFRASTRUCTURE FOR MULTI-CAMPUS ...
ACHIEVING SEAMLESS MIGRATION TO PRIVATECLOUD INFRASTRUCTURE FOR MULTI-CAMPUS ...ACHIEVING SEAMLESS MIGRATION TO PRIVATECLOUD INFRASTRUCTURE FOR MULTI-CAMPUS ...
ACHIEVING SEAMLESS MIGRATION TO PRIVATECLOUD INFRASTRUCTURE FOR MULTI-CAMPUS ...ijccsa
 
The Promise of Grid Computing Technologies for E-Learning Systems in Kenya
The Promise of Grid Computing Technologies for E-Learning Systems in KenyaThe Promise of Grid Computing Technologies for E-Learning Systems in Kenya
The Promise of Grid Computing Technologies for E-Learning Systems in KenyaUmma Khatuna Jannat
 
Integrating Collaboration and Accessibility for Deploying Virtual Labs using ...
Integrating Collaboration and Accessibility for Deploying Virtual Labs using ...Integrating Collaboration and Accessibility for Deploying Virtual Labs using ...
Integrating Collaboration and Accessibility for Deploying Virtual Labs using ...drboon
 
An Open and Improved VISIR System Through PILAR Federation for Electrical/Ele...
An Open and Improved VISIR System Through PILAR Federation for Electrical/Ele...An Open and Improved VISIR System Through PILAR Federation for Electrical/Ele...
An Open and Improved VISIR System Through PILAR Federation for Electrical/Ele...Manuel Castro
 

Similar to Virtualizing testbed resources to enable remote experimentation in online telecommunications education (20)

Integration of an e-learning Platform and a Remote Laboratory for the Experim...
Integration of an e-learning Platform and a Remote Laboratory for the Experim...Integration of an e-learning Platform and a Remote Laboratory for the Experim...
Integration of an e-learning Platform and a Remote Laboratory for the Experim...
 
Widget and Smart Devices. A Different Approach for Remote and Virtual labs
Widget and Smart Devices. A Different Approach for Remote and Virtual labsWidget and Smart Devices. A Different Approach for Remote and Virtual labs
Widget and Smart Devices. A Different Approach for Remote and Virtual labs
 
A Wireless Communications Laboratory On Cellular Network Planning
A Wireless Communications Laboratory On Cellular Network PlanningA Wireless Communications Laboratory On Cellular Network Planning
A Wireless Communications Laboratory On Cellular Network Planning
 
REMOTE REALISTIC INTERFACE EXPERIMENTATION USING THE EMONA DATEX BOARD
REMOTE REALISTIC INTERFACE EXPERIMENTATION USING THE EMONA DATEX BOARDREMOTE REALISTIC INTERFACE EXPERIMENTATION USING THE EMONA DATEX BOARD
REMOTE REALISTIC INTERFACE EXPERIMENTATION USING THE EMONA DATEX BOARD
 
Virtual classroom overview
Virtual classroom overviewVirtual classroom overview
Virtual classroom overview
 
Electronic Instrumentation Virtual Laboratory
Electronic Instrumentation Virtual LaboratoryElectronic Instrumentation Virtual Laboratory
Electronic Instrumentation Virtual Laboratory
 
Hamza, others
Hamza, othersHamza, others
Hamza, others
 
EDUCON2018_P1876_Saliah-Hassane_Final.pptx
EDUCON2018_P1876_Saliah-Hassane_Final.pptxEDUCON2018_P1876_Saliah-Hassane_Final.pptx
EDUCON2018_P1876_Saliah-Hassane_Final.pptx
 
Jasmine
JasmineJasmine
Jasmine
 
Fire Brochure 2015
Fire Brochure 2015Fire Brochure 2015
Fire Brochure 2015
 
Fire Brochure 2015
Fire Brochure 2015Fire Brochure 2015
Fire Brochure 2015
 
Athulya
AthulyaAthulya
Athulya
 
TridentCom 2006 paper on the Living Lab approach
TridentCom 2006 paper on the Living Lab approachTridentCom 2006 paper on the Living Lab approach
TridentCom 2006 paper on the Living Lab approach
 
Online instrument systems in reality for remote wiring and measurement of ele...
Online instrument systems in reality for remote wiring and measurement of ele...Online instrument systems in reality for remote wiring and measurement of ele...
Online instrument systems in reality for remote wiring and measurement of ele...
 
Remote Experimentation from Research to Education: A European Roadmap
Remote Experimentation from Research to Education: A European RoadmapRemote Experimentation from Research to Education: A European Roadmap
Remote Experimentation from Research to Education: A European Roadmap
 
Curriculum Vitae
Curriculum VitaeCurriculum Vitae
Curriculum Vitae
 
ACHIEVING SEAMLESS MIGRATION TO PRIVATECLOUD INFRASTRUCTURE FOR MULTI-CAMPUS ...
ACHIEVING SEAMLESS MIGRATION TO PRIVATECLOUD INFRASTRUCTURE FOR MULTI-CAMPUS ...ACHIEVING SEAMLESS MIGRATION TO PRIVATECLOUD INFRASTRUCTURE FOR MULTI-CAMPUS ...
ACHIEVING SEAMLESS MIGRATION TO PRIVATECLOUD INFRASTRUCTURE FOR MULTI-CAMPUS ...
 
The Promise of Grid Computing Technologies for E-Learning Systems in Kenya
The Promise of Grid Computing Technologies for E-Learning Systems in KenyaThe Promise of Grid Computing Technologies for E-Learning Systems in Kenya
The Promise of Grid Computing Technologies for E-Learning Systems in Kenya
 
Integrating Collaboration and Accessibility for Deploying Virtual Labs using ...
Integrating Collaboration and Accessibility for Deploying Virtual Labs using ...Integrating Collaboration and Accessibility for Deploying Virtual Labs using ...
Integrating Collaboration and Accessibility for Deploying Virtual Labs using ...
 
An Open and Improved VISIR System Through PILAR Federation for Electrical/Ele...
An Open and Improved VISIR System Through PILAR Federation for Electrical/Ele...An Open and Improved VISIR System Through PILAR Federation for Electrical/Ele...
An Open and Improved VISIR System Through PILAR Federation for Electrical/Ele...
 

More from FORGE project

iMinds' course: preceding exercises
iMinds' course: preceding exercisesiMinds' course: preceding exercises
iMinds' course: preceding exercisesFORGE project
 
Education using FIRE
Education using FIREEducation using FIRE
Education using FIREFORGE project
 
Transforming education through FORGE
Transforming education through FORGETransforming education through FORGE
Transforming education through FORGEFORGE project
 
Education using FIRE
Education using FIRE Education using FIRE
Education using FIRE FORGE project
 
FORGE - Perfect Pitch Panel @ NetFutures 15
FORGE - Perfect Pitch Panel @ NetFutures 15FORGE - Perfect Pitch Panel @ NetFutures 15
FORGE - Perfect Pitch Panel @ NetFutures 15FORGE project
 
FIRE in a Book - Future Internet Opportunities for Innovative European Busine...
FIRE in a Book - Future Internet Opportunities for Innovative European Busine...FIRE in a Book - Future Internet Opportunities for Innovative European Busine...
FIRE in a Book - Future Internet Opportunities for Innovative European Busine...FORGE project
 
FORGE: Enhancing eLearning and research in ICT through remote experimentation
FORGE: Enhancing eLearning and research in ICT through remote experimentationFORGE: Enhancing eLearning and research in ICT through remote experimentation
FORGE: Enhancing eLearning and research in ICT through remote experimentationFORGE project
 
FORGE poster @ iMinds Conference
FORGE poster @ iMinds ConferenceFORGE poster @ iMinds Conference
FORGE poster @ iMinds ConferenceFORGE project
 
FORGE - Best poster award FIA14
FORGE - Best poster award FIA14FORGE - Best poster award FIA14
FORGE - Best poster award FIA14FORGE project
 

More from FORGE project (10)

iMinds' course: preceding exercises
iMinds' course: preceding exercisesiMinds' course: preceding exercises
iMinds' course: preceding exercises
 
Education using FIRE
Education using FIREEducation using FIRE
Education using FIRE
 
Transforming education through FORGE
Transforming education through FORGETransforming education through FORGE
Transforming education through FORGE
 
Education using FIRE
Education using FIRE Education using FIRE
Education using FIRE
 
FORGE - Perfect Pitch Panel @ NetFutures 15
FORGE - Perfect Pitch Panel @ NetFutures 15FORGE - Perfect Pitch Panel @ NetFutures 15
FORGE - Perfect Pitch Panel @ NetFutures 15
 
FIRE in a Book - Future Internet Opportunities for Innovative European Busine...
FIRE in a Book - Future Internet Opportunities for Innovative European Busine...FIRE in a Book - Future Internet Opportunities for Innovative European Busine...
FIRE in a Book - Future Internet Opportunities for Innovative European Busine...
 
FORGE: Enhancing eLearning and research in ICT through remote experimentation
FORGE: Enhancing eLearning and research in ICT through remote experimentationFORGE: Enhancing eLearning and research in ICT through remote experimentation
FORGE: Enhancing eLearning and research in ICT through remote experimentation
 
FORGE poster @ iMinds Conference
FORGE poster @ iMinds ConferenceFORGE poster @ iMinds Conference
FORGE poster @ iMinds Conference
 
FORGE Brochure
FORGE BrochureFORGE Brochure
FORGE Brochure
 
FORGE - Best poster award FIA14
FORGE - Best poster award FIA14FORGE - Best poster award FIA14
FORGE - Best poster award FIA14
 

Recently uploaded

SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )Tsuyoshi Horigome
 
Call Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile serviceCall Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile servicerehmti665
 
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Serviceranjana rawat
 
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escortsranjana rawat
 
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130Suhani Kapoor
 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxJoão Esperancinha
 
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
What are the advantages and disadvantages of membrane structures.pptx
What are the advantages and disadvantages of membrane structures.pptxWhat are the advantages and disadvantages of membrane structures.pptx
What are the advantages and disadvantages of membrane structures.pptxwendy cai
 
High Profile Call Girls Nashik Megha 7001305949 Independent Escort Service Na...
High Profile Call Girls Nashik Megha 7001305949 Independent Escort Service Na...High Profile Call Girls Nashik Megha 7001305949 Independent Escort Service Na...
High Profile Call Girls Nashik Megha 7001305949 Independent Escort Service Na...Call Girls in Nagpur High Profile
 
Microscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptxMicroscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptxpurnimasatapathy1234
 
Biology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptxBiology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptxDeepakSakkari2
 
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...Soham Mondal
 
Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024hassan khalil
 
Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxpranjaldaimarysona
 
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...RajaP95
 
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSMANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSSIVASHANKAR N
 
Introduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptxIntroduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptxupamatechverse
 
Introduction to Multiple Access Protocol.pptx
Introduction to Multiple Access Protocol.pptxIntroduction to Multiple Access Protocol.pptx
Introduction to Multiple Access Protocol.pptxupamatechverse
 

Recently uploaded (20)

SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )
 
Call Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile serviceCall Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile service
 
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
 
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
 
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
 
★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR
★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR
★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR
 
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
 
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
 
What are the advantages and disadvantages of membrane structures.pptx
What are the advantages and disadvantages of membrane structures.pptxWhat are the advantages and disadvantages of membrane structures.pptx
What are the advantages and disadvantages of membrane structures.pptx
 
High Profile Call Girls Nashik Megha 7001305949 Independent Escort Service Na...
High Profile Call Girls Nashik Megha 7001305949 Independent Escort Service Na...High Profile Call Girls Nashik Megha 7001305949 Independent Escort Service Na...
High Profile Call Girls Nashik Megha 7001305949 Independent Escort Service Na...
 
Microscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptxMicroscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptx
 
Biology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptxBiology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptx
 
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
 
Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024
 
Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptx
 
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...
 
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSMANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
 
Introduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptxIntroduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptx
 
Introduction to Multiple Access Protocol.pptx
Introduction to Multiple Access Protocol.pptxIntroduction to Multiple Access Protocol.pptx
Introduction to Multiple Access Protocol.pptx
 

Virtualizing testbed resources to enable remote experimentation in online telecommunications education

  • 1. Virtualizing testbed resources to enable remote experimentation in online telecommunications education Johann M. Marquez-Barja∗, Nicholas Kaminski∗, Francisco Paisana∗, Christos Tranoris‡ and Luiz A. DaSilva∗ ∗CTVR / the telecommunications research centre Trinity College Dublin, Ireland. {marquejm,kaminskn,paisanaf,dasilval}@tcd.ie ‡University of Patras, Greece. tranoris@ece.upatras.gr Abstract—In this paper we present an approach towards empowering online telecommunications engineering education by enabling hands-on remote experimentation over Trinity College Dublin’s wireless testbed. Moreover, in order to offer a flex- ible testbed, capable of fulfilling the different and particular requirements of experimenters, we have created a framework that allows the virtualization of our testbed resources to create exper- imentation units to be used by remote experimenters/learners. Furthermore, we present the FORGEBox framework that offers an environment and resources to create online material capable to access the virtualized and physical testbed resources for incor- porating experimentation into HTML-based online educational material. Keywords—virtualized testbeds, cloud computing, wireless testbeds, research experimentation, remote experimentation, elearn- ing. I. INTRODUCTION Learning is a key human activity essential for personal well-being and ensuring a good quality of life. Learning can take many forms, from informal learning via online resources, workplace learning to update oneself on latest procedures or protocols, to formal certified learning within established educational institutions. Learning is also an important concern when considered simply from a budgetary perspective. For ex- ample, in 2009 the European Union (EU) budget on education was 6.2% of the European Gross Domestic Product (GDP)1 . Moreover, the education budget is currently being reduced in a number of EU countries, for example in Spain and Greece, which is an additional rationale for innovative solutions en- abling the provisioning of cost-effective high quality learning. Information and Communications Technologies (ICT) have enabled a wide range of e-learning methods, technologies and tools, varying from asynchronous assisted learning systems to highly dynamic and interactive learning platforms. These techniques provide new options to improve the learning expe- rience of students under a limited budget. A step forward in the evolution of the e-learning processes is to enhance them by enabling experimentally-driven e-learning. To achieve this goal two main components must come together: remote testbed 1http://epp.eurostat.ec.europa.eu/statistics explained/index.php/ Educational expenditure statistics experimentation and online platforms capable of interacting with those testbeds. Experimentation is a key component of engineering ed- ucation. However, physical experimentation is expensive, in particular for low-budget institutions, difficult to maintain, usually requires specific guidance during the experiment, and the access to lab facilities are restricted beyond regular working hours, as emphasized by Bose [1]. Physical experiments are mandatory for most engineering education areas in order to allow learners to fully understand design procedures, practical limitations, and engineering tradeoffs. The experimentation process is widely recognized as vital for developing these skills in both undergraduate and graduate telecommunications engineering education and research [2]. Deploying and main- taining experimental laboratories is costly; offering a labora- tory capable of developing cutting edge telecommunications technologies requires massive effort and budget. Therefore, remote laboratories can alleviate these problems by providing external access to experiments and allowing students to access experiments without time or location restrictions. Furthermore, these facilities can be packaged with supporting materials that provide the necessary guidance to students or are configured to constrain operation according to the experimenter’s require- ments. Remote experiments can be ready all the time, and thus the remote laboratory concept provides a tool to sustain a learner-centric teaching approach [3]. Moreover, several studies demonstrate the benefits of hands-on laboratories and learning-by-doing approaches [4], [2], [5]. Additionally, there are programmes leveraging the wide deployment of experi- mental platforms such as Fed4FIRE2 , Planetlab3 [6], Orbit4 and Forging Online Education through FIRE (FORGE)5 [3] for remote experimentation with communication networks. Testbed facilities, in order to fulfil the different users’ needs and to offer customized solutions to each user or type of experiment, can apply virtualization techniques. Virtual- ization of computational resources offers numerous benefits that have been recognized in several fields. These benefits are based on the abstraction that is fundamental to virtualization; 2http://www.fed4fire.eu 3http://www.planet-lab.org 4http://www.orbit-lab.org 5http://www.ict-forge.eu
  • 2. virtualization separates operating system components from hardware resources. The nature of this abstraction and the additional functionality enabled depends largely on the specific components used to compose the overall testbed. This paper presents our initiative on enhancing engineering education by providing an online course empowered by hands- on experimentation on top of our high-performance testbed that combines virtualized cloud-computing and advanced radio hardware. This effort provides an example of the successful integration of a virtualized wireless testbed into university instruction. II. RELATED WORK Online available labs, depending on their features, have been grouped into several categories. Depending on the meth- ods used to access and to trigger the equipment at the back- end facility and the technology used in the front-end graphical interface, from three to six different categories have been defined [7], [8], [1]. We can summarize those taxonomies into three categories: • Virtual labs, which are software-based laboratories, empowered by simulation tools. • Remote labs, based on remote experimentation on real lab equipment. • Hybrid labs, which combine the above two by pro- cessing output data from real measurements into sim- ulation tools. As mentioned before, experimentation is required to train students and enhance their skills in higher education pro- grams, in particular in engineering fields. There are several works that describe the approaches that different universities and/or projects have applied to enable engineering-related online laboratories. Most of the approaches rely on simulation, providing virtual labs for teaching robotics [9], electronic circuits [10], control systems [7] or a broad list of engineering disciplines [1]. Nevertheless, there are particular areas that require real experimentation, and where remote-based labs bring an added value, as is the case of the lab presented by Fidalgo et al. [11] for remotely designing and testing circuits in physical equipment. Regarding remote labs for teaching telecommunications related content, few approaches have been publicly proposed. Bose and Pawar [12] have proposed a remote lab for wireless signals where students can learn about the foundations of wire- less signal, with concepts such as antenna radiation pattern, gain-bandwidth product of an antenna, cross polar discrimina- tion and SNR. The architecture proposed presents a front-end webpage to access the back-end equipment. The website is deployed with Adobe Flash to offer the graphical interface. The back-end equipment relies on LabView to interface to the telecommunications equipment, including spectrum analyzers, oscilloscopes and signal generators. This lab can be accessed by one student at a time. Our approach falls into the remote lab category. We have enabled flexible radio equipment to be accessed through a cloud-based system, allowing students to perform remote ex- periments from different computing devices. III. VIRTUALIZED TESTBED FOR EDUCATIONAL USE In Trinity College Dublin (TCD) we have been successful in deploying a wireless communications and networks labo- ratory to support telecommunications engineering education. Our laboratory is equipped with advanced radio hardware that allows us to study, in a flexible manner, a wide range of wireless technologies. Figures 1 and 2 show the computa- tional resources and specialized radio frequency equipment, respectively, deployed in our laboratory. The wireless network laboratory allows us to train students on radio hardware -e.g., Universal Software Radio Peripheral (USRP)- that we employ to perform complex experiments in wireless communications, and spectrum analyzers that provide accurate measurements across the frequency spectrum. This combination of labora- tory resources has enabled a telecommunication ecosystem that supports hands-on experimentation not only for TCD’s students, but also students from around the globe, since the laboratory can be accessed both locally and remotely through the Internet. Fig. 1. Wireless laboratory servers General testbed facilities can be classified into develop- ment, research and instructional oriented [7]. Our testbed was initially deployed for research purposes. More recently, we have applied our expertise in testbed development to also support engineering education, testing and prototyping work by industry partners, and research efforts of several institutions throughout Europe. Targeting the educational initiative dis- cussed here, we have designed a wireless communications and networks course that is anchored in hands-on experimentation using our local testbed. Our hands-on lab course relies in two components: the testbed facilities (local and remote) and the educational material.
  • 3. Fig. 2. Wireless laboratory radio equipment A. Testbed architecture and resources We maintain a wireless testbed for the exploration of Software Defined Radio (SDR) systems, focusing on providing users the ability to customize the platform to their needs. In pursuit of providing this custom testbed experience, our facility is organized into experimentation units, supported by virtual computational platforms. Experimentation units are a logical organization of resources consisting of a computational element, a hardware radio front-end component, and the Iris software defined radio package [13]. Each experimentation unit represents the minimum set of resources required by a user to construct a radio element in TCD’s facility. Due to the capabilities of Iris, these experimental units effectively represent the potential to realize any arbitrary radio system that a user may require. This organization of TCD’s testbed facility allows users to deploy a customized radio system as needed. User customization is underpinned by the application of a cloud-computing based management system. This paradigm combines virtualized computational resources, loaded with a highly configurable (and reconfigurable) SDR package, and widely flexible radio hardware to support experimentation based research. Virtualization of computational elements pro- vides each user complete control over an isolated computa- tional environment. Since each user controls their own virtu- alized environment, users are free to completely individualize their computational platform, including configuration of global libraries or loading of additional software. Users may save their configurations, including all details of the computational system, for later use, at any point. The management system streamlines coordination of virtual computers, handling the deployment of these environments and their connection to radio hardware at the request of the user. The result of cloud-computing based management is that each user gets the experience of a personal testbed, yet the resources are shared among many separate users and projects. Figure 3 displays the architecture of TCD’s virtualized testbed. Each experimentation unit initially provides users with a virtual computer running a Linux-based operating system and loaded with the Iris SDR package. An array of servers, referred to as host servers, provide the computational power to run these experimentation units. Each virtual machine is connected to a USRP mounted on our ceiling grid within our dedicated testing space. These connections are made through dedicated network ports; i.e., each experimentation unit is provided with a dedicated network interface for connection to a USRP. The front-end server coordinates and controls virtual machines, handling the deployment of computational environments and their connection to USRPs. The front-end server also provides users access to experimentation units, currently through SSH. Centralized control also allows the front-end to handle the scheduling of user access. Fig. 4. Support architecture Figure 4 displays the support structure for the virtualization management system. A gateway machine provides a central point for remote testbed access, data access, and documenta- tion. This gateway machine also runs the FORGEBOX user interface, see Section III-B. The dedicated documentation server provides users with a wealth of information on how to use the testbed. The data server holds user data separately from virtual machines, providing a more permanent storage lo-
  • 4. Fig. 3. Testbed architecture cation and allowing the collection of information from several virtual machines. This support system allows users to take full advantage of the cloud-based management structure. B. FORGEBox framework To deploy this course and make it available to learners through web access, a framework called FORGEBox6 is used. This framework technology is provided by the FORGE EU Framework Programme 7 project, which aims to transform the Future Internet Research and Experimentation (FIRE)7 testbed facilities into a learning resource for higher education. FORGE provides an educational layer over the FIRE facilities, enabling experiment-based learning resources. FORGE specifies devel- opment methodologies and best practices for offering testbed experimentation facilities to learners. This section gives a brief overview of the FORGEBox framework technology, which is used to support interactive courses using resources of remote labs. FORGEBox is defined and implemented within the FORGE project. The framework defines an architecture, user roles, core entities and necessary components to support these courses. There are three defined core entities: • FORGEBox course module, which consists of course presentation parts and interactive parts. The presenta- tion parts contain text, images and video content. The interactive parts contain widgets that help the learner to interact with the underlying remote lab resources. 6http://www.forgebox.eu 7http://ict-fire.eu • FORGEBox widgets are small web-based standalone applications that expose the remote lab functionality and enable a learner to perform actions on remote resources. These can be embedded in web pages or eBooks. • FIRE adapter/FORGEBox services are backend ser- vices that either support widget functionality or sup- port a lab course assistant/designer to setup a remote lab for a course. The framework defines also the following main actors: • Learner: utilizes FORGEBox tools and services, uses different means to access the courses and manipulates remote lab resources through widgets. The means to access the courses include electronic books or Learning Management System (LMS) web pages. • Lab course designer: designs a course and imple- ments it by using learning material (e.g., text, figures, videos), widgets and FIRE adapters. • Lab course assistant: responsible for the normal execution of a course and has different responsibilities, such as creating accounts for lab learners, scheduling and reserving remote lab resources (if not carried out automatically when a Learner starts a course), delegating control, etc. • Widget provider: develops and maintains widgets (usually for web consumption) providing a user in- terface for learners to manipulate the experimentation environment.
  • 5. • FIRE adapter/service provider: develops and main- tains FIRE adapters, deployed into FORGEBox ser- vices. FORGEBox also defines a platform that hosts all the above necessary artefacts to enable an interactive course. It is an ag- gregation of services able to support all FORGE concepts and requirements, learning widgets, and FIRE adapters/services. FORGEBox is delivered as a middleware solution, deployed in institutions executing courses or into a cloud infrastructure, bridging the interfaces between learning means and FIRE tools and facilities. FORGEBox includes tools and services that target both learners and lab course designers. Learners can easily access FIRE facilities and perform small experiments through the web enabled interface of widgets. Lab course designers have a collection of tools to create the course content, and to prepare and configure the target FIRE testbed that supports the interactive course. Figure 5 presents a detailed view of the FORGEBox architectural framework. The figure displays also the concept of a FORGE repository that hosts any shared published items such as lab courses, widgets and FIRE adapters to be used by the learning community and by other organizations hosting a FORGEBox instantiation. At its simplest form the core consists of services that make some tasks easier such as creating, managing and operating lab courses and their content as well as widgets and adapters. FORGEBox will contain a set of managing services, a widgets layer, a FIRE adapters layer and a local repository of hosted lab courses. FORGEBox is implemented and provided under open source licenses. A run- ning instance can be found at http://www.forgebox.eu/fb. The global repository for FORGEBox artefacts sharing is called FORGEStore and its located at http://www.forgestore.eu. C. SSH One of the most used means to access machines residing in remote lab facilities is through terminal utilities. The most known protocol is Secure Shell (SSH), since it enables an experimenter to access a resource and fully manage it via the command line. SSH client tools exist for almost any operating system, either natively or via external downloaded tools. In FORGEBox we turned to web-based SSH tech- nology. Web-based SSH makes it possible to access SSH servers through web clients that are based on JavaScript/Ajax or JavaScript/WebSockets technologies. To enable web-based SSH clients a server side web application is needed, hosted in a server playing the role of an SSH proxy. Incoming requests are processed on the web application server. Keyboard events are forwarded to a secure shell client communicating with the connected SSH server. Terminal output is either passed to the client where it is converted into HTML via JavaScript or it is translated into HTML by the server before it is transmitted to the client. The SSH proxy web application can be hosted in FORGEBox as a service. Figure 6 presents the ssh2web widget as used inside a course. The widget is provided by a web application written in Java. Figure 7 displays the architecture of the widgets web application. It shows how the communication is accomplished from the ssh2web application towards a remote machine, via Fig. 6. SSH2web widget embedded in HTML private/public keys or even username/password pair. The text provided by the SSH communication is translated from a read/writer thread class into a web JSON object and is passed to the websocket class, and is sent to the web browser via a javascript web socket opened in the browser. The reverse process is applied when the user types a command. Each keystroke is passed as a JSON object to the websocket class, where it is transformed again and sent through the SSH session class to the remote machine. Finally, we can audit the session for security purposes, for future reference, or any other kind of measurements, by accessing the history of typed commands. Fig. 7. SSH2web widget architecture IV. EDUCATIONAL MATERIAL As mentioned previously, our testbed is deployed under the cloud-computing paradigm, having different computational and USRP radio resources under a single managed cloud, as shown in Figure 8. Such resources are then used to enable specific requests on the demand of the users of the cloud. We have deployed the tools that enable the whole infrastructure to create the ‘experimentation units’ for educational purposes. Moreover, Figure 9 illustrates the concept of deploying a real network from a ‘drag and drop’ widget, where the widget tells the front-end what resources are needed and enables such resources to be delivered to the cloud. All of this is enabled through the FORGEBox framework. Finally, the student can access those resources directly in a transparent way, having real resources for online experimentation. The created content can be easily adapted to Massive Online Open Courses (MOOCs) and interactive eBooks, where
  • 6. Fig. 5. FORGEBox framework architecture Fig. 8. Mapping the Widget-based experiment configuration into the testbed resources rich multimedia content is combined with interactive pages to set up and run large-scale experiments on top of our wireless testbed. We now briefly provide an overview of a module created in TCD, as well as the type of experimentation involved within this module: Title of the course Coexistence of Small Cells in Radar Bands Fig. 9. Mock up of the Experiment creator widget Summary of the course Radar spectrum is currently heavily underutilized due pri- marily to the need to avoid interfering with sensitive measuring equipment. Pursuit of such protection has resulted in the creation of large exclusion zones around radar stations that isolate them from potential interference. Due to the high degree of radar directionality and the availability of highly capable wireless systems, existing static exclusion zones represent an unnecessary inefficiency. TCD has constructed a Radio Coordinator Module using the Iris software defined radio package and the virtualized wireless testbed that allows radios to identify the features of a radar system and effectively operate within that radar’s exclusion zone without causing harmful interference. This coordinator module is a prototype for a small cell controller, designed to open radar spectrum for use in
  • 7. future cellular networks. With this course we demonstrate the capability of Cognitive Radios (CRs) or Secondary User (SU) systems to coexist with radar systems, the incumbents, even when the CR is located inside the radar exclusion zone defined by the range of its signal through its antenna main beam. In order to do so, CRs have to perform the following tasks: • Estimate the parameters of the radar systems in the radio environment, namely, their antenna radiation and scan pattern and rotation periodicity, through spectrum sensing. • From the perceived radar’s rotation periodicity and radiation and scan patterns, design a mechanism that predicts future instances of interference from the CR to the radar and vice-versa. To assess whether there might be interference, the received signal strength by the CR is compared with a pre-defined threshold. • Schedule transmissions in such a way it avoids inter- fering with the radar for the intervals of interference calculated in the second step. • Stay synchronized with the radar antenna rotation. Online material of the course The material for this course can be used and reused in different elearning platforms and devices, as mentioned before and shown in Figure 10. Moreover, the full HTML-based course is shown in Figure 11, where different multimedia components, such as widgets, sliders and images, are combined to offer an enhanced hands-on remote experimentation course. This course is being taught in the 5C2 - Wireless networks and communications module of the Electrical and Electronic Engineering (EEE) Master in Engineering (MAI) degree within TCD. Moreover, it will be soon publicly available through the aforementioned FORGEBox portal. Fig. 10. The course material shown in different devices V. DISCUSSION Within the elearning community, and in particular, the online labs community, several concerns are being considered and discussed regarding the educational and technological domains. 1) Education related: • Pedagogical principles. When deploying the content labs and designing the experimentation, several peda- gogical aspects should be taken into account, such as matching the curricula, inclusion, learner engagement, innovative approaches, and effective learning, among others. • Learning analytics. The labs deployed should aim to collect data and analyze the learning patterns of the students in order to improve the labs [14]. • Evaluation. The labs should have an evaluation module that enables the observation of the skills gained by the students due to experimentation. 2) Technology related: • Development methodology and tools. A methodol- ogy should be defined when deploying online labs. Common tools can be used to provide homogeneous feedback about the students’ performance, enabling cross-referenced information to enrich data for ana- lytic purposes. • Sustainability models. There is a concern among on- line lab providers and developers about the sustainabil- ity models that should be applied towards maintaining such labs and towards improving them [8]. VI. CONCLUSIONS We have presented our approach for enabling virtualized cloud-computing and advanced radio hardware for educational purposes. The use of our enhanced facilities for hands-on re- mote experimentation and the experience of lecturing the 5C2 module allow us to attest to the benefits of blended teaching, combining traditional lectures with hands-on experimentation using remote high-performance facilities, and its valuable impact on the students’ learning experience. Moreover, this approach enables Self-Regulated Learning (SRL), allowing the students to learn at their own pace. Nevertheless, our approach will continue being developed to tackle the issues discussed in the paper, to improve the learning experience of the students and to provide feedback to instructors. ACKNOWLEDGMENTS This work has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreements no. 610889 (FORGE) and 258301 (CREW). We also acknowledge support of the Fed4FIRE project (’Federation for FIRE’), an integrated project funded by the European Commission through the 7th ICT-Framework Pro- gramme (318389).
  • 8. REFERENCES [1] R. Bose, “Virtual Labs Project: A Paradigm Shift in Internet-Based Remote Experimentation,” IEEE Access, vol. 1, pp. 718–725, 2013. [Online]. Available: http://dx.doi.org/10.1109/access.2013.2286202 [2] G. Jourjon, S. Kanhere, and J. Yao, “Impact of an e-learning Platform on CSE Lectures,” in Proceedings of the 16th annual joint conference on innovation and technology in computer science education, 2011, pp. 83–87. [3] J. M. Marquez-Barja, G. Jourjon, M. Alexander, C. Tranoris, J. Domingue, and L. A. DaSilva, “FORGE: Enhancing elearning and research in ict through remote experimentation,” in IEEE Global Engineering Education Conference (EDUCON), April 2014, pp. 1157– 1163. [4] A. Sanchez, I. Moerman, S. Bouckaert, D. Willkomm, J. Hauer, N. Michailow, G. Fettweis, L. Dasilva, J. Tallon, and S. Pollin, “Testbed federation: An approach for experimentation-driven research in cognitive radios and cognitive networking,” in Future Network & Mobile Summit (FutureNetw), June 2011, pp. 1–9. [Online]. Available: http://ieeexplore.ieee.org/xpls/abs all.jsp?arnumber=6095242 [5] N. Handigol, B. Heller, V. Jeyakumar, B. Lantz, and N. McKeown, “Reproducible network experiments using container-based emulation,” in Proceedings of CoNEXT, 2012. [6] PlanetLab Consortium, “Planetlab: An open platform for develop- ing, deploying, and accessing planetary-scale services,” http://www. planet-lab.org/. [7] A. Diwakar, S. Poojary, R. Rokade, S. Noronha, and K. Moudgalya, “Control systems virtual labs: Pedagogical and technological perspectives,” in IEEE International Conference on Control Applications (CCA), Aug. 2013, pp. 483–488. [Online]. Available: http://dx.doi.org/10.1109/cca.2013.6662796 [8] S. Frerich, D. Kruse, M. Petermann, and A. Kilzer, “Virtual Labs and Remote Labs: Practical experience for everyone,” in IEEE Global Engineering Education Conference (EDUCON), Apr. 2014, pp. 312–314. [Online]. Available: http://dx.doi.org/10.1109/educon.2014. 6826109 [9] P. Abreu, M. Romano Barbosa, and A. Mendes Lopes, “Robotics virtual lab based on off-line robot programming software,” in 2nd Experimenta International Conference (exp.at’13), 2013, pp. 109–113. [Online]. Available: http://dx.doi.org/10.1109/expat.2013.6703040 [10] D. Bagchi, K. Kaushik, and B. Kapoor, “Virtual labs for electronics engineering using cloud computing,” in 2013 3rd Interdisciplinary Engineering Design Education Conference (IEDEC), Mar. 2013, pp. 39–40. [Online]. Available: http://dx.doi.org/10.1109/iedec.2013. 6526757 [11] A. V. Fidalgo, G. R. Alves, M. A. Marques, M. C. Viegas, M. C. Costa-Lobo, U. Henandez-Jayo, J. Garcia-Zubia, and I. Gustavsson, “Adapting Remote Labs to Learning Scenarios: Case Studies Using VISIR and RemotElectLab,” IEEE Revista Iberoamericana de Tecnologias del Aprendizaje, vol. 9, no. 1, pp. 33–39, Feb. 2014. [Online]. Available: http://dx.doi.org/10.1109/rita.2014.2302071 [12] R. Bose and P. Pawar, “Virtual Wireless Lab Concept, design and implementation,” in IEEE International Conference on Technology Enhanced Education (ICTEE), Jan. 2012, pp. 1–7. [Online]. Available: http://dx.doi.org/10.1109/ictee.2012.6208669 [13] P. D. Sutton, J. Lotze, H. Lahlou, S. A. Fahmy, K. E. Nolan, B. Ozgul, T. W. Rondeau, J. Noguera, and L. E. Doyle, “Iris: an architecture for cognitive radio networking testbeds,” IEEE communications magazine, vol. 48, no. 9, pp. 114–122, Sep. 2010. [Online]. Available: http://dx.doi.org/10.1109/mcom.2010.5560595 [14] L. Rosniak Tibola, “A proposal of engineering education architecture: Improve engineer’s competencies through practice labs and 3D virtual worlds,” in 2th IEEE International Conference on Industrial Informatics (INDIN), Jul. 2014, pp. 791–794. [Online]. Available: http://dx.doi.org/10.1109/indin.2014.6945615 Fig. 11. The HTML-based hands-on remote experimentation based course