This document summarizes two studies: Study 1 evaluated three mobile learning projects in UK higher education at the project level and stage 2 by evaluating the IT intervention within courses. Actor Network Theory and case study analysis were used. Study 2 evaluated a video conferencing network using Apple Macintosh computers at the University of Derby at stage 2 by evaluating the IT intervention in isolation. Surveys, laboratory sessions, office worker trials, and performance analysis under varying parameters were conducted. Both studies provide insights into evaluating educational technology interventions.

1. Levels and stages of Evaluation (Study evaluation)
Study1:
Title: Methodological Issues in a study of Mobile Learning as a Disruptive Innovation
(Actor Network Theory and Case Study Unit Analysis in a qualitative study of
three mobile learning projects in UK Higher Education)
Researcher: Peter Bird. Manchester Metropolitan University, Business School
This study in Level 1: Project level
“In this paper, I present two possible methodological dilemmas with a study of mobile learning
as a disruptive innovation in UK Higher Education.”
This study in stage 2: the evaluation of the IT intervention within the course itself.
“The second issue concerns the choice of unit of analysis in Case Study Methodology, a problem
brought about by having a multi-institution project as one of the three chosen cases.”
“The project is not investigating the impact on pedagogy that m-learning may bring, although the
benefits of mobile technology to teachers and learners will have a major influence on the
sustainability of the innovation.”
The techniques:
“In addition I am planning to use Actor Network Theory (ANT) as a „lens‟ to interpret the results
and identify strategies for embedding mobile learning that were more successful than others.”
In selecting cases for my field research, I started with referencing my research question. The
research question should dictate the type of organization to approach (i.e. universities) and the
type of data to be gathered. Furthermore it may help define the number of organizations and
perhaps indicate timescales.
Reference: (2009) Manchester: UK http://www.edamba.eu/userfiles/file/Bird%20Peter.pdf

2. Study2:
Title: A study into Video Conferencing Using the Apple Macintosh Platform
Researcher: Sean Clark, Giles Mahoney, Stephen Scrivener.
This study in Level 1: Project level
“This study into the uses of video conferencing on the Apple Macintosh took place between June
1994 and January 1995 at the University of Derby and involved members of the Design Research
Centre in the School of Art and Design at Derby, the University's Research Office and the
Computer Services department.”
This study in stage 2: the evaluation of the IT intervention in isolation.
“In conclusion, we found this project interesting and enlightening. At the Design Research
Centre, we are now firm advocates of the benefits of video conferencing as a tool to support day-
to-day work as well as our less frequent international collaborative projects.”
The techniques:
“Firstly, we constructed a video conferencing network at the University of Derby using
Macintosh multimedia computers and a software package called CUSeeMe. Secondly, we
conducted a survey of a group of video conferencing users with the aim of discovering
how video conferencing systems such as CUSeeMe are currently being used.
Thirdly, we ran a series of 'artificial' (in the laboratory) video conferencing sessions D in
which users were asked to use our video conferencing network to work on a number of
pre-defined tasks.
Next, we allowed a group of office workers to use our video conferencing network to
support their work activities for a period of approximately.
And finally, we analyzed the performance of the CUSeeMe package whilst varying a
number of its functional parameters in order to ascertain it's most efficient operating
conditions. Each of these activities is fully reported in this document.”
Reference: Derby: Sima, http://www.agocg.ac.uk/reports/mmedia/apple/apple1.pdf
Dalal AL-Dhafari - 83486