SlideShare a Scribd company logo
1 of 10
Download to read offline
University of Wollongong
Research Online
Academic Services Division - Papers Academic Services Division
1998
Applied Epidemiology - A full-subject self-directed
computer-based problem-solving learning
experience
Irene A. Kreis
University of Wollongong
Adam Orvad
University of Wollongong
Dhammika Ruberu
University of Wollongong
Ray Stace
University of Wollongong, rstace@uow.edu.au
Research Online is the open access institutional repository for the
University of Wollongong. For further information contact Manager
Repository Services: morgan@uow.edu.au.
Publication Details
This conference paper was originally published as Kreis, IA, Orvad, A, Ruberu, D and Stace, R, Applied Epidemiology, A Full-subject
Self-Directed Computer-Based Problem-Solving Learning Experience, in Corderoy, RM (ed), Proceedings of the 15th Annual
Ascilite Conference: Flexibility The next wave?, University of Wollongong, Australia, 1998, 433-439.
Applied Epidemiology - A full-subject self-directed computer-based
problem-solving learning experience
Abstract
A major difficulty of teaching public health to students in a Masters Program is conveying the need for taking
a strategic approach to situations. Tackling real-life public health issues is rather complex. There will generally
be a number of avenues of investigation and it is necessary to be wary of the short and long-term
consequences of actions. Also time and money need to be managed effectively. As one approach to the
education of students about these issues, a computer-based package has been developed which simulates the
investigation of a real public health problem. This simulation enables students to encounter such issues in a
risk-free environment, and to carry out their own investigations and propose their own solutions to the
problems presented. Specifically, students have to clarify the impact of pollution on the health of residents in
an affected area. They will collect and analyse data (from in-built real-life data sets), design and analyse their
own epidemiological study and present their findings as reports, press-releases and presentations. The task
takes students an entire subject (14-weeks) to complete and is largely self-directed. The package contains
both quantitative data, such as mortality and morbidity statistics, and qualitative data, such as the outcome of
interviews with key stakeholders. The package also exploits the multimedia capabilities of a PC by
incorporating maps and photographs of the polluted area. This enables students to undertake a virtual trip,
and thus pick up vital clues about potential sources of contamination. The package provides links to standard
statistical software, thereby giving students an opportunity to become more familiar with programs they are
likely to use in real-life. The data provide sufficient breadth and detail for students to use various strategies.
But, to simulate real-life, students have to conduct their investigations within virtual time and budgetary
constraints, continuously monitored by the computer program. In particular, monitoring of constraints, the
real-life data and the linked use of standard software allow for the realistic development of essential skills. In
the subject setting, role-play during the presentations, and reporting in real-life formats, add to the simulation.
Practical exercises have not been part of most Public Health Masters programs world wide, and yet the
complexity of real-life situations means that such experience is invaluable. When fully complete, this package
will offer a novel, innovative and important approach to the teaching of this aspect of public health.
Keywords
epidemiology, education, case-study, team-work, communication, environment
Publication Details
This conference paper was originally published as Kreis, IA, Orvad, A, Ruberu, D and Stace, R, Applied
Epidemiology, A Full-subject Self-Directed Computer-Based Problem-Solving Learning Experience, in
Corderoy, RM (ed), Proceedings of the 15th Annual Ascilite Conference: Flexibility The next wave?,
University of Wollongong, Australia, 1998, 433-439.
This conference paper is available at Research Online: http://ro.uow.edu.au/asdpapers/47
ASCILITE ā€™98 433
Applied Epidemiology, a Full-subject Self-directed Computer-based Problem-solving . . .
APPLIED EPIDEMIOLOGY,
A FULL-SUBJECT SELF-DIRECTED COMPUTER-BASED
PROBLEM-SOLVING LEARNING EXPERIENCE
1
Irene A. Kreis, 2
Adam Orvad, 3
Dhammika Ruberu,
and 4
Ray Stace
1
Department of Public Health and Nutrition, University of Wollongong, Australia
email: Irene-Kreis@uow.edu.au
2, 3 and 4
Centre for Educational Development and Interactive Resources,
University of Wollongong, Australia
email: adam_orvad@uow.edu.au
email: dhammika_ruberu@uow.edu.au
email: ray_stace@uow.edu.au
ABSTRACT
A major difficulty of teaching public health to students in a Masters Program is conveying the need for
taking a strategic approach to situations. Tackling real-life public health issues is rather complex.
There will generally be a number of avenues of investigation and it is necessary to be wary of the short
and long-term consequences of actions. Also time and money need to be managed effectively.
As one approach to the education of students about these issues, a computer-based package has been
developed which simulates the investigation of a real public health problem. This simulation enables
students to encounter such issues in a risk-free environment, and to carry out their own investigations
and propose their own solutions to the problems presented.
Specifically, students have to clarify the impact of pollution on the health of residents in an affected
area. They will collect and analyse data (from in-built real-life data sets), design and analyse their own
epidemiological study and present their findings as reports, press-releases and presentations. The task
takes students an entire subject (14-weeks) to complete and is largely self-directed.
The package contains both quantitative data, such as mortality and morbidity statistics, and qualitative
data, such as the outcome of interviews with key stakeholders. The package also exploits the multimedia
capabilities of a PC by incorporating maps and photographs of the polluted area. This enables students
to undertake a virtual trip, and thus pick up vital clues about potential sources of contamination. The
package provides links to standard statistical software, thereby giving students an opportunity to become
more familiar with programs they are likely to use in real-life.
The data provide sufficient breadth and detail for students to use various strategies. But, to simulate
real-life, students have to conduct their investigations within virtual time and budgetary constraints,
continuously monitored by the computer program. In particular, monitoring of constraints, the real-life
data and the linked use of standard software allow for the realistic development of essential skills. In
the subject setting, role-play during the presentations, and reporting in real-life formats, add to the
simulation.
Practical exercises have not been part of most Public Health Masters programs world wide, and yet the
complexity of real-life situations means that such experience is invaluable. When fully complete, this
package will offer a novel, innovative and important approach to the teaching of this aspect of public
health.
434
Kreis, Orvad, Ruberu and Stace
KEY WORDS
Epidemiology, education, case-study, team-work, communication, environment.
1. INTRODUCTION
While public health students can be taught epidemiological methods, communication and project
management skills using standard teaching methods, it is difficult to give them a feel for the
richness of undertaking a real epidemiological study. The need for some experience in dealing
with a total study is enforced by the observation that public health practitioners often have to
deal with complicated situations such as cancer clusters, contaminated drinking water, hepatitis
epidemics or unplanned emissions from factories. In these situations, they have to assess the
situation quickly and systematically, gather and evaluate the available information, and present
their opinion about health risks. Public health postgraduate students are taught the concepts
needed to deal with these issues in subjects such as epidemiology, bio-statistics and research
methods. The breadth of knowledge that needs to be covered and the complexity of the causes
of diseases rarely allows for an active involvement of students. Only such an involvement
would allow the students to experience the concepts and methods and internalise the thought
process involved. There are some pen and paper exercises available that do attempt to cover
this gap but they fall far short of the complexity and magnitude public health problems actually
can reach (WHO materials).
It was thought that a real-life public health problem, that was extensively investigated, could
be turned into a useful teaching tool (Kreis PhD). A simulation of the situation the students are
likely to encounter when employed including the likely constraints on time and money would
potentially give the students a feel of what it will be like. This paper describes the tool developed
for this purpose. It also describes the teaching advantages that are possible when using such a
tool as well as some of the potential shortcomings.
2. AIMS
The aims of the subject for which the teaching tool has been and is continuing to be developed
are that at the end of the subject (whole class of 14 weeks and a total of 1/12th
of a Masters
degree) the student will be able to:
ā€¢ actively engage in small team problem solving;
ā€¢ strategically plan their actions and manage time and financial constraints;
ā€¢ utilise available data-sets on health, environmental contamination levels and exposure;
ā€¢ use and apply knowledge on statistical computer software and word processing;
ā€¢ analyse the collected data and integrate the results with literature information into a
view as to whether there is a health risk to a population; and
ā€¢ present and defend conclusions to a critical audience and in a written format according
to established professional standards.
3. MATERIALS AND STRUCTURE
The problem is derived from a case study of cadmium contaminated soil in The Netherlands.
The contamination resulted from long term air emissions and the deposition of waste materials
by a number of metallurgic factories. The investigation of the possible health effects covered
all stages that can be recognised in such investigations. Expert opinion, routine data-sets, ad-
hoc data-sets and data from a large scale study were available or possible to simulate. Information
on both health status and environment relevant to the case study were extensively available (if
predominantly in government reports and often in Dutch). Copyright issues are limited as the
data were collected with public money and the case itself dates back to the early 1980ā€™s.
ASCILITE ā€™98 435
Applied Epidemiology, a Full-subject Self-directed Computer-based Problem-solving . . .
The case-study had been worked into a simple computer-based teaching tool in the Netherlands
itself by the University of Nijmegen. This material was designed to function on the most basic
PC (XTā€™s) and only used text and some numerical information. There was some limitation of
choice in the use of data-sets and students had to work within the constraints of a financial
budget. The structure and some of the materials of this Dutch version were used after translation.
The new CD-ROM based program uses specific multi-media authoring (developed in
MacroMedia Authorware) and allows for greater consistency in the application of the time or
financial restraints. It is also different in that it aims to incorporate standard software that is
often used in public health practice such as Epi-Info. The teaching tool can be used on Windows
3.1 or Windows 95 operating systems with only limited need to install other software. The
minimum requirement for the computers is that they need to have a CD-ROM as well as a
floppy drive. The floppy is needed because the progress of the student is monitored on a
personal floppy so that students can change between computers, and so that students can save
ā€˜notebookā€™ information which they can later incorporate into their reports. (Figure 1)
Figure 1: Notebook with reference text
The case-study is structured in four stages and some additional information is available at all
times (tutorials and maps). The stages represent a pre-structured approach to public health
problems that is widely accepted as reasonable. The tutorials cover materials that one could
assume the student would know but that might do with some repetition (presentation techniques
and the use of Epi-Info), or provide information that might be too hard to collect otherwise
(dietary intake). Also some additional information on the organisation of public health around
the world and dietary intake around the world is available. This enables the student to assess
the equivalent situation in their own country.
The first stage of the actual case-study covers an orientation to the problem including qualitative
as well as some quantitative material. The material covers interviews with experts such as
University professors (Figure 2), and stakeholders such as politicians, factory owner and
residents. Other qualitative data result from simulated literature searches, a tour of the regions
with visual clues (Figure 3) and the inspection of maps. Quantitative data include some limited
environmental sampling and some limited routine data sets. During this stage, the budget is
time related and the students are limited to an equivalent of 3 working weeks. The students
will have to plan their actions as some information takes time to arrive after requesting it.
Another aspect in this stage is that the students can make some clearly wrong choices and they
will get fired from their jobs if they do. The students will then have to start all over. The
multimedia version of this stage has been in use for the past two years (at the time of writing).
Figure 2: Some of the interview subjects
436
Kreis, Orvad, Ruberu and Stace
Figure 3: Part of the guided tour
The second stage of the case-study requires the students to divide their attention between the
environmental component of the case and the health effects component. They are asked to buy
information (Figure 4), but stay within a budget, and they are required to analyse the information.
They also need to make a choice between some analytic tools eg. various forms of standardisation
of the data. To simulate the real-life situation the data-sets need to be ordered separately but
need to be complete when analysing them. This again stimulates strategic planning by the
students. In analysing the health data, some money can be saved by the ingenious combination
of data-sets and being focussed on realistic questions to ask of the data. The multimedia version
of this stage has been in use for the past year (at the time of writing).
Figure 4: Ordering demographic data for East Kempen
The third stage requires the students to design an analytic epidemiological study of health
effects from the environmental contamination. The type of questions the study can address can
vary widely. The students are first and foremost restricted by financial constraints. They will
have to take account of the financial cost of each measurement and also the logistics of the
study they propose. Ultimately they are also restricted by limitations of the database supporting
this and the next stage. However, the currently available database is very extensive and so this
is not a major issue. In addition, it may be possible later to extend the options by including
databases from similar research projects. Once the students have decided how they are going
to collect their information, a database will be created according to their specifications.
In stage four the students are required to analyse the database created at the end of stage three.
The subject assumes that the analysis will take place in the public domain software of Epi-
Info. However, the data can also be exported to software the local teaching facility prefers eg
SAS or SPSS. At this stage, the students will be limited in time only.
ASCILITE ā€™98 437
Applied Epidemiology, a Full-subject Self-directed Computer-based Problem-solving . . .
In teaching the subject, the students are organised into teams of two to three people. At the end
of each stage, the students present the results in standard professional formats such as reports,
press releases and a proposal. To simulate presenting their results to the public, the students
are asked to present their findings orally as well. The other students are asked to play the roles
of stake-holders in the community which thus creates the atmosphere of a public meeting.
4. STATUS AND PLANS
The subject has so far been run employing the multimedia materials over the past two years.
Modifications were made after the first year based on the experiences of the teacher and the
students, and the updated version was used the second time. The current model was used with
a class of 6 students. The evaluation of this teaching process is reflected in a remark form a
student: ā€œI never worked so hard and I never learned so muchā€. Stage one is complete except
for the simulation of the literature searches that would be expected at this time. Stage two has
had a limited number of databases for health available but these are the most relevant ones.
The environmental component of this stage is complete except for the translation of one rather
hefty report on environmental investigations. The interfaces for the information in this stage
have all been redesigned from the earlier version and are considerably improved. They require
a lot of attention to detail by the student but that has been a conscious decision in the design
process. Stages three and four are not yet included in the multimedia program and have been
run using the material in a non-computerised form. Stage three has been simulated with proposal
writing without linking it to the actual data to be analysed. Stage four has been simulated by
giving the students access to the original database but with a limited number of variables.
Most of the essential tutorial material is now available, which was not the case during the
teaching of the subject in 1998.
The plan is to extend the number of databases available in stage two as they are readily available
in the original case-study. It is also intended to implement stages three and four. Some extension
of the materials available in the tutorials is also being prepared. From a teaching perspective it
is envisaged that further trials with the fully completed multimedia program need to be run
under various conditions. One of the possible options is a trial of a workshop format where the
students go through the whole program in a much more condensed time frame. Another aspect
of the evaluation will be the assessment of its effectiveness to a teacher who is less familiar
with the original case study.
5. DISCUSSION
A number of aspects about this teaching tool can be addressed. It can be questioned why one
would use a case study in a country like the Netherlands and why one would not translate the
situation to an imaginary place where the names and such would be more easy pronounced. If
one were to do that, a host of information about the local situation would have to be invented.
Visual clues would be much harder to incorporate and the total case study would become
much less interesting in the view of these authors. Also, within the public health profession, it
is entirely usual to use information from other countries. Using the Netherlands thus becomes
an additional bonus rather than a handicap. The addition of information about other countries
inthetutorialallowsteachersandstudentsusingthetool,toaddressthecomparabilityofthesituation.
Another question one can ask is whether cadmium contamination is sufficiently important to
spend this much time on during the limited time of a Masters program. However, the aim of
the subject is not to teach students all the aspects of cadmium contamination, although cadmium
contamination is enough of a problem worldwide to deserve some attention, and cadmium is
one of the heavy metal pollutants such as lead which all share environmental similarities.
Instead the aim is to confront students with the structured approach to complex problems
which extend beyond the case-study. This is possible because the case study is similar enough in
structure to other public health problems such as the earlier mentioned cancer clusters or water
contaminationincidents,thatitcanfunctionasateachingmodelwherethecontentislessimportant.
438
Kreis, Orvad, Ruberu and Stace
It could be argued that in presenting the case-study in the four prescribed stages we have pre-
structured the approach such that the student can no longer make major mistakes in structuring
the handling of the problem. It is clear that some structuring has taken place and that the
amount of information is presented in a lot more systematic manner than it would in real life.
However, to allow the student to understand the model of investigation, the possibility of
getting fired in the first stage has been consciously incorporated. It does emphasise to the
student that something that turns out to be perfectly OK much later in the investigation can be
entirely out of order in the earlier stages. The clarification of this observation is clearly the task
of the teacher in charge of the subject.
In the subject as we have conducted it at this University, we have insisted on the students working
in teams of two, occasionally three as the class size requires. In the earlier classes as taught at the
University of Nijmegen they had made the same choice. The first reason for doing this is that the
amount of work involved is rather substantial.Another reason is that the University has stated, in its
aims for the attitudes of its graduates, that they should be able to work in teams. The third but most
important reason is that most, if not all public health practice, is conducted in teams. Developing
skills in collaboration and in delegating are essential for a public health practitioner.
The presentation formats required of the students have been chosen to be as similar as possible
to those often used in public health practice. A teacher using the tool could decide to change
the requirements placed on the students. However, it was found that using reports and press
releases rather than an essay format uncovered a lack of recognition by the students of the
differences between the various formats. Using the professional formats also enhanced the
feeling of being part of a real investigation and increased the commitment of the students to
the subject.Assigning students specific roles during the presentations stimulated the discussion.
It also provided additional clues to the students for the context of the case-study.
It can be questioned whether one really needs a computer-based package to do the teaching as
conducted in the subject. It would be possible to give the students some of the information in
more traditional paper formats including the visual clues. However, monitoring their progress
and restricting some options would become incredibly labour intensive to the lecturer. Also,
some aspects of the practice of public health inherently involves computer databases in most
countries in the world.
It is possible that once developed, the teaching tool becomes stale as a number of students
have gone through the process. Either the students collective memory will get to know all the
ins and outs of the case study or the teacher could get bored with the amount of marking that is
inherent in the exercise. The boredom of the teacher can be prevented by having different staff
teaching the subject once all the material has been developed. As the subject is likely to be one
of the last subjects undertaken by the students they are less likely to be in frequent contact with
students yet to undertake the subject. However, the possibility of the tool aging will have to be
evaluated over time. The experience at the University of Nijmegen which has been using the
earlier version for about 8 years, seems to indicate that if one keeps the teachers fresh, the
students keep enjoying the case study.
6. CONCLUSION
The development of a problem-solving computer-based teaching tool seems to indicate that it
is possible to simulate a complex public health problem in a student friendly way. It is also
clear that the development of such a tool requires extensive resources in the availability of
data, time and know-how.
7. ACKNOWLEDGMENT
This development of this teaching tool was made possible with financial support from the
University and with a CUTSD grant and the support from very many people.
ASCILITE ā€™98 439
Applied Epidemiology, a Full-subject Self-directed Computer-based Problem-solving . . .
8. REFERENCES
World Health Organisation. Problem-based training exercises for environmental epidemiology, group
based exercises for students. Geneva, March 1992
Kreis I.A. Health Effects of cadmium Contamination in Kempenland. Ph.D. Leiden University. The
Hague September 1992
Dean A.G., Dean J.A., Coulombier, D. et al. Epi Info, Version 6: a word processing, database, and
statistics program for epidemiology on microcomputers. Centers for Disease Control and Prevention.
Atlanta Georgia, USA 1994
Ā© Irene A. Kreis, Adam Orvad, Dhammika Ruberu, and Ray Stace
The author(s) assign toASCILITE and educational and non-profit institutions a non-exclusive licence
to use this document for personal use and in courses of instruction provided that the article is used in
full and this copyright statement is reproduced.
The author(s) also grant a non-exclusive licence to ASCILITE to publish this document in full on the
World Wide Web (prime sites and mirrors) and in printed form within theASCILITE98 Conference
Proceedings. Any other usage is prohibited without the express permission of the author(s).
440
Kreis, Orvad, Ruberu and Stace

More Related Content

Similar to Applied Epidemiology - A Full-Subject Self-Directed Computer-Based Problem-Solving Learning Experience

Beyond the first steps: Sustaining Health OER Initiatives in Ghana
Beyond the first steps: Sustaining Health OER Initiatives in GhanaBeyond the first steps: Sustaining Health OER Initiatives in Ghana
Beyond the first steps: Sustaining Health OER Initiatives in GhanaPiLNAfrica
Ā 
chapter 9 interprofessional practice, education, and research1. .docx
chapter 9 interprofessional practice, education, and research1. .docxchapter 9 interprofessional practice, education, and research1. .docx
chapter 9 interprofessional practice, education, and research1. .docxchristinemaritza
Ā 
Improving Education, Training and Communication with the Public on Ionizing R...
Improving Education, Training and Communication with the Public on Ionizing R...Improving Education, Training and Communication with the Public on Ionizing R...
Improving Education, Training and Communication with the Public on Ionizing R...eaglecommunicates
Ā 
OLT Feb 2013 final 30_1_13
OLT Feb 2013 final 30_1_13OLT Feb 2013 final 30_1_13
OLT Feb 2013 final 30_1_13Juanita Fernando
Ā 
MSc Thesis - Candidate No. 481129
MSc Thesis - Candidate No. 481129MSc Thesis - Candidate No. 481129
MSc Thesis - Candidate No. 481129Laird Barrett
Ā 
Humanitarian_IM_Research_July2015
Humanitarian_IM_Research_July2015Humanitarian_IM_Research_July2015
Humanitarian_IM_Research_July2015Katie Whipkey
Ā 
SELF LEARNING VERSUS TRADITIONAL LEARNING FOR NURSING STUDENTS REGARDING SAFE...
SELF LEARNING VERSUS TRADITIONAL LEARNING FOR NURSING STUDENTS REGARDING SAFE...SELF LEARNING VERSUS TRADITIONAL LEARNING FOR NURSING STUDENTS REGARDING SAFE...
SELF LEARNING VERSUS TRADITIONAL LEARNING FOR NURSING STUDENTS REGARDING SAFE...indexPub
Ā 
PhD Thesis Defence: From Participation Factors to Co-Calibration of Patient- ...
PhD Thesis Defence: From Participation Factors to Co-Calibration of Patient- ...PhD Thesis Defence: From Participation Factors to Co-Calibration of Patient- ...
PhD Thesis Defence: From Participation Factors to Co-Calibration of Patient- ...Vlad Manea
Ā 
Teaching Pathology To Medical Students 10 25 09
Teaching Pathology To Medical Students 10 25 09Teaching Pathology To Medical Students 10 25 09
Teaching Pathology To Medical Students 10 25 09vshidham
Ā 
MAUREEN AKINYI CV
MAUREEN AKINYI CVMAUREEN AKINYI CV
MAUREEN AKINYI CVMaureen nyaura
Ā 
Tech v Trust: scaling simulation for the 21C student
Tech v Trust: scaling simulation for the 21C studentTech v Trust: scaling simulation for the 21C student
Tech v Trust: scaling simulation for the 21C studentdebbieholley1
Ā 
_Spring_2014_Newsletter_final
_Spring_2014_Newsletter_final_Spring_2014_Newsletter_final
_Spring_2014_Newsletter_finalKevin Hawes
Ā 
The impact of Science Literacy delivery methods - what works?
The impact of Science Literacy delivery methods - what works?The impact of Science Literacy delivery methods - what works?
The impact of Science Literacy delivery methods - what works?NIDA-Net
Ā 
1. In psychological research, investigators sample individuals be.docx
1. In psychological research, investigators sample individuals be.docx1. In psychological research, investigators sample individuals be.docx
1. In psychological research, investigators sample individuals be.docxjeremylockett77
Ā 
68 1 science_fair_guideline_2014-15_english
68 1 science_fair_guideline_2014-15_english 68 1 science_fair_guideline_2014-15_english
68 1 science_fair_guideline_2014-15_english RoyB
Ā 
Exploring Emerging Opportunities - Future Roles, Technology and Scholarship i...
Exploring Emerging Opportunities - Future Roles, Technology and Scholarship i...Exploring Emerging Opportunities - Future Roles, Technology and Scholarship i...
Exploring Emerging Opportunities - Future Roles, Technology and Scholarship i...Poh-Sun Goh
Ā 
Establishing Requirements for a Mobile Learning System H
Establishing Requirements for a Mobile Learning System HEstablishing Requirements for a Mobile Learning System H
Establishing Requirements for a Mobile Learning System HBetseyCalderon89
Ā 

Similar to Applied Epidemiology - A Full-Subject Self-Directed Computer-Based Problem-Solving Learning Experience (20)

Beyond the first steps: Sustaining Health OER Initiatives in Ghana
Beyond the first steps: Sustaining Health OER Initiatives in GhanaBeyond the first steps: Sustaining Health OER Initiatives in Ghana
Beyond the first steps: Sustaining Health OER Initiatives in Ghana
Ā 
chapter 9 interprofessional practice, education, and research1. .docx
chapter 9 interprofessional practice, education, and research1. .docxchapter 9 interprofessional practice, education, and research1. .docx
chapter 9 interprofessional practice, education, and research1. .docx
Ā 
Improving Education, Training and Communication with the Public on Ionizing R...
Improving Education, Training and Communication with the Public on Ionizing R...Improving Education, Training and Communication with the Public on Ionizing R...
Improving Education, Training and Communication with the Public on Ionizing R...
Ā 
OLT Feb 2013 final 30_1_13
OLT Feb 2013 final 30_1_13OLT Feb 2013 final 30_1_13
OLT Feb 2013 final 30_1_13
Ā 
Science popularisation
Science popularisationScience popularisation
Science popularisation
Ā 
MSc Thesis - Candidate No. 481129
MSc Thesis - Candidate No. 481129MSc Thesis - Candidate No. 481129
MSc Thesis - Candidate No. 481129
Ā 
Humanitarian_IM_Research_July2015
Humanitarian_IM_Research_July2015Humanitarian_IM_Research_July2015
Humanitarian_IM_Research_July2015
Ā 
SELF LEARNING VERSUS TRADITIONAL LEARNING FOR NURSING STUDENTS REGARDING SAFE...
SELF LEARNING VERSUS TRADITIONAL LEARNING FOR NURSING STUDENTS REGARDING SAFE...SELF LEARNING VERSUS TRADITIONAL LEARNING FOR NURSING STUDENTS REGARDING SAFE...
SELF LEARNING VERSUS TRADITIONAL LEARNING FOR NURSING STUDENTS REGARDING SAFE...
Ā 
PhD Thesis Defence: From Participation Factors to Co-Calibration of Patient- ...
PhD Thesis Defence: From Participation Factors to Co-Calibration of Patient- ...PhD Thesis Defence: From Participation Factors to Co-Calibration of Patient- ...
PhD Thesis Defence: From Participation Factors to Co-Calibration of Patient- ...
Ā 
Teaching Pathology To Medical Students 10 25 09
Teaching Pathology To Medical Students 10 25 09Teaching Pathology To Medical Students 10 25 09
Teaching Pathology To Medical Students 10 25 09
Ā 
MAUREEN AKINYI CV
MAUREEN AKINYI CVMAUREEN AKINYI CV
MAUREEN AKINYI CV
Ā 
Tech v Trust: scaling simulation for the 21C student
Tech v Trust: scaling simulation for the 21C studentTech v Trust: scaling simulation for the 21C student
Tech v Trust: scaling simulation for the 21C student
Ā 
Wharrad2012
Wharrad2012Wharrad2012
Wharrad2012
Ā 
_Spring_2014_Newsletter_final
_Spring_2014_Newsletter_final_Spring_2014_Newsletter_final
_Spring_2014_Newsletter_final
Ā 
The MICRODIS Project
The MICRODIS ProjectThe MICRODIS Project
The MICRODIS Project
Ā 
The impact of Science Literacy delivery methods - what works?
The impact of Science Literacy delivery methods - what works?The impact of Science Literacy delivery methods - what works?
The impact of Science Literacy delivery methods - what works?
Ā 
1. In psychological research, investigators sample individuals be.docx
1. In psychological research, investigators sample individuals be.docx1. In psychological research, investigators sample individuals be.docx
1. In psychological research, investigators sample individuals be.docx
Ā 
68 1 science_fair_guideline_2014-15_english
68 1 science_fair_guideline_2014-15_english 68 1 science_fair_guideline_2014-15_english
68 1 science_fair_guideline_2014-15_english
Ā 
Exploring Emerging Opportunities - Future Roles, Technology and Scholarship i...
Exploring Emerging Opportunities - Future Roles, Technology and Scholarship i...Exploring Emerging Opportunities - Future Roles, Technology and Scholarship i...
Exploring Emerging Opportunities - Future Roles, Technology and Scholarship i...
Ā 
Establishing Requirements for a Mobile Learning System H
Establishing Requirements for a Mobile Learning System HEstablishing Requirements for a Mobile Learning System H
Establishing Requirements for a Mobile Learning System H
Ā 

More from Scott Faria

002 Essay Example Refle. Online assignment writing service.
002 Essay Example Refle. Online assignment writing service.002 Essay Example Refle. Online assignment writing service.
002 Essay Example Refle. Online assignment writing service.Scott Faria
Ā 
How To Write A Proper Observation Essay - Adair
How To Write A Proper Observation Essay - AdairHow To Write A Proper Observation Essay - Adair
How To Write A Proper Observation Essay - AdairScott Faria
Ā 
Get Community College Essay Examples Tips - Es. Online assignment writing ser...
Get Community College Essay Examples Tips - Es. Online assignment writing ser...Get Community College Essay Examples Tips - Es. Online assignment writing ser...
Get Community College Essay Examples Tips - Es. Online assignment writing ser...Scott Faria
Ā 
Ocean Writing Paper Writing Paper, Kindergarte
Ocean Writing Paper Writing Paper, KindergarteOcean Writing Paper Writing Paper, Kindergarte
Ocean Writing Paper Writing Paper, KindergarteScott Faria
Ā 
CompareContrast Essay Outline Essay Outline The
CompareContrast Essay Outline Essay Outline TheCompareContrast Essay Outline Essay Outline The
CompareContrast Essay Outline Essay Outline TheScott Faria
Ā 
Good Essay Guide Essay Writing Skills, Writing Lesso
Good Essay Guide Essay Writing Skills, Writing LessoGood Essay Guide Essay Writing Skills, Writing Lesso
Good Essay Guide Essay Writing Skills, Writing LessoScott Faria
Ā 
Literature Review Chicago Style Sample Welcome T
Literature Review Chicago Style Sample Welcome TLiterature Review Chicago Style Sample Welcome T
Literature Review Chicago Style Sample Welcome TScott Faria
Ā 
100Th Day Writing Paper With Border And 3-Ruled Lines -
100Th Day Writing Paper With Border And 3-Ruled Lines -100Th Day Writing Paper With Border And 3-Ruled Lines -
100Th Day Writing Paper With Border And 3-Ruled Lines -Scott Faria
Ā 
014 Essay Example Descriptive Person Writing
014 Essay Example Descriptive Person Writing014 Essay Example Descriptive Person Writing
014 Essay Example Descriptive Person WritingScott Faria
Ā 
6 Essay Writing Tips For Scoring Good Grades
6 Essay Writing Tips For Scoring Good Grades6 Essay Writing Tips For Scoring Good Grades
6 Essay Writing Tips For Scoring Good GradesScott Faria
Ā 
Scholarship Essay Graduate Program Essay Examples
Scholarship Essay Graduate Program Essay ExamplesScholarship Essay Graduate Program Essay Examples
Scholarship Essay Graduate Program Essay ExamplesScott Faria
Ā 
Writing A Strong Introduction To A Descriptive Essay
Writing A Strong Introduction To A Descriptive EssayWriting A Strong Introduction To A Descriptive Essay
Writing A Strong Introduction To A Descriptive EssayScott Faria
Ā 
Abstract Writing For Research Papers. How To Make Your
Abstract Writing For Research Papers. How To Make YourAbstract Writing For Research Papers. How To Make Your
Abstract Writing For Research Papers. How To Make YourScott Faria
Ā 
Essay On Child Labour In English How To Write Essay On Child Labour
Essay On Child Labour In English How To Write Essay On Child LabourEssay On Child Labour In English How To Write Essay On Child Labour
Essay On Child Labour In English How To Write Essay On Child LabourScott Faria
Ā 
Short Essay College Apa Format Paper Does Apa F
Short Essay College Apa Format Paper Does Apa FShort Essay College Apa Format Paper Does Apa F
Short Essay College Apa Format Paper Does Apa FScott Faria
Ā 
Pustakachi Atmakatha In Marathi Plz Help - Brainly.In
Pustakachi Atmakatha In Marathi Plz Help - Brainly.InPustakachi Atmakatha In Marathi Plz Help - Brainly.In
Pustakachi Atmakatha In Marathi Plz Help - Brainly.InScott Faria
Ā 
How To Write An Intro Paragraph For A Synthesis Essay - Airey Pen
How To Write An Intro Paragraph For A Synthesis Essay - Airey PenHow To Write An Intro Paragraph For A Synthesis Essay - Airey Pen
How To Write An Intro Paragraph For A Synthesis Essay - Airey PenScott Faria
Ā 
(PDF) Guide To Writing Philosophy Essays Rhod
(PDF) Guide To Writing Philosophy Essays Rhod(PDF) Guide To Writing Philosophy Essays Rhod
(PDF) Guide To Writing Philosophy Essays RhodScott Faria
Ā 
Social Issues Essay By Kelvin. Online assignment writing service.
Social Issues Essay By Kelvin. Online assignment writing service.Social Issues Essay By Kelvin. Online assignment writing service.
Social Issues Essay By Kelvin. Online assignment writing service.Scott Faria
Ā 
How To Write A College Essay Step By Step Guid
How To Write A College Essay Step By Step GuidHow To Write A College Essay Step By Step Guid
How To Write A College Essay Step By Step GuidScott Faria
Ā 

More from Scott Faria (20)

002 Essay Example Refle. Online assignment writing service.
002 Essay Example Refle. Online assignment writing service.002 Essay Example Refle. Online assignment writing service.
002 Essay Example Refle. Online assignment writing service.
Ā 
How To Write A Proper Observation Essay - Adair
How To Write A Proper Observation Essay - AdairHow To Write A Proper Observation Essay - Adair
How To Write A Proper Observation Essay - Adair
Ā 
Get Community College Essay Examples Tips - Es. Online assignment writing ser...
Get Community College Essay Examples Tips - Es. Online assignment writing ser...Get Community College Essay Examples Tips - Es. Online assignment writing ser...
Get Community College Essay Examples Tips - Es. Online assignment writing ser...
Ā 
Ocean Writing Paper Writing Paper, Kindergarte
Ocean Writing Paper Writing Paper, KindergarteOcean Writing Paper Writing Paper, Kindergarte
Ocean Writing Paper Writing Paper, Kindergarte
Ā 
CompareContrast Essay Outline Essay Outline The
CompareContrast Essay Outline Essay Outline TheCompareContrast Essay Outline Essay Outline The
CompareContrast Essay Outline Essay Outline The
Ā 
Good Essay Guide Essay Writing Skills, Writing Lesso
Good Essay Guide Essay Writing Skills, Writing LessoGood Essay Guide Essay Writing Skills, Writing Lesso
Good Essay Guide Essay Writing Skills, Writing Lesso
Ā 
Literature Review Chicago Style Sample Welcome T
Literature Review Chicago Style Sample Welcome TLiterature Review Chicago Style Sample Welcome T
Literature Review Chicago Style Sample Welcome T
Ā 
100Th Day Writing Paper With Border And 3-Ruled Lines -
100Th Day Writing Paper With Border And 3-Ruled Lines -100Th Day Writing Paper With Border And 3-Ruled Lines -
100Th Day Writing Paper With Border And 3-Ruled Lines -
Ā 
014 Essay Example Descriptive Person Writing
014 Essay Example Descriptive Person Writing014 Essay Example Descriptive Person Writing
014 Essay Example Descriptive Person Writing
Ā 
6 Essay Writing Tips For Scoring Good Grades
6 Essay Writing Tips For Scoring Good Grades6 Essay Writing Tips For Scoring Good Grades
6 Essay Writing Tips For Scoring Good Grades
Ā 
Scholarship Essay Graduate Program Essay Examples
Scholarship Essay Graduate Program Essay ExamplesScholarship Essay Graduate Program Essay Examples
Scholarship Essay Graduate Program Essay Examples
Ā 
Writing A Strong Introduction To A Descriptive Essay
Writing A Strong Introduction To A Descriptive EssayWriting A Strong Introduction To A Descriptive Essay
Writing A Strong Introduction To A Descriptive Essay
Ā 
Abstract Writing For Research Papers. How To Make Your
Abstract Writing For Research Papers. How To Make YourAbstract Writing For Research Papers. How To Make Your
Abstract Writing For Research Papers. How To Make Your
Ā 
Essay On Child Labour In English How To Write Essay On Child Labour
Essay On Child Labour In English How To Write Essay On Child LabourEssay On Child Labour In English How To Write Essay On Child Labour
Essay On Child Labour In English How To Write Essay On Child Labour
Ā 
Short Essay College Apa Format Paper Does Apa F
Short Essay College Apa Format Paper Does Apa FShort Essay College Apa Format Paper Does Apa F
Short Essay College Apa Format Paper Does Apa F
Ā 
Pustakachi Atmakatha In Marathi Plz Help - Brainly.In
Pustakachi Atmakatha In Marathi Plz Help - Brainly.InPustakachi Atmakatha In Marathi Plz Help - Brainly.In
Pustakachi Atmakatha In Marathi Plz Help - Brainly.In
Ā 
How To Write An Intro Paragraph For A Synthesis Essay - Airey Pen
How To Write An Intro Paragraph For A Synthesis Essay - Airey PenHow To Write An Intro Paragraph For A Synthesis Essay - Airey Pen
How To Write An Intro Paragraph For A Synthesis Essay - Airey Pen
Ā 
(PDF) Guide To Writing Philosophy Essays Rhod
(PDF) Guide To Writing Philosophy Essays Rhod(PDF) Guide To Writing Philosophy Essays Rhod
(PDF) Guide To Writing Philosophy Essays Rhod
Ā 
Social Issues Essay By Kelvin. Online assignment writing service.
Social Issues Essay By Kelvin. Online assignment writing service.Social Issues Essay By Kelvin. Online assignment writing service.
Social Issues Essay By Kelvin. Online assignment writing service.
Ā 
How To Write A College Essay Step By Step Guid
How To Write A College Essay Step By Step GuidHow To Write A College Essay Step By Step Guid
How To Write A College Essay Step By Step Guid
Ā 

Recently uploaded

ENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptx
ENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptxENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptx
ENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptxAnaBeatriceAblay2
Ā 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
Ā 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
Ā 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionSafetyChain Software
Ā 
Final demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxFinal demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxAvyJaneVismanos
Ā 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
Ā 
Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon AUnboundStockton
Ā 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
Ā 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaVirag Sontakke
Ā 
18-04-UA_REPORT_MEDIALITERAŠ”Y_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAŠ”Y_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAŠ”Y_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAŠ”Y_INDEX-DM_23-1-final-eng.pdfssuser54595a
Ā 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsanshu789521
Ā 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxGaneshChakor2
Ā 
Class 11 Legal Studies Ch-1 Concept of State .pdf
Class 11 Legal Studies Ch-1 Concept of State .pdfClass 11 Legal Studies Ch-1 Concept of State .pdf
Class 11 Legal Studies Ch-1 Concept of State .pdfakmcokerachita
Ā 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
Ā 
Science lesson Moon for 4th quarter lesson
Science lesson Moon for 4th quarter lessonScience lesson Moon for 4th quarter lesson
Science lesson Moon for 4th quarter lessonJericReyAuditor
Ā 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
Ā 
Blooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docxBlooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docxUnboundStockton
Ā 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxthorishapillay1
Ā 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13Steve Thomason
Ā 

Recently uploaded (20)

ENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptx
ENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptxENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptx
ENGLISH5 QUARTER4 MODULE1 WEEK1-3 How Visual and Multimedia Elements.pptx
Ā 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
Ā 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
Ā 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory Inspection
Ā 
Final demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxFinal demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptx
Ā 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
Ā 
Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon A
Ā 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Ā 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of India
Ā 
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
Ā 
18-04-UA_REPORT_MEDIALITERAŠ”Y_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAŠ”Y_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAŠ”Y_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAŠ”Y_INDEX-DM_23-1-final-eng.pdf
Ā 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha elections
Ā 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptx
Ā 
Class 11 Legal Studies Ch-1 Concept of State .pdf
Class 11 Legal Studies Ch-1 Concept of State .pdfClass 11 Legal Studies Ch-1 Concept of State .pdf
Class 11 Legal Studies Ch-1 Concept of State .pdf
Ā 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
Ā 
Science lesson Moon for 4th quarter lesson
Science lesson Moon for 4th quarter lessonScience lesson Moon for 4th quarter lesson
Science lesson Moon for 4th quarter lesson
Ā 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
Ā 
Blooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docxBlooming Together_ Growing a Community Garden Worksheet.docx
Blooming Together_ Growing a Community Garden Worksheet.docx
Ā 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
Ā 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
Ā 

Applied Epidemiology - A Full-Subject Self-Directed Computer-Based Problem-Solving Learning Experience

  • 1. University of Wollongong Research Online Academic Services Division - Papers Academic Services Division 1998 Applied Epidemiology - A full-subject self-directed computer-based problem-solving learning experience Irene A. Kreis University of Wollongong Adam Orvad University of Wollongong Dhammika Ruberu University of Wollongong Ray Stace University of Wollongong, rstace@uow.edu.au Research Online is the open access institutional repository for the University of Wollongong. For further information contact Manager Repository Services: morgan@uow.edu.au. Publication Details This conference paper was originally published as Kreis, IA, Orvad, A, Ruberu, D and Stace, R, Applied Epidemiology, A Full-subject Self-Directed Computer-Based Problem-Solving Learning Experience, in Corderoy, RM (ed), Proceedings of the 15th Annual Ascilite Conference: Flexibility The next wave?, University of Wollongong, Australia, 1998, 433-439.
  • 2. Applied Epidemiology - A full-subject self-directed computer-based problem-solving learning experience Abstract A major difficulty of teaching public health to students in a Masters Program is conveying the need for taking a strategic approach to situations. Tackling real-life public health issues is rather complex. There will generally be a number of avenues of investigation and it is necessary to be wary of the short and long-term consequences of actions. Also time and money need to be managed effectively. As one approach to the education of students about these issues, a computer-based package has been developed which simulates the investigation of a real public health problem. This simulation enables students to encounter such issues in a risk-free environment, and to carry out their own investigations and propose their own solutions to the problems presented. Specifically, students have to clarify the impact of pollution on the health of residents in an affected area. They will collect and analyse data (from in-built real-life data sets), design and analyse their own epidemiological study and present their findings as reports, press-releases and presentations. The task takes students an entire subject (14-weeks) to complete and is largely self-directed. The package contains both quantitative data, such as mortality and morbidity statistics, and qualitative data, such as the outcome of interviews with key stakeholders. The package also exploits the multimedia capabilities of a PC by incorporating maps and photographs of the polluted area. This enables students to undertake a virtual trip, and thus pick up vital clues about potential sources of contamination. The package provides links to standard statistical software, thereby giving students an opportunity to become more familiar with programs they are likely to use in real-life. The data provide sufficient breadth and detail for students to use various strategies. But, to simulate real-life, students have to conduct their investigations within virtual time and budgetary constraints, continuously monitored by the computer program. In particular, monitoring of constraints, the real-life data and the linked use of standard software allow for the realistic development of essential skills. In the subject setting, role-play during the presentations, and reporting in real-life formats, add to the simulation. Practical exercises have not been part of most Public Health Masters programs world wide, and yet the complexity of real-life situations means that such experience is invaluable. When fully complete, this package will offer a novel, innovative and important approach to the teaching of this aspect of public health. Keywords epidemiology, education, case-study, team-work, communication, environment Publication Details This conference paper was originally published as Kreis, IA, Orvad, A, Ruberu, D and Stace, R, Applied Epidemiology, A Full-subject Self-Directed Computer-Based Problem-Solving Learning Experience, in Corderoy, RM (ed), Proceedings of the 15th Annual Ascilite Conference: Flexibility The next wave?, University of Wollongong, Australia, 1998, 433-439. This conference paper is available at Research Online: http://ro.uow.edu.au/asdpapers/47
  • 3. ASCILITE ā€™98 433 Applied Epidemiology, a Full-subject Self-directed Computer-based Problem-solving . . . APPLIED EPIDEMIOLOGY, A FULL-SUBJECT SELF-DIRECTED COMPUTER-BASED PROBLEM-SOLVING LEARNING EXPERIENCE 1 Irene A. Kreis, 2 Adam Orvad, 3 Dhammika Ruberu, and 4 Ray Stace 1 Department of Public Health and Nutrition, University of Wollongong, Australia email: Irene-Kreis@uow.edu.au 2, 3 and 4 Centre for Educational Development and Interactive Resources, University of Wollongong, Australia email: adam_orvad@uow.edu.au email: dhammika_ruberu@uow.edu.au email: ray_stace@uow.edu.au ABSTRACT A major difficulty of teaching public health to students in a Masters Program is conveying the need for taking a strategic approach to situations. Tackling real-life public health issues is rather complex. There will generally be a number of avenues of investigation and it is necessary to be wary of the short and long-term consequences of actions. Also time and money need to be managed effectively. As one approach to the education of students about these issues, a computer-based package has been developed which simulates the investigation of a real public health problem. This simulation enables students to encounter such issues in a risk-free environment, and to carry out their own investigations and propose their own solutions to the problems presented. Specifically, students have to clarify the impact of pollution on the health of residents in an affected area. They will collect and analyse data (from in-built real-life data sets), design and analyse their own epidemiological study and present their findings as reports, press-releases and presentations. The task takes students an entire subject (14-weeks) to complete and is largely self-directed. The package contains both quantitative data, such as mortality and morbidity statistics, and qualitative data, such as the outcome of interviews with key stakeholders. The package also exploits the multimedia capabilities of a PC by incorporating maps and photographs of the polluted area. This enables students to undertake a virtual trip, and thus pick up vital clues about potential sources of contamination. The package provides links to standard statistical software, thereby giving students an opportunity to become more familiar with programs they are likely to use in real-life. The data provide sufficient breadth and detail for students to use various strategies. But, to simulate real-life, students have to conduct their investigations within virtual time and budgetary constraints, continuously monitored by the computer program. In particular, monitoring of constraints, the real-life data and the linked use of standard software allow for the realistic development of essential skills. In the subject setting, role-play during the presentations, and reporting in real-life formats, add to the simulation. Practical exercises have not been part of most Public Health Masters programs world wide, and yet the complexity of real-life situations means that such experience is invaluable. When fully complete, this package will offer a novel, innovative and important approach to the teaching of this aspect of public health.
  • 4. 434 Kreis, Orvad, Ruberu and Stace KEY WORDS Epidemiology, education, case-study, team-work, communication, environment. 1. INTRODUCTION While public health students can be taught epidemiological methods, communication and project management skills using standard teaching methods, it is difficult to give them a feel for the richness of undertaking a real epidemiological study. The need for some experience in dealing with a total study is enforced by the observation that public health practitioners often have to deal with complicated situations such as cancer clusters, contaminated drinking water, hepatitis epidemics or unplanned emissions from factories. In these situations, they have to assess the situation quickly and systematically, gather and evaluate the available information, and present their opinion about health risks. Public health postgraduate students are taught the concepts needed to deal with these issues in subjects such as epidemiology, bio-statistics and research methods. The breadth of knowledge that needs to be covered and the complexity of the causes of diseases rarely allows for an active involvement of students. Only such an involvement would allow the students to experience the concepts and methods and internalise the thought process involved. There are some pen and paper exercises available that do attempt to cover this gap but they fall far short of the complexity and magnitude public health problems actually can reach (WHO materials). It was thought that a real-life public health problem, that was extensively investigated, could be turned into a useful teaching tool (Kreis PhD). A simulation of the situation the students are likely to encounter when employed including the likely constraints on time and money would potentially give the students a feel of what it will be like. This paper describes the tool developed for this purpose. It also describes the teaching advantages that are possible when using such a tool as well as some of the potential shortcomings. 2. AIMS The aims of the subject for which the teaching tool has been and is continuing to be developed are that at the end of the subject (whole class of 14 weeks and a total of 1/12th of a Masters degree) the student will be able to: ā€¢ actively engage in small team problem solving; ā€¢ strategically plan their actions and manage time and financial constraints; ā€¢ utilise available data-sets on health, environmental contamination levels and exposure; ā€¢ use and apply knowledge on statistical computer software and word processing; ā€¢ analyse the collected data and integrate the results with literature information into a view as to whether there is a health risk to a population; and ā€¢ present and defend conclusions to a critical audience and in a written format according to established professional standards. 3. MATERIALS AND STRUCTURE The problem is derived from a case study of cadmium contaminated soil in The Netherlands. The contamination resulted from long term air emissions and the deposition of waste materials by a number of metallurgic factories. The investigation of the possible health effects covered all stages that can be recognised in such investigations. Expert opinion, routine data-sets, ad- hoc data-sets and data from a large scale study were available or possible to simulate. Information on both health status and environment relevant to the case study were extensively available (if predominantly in government reports and often in Dutch). Copyright issues are limited as the data were collected with public money and the case itself dates back to the early 1980ā€™s.
  • 5. ASCILITE ā€™98 435 Applied Epidemiology, a Full-subject Self-directed Computer-based Problem-solving . . . The case-study had been worked into a simple computer-based teaching tool in the Netherlands itself by the University of Nijmegen. This material was designed to function on the most basic PC (XTā€™s) and only used text and some numerical information. There was some limitation of choice in the use of data-sets and students had to work within the constraints of a financial budget. The structure and some of the materials of this Dutch version were used after translation. The new CD-ROM based program uses specific multi-media authoring (developed in MacroMedia Authorware) and allows for greater consistency in the application of the time or financial restraints. It is also different in that it aims to incorporate standard software that is often used in public health practice such as Epi-Info. The teaching tool can be used on Windows 3.1 or Windows 95 operating systems with only limited need to install other software. The minimum requirement for the computers is that they need to have a CD-ROM as well as a floppy drive. The floppy is needed because the progress of the student is monitored on a personal floppy so that students can change between computers, and so that students can save ā€˜notebookā€™ information which they can later incorporate into their reports. (Figure 1) Figure 1: Notebook with reference text The case-study is structured in four stages and some additional information is available at all times (tutorials and maps). The stages represent a pre-structured approach to public health problems that is widely accepted as reasonable. The tutorials cover materials that one could assume the student would know but that might do with some repetition (presentation techniques and the use of Epi-Info), or provide information that might be too hard to collect otherwise (dietary intake). Also some additional information on the organisation of public health around the world and dietary intake around the world is available. This enables the student to assess the equivalent situation in their own country. The first stage of the actual case-study covers an orientation to the problem including qualitative as well as some quantitative material. The material covers interviews with experts such as University professors (Figure 2), and stakeholders such as politicians, factory owner and residents. Other qualitative data result from simulated literature searches, a tour of the regions with visual clues (Figure 3) and the inspection of maps. Quantitative data include some limited environmental sampling and some limited routine data sets. During this stage, the budget is time related and the students are limited to an equivalent of 3 working weeks. The students will have to plan their actions as some information takes time to arrive after requesting it. Another aspect in this stage is that the students can make some clearly wrong choices and they will get fired from their jobs if they do. The students will then have to start all over. The multimedia version of this stage has been in use for the past two years (at the time of writing). Figure 2: Some of the interview subjects
  • 6. 436 Kreis, Orvad, Ruberu and Stace Figure 3: Part of the guided tour The second stage of the case-study requires the students to divide their attention between the environmental component of the case and the health effects component. They are asked to buy information (Figure 4), but stay within a budget, and they are required to analyse the information. They also need to make a choice between some analytic tools eg. various forms of standardisation of the data. To simulate the real-life situation the data-sets need to be ordered separately but need to be complete when analysing them. This again stimulates strategic planning by the students. In analysing the health data, some money can be saved by the ingenious combination of data-sets and being focussed on realistic questions to ask of the data. The multimedia version of this stage has been in use for the past year (at the time of writing). Figure 4: Ordering demographic data for East Kempen The third stage requires the students to design an analytic epidemiological study of health effects from the environmental contamination. The type of questions the study can address can vary widely. The students are first and foremost restricted by financial constraints. They will have to take account of the financial cost of each measurement and also the logistics of the study they propose. Ultimately they are also restricted by limitations of the database supporting this and the next stage. However, the currently available database is very extensive and so this is not a major issue. In addition, it may be possible later to extend the options by including databases from similar research projects. Once the students have decided how they are going to collect their information, a database will be created according to their specifications. In stage four the students are required to analyse the database created at the end of stage three. The subject assumes that the analysis will take place in the public domain software of Epi- Info. However, the data can also be exported to software the local teaching facility prefers eg SAS or SPSS. At this stage, the students will be limited in time only.
  • 7. ASCILITE ā€™98 437 Applied Epidemiology, a Full-subject Self-directed Computer-based Problem-solving . . . In teaching the subject, the students are organised into teams of two to three people. At the end of each stage, the students present the results in standard professional formats such as reports, press releases and a proposal. To simulate presenting their results to the public, the students are asked to present their findings orally as well. The other students are asked to play the roles of stake-holders in the community which thus creates the atmosphere of a public meeting. 4. STATUS AND PLANS The subject has so far been run employing the multimedia materials over the past two years. Modifications were made after the first year based on the experiences of the teacher and the students, and the updated version was used the second time. The current model was used with a class of 6 students. The evaluation of this teaching process is reflected in a remark form a student: ā€œI never worked so hard and I never learned so muchā€. Stage one is complete except for the simulation of the literature searches that would be expected at this time. Stage two has had a limited number of databases for health available but these are the most relevant ones. The environmental component of this stage is complete except for the translation of one rather hefty report on environmental investigations. The interfaces for the information in this stage have all been redesigned from the earlier version and are considerably improved. They require a lot of attention to detail by the student but that has been a conscious decision in the design process. Stages three and four are not yet included in the multimedia program and have been run using the material in a non-computerised form. Stage three has been simulated with proposal writing without linking it to the actual data to be analysed. Stage four has been simulated by giving the students access to the original database but with a limited number of variables. Most of the essential tutorial material is now available, which was not the case during the teaching of the subject in 1998. The plan is to extend the number of databases available in stage two as they are readily available in the original case-study. It is also intended to implement stages three and four. Some extension of the materials available in the tutorials is also being prepared. From a teaching perspective it is envisaged that further trials with the fully completed multimedia program need to be run under various conditions. One of the possible options is a trial of a workshop format where the students go through the whole program in a much more condensed time frame. Another aspect of the evaluation will be the assessment of its effectiveness to a teacher who is less familiar with the original case study. 5. DISCUSSION A number of aspects about this teaching tool can be addressed. It can be questioned why one would use a case study in a country like the Netherlands and why one would not translate the situation to an imaginary place where the names and such would be more easy pronounced. If one were to do that, a host of information about the local situation would have to be invented. Visual clues would be much harder to incorporate and the total case study would become much less interesting in the view of these authors. Also, within the public health profession, it is entirely usual to use information from other countries. Using the Netherlands thus becomes an additional bonus rather than a handicap. The addition of information about other countries inthetutorialallowsteachersandstudentsusingthetool,toaddressthecomparabilityofthesituation. Another question one can ask is whether cadmium contamination is sufficiently important to spend this much time on during the limited time of a Masters program. However, the aim of the subject is not to teach students all the aspects of cadmium contamination, although cadmium contamination is enough of a problem worldwide to deserve some attention, and cadmium is one of the heavy metal pollutants such as lead which all share environmental similarities. Instead the aim is to confront students with the structured approach to complex problems which extend beyond the case-study. This is possible because the case study is similar enough in structure to other public health problems such as the earlier mentioned cancer clusters or water contaminationincidents,thatitcanfunctionasateachingmodelwherethecontentislessimportant.
  • 8. 438 Kreis, Orvad, Ruberu and Stace It could be argued that in presenting the case-study in the four prescribed stages we have pre- structured the approach such that the student can no longer make major mistakes in structuring the handling of the problem. It is clear that some structuring has taken place and that the amount of information is presented in a lot more systematic manner than it would in real life. However, to allow the student to understand the model of investigation, the possibility of getting fired in the first stage has been consciously incorporated. It does emphasise to the student that something that turns out to be perfectly OK much later in the investigation can be entirely out of order in the earlier stages. The clarification of this observation is clearly the task of the teacher in charge of the subject. In the subject as we have conducted it at this University, we have insisted on the students working in teams of two, occasionally three as the class size requires. In the earlier classes as taught at the University of Nijmegen they had made the same choice. The first reason for doing this is that the amount of work involved is rather substantial.Another reason is that the University has stated, in its aims for the attitudes of its graduates, that they should be able to work in teams. The third but most important reason is that most, if not all public health practice, is conducted in teams. Developing skills in collaboration and in delegating are essential for a public health practitioner. The presentation formats required of the students have been chosen to be as similar as possible to those often used in public health practice. A teacher using the tool could decide to change the requirements placed on the students. However, it was found that using reports and press releases rather than an essay format uncovered a lack of recognition by the students of the differences between the various formats. Using the professional formats also enhanced the feeling of being part of a real investigation and increased the commitment of the students to the subject.Assigning students specific roles during the presentations stimulated the discussion. It also provided additional clues to the students for the context of the case-study. It can be questioned whether one really needs a computer-based package to do the teaching as conducted in the subject. It would be possible to give the students some of the information in more traditional paper formats including the visual clues. However, monitoring their progress and restricting some options would become incredibly labour intensive to the lecturer. Also, some aspects of the practice of public health inherently involves computer databases in most countries in the world. It is possible that once developed, the teaching tool becomes stale as a number of students have gone through the process. Either the students collective memory will get to know all the ins and outs of the case study or the teacher could get bored with the amount of marking that is inherent in the exercise. The boredom of the teacher can be prevented by having different staff teaching the subject once all the material has been developed. As the subject is likely to be one of the last subjects undertaken by the students they are less likely to be in frequent contact with students yet to undertake the subject. However, the possibility of the tool aging will have to be evaluated over time. The experience at the University of Nijmegen which has been using the earlier version for about 8 years, seems to indicate that if one keeps the teachers fresh, the students keep enjoying the case study. 6. CONCLUSION The development of a problem-solving computer-based teaching tool seems to indicate that it is possible to simulate a complex public health problem in a student friendly way. It is also clear that the development of such a tool requires extensive resources in the availability of data, time and know-how. 7. ACKNOWLEDGMENT This development of this teaching tool was made possible with financial support from the University and with a CUTSD grant and the support from very many people.
  • 9. ASCILITE ā€™98 439 Applied Epidemiology, a Full-subject Self-directed Computer-based Problem-solving . . . 8. REFERENCES World Health Organisation. Problem-based training exercises for environmental epidemiology, group based exercises for students. Geneva, March 1992 Kreis I.A. Health Effects of cadmium Contamination in Kempenland. Ph.D. Leiden University. The Hague September 1992 Dean A.G., Dean J.A., Coulombier, D. et al. Epi Info, Version 6: a word processing, database, and statistics program for epidemiology on microcomputers. Centers for Disease Control and Prevention. Atlanta Georgia, USA 1994 Ā© Irene A. Kreis, Adam Orvad, Dhammika Ruberu, and Ray Stace The author(s) assign toASCILITE and educational and non-profit institutions a non-exclusive licence to use this document for personal use and in courses of instruction provided that the article is used in full and this copyright statement is reproduced. The author(s) also grant a non-exclusive licence to ASCILITE to publish this document in full on the World Wide Web (prime sites and mirrors) and in printed form within theASCILITE98 Conference Proceedings. Any other usage is prohibited without the express permission of the author(s).