SlideShare a Scribd company logo
1 of 21
The University of Hong Kong
Achieving Systemic eLearning Change:
A Flight of Fancy or Realizable Reality
Dr. Iain Doherty
Associate Professor
Director eLearning Pedagogical Support Unit
Centre for the Enhancement of Teaching and Learning
9th May 2013
Overview
• Systemic Change
• Socio-cultural Milieu
• Change Management
• Flight of Fancy of Realizable Reality?
• Running the Risk of Failing to Change
Systemic Change
• Systemic change refers to change that effects an entity as a whole. In
the case of an educational institution achieving systemic eLearning
change necessarily entails some sort of fundamental shift in the
nature of the institution.
• However, it is not entirely clear what
this shift would look like. For
example, does systemic change
involve change at all levels of the
organization: people, processes,
systems, structures, Faculties and
Departments (Marshall, 2010)?
Systemic Change
• If systemic change does refer to change at all levels of the
organization then what is the nature of the change at these
different levels?
• More specifically, what components or parts of the
institution have to change in order for one to be able to
say that there has been systemic change?
• Finally, when we talk about
systemic change are we talking
about change in which the
change as a whole is greater than
the sum of the parts that led to
the change?
Socio-Cultural Milieu
One way to answer the questions in
the previous paragraph is to think of
an institute of higher education as a
socio-cultural milieu that can be
deconstructed into component parts.
These parts can then be analyzed in
terms of their importance in the
process of bringing about systemic
eLearning change.
Socio-Cultural Milieu
• In this milieu there are people – the socio
element – along with patterns of beliefs,
behaviors, interactions and affective
understandings – the cultural element – that
are common to the members of the institution.
The cultural element is learned through a
process of socialization.
• If we think about the complexity of the milieu then we can begin to
understand just why it is so very challenging to achieve systemic
institutional eLearning change.
Socio-Cultural Milieu
• An example should serve to illustrate the point made in the previous
slides concerning complexity.
• An institute of higher education
consists of a “community” of
individuals at various levels of
seniority, with different responsibilities,
varying attitudes, different career goals
and a range of aspirations. In concrete
terms the implementation of an
eLearning strategy will mean
something different both between
groups and within groups.
Socio-Cultural Milieu
• A Vice Chancellor driving an eLearning
strategy will be – or at least should be –
firmly committed to realizing the
strategic goals. The same should be true
of the Pro-Vice Chancellors and the
senior management team. Whilst we
would ideally see the same commitment
from other groups – Faculties,
Departments, Centers etc. – the reality
will likely be that the commitment of
other groups and within the other groups
will differ to one degree or another from
that of the Senior Management.
Socio-Cultural Milieu
• Another equally important part
of the strategy consists of
addressing the cultural elements
– beliefs, behaviours and
interactions – of the institution.
These beliefs, behaviours and
interactions are instantiated
across people, processes and
documentation and it is
important that an effort to
achieve systemic eLearning
change address the cultural
norms of the institution.
Socio-Cultural Milieu
• Faculties, Departments, Centers
etc. have to report periodically on
their teaching. If these reports
require an update on eLearning
initiatives then, to some degree at
least, eLearning becomes a part
of the reporting culture within the
institution.
• Reporting per se will not bring about systemic eLearning
change. It can however serve to progress the institution
towards embedding eLearning within the institutional culture.
Change Management
• Having broken systemic change down
into two component parts – social
change and cultural change – we can see
that a change management process is
required (Kotter, 1995).
• Uys (2007; 2010) has an enterprise wide
change model that conceptualizes the
change process as both top down and
bottom up. From a top down perspective
managers institute change and from a
bottom up perspective the “workers”
contribute to change.
Change Management
• However, this model misses
the concept of “middle in”
change. Middle in change can
be thought of in terms of the
“middle managers” who are in
a position to influence the
socio-cultural environment in
which they work.
• For example, Associate Deans Teaching and Learning could be
considered as “middle management” and these Deans are in a position
to influence the culture – the way that things are done – and the
individuals who comprise the community.
Change Management
• Achieving systemic change involves a
complex process of transforming the
socio-cultural environment so that
eLearning becomes simply a part of the
way that things are done within an
institution.
• This raises the question whether aiming
for systemic change is a flight of fancy of
a realizable reality.
Change Management
• Kotter (1995) argues that transformation
efforts tend to fail when there is an
insufficient sense of urgency.
• A sense of urgency can have many sources
but one of the most potent drivers comes
when there is a sense that “business” cannot
continue as usual.
• University business cannot continue as usual
when something is perceived to be broken.
• Even then effecting change is difficult.
Flight of Fancy or Realizable Reality
• Change is nigh on impossible in a university
system that is perceived to have been operating
“effectively” for decades (Katz, 2003).
• In the absence of this sense of urgency we can
suggest that aiming for systemic change is a flight
of fancy because there is no “apparent” driver for
disruptive change.
• Does this mean that change is impossible?
• Depends on the sort of change we have in mind.
Flight of Fancy or Realizable Reality
• Change can occur in the absence of a
sense of urgency (Marshall, 2010).
• In this case we are talking about a
transformative change process that takes
a top down, middle in and bottom up
approach.
• This sort of change process can be
thought of as bringing about sustaining
changes that improve the function of the
organization in ways that are consistent
with previous activities (Marshall, 2010).
Flight of Fancy or Realizable Reality
• Sustaining changes do not achieve
systemic change.
• We have to consider the possibility of
“the emergence of new institutions
‘where the weight of history does not
condition and constrain technology’s
use’” (Katz, 2010, p.48).
• In other words sustaining changes may simply not be enough.
• Think what MOOCs might mean for the middle to lower tier universities.
Flight of Fancy or Realizable Reality
• We can understand the component parts of a university system.
• We see complexity but we can adopt a planned approach to
achieving change.
• Problem is that there is no real sense that the
system is broken.
• Therefore systemic change does not occur.
• Any particular organization might survive for a
while but what are the long term risks?
References
• Katz, R. N. (2003). Balancing Technology and Tradition -
The Example of Course Management Systems. Educause
Review, 4(38), 49–59. Retrieved from
http://net.educause.edu/ir/library/pdf/ERM0343.pdf
• Kotter, J. P. (1995). Why Transformation Efforts Fail.
Harvard Business Review, March/April(61), 59–67.
Retrieved from http://hbr.org/2007/01/leading-
change/ar/1
References
• Marshall, S. (2010). Change, Technology and Higher
Education: Are Universities Capable of Organisational
Change? ALT-J: Research in Learning Technology, 18(3),
179–192. Retrieved from
http://www.informaworld.com/10.1080/09687769.2010.5
29107
References
• Uys, P.M. (2007). Enterprise-Wide Technological
Transformation in Higher Education: The LASO Model.
International Journal of Educational Management.
Retrieved from http://www.globe-
online.com/philip.uys/2006 08 uysLASOmodel.htm
• Uys, Philip M. (2010). Implementing An Open Source
Learning Management System : A Critical Analysis of
Change strategies. Australasian Journal of Educational
Technology, 26(7), 980–995. Retrieved from
http://www.ascilite.org.au/ajet/ajet26/uys.pdf

More Related Content

What's hot

Conceptions of agency - CM 4
Conceptions of agency - CM 4Conceptions of agency - CM 4
Conceptions of agency - CM 4Daryl Horney
 
Sanchayan Nath, Evolution in Nature of Collective Action around Water-Bodies ...
Sanchayan Nath, Evolution in Nature of Collective Action around Water-Bodies ...Sanchayan Nath, Evolution in Nature of Collective Action around Water-Bodies ...
Sanchayan Nath, Evolution in Nature of Collective Action around Water-Bodies ...LabGov
 
Transformative Learning & Appreciative Inquiry V2.1
Transformative Learning & Appreciative Inquiry V2.1Transformative Learning & Appreciative Inquiry V2.1
Transformative Learning & Appreciative Inquiry V2.1iAttain
 
Generations of planned organisational change
Generations of planned organisational changeGenerations of planned organisational change
Generations of planned organisational changeShelly Jose
 
Different Perspective On Organizational Communication
Different Perspective On Organizational CommunicationDifferent Perspective On Organizational Communication
Different Perspective On Organizational CommunicationSol Erwin Diaz
 
Employee engagement and change management programmes
Employee engagement and change management programmesEmployee engagement and change management programmes
Employee engagement and change management programmesAlexander Decker
 
2015 OMT Distinguished Scholar presentation by Martha Feldman
2015 OMT Distinguished Scholar presentation by Martha Feldman2015 OMT Distinguished Scholar presentation by Martha Feldman
2015 OMT Distinguished Scholar presentation by Martha FeldmanOMT Division
 
Watts wk2 change research slideshow
Watts wk2 change research   slideshowWatts wk2 change research   slideshow
Watts wk2 change research slideshowNicole Mangum
 
History of Organizational Development - Organizational Change and Developmen...
History of Organizational Development -  Organizational Change and Developmen...History of Organizational Development -  Organizational Change and Developmen...
History of Organizational Development - Organizational Change and Developmen...manumelwin
 
System Thinking - Affect on Decision Making
System Thinking - Affect on Decision MakingSystem Thinking - Affect on Decision Making
System Thinking - Affect on Decision MakingMuhammad Awais
 
Book change leaders roadmap
Book change leaders roadmapBook change leaders roadmap
Book change leaders roadmaphugoprive
 
Sheri L. Miller-Williams & Dr. Wm. A. Kritsonis
Sheri L. Miller-Williams & Dr. Wm. A. KritsonisSheri L. Miller-Williams & Dr. Wm. A. Kritsonis
Sheri L. Miller-Williams & Dr. Wm. A. Kritsonisguestcc1ebaf
 
Leading Change
Leading ChangeLeading Change
Leading ChangeLee James
 

What's hot (17)

Conceptions of agency - CM 4
Conceptions of agency - CM 4Conceptions of agency - CM 4
Conceptions of agency - CM 4
 
Hrm
HrmHrm
Hrm
 
Sanchayan Nath, Evolution in Nature of Collective Action around Water-Bodies ...
Sanchayan Nath, Evolution in Nature of Collective Action around Water-Bodies ...Sanchayan Nath, Evolution in Nature of Collective Action around Water-Bodies ...
Sanchayan Nath, Evolution in Nature of Collective Action around Water-Bodies ...
 
Transformative Learning & Appreciative Inquiry V2.1
Transformative Learning & Appreciative Inquiry V2.1Transformative Learning & Appreciative Inquiry V2.1
Transformative Learning & Appreciative Inquiry V2.1
 
10520130101001
1052013010100110520130101001
10520130101001
 
Generations of planned organisational change
Generations of planned organisational changeGenerations of planned organisational change
Generations of planned organisational change
 
Different Perspective On Organizational Communication
Different Perspective On Organizational CommunicationDifferent Perspective On Organizational Communication
Different Perspective On Organizational Communication
 
Employee engagement and change management programmes
Employee engagement and change management programmesEmployee engagement and change management programmes
Employee engagement and change management programmes
 
2015 OMT Distinguished Scholar presentation by Martha Feldman
2015 OMT Distinguished Scholar presentation by Martha Feldman2015 OMT Distinguished Scholar presentation by Martha Feldman
2015 OMT Distinguished Scholar presentation by Martha Feldman
 
Watts wk2 change research slideshow
Watts wk2 change research   slideshowWatts wk2 change research   slideshow
Watts wk2 change research slideshow
 
History of Organizational Development - Organizational Change and Developmen...
History of Organizational Development -  Organizational Change and Developmen...History of Organizational Development -  Organizational Change and Developmen...
History of Organizational Development - Organizational Change and Developmen...
 
System Thinking - Affect on Decision Making
System Thinking - Affect on Decision MakingSystem Thinking - Affect on Decision Making
System Thinking - Affect on Decision Making
 
Book change leaders roadmap
Book change leaders roadmapBook change leaders roadmap
Book change leaders roadmap
 
Sheri L. Miller-Williams & Dr. Wm. A. Kritsonis
Sheri L. Miller-Williams & Dr. Wm. A. KritsonisSheri L. Miller-Williams & Dr. Wm. A. Kritsonis
Sheri L. Miller-Williams & Dr. Wm. A. Kritsonis
 
Systems thinking
Systems thinkingSystems thinking
Systems thinking
 
Leading Change
Leading ChangeLeading Change
Leading Change
 
Ch05
Ch05Ch05
Ch05
 

Viewers also liked

Industrial revolution steam engine
Industrial revolution  steam engineIndustrial revolution  steam engine
Industrial revolution steam enginehansonau
 
Prof. Gerald KNEZEK: Implications of Digital Generations for a Learning Society
Prof. Gerald KNEZEK: Implications of Digital Generations for a Learning Society Prof. Gerald KNEZEK: Implications of Digital Generations for a Learning Society
Prof. Gerald KNEZEK: Implications of Digital Generations for a Learning Society CITE
 
G:\CITERS2015\29May2015\2 Invited-Talk-2-Sidorko-Fred
G:\CITERS2015\29May2015\2 Invited-Talk-2-Sidorko-FredG:\CITERS2015\29May2015\2 Invited-Talk-2-Sidorko-Fred
G:\CITERS2015\29May2015\2 Invited-Talk-2-Sidorko-FredCITE
 
Dr. David Gibson: Challenge-Based Learning
Dr. David Gibson: Challenge-Based LearningDr. David Gibson: Challenge-Based Learning
Dr. David Gibson: Challenge-Based LearningCITE
 
Seminar on policy study on e-Learning in Formal & Open Learning contexts
Seminar on policy study on e-Learning in Formal & Open Learning contextsSeminar on policy study on e-Learning in Formal & Open Learning contexts
Seminar on policy study on e-Learning in Formal & Open Learning contextsCITE
 
Seminar on policy study on e-Learning in Informal Learning contexts
Seminar on policy study on e-Learning in Informal Learning contextsSeminar on policy study on e-Learning in Informal Learning contexts
Seminar on policy study on e-Learning in Informal Learning contextsCITE
 

Viewers also liked (8)

Walloomsac smar tvt
Walloomsac smar tvtWalloomsac smar tvt
Walloomsac smar tvt
 
Industrial revolution steam engine
Industrial revolution  steam engineIndustrial revolution  steam engine
Industrial revolution steam engine
 
oficina memorias
oficina memoriasoficina memorias
oficina memorias
 
Prof. Gerald KNEZEK: Implications of Digital Generations for a Learning Society
Prof. Gerald KNEZEK: Implications of Digital Generations for a Learning Society Prof. Gerald KNEZEK: Implications of Digital Generations for a Learning Society
Prof. Gerald KNEZEK: Implications of Digital Generations for a Learning Society
 
G:\CITERS2015\29May2015\2 Invited-Talk-2-Sidorko-Fred
G:\CITERS2015\29May2015\2 Invited-Talk-2-Sidorko-FredG:\CITERS2015\29May2015\2 Invited-Talk-2-Sidorko-Fred
G:\CITERS2015\29May2015\2 Invited-Talk-2-Sidorko-Fred
 
Dr. David Gibson: Challenge-Based Learning
Dr. David Gibson: Challenge-Based LearningDr. David Gibson: Challenge-Based Learning
Dr. David Gibson: Challenge-Based Learning
 
Seminar on policy study on e-Learning in Formal & Open Learning contexts
Seminar on policy study on e-Learning in Formal & Open Learning contextsSeminar on policy study on e-Learning in Formal & Open Learning contexts
Seminar on policy study on e-Learning in Formal & Open Learning contexts
 
Seminar on policy study on e-Learning in Informal Learning contexts
Seminar on policy study on e-Learning in Informal Learning contextsSeminar on policy study on e-Learning in Informal Learning contexts
Seminar on policy study on e-Learning in Informal Learning contexts
 

Similar to Achieving Systemic eLearning Change: A Flight of Fancy or Realizable Reality?

Organizational change in transition period
Organizational change in transition periodOrganizational change in transition period
Organizational change in transition periodMasum Hussain
 
Change management 1
Change management 1Change management 1
Change management 1waqole
 
Change ModelsDifferent models have been developed to help plan f.docx
Change ModelsDifferent models have been developed to help plan f.docxChange ModelsDifferent models have been developed to help plan f.docx
Change ModelsDifferent models have been developed to help plan f.docxsleeperharwell
 
Changing and Leading Staff Members of Higher Education in Rural District
Changing and Leading Staff Members of Higher Education in Rural DistrictChanging and Leading Staff Members of Higher Education in Rural District
Changing and Leading Staff Members of Higher Education in Rural DistrictDr. N. Asokan
 
WEEK 5 SCHOOL RESOURSESRole Concepts in HealthcareRole theory is t.docx
WEEK 5 SCHOOL RESOURSESRole Concepts in HealthcareRole theory is t.docxWEEK 5 SCHOOL RESOURSESRole Concepts in HealthcareRole theory is t.docx
WEEK 5 SCHOOL RESOURSESRole Concepts in HealthcareRole theory is t.docxhelzerpatrina
 
Toby lowe - The Gathering Feb 2020
Toby lowe - The Gathering Feb 2020Toby lowe - The Gathering Feb 2020
Toby lowe - The Gathering Feb 2020VolunteerScotland
 
An Emergent Approach to Transitioning Toward Agile Organization
An Emergent Approach to Transitioning Toward Agile OrganizationAn Emergent Approach to Transitioning Toward Agile Organization
An Emergent Approach to Transitioning Toward Agile OrganizationMichael Hamman
 
GreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems ChangeGreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems ChangeGreenBiz Group
 
Towards a new paradigm of ir strategy
Towards a new paradigm of ir strategyTowards a new paradigm of ir strategy
Towards a new paradigm of ir strategyGaurav Singh
 
Reading assignment final
Reading assignment finalReading assignment final
Reading assignment finalDevang Patel
 
The problem with teacher standards a critical processual-complexity approach
The problem with teacher standards   a critical processual-complexity approachThe problem with teacher standards   a critical processual-complexity approach
The problem with teacher standards a critical processual-complexity approachPhilwood
 
Organizational Change
Organizational ChangeOrganizational Change
Organizational ChangeAJ Briones
 
A complex process approach to organisational change
A complex process approach to organisational changeA complex process approach to organisational change
A complex process approach to organisational changePhilwood
 
Societal transformation
Societal transformationSocietal transformation
Societal transformationManoj Mota
 
Practitioner research as organisational change
Practitioner research as organisational changePractitioner research as organisational change
Practitioner research as organisational changePhilwood
 
Discussion Anchoring ChangeThe end result of a successful chang
Discussion Anchoring ChangeThe end result of a successful changDiscussion Anchoring ChangeThe end result of a successful chang
Discussion Anchoring ChangeThe end result of a successful changLyndonPelletier761
 
Projects policy and digital literacy
Projects policy and digital literacyProjects policy and digital literacy
Projects policy and digital literacyJisc
 
episodic and continuous change
episodic and continuous changeepisodic and continuous change
episodic and continuous changemannathoney
 

Similar to Achieving Systemic eLearning Change: A Flight of Fancy or Realizable Reality? (20)

Organizational change in transition period
Organizational change in transition periodOrganizational change in transition period
Organizational change in transition period
 
Change management 1
Change management 1Change management 1
Change management 1
 
Change ModelsDifferent models have been developed to help plan f.docx
Change ModelsDifferent models have been developed to help plan f.docxChange ModelsDifferent models have been developed to help plan f.docx
Change ModelsDifferent models have been developed to help plan f.docx
 
4811363.pdf
4811363.pdf4811363.pdf
4811363.pdf
 
Changing and Leading Staff Members of Higher Education in Rural District
Changing and Leading Staff Members of Higher Education in Rural DistrictChanging and Leading Staff Members of Higher Education in Rural District
Changing and Leading Staff Members of Higher Education in Rural District
 
WEEK 5 SCHOOL RESOURSESRole Concepts in HealthcareRole theory is t.docx
WEEK 5 SCHOOL RESOURSESRole Concepts in HealthcareRole theory is t.docxWEEK 5 SCHOOL RESOURSESRole Concepts in HealthcareRole theory is t.docx
WEEK 5 SCHOOL RESOURSESRole Concepts in HealthcareRole theory is t.docx
 
Toby lowe - The Gathering Feb 2020
Toby lowe - The Gathering Feb 2020Toby lowe - The Gathering Feb 2020
Toby lowe - The Gathering Feb 2020
 
2013 farkas
2013 farkas2013 farkas
2013 farkas
 
An Emergent Approach to Transitioning Toward Agile Organization
An Emergent Approach to Transitioning Toward Agile OrganizationAn Emergent Approach to Transitioning Toward Agile Organization
An Emergent Approach to Transitioning Toward Agile Organization
 
GreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems ChangeGreenBiz 19 Workshop Slides: The School of Systems Change
GreenBiz 19 Workshop Slides: The School of Systems Change
 
Towards a new paradigm of ir strategy
Towards a new paradigm of ir strategyTowards a new paradigm of ir strategy
Towards a new paradigm of ir strategy
 
Reading assignment final
Reading assignment finalReading assignment final
Reading assignment final
 
The problem with teacher standards a critical processual-complexity approach
The problem with teacher standards   a critical processual-complexity approachThe problem with teacher standards   a critical processual-complexity approach
The problem with teacher standards a critical processual-complexity approach
 
Organizational Change
Organizational ChangeOrganizational Change
Organizational Change
 
A complex process approach to organisational change
A complex process approach to organisational changeA complex process approach to organisational change
A complex process approach to organisational change
 
Societal transformation
Societal transformationSocietal transformation
Societal transformation
 
Practitioner research as organisational change
Practitioner research as organisational changePractitioner research as organisational change
Practitioner research as organisational change
 
Discussion Anchoring ChangeThe end result of a successful chang
Discussion Anchoring ChangeThe end result of a successful changDiscussion Anchoring ChangeThe end result of a successful chang
Discussion Anchoring ChangeThe end result of a successful chang
 
Projects policy and digital literacy
Projects policy and digital literacyProjects policy and digital literacy
Projects policy and digital literacy
 
episodic and continuous change
episodic and continuous changeepisodic and continuous change
episodic and continuous change
 

More from CITE

Keynote 1: Teaching and Learning Computational Thinking at Scale
Keynote 1: Teaching and Learning Computational Thinking at ScaleKeynote 1: Teaching and Learning Computational Thinking at Scale
Keynote 1: Teaching and Learning Computational Thinking at ScaleCITE
 
Keynote 2: Social Epistemic Cognition in Engineering Learning: Theory, Pedago...
Keynote 2: Social Epistemic Cognition in Engineering Learning: Theory, Pedago...Keynote 2: Social Epistemic Cognition in Engineering Learning: Theory, Pedago...
Keynote 2: Social Epistemic Cognition in Engineering Learning: Theory, Pedago...CITE
 
Changing Technology Changing Practice: Empowering Staff and Building Capabili...
Changing Technology Changing Practice: Empowering Staff and Building Capabili...Changing Technology Changing Practice: Empowering Staff and Building Capabili...
Changing Technology Changing Practice: Empowering Staff and Building Capabili...CITE
 
Traditional Large Scale Educational Assessment and the Incorporation of Digit...
Traditional Large Scale Educational Assessment and the Incorporation of Digit...Traditional Large Scale Educational Assessment and the Incorporation of Digit...
Traditional Large Scale Educational Assessment and the Incorporation of Digit...CITE
 
Scaling up Assessment for Learning
Scaling up Assessment for LearningScaling up Assessment for Learning
Scaling up Assessment for LearningCITE
 
Analogy, Causality, and Discovery in Science: The engines of human thought
Analogy, Causality, and Discovery in Science: The engines of human thoughtAnalogy, Causality, and Discovery in Science: The engines of human thought
Analogy, Causality, and Discovery in Science: The engines of human thoughtCITE
 
Educating the Scientific Brain and Mind: Insights from The Science of Learnin...
Educating the Scientific Brain and Mind: Insights from The Science of Learnin...Educating the Scientific Brain and Mind: Insights from The Science of Learnin...
Educating the Scientific Brain and Mind: Insights from The Science of Learnin...CITE
 
Science of Learning — Why it matters to schools and families?
Science of Learning — Why it matters to schools and families?Science of Learning — Why it matters to schools and families?
Science of Learning — Why it matters to schools and families?CITE
 
Understanding the self through self bias
Understanding the self through self biasUnderstanding the self through self bias
Understanding the self through self biasCITE
 
The implementation of "Reading Battle" in Lam Tin Methodist Primary School
The implementation of "Reading Battle" in Lam Tin Methodist Primary SchoolThe implementation of "Reading Battle" in Lam Tin Methodist Primary School
The implementation of "Reading Battle" in Lam Tin Methodist Primary SchoolCITE
 
Strengthening students' reading comprehension ability (both Chinese and Engli...
Strengthening students' reading comprehension ability (both Chinese and Engli...Strengthening students' reading comprehension ability (both Chinese and Engli...
Strengthening students' reading comprehension ability (both Chinese and Engli...CITE
 
Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"
Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"
Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"CITE
 
Xiao Hu "Learning Analytics Initiatives"
Xiao Hu "Learning Analytics Initiatives"Xiao Hu "Learning Analytics Initiatives"
Xiao Hu "Learning Analytics Initiatives"CITE
 
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...CITE
 
Phil Winne "Learning Analytics for Learning Science When N = me"
Phil Winne "Learning Analytics for Learning Science When N = me"Phil Winne "Learning Analytics for Learning Science When N = me"
Phil Winne "Learning Analytics for Learning Science When N = me"CITE
 
Xiao Hu "Overview of the Space of Learning Analytics and Educational Data Min...
Xiao Hu "Overview of the Space of Learning Analytics and Educational Data Min...Xiao Hu "Overview of the Space of Learning Analytics and Educational Data Min...
Xiao Hu "Overview of the Space of Learning Analytics and Educational Data Min...CITE
 
Chi-Un Lei "Text Mining and Educational Discourse"
Chi-Un Lei "Text Mining and Educational Discourse"Chi-Un Lei "Text Mining and Educational Discourse"
Chi-Un Lei "Text Mining and Educational Discourse"CITE
 
Using Knowledge Forum (KF) for Scientific Inquiry: A Sharing of School Based ...
Using Knowledge Forum (KF) for Scientific Inquiry: A Sharing of School Based ...Using Knowledge Forum (KF) for Scientific Inquiry: A Sharing of School Based ...
Using Knowledge Forum (KF) for Scientific Inquiry: A Sharing of School Based ...CITE
 
以學生為中心的電子學習
以學生為中心的電子學習以學生為中心的電子學習
以學生為中心的電子學習CITE
 
透過維基平台優化特殊學校中家政科學與教
透過維基平台優化特殊學校中家政科學與教透過維基平台優化特殊學校中家政科學與教
透過維基平台優化特殊學校中家政科學與教CITE
 

More from CITE (20)

Keynote 1: Teaching and Learning Computational Thinking at Scale
Keynote 1: Teaching and Learning Computational Thinking at ScaleKeynote 1: Teaching and Learning Computational Thinking at Scale
Keynote 1: Teaching and Learning Computational Thinking at Scale
 
Keynote 2: Social Epistemic Cognition in Engineering Learning: Theory, Pedago...
Keynote 2: Social Epistemic Cognition in Engineering Learning: Theory, Pedago...Keynote 2: Social Epistemic Cognition in Engineering Learning: Theory, Pedago...
Keynote 2: Social Epistemic Cognition in Engineering Learning: Theory, Pedago...
 
Changing Technology Changing Practice: Empowering Staff and Building Capabili...
Changing Technology Changing Practice: Empowering Staff and Building Capabili...Changing Technology Changing Practice: Empowering Staff and Building Capabili...
Changing Technology Changing Practice: Empowering Staff and Building Capabili...
 
Traditional Large Scale Educational Assessment and the Incorporation of Digit...
Traditional Large Scale Educational Assessment and the Incorporation of Digit...Traditional Large Scale Educational Assessment and the Incorporation of Digit...
Traditional Large Scale Educational Assessment and the Incorporation of Digit...
 
Scaling up Assessment for Learning
Scaling up Assessment for LearningScaling up Assessment for Learning
Scaling up Assessment for Learning
 
Analogy, Causality, and Discovery in Science: The engines of human thought
Analogy, Causality, and Discovery in Science: The engines of human thoughtAnalogy, Causality, and Discovery in Science: The engines of human thought
Analogy, Causality, and Discovery in Science: The engines of human thought
 
Educating the Scientific Brain and Mind: Insights from The Science of Learnin...
Educating the Scientific Brain and Mind: Insights from The Science of Learnin...Educating the Scientific Brain and Mind: Insights from The Science of Learnin...
Educating the Scientific Brain and Mind: Insights from The Science of Learnin...
 
Science of Learning — Why it matters to schools and families?
Science of Learning — Why it matters to schools and families?Science of Learning — Why it matters to schools and families?
Science of Learning — Why it matters to schools and families?
 
Understanding the self through self bias
Understanding the self through self biasUnderstanding the self through self bias
Understanding the self through self bias
 
The implementation of "Reading Battle" in Lam Tin Methodist Primary School
The implementation of "Reading Battle" in Lam Tin Methodist Primary SchoolThe implementation of "Reading Battle" in Lam Tin Methodist Primary School
The implementation of "Reading Battle" in Lam Tin Methodist Primary School
 
Strengthening students' reading comprehension ability (both Chinese and Engli...
Strengthening students' reading comprehension ability (both Chinese and Engli...Strengthening students' reading comprehension ability (both Chinese and Engli...
Strengthening students' reading comprehension ability (both Chinese and Engli...
 
Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"
Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"
Gobert, Dede, Martin, Rose "Panel: Learning Analytics and Learning Sciences"
 
Xiao Hu "Learning Analytics Initiatives"
Xiao Hu "Learning Analytics Initiatives"Xiao Hu "Learning Analytics Initiatives"
Xiao Hu "Learning Analytics Initiatives"
 
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...
Tiffany Barnes "Making a meaningful difference: Leveraging data to improve le...
 
Phil Winne "Learning Analytics for Learning Science When N = me"
Phil Winne "Learning Analytics for Learning Science When N = me"Phil Winne "Learning Analytics for Learning Science When N = me"
Phil Winne "Learning Analytics for Learning Science When N = me"
 
Xiao Hu "Overview of the Space of Learning Analytics and Educational Data Min...
Xiao Hu "Overview of the Space of Learning Analytics and Educational Data Min...Xiao Hu "Overview of the Space of Learning Analytics and Educational Data Min...
Xiao Hu "Overview of the Space of Learning Analytics and Educational Data Min...
 
Chi-Un Lei "Text Mining and Educational Discourse"
Chi-Un Lei "Text Mining and Educational Discourse"Chi-Un Lei "Text Mining and Educational Discourse"
Chi-Un Lei "Text Mining and Educational Discourse"
 
Using Knowledge Forum (KF) for Scientific Inquiry: A Sharing of School Based ...
Using Knowledge Forum (KF) for Scientific Inquiry: A Sharing of School Based ...Using Knowledge Forum (KF) for Scientific Inquiry: A Sharing of School Based ...
Using Knowledge Forum (KF) for Scientific Inquiry: A Sharing of School Based ...
 
以學生為中心的電子學習
以學生為中心的電子學習以學生為中心的電子學習
以學生為中心的電子學習
 
透過維基平台優化特殊學校中家政科學與教
透過維基平台優化特殊學校中家政科學與教透過維基平台優化特殊學校中家政科學與教
透過維基平台優化特殊學校中家政科學與教
 

Recently uploaded

SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxiammrhaywood
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 
JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...
JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...
JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...anjaliyadav012327
 
The byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptxThe byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptxShobhayan Kirtania
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxGaneshChakor2
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfchloefrazer622
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3JemimahLaneBuaron
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfchloefrazer622
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room servicediscovermytutordmt
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 

Recently uploaded (20)

SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...
JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...
JAPAN: ORGANISATION OF PMDA, PHARMACEUTICAL LAWS & REGULATIONS, TYPES OF REGI...
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
The byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptxThe byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptx
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptx
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdf
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Disha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdfDisha NEET Physics Guide for classes 11 and 12.pdf
Disha NEET Physics Guide for classes 11 and 12.pdf
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room service
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 

Achieving Systemic eLearning Change: A Flight of Fancy or Realizable Reality?

  • 1. The University of Hong Kong Achieving Systemic eLearning Change: A Flight of Fancy or Realizable Reality Dr. Iain Doherty Associate Professor Director eLearning Pedagogical Support Unit Centre for the Enhancement of Teaching and Learning 9th May 2013
  • 2. Overview • Systemic Change • Socio-cultural Milieu • Change Management • Flight of Fancy of Realizable Reality? • Running the Risk of Failing to Change
  • 3. Systemic Change • Systemic change refers to change that effects an entity as a whole. In the case of an educational institution achieving systemic eLearning change necessarily entails some sort of fundamental shift in the nature of the institution. • However, it is not entirely clear what this shift would look like. For example, does systemic change involve change at all levels of the organization: people, processes, systems, structures, Faculties and Departments (Marshall, 2010)?
  • 4. Systemic Change • If systemic change does refer to change at all levels of the organization then what is the nature of the change at these different levels? • More specifically, what components or parts of the institution have to change in order for one to be able to say that there has been systemic change? • Finally, when we talk about systemic change are we talking about change in which the change as a whole is greater than the sum of the parts that led to the change?
  • 5. Socio-Cultural Milieu One way to answer the questions in the previous paragraph is to think of an institute of higher education as a socio-cultural milieu that can be deconstructed into component parts. These parts can then be analyzed in terms of their importance in the process of bringing about systemic eLearning change.
  • 6. Socio-Cultural Milieu • In this milieu there are people – the socio element – along with patterns of beliefs, behaviors, interactions and affective understandings – the cultural element – that are common to the members of the institution. The cultural element is learned through a process of socialization. • If we think about the complexity of the milieu then we can begin to understand just why it is so very challenging to achieve systemic institutional eLearning change.
  • 7. Socio-Cultural Milieu • An example should serve to illustrate the point made in the previous slides concerning complexity. • An institute of higher education consists of a “community” of individuals at various levels of seniority, with different responsibilities, varying attitudes, different career goals and a range of aspirations. In concrete terms the implementation of an eLearning strategy will mean something different both between groups and within groups.
  • 8. Socio-Cultural Milieu • A Vice Chancellor driving an eLearning strategy will be – or at least should be – firmly committed to realizing the strategic goals. The same should be true of the Pro-Vice Chancellors and the senior management team. Whilst we would ideally see the same commitment from other groups – Faculties, Departments, Centers etc. – the reality will likely be that the commitment of other groups and within the other groups will differ to one degree or another from that of the Senior Management.
  • 9. Socio-Cultural Milieu • Another equally important part of the strategy consists of addressing the cultural elements – beliefs, behaviours and interactions – of the institution. These beliefs, behaviours and interactions are instantiated across people, processes and documentation and it is important that an effort to achieve systemic eLearning change address the cultural norms of the institution.
  • 10. Socio-Cultural Milieu • Faculties, Departments, Centers etc. have to report periodically on their teaching. If these reports require an update on eLearning initiatives then, to some degree at least, eLearning becomes a part of the reporting culture within the institution. • Reporting per se will not bring about systemic eLearning change. It can however serve to progress the institution towards embedding eLearning within the institutional culture.
  • 11. Change Management • Having broken systemic change down into two component parts – social change and cultural change – we can see that a change management process is required (Kotter, 1995). • Uys (2007; 2010) has an enterprise wide change model that conceptualizes the change process as both top down and bottom up. From a top down perspective managers institute change and from a bottom up perspective the “workers” contribute to change.
  • 12. Change Management • However, this model misses the concept of “middle in” change. Middle in change can be thought of in terms of the “middle managers” who are in a position to influence the socio-cultural environment in which they work. • For example, Associate Deans Teaching and Learning could be considered as “middle management” and these Deans are in a position to influence the culture – the way that things are done – and the individuals who comprise the community.
  • 13. Change Management • Achieving systemic change involves a complex process of transforming the socio-cultural environment so that eLearning becomes simply a part of the way that things are done within an institution. • This raises the question whether aiming for systemic change is a flight of fancy of a realizable reality.
  • 14. Change Management • Kotter (1995) argues that transformation efforts tend to fail when there is an insufficient sense of urgency. • A sense of urgency can have many sources but one of the most potent drivers comes when there is a sense that “business” cannot continue as usual. • University business cannot continue as usual when something is perceived to be broken. • Even then effecting change is difficult.
  • 15. Flight of Fancy or Realizable Reality • Change is nigh on impossible in a university system that is perceived to have been operating “effectively” for decades (Katz, 2003). • In the absence of this sense of urgency we can suggest that aiming for systemic change is a flight of fancy because there is no “apparent” driver for disruptive change. • Does this mean that change is impossible? • Depends on the sort of change we have in mind.
  • 16. Flight of Fancy or Realizable Reality • Change can occur in the absence of a sense of urgency (Marshall, 2010). • In this case we are talking about a transformative change process that takes a top down, middle in and bottom up approach. • This sort of change process can be thought of as bringing about sustaining changes that improve the function of the organization in ways that are consistent with previous activities (Marshall, 2010).
  • 17. Flight of Fancy or Realizable Reality • Sustaining changes do not achieve systemic change. • We have to consider the possibility of “the emergence of new institutions ‘where the weight of history does not condition and constrain technology’s use’” (Katz, 2010, p.48). • In other words sustaining changes may simply not be enough. • Think what MOOCs might mean for the middle to lower tier universities.
  • 18. Flight of Fancy or Realizable Reality • We can understand the component parts of a university system. • We see complexity but we can adopt a planned approach to achieving change. • Problem is that there is no real sense that the system is broken. • Therefore systemic change does not occur. • Any particular organization might survive for a while but what are the long term risks?
  • 19. References • Katz, R. N. (2003). Balancing Technology and Tradition - The Example of Course Management Systems. Educause Review, 4(38), 49–59. Retrieved from http://net.educause.edu/ir/library/pdf/ERM0343.pdf • Kotter, J. P. (1995). Why Transformation Efforts Fail. Harvard Business Review, March/April(61), 59–67. Retrieved from http://hbr.org/2007/01/leading- change/ar/1
  • 20. References • Marshall, S. (2010). Change, Technology and Higher Education: Are Universities Capable of Organisational Change? ALT-J: Research in Learning Technology, 18(3), 179–192. Retrieved from http://www.informaworld.com/10.1080/09687769.2010.5 29107
  • 21. References • Uys, P.M. (2007). Enterprise-Wide Technological Transformation in Higher Education: The LASO Model. International Journal of Educational Management. Retrieved from http://www.globe- online.com/philip.uys/2006 08 uysLASOmodel.htm • Uys, Philip M. (2010). Implementing An Open Source Learning Management System : A Critical Analysis of Change strategies. Australasian Journal of Educational Technology, 26(7), 980–995. Retrieved from http://www.ascilite.org.au/ajet/ajet26/uys.pdf