ID 164. Combatting survey fatigue:  uncovering the student learning        experience using the     Nominal Group Techniqu...
Outcomes•To consider the use of NominalGroup Technique as a studentevaluation strategy•To question the use (and concept)of...
HE context: surveys
One solution: face-to-face Nominal   Group Technique sessions
What is the   Nominal Group Technique?• Structured group activity• One given topic• Facilitates group  decision-making• Im...
Nominal Group Technique Stages  Example question: ‘What to keep doing (feedback)?’1) Individual responses       2) Clarifi...
What to keep doing? (feedback) Stage 1: individual responses               1                 2                 3          ...
What to keep doing? (feedback)Stage2 : clarification and consolidation                                Model answers       ...
What to keep doing? (feedback)     Stage3 : ranking responses            Item no.   Item description 5 points   1         ...
The top five qualities of good                 feedback1   Timing,    quick              Detailed,              on how to ...
Conclusion: The Nominal Group          Technique   is a useful student evaluation             technique
… (minor) problems of efficiency                   Credit by Nathan T. Baker
Can technology improve(time & resource) efficiency    of the NGT process?                   Presumption!
No single technology   could replicate all the 3 stages of        NGT.Technologies we tried: ID275, Thu 9am
and…
Our assumption:         Technology can          improve (time)      efficiency of the NGT             process.
revisited…   learning     + (evaluation)                     technology          =       efficiency          ?            ...
Paper                    Digital• ubiquitous          •   text entry• manipulabl          •   legibility  e               ...
Conclusion: can technology enhance     efficiency of the process?           •   ubiquitous           •   manipulable      ...
Finally…thanks toContact:  –Tünde Varga-Atkins, tva@liv.ac.uk  –Jaye McIsaac, jayem@liv.ac.uk
References• Delbecq, A., Van de Ven, Andrew, & Gustafson, D.  (1975). Group techniques for program planning  a    :  guide...
Guide to NGT & Project report                                                See References         On slideshare.net , se...
Upcoming SlideShare
Loading in …5
×

Combatting survey fatigue: uncovering the student learning experience using the

626
-1

Published on

Presentation given by Tunde Varga-Atkins and Jaye McIsaac at the University of Manchester, ALT-C 2012, Sep 11, 2012.

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
626
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Combatting survey fatigue: uncovering the student learning experience using the

  1. 1. ID 164. Combatting survey fatigue: uncovering the student learning experience using the Nominal Group Technique Tunde Varga-Atkins, eLearning Unit Jaye McIsaac, Educational Development University of Liverpool 11-13 Sep 2012, ALT-C Funded by ELESIG
  2. 2. Outcomes•To consider the use of NominalGroup Technique as a studentevaluation strategy•To question the use (and concept)of technology in relation to anevaluation process
  3. 3. HE context: surveys
  4. 4. One solution: face-to-face Nominal Group Technique sessions
  5. 5. What is the Nominal Group Technique?• Structured group activity• One given topic• Facilitates group decision-making• Immediate results• Reducing researcher/participant bias - Delbecq & Van de Ven (1971)
  6. 6. Nominal Group Technique Stages Example question: ‘What to keep doing (feedback)?’1) Individual responses 2) Clarification and 3) Ranking responses consolidation ‘Nominal’ Group = only in name group, most activities are individual
  7. 7. What to keep doing? (feedback) Stage 1: individual responses 1 2 3 Annotated Model Audio ,personalised answers feedback feedback. giving extensive comments4Giving model 5 Audio 6answers for feedback Drafts thatessay titles for must be everything! submitted and marked prior final work
  8. 8. What to keep doing? (feedback)Stage2 : clarification and consolidation Model answers 4 2 Giving model Model answers for answers essay titles Audio feedback Personalised feedbac 3 Audio 6 5 Drafts that feedback Audio must be 1 giving feedback submitted and Annotated extensive for marked prior ,personalised comments final work feedback. everything!
  9. 9. What to keep doing? (feedback) Stage3 : ranking responses Item no. Item description 5 points 1 Annotated, personalised feedback 4 points 2 Giving model answers 3 points 4 Audio feedback 2 points 7 etc. 1 point 10 etc.
  10. 10. The top five qualities of good feedback1 Timing, quick Detailed, on how to 2 improve Applicable to future 3 work Personal 4 Consistent bw 5 markers
  11. 11. Conclusion: The Nominal Group Technique is a useful student evaluation technique
  12. 12. … (minor) problems of efficiency Credit by Nathan T. Baker
  13. 13. Can technology improve(time & resource) efficiency of the NGT process? Presumption!
  14. 14. No single technology could replicate all the 3 stages of NGT.Technologies we tried: ID275, Thu 9am
  15. 15. and…
  16. 16. Our assumption: Technology can improve (time) efficiency of the NGT process.
  17. 17. revisited… learning + (evaluation) technology = efficiency ? Problem of lack of theorising technology (Oliver 2012)
  18. 18. Paper Digital• ubiquitous • text entry• manipulabl • legibility e • visibility• overlay • scoring• multi-items • manipulable• legible • multiitems• visible (Luff et al 2007)
  19. 19. Conclusion: can technology enhance efficiency of the process? • ubiquitous • manipulable • overlay • multi-items • text entry • legibility • visibility Image by Paul Duvall
  20. 20. Finally…thanks toContact: –Tünde Varga-Atkins, tva@liv.ac.uk –Jaye McIsaac, jayem@liv.ac.uk
  21. 21. References• Delbecq, A., Van de Ven, Andrew, & Gustafson, D. (1975). Group techniques for program planning  a : guide to nominal group and Delphi processes. Glenview Ill.: Scott Foresman.• Luff et al (2007) Augmented Paper: Developing relationships between digital content and paper• Oliver, M. (2012) Learning with technology as a coordinated sociomaterial practice: digital literacies as a site of praxiological study• Varga-Atkins, McIsaac et al (2011) Using the nominal group technique with clickers to research student experiences of e-learning: a project report [http://slidesha.re/xQlBCg ]• Varga-Atkins, McIsaac et al (2011) The Nominal Group Technique – a practical guide for facilitators [http://slidesha.re/AmYOgv]
  22. 22. Guide to NGT & Project report See References On slideshare.net , search for Nominal Group Technique
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×