Tunde & JayeWhat we found:That there is no one tool that enables/enhances all 3 stages of the NGT processReference UoL work in curriculum development/supporting learning & teaching with project and examples
Enhancing Nominal Group Technique using technologies: a demonstration
Enhancing Nominal Group Technique using technologies: a demonstration (ID275) ALT-C 11-13 September 2012 Jaye McIsaac, Educational Development Tunde Varga-Atkins, eLearning Unit University of Liverpool ELESIG-funded project
OUTLINE• Introduction and purpose• What is the Nominal Group Technique?• What is the problem?• Technologies we tried
OUTCOMES• To describe the Nominal Group Technique (NGT) as a student feedback & evaluation tool.• To evaluate the use of learning technologies in the process of a face- to-face NGT session.• To consider the value of using technologies in online settings using NGT.
WHAT IS NOMINAL GROUP TECHNIQUE?• Structured group activity• One given topic• Facilitates group decision-making• Immediate results• Reduces researcher/participant bias - Delbecq & Van de Ven(1971)
NGT: STAGES Example question: ‘What would you change in your course?’1) Individual 2) Clarification and 3) Ranking responsesresponses consolidation
STAGE 1: WHAT TO KEEP DOING (FEEDBACK TO STUDENTS) 1 2 3 Annotated Model Audio ,personalised answers feedbac feedback. k giving extensive commen4 5 tsGiving Audio 6model feedback Drafts thatanswers for for must beessay titles everythin submitted g! and marked prior final work
STAGE 2 : WHAT TO KEEP DOING (FEEDBACK TO STUDENTS) Model answers 4 2 Giving Model model answers answers for essay titles Audio feedback Personalised3 Audio 5 6 Drafts that feedback feedbac Audio must be 1 k giving submitted Annotated feedback extensive for and marked ,personalise commen prior final feedback. everythin ts g! work
STAGE 3 : WHAT TO KEEP DOING (FEEDBACK) Item no. Item description5 points 1 Annotated, personalised feedback4 points 2 Giving model answers3 points 4 Audio feedback2 points 7 etc.1 point 10 etc.
THE TOP FIVE QUALITIES OF GOOD FEEDBACK1 Timing, quick Detailed, on how to 2 improve Applicable to future 3 work Personal 4 Consistent bw 5 markers
REFERENCES• Delbecq, A., Van de Ven, Andrew, & Gustafson, D. (1975). Group techniques for program planning a guide to nominal : group and Delphi processes. Glenview Ill.: Scott Foresman.• Luff et al (2007) Augmented Paper: Developing relationships between digital content and paper• Oliver, M. (2012) Learning with technology as a coordinated sociomaterial practice: digital literacies as a site of praxiological study• Varga-Atkins, McIsaac et al (2011) Using the nominal group technique with clickers to research student experiences of e- learning: a project report [http://slidesha.re/xQlBCg ]• Varga-Atkins, McIsaac et al (2011) The Nominal Group Technique – a practical guide for facilitators [http://slidesha.re/AmYOgv]