Quality schemes in cooperative learning environments


Published on

The presentation reflects on systematic and continuous quality schemes in large-scale, online learning environments.
It also focus on the experiences with quality barometers and other quality enhancement tools and services at NKI Nettstudier – Scandinavia’s largest online education provider.

Published in: Education
1 Like
  • Be the first to comment

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Quality schemes in cooperative learning environments

  1. 1. Quality schemes in cooperative learning environments Morten Flate Paulsen Professor of Online Education A 50-minutes presentation at the International Scientific Conference on ICT and Education Montreal, May 2012http://twitter.com/MFPaulsen www.slideshare.net/MortenFPhttp://nettstudier.blogspot.com www.facebook.com/mfpaulsenhttp://home.nki.no/morten www.eden-online.org/blog/ 1
  2. 2. AbstractThe presentation will reflect on systematic andcontinuous quality schemes in large-scale,online learning environments.It will focus on the experiences with qualitybarometers and other quality enhancement toolsand services at NKI Nettstudier –Scandinavia’s largest online education provider. 2
  3. 3. About me• Worked with online education since 1986• Professor of Online Education at NKI Nettstudier , Norway• President of European Distance and E-learning Network (EDEN)• Doctor of Education from the Pennsylvania State University, working for the American Center for the Study of Distance Education (1990-1992)• Adjunct Professor Athabasca University (1999 to 2005)• Professor associado Universidade Aberta, Portugal (2009-2010) 3
  4. 4. www.eden-online.org• 20th anniversary in 2011, 8 in secretariat, 11 in EC• EDEN members from 400 institutions in 56 countries: – 20th anniversary – 200 institutional members – 2000 potential members of NAP – Network of Academics and Professionals• Conferences – Open Classroom conference ,Athens October 2011 – Annual conference, Porto June 2012 – Research Workshop, Leuven October 2012• EU-projects with 168 institutions• European Journal of Open, Distance and E-learning www.eurodl.org
  5. 5. EDEN-members in Canada• Athabasca University• Canadian Network for Innovation in Education – CNIE• Société de Formation a distance des Commissions Scolairs du Que 5
  6. 6. Annual Conferences 21. Oporto 2012Open Classroom 20. Dublin, 20119. Athens, 2011 19. Valencia, 20108. Oporto, 2009 18. Gdansk, 20097. Stockholm, 2007 17. Lisbon, 20086. Poitiers, 2005 16. Naples, 20075. Copenhagen, 2002 15. Vienna, 20064. Barcelona, 2000 14. Helsinki, 20053. Balatonfüred, 1999 13. Budapest, 20042. Crete, 1997 12. Rhodes, 20031. Oslo, 1995 11. Granada, 2002 10. Stockholm, 2001Research Workshops 8. Moscow, 19997. Leuven, 2012 7. Bologna, 19986. Budapest, 2010 6. Budapest, 19975. Paris, 2008 5. Poitiers, 19964. Barcelona, 2006 4. Birmingham, 19953. Oldenburg, 2004 3. Tallinn, 19942. Hildesheim, 2002 2. Berlin, 19931. Prague, 2000 1. Krakow, 1992 6
  7. 7. Planning for OsloEDEN’s Annual Conference, June 2013
  8. 8. November 2011NKI Nettstudier was established as a correspondence school in 1910• One of Europe’s largest providers of online distance education• About 150 000 enrolments in online courses since 1987• Broad range of subjects from secondary to master level• About 400 distance education courses online (all in Norwegian)• About 12 000 online students in about 40 countries• About 70 % women• Individual progress plans/individual follow-up• Thousands of potential learning partners• Global student catalogue with 1200 profiles• Always room for more students• Exams at local schools and embassies 8 www.nki.no
  9. 9. College, vocational- and secondary schoolPicture from: http://youtu.be/NXBNVauG9bE 9
  10. 10. 400 online coursesPicture from: http://youtu.be/NXBNVauG9bE 10
  11. 11. Focus on individual progress plans
  12. 12. Example of individual progress plan 12
  13. 13. NKI: A pioneer in Online Education1986: First LMS – specifically developed for distance learning1987: First online distance education course1992: Mandatory course for new NKI tutors on the Internet1996: First web-based courses2002: First m-learning courses2003: Speech synthesis in all courses2004: Individual planning system and individual follow upaccording to the student’s plan2004: Continuous tracking of turn-around time2006: Learning partner system2008: Global student profiles2010: Peer counselling system for tutors2011: Quality barometer for tutors and course materials 13
  14. 14. The most interesting pedagogical challenge in ourlifetime is to provide online education thatcombines individual freedom with meaningfulcooperation.I have struggled with this challenge since I firstintroduced my Theory of Cooperative Freedom in 1992.www.ednews.org/articles/10626/1/An-Interview-with-Morten-Flate-Paulsen-Focusing-on-His-T 14
  15. 15. Cooperative Freedom is discussed in my book Online Education which is available from http://issuu.com/mfpaulsen 15
  16. 16. More resources on Cooperative Freedom• Cooperative online education www.youtube.com/user/nki2008#p/a/u/2/HVXtbLg5ycE• Online education barometers www.youtube.com/watch?v=gyoe7dGIwkE&feature=relmfu• Transparency in Cooperative Online Education www.irrodl.org/index.php/irrodl/article/view/671/1267• E-viva em Portugal http://nettstudier.blogspot.com/• Cooperative Online Education http://seminar.net/index.php/volume-4-issue-2-2008-previousissuesmeny-124/100-cooperative-online-ed• Cooperative Freedom and Transparency in Online Education www.slideshare.net/MortenFP/futuralia-3400339• Visualizing student profiles www.slideshare.net/MortenFP/visualizing-student-profiles-through-nkis-online-catalogue-and-student-ne• Transparency for Cooperation http://toonlet.com/archive?m=s&i=11245
  17. 17. Six Dimensions of FreedomCompilation of resources made by my students at Universidade Aberta in Portugal It is difficult to combine individual flexibility and cooperation http://ppel4.pbworks.com/
  18. 18. One may say that:Individual learning is conducted alone Cooperative learning takes place in networks Connectivism? Collaborative learning depends on groups 18
  19. 19. NKI provides cooperative online education Independence with the help of others 19
  20. 20. Cooperative learning• Cooperative learning seeks to develop virtual learning environments that allow students to have optimal individual freedom within online learning communities.• Cooperative learning is based on voluntary participation in a learning community• Cooperative learning benefits from transparencyNKI’s Philosophy: We facilitate individual freedom within a learning community in which online students serve as mutual resources without being dependent on each other. 20
  21. 21. Tools and strategies to enhance qualityin a virtual learning environment with:• 12.500 students• 400 courses• 150 part-time teachers• 60 full-time employeesshould be systematic, continuous and cost-effective www.nki.no 21
  22. 22. Strategies and tools to enhance quality1. Large scale online education needs systematic, continuous and cost-effective quality measures2. Transparency improves quality3. Teacher Support Services4. Quality Barometers 22
  23. 23. Transparency or privacy? 23
  24. 24. 24
  25. 25. Transparency improves quality…of system data, course content, course work etc…. 25
  26. 26. Audio Journalism: Berghs School of Communication (Sweden)Video Journalism: UPDATE – Danish School of Media and Journalism Text Journalism: NKI Distance Education (Norway)
  27. 27. Transparency promotes cooperationDalsgaard, C. and Paulsen, M.F. (2009) Transparency in Cooperative O IRRODL, Vol 10, No 3. 27
  28. 28. Three degrees of transparency• Low: Private e-mail• Medium: Class forum• High: Global web2.0 servicesTransparency provides better quality and more cooperation, but both students and teachers should be comfortable with the chosen transparency level. 28
  29. 29. Online teachers deserve decent support services http://nettstudier.blogspot.com/2011/08/online-teachers-deserve-decent-support.html1992: Online course for online teachers 2010: Peer counseling and self-evaluation2004: Response Barometer 2011: Quality Barometer for Teachers 29
  30. 30. Response Barometer for Teachers• Introduced in May 2004• Resulted in much discussion in the teachers’ online forum• A few teachers voiced strong criticism, doubts and reservations The average response time for all In 2008 NKI introduced 150 teachers in 2010 was 1.77 days. an automatic e-mail reminder to the tutors who had one ore more assignments waiting for 7 days or more. 30
  31. 31. Barometer Questions1. What to measure?2. Which scale?3. Transparent for whom?4. Possible to show trends?5. What about Evaluation Moment, Frequency and Fatigue? 31
  32. 32. Online Education Barometers should have individual readingscooperative readings, aims,, warning levels and transparent feedback loops Ideal for Individual Start and Progression Transparent feedback to the right people 32
  33. 33. NKI’s Transparent: Quality Barometerfor Online Teachers
  34. 34. Evaluation IconAs soon as a teacher provides submission feedback and enters a grade, thefar right evaluation icon shows up in the planning tool at the student’sstart page.Click the box to open it.
  35. 35. Evaluation ButtonThe student has to evaluate the teacher to embed the grade.Click the evaluation button to open the teacher evaluation window.
  36. 36. Teacher Evaluation WindowChoose the teacher satisfaction level.The options from left to right are:Very dissatisfied, Dissatisfied,Neutral, Satisfied and Very Satisfied.Then enter some optional commentson the teacher’s work.The chosen satisfaction levelinfluences the Teacher QualityBarometer as soon as it issubmitted.After a random time delay foranonymity reasons, the teachers cansee the comments in their DetailsReport.
  37. 37. Teacher Quality Barometer Percentages shown in the teacher’s individual barometer and thecooperative barometer for all 140 teachers, are updated continuously as additional evaluations are submitted.The impressive barometer readings show the percentages of Very satisfied and Satisfied evaluations.After a random anonymity delay, the student’s comments are shown in the Teacher Details Report.
  38. 38. Teacher Details ReportExample of detailed quality report for a teacher including anonymous verbal comments. 38
  39. 39. NKI’s transparent Teacher Quality Barometer waslaunched in 2011 for further quality improvements atScandinavia’s leading online education provider.On September 7, NKI’s 12.000 online students started evaluating theirteachers.On October12, NKI’s 140 online teachers could access the onlineevaluation results.At the launch, 2000 evaluations were accrued and 88% wereeither Very satisfied or Satisfied.
  40. 40. Barometer Reading after 4017 Evaluations 2011Tutor quality barometer 40
  41. 41. Peer Evaluation of TeachersIn 2010, NKI introduced an online course structure for systematic peer evaluationamong all the teachers. Random feedback the teachers have given on studentsubmissions are sent to a colleague who evaluate it and give advice on possibleimprovements.Professor Torstein Rekkedal has conducted a survey among the first participants andconcluded that they perceive it as motivating and informative. They also reported thatthey learned at least as much from giving feedback as they did from receiving feedback.They will therefore both give and receive feedback on each others work in the future. 41
  42. 42. Teacher Self-evaluationLast school year, the majority of the teachers alsodelivered self-evaluation of one of the feedbacksthey gave on student assignments. The experienceswere so positive that future self-evaluation will beincluded in an online course structure in which theteachers will use the online submission system toevaluate their personal presentations, activity inforums and feedback on student submissions. 42
  43. 43. Star teachers deserve Golden Apples alongwith other stars who are awarded with goldmedals, Oscars and Grammies. Therefore,NKI has introduced a new, and hopefullysustainable, scheme for nominating andawarding NKI-teachers of the year. 43
  44. 44. Thank you I care, so I share:http://nettstudier.blogspot.com http://home.nki.no/morten https://twitter.com/MFPaulsen www.slideshare.net/MortenFP www.facebook.com/mfpaulsen www.eden-online.org/blog 44
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.