Assessment Portfolios: Answering Users’needs in a Sakai OAE Type Environment<br />Jacques Raynauld, Faculty, HEC Montréal ...
Overview<br />Short history – link to the community<br />Sakai OAE vs US<br />Portfolios and OSP :  the needs<br />Short D...
Context of the session<br />MATI Montréal is a research center for HEC Montréal, École polytechnique and University of Mon...
Context of the session<br />Activelyparticipated to the Sakai portfolio community<br />Presentation at the Sakai Denver Co...
Sakai OAE vs US<br />jQueryJavascript + widgets<br />TinyMCE free form editor<br />Sling REST API<br />noSQL back-end<br /...
Portfolios and OSP<br />Portfolios answermanyneeds: assessment and presentation (free-form)<br />Discussion over the year:...
Portfolios scenarios<br />Although the needs are similar, ourexperienceso far isthat all portfolios are slightlydifferent<...
Demo<br />8<br />
Simple demo – proof of concept<br />Playing the portfolio<br />Student<br />Tutor<br />Reports<br />Creatingformsusing ORB...
Demo<br />MATI portfolio Editor<br />OrbeonForm Server<br />Sling<br />EMaEval – CompetencyGradebook<br />Front-end GWT <b...
July 2009<br />10th Sakai Conference - Boston, MA, U.S.A.<br />12<br />All these entries are activities to beexecutedseque...
July 2009<br />10th Sakai Conference - Boston, MA, U.S.A.<br />13<br />Sakai OSP cell interface<br />
Key building blocks – a model-based approach to portfolios<br />14<br />
Key building blocks<br />Resources? Types? <br />Assembling the resources: creating activities<br />Views (matrices)<br />...
1. Resources<br />1. Resources<br />Text<br />Files (Power Point, PDF, Doc, videos, etc.)<br />URL<br />Comments<br />Form...
1. Resources<br />17<br />Learning outcomes/competencies<br />Civic knowledge & engagement (local & global)<br />Creativet...
1. Resources<br />18<br />Rubrics (forms)<br />Association of American Colleges and Universities<br />http://www.aacu.org/...
2. Assembling the resources<br />19<br />Organizing the resources according  to a model approach<br />Structure<br />Unit<...
2. Assembling the resources - OSP <br />20<br />Root<br />Structure<br />Competency 1<br />Porfolio<br />Unit<br />Context...
Competency 1<br />Instructions<br />Text file<br />Submit form<br />Form to submit the artefact (student)<br />Evaluation<...
4. Role<br />Very important -  in anylearningactivity, the student an be an editor, an evaluator, writecomments, etc.<br /...
5 - Workflow<br />Our workflow are codedmanuallyusingSling but playeddynamicallyplayed<br />Nextstep:  use a workflow stan...
6- Export<br />Vous have a project to export in the LEAP2A standard<br />12th Sakai Conference – Los Angeles, California –...
7. Reports and competencygradebook<br />EMaEvalis an open source environmentthatisspecialized for competencyevaluation (Pe...
6. Reports and competencygradebook<br />We are going to writespecialed Web services to leverage all the EMaEvalpossibiliti...
Road-map<br />Proof of concept isworking fine – weunderstand the wholechain<br />Small Pilot with the engineering school i...
Road-map<br />Weshould report on the variousexperiments<br />Any questions?  Comments?  Ideas?  <br />12th Sakai Conferenc...
Upcoming SlideShare
Loading in …5
×

Sakai11 la assessmentportfolio

968 views

Published on

Over the last year, the OSP community has done some interesting work on describing the portfolio requirements of an assessment scenario. It encompasses setting up learning/competency objectives, guiding students in the construction of artefacts, providing simple forms for rubrics-type feedback and evaluation and generating appropriate reports. In this presentation, we demonstrate a Sakai OAE type environment currently in development at MATI Montreal that addresses all these needs. Key to this work is the use of open source solutions for building forms, sequencing tasks, and generating reports using a unique competency gradebook.

Published in: Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
968
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Sakai11 la assessmentportfolio

  1. 1. Assessment Portfolios: Answering Users’needs in a Sakai OAE Type Environment<br />Jacques Raynauld, Faculty, HEC Montréal and MATI Montréal<br />
  2. 2. Overview<br />Short history – link to the community<br />Sakai OAE vs US<br />Portfolios and OSP : the needs<br />Short Demo of a proof of concept (activity)<br />Building blocks<br />CompetencyGradebook<br />Road-map<br />2<br />
  3. 3. Context of the session<br />MATI Montréal is a research center for HEC Montréal, École polytechnique and University of Montréal<br />Started a strategic initiative on guided- assessment portfolios in 2008 – manyschoolsinvolved<br />3<br />
  4. 4. Context of the session<br />Activelyparticipated to the Sakai portfolio community<br />Presentation at the Sakai Denver Conference : Learning portfolios : a structured approach<br />Choose a Sakai OAE type framework for development <br />Complementary …knowing that OAE team is working on free form portfolios (NYU)<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />4<br />
  5. 5. Sakai OAE vs US<br />jQueryJavascript + widgets<br />TinyMCE free form editor<br />Sling REST API<br />noSQL back-end<br />Google WebToolKitjavascriptwidgets<br />Model-based structural editor<br />Sling REST API<br />Jack-Rabbit<br />Slight interface differences<br />Use of external open source tools (ORBEON, EMaEval)<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />5<br />
  6. 6. Portfolios and OSP<br />Portfolios answermanyneeds: assessment and presentation (free-form)<br />Discussion over the year: personas, sce-narios,use cases mini-specsrevolvearound<br />Competency/learningoutcomes<br />Artefact construction by students<br />Reflection/Feedback<br />Rubric/Evaluation<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />6<br />
  7. 7. Portfolios scenarios<br />Although the needs are similar, ourexperienceso far isthat all portfolios are slightlydifferent<br />Need a very flexible tool!<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />7<br />
  8. 8. Demo<br />8<br />
  9. 9. Simple demo – proof of concept<br />Playing the portfolio<br />Student<br />Tutor<br />Reports<br />Creatingformsusing ORBEON<br />Creating the portfolio structure<br />CompetencygradebookEMaEval<br />9<br />
  10. 10. Demo<br />MATI portfolio Editor<br />OrbeonForm Server<br />Sling<br />EMaEval – CompetencyGradebook<br />Front-end GWT <br />To create and fillforms<br />Back-end – data persistence and workflow<br />Manage competencyframework, competencyrelatedtasks for students, tutors, <br />12th Sakai Conference – Los Angeles, California – June 14-16<br />10<br />Set of Web services thatlink the differenttools<br />
  11. 11.
  12. 12. July 2009<br />10th Sakai Conference - Boston, MA, U.S.A.<br />12<br />All these entries are activities to beexecutedsequentially by the actors<br />
  13. 13. July 2009<br />10th Sakai Conference - Boston, MA, U.S.A.<br />13<br />Sakai OSP cell interface<br />
  14. 14. Key building blocks – a model-based approach to portfolios<br />14<br />
  15. 15. Key building blocks<br />Resources? Types? <br />Assembling the resources: creating activities<br />Views (matrices)<br />Roles? Instructor, tutor, student<br />Workflow <br />Export<br />Reports and the competency gradebook<br />
  16. 16. 1. Resources<br />1. Resources<br />Text<br />Files (Power Point, PDF, Doc, videos, etc.)<br />URL<br />Comments<br />Forms<br />16<br />
  17. 17. 1. Resources<br />17<br />Learning outcomes/competencies<br />Civic knowledge & engagement (local & global)<br />Creativethinking<br />Criticalthinking<br />Ethicalreasoning & action<br />Foundations & skills for lifelonglearning<br />Information literacy<br />Inquiry & analysis<br />Integrativelearning<br />Interculturalknowledge & competence<br />Oral communication<br />Problemsolving<br />Quantitative literacy<br />Teamwork<br />Written communication<br />Association of American Colleges and Universities<br />http://www.aacu.org/<br />
  18. 18. 1. Resources<br />18<br />Rubrics (forms)<br />Association of American Colleges and Universities<br />http://www.aacu.org/<br />
  19. 19. 2. Assembling the resources<br />19<br />Organizing the resources according to a model approach<br />Structure<br />Unit<br />Context<br />Resources<br />Root<br />Structure<br />Unit<br />Context<br />Resource<br />
  20. 20. 2. Assembling the resources - OSP <br />20<br />Root<br />Structure<br />Competency 1<br />Porfolio<br />Unit<br />Context<br />Instructions<br />Text file<br />Year1<br />Resource<br /> Competency 1<br /> Competency 2<br />Submit form<br />Form to submit the artefact (student)<br />Year 2<br /> Competency 1<br /> Competency 2<br />Evaluation<br />Grading rubric form (tutor)<br />
  21. 21. Competency 1<br />Instructions<br />Text file<br />Submit form<br />Form to submit the artefact (student)<br />Evaluation<br />Grading rubric form (tutor)<br />3 - Matrice view<br />For us, matrices are a view (differentpresentation) of the information alreadyavailableelsewhere. <br />21<br />
  22. 22. 4. Role<br />Very important - in anylearningactivity, the student an be an editor, an evaluator, writecomments, etc.<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />22<br />
  23. 23. 5 - Workflow<br />Our workflow are codedmanuallyusingSling but playeddynamicallyplayed<br />Nextstep: use a workflow standard like XPDL and a workflowengine (Bonita)<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />23<br />
  24. 24. 6- Export<br />Vous have a project to export in the LEAP2A standard<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />24<br />
  25. 25. 7. Reports and competencygradebook<br />EMaEvalis an open source environmentthatisspecialized for competencyevaluation (Pentila – Savoie - usedextensively in France) <br />Competencyframework<br />List of competencyrelatedactivitieswithactorsinvolved<br />Tracks and saves the results<br />Can generate reports and certificates (accreditation) <br />12th Sakai Conference – Los Angeles, California – June 14-16<br />25<br />Highly flexible model basedapproach – cantackleverydifficults scenarios<br />
  26. 26. 6. Reports and competencygradebook<br />We are going to writespecialed Web services to leverage all the EMaEvalpossibilities<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />26<br />
  27. 27. Road-map<br />Proof of concept isworking fine – weunderstand the wholechain<br />Small Pilot with the engineering school in September (faculty of education?)<br />Numeroussmaller pilots withourmock-up engine<br />More stable and robust application nextyear<br />12th Sakai Conference – Los Angeles, California – June 14-16<br />27<br />
  28. 28. Road-map<br />Weshould report on the variousexperiments<br />Any questions? Comments? Ideas? <br />12th Sakai Conference – Los Angeles, California – June 14-16<br />28<br />

×