The document discusses a study that aimed to develop and evaluate the use of peer assessment to promote quality in a blended learning context. The study was conducted within a PhD module that used blended learning and involved both face-to-face and distance group work. A design-based methodology was used to conceive, implement and analyze a peer assessment strategy. Analysis found that peer assessment improved over time and helped students better understand assessment frameworks, but difficulties remained in managing personal schedules within blended learning.
1. Peer assessment as a strategy to promote
quality in a bLearning context: a design-based
approach
Topics
Context
Objective
Methodology
Lisboa, 18 e 19.07.2013
Lúcia Pombo & Maria João Loureiro| lpombo@ua.pt; mjoao@ua.pt
Methodology
Conception/implementation
Analysis
Evaluation
Final thoughts
2. Peer assessment as a strategy to promote
quality in a bLearning context: a design-based
approach
context
PhD program in Multimedia in Education module
• Distance Education (DE)
• f2f and at a distance group work (bLearning)
Lisboa, 18 e 19.07.2013
Lúcia Pombo & Maria João Loureiro| lpombo@ua.pt; mjoao@ua.pt
module aim - develop research competences related with literature review
• search, select, systematize and synthesize literature related with DE
• communication, collaborative work and assessment competences
(self- and peer- assessment)
3. Peer assessment as a strategy to promote
quality in a bLearning context: a design-based
approachLisboa, 18 e 19.07.2013
Course organization
Ramos (2004)
Lúcia Pombo & Maria João Loureiro| lpombo@ua.pt; mjoao@ua.pt
4. Peer assessment as a strategy to promote
quality in a bLearning context: a design-based
approachLisboa, 18 e 19.07.2013
Objective:
• to share an ongoing
project aiming to
develop and evaluate
quality bLearning
Lúcia Pombo & Maria João Loureiro| lpombo@ua.pt; mjoao@ua.pt
quality bLearning
modules
Methodology:
• Design-based approach
5. Peer assessment as a strategy to promote
quality in a bLearning context: a design-based
approach
Conception/implementation
Lisboa, 18 e 19.07.2013
Lúcia Pombo & Maria João Loureiro| lpombo@ua.pt; mjoao@ua.pt
6. Peer assessment as a strategy to promote
quality in a bLearning context: a design-based
approach
Analysis
Lisboa, 18 e 19.07.2013
• Decrease the lack of confidence feelings
and fear of exposing critical feedback
• Opportunity for better interiorization of the
assessment frameworks by re-using them
Lúcia Pombo & Maria João Loureiro| lpombo@ua.pt; mjoao@ua.pt
assessment frameworks by re-using them
• Increase the transparency of the
assessment process – negotiation of the
assessment framework (end of 1st week)
7. Peer assessment as a strategy to promote
quality in a bLearning context: a design-based
approach
Evaluation
Lisboa, 18 e 19.07.2013
• Students’ perceptions of e-assessment
(Loureiro et al., 2011)
Lúcia Pombo & Maria João Loureiro| lpombo@ua.pt; mjoao@ua.pt
• Increase positive perceptions
(PA relevance increased)
8. Peer assessment as a strategy to promote
quality in a bLearning context: a design-based
approach
Evaluation
Lisboa, 18 e 19.07.2013
• Evaluation of PA
(Loureiro et al., 2012)
Provision of constructive feedback
Provision of constructive feedback
(suggestions for improvement)
Fairness of the score
Adequacy of the final considerations
Lúcia Pombo & Maria João Loureiro| lpombo@ua.pt; mjoao@ua.pt
• PA could be better
(lack of criticism, suggestions and questions)
%0 20 40 60 80 100
Use of the negotiated criteria
Adequacy of the chosen vocabulary
Provision of constructive feedback
(criticisms)
Provision of constructive feedback
(questions)
2010/11
9. Peer assessment as a strategy to promote
quality in a bLearning context: a design-based
approach
Final Thoughts
Quality of PA improved in the last year
“…a oportunidade de experimentarmos uma situação real de avaliação pelos pares…”
Lisboa, 18 e 19.07.2013
Lúcia Pombo & Maria João Loureiro| lpombo@ua.pt; mjoao@ua.pt
“…a oportunidade de experimentarmos uma situação real de avaliação pelos pares…”
“…Relativamente à avaliação por pares, esta revelou-se uma boa estratégia, tanto nos
momentos em que avaliei como nos que fui avaliada, uma vez que contribui para momentos
auto-reflexivos sobre o trabalho desenvolvido.”
PA may improve Learning in bLearning contexts but... it needs training
There are difficulties to manage personal and professional agendas
10. Peer assessment as a strategy to promote
quality in a bLearning context: a design-based
approach
Thank you for your attention
questions?
Lisboa, 18 e 19.07.2013
Lúcia Pombo & Maria João Loureiro| lpombo@ua.pt; mjoao@ua.pt
questions?
11. Peer assessment as a strategy to promote
quality in a bLearning context: a design-based
approachLisboa, 18 e 19.07.2013
Lúcia Pombo & Maria João Loureiro| lpombo@ua.pt; mjoao@ua.pt
12. Peer assessment as a strategy to promote
quality in a bLearning context: a design-based
approachLisboa, 18 e 19.07.2013
Lúcia Pombo & Maria João Loureiro| lpombo@ua.pt; mjoao@ua.pt