The document discusses a design-based research project that evaluated the use of peer assessment to promote quality in a blended learning context. The project was implemented over three years in a PhD module, with different online tools used each year (wiki, social networking site, content management system). Analysis found that peer assessment improved over the years, decreasing fears and increasing transparency. Students' perceptions of e-assessment also increased in positivity over time. While peer assessment contributed to self-reflection and a real assessment experience, the quality of feedback could still be improved with more training.

1. Peer assessment as a strategy to promote quality in a bLearning context:
a design-based approach
Peer assessment as a strategy to
promote quality in a bLearning context:
a design-based approach
Lúcia Pombo & Mª João Loureiro
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
CIDTFF, DE, Universidade de Aveiro

2. Peer assessment as a strategy to promote quality in a bLearning context:
a design-based approach
Topics
Context
Objective
Methodology
Conception/implementation
Analysis
Evaluation
Final thoughts
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
CIDTFF, DE, Universidade de Aveiro

3. Peer assessment as a strategy to promote quality in a bLearning context:
a design-based approach
context
PhD program in Multimedia in Education module
Distance Education (DE)
f2f and at a distance group work (bLearning)
module aim - develop research competences related with
literature review
search, select, systematize and synthesize literature related with DE
communication, collaborative work and assessment competences
(self- and peer- assessment)
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
CIDTFF, DE, Universidade de Aveiro

4. Peer assessment as a strategy to promote quality in a bLearning context:
a design-based approach
course
organization
Ramos (2004)
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
CIDTFF, DE, Universidade de Aveiro

5. Peer assessment as a strategy to promote quality in a bLearning context:
a design-based approach
Objective:
• to share an ongoing project
aiming to develop and evaluate
quality bLearning modules
Methodology:
•Design-based approach
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
CIDTFF, DE, Universidade de Aveiro

6. Peer assessment as a strategy to promote quality in a bLearning context:
a design-based approach
Conception/implementation
2008/09 (Wiki) 2010/11 (social networking) 2011/12 (CMS)
1st week -Closed individual -Open individual reflections (Ning) -Open individual reflections
reflections (googleDocs) (Drupal Group)
-Negotiation of the -Negotiation of the
assessment framework ( assessment framework
literature review) (literature review+
quality feedback)
2nd week -Open formative PA+Teachers
(paper’s structure)
3rd week -Open formative -Closed formative PA+Teachers -Open formative PA+Teachers
PA+Teachers (wiki) (GoogleDocs) (CMS+email)
(1st version) (1st version) (1st version)
4th week -Closed sumative -Closed sumative self+PA+Teachers -Closed sumative self+PA
self+PA+Teachers assessment (product & competences) (competences)+Teachers
assessment (product & assessment (product)
competences)
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
CIDTFF, DE, Universidade de Aveiro

7. Peer assessment as a strategy to promote quality in a bLearning context:
a design-based approach
Analysis
•Decrease the lack of confidence feelings
2
2011/1 and fear of exposing critical feedback
•Opportunity for better interiorization of
the assessment frameworks by re-using
them
1
2010/1
•Increase the transparency of the
assessment process – negotiation of
the assessment framework (end of 1st
9
2008/0 week)
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
CIDTFF, DE, Universidade de Aveiro

8. Peer assessment as a strategy to promote quality in a bLearning context:
a design-based approach
Evaluation
Students’ perceptions of e-
assessment
(Loureiro et al., 2011)
• increase positive
perceptions
(PA relevance increased)
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
CIDTFF, DE, Universidade de Aveiro

9. Peer assessment as a strategy to promote quality in a bLearning context:
a design-based approach
Evaluation
Adequacy of the final considerations
Fairness of the score
Provision of constructive feedback
Evaluation of PA
(suggestions for improvement) (Loureiro et al., 2012)
Provision of constructive feedback
(questions)
Provision of constructive feedback
(criticisms) • PA could be better
Adequacy of the chosen vocabulary (lack of criticism,
suggestions and questions)
Use of the negotiated criteria
0 20 40 60 80 100 %
2010/11
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
CIDTFF, DE, Universidade de Aveiro

10. Peer assessment as a strategy to promote quality in a bLearning context:
a design-based approach
Final thoughts
Quality of PA improved in the last year
“…a oportunidade de experimentarmos uma situação real de avaliação pelos pares…”
“…Relativamente à avaliação por pares, esta revelou-se uma boa estratégia, tanto nos
momentos em que avaliei como nos que fui avaliada, uma vez que contribui para
momentos auto-reflexivos sobre o trabalho desenvolvido.”
PA may improve Learning in bLearning contexts but...
it needs training
There are difficulties to manage personal and
professional agendas
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
CIDTFF, DE, Universidade de Aveiro

11. Peer assessment as a strategy to promote quality in a bLearning context:
a design-based approach
Thank you for your attention
questions???
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
CIDTFF, DE, Universidade de Aveiro

12. Peer assessment as a strategy to promote quality in a bLearning context:
a design-based approach
Criteria Indicators
Use of the negotiated Students used the negotiated criteria or words with the same
criteria significance explicitly.
Adequacy of the chosen
Concepts are used with rigour and differentiated.
vocabulary
PA text includes criticism (both positive and negative), pointing
criticisms
out aspects that could be improved, without making suggestions.
Provision of PA text presents questions for reflection concerning, for example,
questions
constructive the theme or the development of the literature review.
feedback suggestions PA text includes suggestions that can lead to the improvement of
for the literature review, like, new readings, proposing ways to
improvement systematize the corpus of the review....
the PA includes a score which should be in accordance with the
Fairness of the score
given feedback
Adequacy of the final A synthesis of the main positive and negative aspects of the
considerations review is presented.Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
Práticas de
CIDTFF, DE, Universidade de Aveiro

13. Peer assessment as a strategy to promote quality in a bLearning context:
a design-based approach
Práticas de Qualidade no Ensino e Aprendizagem – Pombo & Loureiro
CIDTFF, DE, Universidade de Aveiro