“Tell me how you assessI ll tell you how youteach” Abrantes (1990)
A new assessment cultureEmerging from the growing criticism oftraditional testing methods relating tothe unrealistic nature of the tests, theloss of faith in them as valid measuresof learning, and an over-reliance ontests as the ultimategoal of the instructionprocess.
Assessment OF learningassessment focused on measurementand scaling
Assessment FOR learningassessment meantfor the students,through feedback,to understand theirown learningprocesses andthe goals that theyintend to achieve
From psychometrics to edumetricsEdumetrics criteria are recognized as more validand fair for competence based assessment, giventheir emphasis in flexibility and authenticity, aswell as their integration into the learning processvaluing the formative function of assessment
The challenge of e-assessment “Confusion of tongues”“e-assessment occurs when there is an automatedmarking/response to student input on-screen in atest, informing on the process of answering aquestion and providing feedback to learners andtheir teachers through well-crafted advice andreports”. (Beevers, 2010)“e-assessment is sometimes used to refer solelyto on-screen assessment but, in its broadestsense, can refer to all technology-enabledassessment activities”. (JISC, 2010)
e-assessment our definitione-assessment refers to all technology-enabledassessment activities where the design andstudent activities (complete, present, submit)must be mediated by technologies.It is regarded as optional the format in which theinstructor presents the assignment, as well asthe way feedback is provided@ssess – project financed through FCT (PTDC/CPE-CED/104373/2008)
Steps of an e-assessment strategy Student• design • classification• presentation • complete • feedback • present • submit Instructor Instructor must be mediated by technologies
e-assessment benefits (JISC, 2010)• Greater variety and authenticity in assessment designs• Improved learner engagement• Choice in the timing and location of assessments• Capture of wider skills and attributes• Efficient submission, marking, moderation and data storage• Consistent, accurate results• Increased opportunities for learners to act on feedback
Conceptual framework for e-assessment authenticity consistency e-assessment transparency practicability
Authenticity• Similarity – competeces needed in real/professioanl life• Complexity – cognitive chalenge• Adequacy – adequate performing conditions• Significance – value for students, instructors and employers
ConsistencyThis dimension emerges as an answer to thetraditional demands for validity and reliability,associated with psychometric indicators.• Instruction-assessment alignment• Relevant criteria• Competences-assessment alignment• Multiple indicators – assessment methods, contexts and assessors
Transparency• Democratization – availability and participation• Engagement – participation in the definition of the learning goals• Visibility – present/share processes and/or products• Impact – effect on the learning process and on course design
Practicability• Cost – time, digital resources, training, …• Efficiency• Sustainability – implement and sustain the proposed assessment design, taking into account the learner profiles and the contextual constraints, both for the organizations and for the assessors
DiscussionThese dimensions are articulated, representing severaldegrees of reciprocal interdependence.The criteria, more than just illustratingthe different features of each dimension,allow for the operational description ofeach criterion stage of implementation, and so contributeto the evaluation of the achieved assessment strategyquality level.
DiscussionWhat can be the contributions ofe-assessment for the assessment culture?How can e-assessment be usedfor internal improvement andexternal accreditation?From a research standpoint should alldimensions be regarded as equallyimportant?
Thank You! Gracias! Obrigado! I care so I sharehttp://www.slideshare.net/luistinoca firstname.lastname@example.org @luistinoca