A Conceptual Model for e-Assessing Student Learning in Engineering Education                                        Rita F...
nt of student’s learning and e-learning. It will be focusing in Higher Educationlly in Engineering Education. The question...
Initial problemTo what extent e-assessment methods may beused to measure the achievement of LearningOutcomes in engineerin...
Research questions I• RQ1) Which type of Learning Outcomes in the  field of Engineering are relevant and should be  consid...
Learning OutcomesLearning outcomes are statements of what alearner is expected to know, understandand/or be able to demons...
Learning Outcomes in EESelection and description of LOs in EngineeringEducation   • ABET   • EUR-ACE   • CDIO   • EQF     ...
(e) AssessmentAssessment: Any procedure used to estimatestudent learning for whatever purpose. (Brown etal)e-Assessment is...
(e) Assessment methods• Multiple choice questions• Short Answer Questions• Problems• Essays• Practical work• Reflexive pra...
Research questions II• RQ3) What type of intended Learning  Outcomes can be measured by e- assessment  methods?• RQ4) Is i...
The ALIGNMENT question      Evaluation of the Application of e-Learning Methodologies to the Education of                 ...
Evaluation of the Application of e-Learning Methodologies to the Education of Engineering            Revised Bloom’s Taxon...
Some pilot tests of application were done using iLO at course level and QF level. It was found that atthe level of QF, mos...
le course usually has more that one iLO statement and more thns that one method may be assessing more than one iLO and th ...
Application of the modelScenarios                           Criteria   Verification of internal                           ...
Evaluate: critiquing                             Create: planning      Application to EUR-ACE         Table 43 - Complete ...
Example of case-study                  Table 54 - Alignment of LO2 with real assessment                    FACTUAL   CONCE...
Thank you!   Rita Falcao de Berredoritafalcaoberredo@gmail.com                 www.up.pt :: www.fe.up.pt
Upcoming SlideShare
Loading in …5
×

The ALOA model: assessment of Learning Outcomes

1,357 views

Published on

Presentation of the development process of the ALO conceptual model for aligning assessment and Learning Outcomes in Engineering education

Published in: Education, Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,357
On SlideShare
0
From Embeds
0
Number of Embeds
14
Actions
Shares
0
Downloads
14
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

The ALOA model: assessment of Learning Outcomes

  1. 1. A Conceptual Model for e-Assessing Student Learning in Engineering Education Rita Falcao Universidade do Porto :: FEUP Portugal ICL 2012 / IGIP 2012 :: Villach, Austria www.up.pt :: www.fe.up.pt
  2. 2. nt of student’s learning and e-learning. It will be focusing in Higher Educationlly in Engineering Education. The question of alignment of e-assessment and ed Field of studyed by the area where the three circles overlap. Learning! Outcomes! e0Learning Assessment! ! Figure 1 - Field of study www.up.pt :: www.fe.up.pt
  3. 3. Initial problemTo what extent e-assessment methods may beused to measure the achievement of LearningOutcomes in engineering education? www.up.pt :: www.fe.up.pt
  4. 4. Research questions I• RQ1) Which type of Learning Outcomes in the field of Engineering are relevant and should be considered?• RQ2) Which are the e-assessment methods that should be considered? www.up.pt :: www.fe.up.pt
  5. 5. Learning OutcomesLearning outcomes are statements of what alearner is expected to know, understandand/or be able to demonstrate aftercompletion of learning. (AHELO) www.up.pt :: www.fe.up.pt
  6. 6. Learning Outcomes in EESelection and description of LOs in EngineeringEducation • ABET • EUR-ACE • CDIO • EQF www.up.pt :: www.fe.up.pt
  7. 7. (e) AssessmentAssessment: Any procedure used to estimatestudent learning for whatever purpose. (Brown etal)e-Assessment is the use of ICT and the Internet inparticular for the assessment of learning,including design, delivery and/or recording ofresponses. (JISC) www.up.pt :: www.fe.up.pt
  8. 8. (e) Assessment methods• Multiple choice questions• Short Answer Questions• Problems• Essays• Practical work• Reflexive practice www.up.pt :: www.fe.up.pt
  9. 9. Research questions II• RQ3) What type of intended Learning Outcomes can be measured by e- assessment methods?• RQ4) Is it possible to propose specific e- assessment strategies for each type of LO in EE? www.up.pt :: www.fe.up.pt
  10. 10. The ALIGNMENT question Evaluation of the Application of e-Learning Methodologies to the Education of Statement!!of! the!intented! Learning!! Outcome! Learning! Outcome! Teaching!and! Learning! Assessment! Tasks! Ac=vi=es! Figure 10 - The same LO should be present in all:: www.fe.up.pt www.up.pt the activities
  11. 11. Evaluation of the Application of e-Learning Methodologies to the Education of Engineering Revised Bloom’s Taxonomy Table 22 - The Taxonomy Table by Anderson et al. The Knowledge The Cognitive dimension dimension 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create A. Factual knowledge B. Conceptual knowledge C. Procedural knowledge D. Meta-cognitive knowledgeThe• Taxonomy Table created by Anderson LOs ofplays aqualification frameworks of the Analyzing and describing the et al. the major role in the development • Analyzing the describing When approaching the conceptconceptual model inand current work. LOs from case-studies of writing iLOs statements,several authors refer the importance of including verbs that describe a measurable action so they canbe • Analyzing and describing assessment methods assessed [41, 42, 77]. The revised version of the taxonomy of Bloom and the Taxonomy Tableprovided the best solution for this problem. The cognitive dimension of the table is structured using • Aligning assessment and LOsverbs with detailed descriptions explaining their meaning. Verbs were carefully selected to matchcognitive processes and to be the ones used normally by teachers when:: www.fe.up.pt Additionally, www.up.pt stating the iLOs.
  12. 12. Some pilot tests of application were done using iLO at course level and QF level. It was found that atthe level of QF, most matrixes have a large number of cells filled. At course level, the distribution of The ALOA conceptual modelfilled cells is considerable more precise and easier to match with specific assessment methods. Thisrepresented another revision of the model where alignment was achieved at course level but could beinferred to the higher levels through existing matrixes. Figure 15 - Fourth and final version of the model www.up.pt :: www.fe.up.pt
  13. 13. le course usually has more that one iLO statement and more thns that one method may be assessing more than one iLO and th Alignmentthan one method. This multiplicity of possibilities is represented i Many!LO! Many!LOs! One! Many! Assessment! assessments! One!LO! One!LO! one! Many! assessment! assessment! www.up.pt :: www.fe.up.pt Figure 17 - Alignment possibilities for one unit or course
  14. 14. Application of the modelScenarios Criteria Verification of internal Match alignmentProposal of internal alignment Emphasis Vertical alignment Coverage Horizontal alignment Precision www.up.pt :: www.fe.up.pt
  15. 15. Evaluate: critiquing Create: planning Application to EUR-ACE Table 43 - Complete mapping of EUR-ACE programme outcomes to Blooms revised taxonomy. FACTUAL CONCEPTUAL PROCEDURAL METACOGNITIVEREMEMBER Recognizing 156 156 256 Recalling 156 156 256UNDERSTAND Interpreting 12456 Exemplifying Evaluation of the Application of e-Learning Methodologies to the Education of Engineering 15 Classifying 15 25 Summarizing 15 Inferring 1245 Comparing 15 Explaining 12456 25APPLY Executing 2 245 Implementing 2456 23456ANALYZE Differentiating 456 245104 Organizing 123456 2345 Attributing 6EVALUATE Checking 5 5 Critiquing 123456 235CREATE Generating 2345 35 Planning 23456 2345 Producing www.up.pt :: www.fe.up.pt
  16. 16. Example of case-study Table 54 - Alignment of LO2 with real assessment FACTUAL CONCEPTUAL PROCEDURAL METACOGNITIVERecognizing CS.02.DSYS.LO.02Recalling CS.02.DSYS.LO.02InterpretingExemplifyingClassifyingSummarizingInferring CS.02.DSYS.LO.02 CS.02.DSYS.LO.02Comparing CS.02.DSYS.LO.02 CS.02.DSYS.LO.02Explaining CS.02.DSYS.LO.02 CS.02.DSYS.LO.02ExecutingImplementingDifferentiatingOrganizingAttributingCheckingCritiquingGeneratingPlanningProducing www.up.pt :: www.fe.up.pt
  17. 17. Thank you! Rita Falcao de Berredoritafalcaoberredo@gmail.com www.up.pt :: www.fe.up.pt

×