Your SlideShare is downloading. ×
0
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
The ALOA model: assessment of Learning Outcomes
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

The ALOA model: assessment of Learning Outcomes

551

Published on

Presentation of the development process of the ALO conceptual model for aligning assessment and Learning Outcomes in Engineering education

Presentation of the development process of the ALO conceptual model for aligning assessment and Learning Outcomes in Engineering education

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
551
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
10
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. A Conceptual Model for e-Assessing Student Learning in Engineering Education Rita Falcao Universidade do Porto :: FEUP Portugal ICL 2012 / IGIP 2012 :: Villach, Austria www.up.pt :: www.fe.up.pt
  • 2. nt of student’s learning and e-learning. It will be focusing in Higher Educationlly in Engineering Education. The question of alignment of e-assessment and ed Field of studyed by the area where the three circles overlap. Learning! Outcomes! e0Learning Assessment! ! Figure 1 - Field of study www.up.pt :: www.fe.up.pt
  • 3. Initial problemTo what extent e-assessment methods may beused to measure the achievement of LearningOutcomes in engineering education? www.up.pt :: www.fe.up.pt
  • 4. Research questions I• RQ1) Which type of Learning Outcomes in the field of Engineering are relevant and should be considered?• RQ2) Which are the e-assessment methods that should be considered? www.up.pt :: www.fe.up.pt
  • 5. Learning OutcomesLearning outcomes are statements of what alearner is expected to know, understandand/or be able to demonstrate aftercompletion of learning. (AHELO) www.up.pt :: www.fe.up.pt
  • 6. Learning Outcomes in EESelection and description of LOs in EngineeringEducation • ABET • EUR-ACE • CDIO • EQF www.up.pt :: www.fe.up.pt
  • 7. (e) AssessmentAssessment: Any procedure used to estimatestudent learning for whatever purpose. (Brown etal)e-Assessment is the use of ICT and the Internet inparticular for the assessment of learning,including design, delivery and/or recording ofresponses. (JISC) www.up.pt :: www.fe.up.pt
  • 8. (e) Assessment methods• Multiple choice questions• Short Answer Questions• Problems• Essays• Practical work• Reflexive practice www.up.pt :: www.fe.up.pt
  • 9. Research questions II• RQ3) What type of intended Learning Outcomes can be measured by e- assessment methods?• RQ4) Is it possible to propose specific e- assessment strategies for each type of LO in EE? www.up.pt :: www.fe.up.pt
  • 10. The ALIGNMENT question Evaluation of the Application of e-Learning Methodologies to the Education of Statement!!of! the!intented! Learning!! Outcome! Learning! Outcome! Teaching!and! Learning! Assessment! Tasks! Ac=vi=es! Figure 10 - The same LO should be present in all:: www.fe.up.pt www.up.pt the activities
  • 11. Evaluation of the Application of e-Learning Methodologies to the Education of Engineering Revised Bloom’s Taxonomy Table 22 - The Taxonomy Table by Anderson et al. The Knowledge The Cognitive dimension dimension 1. Remember 2. Understand 3. Apply 4. Analyze 5. Evaluate 6. Create A. Factual knowledge B. Conceptual knowledge C. Procedural knowledge D. Meta-cognitive knowledgeThe• Taxonomy Table created by Anderson LOs ofplays aqualification frameworks of the Analyzing and describing the et al. the major role in the development • Analyzing the describing When approaching the conceptconceptual model inand current work. LOs from case-studies of writing iLOs statements,several authors refer the importance of including verbs that describe a measurable action so they canbe • Analyzing and describing assessment methods assessed [41, 42, 77]. The revised version of the taxonomy of Bloom and the Taxonomy Tableprovided the best solution for this problem. The cognitive dimension of the table is structured using • Aligning assessment and LOsverbs with detailed descriptions explaining their meaning. Verbs were carefully selected to matchcognitive processes and to be the ones used normally by teachers when:: www.fe.up.pt Additionally, www.up.pt stating the iLOs.
  • 12. Some pilot tests of application were done using iLO at course level and QF level. It was found that atthe level of QF, most matrixes have a large number of cells filled. At course level, the distribution of The ALOA conceptual modelfilled cells is considerable more precise and easier to match with specific assessment methods. Thisrepresented another revision of the model where alignment was achieved at course level but could beinferred to the higher levels through existing matrixes. Figure 15 - Fourth and final version of the model www.up.pt :: www.fe.up.pt
  • 13. le course usually has more that one iLO statement and more thns that one method may be assessing more than one iLO and th Alignmentthan one method. This multiplicity of possibilities is represented i Many!LO! Many!LOs! One! Many! Assessment! assessments! One!LO! One!LO! one! Many! assessment! assessment! www.up.pt :: www.fe.up.pt Figure 17 - Alignment possibilities for one unit or course
  • 14. Application of the modelScenarios Criteria Verification of internal Match alignmentProposal of internal alignment Emphasis Vertical alignment Coverage Horizontal alignment Precision www.up.pt :: www.fe.up.pt
  • 15. Evaluate: critiquing Create: planning Application to EUR-ACE Table 43 - Complete mapping of EUR-ACE programme outcomes to Blooms revised taxonomy. FACTUAL CONCEPTUAL PROCEDURAL METACOGNITIVEREMEMBER Recognizing 156 156 256 Recalling 156 156 256UNDERSTAND Interpreting 12456 Exemplifying Evaluation of the Application of e-Learning Methodologies to the Education of Engineering 15 Classifying 15 25 Summarizing 15 Inferring 1245 Comparing 15 Explaining 12456 25APPLY Executing 2 245 Implementing 2456 23456ANALYZE Differentiating 456 245104 Organizing 123456 2345 Attributing 6EVALUATE Checking 5 5 Critiquing 123456 235CREATE Generating 2345 35 Planning 23456 2345 Producing www.up.pt :: www.fe.up.pt
  • 16. Example of case-study Table 54 - Alignment of LO2 with real assessment FACTUAL CONCEPTUAL PROCEDURAL METACOGNITIVERecognizing CS.02.DSYS.LO.02Recalling CS.02.DSYS.LO.02InterpretingExemplifyingClassifyingSummarizingInferring CS.02.DSYS.LO.02 CS.02.DSYS.LO.02Comparing CS.02.DSYS.LO.02 CS.02.DSYS.LO.02Explaining CS.02.DSYS.LO.02 CS.02.DSYS.LO.02ExecutingImplementingDifferentiatingOrganizingAttributingCheckingCritiquingGeneratingPlanningProducing www.up.pt :: www.fe.up.pt
  • 17. Thank you! Rita Falcao de Berredoritafalcaoberredo@gmail.com www.up.pt :: www.fe.up.pt

×