2011 04 12 (uned) emadrid igutierrez uc3m estandares especificaciones evaluacion orientada competencias
Upcoming SlideShare
Loading in...5
×
 

2011 04 12 (uned) emadrid igutierrez uc3m estandares especificaciones evaluacion orientada competencias

on

  • 981 views

2011 04 12

2011 04 12
(uned)
emadrid
igutierrez
uc3m
estandares especificaciones evaluacion orientada competencias

Statistics

Views

Total Views
981
Views on SlideShare
584
Embed Views
397

Actions

Likes
0
Downloads
7
Comments
0

4 Embeds 397

http://www.emadridnet.org 388
https://www.gast.it.uc3m.es 4
http://webcache.googleusercontent.com 3
http://www.gast.it.uc3m.es 2

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

2011 04 12 (uned) emadrid igutierrez uc3m estandares especificaciones evaluacion orientada competencias 2011 04 12 (uned) emadrid igutierrez uc3m estandares especificaciones evaluacion orientada competencias Presentation Transcript

  • Open Standards and Specifications for Outcome-based Assessment
    Israel Gutiérrez
    Universidad Carlos III de Madrid
    Madrid, April 12th 2010
  • Standards and Specifications
  • Computer-based assessment
    Reduce effort and costs: permit continuous assessment
    Assessment re-use: interoperability needed
    Variety of assessment formats
    Proprietary: MoodleXML, HotPotatoes, Blackboard
    Ad hoc: OpenMark
    IMS QTI
    Open Standards and Specifications for Assessment
  • Outcome-based Assessment
    Universities developing an outcome-based learning strategy
    Adaptation to European Space for Higher Education
    Improve course structure for accreditation (ABET)
    Creation of new courses
    Learning outcomes
    Assessment as a key process
  • Outline
    Analysis of assessment standards and specifications
    Usage of assessment formats in Europe
    Interoperability issues
    Next generation assessment scenarios
    Best practices
  • Methodology
    Analysis of Assessment Standards and Specifications
    Metamodels (UML diagrams) from MDA
    Understand better studied formats
    Abstraction from syntax (XML binding)
    Focus on content
  • Studied Assessment Formats
    Assessment purpose
    General purpose
    IMS QTI
    FML
    OpenMark
    SuML
    QAML
  • Qualitative Comparison
    Key features
    Multiple response allowance
    Correct response indication
    Metadata capabilities
    Hybrid question management
    Question types (from FREMA)
    Constructed: essay, short answer, FIB, etc.
    Constrained: MCQ, MRQ, TF, matching, etc.
    Miscellaneous: simulations, practical sessions
  • Assessment Formats Comparison
  • Project results: WP6
    Assessment Formats Usage in Europethe current picture – methodology and sample description
    • Data collection
    • Personal interview
    • In-depthreport
    • Qualitativeanalysis
    • Samplecharacteristics
    • Highereducation
    • Multicultural
    • Multilingual
    Sample size
  • Geographical Distribution
  • Assessment Formats Study: Resultsthe current picture – key conclusions
    • Scarce re-use of assessment resources
    • Scarce acceptance of IMS QTI specification
    • High technological diversity
    • LMS, ad-hoc tools, etc.
    • Diversity of assessment methodologies
    • formative/summative, various types of activities, face-to-face/blended/elearning settings, etc.
  • Interoperability Issues: IMS QTI
    Scarce use of the specification
    Incomplete support in LMS
    i.e. adaptive material
    Flexibility handicaps
    QTI profiles
    Versions instability: 1.2.1 or 2.1?
    Versions are not backwards compatible
  • Assessment Interoperability
    Moodle
    QTIlrn
    QTIclix
    QTIexport
    QTIMoodle
    QTI 1.2.1
    QTI 1.2.1
    QTI 1.2.1
    .LRN
    Clix
  • Next Generation Assessment Scenarios
    • Hints
    • Adaptation
    • Instructional design
  • Assessment Resources Interoperability Proposal
    Assessment resources
  • Objective: Gather and develop best practices about interoperable content as support to higher education and learning outcome oriented
    Results
    • ICOPER Reference Model
    • Gathering of recommendations
    • Open ICOPER Content Space
    • One of the most successful eContent+ projects since 2004
  • Open ICOPER Content Space
    • Federated repository of educational resources
  • Outcome-based Assessment App
    Use cases
    Search for assessment resources in a repository
    Filter by intended learning outcomes
    Filter by assessment methods
    Import/re-use of assessment resources
    Publish/share assessment resources
    Online demo: http://mozart.gast.it.uc3m.es:9000/
  • Outcome-based Assessment App
    Use cases (cont.)
    Annotate assessment resources
    Peer review
    Teacher reflection
    Student feedback
    Update learner’s profile
    Stakeholders
    Faculty members
    Course developers
    Online demo: http://mozart.gast.it.uc3m.es:9000/
  • Outcome-based Assessment App
    Learningoutcome-based search
    Implementation for dotLRN
    based on ICOPER LOM profile
    Learningoutcome profile update
  • Outcome-based Assessment App: Evaluation
    Engineering evaluation
    Implementers
    Tool developers
    End user evaluation
    Faculty members
    Course developers
    Epistemological evaluation
    Researchers
    Standardization bodies
  • ICOPER Assessment app
    Assessment resources should include information about
    Intended learning outcomes
    Recommended assessment methods
    Annotations about resources
    Usage of integrated environment for outcome-based assessment
  • Best Practices for Assessment
  • Thank you for your attention!
    http://www.it.uc3m.es/igrojas/index.html
    igutierrez@inv.it.uc3m.es