OPEN BADGES
DISTRIBUTED ASSESSMENT
Prof. Dr. Ilona Buchem
Beuth University of Applied Sciences Berlin
@mediendidaktik
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
Photo: http://www.publicdomainpictures.net/
12 500 students
8 departments, 70 BA and MA programs
Member in Virtual Universities Association
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
RESEARCH & PROJECTS
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
Open Badges at Beuth University
Bachelor and master thesis about Open Badges
Qualification programs for migrants
Perceived
usefulness to
employers
Competency
assessment for
Open Badges
Design
requirements for
Open Badges
Policy
recommendations
for Open Badges
Policy
recommendations
from Germany
DACH Community
Output 1: Open Badge Network Framework & Leadership
Output 2: Open Badge Network Infrastructure
Output 3: Open Badges for Individuals & Organisations
Output 4: Open Badges in Territories
Output 5: Establishing Open Badges at Policy Levels
Output 6: European Open Badge Network
Output 7: Research, Evaluation and Quality
http://www.openbadgenetwork.com/
OPEN BADGE NETWORK / ERASMUS+
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
OPEN MOVEMENT - ACCESS REVOLUTION
Open Licence
(use of work)
Open Access
(research outputs)
Open Source
(source code)
1998
OpenContent
(David Wiley)
1998
2001
OpenCourseware
(MIT)
2001
Suber (2012)
2002
Open Edu Resources
(UNESCO)
2002
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
OPEN MOVEMENT - CREATIVE DISRUPTION
Open Learning
(community)
Open Coding
(skills)
2009
Broekman et al. (2014)
2011
Open Syllabus
(Jim Groom)
2010
MOOC
(Siemens & Downes)
20082007
Open Data
(knowledge)
Open Badges
(Mozilla)
2012
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
https://www.futurelearn.com
O
P
E
N
?
“After all, traditional college diplomas
look elegant when hung on the wall, but
they contain very little detail about what
the recipient learned.” (Young, 2012)
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
“The Web has blown documents apart. (…)
What once was literally a tightly bound
entity has been ripped into pieces and
thrown into the air.
-Weinberger (2003)
Small Pieces Loosely Joined. The unified theory of the Web.
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
REINVENTING (DIGITAL) CREDENTIALS
“Mozilla Open Badges are Web-enabled tokens of learning and accomplishment
Casilli & Hickey (2016)
Image: http://sportthieme.scene7.com/
Open Badges form a loose federation of many small digital credentials.
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
“ Mozilla Open Badges is an initiative exploring
alternative ways for learners to receive recognition
for skills and achievements gained outside of the
school environment, such as open credentialing
and accreditation for all types of learning, including
informal and interest driven.
-Knight & Casilli (2012)
Gamification
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
USING OPEN BADGES
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
Share in social
networks
Add to job
application Collect in
ePortfolio
Publish on a
blog / website
Foto: https://upload.wikimedia.org/wikipedia/commons/e/e9/Azerbajiani_landscape_-_Another_version.jpg
OBI is the underlying technology supporting badge issuing, collection, and display.
(1) OBI INTEROPERABILITY
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
(2) OPEN BADGES METADATA
Open Bades Technical Specification defines the metadata required for interoperability
Image: DigitalMe
“90% of the badge system is not visual”
Klein, J. (2013)
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
(2) OPEN BADGES METADATA
(3) OPEN BADGES USER HUB
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
(3) OPEN BADGES USER HUB
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
21ST CENTURY SKILLS
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
http://stratfordhigh.stratfordk12.org/images/customer-images/Misc/21st.PNG
Demand for skills continues to shift towards more sophisticated tasks requiring
Creativity, Communication, Collaboration and Critical thinking
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
https://www.buzzmath.com/badges#process-knowledge
FORMATIVE ASSESSMENT
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
Open Badges may be used to provide feedback on learning, outline
possible paths of progress and serve as artefacts for reflection
CRITERIA-BASED ASSESSMENT
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
Example / BESTR: https://bestr.it/badge/show/221
EVIDENCE-BASED ASSESSMENT
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
Example / OPEN BADGE ACADEMY: https://www.openbadgeacademy.com/badge/210
EVIDENCE-BASED ASSESSMENT
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
Example / OPEN BADGE ACADEMY: https://www.openbadgeacademy.com/badge/926
To earn this badge
you have to
write a self-report
EVIDENCE-BASED ASSESSMENT
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
Example / ST. LAWRENCE COLLEGE: http://www.slcbiz.ca/index.cfm/badges/communication-badges/communication-specialist-badge/
SKILLS DEMAND & OPEN BADGES
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
goal-setting
(e. g. by visualising which 21st
century skills matter, what criteria
need to be fulfilled for a particular
skill level)
identity-formation
(e. g. by warranting claims about
own 21st century skills as resources
and affirming or disaffirming these
claims by others)
reach of assessment
(e. g. by applying criteria from the
world of work and providing
multiple evidence in support of
claims of 21st century skills)
data transparency
(e. g. by making data about 21st
century skills available for learners,
educators, employers,
policy-makers)
Open Badges may be used to assess personal/individual skills but also to assess organisational/system
performance, e.g. education systems, workplace practices and policies in developing 21st century skills.
Project website: beuthbonus.beuth-hochschule.de
• employment
• IT-related fields
• STEM degrees
• 50% female/male
Qualification
program
for migrant
academics
Goals:
QUALIFICATION PROGRAM FOR MIGRANTS
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
IQ Network
Integration though Qualification
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
DESIGN OF ASSESSMENT
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
5. Evidence-based
assessment
ASSESS
CONCEPT
1. Conceptual
design
DESIGN
2. Visual & textual
design
DISPLAY
3. Displaying
available badges
ISSUE
6. Issuing/earning
badges
Beuth
Bonus
Badges
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
EVIDENCE
4. Submit evidence
BEUTH BONUS PROGRAM
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
BEUTH BONUS PROGRAM
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
DISTRIBUTED ASSESSMENT
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
Evidence #1
Test results from
the university
Evidence #2
Testimonials from
clients/colleagues
Evidence #3
Interview results
from a coach
Evidence #4
Self-report /
ePortfolio
Evidence #5
Activities in
social media
Evidence #6
Endorsement from
employer
Distributed assessment is multi-perspective, negotiable and learner-driven!
Open Badges can help
learners to connect
diverse
learning contexts,
learning episodes,
learning outcomes,
by assembling
learning evidence
and creating
learning pathways.
LEARNING PATHWAYS
Casilli (2013)
#ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
“ Thank you!
@mediendidaktik
@OpenBadgeNet
#OpenBadges

Open Badges for Distributed Assessment

  • 1.
    OPEN BADGES DISTRIBUTED ASSESSMENT Prof.Dr. Ilona Buchem Beuth University of Applied Sciences Berlin @mediendidaktik #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA Photo: http://www.publicdomainpictures.net/
  • 2.
    12 500 students 8departments, 70 BA and MA programs Member in Virtual Universities Association #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 3.
    RESEARCH & PROJECTS #ECTEL2016| UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA Open Badges at Beuth University Bachelor and master thesis about Open Badges Qualification programs for migrants Perceived usefulness to employers Competency assessment for Open Badges Design requirements for Open Badges Policy recommendations for Open Badges Policy recommendations from Germany DACH Community
  • 4.
    Output 1: OpenBadge Network Framework & Leadership Output 2: Open Badge Network Infrastructure Output 3: Open Badges for Individuals & Organisations Output 4: Open Badges in Territories Output 5: Establishing Open Badges at Policy Levels Output 6: European Open Badge Network Output 7: Research, Evaluation and Quality http://www.openbadgenetwork.com/ OPEN BADGE NETWORK / ERASMUS+ #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 5.
    OPEN MOVEMENT -ACCESS REVOLUTION Open Licence (use of work) Open Access (research outputs) Open Source (source code) 1998 OpenContent (David Wiley) 1998 2001 OpenCourseware (MIT) 2001 Suber (2012) 2002 Open Edu Resources (UNESCO) 2002 #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 6.
    OPEN MOVEMENT -CREATIVE DISRUPTION Open Learning (community) Open Coding (skills) 2009 Broekman et al. (2014) 2011 Open Syllabus (Jim Groom) 2010 MOOC (Siemens & Downes) 20082007 Open Data (knowledge) Open Badges (Mozilla) 2012 #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 7.
    https://www.futurelearn.com O P E N ? “After all, traditionalcollege diplomas look elegant when hung on the wall, but they contain very little detail about what the recipient learned.” (Young, 2012) #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 8.
    “The Web hasblown documents apart. (…) What once was literally a tightly bound entity has been ripped into pieces and thrown into the air. -Weinberger (2003) Small Pieces Loosely Joined. The unified theory of the Web. #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 9.
    REINVENTING (DIGITAL) CREDENTIALS “MozillaOpen Badges are Web-enabled tokens of learning and accomplishment Casilli & Hickey (2016) Image: http://sportthieme.scene7.com/ Open Badges form a loose federation of many small digital credentials. #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 10.
    “ Mozilla OpenBadges is an initiative exploring alternative ways for learners to receive recognition for skills and achievements gained outside of the school environment, such as open credentialing and accreditation for all types of learning, including informal and interest driven. -Knight & Casilli (2012) Gamification #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 11.
    USING OPEN BADGES #ECTEL2016| UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA Share in social networks Add to job application Collect in ePortfolio Publish on a blog / website Foto: https://upload.wikimedia.org/wikipedia/commons/e/e9/Azerbajiani_landscape_-_Another_version.jpg
  • 12.
    OBI is theunderlying technology supporting badge issuing, collection, and display. (1) OBI INTEROPERABILITY #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 13.
    (2) OPEN BADGESMETADATA Open Bades Technical Specification defines the metadata required for interoperability Image: DigitalMe “90% of the badge system is not visual” Klein, J. (2013) #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 14.
    #ECTEL2016 | UNIVERSITYJEAN MOULIN LYON | 16-09-2016 | CC BY-SA (2) OPEN BADGES METADATA
  • 15.
    (3) OPEN BADGESUSER HUB #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 16.
    (3) OPEN BADGESUSER HUB #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 17.
    21ST CENTURY SKILLS #ECTEL2016| UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA http://stratfordhigh.stratfordk12.org/images/customer-images/Misc/21st.PNG Demand for skills continues to shift towards more sophisticated tasks requiring Creativity, Communication, Collaboration and Critical thinking
  • 18.
    #ECTEL2016 | UNIVERSITYJEAN MOULIN LYON | 16-09-2016 | CC BY-SA https://www.buzzmath.com/badges#process-knowledge
  • 19.
    FORMATIVE ASSESSMENT #ECTEL2016 |UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA Open Badges may be used to provide feedback on learning, outline possible paths of progress and serve as artefacts for reflection
  • 20.
    CRITERIA-BASED ASSESSMENT #ECTEL2016 |UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA Example / BESTR: https://bestr.it/badge/show/221
  • 21.
    EVIDENCE-BASED ASSESSMENT #ECTEL2016 |UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA Example / OPEN BADGE ACADEMY: https://www.openbadgeacademy.com/badge/210
  • 22.
    EVIDENCE-BASED ASSESSMENT #ECTEL2016 |UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA Example / OPEN BADGE ACADEMY: https://www.openbadgeacademy.com/badge/926 To earn this badge you have to write a self-report
  • 23.
    EVIDENCE-BASED ASSESSMENT #ECTEL2016 |UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA Example / ST. LAWRENCE COLLEGE: http://www.slcbiz.ca/index.cfm/badges/communication-badges/communication-specialist-badge/
  • 24.
    SKILLS DEMAND &OPEN BADGES #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA goal-setting (e. g. by visualising which 21st century skills matter, what criteria need to be fulfilled for a particular skill level) identity-formation (e. g. by warranting claims about own 21st century skills as resources and affirming or disaffirming these claims by others) reach of assessment (e. g. by applying criteria from the world of work and providing multiple evidence in support of claims of 21st century skills) data transparency (e. g. by making data about 21st century skills available for learners, educators, employers, policy-makers) Open Badges may be used to assess personal/individual skills but also to assess organisational/system performance, e.g. education systems, workplace practices and policies in developing 21st century skills.
  • 25.
    Project website: beuthbonus.beuth-hochschule.de •employment • IT-related fields • STEM degrees • 50% female/male Qualification program for migrant academics Goals: QUALIFICATION PROGRAM FOR MIGRANTS #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 26.
    IQ Network Integration thoughQualification #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 27.
    DESIGN OF ASSESSMENT #ECTEL2016| UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA 5. Evidence-based assessment ASSESS CONCEPT 1. Conceptual design DESIGN 2. Visual & textual design DISPLAY 3. Displaying available badges ISSUE 6. Issuing/earning badges Beuth Bonus Badges #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA EVIDENCE 4. Submit evidence
  • 28.
    BEUTH BONUS PROGRAM #ECTEL2016| UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 29.
    BEUTH BONUS PROGRAM #ECTEL2016| UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 30.
    DISTRIBUTED ASSESSMENT #ECTEL2016 |UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA Evidence #1 Test results from the university Evidence #2 Testimonials from clients/colleagues Evidence #3 Interview results from a coach Evidence #4 Self-report / ePortfolio Evidence #5 Activities in social media Evidence #6 Endorsement from employer Distributed assessment is multi-perspective, negotiable and learner-driven!
  • 31.
    Open Badges canhelp learners to connect diverse learning contexts, learning episodes, learning outcomes, by assembling learning evidence and creating learning pathways. LEARNING PATHWAYS Casilli (2013) #ECTEL2016 | UNIVERSITY JEAN MOULIN LYON | 16-09-2016 | CC BY-SA
  • 32.