SlideShare a Scribd company logo
1 of 6
ALL ABOUT BADGES
HOW THEY WORK AT P2PU
•Background
•Badge Ecosystem
•Testing Our System:
 Empirical Research and UX
•Future of badges at P2PU
                             Vanessa Gennarelli
                             @mozzadrella
                             CC-BY
BACKGROUND

• P2PU: badgemakers
  since 2009
• Published a seminal
  whitepaper
• Webmaking 101: over
  1,000 learners
• Next milestone: Badge-
  issuing platform
                           Vanessa Gennarelli
                           @mozzadrella
                           CC-BY
BADGE ECOSYSTEM

                                                Require 1
                                                                  •3 types of
                                                                   badges
     Require
    evidence of                                 peer vote
     project...    Skill

                                                                  •Influenced
                  Badges               Community
   Gauge                                Badges Often used
 “how well”
 a peer has
                   Peers assess
                   on a rubric
                                                     for traits
                                                      (“Team
                                                                   by a
                                                                   gameful
accomplished                                         Player”)
   a task


                                  Stealth                          theory of
                                  Badges
                                                                   motivation
                         Awarded
                       automatically
                       by the system
TESTING OUR SYSTEM:
EMPIRICAL RESEARCH
•   Test our system through
    research projects

•   P2PU Labs

•   Research Questions

    •   Relationship between badges
        and participation

    •   Measure community activity
        around “accredited” versus
        “user-generated” badges
    •   How “open” to everyone is
        open ed?                      Vanessa Gennarelli
                                      @mozzadrella
                                      CC-BY
TESTING OUR SYSTEM: UX
RESEARCH
         •   Usability

             •   Badge creation
             •   Badge review

         •   Appeal & Learner Satisfaction

         •   Methods:
             •   Interviews

             •   Mental Model research
             •   Usertesting.com screencast testing

             •   Pre-launch click tests

             •   Post-launch A/B testing   Vanessa Gennarelli
                                           @mozzadrella
                                           CC-BY
FUTURE OF BADGES @P2PU
• Finishing up our plan for 3rd iteration of badges
• Looking at lessons learned and listening to
  critique

• Deploy our 3.0 in phases
 • New badge system
 • Assessment in cohorts
 • Learner trajectories
                                        Vanessa Gennarelli
                                        @mozzadrella
                                        CC-BY

More Related Content

Similar to Badges at P2PU

Exploring ux practices 4 product development agile2012
Exploring ux practices 4 product development agile2012Exploring ux practices 4 product development agile2012
Exploring ux practices 4 product development agile2012drewz lin
 
Recommender system introduction
Recommender system   introductionRecommender system   introduction
Recommender system introductionLiang Xiang
 
Creating creativity
Creating creativityCreating creativity
Creating creativityKreativeAsia
 
Understanding The Value Of User Research, Usability Testing, and Information ...
Understanding The Value Of User Research, Usability Testing, and Information ...Understanding The Value Of User Research, Usability Testing, and Information ...
Understanding The Value Of User Research, Usability Testing, and Information ...Kyle Soucy
 
Effective Prototyping Process for Software Creation
Effective Prototyping Process for Software CreationEffective Prototyping Process for Software Creation
Effective Prototyping Process for Software CreationJonathan Arnowitz
 
From Inspiration to Activation: Making Online Collaborative Communities Work
From Inspiration to Activation: Making Online Collaborative Communities WorkFrom Inspiration to Activation: Making Online Collaborative Communities Work
From Inspiration to Activation: Making Online Collaborative Communities WorkCommunitySense
 
It's Not Just About Code
It's Not Just About CodeIt's Not Just About Code
It's Not Just About CodeDan Pickett
 
Userzoom Webinar Monster Aug09
Userzoom Webinar Monster Aug09Userzoom Webinar Monster Aug09
Userzoom Webinar Monster Aug09Alfonso de la Nuez
 
Budget Usability without a Usability Budget
Budget Usability without a Usability BudgetBudget Usability without a Usability Budget
Budget Usability without a Usability Budgetjuliepia
 
Session1 methods research_question
Session1 methods research_questionSession1 methods research_question
Session1 methods research_questionmilolostinspace
 
Usability Testing
Usability TestingUsability Testing
Usability TestingJan Moons
 
Human and social computation
Human and social computation Human and social computation
Human and social computation Piero Fraternali
 
Stc tc open_documentation
Stc tc open_documentationStc tc open_documentation
Stc tc open_documentationJanet Swisher
 
Ronny lempelyahooindiabigthinkerapril2013
Ronny lempelyahooindiabigthinkerapril2013Ronny lempelyahooindiabigthinkerapril2013
Ronny lempelyahooindiabigthinkerapril2013Muthusamy Chelliah
 
Choosing the right crowd. Expert finding in social networks. edbt 2013
Choosing the right crowd. Expert finding in social networks. edbt 2013Choosing the right crowd. Expert finding in social networks. edbt 2013
Choosing the right crowd. Expert finding in social networks. edbt 2013Marco Brambilla
 
Mob Programming for Continuous Learning
Mob Programming for Continuous LearningMob Programming for Continuous Learning
Mob Programming for Continuous LearningMike Clement
 
User Experience Design Fundamentals - Part 2: Talking with Users
User Experience Design Fundamentals - Part 2: Talking with UsersUser Experience Design Fundamentals - Part 2: Talking with Users
User Experience Design Fundamentals - Part 2: Talking with UsersLaura B
 
Jmrx presentation on mro cs to cps ver2c日本語
Jmrx presentation on mro cs to cps ver2c日本語Jmrx presentation on mro cs to cps ver2c日本語
Jmrx presentation on mro cs to cps ver2c日本語Shigeru Kishikawa
 
Agile & UX What changes and other C.R.A.P.
Agile & UX What changes and other C.R.A.P.Agile & UX What changes and other C.R.A.P.
Agile & UX What changes and other C.R.A.P.LeanDog
 

Similar to Badges at P2PU (20)

Exploring ux practices 4 product development agile2012
Exploring ux practices 4 product development agile2012Exploring ux practices 4 product development agile2012
Exploring ux practices 4 product development agile2012
 
KW001
KW001KW001
KW001
 
Recommender system introduction
Recommender system   introductionRecommender system   introduction
Recommender system introduction
 
Creating creativity
Creating creativityCreating creativity
Creating creativity
 
Understanding The Value Of User Research, Usability Testing, and Information ...
Understanding The Value Of User Research, Usability Testing, and Information ...Understanding The Value Of User Research, Usability Testing, and Information ...
Understanding The Value Of User Research, Usability Testing, and Information ...
 
Effective Prototyping Process for Software Creation
Effective Prototyping Process for Software CreationEffective Prototyping Process for Software Creation
Effective Prototyping Process for Software Creation
 
From Inspiration to Activation: Making Online Collaborative Communities Work
From Inspiration to Activation: Making Online Collaborative Communities WorkFrom Inspiration to Activation: Making Online Collaborative Communities Work
From Inspiration to Activation: Making Online Collaborative Communities Work
 
It's Not Just About Code
It's Not Just About CodeIt's Not Just About Code
It's Not Just About Code
 
Userzoom Webinar Monster Aug09
Userzoom Webinar Monster Aug09Userzoom Webinar Monster Aug09
Userzoom Webinar Monster Aug09
 
Budget Usability without a Usability Budget
Budget Usability without a Usability BudgetBudget Usability without a Usability Budget
Budget Usability without a Usability Budget
 
Session1 methods research_question
Session1 methods research_questionSession1 methods research_question
Session1 methods research_question
 
Usability Testing
Usability TestingUsability Testing
Usability Testing
 
Human and social computation
Human and social computation Human and social computation
Human and social computation
 
Stc tc open_documentation
Stc tc open_documentationStc tc open_documentation
Stc tc open_documentation
 
Ronny lempelyahooindiabigthinkerapril2013
Ronny lempelyahooindiabigthinkerapril2013Ronny lempelyahooindiabigthinkerapril2013
Ronny lempelyahooindiabigthinkerapril2013
 
Choosing the right crowd. Expert finding in social networks. edbt 2013
Choosing the right crowd. Expert finding in social networks. edbt 2013Choosing the right crowd. Expert finding in social networks. edbt 2013
Choosing the right crowd. Expert finding in social networks. edbt 2013
 
Mob Programming for Continuous Learning
Mob Programming for Continuous LearningMob Programming for Continuous Learning
Mob Programming for Continuous Learning
 
User Experience Design Fundamentals - Part 2: Talking with Users
User Experience Design Fundamentals - Part 2: Talking with UsersUser Experience Design Fundamentals - Part 2: Talking with Users
User Experience Design Fundamentals - Part 2: Talking with Users
 
Jmrx presentation on mro cs to cps ver2c日本語
Jmrx presentation on mro cs to cps ver2c日本語Jmrx presentation on mro cs to cps ver2c日本語
Jmrx presentation on mro cs to cps ver2c日本語
 
Agile & UX What changes and other C.R.A.P.
Agile & UX What changes and other C.R.A.P.Agile & UX What changes and other C.R.A.P.
Agile & UX What changes and other C.R.A.P.
 

More from Vanessa Gennarelli

Coworking Well: Social Design for Learning
Coworking Well: Social Design for LearningCoworking Well: Social Design for Learning
Coworking Well: Social Design for LearningVanessa Gennarelli
 
Radically Learner-Centered: P2PU and Badges
Radically Learner-Centered: P2PU and BadgesRadically Learner-Centered: P2PU and Badges
Radically Learner-Centered: P2PU and BadgesVanessa Gennarelli
 
Getting the User-Generated Content You Want
Getting the User-Generated Content You WantGetting the User-Generated Content You Want
Getting the User-Generated Content You WantVanessa Gennarelli
 
Reflection: Old Skool and New Skool
Reflection: Old Skool and New SkoolReflection: Old Skool and New Skool
Reflection: Old Skool and New SkoolVanessa Gennarelli
 
The Birth of the Mechanical MOOC
The Birth of the Mechanical MOOCThe Birth of the Mechanical MOOC
The Birth of the Mechanical MOOCVanessa Gennarelli
 
Formative Evaluation for Educational Product Development
Formative Evaluation for Educational Product DevelopmentFormative Evaluation for Educational Product Development
Formative Evaluation for Educational Product DevelopmentVanessa Gennarelli
 
Design Research: Course Creation
Design Research: Course CreationDesign Research: Course Creation
Design Research: Course CreationVanessa Gennarelli
 
User Research: P2PU.org Home Page
User Research: P2PU.org Home PageUser Research: P2PU.org Home Page
User Research: P2PU.org Home PageVanessa Gennarelli
 
Sharing and status for Learning
Sharing and status for LearningSharing and status for Learning
Sharing and status for LearningVanessa Gennarelli
 

More from Vanessa Gennarelli (14)

Play With Your MOOC
Play With Your MOOCPlay With Your MOOC
Play With Your MOOC
 
Coworking Well: Social Design for Learning
Coworking Well: Social Design for LearningCoworking Well: Social Design for Learning
Coworking Well: Social Design for Learning
 
Radically Learner-Centered: P2PU and Badges
Radically Learner-Centered: P2PU and BadgesRadically Learner-Centered: P2PU and Badges
Radically Learner-Centered: P2PU and Badges
 
Getting the User-Generated Content You Want
Getting the User-Generated Content You WantGetting the User-Generated Content You Want
Getting the User-Generated Content You Want
 
Open for Impact
Open for ImpactOpen for Impact
Open for Impact
 
Reflection: Old Skool and New Skool
Reflection: Old Skool and New SkoolReflection: Old Skool and New Skool
Reflection: Old Skool and New Skool
 
The Birth of the Mechanical MOOC
The Birth of the Mechanical MOOCThe Birth of the Mechanical MOOC
The Birth of the Mechanical MOOC
 
Badge Spec for P2PU
Badge Spec for P2PUBadge Spec for P2PU
Badge Spec for P2PU
 
Formative Evaluation for Educational Product Development
Formative Evaluation for Educational Product DevelopmentFormative Evaluation for Educational Product Development
Formative Evaluation for Educational Product Development
 
2013 Update P2PU + Badges
2013 Update P2PU + Badges2013 Update P2PU + Badges
2013 Update P2PU + Badges
 
P2PU Course Creation 101
P2PU Course Creation 101P2PU Course Creation 101
P2PU Course Creation 101
 
Design Research: Course Creation
Design Research: Course CreationDesign Research: Course Creation
Design Research: Course Creation
 
User Research: P2PU.org Home Page
User Research: P2PU.org Home PageUser Research: P2PU.org Home Page
User Research: P2PU.org Home Page
 
Sharing and status for Learning
Sharing and status for LearningSharing and status for Learning
Sharing and status for Learning
 

Recently uploaded

1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdfQucHHunhnh
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfAdmir Softic
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...PsychoTech Services
 
social pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajansocial pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajanpragatimahajan3
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfsanyamsingh5019
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhikauryashika82
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphThiyagu K
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room servicediscovermytutordmt
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...christianmathematics
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Celine George
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Disha Kariya
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 

Recently uploaded (20)

1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
 
social pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajansocial pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajan
 
Sanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdfSanyam Choudhary Chemistry practical.pdf
Sanyam Choudhary Chemistry practical.pdf
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
9548086042 for call girls in Indira Nagar with room service
9548086042  for call girls in Indira Nagar  with room service9548086042  for call girls in Indira Nagar  with room service
9548086042 for call girls in Indira Nagar with room service
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 

Badges at P2PU

  • 1. ALL ABOUT BADGES HOW THEY WORK AT P2PU •Background •Badge Ecosystem •Testing Our System: Empirical Research and UX •Future of badges at P2PU Vanessa Gennarelli @mozzadrella CC-BY
  • 2. BACKGROUND • P2PU: badgemakers since 2009 • Published a seminal whitepaper • Webmaking 101: over 1,000 learners • Next milestone: Badge- issuing platform Vanessa Gennarelli @mozzadrella CC-BY
  • 3. BADGE ECOSYSTEM Require 1 •3 types of badges Require evidence of peer vote project... Skill •Influenced Badges Community Gauge Badges Often used “how well” a peer has Peers assess on a rubric for traits (“Team by a gameful accomplished Player”) a task Stealth theory of Badges motivation Awarded automatically by the system
  • 4. TESTING OUR SYSTEM: EMPIRICAL RESEARCH • Test our system through research projects • P2PU Labs • Research Questions • Relationship between badges and participation • Measure community activity around “accredited” versus “user-generated” badges • How “open” to everyone is open ed? Vanessa Gennarelli @mozzadrella CC-BY
  • 5. TESTING OUR SYSTEM: UX RESEARCH • Usability • Badge creation • Badge review • Appeal & Learner Satisfaction • Methods: • Interviews • Mental Model research • Usertesting.com screencast testing • Pre-launch click tests • Post-launch A/B testing Vanessa Gennarelli @mozzadrella CC-BY
  • 6. FUTURE OF BADGES @P2PU • Finishing up our plan for 3rd iteration of badges • Looking at lessons learned and listening to critique • Deploy our 3.0 in phases • New badge system • Assessment in cohorts • Learner trajectories Vanessa Gennarelli @mozzadrella CC-BY

Editor's Notes

  1. \n
  2. \n
  3. \n
  4. \n
  5. \n
  6. \n