Open.Michigan Badge Pilot Summary and FindingsUnless otherwise noted, this material is made available under the terms of the Creative CommonsAttribution License: http://creativecommons.org/licenses/by/3.0/
Purpose • Gain comments on the usability • See if there are any particular problems that need to be addressed • See if the OM community had any reservations about badges
Who Responded • 16 total non-staff participants o 5 Faculty o 5 Students o 3 Alumni o 3 Staff • Age range 24-64, with an average age of 35 (pretty even spread of ages through the range) • High to very high computer literacyPhoto attributions can be found at: http://open.umich.edu/about/alumni
What was discovered • Pilot group would like to receive more badges from Open.Michigan • Pilot group understood the purpose of badges • Pilot participants are interested in sharing their badges • Most participants were interested in posting their badges on their own sites, likely because of the higher tech proficiency of our population.
What could be improved • Ability to find badge assessment criteria • Ability to find other badges you could earn • Badge graphics • Badge Community Page • Link between badge and why person earned the badge
What could be improved• Making it more obvious that badges need to first be sent to the Mozilla backpack before they show up there (some people couldnt find their badges because they didnt send them over)• More clarity around profiles o "Im not sure if I have my badge "displayed" on the site. I published it to my account, but I dont know if that is the same as my profile. Since the page only has my username and my time since creating my account it doesnt really resonate as a profile. Some clarification around this is needed I think." o "I wish I could have a more robust profile where I could link to my own website or linkedin page." o "I wanted to edit my personal contact form, but my access was denied.• Better access to badges from the main pages o"Its difficult to figure out how to access the individual profiles from the main Open.Michigan page. I like the idea of a more active Open.Michigan community revolving around the badge system (or around which the badge system revolves). Right now, it doesnt seem easy to access it from the main page."
Open Questions • Most people said they were interested in earning the "Open Ally" badge. Why? o Do they believe they deserve it? o Are they motivated by it? • Most people found it easy to display their badge on the OM site while a good amount of people found it difficult to share their badges with Mozilla. Why? o Its easier to see/understand what happens when you share badge on OM site than it is to see the OBI backpack? o People misunderstood what we meant by "display your badge"?
Data: Overall Impression Overall, how do you like the badge that you received? •Minimum 2, Maximum 5, Average 3.79, SD 0.8 How easy to understand was the badge criteria page for your badge? •Minimum 2, Maximum 5, Average 4.13, SD 0.9 How easy to understand was the email informing you that you received a badge? •Minimum 2, Maximum 5, Average 4.31, SD 1.0
Data: Overall Impression Would you be interested in earning other badges from Open.Michigan? •No - 1 •Yes - 13 •Not Sure - 2 If you were to review our badge community page, what score would you give it out of 10? • Minimum 6, Maximum 8, Average 7.6
Data: SpecificsPlease indicate the extent to which you agree or disagree with the followingstatements:• I found my badge graphic to be appealing - Neutral/Agree o Minimum 2, Maximum 5, Average 3.69, SD 0.8• My badge correctly represents my work - Neutral/Agree o Minimum 2, Maximum 5, Average 3.81, SD 0.9• I would like to receive more badges from Open.Michigan - Agree o Minimum 3, Maximum 5, Average 4.13, SD 0.7• I am likely to share my badge with others - Depends o Minimum 1, Maximum 5, Average 3.75, SD 1.2• I dont understand the purpose of badges - Disagree o Minimum 1, Maximum 5, Average 2.31, SD 0.8• Badges have no impact on my work with OM - Depends o Minimum 1, Maximum 5, Average 3.19, SD 1.2
Data: Specifics - depends on what?** Very Very RoughlyIdentity• Faculty - may be more likely to share their badges than students butmay feel more strongly than students that badges do not impact their workat Open.MichiganAge• Older respondents (35+) tended to agree more with the statement"Badges have no impact on my work with OM" than younger respondents
Data: SpecificsHow easy was the badge system to use? Please rank the following:•Ability to see the badge community page - Easy o Minimum 3, Maximum 5, Average 3.9, SD 0.6•Ability to display your badge to the OM site - Easy o Minimum 3, Maximum 5, Average 4.1, SD 0.6•Ability to see your badges - Easy o Minimum 4, Maximum 5, Average 4.3, SD 0.4•Ability to find badge assessment criteria - Neutral o Minimum 2, Maximum 5, Average 3.6, SD 0.9•Ability to find other badges you could earn - Neutral o Minimum 2, Maximum 5, Average 3.8 , SD 0.94
Data: SharingWhere would you share?•Facebook - 10 yes•Personal Site - 12 yes•LinkedIn - 9 yes•Resume - 8 yes•Other - 1 suggestion (http://re.vu)
Data: Mozilla BackpackDo you think you are likely to use the Mozilla OBI Backpack?•No - 4•Yes - 10•I dont know - 2Were you able to access the Mozilla OBI Backpack•No - 1•Yes - 9•Not sure - 5How easy was the badge system to use? Particularly, the ability to share badges with theMozilla OBI Backpack. - Neutral•Minimum 1, Maximum 5, Average 3.40, SD 0.9