Download as PDF, PPTX
Uploaded byNegar Khalandi
SNS Dash
The document summarizes a usability study conducted on the social networking site Dash. 26 students participated in the study, which involved completing 12 tasks on the site like creating an account, adding photos to a dash, and searching for other users. The study measured efficiency by time on task, effectiveness by number of errors, and satisfaction using a technology acceptance model. Key findings were that setting contacts as contributors and searching for friends were inefficient. Overall, 34% of users reported satisfaction with Dash while 41% found adding contributors most frustrating. Researchers concluded the unique security controls were effective but interface improvements could enhance usability.
More Related Content
SNS Dash
- 1. SNS DASH Hacetteppe University NegarKhalandi Santhosh Kasula Stewart Hutchison
- 2. AGENDA 1. Main Question 2.Project Details 3. Efficiency 4. Effectiveness 5. Satisfaction 6. Done Right 7. Best Practice 8. Data Collection 9. Conclusion Negar Khalandi Santhosh Kasula Stewart Hutchison
- 3. MAIN QUESTION Whatwere the objectives?
- 4. MAIN QUESTION? • Whatare some of the usability issues with Dash? o Efficiency o Effectiveness o Satisfaction Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 5. PROJECT DETAILS Howwas the experiment conducted?
- 6. HOW WAS THE PROJECTCONDUCTED • Usability test was conducted at Hacetteppe University in Turkey • Participants were asked to complete 12 tasks • Using https://dashes.lifedash.com to complete these tasks • All participants utilized a Windows operated PC o Mobile device applications are available o They were not tested during this experiment Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 7. PARTICIPANT DEMOGRAPHICS Negar Khalandi SanthoshKasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion 10Male 16Female 26 Students
- 8. PARTICIPANT DEMOGRAPHICS Negar Khalandi SanthoshKasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion Average Age Age Range
- 9. 12 TASKS INCLUDED: 1.Finding the website dashes.lifedash.com 2. Creating an account 3. Creating a dash 4. Adding 3 photos, 1 video and 1 post about the photos to the dash 5. Adding others to this dash as contributors 6. Making the dash public so followers can also see this dash. 7. Finding some other people and following them 8. Viewing, browsing and exiting Amy’s profile 9. Finding and liking Kevin’s first picture of the “Beach house 2013” dash 10. Update profile picture 11. Modify the “About Me” section 12. Log Out Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 10.
- 11. HOW WAS EFFICIENCY MEASURED? •Efficiency was measured as the time on task • Experiments were recorded o Mostly using Morae o Some using Camtasia • Videos were reviewed to obtain the time on task o Bias is introduced due to the lack of audio o Difficult to truly know the start and end of a task o Could not determine if any assists were given Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 12. AVERAGE TIME ONTASK Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion 28 85 50 148 98 134 69 30 42 50 26 16 0 20 40 60 80 100 120 140 160 1 2 3 4 5 6 7 8 9 10 11 12 AVERAGETIMEONTASK(SECONDS) TASK #
- 13. AVERAGE TIME ONTASK Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion 28 85 50 148 98 134 69 30 42 50 26 16 0 20 40 60 80 100 120 140 160 1 2 3 4 5 6 7 8 9 10 11 12 AVERAGETIMEONTASK(SECONDS) TASK #
- 14. RANGE IN TIMEON TASK Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion 84 210 309 326 220 216 263 100 240 98 56 163 8 21 13 87 30 85 14 8 16 10 10 2 0 50 100 150 200 250 300 350 1 2 3 4 5 6 7 8 9 10 11 12 AVERAGETIMEONTASK(SECONDS) TASK #
- 15.
- 16. HOW WAS EFFECTIVENESS MEASURED Effectivenesswas measured by counting the number of errors on task Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion Backtrack Error
- 17. DIFFICULTIES IN COUNTING ERRORS NegarKhalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion Backtrack Error Errors counted by reviewing videos of experiments When a task was completed correctly, then it was considered as a completion Difficult to definitively know when a task was completed correctly – EX: Task 6
- 18. EXAMPLES: TASK 6 NegarKhalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion You’d also like to share this dash with other people who are following you but not make them contributors. Make this dash public so they can also see this dash.
- 19. EXAMPLES: TASK 5 NegarKhalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion You’d like to add others to this dash who were at the experiment with you, find Vera USF and Jo USF and add them to this dash as Contributors. Only Completed task 5
- 20. EXAMPLES: TASK 5 NegarKhalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 21. EXAMPLES: TASK 5 NegarKhalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 22. EXAMPLES: TASK 5 NegarKhalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 23. HOW WAS EFFECTIVENESS MEASURED NegarKhalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 24. EXAMPLES: TASK 5 NegarKhalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 25. NUMBER OF ERRORS PERTASK Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion 12 45 12 43 40 0 17 10 13 19 16 4 0 5 10 15 20 25 30 35 40 45 50 1 2 3 4 5 6 7 8 9 10 11 12 TotalNumberofErrors Task #
- 26. NUMBER OF ERRORS PERTASK Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion 12 45 12 43 40 0 17 10 13 19 16 4 0 5 10 15 20 25 30 35 40 45 50 1 2 3 4 5 6 7 8 9 10 11 12 TotalNumberofErrors Task #
- 27. TASK COMPLETION RATE Negar KhalandiSanthosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion 100% 96% 100% 100% 12% 0% 100% 100% 88% 100% 100% 100% 0% 20% 40% 60% 80% 100% 120% 1 2 3 4 5 6 7 8 9 10 11 12 ComplitionRate Task #
- 28.
- 29. MEASURING SATISFACTION: TAM Negar KhalandiSanthosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion High SNS Diet High rate of Usefulness Satisfied User Low SNS Diet High rate of Ease of Use Satisfied User
- 30. MEASURING SATISFACTION Negar Khalandi SanthoshKasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion High SNS Diet High rate of Usefulness Satisfied User Low SNS Diet High rate of Ease of Use Satisfied User
- 31. UNDERSTANDING SNS DIET Negar KhalandiSanthosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion High SNS Diet High rate of Usefulness Satisfied User Low SNS Diet High rate of Ease of Use Satisfied User Frequency of SNS use • Hourly, every few hours, daily, etc. Duration of use • Age of first internet use Amount of use • Number of apps installed
- 32. MEASURING SATISFACTION Negar Khalandi SanthoshKasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion High SNS Diet High rate of Usefulness Satisfied User Low SNS Diet High rate of Ease of Use Satisfied User
- 33. MEASURING USEFULNESS Negar Khalandi SanthoshKasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion High SNS Diet High rate of Usefulness Satisfied User Friends are on it Friends are not on it Useful Not Useful Not Useful
- 34. MEASURING EASE OF USE NegarKhalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion Low SNS Diet High rate of Ease of Use Satisfied User Based on a satisfaction rating of the ease with which the participant could do the tasks Participants rated the difficulty of tasks on a 1 – 7 scale 1 = easiest and 7 = most difficult
- 35. MEASURING SATISFACTION Negar Khalandi SanthoshKasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion High SNS Diet High rate of Usefulness Satisfied User Low SNS Diet High rate of Ease of Use Satisfied User
- 36. SATISFIED USERS? Negar KhalandiSanthosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion Satisfied 34% Not Satisfied 8% Unknown 58%
- 37. SATISFIED USERS? YES! NegarKhalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion Satisfied 34% Not Satisfied 8% Unknown 58% Satisfaction conclusion drawn from: 1. Technology Acceptance Model • 2 High SNS diet users • 10 Low SNS diet users • 14 uncategorized 2. User feedback • 21 out of 26 participants said they would use Dash to share photos, videos and status
- 38. MOST FRUSTRATING Negar KhalandiSanthosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion 22% 41% 7% 7% 7% 4% 4% 4% 4% Making dash public Adding contributor to the dash Searching for people Internet connection Updating profile Creating an account Creating a Dash Case sensitivity when finding users None
- 39. MOST FRUSTRATING Negar KhalandiSanthosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion 22% 41% 7% 7% 7% 4% 4% 4% 4% Making dash public Adding contributor to the dash Searching for people Internet connection Updating profile Creating an account Creating a Dash Case sensitivity when finding users None
- 40. WHAT DID THE DEVELOPERDO RIGHT?
- 41. WHAT DID THE DEVELOPERDO RIGHT? • Dash is a more secure way of sharing pictures, videos and status • Simplistic design of pages • Users found it very easy to create a Dash o The Plus sign is very intuitive o User can limit the level of contribution to their dashes • Intent of the SNS was translated to the users o 21 out of the 26 users said they would use Dash to share photos, videos, and socialize Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 42.
- 43. WE LEARNED • Theimportance of audio to determine: o Stop start of a task o Whether users were getting assists o Confusion during a task • Technology Assistance Model o Measuring usefulness o Measuring ease of use o SNS Diet o How these contribute to understanding a user’s satisfaction of an SNS Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 44. SURPRISED • By theamount of work involved in coding video o A total of 26 videos o Ranging from 10 to 18 minutes in length • The amount of variables that can be pulled from the surveys Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 45. WHAT WORKED? DIDN’T WORK? Worked: •The correlation between high-low SNS diet and satisfaction • The site functioned as it was intended to (for the most part) • Team dynamic worked well Didn’t Work: • We would have liked to see the results of a SUS questionnaire • The language barrier was difficult to work around o Many assumptions were made due to this fact Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 46.
- 47. DATA COLLECTION What welearned about data collection: • Agreeing on metrics before scoring is critical • Variations in data interpretation • Splitting up video reviews resulted in saving time What we would do differently: • Determining an agreed upon set of tasks before reviewing videos • Collect the data ourselves • Evaluating the videos in more detail • Test more high SNS diet users Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 48.
- 49. CONCLUSION Biggest Problem: • Theunique aspect of this site is the user’s level of security controls o However, the interface for setting contacts as contributors was ineffective o Only 12% of the users were able to complete this task Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 50. CONCLUSION Other Problem: • Manyof the users compared it to other SNS o 16 out of the 26 users • Notify users that multiple images can be uploaded at once o Many users uploaded the photos one at a time o Contributed to the longer time on task 4 o Can lead to a more efficient experience • Searching for friends was not intuitive Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 51. SEARCHING FOR FRIENDS Searching forfriends was not intuitive Negar Khalandi Santhosh Kasula Stewart Hutchison Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
- 52.