The document summarizes a usability study conducted on the social networking site Dash. 26 students participated in the study, which involved completing 12 tasks on the site like creating an account, adding photos to a dash, and searching for other users. The study measured efficiency by time on task, effectiveness by number of errors, and satisfaction using a technology acceptance model. Key findings were that setting contacts as contributors and searching for friends were inefficient. Overall, 34% of users reported satisfaction with Dash while 41% found adding contributors most frustrating. Researchers concluded the unique security controls were effective but interface improvements could enhance usability.

1. SNS DASH
Hacetteppe University
Negar Khalandi
Santhosh Kasula
Stewart Hutchison

2. AGENDA
1. Main Question
2. Project Details
3. Efficiency
4. Effectiveness
5. Satisfaction
6. Done Right
7. Best Practice
8. Data Collection
9. Conclusion
Negar Khalandi Santhosh Kasula Stewart Hutchison

3. MAIN QUESTION What were the objectives?

4. MAIN QUESTION?
• What are some of the
usability issues with Dash?
o Efficiency
o Effectiveness
o Satisfaction
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question
Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion

5. PROJECT DETAILS How was the experiment
conducted?

6. HOW WAS THE
PROJECT CONDUCTED
• Usability test was conducted at Hacetteppe University in Turkey
• Participants were asked to complete 12 tasks
• Using https://dashes.lifedash.com to complete these tasks
• All participants utilized a Windows operated PC
o Mobile device applications are available
o They were not tested during this experiment
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question
Project Details
Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion

7. PARTICIPANT
DEMOGRAPHICS
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question
Project Details
Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
10Male
16Female
26 Students

8. PARTICIPANT
DEMOGRAPHICS
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question
Project Details
Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
Average Age
Age Range

9. 12 TASKS INCLUDED:
1. Finding the website dashes.lifedash.com
2. Creating an account
3. Creating a dash
4. Adding 3 photos, 1 video and 1 post about the photos to the dash
5. Adding others to this dash as contributors
6. Making the dash public so followers can also see this dash.
7. Finding some other people and following them
8. Viewing, browsing and exiting Amy’s profile
9. Finding and liking Kevin’s first picture of the “Beach house 2013” dash
10. Update profile picture
11. Modify the “About Me” section
12. Log Out
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question
Project Details
Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion

10. EFFICIENCY Time on task

11. HOW WAS EFFICIENCY
MEASURED?
• Efficiency was measured as the time on task
• Experiments were recorded
o Mostly using Morae
o Some using Camtasia
• Videos were reviewed to obtain the time on task
o Bias is introduced due to the lack of audio
o Difficult to truly know the start and end of a task
o Could not determine if any assists were given
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details
Efficiency
Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion

12. AVERAGE TIME ON TASK
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details
Efficiency
Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
28
85
50
148
98
134
69
30
42
50
26
16
0
20
40
60
80
100
120
140
160
1 2 3 4 5 6 7 8 9 10 11 12
AVERAGETIMEONTASK(SECONDS)
TASK #

13. AVERAGE TIME ON TASK
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details
Efficiency
Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
28
85
50
148
98
134
69
30
42
50
26
16
0
20
40
60
80
100
120
140
160
1 2 3 4 5 6 7 8 9 10 11 12
AVERAGETIMEONTASK(SECONDS)
TASK #

14. RANGE IN TIME ON
TASK
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details
Efficiency
Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion
84
210
309
326
220 216
263
100
240
98
56
163
8
21 13
87
30
85
14 8 16 10 10 2
0
50
100
150
200
250
300
350
1 2 3 4 5 6 7 8 9 10 11 12
AVERAGETIMEONTASK(SECONDS)
TASK #

15. EFFECTIVENESS Errors on task

16. HOW WAS EFFECTIVENESS
MEASURED
Effectiveness was measured by counting the number of errors on task
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency
Effectiveness
Satisfaction Done Right Best Practices Data Collection Conclusion
Backtrack Error

17. DIFFICULTIES IN
COUNTING ERRORS
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency
Effectiveness
Satisfaction Done Right Best Practices Data Collection Conclusion
Backtrack Error
Errors counted by reviewing videos of experiments
When a task was completed correctly, then it was considered as a completion
Difficult to definitively know when a task was completed correctly – EX: Task 6

18. EXAMPLES: TASK 6
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency
Effectiveness
Satisfaction Done Right Best Practices Data Collection Conclusion
You’d also like to share this dash with other people who are following you but not
make them contributors. Make this dash public so they can also see this dash.

19. EXAMPLES: TASK 5
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency
Effectiveness
Satisfaction Done Right Best Practices Data Collection Conclusion
You’d like to add others to this dash who were at the experiment with you,
find Vera USF and Jo USF and add them to this dash as Contributors.
Only
Completed
task 5

20. EXAMPLES: TASK 5
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency
Effectiveness
Satisfaction Done Right Best Practices Data Collection Conclusion

21. EXAMPLES: TASK 5
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency
Effectiveness
Satisfaction Done Right Best Practices Data Collection Conclusion

22. EXAMPLES: TASK 5
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency
Effectiveness
Satisfaction Done Right Best Practices Data Collection Conclusion

23. HOW WAS EFFECTIVENESS
MEASURED
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency
Effectiveness
Satisfaction Done Right Best Practices Data Collection Conclusion

24. EXAMPLES: TASK 5
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency
Effectiveness
Satisfaction Done Right Best Practices Data Collection Conclusion

25. NUMBER OF ERRORS
PER TASK
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency
Effectiveness
Satisfaction Done Right Best Practices Data Collection Conclusion
12
45
12
43
40
0
17
10
13
19
16
4
0
5
10
15
20
25
30
35
40
45
50
1 2 3 4 5 6 7 8 9 10 11 12
TotalNumberofErrors
Task #

26. NUMBER OF ERRORS
PER TASK
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency
Effectiveness
Satisfaction Done Right Best Practices Data Collection Conclusion
12
45
12
43
40
0
17
10
13
19
16
4
0
5
10
15
20
25
30
35
40
45
50
1 2 3 4 5 6 7 8 9 10 11 12
TotalNumberofErrors
Task #

27. TASK COMPLETION
RATE
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency
Effectiveness
Satisfaction Done Right Best Practices Data Collection Conclusion
100%
96%
100% 100%
12%
0%
100% 100%
88%
100% 100% 100%
0%
20%
40%
60%
80%
100%
120%
1 2 3 4 5 6 7 8 9 10 11 12
ComplitionRate
Task #

28. SATISFACTION
SNS Diet
Usefulness
Ease of Use

29. MEASURING
SATISFACTION: TAM
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness
Satisfaction
Done Right Best Practices Data Collection Conclusion
High SNS
Diet
High rate
of
Usefulness
Satisfied
User
Low SNS
Diet
High rate
of Ease
of Use
Satisfied
User

30. MEASURING
SATISFACTION
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness
Satisfaction
Done Right Best Practices Data Collection Conclusion
High SNS
Diet
High rate
of
Usefulness
Satisfied
User
Low SNS
Diet
High rate
of Ease
of Use
Satisfied
User

31. UNDERSTANDING SNS
DIET
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness
Satisfaction
Done Right Best Practices Data Collection Conclusion
High SNS
Diet
High rate
of
Usefulness
Satisfied
User
Low SNS
Diet
High rate
of Ease of
Use
Satisfied
User
Frequency of SNS use
• Hourly, every few hours, daily, etc.
Duration of use
• Age of first internet use
Amount of use
• Number of apps installed

32. MEASURING
SATISFACTION
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness
Satisfaction
Done Right Best Practices Data Collection Conclusion
High SNS
Diet
High rate
of
Usefulness
Satisfied
User
Low SNS
Diet
High rate
of Ease
of Use
Satisfied
User

33. MEASURING
USEFULNESS
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness
Satisfaction
Done Right Best Practices Data Collection Conclusion
High
SNS Diet
High rate
of
Usefulness
Satisfied
User
Friends are
on it
Friends are not
on it
Useful
Not Useful
Not Useful

34. MEASURING EASE OF
USE
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness
Satisfaction
Done Right Best Practices Data Collection Conclusion
Low SNS
Diet
High rate
of Ease of
Use
Satisfied
User
Based on a satisfaction rating of the ease with which the
participant could do the tasks
Participants rated the difficulty of tasks on a 1 – 7 scale
1 = easiest and 7 = most difficult

35. MEASURING
SATISFACTION
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness
Satisfaction
Done Right Best Practices Data Collection Conclusion
High SNS
Diet
High rate
of
Usefulness
Satisfied
User
Low SNS
Diet
High rate
of Ease
of Use
Satisfied
User

36. SATISFIED USERS?
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness
Satisfaction
Done Right Best Practices Data Collection Conclusion
Satisfied
34%
Not Satisfied
8%
Unknown
58%

37. SATISFIED USERS? YES!
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness
Satisfaction
Done Right Best Practices Data Collection Conclusion
Satisfied
34%
Not
Satisfied
8%
Unknown
58%
Satisfaction conclusion drawn from:
1. Technology Acceptance Model
• 2 High SNS diet users
• 10 Low SNS diet users
• 14 uncategorized
2. User feedback
• 21 out of 26 participants said they would
use Dash to share photos, videos and
status

38. MOST FRUSTRATING
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness
Satisfaction
Done Right Best Practices Data Collection Conclusion
22%
41%
7%
7%
7%
4%
4%
4%
4%
Making dash public
Adding contributor to the dash
Searching for people
Internet connection
Updating profile
Creating an account
Creating a Dash
Case sensitivity when finding users
None

39. MOST FRUSTRATING
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness
Satisfaction
Done Right Best Practices Data Collection Conclusion
22%
41%
7%
7%
7%
4%
4%
4%
4%
Making dash public
Adding contributor to the dash
Searching for people
Internet connection
Updating profile
Creating an account
Creating a Dash
Case sensitivity when finding users
None

40. WHAT DID THE
DEVELOPER DO
RIGHT?

41. WHAT DID THE
DEVELOPER DO RIGHT?
• Dash is a more secure way of sharing pictures, videos
and status
• Simplistic design of pages
• Users found it very easy to create a Dash
o The Plus sign is very intuitive
o User can limit the level of contribution to their dashes
• Intent of the SNS was translated to the users
o 21 out of the 26 users said they would use Dash to share photos, videos,
and socialize
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness Satisfaction
Done Right
Best Practices Data Collection Conclusion

42. BEST PRACTICE

43. WE LEARNED
• The importance of audio to determine:
o Stop start of a task
o Whether users were getting assists
o Confusion during a task
• Technology Assistance Model
o Measuring usefulness
o Measuring ease of use
o SNS Diet
o How these contribute to understanding a user’s satisfaction of an SNS
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness Satisfaction Done Right
Best Practices
Data Collection Conclusion

44. SURPRISED
• By the amount of work involved in coding video
o A total of 26 videos
o Ranging from 10 to 18 minutes in length
• The amount of variables that can be pulled from the
surveys
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness Satisfaction Done Right
Best Practices
Data Collection Conclusion

45. WHAT WORKED?
DIDN’T WORK?
Worked:
• The correlation between high-low SNS diet and satisfaction
• The site functioned as it was intended to (for the most part)
• Team dynamic worked well
Didn’t Work:
• We would have liked to see the results of a SUS questionnaire
• The language barrier was difficult to work around
o Many assumptions were made due to this fact
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness Satisfaction Done Right
Best Practices
Data Collection Conclusion

46. DATA
COLLECTION

47. DATA COLLECTION
What we learned about data collection:
• Agreeing on metrics before scoring is critical
• Variations in data interpretation
• Splitting up video reviews resulted in saving time
What we would do differently:
• Determining an agreed upon set of tasks before reviewing videos
• Collect the data ourselves
• Evaluating the videos in more detail
• Test more high SNS diet users
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection Conclusion

48. CONCLUSION

49. CONCLUSION
Biggest Problem:
• The unique aspect of this site is the user’s level of security controls
o However, the interface for setting contacts as contributors was ineffective
o Only 12% of the users were able to complete this task
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection
Conclusion

50. CONCLUSION
Other Problem:
• Many of the users compared it to other SNS
o 16 out of the 26 users
• Notify users that multiple images can be uploaded at once
o Many users uploaded the photos one at a time
o Contributed to the longer time on task 4
o Can lead to a more efficient experience
• Searching for friends was not intuitive
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection
Conclusion

51. SEARCHING FOR
FRIENDS
Searching for friends was not intuitive
Negar Khalandi Santhosh Kasula Stewart Hutchison
Main Question Project Details Efficiency Effectiveness Satisfaction Done Right Best Practices Data Collection
Conclusion

52. ANY QUESTIONS?