SlideShare a Scribd company logo
1 of 32
Download to read offline
DIARY STUDYING
WITH PWC
February 2016
#MakeItBetter
INTERNAL ONLY
#MakeItBetter
WHAT IS A DIARY STUDY?
#MakeItBetter
WHAT IS A DIARY STUDY?
#MakeItBetter
WHAT IS A DIARY STUDY?
#MakeItBetter
WHAT IS A DIARY STUDY?
• Diary studies are a form of research that takes place over a long period of time
• Diary studies prompt users to report their activities at regular intervals
#MakeItBetter
WHY WOULD YOU USE A
DIARY STUDY?
• To observe product use outside of a controlled environment
• To observe product use over a period of time
• To uncover the motivation behind why users take certain actions
• To observe users actually try to use the product to solve their pain points
• To uncover how a user feels about a product
#MakeItBetter
WHEN IS IT PRUDENT TO
CONDUCT A DIARY STUDY?
• When the value of your product is better revealed after prolonged, regular
usage
• When the value of your product relies on how a product fits into a user’s regular
habits
• When you don’t have time/resources for an on-field study
#MakeItBetter
WHAT TOOLS DO YOU NEED TO RUN
A DIARY STUDY?
#MakeItBetter
Stable, usable product build
#MakeItBetter
A way to recruit users
#MakeItBetter
A way to track user actions and data
#MakeItBetter
A way for users to give feedback about their experience during the study
#MakeItBetter
CONSTANT VIGILANCE
#MakeItBetter
HOW DID WE USE A DIARY STUDY?
#MakeItBetter
PWC SBS
#MakeItBetter
Our original provisional persona
#MakeItBetter
WHO WERE OUR USERS?
#MakeItBetter
STEP 1: USER INTERVIEWS
#MakeItBetter
WHAT WE GOT OUT OF
INTERVIEWS
• Understanding the users who participated in the study
• Understanding the problem space
• Understanding how they perceived the initial value prop
• Evaluating usability of onboarding
#MakeItBetter
5
“How would you rate this app?”
“i like that there are
thought put into the
different type of clients
that exist.”
-Destiny
4
“it might make me look
more professional”
-Fatima
#MakeItBetter
INSIGHTS
• Our provisional persona did not fit with the persona who would actually find use
in the app
• Onboarding needed to better explain the value prop of the app and, specifically,
what it actually did
• Users tended to use dummy data for entering their first invoice, and tapped
around without necessarily understanding what they were tapping on
#MakeItBetter
STEP 2: THE DIARY STUDY
#MakeItBetter
AVERAGE RATING & USAGE
2.28
0.65 visits per day
3.71 invoices entered
1.71 invoices marked paid
1.67 action views
1.14 emailed action content
Overall
#MakeItBetter
TESTER FEEDBACK
#MakeItBetter
–Fatima Cubilette
“The email templates are very convenient and easy to edit”
POSITIVE FEEDBACK
–Sonya Webb
“I liked the way I was prompted to set up an invoice. I frankly find that task a little daunting,
so I was surprised at how easy it was.”
–Destiny Jackson
“I liked that I got reminders about the invoices because I forgot about them”
#MakeItBetter
–Boris Lipsman
“It's hard thus far to have expectations without a clear understanding of what value the app
delivers to the user. Sure, I see my invoice is due in 18 days so there is nothing to worry
about now. What else can I use it for?”
AREAS OF IMPROVEMENT
–Sonya Webb
“It just seems like another reminder app. Not sure I'd switch from just using a calendar app.”
–Leigh Henley
“I logged in today and it continued to give me the same advice about my overdue invoice but
it didn't give me an option to let it know if I had taken those actions.”
#MakeItBetter
PRIORITY FEATURES
Separation of paid from outstanding invoices
Notes/description/details needed on invoices
Integration or sync with accounting software (QB)
5 (3)
4.5 (3)
3.75 (4)
Send invoices directly to client2.75 (2)
Weighted/Unweighted Request
More colloquial, less formal language on recommendations2.75 (2)
Create and schedule repeating invoices2.75 (2)
*Create invoices in the app (use PwCSBS as primary invoicing system)2.75 (2)
Duplicate invoices2.75 (2)
Edit invoice2.5 (2)
Database of clients (add client, edit client, create invoice attached to client)2.25 (2)
Requests are weighted by how close the tester matches PwC SBS’s primary persona
Client-facing app to send them invoices/reminders1.25 (2)
#MakeItBetter
INSIGHTS
• What users said during interviews did not necessarily correspond with what
they did
• Most users wanted a tool to manage everything invoice related — create and
send, edit, track.
• Reminders/push notifications were useful to users who weren’t already
competent at remembering when they needed to get paid
• Became clear that there are at least 2 customer segments with significantly
different needs — those who already use accounting software and those that
don’t
#MakeItBetter
REVISED USER PERSONA: OLIVIA
“I feel my best when my
businesses’ financial chores are
automated and mobile, so I can
focus on serving my clients.”
- Lives & works in LA
- 29 years old, making $88,000
- Freelance web designer with 3 large
clients and ~20 small or individual
clients.
- Not a financial alpha. Seeks enough to
be comfortable
- Enables push notification on business
apps, but sometimes feels overwhelmed
by alert overload.
- Tracks invoices manually and in excel
- Is a passive power user of business apps -
consistently enables push notifications for
banking and finance apps.
- Not a tech first mover, but is quick to
download new apps as they gain
popularity.
- Looks to communities (freelancers union,
community forums, friends) for business
advice
- Likely to talk with clients over text
- Willing to try new apps, but not necessarily
sticky
- wary of disturbing important business
relationships
- Expects to carry out complex financial
chores in mobile apps, on the go.
- Rarely forgets about an invoice but often
forgets about timing
- Wants to have better insight into the on-
time payment record of a client
- Wants to be tactful when chasing a
client for money. A financial relationship
coach
- Wants to know how and when to be firm
toward a late payer, but also has her
own techniques.
#MakeItBetter
TAKEAWAYS
• User Interviews are effective in moving onboarding boulders
• Diary Tests are effective in catching bugs and gathering feature requests
#MakeItBetter
SPECIAL THANKS
• PwC team
• Lane Halley
• Tomer Sharon
• Aliya Marder :)
#MakeItBetter
FURTHER READING
• http://www.slideshare.net/jaremfan/the-goodness-of-diary-studies/26-
Thanksbr_Contact_Mebr_wwwboonyewcombr_wwwtwittercomjaremfanbr
• https://www.usertesting.com/blog/2014/06/25/how-to-get-feedback-over-
time-with-diary-studies/
• http://www.uxbooth.com/articles/jumpstart-design-research-with-a-diary-
study/

More Related Content

Similar to Diary Studying

Understanding a QuickBase App You Didn't Build
Understanding a QuickBase App You Didn't Build Understanding a QuickBase App You Didn't Build
Understanding a QuickBase App You Didn't Build
QuickBase, Inc.
 

Similar to Diary Studying (20)

Product Management workshop
Product Management workshopProduct Management workshop
Product Management workshop
 
PM workshop
PM workshopPM workshop
PM workshop
 
Understanding a QuickBase App You Didn't Build
Understanding a QuickBase App You Didn't Build Understanding a QuickBase App You Didn't Build
Understanding a QuickBase App You Didn't Build
 
StartupQ8: Learn startup presentation
StartupQ8: Learn startup presentationStartupQ8: Learn startup presentation
StartupQ8: Learn startup presentation
 
Backlog Management & Discovery
Backlog Management & DiscoveryBacklog Management & Discovery
Backlog Management & Discovery
 
User Stories Training
User Stories TrainingUser Stories Training
User Stories Training
 
Portfolio bahtiyar
Portfolio bahtiyarPortfolio bahtiyar
Portfolio bahtiyar
 
PM workshop
PM workshopPM workshop
PM workshop
 
Agile Course Presentation
Agile Course PresentationAgile Course Presentation
Agile Course Presentation
 
S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...
S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...
S.M.A.R.T & F.O.C.U.S Testing - Increasing the value provided by your testing...
 
04: How To Engage And Retain Your Current And Future Users
04: How To Engage And Retain Your Current And Future Users04: How To Engage And Retain Your Current And Future Users
04: How To Engage And Retain Your Current And Future Users
 
Evaluating the customer needs identification process and finding its effects ...
Evaluating the customer needs identification process and finding its effects ...Evaluating the customer needs identification process and finding its effects ...
Evaluating the customer needs identification process and finding its effects ...
 
Report
ReportReport
Report
 
Rails conference 2016 building applications better the first time
Rails conference 2016 building applications better the first timeRails conference 2016 building applications better the first time
Rails conference 2016 building applications better the first time
 
Evaluating the customer needs identification process and finding its effects ...
Evaluating the customer needs identification process and finding its effects ...Evaluating the customer needs identification process and finding its effects ...
Evaluating the customer needs identification process and finding its effects ...
 
Webinar Evolving Monitoring & Customer Experience
Webinar Evolving Monitoring & Customer ExperienceWebinar Evolving Monitoring & Customer Experience
Webinar Evolving Monitoring & Customer Experience
 
User stories in agile software development
User stories in agile software developmentUser stories in agile software development
User stories in agile software development
 
MVP: Minimum Viable Product vs. Maximum Value Product
MVP:  Minimum Viable Product vs. Maximum Value ProductMVP:  Minimum Viable Product vs. Maximum Value Product
MVP: Minimum Viable Product vs. Maximum Value Product
 
Budge it!
Budge it!Budge it!
Budge it!
 
Putting Customers First: How To Build Data-Driven Strategies To Ensure Custom...
Putting Customers First: How To Build Data-Driven Strategies To Ensure Custom...Putting Customers First: How To Build Data-Driven Strategies To Ensure Custom...
Putting Customers First: How To Build Data-Driven Strategies To Ensure Custom...
 

Recently uploaded

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 

Recently uploaded (20)

Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptx
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overview
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
API Governance and Monetization - The evolution of API governance
API Governance and Monetization -  The evolution of API governanceAPI Governance and Monetization -  The evolution of API governance
API Governance and Monetization - The evolution of API governance
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Simplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxSimplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptx
 
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by Anitaraj
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptx
 
Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data Science
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 

Diary Studying

  • 1. DIARY STUDYING WITH PWC February 2016 #MakeItBetter INTERNAL ONLY
  • 2. #MakeItBetter WHAT IS A DIARY STUDY?
  • 3. #MakeItBetter WHAT IS A DIARY STUDY?
  • 4. #MakeItBetter WHAT IS A DIARY STUDY?
  • 5. #MakeItBetter WHAT IS A DIARY STUDY? • Diary studies are a form of research that takes place over a long period of time • Diary studies prompt users to report their activities at regular intervals
  • 6. #MakeItBetter WHY WOULD YOU USE A DIARY STUDY? • To observe product use outside of a controlled environment • To observe product use over a period of time • To uncover the motivation behind why users take certain actions • To observe users actually try to use the product to solve their pain points • To uncover how a user feels about a product
  • 7. #MakeItBetter WHEN IS IT PRUDENT TO CONDUCT A DIARY STUDY? • When the value of your product is better revealed after prolonged, regular usage • When the value of your product relies on how a product fits into a user’s regular habits • When you don’t have time/resources for an on-field study
  • 8. #MakeItBetter WHAT TOOLS DO YOU NEED TO RUN A DIARY STUDY?
  • 10. #MakeItBetter A way to recruit users
  • 11. #MakeItBetter A way to track user actions and data
  • 12. #MakeItBetter A way for users to give feedback about their experience during the study
  • 14. #MakeItBetter HOW DID WE USE A DIARY STUDY?
  • 19. #MakeItBetter WHAT WE GOT OUT OF INTERVIEWS • Understanding the users who participated in the study • Understanding the problem space • Understanding how they perceived the initial value prop • Evaluating usability of onboarding
  • 20. #MakeItBetter 5 “How would you rate this app?” “i like that there are thought put into the different type of clients that exist.” -Destiny 4 “it might make me look more professional” -Fatima
  • 21. #MakeItBetter INSIGHTS • Our provisional persona did not fit with the persona who would actually find use in the app • Onboarding needed to better explain the value prop of the app and, specifically, what it actually did • Users tended to use dummy data for entering their first invoice, and tapped around without necessarily understanding what they were tapping on
  • 23. #MakeItBetter AVERAGE RATING & USAGE 2.28 0.65 visits per day 3.71 invoices entered 1.71 invoices marked paid 1.67 action views 1.14 emailed action content Overall
  • 25. #MakeItBetter –Fatima Cubilette “The email templates are very convenient and easy to edit” POSITIVE FEEDBACK –Sonya Webb “I liked the way I was prompted to set up an invoice. I frankly find that task a little daunting, so I was surprised at how easy it was.” –Destiny Jackson “I liked that I got reminders about the invoices because I forgot about them”
  • 26. #MakeItBetter –Boris Lipsman “It's hard thus far to have expectations without a clear understanding of what value the app delivers to the user. Sure, I see my invoice is due in 18 days so there is nothing to worry about now. What else can I use it for?” AREAS OF IMPROVEMENT –Sonya Webb “It just seems like another reminder app. Not sure I'd switch from just using a calendar app.” –Leigh Henley “I logged in today and it continued to give me the same advice about my overdue invoice but it didn't give me an option to let it know if I had taken those actions.”
  • 27. #MakeItBetter PRIORITY FEATURES Separation of paid from outstanding invoices Notes/description/details needed on invoices Integration or sync with accounting software (QB) 5 (3) 4.5 (3) 3.75 (4) Send invoices directly to client2.75 (2) Weighted/Unweighted Request More colloquial, less formal language on recommendations2.75 (2) Create and schedule repeating invoices2.75 (2) *Create invoices in the app (use PwCSBS as primary invoicing system)2.75 (2) Duplicate invoices2.75 (2) Edit invoice2.5 (2) Database of clients (add client, edit client, create invoice attached to client)2.25 (2) Requests are weighted by how close the tester matches PwC SBS’s primary persona Client-facing app to send them invoices/reminders1.25 (2)
  • 28. #MakeItBetter INSIGHTS • What users said during interviews did not necessarily correspond with what they did • Most users wanted a tool to manage everything invoice related — create and send, edit, track. • Reminders/push notifications were useful to users who weren’t already competent at remembering when they needed to get paid • Became clear that there are at least 2 customer segments with significantly different needs — those who already use accounting software and those that don’t
  • 29. #MakeItBetter REVISED USER PERSONA: OLIVIA “I feel my best when my businesses’ financial chores are automated and mobile, so I can focus on serving my clients.” - Lives & works in LA - 29 years old, making $88,000 - Freelance web designer with 3 large clients and ~20 small or individual clients. - Not a financial alpha. Seeks enough to be comfortable - Enables push notification on business apps, but sometimes feels overwhelmed by alert overload. - Tracks invoices manually and in excel - Is a passive power user of business apps - consistently enables push notifications for banking and finance apps. - Not a tech first mover, but is quick to download new apps as they gain popularity. - Looks to communities (freelancers union, community forums, friends) for business advice - Likely to talk with clients over text - Willing to try new apps, but not necessarily sticky - wary of disturbing important business relationships - Expects to carry out complex financial chores in mobile apps, on the go. - Rarely forgets about an invoice but often forgets about timing - Wants to have better insight into the on- time payment record of a client - Wants to be tactful when chasing a client for money. A financial relationship coach - Wants to know how and when to be firm toward a late payer, but also has her own techniques.
  • 30. #MakeItBetter TAKEAWAYS • User Interviews are effective in moving onboarding boulders • Diary Tests are effective in catching bugs and gathering feature requests
  • 31. #MakeItBetter SPECIAL THANKS • PwC team • Lane Halley • Tomer Sharon • Aliya Marder :)
  • 32. #MakeItBetter FURTHER READING • http://www.slideshare.net/jaremfan/the-goodness-of-diary-studies/26- Thanksbr_Contact_Mebr_wwwboonyewcombr_wwwtwittercomjaremfanbr • https://www.usertesting.com/blog/2014/06/25/how-to-get-feedback-over- time-with-diary-studies/ • http://www.uxbooth.com/articles/jumpstart-design-research-with-a-diary- study/