DIY UX
Give Your Users
an Upgrade
(Without Calling In a Pro)



    Whitney Hess
    whitney@whitneyhess.com
          @whitneyhess
     http://whitneyhess.com
Hi, Iโ€™m Whitney Hess

 User Experience Designer
        Consultant
        New Yorker


      @whitneyhess
๏ฌ”isIsIndexed.com
You
     are a
user experience
   designer
Shawn Liu & Danny Wen
Founders
Iridesco
New York, NY
http://getharvest.com
Design research
 Web analytics
Usability testing
Experimentation
  & iteration
Design
  research
What do our users actually need?
Footer
Kaizen   means โ€œcontinuous improvementโ€ in Japanese
Kaizen   means โ€œcontinuous improvementโ€ in Japanese
http://iridesco.wufoo.com/forms/harvest-survey/
โ€œWe donโ€™t just want to
  patch; we want to
  address the core
      problem.โ€
        โ€“ Iridesco
โ€œCustomers love to tell
 you their work๏ฌ‚ow.โ€
         โ€“ Iridesco
Design Research
Make it easy for customers to
reach you

Log their requests & use them to
prioritize new features

Dig deeper to discover the
underlying problems

Keep in touch
For more on design research...



                 Observing the
                 User Experience

                 Mike Kuniavsky
Web
   analytics
What are our users actually doing?
โ€œWe donโ€™t believe in
              data-driven design,
             but data doesnโ€™t lie .โ€
                                 *


                      โ€“ Iridesco



* Sometimes it does
One month of visits



   Mon        Mon     Mon        Mon




             Highest usage at
             beginning of week
             Dropo๏ฌ€s on weekends
             Somewhat lower
             usage mid-month
Crazyegg.com
Crazyegg.com
Google Website Optimizer


   Same exact page with three
   di๏ฌ€erent Free Trial buttons

   Found green and blue buttons
   performed much better than
   muted gray button

   10% improvement in trial
   acquisition over two buttons
   (Learn More and Free Trial)
Matthew Marco
Visual Designer
House of Representatives
Washington, D.C.
Chief Administrative O๏ฌƒcer ->
  House Information Resources ->
CAO Advanced Business Solutions ->
       Web Solutions Branch
House.gov
97 most frequent queries on House.gov
and top 10 results of each
97 most frequent queries on House.gov
and top 10 results of each
Queries are, in fact, case-sensitive.
             โ€œNancy Pelosiโ€ and โ€œnancy pelosiโ€ produce
             di๏ฌ€erent quantities of results
             ๏ฌ”e Pell Grant Underfunding PDF by the
             Oversight Committee appears in the top-ten
             results of most state searches; more relevant
             than any member-generated page in Colorado,
             Missouri, North Carolina, and Texas
             ๏ฌ”ere is no apparent weight given to the title of a
             document. Untitled documents are not subdued
             in the results


http://www.matthewtmarco.com/studies/2007/pathetic-to-absurd-to-disheartening-in-97-queries/
Sunday, September 28, 2008
1347 bailout
419 bailout bill
282 bail out
208 bailout plan
184 ๏ฌnancial services
132 Search Other Sites
130 Emergency Economic Stabilization Act of 2008
103 bail out bill
95 ๏ฌnancial bailout
80 Bailout
78 tarp
68 email
68 700 billion
66 rescue plan
66 rescue bill
66 old AND eye AND 6
64 ๏ฌnancial
62 rescue
62 ๏ฌnancial markets bill
58 contact
โ€œStats let me refute the
 clientโ€™s notion of how
their constituents were
       behaving.โ€
     โ€“ Matthew Marco, House.gov
Web Analytics
Understand your tra๏ฌƒc cycles

Use analytics tools to uncover
usage patterns

Test design variations

Explore your search logs to see
what people are looking for
For more on web analytics...



                Web Analytics:
                An Hour a Day

                Avinash Kaushik
Usability
     testing
How well does our stu๏ฌ€ actually work?
NOT Shawn & wife
Usability Testing Light

Shows a build, a prototype, a comp, a
sketch, whatever

Doesnโ€™t tell participant what sheโ€™s
supposed to be doing

Asks โ€œWhat are your general feelings
about this?โ€ and then lets participant talk
โ€œโ€˜It looks goodโ€™
is the worst feedback
      we can get.โ€
        โ€“ Iridesco
โ€œYou need to have
   humility and listen.
Users arenโ€™t always right,
    but you need to
      hear them.โ€
          โ€“ Iridesco
Where to Find Participants

 Friends and family
 Folks in your o๏ฌƒce who donโ€™t work on
 the project: receptionist, HR, sales
 Twitter followers
 Starbucks
 Craigslist
Tools to Capture Feedback
#1 Most Common Question:
 What about testing
      online?
Online Testing Tools
Online Testing Tools
Moderated



Self-Moderated

       For A Long Time



Automated Live

       Conceptual



Automated Static

http://remoteusability.com
Drawbacks of Online Tools
   Donโ€™t see the participantsโ€™
   expressions and body language

   Canโ€™t ask probing, follow-up questions

   A lot harder to internalize the ๏ฌndings

   Itโ€™s cowardly โ€“ you need to feel the
   embarrassment of a sucky design
Usability Testing
Test your designs early and o๎–ƒen
Informal tests are just as valuable
Use people in your environment who
arenโ€™t involved in the project
Choose participants of di๏ฌ€erent
backgrounds & capabilities
Do it yourself & acknowledge your
poor design choices
For more on usability testing...



                  Handbook of
                  Usability Testing

                  Je๏ฌ€rey Rubin and
                  Dana Chisnell
For more on remote usability testing...



                     Remote
                     Research

                     Nate Bolt and
                     Tony Tulathimutte
Experimentation
& iteration
How are we always getting better?
Sketch
Photoshop
Test
Static HTML prototype
Test again
Working prototype
Test again
Tweak
Launch quietly
Get feedback
Tweak
Roz Du๏ฌ€y
Web Developer
Comcast Interactive Media
Philadelphia, PA
Refresh Philly - June 2009
โ€œWe arenโ€™t always
  working on the most
interesting stu๏ฌ€, but we
  always want to work
       smarter.โ€
  โ€“ Roz Du๏ฌ€y, Comcast Interactive Media
An amazing thing
happened because of
  this presentation
A relationship formed
An Experiment:
Engineering Lab Week
Experimentation & Iteration
     Never stop improving your product

     Make your working environment
     a creative one

     Encourage everyone on the team
     to solve problems together

     Soak up inspiration from
     everywhere
For more on experimentation and iteration...



                        Sketching User
                        Experiences

                        Bill Buxton
Design research
 Web analytics
Usability testing
Experimentation
  & iteration
IMPORTANT STUFF
Always be listening

Ask questions to get to underlying problems

Use data and anecdotes to inform the design

Test your designs and have the humility to
admit youโ€™re wrong

Complete the feedback loop

Never stop trying to make things better
Make your users happy
and they will thank you
๏ฌ”ank you!
                     Whitney Hess
               whitney@whitneyhess.com
                     @whitneyhess
                http://whitneyhess.com


Special thanks to:
Danny Wen and Shawn Liu of Iridesco,
Matthew Marco, and Roz Du๏ฌ€y

DIY UX: Give Your Users an Upgrade (Without Calling In a Pro)

  • 1.
    DIY UX Give YourUsers an Upgrade (Without Calling In a Pro) Whitney Hess whitney@whitneyhess.com @whitneyhess http://whitneyhess.com
  • 2.
    Hi, Iโ€™m WhitneyHess User Experience Designer Consultant New Yorker @whitneyhess
  • 3.
  • 4.
    You are a user experience designer
  • 5.
    Shawn Liu &Danny Wen Founders Iridesco New York, NY
  • 6.
  • 9.
    Design research Webanalytics Usability testing Experimentation & iteration
  • 10.
    Design research Whatdo our users actually need?
  • 11.
  • 12.
    Kaizen means โ€œcontinuous improvementโ€ in Japanese
  • 13.
    Kaizen means โ€œcontinuous improvementโ€ in Japanese
  • 15.
  • 16.
    โ€œWe donโ€™t justwant to patch; we want to address the core problem.โ€ โ€“ Iridesco
  • 17.
    โ€œCustomers love totell you their work๏ฌ‚ow.โ€ โ€“ Iridesco
  • 18.
    Design Research Make iteasy for customers to reach you Log their requests & use them to prioritize new features Dig deeper to discover the underlying problems Keep in touch
  • 19.
    For more ondesign research... Observing the User Experience Mike Kuniavsky
  • 20.
    Web analytics What are our users actually doing?
  • 21.
    โ€œWe donโ€™t believein data-driven design, but data doesnโ€™t lie .โ€ * โ€“ Iridesco * Sometimes it does
  • 22.
    One month ofvisits Mon Mon Mon Mon Highest usage at beginning of week Dropo๏ฌ€s on weekends Somewhat lower usage mid-month
  • 23.
  • 24.
  • 25.
    Google Website Optimizer Same exact page with three di๏ฌ€erent Free Trial buttons Found green and blue buttons performed much better than muted gray button 10% improvement in trial acquisition over two buttons (Learn More and Free Trial)
  • 26.
    Matthew Marco Visual Designer Houseof Representatives Washington, D.C.
  • 27.
    Chief Administrative O๏ฌƒcer-> House Information Resources -> CAO Advanced Business Solutions -> Web Solutions Branch
  • 28.
  • 31.
    97 most frequentqueries on House.gov and top 10 results of each
  • 32.
    97 most frequentqueries on House.gov and top 10 results of each
  • 33.
    Queries are, infact, case-sensitive. โ€œNancy Pelosiโ€ and โ€œnancy pelosiโ€ produce di๏ฌ€erent quantities of results ๏ฌ”e Pell Grant Underfunding PDF by the Oversight Committee appears in the top-ten results of most state searches; more relevant than any member-generated page in Colorado, Missouri, North Carolina, and Texas ๏ฌ”ere is no apparent weight given to the title of a document. Untitled documents are not subdued in the results http://www.matthewtmarco.com/studies/2007/pathetic-to-absurd-to-disheartening-in-97-queries/
  • 34.
    Sunday, September 28,2008 1347 bailout 419 bailout bill 282 bail out 208 bailout plan 184 ๏ฌnancial services 132 Search Other Sites 130 Emergency Economic Stabilization Act of 2008 103 bail out bill 95 ๏ฌnancial bailout 80 Bailout 78 tarp 68 email 68 700 billion 66 rescue plan 66 rescue bill 66 old AND eye AND 6 64 ๏ฌnancial 62 rescue 62 ๏ฌnancial markets bill 58 contact
  • 37.
    โ€œStats let merefute the clientโ€™s notion of how their constituents were behaving.โ€ โ€“ Matthew Marco, House.gov
  • 38.
    Web Analytics Understand yourtra๏ฌƒc cycles Use analytics tools to uncover usage patterns Test design variations Explore your search logs to see what people are looking for
  • 39.
    For more onweb analytics... Web Analytics: An Hour a Day Avinash Kaushik
  • 40.
    Usability testing How well does our stu๏ฌ€ actually work?
  • 41.
  • 42.
    Usability Testing Light Showsa build, a prototype, a comp, a sketch, whatever Doesnโ€™t tell participant what sheโ€™s supposed to be doing Asks โ€œWhat are your general feelings about this?โ€ and then lets participant talk
  • 43.
    โ€œโ€˜It looks goodโ€™ isthe worst feedback we can get.โ€ โ€“ Iridesco
  • 44.
    โ€œYou need tohave humility and listen. Users arenโ€™t always right, but you need to hear them.โ€ โ€“ Iridesco
  • 45.
    Where to FindParticipants Friends and family Folks in your o๏ฌƒce who donโ€™t work on the project: receptionist, HR, sales Twitter followers Starbucks Craigslist
  • 46.
  • 47.
    #1 Most CommonQuestion: What about testing online?
  • 48.
  • 49.
    Online Testing Tools Moderated Self-Moderated For A Long Time Automated Live Conceptual Automated Static http://remoteusability.com
  • 50.
    Drawbacks of OnlineTools Donโ€™t see the participantsโ€™ expressions and body language Canโ€™t ask probing, follow-up questions A lot harder to internalize the ๏ฌndings Itโ€™s cowardly โ€“ you need to feel the embarrassment of a sucky design
  • 51.
    Usability Testing Test yourdesigns early and o๎–ƒen Informal tests are just as valuable Use people in your environment who arenโ€™t involved in the project Choose participants of di๏ฌ€erent backgrounds & capabilities Do it yourself & acknowledge your poor design choices
  • 52.
    For more onusability testing... Handbook of Usability Testing Je๏ฌ€rey Rubin and Dana Chisnell
  • 53.
    For more onremote usability testing... Remote Research Nate Bolt and Tony Tulathimutte
  • 54.
    Experimentation & iteration How arewe always getting better?
  • 55.
    Sketch Photoshop Test Static HTML prototype Testagain Working prototype Test again Tweak Launch quietly Get feedback Tweak
  • 56.
    Roz Du๏ฌ€y Web Developer ComcastInteractive Media Philadelphia, PA
  • 58.
  • 63.
    โ€œWe arenโ€™t always working on the most interesting stu๏ฌ€, but we always want to work smarter.โ€ โ€“ Roz Du๏ฌ€y, Comcast Interactive Media
  • 64.
    An amazing thing happenedbecause of this presentation
  • 65.
  • 66.
  • 69.
    Experimentation & Iteration Never stop improving your product Make your working environment a creative one Encourage everyone on the team to solve problems together Soak up inspiration from everywhere
  • 70.
    For more onexperimentation and iteration... Sketching User Experiences Bill Buxton
  • 71.
    Design research Webanalytics Usability testing Experimentation & iteration
  • 72.
    IMPORTANT STUFF Always belistening Ask questions to get to underlying problems Use data and anecdotes to inform the design Test your designs and have the humility to admit youโ€™re wrong Complete the feedback loop Never stop trying to make things better
  • 73.
    Make your usershappy and they will thank you
  • 75.
    ๏ฌ”ank you! Whitney Hess whitney@whitneyhess.com @whitneyhess http://whitneyhess.com Special thanks to: Danny Wen and Shawn Liu of Iridesco, Matthew Marco, and Roz Du๏ฌ€y