These are the slides for the January 2013 NoVA UX Meetup in Vienna, VA. VP of UX Jim Lane shared tips, tools, and research strategies that the AddThis has used to develop publisher products used on over 14 million websites.
3. Who the heck are you?
Jim Lane
VP, UX AddThis
Organizer, NoVA UX Meetup
jim@addthis.com
@jimlanenova
4. Ok, what's AddThis?
AddThis a data, distribution and decisioning
company delivering powerful, easy to use
consumer engagement tools and services.
We provide:
β Consumer engagement tools
β Audience and data products
β Library of APIs and SDKs
β Browser extensions
5.
6. By the numbers...
2008 2012
β 50 services β 330 services
β 17 languages β 70 languages
β 116k domains β 14M domains
β 300M views daily β 3B+ views daily
β 10TB of data daily
9. Three key takeaways
Research + data + testing = informed design
Being informed is easier than you think.
No excuses!
10. A caveat...
Data is important, but there are other
considerations as well...
β brand identity
β business objectives
β context (ex: mobile)
Let's get started with...
11. User-centered Design Approach
Plan Observe Prototype Design Test
Goals Surveys Paper Wireframes Quick tests
Metrics Field research Interactive PDF Design mocks A/B tests
Baselines User groups HTML Specifications Multi-variate
Personas User testing
Diagrams
13. Defining things up front
Start by understanding who your audience is:
β Who are they?
β What are they trying to do? What are their pain
points?
β What problems are they trying to solve?
β Who are primary vs secondary personas?
At AddThis, we have a lot of different kinds of users, so
utilizing multiple personas helps us structure different kinds
of design problems for different groups of people.
14. Google Analytics
Understand the existing state
β Basic site metrics
β Navigation analysis
β Demographics
β What are the metrics that really matter?
β Baseline before experimenting
Advanced segments can be used to apply historical
analysis and side-by-side comparison to visits that share a
particular characteristic, such as users of a particular OS.
17. Enlist your users!
Lots of ways to engage your audience
β Social media channels (Twitter, Facebook)
β Email feedback tools
β Support SaaS (Assistly)
β Stakeholder interviews (Skype interviews)
β Start a user group (Google Hangouts)
β Surveys (SurveyMonkey)
Tip: SurveyMonkey crosstabs can help identify trends by
cross-referencing answers to poll questions based on
answers to other questions, such as company size or level
of experience.
18. General survey
Intro survey
β
β
β
Constructing a User Group
21. Fast and iterative
Minimum viable design fosters speed and
iterative usability enhancement
β White boards
β Paper
β Omnigraffle
β diagram -> wireframe -> design mock -> assets
β Balsamiq, other fast prototype-to-design-to-code
solutions
24. Testing
Start with understanding the hypothesis
you're trying to evaluate. Be sure you're
solving the right problem!
Plan for testing as part of the design and
development process.
Statistical significance and confidence
intervals matter.
25. Testing hypotheses
Strategies
β A/B or multi-cell to get the big picture
β Multi-variate to fine-tune
β Funnel analysis to optimize conversions
β Release and measure for complex interactions or
little stuff
Tools
β GA & Google Content Experiments (formerly
Google Website Optimizer) for multi-cell
β Optimiz.ly or Convert.com for multi-cell and
multi-variate
β In-house A/B testing
26. User testing
Methods
β Task completion rate
β Task completion time
β Cognitive models and process analysis
β Track usability longitudinally
Tools
β 5-second test
β Usertesting.com
27. Don't forget about monitoring
β Google Analytics
β Product & brand scorecards (longitudinal)
β Internal reporting and alerting
29. User-centered Design Approach
Plan Observe Prototype Design Test
Goals Surveys Paper Wireframes Quick tests
Metrics Field research Interactive PDF Design mocks A/B tests
Baselines User groups HTML Specifications Multi-variate
Personas User testing
Diagrams
(whether you're waterfall or agile!)
30. Lots of strategies to choose from...
Quantitative Qualitative
β Google Analytics β User surveys
β CrazyEgg.com β Email feedback
β 5secondtest.com β Assistly
β PDF prototypes β User groups
β A/B & multi-variate testing β Google+ hangouts
β User testing β Social comments are data
β Facebook Insights β ... and some of these can
β TwitterCounter.com et al. be quantified!
β Internal analytics systems
β Some can also provide
qualitative data
31. Three key takeaways
Research + data + testing = informed design
Being informed is easier than you think.
No excuses!
32. Resources
β Quantifying the User Experience (Sauro/Lewis)
β Advanced Web Metrics with Google Analytics (Clifton)
β Web Analytics An Hour a Day (Kaushik)
β HeadFirst Statistics (Griffiths)
β Landing Page Optimization (Ash)