Experience Strategy: Dealing with a UX mid-life crisis

  • 4,663 views
Uploaded on

We make changes to our user experiences based on heuristics, usability testing, and data, but do we really know if we’re improving the overall experience over time and across projects?

We make changes to our user experiences based on heuristics, usability testing, and data, but do we really know if we’re improving the overall experience over time and across projects?

More in: Design
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
4,663
On Slideshare
0
From Embeds
0
Number of Embeds
2

Actions

Shares
Downloads
119
Comments
0
Likes
28

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • We work at an investment management company called Vanguard. Our user experience is very mature and very important to us, especially the online channel, because it handles most of our client interactions. And because we care a lot about it, year after year we have lots of projects trying to improve it. Which sometimes feels a little bit like this – lots of activity purposefully going in different directions, one after another – or even at the same time.
  • To extend this metaphor for a moment, imagine that folks at Vanguard tried their hand at aircraft design. A team is assigned to improve this bi-plane to carry more cargo …
  • … they might come up with something like this cargo plane. A little while later, another team discovers that passenger capacity is very important, and they redesign it …
  • … into this passenger plane. Still later, another team decides that speed is critical …
  • … and produces this fighter. Lastly, minutes before the deadline, a team of IAs decides that this …
  • … would be appropriate, and so on.We have this problem with our experience. Each project gets so focused on its own improvements that it doesn’t see the big picture – the fact that the experience has to balance a number of user tasks and business goals. Unfortunately we don’t have a way to facilitate a conversation about the overall objectives and priorities of the experience other than arguing about the design. So when we show our designs to project sponsors they often take it upon themselves to redesign them. “Make it red, make it bigger, move it up the page” they’ll say – they’re really just trying to express the objectives and priorities of their project. As a result the priorities for the experience are constantly changing over time.
  • This isn’t the only challenge we face however.Tell me, is this a good web page?
  • How about this one?
  • How about this iPhone app, is it “good”?
  • Or this drive-thru experience?Of course, I can’t tell you, because “good” needs to be evaluated in the context of what the experience is trying to achieve and since I didn’t design it, I don’t know for sure what that is.
  • So how about this one?I should be able to tell you if this one is “good”, right? Well this is also a problem for us. You see, too often we measure things “because we can”, not because they’re true measures of success. “10,000 people hit this page last month” someone will say. Well so what? Is that good? Did we want more? Less? Did those 10,000 people get what they needed from it? Where 100,000 looking for it and only 10,000 found it? Our measures are rarely in the context of objectives and so we never really know if the experience is “good”. Because of that we can’t learn from our mistakes, and we don’t know if we’re improving the experience over time.
  • So, we have two problems, projects becoming too focused and not seeing the big picture and no real way to judge success. We had thought that our design process was quite robust so this was a bit of a mid-life crisis for us. As we thought more about it we realized that both of these problems shared the same fundamental root cause: the lack of a common language for describing the objectives of the experience.  So we’ve spent the last 6 months trying to fill this gap by pulling together the research we’ve gathered over the last few years to create a framework that fosters big picture thinking and allows us to measure success against meaningful objectives. This is much easier to show than to explain, so let’s take a look.
  • Before we look at the framework itself lets level-set on some basic terminology.
  • However we know that users aren’t simply robots, blindly performing tasks. They have feelings and emotions about the activities they’re doing.
  • The framework is constructed from user-driven tasks, business-driven tasks and capabilities.
  • The framework allows us to create two distinct tools. The first, called a “Capability Strategy Sheet” is useful for practitioners focusing on a single part of the experience. The second view, called an “Experience Strategy Map” is useful for UX managers responsible for the entire experience.
  • Lets take a look at how we use the framework to create a strategy sheet for a single capability.
  • We use the framework to identify the tasks that this capability has to satisfy.
  • Then we prioritize the tasks.
  • And for each task, describe any emotional considerations, a high-level approach and the success criteria to show if we’re satisfying it well.
  • We can then use the sheet to inform, analyze and discuss our design solutions.
  • The other tool that we can create is the Experience Strategy Map. This is a little like one of Indi Young’s mental models in structure with the user tasks arranged along the top and the capabilities mapped against the appropriate tasks. We can also surface the success criteria onto this map, showing how well each capability satisfies a task.
  • When we show people the framework’s 90 user driven tasks, 45 business driven tasks, and 600 (and counting) capabilities, they’re often overwhelmed by the size and complexity of the idea. And that’s an unfortunate, but understandable reaction, because there’s no doubt that the framework really is a “big” idea. That’s’ the bad news…The good news is that taken one capability at a time, the framework is surprisingly simple and easy to use. Working with our business partners, we’ve found that it takes 2-3 hours to create a basic sheet, i.e., a prioritized list of 10-15 tasks. And we’ve found that once the business understands the language of the framework, they actively engage in discussing tasks and task prioritization.
  • …And it’s a great thing that our business colleagues seem to enjoy participating in capability discussions – because not only are they critical to identifying tasks and setting priorities, but they’re also critical to getting the framework accepted in the larger organization. We need a small group in the business to have positive experiences using the framework so that they will recommend it to their colleagues working on other projects.
  • Now let’s talk about some other applications of the framework. Up to now, we’ve talked about using the language of goals and tasks to describe the capabilities that make up our user experience. We also think that the same framework could effect an even broader cultural change. Here’s how that might work. Each year at Vanguard, middle and upper managers meet to discuss and prioritize the projects they want to fund. Those projects are described in 2-3 page documents called project briefs, or charters. And very often, the brief will contain very concrete design directives, like: Add a link on this page… Add content here… Make this more prominent on the site…Add this new section to the site…OK, we recognize that it’s quite natural to describe a project in terms of tangible, physical things. But that also has an unfortunate side-effect: right from the outset of a project, it puts the business squarely into the business of user experience design… and somehow, we keep on hoping that that’s our job. So here’s the opportunity: We want to work with the business to write their project briefs using our framework’s goals and tasks and then help them to identify the capabilities that should be improved or created. How would this be better? We’re hoping that it would allow the business to focus more on defining the problems it’s trying to solve; and it would allow us to focus on finding solutions.
  • We set out with a couple of fairly tactical problems - to improve the way we set goals for and evaluate our user experience. However, the solution we came up with – this common language – is causing us to behave differently. By facilitating communication across roles and over time it’s enabling people with different perspectives, backgrounds and responsibilities to talk and collaborate – and ultimately work together towards shared goals. Now, will this work for you? Well – we’re not sure, but we do think it could work for organizations like ours. Ones with a mature user experience, where the tasks and capabilities are well known and where continuous, measurable improvement of the user experience is desired. If you try it, even pieces of it, we’d love to know how it works out for you.

Transcript

  • 1. © 2010 The Vanguard Group Inc. All rights reserved.
    1
    Experience Strategy:
    Dealing with a UX Mid-life Crisis
    Richard Dalton
    Rob Weening
    IA Summit, Phoenix, April 10th 2010
  • 2. © 2010 The Vanguard Group Inc. All rights reserved.
    2
    http://www.flickr.com/photos/mrbigdog2k/2539218247/
  • 3. © 2010 The Vanguard Group Inc. All rights reserved.
    3
    http://www.flickr.com/photos/ackook/2012371141/
  • 4. © 2010 The Vanguard Group Inc. All rights reserved.
    4
    http://www.flickr.com/photos/10037058@N08/2805524085/
  • 5. © 2010 The Vanguard Group Inc. All rights reserved.
    5
    http://www.flickr.com/photos/asten/2776369677/
  • 6. © 2010 The Vanguard Group Inc. All rights reserved.
    6
    http://www.flickr.com/photos/7817806@N02/3003122116/
  • 7. © 2010 The Vanguard Group Inc. All rights reserved.
    7
  • 8. © 2010 The Vanguard Group Inc. All rights reserved.
    8
  • 9. © 2010 The Vanguard Group Inc. All rights reserved.
    9
    http://www.flickr.com/photos/12905355@N05/4275453227/
  • 10. © 2010 The Vanguard Group Inc. All rights reserved.
    10
    http://www.flickr.com/photos/iirraa/3682940547/
  • 11. © 2010 The Vanguard Group Inc. All rights reserved.
    11
  • 12. At mid-life we discovered two problems:
    • Project teams are too focused on their goals and don’t consider the bigger picture
    • 13. We have no consistent way to gauge success
    We have these problems because we don’t have a common language for describing the objectives of the experience
    © 2010 The Vanguard Group Inc. All rights reserved.
    12
  • 14. Users have goals
    … and the business has goals
    Users do things to try to meet their goals
    … and the business wants users to do things so it can meet its goals
    Capabilities help users to do the tasks they want to do
    … and encourage users to do the tasks the business wants them to do
    Projects create new capabilities
    Projects change existing capabilities
    Goals
    Are realized through
    Tasks
    Are enabled & encouraged by
    Capabilities
    Are created & changed by
    Projects
    © 2010 The Vanguard Group Inc. All rights reserved.
    13
  • 15. Users have goals
    … and the business has goals
    Users also have feelings about their goals & tasks
    … and the business wants to encourage certain feelings
    Capabilities help users to do the tasks they want to do
    … and encourage users to do the tasks the business wants them to do
    Projects create new capabilities
    Projects change existing capabilities
    Goals
    Are realized through
    + Emotions
    Are enabled & encouraged by
    Capabilities
    Are created & changed by
    Projects
    © 2010 The Vanguard Group Inc. All rights reserved.
    14
  • 16. User-driven tasks
    Business-driven tasks
    Capabilities
    Find an investment company
    Make good investment decisions
    Follow Vanguard’s investing principles
    Web
    Phone
    Paper
    E-mail
    Mobile devices
    Radio/TV
    Monitor my investments
    Learn why Vanguard is great
    Act on my investments
    Bring assets to Vanguard
    Stay current on news and commentary
    Use Vanguard's products & services
    Deal with taxes
    Self-provision on the web
    Help other people be successful investors
    Spread the word about Vanguard
    Help my heirs be successful at Vanguard
    Trust Vanguard
    90 tasks grouped
    into 8 categories
    45 tasks grouped
    into 7 categories
    635 capabilities and counting …
    © 2010 The Vanguard Group Inc. All rights reserved.
    15
  • 17. Capability Strategy Sheet
    Experience Strategy Map
    User-driven tasks
    Business-driven tasks
    Capabilities
    Find an investment company
    Make good investment decisions
    Follow Vanguard’s investing principles
    Web
    Phone
    Paper
    E-mail
    Mobile devices
    Radio/TV
    Monitor my investments
    Learn why Vanguard is great
    Act on my investments
    Bring assets to Vanguard
    Stay current on news and commentary
    Use Vanguard's products & services
    Deal with taxes
    Self-provision on the web
    Help other people be successful investors
    Spread the word about Vanguard
    Help my heirs be successful at Vanguard
    Trust Vanguard
    90 tasks grouped
    into 8 categories
    45 tasks grouped
    into 7 categories
    635 capabilities and counting …
    © 2010 The Vanguard Group Inc. All rights reserved.
    16
  • 18. User-driven tasks
    Business-driven tasks
    Capabilities
    Rollover Offer
    (web)
    © 2010 The Vanguard Group Inc. All rights reserved.
    17
  • 19. User-driven tasks
    Business-driven tasks
    Capabilities
    Rollover Offer
    (web)
    © 2010 The Vanguard Group Inc. All rights reserved.
    18
    Find an investment company
    Search for candidates
    Find out about Vanguard’s reputation
    Explore Vanguard’s range of products
    Find out if there are fees to do a rollover
  • 20. User-driven tasks
    Business-driven tasks
    Capabilities
    Rollover Offer
    (web)
    © 2010 The Vanguard Group Inc. All rights reserved.
    19
    Find an investment company
    Search for candidates
    Find out about Vanguard’s reputation
    Learn why Vanguard is great
    Explore Vanguard’s range of products
    Learn why our mutual funds are great
    Find out if there are fees to do a rollover
    Learn how we can help you do a rollover
    Learn about the Vanguard story
    Make good investment decisions
    Get investment recommendations
    Bring assets to Vanguard
    Get information about investments
    Rollover 401(k) plans into Vanguard IRAs
    Learn the process and benefits of rollovers
    Use Vanguard’s products & services
    Act on my investments
    Invest in simplified investing solutions
    Rollover my 401(k) to Vanguard
    Use Vanguard for advice or guidance
    Transfer my IRA to Vanguard
  • 21. © 2010 The Vanguard Group Inc. All rights reserved.
    20
    Rollover my 401(k) to Vanguard
    1
    Rollover 401(k) plans into Vanguard IRAs
    Get investment recommendations
    2
    Get information about investments
    3
    Learn the process and benefits of rollovers
    4
    Learn how we can help you do a rollover
    5
    Learn about the Vanguard story
    6
    Find out about Vanguard’s reputation
    7
    Learn why our mutual funds are great
    Find out if there are fees to do a rollover
    8
    Transfer my IRA to Vanguard
    9
    10
    Invest in simplified investing solutions
  • 22. Emotional considerations
    2
    3
    © 2010 The Vanguard Group Inc. All rights reserved.
    21
    Rollover my 401(k) to Vanguard
    1
    Rollover 401(k) plans into Vanguard IRAs
    Get investment recommendations
    Get information about investments
    Learn the process and benefits of rollovers
    4
    High-level approach
    Learn how we can help you do a rollover
    5
    Learn about the Vanguard story
    6
    Find out about Vanguard’s reputation
    7
    Learn why our mutual funds are great
    Success criteria – “what is good?”
    Find out if there are fees to do a rollover
    8
    Transfer my IRA to Vanguard
    9
    10
    Invest in simplified investing solutions
  • 23. © 2010 The Vanguard Group Inc. All rights reserved.
    22
    Rollover my 401(k) to Vanguard
    Emotional considerations
    1
    Rollover 401(k) plans into Vanguard IRAs
    Anxious Confident
    Frustrated Delighted
    Disinterested Engaged
    Confused Informed
    Regretful Reassured
    Envious Content
    Alone Supported
    Skeptical Trusting
    Get investment recommendations
    2
    Get information about investments
    3
    Learn the process and benefits of rollovers
    4
    High-level approach
    Learn how we can help you do a rollover
    5
    Learn about the Vanguard story
    6
    Find out about Vanguard’s reputation
    7
    Learn why our mutual funds are great
    Success criteria – “what is good?”
    Find out if there are fees to do a rollover
    8
    Transfer my IRA to Vanguard
    9
    10
    Invest in simplified investing solutions
  • 24. Emotional considerations
    Many users aren’t sure what they need to know in order to make a good decision. Offering too much information can lead to decision paralysis
    2
    3
    4
    High-level approach
    5
    6
    Confused Informed
    Success criteria – “what is good?”
    8
    9
    10
    © 2010 The Vanguard Group Inc. All rights reserved.
    23
    Rollover my 401(k) to Vanguard
    1
    Rollover 401(k) plans into Vanguard IRAs
    Get investment recommendations
    Get information about investments
    Learn the process and benefits of rollovers
    Learn how we can help you do a rollover
    Learn about the Vanguard story
    Find out about Vanguard’s reputation
    7
    Learn why our mutual funds are great
    Find out if there are fees to do a rollover
    Transfer my IRA to Vanguard
    Invest in simplified investing solutions
  • 25. Emotional considerations
    Many users aren’t sure what they need to know in order to make a good decision. Offering too much information can lead to decision paralysis
    2
    3
    4
    High-level approach
    5
    Provide summary information about investments appropriate for rollovers within this capability. Provide contextual access to the full investment information – and an easy path back
    6
    Confused Informed
    Success criteria – “what is good?”
    8
    9
    10
    © 2010 The Vanguard Group Inc. All rights reserved.
    24
    Rollover my 401(k) to Vanguard
    1
    Rollover 401(k) plans into Vanguard IRAs
    Get investment recommendations
    Get information about investments
    Learn the process and benefits of rollovers
    Learn how we can help you do a rollover
    Learn about the Vanguard story
    Find out about Vanguard’s reputation
    7
    Learn why our mutual funds are great
    Find out if there are fees to do a rollover
    Transfer my IRA to Vanguard
    Invest in simplified investing solutions
  • 26. Emotional considerations
    Many users aren’t sure what they need to know in order to make a good decision. Offering too much information can lead to decision paralysis
    2
    3
    4
    High-level approach
    5
    Provide summary information about investments appropriate for rollovers within this capability. Provide contextual access to the full investment information – and an easy path back
    6
    Confused Informed
    Success criteria – “what is good?”
    80% of people who navigate to the full investment information from this page should use the in-page links vs. global navigation
    8
    9
    10
    © 2010 The Vanguard Group Inc. All rights reserved.
    25
    Rollover my 401(k) to Vanguard
    1
    Rollover 401(k) plans into Vanguard IRAs
    Get investment recommendations
    Get information about investments
    Learn the process and benefits of rollovers
    Learn how we can help you do a rollover
    Learn about the Vanguard story
    Find out about Vanguard’s reputation
    7
    Learn why our mutual funds are great
    Find out if there are fees to do a rollover
    Transfer my IRA to Vanguard
    Invest in simplified investing solutions
  • 27. Rollover my 401(k) to Vanguard
    1
    Rollover 401(k) plans into Vanguard IRAs
    Get investment recommendations
    2
    Get information about investments
    3
    10
    3
    4
    7
    8
    1
    4
    Learn the process and benefits of rollovers
    4
    Learn how we can help you do a rollover
    5
    4
    Learn about the Vanguard story
    6
    Find out about Vanguard’s reputation
    7
    5
    7
    Learn why our mutual funds are great
    Find out if there are fees to do a rollover
    8
    2
    Transfer my IRA to Vanguard
    9
    5
    10
    Invest in simplified investing solutions
    © 2010 The Vanguard Group Inc. All rights reserved.
    26
  • 28. Rollover my 401(k) to Vanguard
    1
    Rollover 401(k) plans into Vanguard IRAs
    Get investment recommendations
    2
    Get information about investments
    3
    10
    3
    4
    7
    8
    1
    4
    Learn the process and benefits of rollovers
    4
    Learn how we can help you do a rollover
    5
    4
    Learn about the Vanguard story
    6
    Find out about Vanguard’s reputation
    7
    5
    7
    Learn why our mutual funds are great
    Find out if there are fees to do a rollover
    8
    2
    Transfer my IRA to Vanguard
    9
    5
    10
    Invest in simplified investing solutions
    © 2010 The Vanguard Group Inc. All rights reserved.
    27
  • 29. Rollover my 401(k) to Vanguard
    1
    Rollover 401(k) plans into Vanguard IRAs
    Get investment recommendations
    2
    Get information about investments
    3
    10
    3
    4
    7
    8
    1
    4
    Learn the process and benefits of rollovers
    4
    Learn how we can help you do a rollover
    5
    4
    Learn about the Vanguard story
    6
    Find out about Vanguard’s reputation
    7
    5
    7
    Learn why our mutual funds are great
    Find out if there are fees to do a rollover
    8
    2
    Transfer my IRA to Vanguard
    9
    5
    10
    Invest in simplified investing solutions
    © 2010 The Vanguard Group Inc. All rights reserved.
    28
  • 30. Rollover my 401(k) to Vanguard
    1
    Rollover 401(k) plans into Vanguard IRAs
    Get investment recommendations
    2
    Get information about investments
    3
    10
    3
    4
    7
    8
    1
    4
    Learn the process and benefits of rollovers
    4
    Learn how we can help you do a rollover
    5
    4
    Learn about the Vanguard story
    6
    Find out about Vanguard’s reputation
    7
    5
    7
    Learn why our mutual funds are great
    Find out if there are fees to do a rollover
    8
    2
    Transfer my IRA to Vanguard
    9
    5
    10
    Invest in simplified investing solutions
    © 2010 The Vanguard Group Inc. All rights reserved.
    29
  • 31. Rollover my 401(k) to Vanguard
    1
    Rollover 401(k) plans into Vanguard IRAs
    Get investment recommendations
    2
    Get information about investments
    3
    10
    3
    4
    7
    8
    1
    4
    Learn the process and benefits of rollovers
    4
    Learn how we can help you do a rollover
    5
    4
    Learn about the Vanguard story
    6
    Find out about Vanguard’s reputation
    7
    5
    7
    Learn why our mutual funds are great
    Find out if there are fees to do a rollover
    8
    2
    Transfer my IRA to Vanguard
    9
    5
    10
    Invest in simplified investing solutions
    © 2010 The Vanguard Group Inc. All rights reserved.
    30
  • 32. Capability Strategy Sheet
    Ensures that project teams are aware of the full scope of the capability and what is most important
    Helps sponsors to stay focused on tasks and their priorities rather than design decisions
    Supports controlled evolution of capabilities by providing a stable framework to evaluate success or failure
    © 2010 The Vanguard Group Inc. All rights reserved.
    31
  • 33. © 2010 The Vanguard Group Inc. All rights reserved.
    32
    tasks
    Monitor my investments
    Find out how much money I’ve made
    Check the status of transactions
    Am I on track to reach my goal?
    Check my balance
  • 34. © 2010 The Vanguard Group Inc. All rights reserved.
    33
    capabilities
    Web
    Print
    Phone
    tasks
    Monitor my investments
    Find out how much money I’ve made
    Check the status of transactions
    Am I on track to reach my goal?
    Check my balance
  • 35. © 2010 The Vanguard Group Inc. All rights reserved.
    34
    capabilities
    Web
    Print
    Phone
    tasks
    Monitor my investments
    Find out how much money I’ve made
    Check the status of transactions
    Am I on track to reach my goal?
    Check my balance
    Client Homepage
    Account Balances
    Statement
    Statement
    Balances call
  • 36. Experience Strategy Map
    Shows which capabilities support which client tasks across all channels – useful as we think about consistency of the experience
    Shows the health of the entire experience - helping sponsors prioritize which capabilities should be improved
    © 2010 The Vanguard Group Inc. All rights reserved.
    35
  • 37. Look daunting but its composed of simple elements
    © 2010 The Vanguard Group Inc. All rights reserved.
    36
    http://en.wikipedia.org/wiki/Mandelbrot_set
  • 38. © 2010 The Vanguard Group Inc. All rights reserved.
    37
    We need our business partners to spread the idea throughout the organization
    http://www.flickr.com/photos/63197350@N00/471062320/
  • 39. Helping the business …
    … to reframe their ideas
    http://commons.wikimedia.org/wiki/File:Two_silhouette_profile_or_a_white_vase.jpg
    © 2010 The Vanguard Group Inc. All rights reserved.
    38
  • 40. The same goals, tasks & emotions can often describe the current and future state
    http://yearofadventure.wordpress.com/2008/09/16/ode-to-my-triptik/
    © 2010 The Vanguard Group Inc. All rights reserved.
    39
    http://www.flickr.com/photos/rapo/2251688164/
  • 41. The journey is as important as the destination
    © 2010 The Vanguard Group Inc. All rights reserved.
    40
    http://www.flickr.com/photos/quitelucid/246647500/
  • 42. Richard Dalton
    Rob Weening
    richard_dalton@vanguard.com
    richard@mauvyrusset.com
    @mauvyrusset
    rob_weening@vanguard.com
    Thanks also to Steve Weber
    © 2010 The Vanguard Group Inc. All rights reserved.
    41