SlideShare a Scribd company logo
1 of 35
Hello 👋🏻
James Barley,
UX Research
@AutoTraderLife
😀
@jamesbarley
@jamesbarley
Text Text
New Car
IBET
B2C Buying
Experience
Finance
UX research @ Auto Trader
B2B Service
Design
UX research for
the masses
@jamesbarley
Why we started
What we’ve been doing
The impact
UX research for the masses
5@jamesbarley
Why we started
democratising
research
@jamesbarley
Why we started democratising research
Build the profile and engagement
in research
@jamesbarley
Why we started democratising research
Build the profile and engagement
in research
Educate about the role and benefits of
using evidence in design decisions
@jamesbarley
Why we started democratising research
Build the profile and engagement
in research
Educate about the role and benefits of
using evidence in design decisions
Get research to land and create an
evidence-led culture
@jamesbarley
10@jamesbarley
What we’ve
been doing
50% evidence
50% engagement
What we’ve been doing
@jamesbarley
What we’ve been doing
12
Research as a team
@jamesbarley
What we’ve been doing
Task 1: New Car – Live website (mobile)
5
New Car / Finance - lab study 28 Feb 2019
Task description
This task will enable us to observe the participants using the live product in
the lab for the first time. They will be asked to find a car that matches what
they are looking for / have currently bought, using the same criteria.
NBthis task will be alternated with Task 2.
Task goals
This task will aim to answer the following questions:
• How od they interact with search, and why do they choose a specific car
from the results?
• Are we presenting enough / the right info on the FPA?
• Are there any other pain points in the journey that we have not yet
observed?
• The primary objective of this task is to generate ideas and hypotheses for
further optimisation of the New Car journey
Est task duration: 10 mins
Before
@jamesbarley
Section title
14
During
@jamesbarley
Section title
15
After
@jamesbarley
What we’ve been doing
16
Research as a team
Training and access to the
right tools
@jamesbarley
17
Now it’s your turn!
1. Teams of 4
2. Discuss and vote on
which project to focus on
3. Create a test plan for the
project
4. 1minute showcase
per team
UX research
@jamesbarley
Internal T&D
Section title
18
Autotrader
Feb 2018
@jamesbarley
Access to tools
What we’ve been doing
19
10% time
@jamesbarley
💡💡💡💡👊👊👊👊
What we’ve been doing
20
Research as a team
Training in methods, and access to the
right tools
Continuous internal PR
@jamesbarley
Section title
21
@jamesbarley
Showcase,
showcase,
showcase
Section title
Socialise through
social
@jamesbarley
Section title
23
@jamesbarley
Solve other
problems
@jamesbarley
Tangible impacts
Tangible impacts
Built the profile of the team as the
experts in audience behaviour
@jamesbarley
Tangible impacts
Built the profile of the team as the
experts in audience behaviour
Engaged and evidence-led squads
@jamesbarley
Get 25% of them on board
Section title
27
Tangible impacts
@jamesbarley
New Car in Quick Search
Increased New Car searches by
155%
Evidence-led testing
28
Winner
Red button execution increased New Car searches by
393%
Evidence and outcomes-led planning
Goals / OKRs
Hypotheses
Experiments &
projects
@jamesbarley
Tangible impacts
Built the profile of the team as the
experts in audience behaviour
Engaged and evidence-led squads
Evidence-led backlog is yielding more
(and bigger) winners
@jamesbarley
‘Brand New’ toggle
Increased Brand New searches in ‘All cars’ search by
30%
Evidence-led testing
31
Winner
Test where you can, then iterate
Winner
Search typography
CTR for Deals adverts increased
12%
Section title
Pipeline ~
6 months of tests
@jamesbarley
We started with the simple goal to get research to
land, and make a difference
Our approach: 50% evidence, 50% engagement
We’ve made good progress, but it’s an
ongoing effort
In summary
@jamesbarley
Thanks for listening 👍🏻

More Related Content

What's hot

Adversarial to Harmonious: Building the Developer/UX Connection
Adversarial to Harmonious: Building the Developer/UX ConnectionAdversarial to Harmonious: Building the Developer/UX Connection
Adversarial to Harmonious: Building the Developer/UX ConnectionUXPA International
 
Building a UX Process at Salesforce that Promotes Focus and Creativity
Building a UX Process at Salesforce that Promotes Focus and CreativityBuilding a UX Process at Salesforce that Promotes Focus and Creativity
Building a UX Process at Salesforce that Promotes Focus and Creativityuxpin
 
From Product Requirements to Hypotheses
From Product Requirements to HypothesesFrom Product Requirements to Hypotheses
From Product Requirements to Hypothesesuxpin
 
Calculating the ROI of UX with Standard Financial Models
Calculating the ROI of UX with Standard Financial ModelsCalculating the ROI of UX with Standard Financial Models
Calculating the ROI of UX with Standard Financial Modelsuxpin
 
Building & Sustaining Successful UX Teams
Building & Sustaining Successful UX TeamsBuilding & Sustaining Successful UX Teams
Building & Sustaining Successful UX Teamsuxpin
 
The tiny internal agency
The tiny internal agencyThe tiny internal agency
The tiny internal agencyZenan Liu
 
Practical UX Research for the Enterprise
Practical UX Research for the EnterprisePractical UX Research for the Enterprise
Practical UX Research for the Enterpriseuxpin
 
Sharing the Love: Democratising Research at MoneySuperMarket
Sharing the Love: Democratising Research at MoneySuperMarketSharing the Love: Democratising Research at MoneySuperMarket
Sharing the Love: Democratising Research at MoneySuperMarketUserZoom
 
Embracing OOUX for Better Projects and Happier Teams
Embracing OOUX for Better Projects and Happier TeamsEmbracing OOUX for Better Projects and Happier Teams
Embracing OOUX for Better Projects and Happier TeamsCaroline Sober-James
 
Architecting Your UX Career: Interview and Presentation Techniques to Land Yo...
Architecting Your UX Career: Interview and Presentation Techniques to Land Yo...Architecting Your UX Career: Interview and Presentation Techniques to Land Yo...
Architecting Your UX Career: Interview and Presentation Techniques to Land Yo...UXPA International
 
#flashtest: User Research Live
#flashtest: User Research Live#flashtest: User Research Live
#flashtest: User Research LiveUXPA Boston
 
Designing a Single Experience for Different Users
Designing a Single Experience for Different UsersDesigning a Single Experience for Different Users
Designing a Single Experience for Different UsersUXDXConf
 
Making Research a UX Team Sport
Making Research a UX Team SportMaking Research a UX Team Sport
Making Research a UX Team SportUserZoom
 
Applying UX Principles As A Product Owner
Applying UX Principles As A Product OwnerApplying UX Principles As A Product Owner
Applying UX Principles As A Product OwnerUXDXConf
 
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...UserZoom
 
UX Maturity Models
UX Maturity Models   UX Maturity Models
UX Maturity Models Gena Drahun
 
Building Products Your Customers Love with Empathy and Human Insights
Building Products Your Customers Love with Empathy and Human InsightsBuilding Products Your Customers Love with Empathy and Human Insights
Building Products Your Customers Love with Empathy and Human InsightsAggregage
 
UX STRAT USA 2021: Calvin Robertson, Best Buy
UX STRAT USA 2021: Calvin Robertson, Best BuyUX STRAT USA 2021: Calvin Robertson, Best Buy
UX STRAT USA 2021: Calvin Robertson, Best BuyUX STRAT
 
Retail UX in 2020: How to stay on top of changing customer behaviors
Retail UX in 2020: How to stay on top of changing customer behaviorsRetail UX in 2020: How to stay on top of changing customer behaviors
Retail UX in 2020: How to stay on top of changing customer behaviorsUserZoom
 
Building a UX team
Building a UX teamBuilding a UX team
Building a UX teamNorthernUX
 

What's hot (20)

Adversarial to Harmonious: Building the Developer/UX Connection
Adversarial to Harmonious: Building the Developer/UX ConnectionAdversarial to Harmonious: Building the Developer/UX Connection
Adversarial to Harmonious: Building the Developer/UX Connection
 
Building a UX Process at Salesforce that Promotes Focus and Creativity
Building a UX Process at Salesforce that Promotes Focus and CreativityBuilding a UX Process at Salesforce that Promotes Focus and Creativity
Building a UX Process at Salesforce that Promotes Focus and Creativity
 
From Product Requirements to Hypotheses
From Product Requirements to HypothesesFrom Product Requirements to Hypotheses
From Product Requirements to Hypotheses
 
Calculating the ROI of UX with Standard Financial Models
Calculating the ROI of UX with Standard Financial ModelsCalculating the ROI of UX with Standard Financial Models
Calculating the ROI of UX with Standard Financial Models
 
Building & Sustaining Successful UX Teams
Building & Sustaining Successful UX TeamsBuilding & Sustaining Successful UX Teams
Building & Sustaining Successful UX Teams
 
The tiny internal agency
The tiny internal agencyThe tiny internal agency
The tiny internal agency
 
Practical UX Research for the Enterprise
Practical UX Research for the EnterprisePractical UX Research for the Enterprise
Practical UX Research for the Enterprise
 
Sharing the Love: Democratising Research at MoneySuperMarket
Sharing the Love: Democratising Research at MoneySuperMarketSharing the Love: Democratising Research at MoneySuperMarket
Sharing the Love: Democratising Research at MoneySuperMarket
 
Embracing OOUX for Better Projects and Happier Teams
Embracing OOUX for Better Projects and Happier TeamsEmbracing OOUX for Better Projects and Happier Teams
Embracing OOUX for Better Projects and Happier Teams
 
Architecting Your UX Career: Interview and Presentation Techniques to Land Yo...
Architecting Your UX Career: Interview and Presentation Techniques to Land Yo...Architecting Your UX Career: Interview and Presentation Techniques to Land Yo...
Architecting Your UX Career: Interview and Presentation Techniques to Land Yo...
 
#flashtest: User Research Live
#flashtest: User Research Live#flashtest: User Research Live
#flashtest: User Research Live
 
Designing a Single Experience for Different Users
Designing a Single Experience for Different UsersDesigning a Single Experience for Different Users
Designing a Single Experience for Different Users
 
Making Research a UX Team Sport
Making Research a UX Team SportMaking Research a UX Team Sport
Making Research a UX Team Sport
 
Applying UX Principles As A Product Owner
Applying UX Principles As A Product OwnerApplying UX Principles As A Product Owner
Applying UX Principles As A Product Owner
 
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
 
UX Maturity Models
UX Maturity Models   UX Maturity Models
UX Maturity Models
 
Building Products Your Customers Love with Empathy and Human Insights
Building Products Your Customers Love with Empathy and Human InsightsBuilding Products Your Customers Love with Empathy and Human Insights
Building Products Your Customers Love with Empathy and Human Insights
 
UX STRAT USA 2021: Calvin Robertson, Best Buy
UX STRAT USA 2021: Calvin Robertson, Best BuyUX STRAT USA 2021: Calvin Robertson, Best Buy
UX STRAT USA 2021: Calvin Robertson, Best Buy
 
Retail UX in 2020: How to stay on top of changing customer behaviors
Retail UX in 2020: How to stay on top of changing customer behaviorsRetail UX in 2020: How to stay on top of changing customer behaviors
Retail UX in 2020: How to stay on top of changing customer behaviors
 
Building a UX team
Building a UX teamBuilding a UX team
Building a UX team
 

Similar to UX Research for the Masses

Building a UX Brand
Building a UX BrandBuilding a UX Brand
Building a UX BrandBob Thomas
 
How To Be An Unofficial Agile Transformation Catalyst
How To Be An Unofficial Agile Transformation CatalystHow To Be An Unofficial Agile Transformation Catalyst
How To Be An Unofficial Agile Transformation CatalystSynerzip
 
Conducting Effective Job Interviews.pptx
Conducting Effective Job Interviews.pptxConducting Effective Job Interviews.pptx
Conducting Effective Job Interviews.pptxGina Meronek
 
Blend It 2018: Blended Learning in Our Library Learning Landscape (January 2018)
Blend It 2018: Blended Learning in Our Library Learning Landscape (January 2018)Blend It 2018: Blended Learning in Our Library Learning Landscape (January 2018)
Blend It 2018: Blended Learning in Our Library Learning Landscape (January 2018)ALATechSource
 
No frameworks: How we can take agile back
No frameworks: How we can take agile backNo frameworks: How we can take agile back
No frameworks: How we can take agile backScott W. Ambler
 
Who has time for research?!!
Who has time for research?!!Who has time for research?!!
Who has time for research?!!Amir Ansari
 
Turning a Startup to a Design-Driven Company
Turning a Startup to a Design-Driven CompanyTurning a Startup to a Design-Driven Company
Turning a Startup to a Design-Driven CompanyTanya Zavialova
 
LEADS VS. TRIALS: A CASE STUDY ON WHEN YOU NEED CONTENT MARKETING AND WHEN YO...
LEADS VS. TRIALS: A CASE STUDY ON WHEN YOU NEED CONTENT MARKETING AND WHEN YO...LEADS VS. TRIALS: A CASE STUDY ON WHEN YOU NEED CONTENT MARKETING AND WHEN YO...
LEADS VS. TRIALS: A CASE STUDY ON WHEN YOU NEED CONTENT MARKETING AND WHEN YO...HubSpot
 
Michelle Kempner, BuzzFeed 5 ways to crush on a platform presentation
Michelle Kempner, BuzzFeed  5 ways to crush on a platform presentationMichelle Kempner, BuzzFeed  5 ways to crush on a platform presentation
Michelle Kempner, BuzzFeed 5 ways to crush on a platform presentationHilary Ip
 
“Digital Transformation: Going Beyond Buzzwords” - ConveyUX Boston 2019 Keyno...
“Digital Transformation: Going Beyond Buzzwords” - ConveyUX Boston 2019 Keyno...“Digital Transformation: Going Beyond Buzzwords” - ConveyUX Boston 2019 Keyno...
“Digital Transformation: Going Beyond Buzzwords” - ConveyUX Boston 2019 Keyno...Jaime Levy Consulting
 
Get Going with Users WhatUsersDo Workshop 11 Dec 2014
Get Going with Users WhatUsersDo Workshop 11 Dec 2014Get Going with Users WhatUsersDo Workshop 11 Dec 2014
Get Going with Users WhatUsersDo Workshop 11 Dec 2014Lee Duddell
 
Designed by Committee: An Analytics and User-Focused Approach to the Overhaul...
Designed by Committee: An Analytics and User-Focused Approach to the Overhaul...Designed by Committee: An Analytics and User-Focused Approach to the Overhaul...
Designed by Committee: An Analytics and User-Focused Approach to the Overhaul...nealw6971
 
Abbytheiaportfolioworkshop 120816214121-phpapp02 (1)
Abbytheiaportfolioworkshop 120816214121-phpapp02 (1)Abbytheiaportfolioworkshop 120816214121-phpapp02 (1)
Abbytheiaportfolioworkshop 120816214121-phpapp02 (1)Luis Trullenque
 
Lean UX in the Enterprise
Lean UX in the EnterpriseLean UX in the Enterprise
Lean UX in the EnterpriseAustin Knight
 
The Future for Marketers - Strategy, Creativity and Technology
The Future for Marketers - Strategy, Creativity and TechnologyThe Future for Marketers - Strategy, Creativity and Technology
The Future for Marketers - Strategy, Creativity and TechnologyPaddy Moogan
 
Build the Right Product with Lean UX
Build the Right Product with Lean UXBuild the Right Product with Lean UX
Build the Right Product with Lean UXMike Long
 
Sneaking in Good UX Without a UX Budget - WordCamp Chicago 2017 - anthonydpaul
Sneaking in Good UX Without a UX Budget - WordCamp Chicago 2017 - anthonydpaulSneaking in Good UX Without a UX Budget - WordCamp Chicago 2017 - anthonydpaul
Sneaking in Good UX Without a UX Budget - WordCamp Chicago 2017 - anthonydpaulAnthony D. Paul
 
GA_LeanResearch
GA_LeanResearchGA_LeanResearch
GA_LeanResearchLiya James
 

Similar to UX Research for the Masses (20)

Building a UX Brand
Building a UX BrandBuilding a UX Brand
Building a UX Brand
 
Building a UX Brand
 Building a UX Brand Building a UX Brand
Building a UX Brand
 
How To Be An Unofficial Agile Transformation Catalyst
How To Be An Unofficial Agile Transformation CatalystHow To Be An Unofficial Agile Transformation Catalyst
How To Be An Unofficial Agile Transformation Catalyst
 
Conducting Effective Job Interviews.pptx
Conducting Effective Job Interviews.pptxConducting Effective Job Interviews.pptx
Conducting Effective Job Interviews.pptx
 
Blend It 2018: Blended Learning in Our Library Learning Landscape (January 2018)
Blend It 2018: Blended Learning in Our Library Learning Landscape (January 2018)Blend It 2018: Blended Learning in Our Library Learning Landscape (January 2018)
Blend It 2018: Blended Learning in Our Library Learning Landscape (January 2018)
 
No frameworks: How we can take agile back
No frameworks: How we can take agile backNo frameworks: How we can take agile back
No frameworks: How we can take agile back
 
Who has time for research?!!
Who has time for research?!!Who has time for research?!!
Who has time for research?!!
 
Turning a Startup to a Design-Driven Company
Turning a Startup to a Design-Driven CompanyTurning a Startup to a Design-Driven Company
Turning a Startup to a Design-Driven Company
 
LEADS VS. TRIALS: A CASE STUDY ON WHEN YOU NEED CONTENT MARKETING AND WHEN YO...
LEADS VS. TRIALS: A CASE STUDY ON WHEN YOU NEED CONTENT MARKETING AND WHEN YO...LEADS VS. TRIALS: A CASE STUDY ON WHEN YOU NEED CONTENT MARKETING AND WHEN YO...
LEADS VS. TRIALS: A CASE STUDY ON WHEN YOU NEED CONTENT MARKETING AND WHEN YO...
 
Michelle Kempner, BuzzFeed 5 ways to crush on a platform presentation
Michelle Kempner, BuzzFeed  5 ways to crush on a platform presentationMichelle Kempner, BuzzFeed  5 ways to crush on a platform presentation
Michelle Kempner, BuzzFeed 5 ways to crush on a platform presentation
 
“Digital Transformation: Going Beyond Buzzwords” - ConveyUX Boston 2019 Keyno...
“Digital Transformation: Going Beyond Buzzwords” - ConveyUX Boston 2019 Keyno...“Digital Transformation: Going Beyond Buzzwords” - ConveyUX Boston 2019 Keyno...
“Digital Transformation: Going Beyond Buzzwords” - ConveyUX Boston 2019 Keyno...
 
Get Going with Users WhatUsersDo Workshop 11 Dec 2014
Get Going with Users WhatUsersDo Workshop 11 Dec 2014Get Going with Users WhatUsersDo Workshop 11 Dec 2014
Get Going with Users WhatUsersDo Workshop 11 Dec 2014
 
Designed by Committee: An Analytics and User-Focused Approach to the Overhaul...
Designed by Committee: An Analytics and User-Focused Approach to the Overhaul...Designed by Committee: An Analytics and User-Focused Approach to the Overhaul...
Designed by Committee: An Analytics and User-Focused Approach to the Overhaul...
 
Abbytheiaportfolioworkshop 120816214121-phpapp02 (1)
Abbytheiaportfolioworkshop 120816214121-phpapp02 (1)Abbytheiaportfolioworkshop 120816214121-phpapp02 (1)
Abbytheiaportfolioworkshop 120816214121-phpapp02 (1)
 
Lean UX in the Enterprise
Lean UX in the EnterpriseLean UX in the Enterprise
Lean UX in the Enterprise
 
The Future for Marketers - Strategy, Creativity and Technology
The Future for Marketers - Strategy, Creativity and TechnologyThe Future for Marketers - Strategy, Creativity and Technology
The Future for Marketers - Strategy, Creativity and Technology
 
Build the Right Product with Lean UX
Build the Right Product with Lean UXBuild the Right Product with Lean UX
Build the Right Product with Lean UX
 
Sneaking in Good UX Without a UX Budget - WordCamp Chicago 2017 - anthonydpaul
Sneaking in Good UX Without a UX Budget - WordCamp Chicago 2017 - anthonydpaulSneaking in Good UX Without a UX Budget - WordCamp Chicago 2017 - anthonydpaul
Sneaking in Good UX Without a UX Budget - WordCamp Chicago 2017 - anthonydpaul
 
GA_LeanResearch
GA_LeanResearchGA_LeanResearch
GA_LeanResearch
 
Flaneur
Flaneur Flaneur
Flaneur
 

More from UserZoom

[Webinar] Transitioning to Remote Research
[Webinar] Transitioning to Remote Research[Webinar] Transitioning to Remote Research
[Webinar] Transitioning to Remote ResearchUserZoom
 
Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...
Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...
Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...UserZoom
 
[19.2 UserZoom Spring Release Webinar] Get Card Sort Insights with Confidence
[19.2 UserZoom Spring Release Webinar] Get Card Sort Insights with Confidence[19.2 UserZoom Spring Release Webinar] Get Card Sort Insights with Confidence
[19.2 UserZoom Spring Release Webinar] Get Card Sort Insights with ConfidenceUserZoom
 
Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...
Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...
Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...UserZoom
 
How to Work Collaboratively on the User Experience
How to Work Collaboratively on the User ExperienceHow to Work Collaboratively on the User Experience
How to Work Collaboratively on the User ExperienceUserZoom
 
How to Help Newbies Run UX Tests
How to Help Newbies Run UX TestsHow to Help Newbies Run UX Tests
How to Help Newbies Run UX TestsUserZoom
 
Ready to Democratise UX Insights?
Ready to Democratise UX Insights?Ready to Democratise UX Insights?
Ready to Democratise UX Insights?UserZoom
 
BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...
BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...
BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...UserZoom
 
How to Master UserZoom’s Latest Study Builder & Extract Meaningful UX Insights
How to Master UserZoom’s Latest Study Builder & Extract Meaningful UX InsightsHow to Master UserZoom’s Latest Study Builder & Extract Meaningful UX Insights
How to Master UserZoom’s Latest Study Builder & Extract Meaningful UX InsightsUserZoom
 
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...UserZoom
 
How to Run Research in Agile Sprints by Democratizing It Across Teams
How to Run Research in Agile Sprints by Democratizing It Across TeamsHow to Run Research in Agile Sprints by Democratizing It Across Teams
How to Run Research in Agile Sprints by Democratizing It Across TeamsUserZoom
 
[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...
[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...
[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...UserZoom
 
Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...
Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...
Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...UserZoom
 
Telling Your UX Metrics Story - The 21st Century Metrics Model
Telling Your UX Metrics Story - The 21st Century Metrics ModelTelling Your UX Metrics Story - The 21st Century Metrics Model
Telling Your UX Metrics Story - The 21st Century Metrics ModelUserZoom
 
[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...
[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...
[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...UserZoom
 
[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...
[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...
[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...UserZoom
 
A Forrester Study: The Total Economic Impact™ Of UserZoom
A Forrester Study: The Total Economic Impact™ Of UserZoomA Forrester Study: The Total Economic Impact™ Of UserZoom
A Forrester Study: The Total Economic Impact™ Of UserZoomUserZoom
 
Optimize Your Strategy - The Power of Combining Design Thinking and ROI Metrics
Optimize Your Strategy - The Power of Combining Design Thinking and ROI MetricsOptimize Your Strategy - The Power of Combining Design Thinking and ROI Metrics
Optimize Your Strategy - The Power of Combining Design Thinking and ROI MetricsUserZoom
 
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...UserZoom
 
Telling the Full Story: Adding Qualitative Data To Executive Dashboards
Telling the Full Story: Adding Qualitative Data To Executive DashboardsTelling the Full Story: Adding Qualitative Data To Executive Dashboards
Telling the Full Story: Adding Qualitative Data To Executive DashboardsUserZoom
 

More from UserZoom (20)

[Webinar] Transitioning to Remote Research
[Webinar] Transitioning to Remote Research[Webinar] Transitioning to Remote Research
[Webinar] Transitioning to Remote Research
 
Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...
Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...
Moderated vs Unmoderated Research: It’s time to say ELMO (Enough, let’s move ...
 
[19.2 UserZoom Spring Release Webinar] Get Card Sort Insights with Confidence
[19.2 UserZoom Spring Release Webinar] Get Card Sort Insights with Confidence[19.2 UserZoom Spring Release Webinar] Get Card Sort Insights with Confidence
[19.2 UserZoom Spring Release Webinar] Get Card Sort Insights with Confidence
 
Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...
Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...
Benchmarking Mini-series Part #2: Conducting Quick, Cost-Effective UX Benchma...
 
How to Work Collaboratively on the User Experience
How to Work Collaboratively on the User ExperienceHow to Work Collaboratively on the User Experience
How to Work Collaboratively on the User Experience
 
How to Help Newbies Run UX Tests
How to Help Newbies Run UX TestsHow to Help Newbies Run UX Tests
How to Help Newbies Run UX Tests
 
Ready to Democratise UX Insights?
Ready to Democratise UX Insights?Ready to Democratise UX Insights?
Ready to Democratise UX Insights?
 
BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...
BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...
BENCHMARKING MINI-SERIES PART #1: Proving Value & Quantifying the Impact of U...
 
How to Master UserZoom’s Latest Study Builder & Extract Meaningful UX Insights
How to Master UserZoom’s Latest Study Builder & Extract Meaningful UX InsightsHow to Master UserZoom’s Latest Study Builder & Extract Meaningful UX Insights
How to Master UserZoom’s Latest Study Builder & Extract Meaningful UX Insights
 
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
Exploring UX in the Enterprise: The Industry’s Hottest Trends & Insights from...
 
How to Run Research in Agile Sprints by Democratizing It Across Teams
How to Run Research in Agile Sprints by Democratizing It Across TeamsHow to Run Research in Agile Sprints by Democratizing It Across Teams
How to Run Research in Agile Sprints by Democratizing It Across Teams
 
[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...
[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...
[Product Release Highlight] Seamlessly Discover and Share Your User Experienc...
 
Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...
Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...
Hold on to Your Hats: The Scaled Agile Framework (SAFe) Might Actually Be a G...
 
Telling Your UX Metrics Story - The 21st Century Metrics Model
Telling Your UX Metrics Story - The 21st Century Metrics ModelTelling Your UX Metrics Story - The 21st Century Metrics Model
Telling Your UX Metrics Story - The 21st Century Metrics Model
 
[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...
[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...
[Product Release Highlight] Accelerate Your UX Research - Gaining Fast & Flex...
 
[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...
[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...
[UserZoom Webinar] The Online Shopping Experience: Benchmarking Four Ecommerc...
 
A Forrester Study: The Total Economic Impact™ Of UserZoom
A Forrester Study: The Total Economic Impact™ Of UserZoomA Forrester Study: The Total Economic Impact™ Of UserZoom
A Forrester Study: The Total Economic Impact™ Of UserZoom
 
Optimize Your Strategy - The Power of Combining Design Thinking and ROI Metrics
Optimize Your Strategy - The Power of Combining Design Thinking and ROI MetricsOptimize Your Strategy - The Power of Combining Design Thinking and ROI Metrics
Optimize Your Strategy - The Power of Combining Design Thinking and ROI Metrics
 
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
Competitive UX Benchmarking: How Four Healthcare Insurance Sites Scored Acros...
 
Telling the Full Story: Adding Qualitative Data To Executive Dashboards
Telling the Full Story: Adding Qualitative Data To Executive DashboardsTelling the Full Story: Adding Qualitative Data To Executive Dashboards
Telling the Full Story: Adding Qualitative Data To Executive Dashboards
 

Recently uploaded

New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 

Recently uploaded (20)

New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort ServiceHot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 

UX Research for the Masses

Editor's Notes

  1. James I’ve been heading up UX Research @ AT for the last couple of years I kind of feel like the first act on at Glastonbury today A lot of great speakers to follow - you're in for a good day Just wanted to say a couple of thank-yous before I start 1stly - to you folks for coming along to listen. Don't think of myself as a thought leader Passionate practitioner - find it humbling people come to listen to me & the Userzoom for having me here
  2. My team are embedded in our Buying Experience Tribe For the last year our focus has been What we call Blue Cards Tribe's big bets for the next 12-18 months New Car Finance Core
  3. We’ve worked hard to democratise research What I mean by democratise To make it more accessible
  4. Talk about why we bothered the effort we’ve put in has been for a v specific reason How we’ve approached this And what difference it’s made
  5. Of course we want to share how awesome what we do is with everyone But there’s a strategy behind why we have made research accessible to as many people as possible A means to an end
  6. When I started at AT we were at Ground Zero in terms of research. I was the only researcher Organization that paid lip service to research, but was in reality fueled by opinion. Delivery-led culture Get onto people’s radars – make them aware. Get them interested, inquisitive, curious, engaged Get them talking – foundations for creating advocates and ‘believers’
  7. Show them what real research is, and is all about. Educate them that real research is not asking if users ‘like’ a new feature, and would they use it in the future Educate them that using evidence gives you a greater chance of success, since it moves you closer to the truth Ultimately to try to slay the hippo
  8. This is the primary objective truth be told To make sure the work we did would make a difference Our primary goal isn’t to have designers and product leads doing their own lab studies The democratisation of research is categorically not intended to replace the researcher If anything it is the opposite – if people understand why we do it, and the impact it can have Then we can hopefully move from contributors to the product and design leads, to become peers
  9. So, what have we been up to?
  10. This is the mantra Spend half the time looking outside the organisation (at our users) And half the time looking in If we understand and empathise with our stakeholders we can frame our work around how it benefits them
  11. We work in squads I'm aligned to our New Car squad i.e. Product Lead, Design Lead, Tech lead, engineers, QA, delivery leads etc I don't just 'bring them on the journey' I go on it with them Before during after, Exercise in creating common ground Collaboration, inspiration, share ownership of goals and OKRs
  12. Work with the team to agree what’s the highest priority Usually driven by product lead Then work with the squad (product lead, design lead, tech lead) to bottom what they want to learn Take the lead, shape the tasks Making sure I check in with them The squad can help to fill in any blanks Or throw in any additional questions they've got
  13. During the study, we invite as many stakeholders as possible Entire squads Product, design, tech, delivery, Take notes Share and discuss observations at the end of each session
  14. Evaluative testing Delta Next Framework – matrix Researchers don’t recommend – we find what needs fixing, and help to contextualise that But it's the whole squad that generates the ideas and hypotheses Shared understanding, shared ownership of the solution Collaborative workshops for whole squad – often including colleagues from different squads Inclusive approach – broad spectrum of ideas e.g. New Car - backlog of ideas and hypotheses that should see us through about 6 months of experimentation
  15. Training sessions. Guerilla testing, agile testing with UZ, UX analytics with CS
  16. Internal coaching sessions Basics in conducting user testing Bi-monthly drop in sessions Trained over 80 colleagues part of the grad induction programme Experimentation Guild Part operational Part mentoring
  17. Our partners UZ and ContentSquare have come in and helped me to train product, design, data people, QA, delivery leads Goal… build their awareness/understanding of the tools We don’t expect them to be suddenly spinning up their own studies We want them to know when to ask the right questions To challenge if there's no data or testing happening They now know what we can test And how quick and easy it support research in getting involved at every step of the way
  18. 10% time We used it for our PDPs I’ve currently got 4 mentees doing research in their 10% time 2 are doing it because they might change career It’s really flattering that these guys are committed enough Made a point And the quality of their work has been really high
  19. Ongoing awareness campaign Engagement at all levels…
  20. I’m naturally quite introverted But have had to learn to always look for how we can build attention and awareness Present playbacks, company show cases, tribe days, guild meetings Get in front of steering committees Even presenting to the the board If there’s a chance to plug in a laptop we’ll be there And we don’t stop there…
  21. We hammer Yammer
  22. And work with other teams to help solve their problems using the same methods we use in our day to day work Rather than tell people how fun it is to solve problems like we do We show them The People team are big advocates Discovery Day for Returnship programme
  23. So what’s been to outcome of all of this? Has it helped move the needle for us in the way that we’d hoped?
  24. Well yes. We are the go-to in product and tech when it comes to consumer behaviour even with our sales and service teams A good measure is how often you get a request for some research from someone you’ve never heard of People are talking about research in a good way Demand is far outstripping supply – And so the new measure is how we frequently we have to say ‘no’
  25. This has been a real indicator
  26. The key has been to get 25% on board Then the rest will follow Worked out who were already advocates of using data and evidence Initially focused on building close relationships with them
  27. You know you’ve hit the sweetspot When engineers are taking the evidence And are writing their own tests – hypotheses with evidence behind them New Car – goal This was a test done by them – they’d even gone a bit rogue Political – they decided to ask forgiveness rather than permission Sounds pretty obvious – was worth worth a test This variant increased new car searches by 155%
  28. Planning processes across the tribe Evidence backed into it New Car – evolved from having a 30% ‘continual improvement’ allocation of resource To now… we’ve not built anything new since pre-Xmas Optimising what we’ve got This is a complete turnaround It’s taken nearly 2 years to get here, old habits die hard The road has been bumpy Taken a mixture of patience, resilience And inevitably a lot of compromise
  29. And now, the squads doing this are cooking on gas Recently it’s been winner after winner