In our spring edition of ResearchOps Berlin we will likewise talk about growing and maturing.
Our host FlixBus will give us insights into how they started UX in their organization and how they accelerated research in terms of such as their team set-up or research methods. Luky Primadani, Katja Borchert, Carolina Schomer and Pietro Romeo will provide us with use cases and how they see the next steps in becoming more UX mature.
Have you always wanted to do more UX research but thought it might cost too much, or take too much time? Learn how a few UX ers, Jodi Bollaert and Megan Schwarz, at Team Detroit (advertising) in Michigan, have used several fast & cheap web-based tools & methodologies to glean valuable user insights for digital automotive projects.
Remote Fieldwork: How observational studies elevated usability at AutoTrader.comEmily Schroeder
While traditional task-based usability research provides invaluable insights, sometimes expanding your practice to include additional methodologies allows usability to have greater influence in an organization. In this session, you will learn how adding remote observational studies enabled the team at AutoTrader.com to become more involved in projects from the beginning.
Introduction to usability and usability testing as a discipline, followed by how to do guerilla usability testing. Presented at Duke Tech Expo April 13, 2018 with co-author Lauren Hirsh, with content from a prior collaborative presentation of hers.
Have you always wanted to do more UX research but thought it might cost too much, or take too much time? Learn how a few UX ers, Jodi Bollaert and Megan Schwarz, at Team Detroit (advertising) in Michigan, have used several fast & cheap web-based tools & methodologies to glean valuable user insights for digital automotive projects.
Remote Fieldwork: How observational studies elevated usability at AutoTrader.comEmily Schroeder
While traditional task-based usability research provides invaluable insights, sometimes expanding your practice to include additional methodologies allows usability to have greater influence in an organization. In this session, you will learn how adding remote observational studies enabled the team at AutoTrader.com to become more involved in projects from the beginning.
Introduction to usability and usability testing as a discipline, followed by how to do guerilla usability testing. Presented at Duke Tech Expo April 13, 2018 with co-author Lauren Hirsh, with content from a prior collaborative presentation of hers.
Choosing the Right Research Methods for Your Project (webinar)Susan Mercer
It’s very easy for User Experience researchers to get stuck in the rut of using your favorite research methods for gathering information and getting user feedback. But, are you really gathering the best information that you can? Or are there other methods that are better suited for your project’s specific needs?
Or, if you’re just starting out – how do you know whether you should conduct interviews, run a survey or a card sort, or something different all together?
Don’t stress – in this webinar, we’ll cover the most popular user research methods and discuss their strengths and weaknesses. Each method shines in different circumstances, and we’ll highlight the factors that will make each successful. We will also present a structured approach to helping you choose the best method or methods for a particular situation.
Preference and Desirability Testing: Measuring Emotional Response to Guide De...Paul Doncaster
(From UPA 2011-Atlanta) Usability practitioners have a variety of methods and techniques to inform interaction design and identify usability problems. However, these tools are not as effective at evaluating the visceral and emotional response generated by visual design and aesthetics. This presentation will discuss why studying visual design is important, review considerations for preference and desirability testing and present two alternative approaches to user studies of visual designs in the form of case studies.
UXPA International 2013 The Note-Taker's Perspective UserWorks
Kristen Davis's and Dick Horst's 2013 UXPA International presentation on The Note-Taker's Perspective During Usability Testing: Recognizing What's Important, What’s Not.
User Experience Design (UX) is a hot term in software these days, but as a relatively new and evolving field there has been confusion as to what this discipline entails and how it relates to other design practices. In this talk, Dorothy will provide an overview of current user experience design and research best practices, touch on how these methods have evolved in recent years, and discuss what many practitioners believe to be core philosophies behind "User Experience Design" as an approach to software design. In addition, Dorothy will walk through a software product lifecycle using case study examples to illustrate how common UX methods can be leveraged to improve a product. The presentation will be followed by an open discussion about where User Experience Design methods parallel or counter other human factors and ergonomics practices.
Takeaways - Participants will walk away with a clear understanding of User Experience Design as a practice, an overview of current methods, and insight into how these practices might relate to broader human factors and ergonomics approaches.
Intimidated by conducting your own usability study? This session will give you the tools you need to conduct effective usability tests whether your participants are in the room or in a different country. The session includes practical techniques to successfully plan, prepare, and conduct your test and activities to help you become more confident with the entire process of usability testing. Finally, you’ll get tips on how to get the most useful results from your study.
Participants will also learn about:
Testing protocols
Types of usability testing and required vs. optional resources
Recruiting and scheduling usability tests
Non-disclosure and consent forms and their purposes
Pilot testing
Techniques for interacting with test participants
Current usability testing issues of interest (e.g. testing internationally, moderated vs. un-moderated, etc.)
Usability and User Experience Training Seminarlabecvar
This presentation describes a day-long seminar for giving participants an overview of best practices in usability design and research. Also included are several hand-on exercises to be done throughout the day to solidify participants' understanding of course concepts.
User Experience Design + Agile: The Good, The Bad, and the UglyJoshua Randall
There's a rumor going around that user experience design (UXD) and Agile don't play well together. In this talk, I'll explain that they do -- most of the time! Learn about the historical reasons for why these two disciplines sometimes butt heads, as well as the good/bad/ugly of various approaches to integrating design and development.
Day 2 slides from a two-day workshop on UX Foundations by Meg Kurdziolek and Karen Tang. Day 2 covered research methods that can be used throughout the design process to evaluate and validate design.
User Experience professionals are commonly called upon to fix a problematic design or help drive product enhancements. There is a wealth of research methods to help assess the success of an existing interface. But what about the early phases of a new product or concept? Do these same methods still apply? How can you best tailor your approach to gather useful input when your product and/or company are still in the formative stages?
For this presentation, Dorothy M. Danforth will discuss various low overhead, high-impact research methods available to Web Designers and UX professionals when creating new products, scenarios for when and how to use these methods, as well as general insights on how to get the most out of early stage R&D processes. Some illustrative examples and ideas from past product-concept research efforts will be provided.
Talking points to include:
• considerations when developing a UX focused research plan for a new product or concept
• how brand and corporate culture can impact and possibly drive interface decisions
• how the research process can identify organizational knowledge gaps (and vice versa)
• integrating UX research within the creative (visual design) and engineering processes
In the last episode of Putting Users in UX, Steven and Terry dove into the mechanics of effective user research.
We began with tips for planning your research, including setting research objectives, choosing the right research methods, and recruiting participants.
Then we got into conducting research: the set-up, facilitating the sessions, and guiding participants appropriately to ensure you’re getting the insights you need.
Finally, we showed you how to capture and analyze your findings so that your research can be easily understood and used by the rest of the project team.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Carol Smith
Presented at CodeMash 2013.
If this sounds familiar it is time to make big changes or look for a new job. Failing your users will only end badly. In this session we look at the assumptions that are all-too-often made about users, usability and the User Experience (UX). In response to each of these misguided statements Carol will provide a quick method you can conduct with little or no resources to debunk these myths.
Choosing the Right Research Methods for Your Project (webinar)Susan Mercer
It’s very easy for User Experience researchers to get stuck in the rut of using your favorite research methods for gathering information and getting user feedback. But, are you really gathering the best information that you can? Or are there other methods that are better suited for your project’s specific needs?
Or, if you’re just starting out – how do you know whether you should conduct interviews, run a survey or a card sort, or something different all together?
Don’t stress – in this webinar, we’ll cover the most popular user research methods and discuss their strengths and weaknesses. Each method shines in different circumstances, and we’ll highlight the factors that will make each successful. We will also present a structured approach to helping you choose the best method or methods for a particular situation.
Preference and Desirability Testing: Measuring Emotional Response to Guide De...Paul Doncaster
(From UPA 2011-Atlanta) Usability practitioners have a variety of methods and techniques to inform interaction design and identify usability problems. However, these tools are not as effective at evaluating the visceral and emotional response generated by visual design and aesthetics. This presentation will discuss why studying visual design is important, review considerations for preference and desirability testing and present two alternative approaches to user studies of visual designs in the form of case studies.
UXPA International 2013 The Note-Taker's Perspective UserWorks
Kristen Davis's and Dick Horst's 2013 UXPA International presentation on The Note-Taker's Perspective During Usability Testing: Recognizing What's Important, What’s Not.
User Experience Design (UX) is a hot term in software these days, but as a relatively new and evolving field there has been confusion as to what this discipline entails and how it relates to other design practices. In this talk, Dorothy will provide an overview of current user experience design and research best practices, touch on how these methods have evolved in recent years, and discuss what many practitioners believe to be core philosophies behind "User Experience Design" as an approach to software design. In addition, Dorothy will walk through a software product lifecycle using case study examples to illustrate how common UX methods can be leveraged to improve a product. The presentation will be followed by an open discussion about where User Experience Design methods parallel or counter other human factors and ergonomics practices.
Takeaways - Participants will walk away with a clear understanding of User Experience Design as a practice, an overview of current methods, and insight into how these practices might relate to broader human factors and ergonomics approaches.
Intimidated by conducting your own usability study? This session will give you the tools you need to conduct effective usability tests whether your participants are in the room or in a different country. The session includes practical techniques to successfully plan, prepare, and conduct your test and activities to help you become more confident with the entire process of usability testing. Finally, you’ll get tips on how to get the most useful results from your study.
Participants will also learn about:
Testing protocols
Types of usability testing and required vs. optional resources
Recruiting and scheduling usability tests
Non-disclosure and consent forms and their purposes
Pilot testing
Techniques for interacting with test participants
Current usability testing issues of interest (e.g. testing internationally, moderated vs. un-moderated, etc.)
Usability and User Experience Training Seminarlabecvar
This presentation describes a day-long seminar for giving participants an overview of best practices in usability design and research. Also included are several hand-on exercises to be done throughout the day to solidify participants' understanding of course concepts.
User Experience Design + Agile: The Good, The Bad, and the UglyJoshua Randall
There's a rumor going around that user experience design (UXD) and Agile don't play well together. In this talk, I'll explain that they do -- most of the time! Learn about the historical reasons for why these two disciplines sometimes butt heads, as well as the good/bad/ugly of various approaches to integrating design and development.
Day 2 slides from a two-day workshop on UX Foundations by Meg Kurdziolek and Karen Tang. Day 2 covered research methods that can be used throughout the design process to evaluate and validate design.
User Experience professionals are commonly called upon to fix a problematic design or help drive product enhancements. There is a wealth of research methods to help assess the success of an existing interface. But what about the early phases of a new product or concept? Do these same methods still apply? How can you best tailor your approach to gather useful input when your product and/or company are still in the formative stages?
For this presentation, Dorothy M. Danforth will discuss various low overhead, high-impact research methods available to Web Designers and UX professionals when creating new products, scenarios for when and how to use these methods, as well as general insights on how to get the most out of early stage R&D processes. Some illustrative examples and ideas from past product-concept research efforts will be provided.
Talking points to include:
• considerations when developing a UX focused research plan for a new product or concept
• how brand and corporate culture can impact and possibly drive interface decisions
• how the research process can identify organizational knowledge gaps (and vice versa)
• integrating UX research within the creative (visual design) and engineering processes
In the last episode of Putting Users in UX, Steven and Terry dove into the mechanics of effective user research.
We began with tips for planning your research, including setting research objectives, choosing the right research methods, and recruiting participants.
Then we got into conducting research: the set-up, facilitating the sessions, and guiding participants appropriately to ensure you’re getting the insights you need.
Finally, we showed you how to capture and analyze your findings so that your research can be easily understood and used by the rest of the project team.
Users are Losers! They’ll Like Whatever we Make! and Other Fallacies.Carol Smith
Presented at CodeMash 2013.
If this sounds familiar it is time to make big changes or look for a new job. Failing your users will only end badly. In this session we look at the assumptions that are all-too-often made about users, usability and the User Experience (UX). In response to each of these misguided statements Carol will provide a quick method you can conduct with little or no resources to debunk these myths.
In this session we looked at the different kinds of UX research. Primary and Secondary research, foundational research, post launch research, qualitative and quantitative research. Attitudinal and behavioral research. We also looked at the benefits and drawbacks of different UX research methods. Lastly we covered how to chose a UX research method
This proposal of work contains details and samples of the user centric design process I follow. I have been trying to find a good graph that represents the process, but at the end I have decided to make my own! ;)
UXPA 2023: UX Fracking: Using Mixed Methods to Extract Hidden InsightsUXPA International
Users do not always accurately describe what they mean or feel. There are many reasons for this, ranging from politeness to poor introspection, to lack of sufficient technical vocabulary. Fortunately, UX researchers have tools in their trade to deduce what was really meant. We call this UX Fracking, a mixed methods approach that is optimized for extracting hidden user insights. We will illustrate the dangers of inadequate, superficial research, and how this may lead to outcomes incapable of addressing the users’ core issues. We will explore ways to avoid these pitfalls by leveraging mixed research methods to test hypotheses about the users’ intent and needs. This starts with a thorough understanding of who the user is, their goals, and how they work today, to an approach that combines surveys, interviews, and comment analysis with behavioral observation, and finally, validating the newly discovered user insights with the users themselves.
Introduction to Prototyping - Scottish UPA - June 2011Neil Allison
Presented to the Scottish Usability Professionals Association, Edinburgh, 22 June 2011.
Covering the basics, the benefits, some tools, some tips and a case study.
Composing the perfect research symphony – What are the key elements to conduc...innogy Innovation GmbH
It was only a couple of years ago that online qualitative studies were still approached skeptically by researchers. Today many case studies and publications illustrate that online qualitative research has become a valid methodology amongst many practitioners.
• Do we actually use the full potential that online qualitative research offers?
• How can we actually determine the quality of online qualitative research?
• Does the quality just lie in the eye of the observer? What works, what does not?
In this webinar, research and innovation consultant Nicole Reinhold will take you a step further and share with you her strategies to achieve high quality results by doing ‘activity-based’ online research.
As a specialist in research for innovation projects, Nicole creates customized research designs that creatively combine different type of research methodologies into one online study. Feeling like a sort of ‘composer’ of research designs, she will share with us some of her international ‘compositions.’
Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...All Things Open
Presented at: All Things Open 2019
Presented by: Piet Kruithof, IBM, Ju Lim, Red Hat, & Melissa Meingast, Hewlett Packard Enterprise
Find more slides by Ju Lim: https://www.slideshare.net/julienlim
Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...Ju Lim
"Ten Lessons Learnt to Drive and Transform Open Source Software User Experience, and How to Get There" talk was presented by Piet Kruithof, Ju Lim, and Melissa Meingast at All Things Open 2019 in Raleigh, NC on 14 October 2019.
Abstract
The greatest strength associated with open source communities is the developer-driven culture that leverages processes and tools optimized for code development and review. One reason this model works is the developers are also the consumers of the software.
But what if community members aren’t the only ones using the software? How do we give them a voice within the open source community?
This discussion includes an overview of our efforts to drive and transform open source software user experience, how we got there, and what needs to be improved.
Julie Grundy gives an overview of user experience Design, why it's important, guiding principles, UX research overview, and tactics used by UX professionals. November 2015.
Mobile & Tablet UX | NYU School of Professional Studies | Week 1 (Intro)Liz Filardi
These are my slides for the first week of the class "Mobile and Tablet UX" at the NYU School of Professional Studies. The course is taught online in 4 sessions.
Requirements Engineering for the HumanitiesShawn Day
This workshop explores how requirements engineering can be employed by digital and non-digital humanities scholars (and others) to conceptualise and communicate a research project.
requirementsEngineeringAs the field of digital humanities has evolved, one of the biggest challenges has been getting the marrying technical expertise with humanities scholarly practice to successfully deliver sustainable and sound digital projects. At its core this is a communications exercise. However, to communicate effectively demands an ability to effectively translate, define and find clarity in your own mind.
Similar to ResearchOps Berlin Meetup #2 - UX Maturity - How to Grow User Research in your Organization (20)
Personal Brand Statement:
As an Army veteran dedicated to lifelong learning, I bring a disciplined, strategic mindset to my pursuits. I am constantly expanding my knowledge to innovate and lead effectively. My journey is driven by a commitment to excellence, and to make a meaningful impact in the world.
Digital Transformation and IT Strategy Toolkit and TemplatesAurelien Domont, MBA
This Digital Transformation and IT Strategy Toolkit was created by ex-McKinsey, Deloitte and BCG Management Consultants, after more than 5,000 hours of work. It is considered the world's best & most comprehensive Digital Transformation and IT Strategy Toolkit. It includes all the Frameworks, Best Practices & Templates required to successfully undertake the Digital Transformation of your organization and define a robust IT Strategy.
Editable Toolkit to help you reuse our content: 700 Powerpoint slides | 35 Excel sheets | 84 minutes of Video training
This PowerPoint presentation is only a small preview of our Toolkits. For more details, visit www.domontconsulting.com
Kseniya Leshchenko: Shared development support service model as the way to ma...Lviv Startup Club
Kseniya Leshchenko: Shared development support service model as the way to make small projects with small budgets profitable for the company (UA)
Kyiv PMDay 2024 Summer
Website – www.pmday.org
Youtube – https://www.youtube.com/startuplviv
FB – https://www.facebook.com/pmdayconference
Buy Verified PayPal Account | Buy Google 5 Star Reviewsusawebmarket
Buy Verified PayPal Account
Looking to buy verified PayPal accounts? Discover 7 expert tips for safely purchasing a verified PayPal account in 2024. Ensure security and reliability for your transactions.
PayPal Services Features-
🟢 Email Access
🟢 Bank Added
🟢 Card Verified
🟢 Full SSN Provided
🟢 Phone Number Access
🟢 Driving License Copy
🟢 Fasted Delivery
Client Satisfaction is Our First priority. Our services is very appropriate to buy. We assume that the first-rate way to purchase our offerings is to order on the website. If you have any worry in our cooperation usually You can order us on Skype or Telegram.
24/7 Hours Reply/Please Contact
usawebmarketEmail: support@usawebmarket.com
Skype: usawebmarket
Telegram: @usawebmarket
WhatsApp: +1(218) 203-5951
USA WEB MARKET is the Best Verified PayPal, Payoneer, Cash App, Skrill, Neteller, Stripe Account and SEO, SMM Service provider.100%Satisfection granted.100% replacement Granted.
3.0 Project 2_ Developing My Brand Identity Kit.pptxtanyjahb
A personal brand exploration presentation summarizes an individual's unique qualities and goals, covering strengths, values, passions, and target audience. It helps individuals understand what makes them stand out, their desired image, and how they aim to achieve it.
RMD24 | Debunking the non-endemic revenue myth Marvin Vacquier Droop | First ...BBPMedia1
Marvin neemt je in deze presentatie mee in de voordelen van non-endemic advertising op retail media netwerken. Hij brengt ook de uitdagingen in beeld die de markt op dit moment heeft op het gebied van retail media voor niet-leveranciers.
Retail media wordt gezien als het nieuwe advertising-medium en ook mediabureaus richten massaal retail media-afdelingen op. Merken die niet in de betreffende winkel liggen staan ook nog niet in de rij om op de retail media netwerken te adverteren. Marvin belicht de uitdagingen die er zijn om echt aansluiting te vinden op die markt van non-endemic advertising.
Falcon stands out as a top-tier P2P Invoice Discounting platform in India, bridging esteemed blue-chip companies and eager investors. Our goal is to transform the investment landscape in India by establishing a comprehensive destination for borrowers and investors with diverse profiles and needs, all while minimizing risk. What sets Falcon apart is the elimination of intermediaries such as commercial banks and depository institutions, allowing investors to enjoy higher yields.
What is the TDS Return Filing Due Date for FY 2024-25.pdfseoforlegalpillers
It is crucial for the taxpayers to understand about the TDS Return Filing Due Date, so that they can fulfill your TDS obligations efficiently. Taxpayers can avoid penalties by sticking to the deadlines and by accurate filing of TDS. Timely filing of TDS will make sure about the availability of tax credits. You can also seek the professional guidance of experts like Legal Pillers for timely filing of the TDS Return.
What are the main advantages of using HR recruiter services.pdfHumanResourceDimensi1
HR recruiter services offer top talents to companies according to their specific needs. They handle all recruitment tasks from job posting to onboarding and help companies concentrate on their business growth. With their expertise and years of experience, they streamline the hiring process and save time and resources for the company.
Cracking the Workplace Discipline Code Main.pptxWorkforce Group
Cultivating and maintaining discipline within teams is a critical differentiator for successful organisations.
Forward-thinking leaders and business managers understand the impact that discipline has on organisational success. A disciplined workforce operates with clarity, focus, and a shared understanding of expectations, ultimately driving better results, optimising productivity, and facilitating seamless collaboration.
Although discipline is not a one-size-fits-all approach, it can help create a work environment that encourages personal growth and accountability rather than solely relying on punitive measures.
In this deck, you will learn the significance of workplace discipline for organisational success. You’ll also learn
• Four (4) workplace discipline methods you should consider
• The best and most practical approach to implementing workplace discipline.
• Three (3) key tips to maintain a disciplined workplace.
ResearchOps Berlin Meetup #2 - UX Maturity - How to Grow User Research in your Organization
1. Welcome to our 2nd
ResearchOps Berlin
Meetup!
ResearchOps Meetup
Berlin
PhotobyJoshuaLanzarinionUnsplash
2. Today’s agenda
ResearchOps Meetup
Berlin
6:30 pm Opening
7:00 pm Welcome and Intro: "UX Maturity Models"
7:20 pm "Fast forward with research" (FlixBus)
By Luky Primadani, Katja Borchert, Carolina Schomer & Pietro Romeo
7:50 pm Q&A
8:00 pm Discussion in small groups
8:30 pm The End and Preview
10:00 pm We’ll all be kicked out!
3. Who are we
ResearchOps Meetup
Berlin
Nikki
UX Researcher,
Instructor & Writer
Anne
UX Researcher,
smart Helios GmbH
Judith
User & Innovation
Researcher
Lisa
Service Design &
User Research
Katia
Design Researcher
& Strategist
4. Talk Name
Speaker Name
What is
ResearchOps?
"ResearchOps is the mechanisms and strategies
that set user research into motion. It provides the
roles, tools and processes needed to support
researchers in delivering and scaling the impact of
the craft across an organization.“ Kate Towsey
ResearchOps Meetup
Berlin
5. Talk Name
Speaker Name
Who is part of
ResearchOps?
ResearchOps Meetup
Berlin
User
Researcher
User
Researcher
doing Ops
Research
Ops
Adapted from Emma Boulton
6. Why are we doing it
1. Sharing knowledge
and experiences
about user research
2. Getting to know
each other on local &
global level through
different interactive
formats
3. Improving the
awareness of
ResearchOps and its
needs
ResearchOps Meetup
Berlin
8. What is a UX maturity
model?
ResearchOps Meetup
Berlin
9. There are many out
there.
ResearchOps Meetup
Berlin
Design Research Maturity Model
By Chris Avore @NASDAQ Design
Design Maturity Model
By InVision
Implement user research
to level up.
12. Discussion - in groups
ResearchOps Meetup
Berlin
25 min + 5 min overall sharing
1. Reflect on your company’s situation when it comes to reaching the next level of maturity in
user research (if applicable). See the NASDAQ maturity model as example.
a. Think about where you are at in terms of maturity level and rrite down your No1
current barrier for not progressing (3 min)
b. Stick post-its on the wall and read the other post-its. (2 min)
2. (App. 2x): Someone starts sharing a barrier: Make it tangible - share a situation/story. (2 min)
a. The others listen, then note down their suggestions on post-its. (3 min)
b. Suggestions and best practices are shared in group. (5 min)
3. Each group shares a highlight/learning from their discussion in one sentence (5 min total)
13. Talk Name
Speaker Name
June ‘19
PREVIEW
ResearchOps Meetup
Berlin
https://medium.c
om/researchops-
community
21. We support teams to test & validate their
assumptions through user research, so that
they can make more confident product
decisions.
Our team purpose
22. 1. Research at FlixBus: how everything started
2. The journey towards UX maturity
3. Fast forward: scaling research
4. How do we expect to reach the next stage
Agenda
45. How can we run
tests as
EARLY, OFTEN
and QUICKLY
as possible?
46. More insights on
cultural differences
in different markets.
How do customers
use our products in
their natural
environment.
Multiple studies at a
time = no bottleneck due
to complex recruitment
and logistics processes.
Remote testing tool
60. UX Croissant: speed dating style userlab
Quick Findings or Confirmations
for small studies
61. Research timeline: testing the “problem”, not the “solution”
*inspired by a model from “Validating Product Ideas Through Lean User Research” book by Thomer Sharon
STRATEGIZE EXECUTE EVALUATE
63. Tip the
driver
Self Check
in Machine
Mobile Web
Redesign
What do people
want/need?
What is
the workflow?
How people use
the product?
FlixBus use cases in the product development cycle
STRATEGIZE EXECUTE EVALUATE
65. How can we
improve the
Check in
Process?
Testing new
Technology:
Self check in
machine
Usability test
How people use the product?
STRATEGIZE EXECUTE EVALUATE
67. Impact: product adjustments to diminish user
misunderstandings
"I think the machine
doesn't like me"
E., 65 years old
68. USE CASES
2.
Tip the driver
What is the workflow?
How do people use the
product?
69. Iteration:
Usability test
A/B test
What is the workflow? How people use the product?
How to
improve bus
driver’s quality
and behavior?
What is the
better
workflow for
users to tip?
Market
research
Qualitative
research
STRATEGIZE EXECUTE EVALUATE
70. Market Research: where should the feature be launched?
Cultural behavior
impacts acceptance
74. How users are
currently using
FlixBus mobile
web?
(Analytics + user
research)
Design Sprint Iteration:
Usability test
A/B test
What do people want? How currently people solve a problem?
STRATEGIZE EXECUTE EVALUATE
77. How to reach the next stage
1. Field Studies to discover new findings in the real environment
2. Testing in different markets
3. Pro-active studies
4. Improve data accessibility with a “Results sharing platform”
5. Enable others to do research → democratize research
6. Exchange ideas with Research professionals > Best practices
78. Get in touch with us via
LinkedIn or email:
Luky Primadani
Katja Borchert
Carolina Schomer
Pietro Romeo
userlab@flixbus.com
TEAM SWARM
80. “Elaborate usability tests are a waste of resources. The best results come from testing no more than 5
users and running as many small tests as you can afford” Why You Only Need to Test with 5 Users by
Jakob Nielsen
“The goal in sampling with qualitative data is to detect repeating patterns— not to achieve statistical
significance. With these smaller sample sizes qualitative research looks for signals, which are indicators
of trends within a population” Kelly Moran, Google UX Researcher
“With qualitative research, you’re zooming in and getting a closer picture of fewer people. So that you
know them better” Kelly Moran, Google UX Researcher
What is the relevance of a study with only 5 people?
Is this sample size statistically significant?
82. Which app icon
made people
download the
app the most?
What is the
brand
perception in
new markets?
Internal
designers
create
logotype
icon option Survey
Click Test
A/B Test
Which design generates better results?
New Icon:
Logotype
Current Icon:
Logogram
STRATEGIZE EXECUTE EVALUATE
84. QUALITATIVE RESULTS:
The new icon improves usability and brand image.
It is easier to find and more modern.
QUANTITATIVE RESULTS (A/B Test):
Install rate uplift of ~5% on Google Play.
Impact: change for the Logotype icon
Editor's Notes
Photo by Joshua Lanzarini on Unsplash
Also: Mention house keeping rules, who is taking pics and should be informed if someone doesn’t want to be in the pic
(For Chart 7: There is a growing global community since about a year with an active slack, medium and online town halls. All over the world workshops happened to define the needs of UX researchers and define research operations. In June, Chris and Kat organized a workshop in Berlin (at Here maps). Since then, we’ve met 3 times in a smaller group but felt there’s a need for a regular, public meetup focusing on user and design research.
Intl. community, No one owning it ))
Ops- What? “Everything is ‘ops’ today…”! “Not another Ops”
Yes, because research demand is growing, but it lacks resources and infrastructure.
So R+ is about the infrastructure, e.g. recruiting, knowledge management (like data repositories), governance, tools etc.
It’s everything that supports research/the craft, implementing research. / research about researchers
Who is in the community? Looking at the slack channel conversations and the current state of Research this only makes sense. We have very few people soley doing Research Ops hence there is such a huge overlap of user researchers also doing Ops related tasks and activities. // Anyone mainly doing ResearchOps? Who is mainly working as a user researcher? Who is partly doing user research (e.g. UX Designer, Service Designer)? Who is usually less involved in user research (e.g. PMs)? / meet up not restricted to pure Ops topics - and boundaries are blurry
Tonspur auf S 7
mention the Chatham House Rule:
“...participants are free to use the information received, but neither the identity nor the affiliation of the speaker(s), nor that of any other participant, may be revealed.”
What is a UX maturity and Why could it be helpful for us? I think this is why you are all here tonight. You want to find out what UX maturity is and what kind of models are out there and what this could me mean for you.
There are many models out there. The all indicate where an organisation exist in a spectrum across levels of maturity AND they allow us to identify where to take action and where to improve.
It is important to know, however, that the different models depict maturity from different perspectives such as Design Team (which only at some point includes user research) and others specifically address User or Design Research maturity only such as the one by Chris Avore.
Left to right: 1) Maturity Model by Invision (5 Levels, Desgin Team, Research is included at Level 3; Majority of Companies is 1-3)2) Design Research Maturity Model (4 Stages, Research Specific, lists many attributes concerning organisational set-up)
3) Third one will be introduced in more Detail in the Talk by Flixbus
(Based on roughly 2.2000 designers) http://www.invisionapp.com/design-better/desing-maturity-model ResearchOps relevant only up from level 3 → Level 5 makes roughly 5%
Generally the following characteristics have these modelsl in common independent of number of steps and activities:
Aesthetics/design/UI, not that many people involved, low awareness
More people involved, workshops, usability
Dedicated team, bigger audience
training offered, research becomes democratized, tied to KPIs and revenue
Whole org aware of it/fully integrated, research for strategy & discovery, organized, dedicated ResearchOps role
We wanted to focus on Chris’ modul as we thought it might be easier to locate yourself as User Researchers or Research Activities you are aware of in your organisation. Print outs are in various rooms spread across the rooms.
prepare whiteboards // give people a chance to leave/step back in case they don’t want to be part of the discussion
Use the watch
Randomly assign participants and ourselves (moderators) to groups (1,2,3,...up to 8), if too homogene people might switch
Short clustering in groups could be an option so that a barrier that many people experience is tackled.
It is not required that people put their organization into a certain maturity level but get a general impression of where they are standing.
Pay attention to these sub-topics (esp. if discussion is fading): middlemen, sponsors/supporters in your organization, working at an agency vs. corporation, informing strategy vs. product, top-down vs. bottom up (Is it better to implement UX maturity throughout the whole organization (top down) or set it up individually at each product team (bottom up)?)
Scaling, training, KPIs
We (dedicated ResearchOps team) have reflected upon where our organisations stands in terms of UX maturity. Yet, it is also important to think about our on skills set. What level are we at? What is ahead of me. We want to provide the opportunity to answer these kinds of questions. Hence we trial running a skills workshop as the next meet up format. // There will be skill sorkshops happening across the globe. It is an initiative of the ResearchOps Community.. We’ll provide more information and links on the Meetup page. // Sign up is free and first come first serve basis
Takes about 2.5 hours // We’ll provide more links on the Meetup page. / Reach out if you want to talk or host // @Anne, @Luky, @Carolina, @Carina, @Judith
Slides will be put on slideshare, recording…
Thank you, thanks FlixBus!
I want to quickly introduce our team to you
Our Cultural Background is as different as our Professional backgrounds
Luky comes from Indonesia and is a experienced UI & UX Designer
I’m from germany with background in Product Management
Carolina from Brazil she worked many years in Branding and Marketing
Pietro from Italy with background in Computer Science
To give you a quick outlook:
Luky is going to talk about UX in general & evolution of UX here at FlixBus,
I will tell you a bit about how did we scale research
Carolina & Pietro are going to present a few interesting case studies
After our presentation we are happy to answer your questions
When we want people to learn something, we want them to particiopate
Ux mindset
So until here Luky explained how do you convince people that UX is important and the whole strategy to make the company and the stakeholders adopt it.So I’ll be taking you through what happened since then. How do we set up the team to attend the requests and accelerate the research adoption.
The 1st thing is that the demand for research increased. More areas saw the benefit of it and wanted to try research. Teams were talking and recommending the SWARM team.
It’s not just about tool, democratizing is about involving people
This is how we see people in the stages. Research Partner. Empower more people and have a Facilitation role.
Example. POs. Gurrilla Test (convenient and phrase questions).
Pushy → Prioritizing.
In this stage we still need to make the findings access and generate discussions
What we Understand - more mature we get, the topics also get more strategic, we need to combine more tests to get deeper findings
Deep interview: in depth interview
Involve people → commitment and sense of belonging
Finish my part of scaling research, this is a timeline we based ourselves to help us organize and also understand the studies we are dealing with.
What is clear for us is that maturity is really about testing the problem and not the solution. So think this is a product development timeline. When we test in the begining
Interesting case because it involved four product teams and two different user segments - customers and bus drivers. There were A LOT of people involved in this project and hence it required a lot of different research studies.
Google Play AB-Test Results: The new icon leads to more installs
Germany: Install rate uplift of up to 4.3%, which means up to 16.7K more installs on Google Play only in December 2018 (potentially another ~ 10K on iOS)
US: Install rate uplift of to 7.4%, which means up to 6K more installs on Google Play only in December 2018 (potentially another ~ 4K on iOS)
The new icon called more attention (+clicks)
The new icon was easier to find and more associated with the brand
While the original icon (arrows) is perceived as more dynamic, the new icon is perceived as more digital/modern