How to get more than opinions: Interview techniques and advicejohanna kollmann
Given at the intro evening of Lean UX Machine Tel Aviv (http://leanuxmachine.com/ & http://leanuxmachine2011.tumblr.com/), this short talk on interview techniques introduces basic principles of how to facilitate qualitative research. Aimed at lean startups, I hope it will be relevant advice for 'getting out of the building'.
Shared under a Creative Commons with Attribution license :)
User research, analytics, hypotheses and experiments: we are focused on gaining understanding through data, validating that our interventions bring about the (user) behaviour we desire. We design systems, the systems we design interact with other systems, and it’s all getting awfully complex. Can we truly understand what’s going on?
In this talk, Johanna will introduce you to core principles of systems thinking, and discuss how they relate to our work as designers of products, services, companies. What methods and tools can we employ to make sense of systems? How do we enable users to form a mental model of a system - and what role are we designing for our users?
Expect to walk away with some systems theory, some practical take-aways, and the insight that the system is always one step ahead of you.
The talk I gave at WebExpo 2014 in Prague! Slides only.
Here is the abstract:
Usability testing, focus groups, interviews, contextual inquiry, customer development - there are many names and techniques for gathering insights from your users, your customers. In recent years, agile software development and lean startup have changed how research is conducted, and have raised awareness of how important it is to understand who you are building your products for.
In this talk, Johanna will cover best practices for gathering insights in the context of product development. Her session will address questions such as:
* What techniques are best at the early stage of a product?
* What exactly is customer development and how is it different?
* What are the skills you need to turn research results into actionable insights that inform your product strategy?
Johanna will share her own story of being a researcher and product manager, how and why her practice has changed, and provide actionable advice on embedding research in your process.
How to get more than opinions: Interview techniques and advicejohanna kollmann
Given at the intro evening of Lean UX Machine Tel Aviv (http://leanuxmachine.com/ & http://leanuxmachine2011.tumblr.com/), this short talk on interview techniques introduces basic principles of how to facilitate qualitative research. Aimed at lean startups, I hope it will be relevant advice for 'getting out of the building'.
Shared under a Creative Commons with Attribution license :)
User research, analytics, hypotheses and experiments: we are focused on gaining understanding through data, validating that our interventions bring about the (user) behaviour we desire. We design systems, the systems we design interact with other systems, and it’s all getting awfully complex. Can we truly understand what’s going on?
In this talk, Johanna will introduce you to core principles of systems thinking, and discuss how they relate to our work as designers of products, services, companies. What methods and tools can we employ to make sense of systems? How do we enable users to form a mental model of a system - and what role are we designing for our users?
Expect to walk away with some systems theory, some practical take-aways, and the insight that the system is always one step ahead of you.
The talk I gave at WebExpo 2014 in Prague! Slides only.
Here is the abstract:
Usability testing, focus groups, interviews, contextual inquiry, customer development - there are many names and techniques for gathering insights from your users, your customers. In recent years, agile software development and lean startup have changed how research is conducted, and have raised awareness of how important it is to understand who you are building your products for.
In this talk, Johanna will cover best practices for gathering insights in the context of product development. Her session will address questions such as:
* What techniques are best at the early stage of a product?
* What exactly is customer development and how is it different?
* What are the skills you need to turn research results into actionable insights that inform your product strategy?
Johanna will share her own story of being a researcher and product manager, how and why her practice has changed, and provide actionable advice on embedding research in your process.
Textsl: a screen reader accessible virtual world client for second lifeEelke Folmer
Virtual worlds are not accessible to users who are visually impaired as they lack any textual representation that can be read with a screen reader. We developed an interface modeled after text based adventure games like zork that allows a screen reader user to iteratively interact with the popular virtual world of second life.
In this exclusive webinar, Deborah Torres, Sr. User Experience Researcher at Paypal, and UserZoom’s co-CEO, Alfonso de la Nuez, will discuss how you can scale back the time and resources it takes to do user research, while still providing valuable results.
Aibdconference chat bot for every product Maksym VolchenkoOlga Zinkevych
Topic of presentation: Chat Bot for every product
The main points of the presentation: During the presentation you will know about:
• what are conversational interfaces?
• which AI technologies are they based on?
• how we can use conversational interfaces in our products?
• which technologies & tools are needed to build conversational interfaces?
• how to work with statistics about bot?
Slides from my invited keynote for Game To Learn: Take 2 in Dundee, Scotland on March 18, 2011.
Abstract:
"All you need to understand is everything you know is wrong.”—Weird Al
My mother told me cleaning toilets builds character if done repeatedly. The other night five friends spent more than three hours dying over and over again while playing World of Warcraft (WoW). She never said anything about dying. I found cleaning toilets only gets you clean toilets. Dying and playing, however, teaches you important things. Demons, dragons, dwarves, and possibly folklore, you could see, but learning, love, and leadership?
Sounds crazy, but it’s true: World of Warcraft has something to say about learning. Prepare yourself, because everything you thought you knew is wrong.
Note: This version has stills in place in the movies to reduce the file size for sharing.
I have completed my Post graduate diploma program in design from National Institute of Design in Design for digital exp. I am keenly interested in projects related on user experience design, research methodology and development, product usability, service design and Interaction &interface design. I preferably would also like to do research and design process for innovative e- learning system, tools and techniques.
I am very passionate to read articles and materials on ancient civilization, culture, people and arts& crafts of different countries.
Engaging with the global consumers - Future Forum Breakfast #2 [Mark McCrindl...McCrindleResearch
From Boomers & Xers to Generations Y & Z
Consumerography: A snapshot of today's key consumers
Macro customer segments
The power of brand in a fragmented market
Understanding Niche: An analysis of micro segments
Emerging drivers of consumer behaviour
Innovative research methods for the new generations
Global generations, world consumers
21st Century Customers: Engaging with Global ConsumersMark McCrindle
Social Researcher Mark McCrindle analyses the emerging global consumers. He defines new customers & the shifts: from low loyalty to brand evangelists and from digital transactors to digital integrators- and how marketers should respond: from power to influence, and from structured delivery to interactivity. From a study of memes, to the consumer value wheel, you'll find this presentation on customer engagement very useful.
The Semiotic Inspection Method - Overview, Analysis and CritiqueOmar Sosa-Tzec
Analysis and critique to the Semiotic Inspection Method (de Souza, 2006). Final presentation for INFO 502 "Human-Centered Research Methods" class at Indiana University, Bloomington. PhD in Informatics. Prof. John Paolillo. Spring, 2013. By Omar Sosa Tzec.
Tzek, Tzek Design. HCI PhD.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
More Related Content
Similar to Ian Collingwood - LeanStartupMachine Rotterdam
Textsl: a screen reader accessible virtual world client for second lifeEelke Folmer
Virtual worlds are not accessible to users who are visually impaired as they lack any textual representation that can be read with a screen reader. We developed an interface modeled after text based adventure games like zork that allows a screen reader user to iteratively interact with the popular virtual world of second life.
In this exclusive webinar, Deborah Torres, Sr. User Experience Researcher at Paypal, and UserZoom’s co-CEO, Alfonso de la Nuez, will discuss how you can scale back the time and resources it takes to do user research, while still providing valuable results.
Aibdconference chat bot for every product Maksym VolchenkoOlga Zinkevych
Topic of presentation: Chat Bot for every product
The main points of the presentation: During the presentation you will know about:
• what are conversational interfaces?
• which AI technologies are they based on?
• how we can use conversational interfaces in our products?
• which technologies & tools are needed to build conversational interfaces?
• how to work with statistics about bot?
Slides from my invited keynote for Game To Learn: Take 2 in Dundee, Scotland on March 18, 2011.
Abstract:
"All you need to understand is everything you know is wrong.”—Weird Al
My mother told me cleaning toilets builds character if done repeatedly. The other night five friends spent more than three hours dying over and over again while playing World of Warcraft (WoW). She never said anything about dying. I found cleaning toilets only gets you clean toilets. Dying and playing, however, teaches you important things. Demons, dragons, dwarves, and possibly folklore, you could see, but learning, love, and leadership?
Sounds crazy, but it’s true: World of Warcraft has something to say about learning. Prepare yourself, because everything you thought you knew is wrong.
Note: This version has stills in place in the movies to reduce the file size for sharing.
I have completed my Post graduate diploma program in design from National Institute of Design in Design for digital exp. I am keenly interested in projects related on user experience design, research methodology and development, product usability, service design and Interaction &interface design. I preferably would also like to do research and design process for innovative e- learning system, tools and techniques.
I am very passionate to read articles and materials on ancient civilization, culture, people and arts& crafts of different countries.
Engaging with the global consumers - Future Forum Breakfast #2 [Mark McCrindl...McCrindleResearch
From Boomers & Xers to Generations Y & Z
Consumerography: A snapshot of today's key consumers
Macro customer segments
The power of brand in a fragmented market
Understanding Niche: An analysis of micro segments
Emerging drivers of consumer behaviour
Innovative research methods for the new generations
Global generations, world consumers
21st Century Customers: Engaging with Global ConsumersMark McCrindle
Social Researcher Mark McCrindle analyses the emerging global consumers. He defines new customers & the shifts: from low loyalty to brand evangelists and from digital transactors to digital integrators- and how marketers should respond: from power to influence, and from structured delivery to interactivity. From a study of memes, to the consumer value wheel, you'll find this presentation on customer engagement very useful.
The Semiotic Inspection Method - Overview, Analysis and CritiqueOmar Sosa-Tzec
Analysis and critique to the Semiotic Inspection Method (de Souza, 2006). Final presentation for INFO 502 "Human-Centered Research Methods" class at Indiana University, Bloomington. PhD in Informatics. Prof. John Paolillo. Spring, 2013. By Omar Sosa Tzec.
Tzek, Tzek Design. HCI PhD.
Similar to Ian Collingwood - LeanStartupMachine Rotterdam (20)
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
7. Eric & Steve say...
“Get out of the building!”
@johnnyforeigner
8. Eric & Steve say...
“Get out of the building!”
@johnnyforeigner Image by Jeff Gotthelf
9. UX people are good at getting out of the
building
@johnnyforeigner
10. UX people are good at getting out of the
building
@johnnyforeigner
11. UX people are good at getting out of the
building
Quantitative
@johnnyforeigner
12. UX people are good at getting out of the
building
Quantitative Qualitative
@johnnyforeigner
13. UX people are good at getting out of the
building
Quantitative Qualitative
Generative
@johnnyforeigner
14. UX people are good at getting out of the
building
Quantitative Qualitative
Generative
Evaluative
@johnnyforeigner
15. UX people are good at getting out of the
building
Quantitative Qualitative
Depth Interviews
Contextual Inquiry
Surveys Ethnography
Generative Interviews Diary Studies
Participatory Design (Co-creation)
Mental Models
Web Analytics
Multi-variant Testing Usability Testing
Remote Card Sorting Moderated Card Sorting
Evaluative Clicktale / CrazyEgg (et al) Wizard of Oz Testing
Treejack (et al) Desirability Toolkit
Chalkmark / 5-Second Test (et al) R.I.T.
Usertesting.com (et al)
@johnnyforeigner
16. UX people are good at getting out of the
building
Quantitative Qualitative
Depth Interviews
Contextual Inquiry
Surveys Ethnography
Generative Interviews Diary Studies
Participatory Design (Co-creation)
Mental Models
Web Analytics
Multi-variant Testing Usability Testing
Remote Card Sorting Moderated Card Sorting
Evaluative Clicktale / CrazyEgg (et al) Wizard of Oz Testing
Treejack (et al) Desirability Toolkit
Chalkmark / 5-Second Test (et al) R.I.T.
Usertesting.com (et al)
@johnnyforeigner
17. UX people are good at getting out of the
building
Quantitative Qualitative
Depth Interviews
Contextual Inquiry
Surveys Ethnography
Generative Interviews Diary Studies
Participatory Design (Co-creation)
Mental Models
Web Analytics
Multi-variant Testing Usability Testing
Remote Card Sorting Moderated Card Sorting
Evaluative Clicktale / CrazyEgg (et al) Wizard of Oz Testing
Treejack (et al) Desirability Toolkit
Chalkmark / 5-Second Test (et al) R.I.T.
Usertesting.com (et al)
@johnnyforeigner
18. UX people are good at getting out of the
building
Quantitative Qualitative
Depth Interviews
Contextual Inquiry
Surveys Ethnography
Generative Interviews Diary Studies
Participatory Design (Co-creation)
Mental Models
Web Analytics
Multi-variant Testing Usability Testing
Remote Card Sorting Moderated Card Sorting
Evaluative Clicktale / CrazyEgg (et al) Wizard of Oz Testing
Treejack (et al) Desirability Toolkit
Chalkmark / 5-Second Test (et al) R.I.T.
Usertesting.com (et al)
@johnnyforeigner
19. UX people are good at getting out of the
building
Quantitative Qualitative
Depth Interviews
Contextual Inquiry
Surveys Ethnography
Generative Interviews Diary Studies
Participatory Design (Co-creation)
Mental Models
Web Analytics
Multi-variant Testing Usability Testing
Remote Card Sorting Moderated Card Sorting
Evaluative Clicktale / CrazyEgg (et al) Wizard of Oz Testing
Treejack (et al) Desirability Toolkit
Chalkmark / 5-Second Test (et al) R.I.T.
Usertesting.com (et al)
@johnnyforeigner Adapted from material by Johanna Kollman Janice Fraser, Nate Bolt, Christian Rohrer
20. http://trapblog.org/wp-content/uploads/ackbar_mouse_trap2.jpg
Do n’t fa ll in to th e trap of
re ly ing exclusi ve ly on
an al yt ics, A/B te st s an d
co nversio ns .
Tr ia ng ul ate yo ur data w
ith
qu al itati ve re se arch .
Un de rs ta nd th e “w hy” as
wel l
as th e “w hat”
21. ingredients:
two rooms
one wifi network
two computers
some cheap or free software
five participants
your whole team
your product or prototype
five colours of mini post it notes
blu-tack
your eyes & your ears
your brain & your heart
@johnnyforeigner
22. Room 1
Skype and a screensharing tool
Your Product or MVP
Read Steve K rug’s bo ok :
“R oc ke t Su rger y M ade
Ea sy” fo r great in tro to
pl an ni ng & ru nn ing us er
te st ing se ss io ns .
Moderator
“Participant” (aka Customer) (you)
@johnnyforeigner
25. User 1 User 2 User 3 User 4 User 5
Us e th e sm al le st si ze of
Po st-I t no te th at yo u ca n
fi nd (38mm x 51mm ).
Yo u’ll ne ed a di ff eren t
co lo ur no te fo r each
pe rs on yo u are te st ing
w it h.
@johnnyforeigner
26. ADD AN IMATIO
key:
ER N
ATED ORD
AUTOM G TOOL? TO IM P ROVE
T R ACK IN V ISI BI LITY?
ISSUE GOOD
FEATURE IDEA/
BY
CONFUSED
REQUEST SOLUTION
“I LIK E H OW IT
P R EDICTS WHAT I MENU
TY P E” LABE LLING Wri te in ALL CAPS
Wri te clea rl y & us e “q uo te
m ar ks” fo r us er
commen ts .
Bu t ac ti on s & us er
be havi ou r are more
va lu able th an op in io ns .
@johnnyforeigner
27. ADD AN IMATIO
key:
ER N
ATED ORD
AUTOM G TOOL? TO IM P ROVE
T R ACK IN V ISI BI LITY?
ISSUE GOOD
FEATURE IDEA/
BY
CONFUSED
REQUEST SOLUTION
“I LIK E H OW IT
P R EDICTS WHAT I MENU
TY P E” LABE LLING
Adding th es e ic on s m ay
m ak e yo ur an al ys is ea si
er.
Th ey are no t es se nt ia l
th ough .
And yo u ca n m ak e up yo
ur
ow n, of co urse .
@johnnyforeigner
28. Room 2
Journey
At th e en d of th e fi rs t
se ss io n yo ur ro om m ight
lo ok lik e th is .
@johnnyforeigner
29. Room 2
Journey
Du ri ng yo ur di sc us si on
af te r th e se ss io n, re mov
e
du pl ic ate no te s an d
re w ri te any no te s th at
are un clea r.
@johnnyforeigner
30. Room 2
Journey
Du ri ng yo ur di sc us si on
af te r th e se ss io n, re mov
e
du pl ic ate no te s an d
re w ri te any no te s th at
are un clea r.
@johnnyforeigner
31. Room 2
Journey
A pict ure bu ild s up as yo
u
se e more us ers.
@johnnyforeigner
32. Room 2
Journey
By th e en d it m ight lo ok
lik e th is .
@johnnyforeigner
33. Room 2
Journey
2
1
Bu t m any no te s of one
M any co lo urs mea n th at co lo ur m ay te ll yo u
th e proble m is common to somet hi ng in te re st ing
us ers, so th is is worth ab ou t th is pa rt ic ul ar us er
lo ok ing in to. .
What m ak es th em
Bu t no t al l proble ms th at di ff eren t? Do es th is adju
are common are st
yo ur pe rc ep ti on of yo ur
ne ce ss ar ily im po rt an t. ta rget us er ?
@johnnyforeigner
34. Room 2
Journey
By th e en d of th e day th
e
te am sh ou ld ag re e on th e
m ai n proble ms an d th ei r
pr io ri ty.
M ak e a no te of any ot he
r
in sigh ts ab ou t us er
be havi ou r th at emerge d
du ri ng th e day. Do n’t lo se
th is vi ta l data .
@johnnyforeigner
About me\nDesigning experiences since about 93...\nWeb since 1996\nAmberlight\nUXdna\n\n\nFirst I want to talk about a few of things that people in the UX field have learned over the years that can help those practising a lean startup approach\n\nThen I’m going to show you a method you can use to get really rich insights into customer behaviour in less than a day and a half and for less than 500 quid. (Or euros).\n
There’s a lot of crossover between Lean Startup and User Centred Design. \n\nAt Amberlight we made a really nice little business helping companies test their products with users. They’d spend months developing a product and then they’d hand it over to us to test.\n\nAnd what they wanted was feedback on usability, but what we often found was that they problems were not usability they were user need. Nobody needed the product. So we’d try to get them to involve us (and therefore users) earlier. We failed.\n\nWe’d talk to them about defining product need, building a prototype and then testing it with users. We even drew them a diagram...\n\n\n
UCD has been around so long it even has an ISO standard (can’t get much more mainstream than that)\n\nThen Lean Startup came along and for me at least it was a revelation. Suddenly business people were talking about the kind of things we’d been yelling about for years.\n\n\n
Lean Startup = UCD applied to business models\n
\n
All of these methods are aimed at one thing: \nHelping you to understand your customer and what they need\n\nWhich one you choose will depend on where you are in the product development process and what you’re trying to learn\n\nToday we’re mainly going to look at conducting in-depth interviews, because the techniques you’ll learn will help with almost all the other qualitative techniques.\n
All of these methods are aimed at one thing: \nHelping you to understand your customer and what they need\n\nWhich one you choose will depend on where you are in the product development process and what you’re trying to learn\n\nToday we’re mainly going to look at conducting in-depth interviews, because the techniques you’ll learn will help with almost all the other qualitative techniques.\n
All of these methods are aimed at one thing: \nHelping you to understand your customer and what they need\n\nWhich one you choose will depend on where you are in the product development process and what you’re trying to learn\n\nToday we’re mainly going to look at conducting in-depth interviews, because the techniques you’ll learn will help with almost all the other qualitative techniques.\n
All of these methods are aimed at one thing: \nHelping you to understand your customer and what they need\n\nWhich one you choose will depend on where you are in the product development process and what you’re trying to learn\n\nToday we’re mainly going to look at conducting in-depth interviews, because the techniques you’ll learn will help with almost all the other qualitative techniques.\n
All of these methods are aimed at one thing: \nHelping you to understand your customer and what they need\n\nWhich one you choose will depend on where you are in the product development process and what you’re trying to learn\n\nToday we’re mainly going to look at conducting in-depth interviews, because the techniques you’ll learn will help with almost all the other qualitative techniques.\n
All of these methods are aimed at one thing: \nHelping you to understand your customer and what they need\n\nWhich one you choose will depend on where you are in the product development process and what you’re trying to learn\n\nToday we’re mainly going to look at conducting in-depth interviews, because the techniques you’ll learn will help with almost all the other qualitative techniques.\n
All of these methods are aimed at one thing: \nHelping you to understand your customer and what they need\n\nWhich one you choose will depend on where you are in the product development process and what you’re trying to learn\n\nToday we’re mainly going to look at conducting in-depth interviews, because the techniques you’ll learn will help with almost all the other qualitative techniques.\n
All of these methods are aimed at one thing: \nHelping you to understand your customer and what they need\n\nWhich one you choose will depend on where you are in the product development process and what you’re trying to learn\n\nToday we’re mainly going to look at conducting in-depth interviews, because the techniques you’ll learn will help with almost all the other qualitative techniques.\n
All of these methods are aimed at one thing: \nHelping you to understand your customer and what they need\n\nWhich one you choose will depend on where you are in the product development process and what you’re trying to learn\n\nToday we’re mainly going to look at conducting in-depth interviews, because the techniques you’ll learn will help with almost all the other qualitative techniques.\n
All of these methods are aimed at one thing: \nHelping you to understand your customer and what they need\n\nWhich one you choose will depend on where you are in the product development process and what you’re trying to learn\n\nToday we’re mainly going to look at conducting in-depth interviews, because the techniques you’ll learn will help with almost all the other qualitative techniques.\n
There are literally hundreds of tools out there now that can tell you something about what users did. With stuff like Website Optimiser, Wufoo, SurveyGizmo, Crazy Egg, Clicktale, Chalkmark it feels like you have a lot to work with.\n\nAnd it’s hard to argue against this - the numbers don’t lie, right? Either people clicked on the button or they didn’t, right? Surely that’s all we need to know? \n\nWell, yes, and no. It’s true, you can find out a lot from these tools, and I use them all the time.\n\nBut many times you’re looking at a heatmap or a mouse trail or a conversion funnel that shows me exactly *what* a user did, but you’re still left wondering... WHY?\n\nIt feels a bit like being an archeologist - you’re sifting through these digital artefacts that represent the activities of some long lost user and you’re trying to understand their significance. Why does everybody miss that button? Why aren’t they filling in the form right? What is it about this page that makes everyone drop out?\n\nBasically - what were they thinking? \n\nAnd that’s the big question that will help you to steer your product to success. And sadly - the stats just won’t get you there. \n\nBecause behind every click, every mouse move, every heatmap is a hand, and attached to that hand is a human, and if you don’t understand that human, you won’t make great products. \n\nThis is what Steve Blank means when he says you need to “get out of the building”. Metrics aren’t getting you out of the building. They can become a trap that keeps you at one remove from your customers. What Steve means is: meet your customers, listen to them, watch them. \n\nBest of all - watch them using your product. \n\nNow, in the past, this meant spending a few weeks and a fair amount of cash on planning and running some formal user testing. This could be several weeks and several thousand pounds. \n\nAnd honestly, that’s often time and money well spent - because there’s nothing like seeing the grimaces, sighs, the frustration and curses of people who are simply unable to understand your product. It really forces you to confront the reality inside the minds of your customers - and apart from anything else, it gives you fantastic ideas and real empathy with these people. That should be your secret weapon - not tech, not ideas, but knowing your customers better than the competition does.\n\nAnd for this reason, regular face-to-face customer research is something you should be doing at least twice a month as a matter of course - not just during customer discovery phase, but forever. \n\nAnd before you freak out about the cost - you’re about to see how to do it for under 500 quid and less than a day and a half per round.\n
\n
So you’ve got two rooms. This room is the Testing Room. \n\nYou’ve got a computer in each room, both connected to the same wifi network. \n\nIt helps if both are Macs. \n\nYou’ll be recording what happens on the screen of the computer here, using some cool software called Silverback, which is made by the guys at Clearleft. It’s really simple, and it’ll cost you just 60 bucks, which is a steal.\n\nThe people in the other room will also be watching and for this you’ll be streaming what happens here through to their computer using two neat little bits of software. One is called Soundfly by Abyssoft and the other is called LineIn, by Rogue Amoeba. Both are great little apps which are free, but if you use them, do the decent thing and donate to the guys that wrote them, because they’re both really neat, and they’re starving startups, just like you. \n\nAlso on this computer is your product or prototype. \n\nNow, this could be your Minimum Viable Product, but I suggest you think about this type of testing even before you get to that point. So you might want to think about something even more stripped down - something that has no real functionality, but just represents the interactions that a customer might have with your product. You can call it a “Minimum Testable Prototype”. It’s basically a clickable mockup and you can make it in Keynote or Powerpoint.\n\nNow, we don’t have time to tell you how to write a test plan and how to run a session, so buy yourself a great book by Steve Krug called Rocket Surgery Made Easy. Best 12 quid you’ll spend. \n\nBut you do need to know a bit about finding participants. You should have already thought about your customers and who they are. So now you just need to find some of them and get them to come and test with you. You can do this via friends and family, which will cost you nothing in recruitment fees, but it can take time. So often your best bet is a specialist agency. They’ll take a profile from you and charge you between 30 and 50 quid per person to find the people. It’ll save you time, but do take care to brief them properly or you might get people who aren’t quite what you need.\n\nAlso in the room is you. You will guide the participant through the tasks.\nSo that’s the Testing Room.\n
The second room is the Viewing Room. \n\nThe rest of your team is here. All of them. \n\nThis method works if you stick to rules, and one of the rules is “Everyone participates”. You’ll see why later.\n\nOn the walls of this room you’re going to stick up printouts of each screen involved in each journey you are testing. Print them out as big as you can and stick them onto sheets that are bigger so you can leave a few inches of margin around them.\n\nIt should look like this.\n
\nNow you set up the computer so you can see and hear what’s happening in the Testing Room. You might want some external speakers and a bigger screen (even a projector) if there are more than about 3 of you. \n\nYou are all going to be watching what is happening, and making notes.\n\nHere’s the second rule: When testing is happening, the room is silent. This is learning time. There’s time to discuss what you see later - if you talk now you’ll miss something.\n
You’ll be making notes on mini Post Its, and you’ll be using a different colour for each participant. You’ll see why in a minute.\n\nIn this example, we’ll be using yellow notes for the first participant.\n
When you make notes, you want to capture just one thing on each Post It you use. \n \nDon’t write down everything - choose things that seem relevant or useful. \n\nWrite down good things and bad things, and capture any ideas you have while watching and any suggestions, frustrations or needs that the participants mention.\n\nIf it’s a quote, write quotation marks.\n\nEach time you write a note, stick it onto the page it relates to, close to the area it concerns. If it’s about the whole page, stick it on the border.\n
When you make notes, you want to capture just one thing on each Post It you use. \n \nDon’t write down everything - choose things that seem relevant or useful. \n\nWrite down good things and bad things, and capture any ideas you have while watching and any suggestions, frustrations or needs that the participants mention.\n\nIf it’s a quote, write quotation marks.\n\nEach time you write a note, stick it onto the page it relates to, close to the area it concerns. If it’s about the whole page, stick it on the border.\n
At the end of the first session, the wall should look something like this. (But with more notes)\n\nYou’ll now spend about 15 minutes doing a quick wrap up of what you all saw. Review the post it notes, make sure all are legible and if there are duplicates, remove all the extras.\n\nThis is just a quick chat. You’ll have a full discussion at the end of the day.\n
Here’s what it might look like after the duplicates are removed.\n\nWhen the second participant arrives for their session, the discussion stops, your moderator pops back into the Testing Room, and you ditch the yellow Post It notes in favour of Orange\n
And after that session, you repeat your quick discussion, de-duplicate the post its and move to a new colour.\n\nAnd of course, as the days goes on, it starts to build up like this.\n
\n
After the final session, you’ll have walls that look a bit like these. \n\nYou’ll notice that some areas have lots of different colours - this means it generated a lot of feedback from many different users (could be good, could be bad). \n\nOther areas have a lot of post its of just one colour. This indicates that only one particular user had problems with that area. \n\nThese two different facts can give you a quick start on where to focus your attention. I don’t have time to talk you through how you might manage this discussion, but I’m happy to chat about it afterwards.\n\nBut the main this is to make sure that when you leave the room that evening, you have some clear, actionable decisions about where you will focus your efforts in the coming days.\n\nYour whole team will have been involved in absorbing what your customers think and feel. Your whole team is engaged in collecting nuggets of data that will help them decide where to go next. \n\nAs I said before, this kind of engagement - backed up with a solid metrics - helps build a culture of customer centred thinking in your startup. I recommend it!\n\nAnd that’s it. \n
After the final session, you’ll have walls that look a bit like these. \n\nYou’ll notice that some areas have lots of different colours - this means it generated a lot of feedback from many different users (could be good, could be bad). \n\nOther areas have a lot of post its of just one colour. This indicates that only one particular user had problems with that area. \n\nThese two different facts can give you a quick start on where to focus your attention. I don’t have time to talk you through how you might manage this discussion, but I’m happy to chat about it afterwards.\n\nBut the main this is to make sure that when you leave the room that evening, you have some clear, actionable decisions about where you will focus your efforts in the coming days.\n\nYour whole team will have been involved in absorbing what your customers think and feel. Your whole team is engaged in collecting nuggets of data that will help them decide where to go next. \n\nAs I said before, this kind of engagement - backed up with a solid metrics - helps build a culture of customer centred thinking in your startup. I recommend it!\n\nAnd that’s it. \n
After the final session, you’ll have walls that look a bit like these. \n\nYou’ll notice that some areas have lots of different colours - this means it generated a lot of feedback from many different users (could be good, could be bad). \n\nOther areas have a lot of post its of just one colour. This indicates that only one particular user had problems with that area. \n\nThese two different facts can give you a quick start on where to focus your attention. I don’t have time to talk you through how you might manage this discussion, but I’m happy to chat about it afterwards.\n\nBut the main this is to make sure that when you leave the room that evening, you have some clear, actionable decisions about where you will focus your efforts in the coming days.\n\nYour whole team will have been involved in absorbing what your customers think and feel. Your whole team is engaged in collecting nuggets of data that will help them decide where to go next. \n\nAs I said before, this kind of engagement - backed up with a solid metrics - helps build a culture of customer centred thinking in your startup. I recommend it!\n\nAnd that’s it. \n