AB Testing and UX - a love story with numbers and people
Slides from the NUX6 talk by Craig Sullivan, Friday 27th October 2017.
2017.nuxconf.uk / nuxuk.org
Synopsis:
What’s wrong with the web these days? The mobile experience sucks. The customer experience sucks. It doesn’t work. It’s too hard to use. The text is too small. Nobody measures this happening. The interaction patterns suck. Nobody ever calls up to complain but nobody does anything anyway. Millions of people lose countless days to friction, poor design and frustrating moments on their devices.
There may be thousands of things you can fix that look promising – but how do you know where to start? What if you could measure what sucked, where it sucked and how big the problem was? Using lightweight research methods and tools, you can stop making excuses and start knowing exactly what to do. Life becomes much simpler and easier with a scientific method of optimising growth or delight within your product.
Craig has trained over 500 people on how to measure and optimise their product experience, finding 100M of ‘lost revenue’ using just one of the techniques you will learn. With reports, checklists, downloadable templates and toolkits for every budget and stage of growth – you can stop guessing tomorrow.
Putting Customers First: How To Build Data-Driven Strategies To Ensure Custom...VWO
When opinions take a backseat and data takes control, you can be sure of incremental revenue by building data-informed digital experiences that your customers will love. In this webinar, learn how to develop an evidence-based approach instead of an opinion-based approach.
Watch webinar recording here - https://vwo.com/resources/webinars/how-to-build-data-driven-strategies-ensuring-customer-loyalty/
Demystifying UX – A toolkit approach to better, cheaper & faster experience d...dtremonte
On April 9, 2014, Mary Kennedy, User Experience, Product Design & Management expert, gave a talk entitled "Demystifying UX – A toolkit approach to better, cheaper & faster experience design."
UX / User Experience is booming as a practice and methodology. However, there is often misunderstanding and mystery around UX basic practices. Join us for a discussion of simple tools and processes to use as a reliable toolkit from project to project. Yes, they take time to complete but these practices in the early stages of design mean lower rates of change later in the project - translating to lower cost, faster timelines and more solid design decisions.
eCommerce & Accessibility Webinar: How Accessibility can Boost Conversion RatesCyber-Duck
Presentation slides from Cyber-Duck's eCommerce and Accessibility Webinar: How Accessibility Can Boost Conversion Rates.
According to the 2019 Click-Away Pound report, 69% of disabled people with access needs will ‘click away’ from a website with accessibility barriers. The estimated value of this ‘click away’ spend is over £17 billion. This is without considering how non accessible websites often deter users without disabilities.
On October 26th, Cyber-Duck joined with BigCommerce for an exclusive webinar on how providing an accessible eCommerce site can help retail businesses succeed online and boost conversions.
Designing Experiences that Drive Consumer EngagementAshley Dzick
Ashley Dzick from SafeNet Consulting explains what user experience (UX) is, why it matters, who is responsible for UX and how you can measure your return on investment for UX.
The Great Dis-Content: Tackling Content in a Website RedesignAndrea Zoellner
*** These slides accompany a talk given at WordCamp Kansas City on June 11, 2016. ***
Revamping the design of a website can be a fun and exciting project. Hopefully, the result is a prettier and more user-friendly site. But don’t forget about content! It’s easy to be consumed by theme design and features while overlooking the impact of a content review on the success of your website redesign.
I’ll share best practices for good website content, audits, and page rewrites while handling the challenges of simultaneous design and text overhauls.
This talk is aimed at webmasters, small business owners, web developers, or anyone interested in tips for effective copywriting, information hierarchy, and project management.
Putting Customers First: How To Build Data-Driven Strategies To Ensure Custom...VWO
When opinions take a backseat and data takes control, you can be sure of incremental revenue by building data-informed digital experiences that your customers will love. In this webinar, learn how to develop an evidence-based approach instead of an opinion-based approach.
Watch webinar recording here - https://vwo.com/resources/webinars/how-to-build-data-driven-strategies-ensuring-customer-loyalty/
Demystifying UX – A toolkit approach to better, cheaper & faster experience d...dtremonte
On April 9, 2014, Mary Kennedy, User Experience, Product Design & Management expert, gave a talk entitled "Demystifying UX – A toolkit approach to better, cheaper & faster experience design."
UX / User Experience is booming as a practice and methodology. However, there is often misunderstanding and mystery around UX basic practices. Join us for a discussion of simple tools and processes to use as a reliable toolkit from project to project. Yes, they take time to complete but these practices in the early stages of design mean lower rates of change later in the project - translating to lower cost, faster timelines and more solid design decisions.
eCommerce & Accessibility Webinar: How Accessibility can Boost Conversion RatesCyber-Duck
Presentation slides from Cyber-Duck's eCommerce and Accessibility Webinar: How Accessibility Can Boost Conversion Rates.
According to the 2019 Click-Away Pound report, 69% of disabled people with access needs will ‘click away’ from a website with accessibility barriers. The estimated value of this ‘click away’ spend is over £17 billion. This is without considering how non accessible websites often deter users without disabilities.
On October 26th, Cyber-Duck joined with BigCommerce for an exclusive webinar on how providing an accessible eCommerce site can help retail businesses succeed online and boost conversions.
Designing Experiences that Drive Consumer EngagementAshley Dzick
Ashley Dzick from SafeNet Consulting explains what user experience (UX) is, why it matters, who is responsible for UX and how you can measure your return on investment for UX.
The Great Dis-Content: Tackling Content in a Website RedesignAndrea Zoellner
*** These slides accompany a talk given at WordCamp Kansas City on June 11, 2016. ***
Revamping the design of a website can be a fun and exciting project. Hopefully, the result is a prettier and more user-friendly site. But don’t forget about content! It’s easy to be consumed by theme design and features while overlooking the impact of a content review on the success of your website redesign.
I’ll share best practices for good website content, audits, and page rewrites while handling the challenges of simultaneous design and text overhauls.
This talk is aimed at webmasters, small business owners, web developers, or anyone interested in tips for effective copywriting, information hierarchy, and project management.
Website Accessibility FAQs by MediacurrentMediacurrent
Got web accessibility questions? Mediacurrent’s expert team has answers. This webinar was presented by a cross-disciplinary team of web developers, designers, and strategists.
The transcript and a recording of the event are available on our blog:
https://www.mediacurrent.com/blog/website-accessibility-faqs-webinar-recording-and-transcript/
SilverStripe is a PHP web application framework and CMS that is comparable to WordPress and Joomla but it is leaner, more secure and enterprise ready. This presentations gives an overview of some of its features and includes a video demo.
How to Disrupt Digital Product Cultures by LearnVest VP of ProductProduct School
A big part of product management success is bringing various cultures together from people, process, and innovation. Vivek Bedi from LearnVest hosted the product and technology digital teams from Northwestern Mutual and LearnVest as they discussed over the past two years how they have brought two cultures together to come up with a bold, brave, yet balanced "third" culture.
The new culture is one of taking risks, being ok with failing, and focused on innovation while keeping focus on being at the center of clients' financial lives.
Product Development with Spotify's Product ManagerProduct School
Companies treat the role of product management differently. Miles Davis, Product Manager at Spotify, shared how they articulate the product development process at Spotify and the role and expectations of a PM.
User Experience: Building with Hypermedia for Other FolksNordic APIs
Why do certain technologies succeed in upending the development landscape while so many others fall to the wayside? Can we drive commercial success from technological choices we make on a daily basis?
SPA frameworks like React, and Angular, and opinionated libraries like Ruby on Rails, Spring and Django all share a common obsession with the user experience. Many of the worlds largest organizations grew relying on obsessive customer focus. What can we learn from this to enhance our API Design and Strategy?
In this talk we’ll explore how we can utilize hypermedia to improve experiences for our consumers and developers.
Every day, inspection managers, auditors, and safety and health engineers are tasked with monitoring risk, documenting incidents and maintaining compliance with OSHA and other industry standards for safety. Securing the accurate and ongoing execution of these standards is a challenge that seems to be expected from the job.
With QuickBase, building an Audit Management app that fits your existing audit processes exactly has never been easier. Ensure the accurate and ongoing execution of your audits and be confident that you’re running a safe and successful business.
How to Become a Versatile Product Manager by Google's PMProduct School
The pace of change in technology products is accelerating. As you build out your Swiss army knife of Product Manager skills, one key asset is an ability to be able to adapt to different types of products. Large companies look to hire generalist product managers who can navigate across product areas with ease. Some startups pivot from focusing on the consumer to becoming a B2B product. Are you prepared to be the versatile Product Manager that can be effective, no matter what?
In this session, Siddharth Bhai from Google took a look at three types of products, and discussed their distinct needs and strategies to succeed as a Product Manager in each:
Enterprise (Eg. Infrastructure/Deployment/IT)
Consumer (Eg. Apps/Websites)
Business (Eg. Sales/Marketing/Finance)
How to Build the Best Apps by Ticketmaster’s Sr. Product ManagerProduct School
When the Mobile Product team at Ticketmaster set out to re-envision the app, they thought a lot about how they could make the experience relevant, engaging and simple. They started product focus groups a few months ago and started bringing actual fans into our Hollywood office to answer the critical question, “What do consumers need right now that matters? What causes them to engage numerous times? What is important to them?” Their new app is built from the ground up on a foundation of empathy focused on increasing fan confidence in the app. It recognizes that their fans are ardent artist supporters, and they want to be rewarded for their loyalty.
Cecilia White, Senior Product Manager at Ticketmaster, talked about why they decided it was time to build a new Ticketmaster experience with new architecture and technologies.
AEM DataLayer IMMERSE 2017 Presentation by Dan KlcoDaniel Klco
Presentation at IMMERSE 2017 about AEM DataLayer, an Open-Source library, based on the Apache Sling framework, which makes it easy to create DataLayers using Adobe Experience Manager.
Lean & Agile: What Publishing Can Learn From Startupsrwillmer
This presentation was given by at the Edinburgh Publishing Conference held June 12, 2013 at the Edinburgh Business School in Edinburgh, Scotland. The conference examined the innovation, disruption and new business models that are helping to shape the future of publishing. In this presentation, Rachel Willmer, the founder of Luzme (a worldwide ebook search site) discussed how Lean & Agile practices learned from decades of software startups can be applied to building a successful business in the new disrupted future of publishing.
How to Design Inclusive Products by Google's Sr. Product ManagerProduct School
Product managers have to be user centric to build great products, but many Product Managers stop short and focus only on generic use cases. A great product that reaches the masses needs to be inclusive of the many different types of users that might use it.
Laura Holmes from Google talked about how to build inclusive products and discussed how biases can impact product design and the many tools for counteracting bias as you build the next unicorn.
Bullet Points on what Ravi Tadi, a Lead Software Engineer at eBay talked about were which mobile web app you should build, (PWA, Website and AMP), how to scale the app globally, and how to build the app with speed, network and usability in mind?
Myths and Illusions of Cross Device Testing - Elite Camp June 2015Craig Sullivan
A compendium of the most common mistakes and problems people encounter when trying to optimise or split test cross device experiences (mobile, tablet, desktop, app, tv etc.)
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to MeCraig Sullivan
An updated deck of a short talk (30m) given at the first Brighton CRO meetup. Contains useful AB testing tools as well as full speaker notes for most of the slides.
Website Accessibility FAQs by MediacurrentMediacurrent
Got web accessibility questions? Mediacurrent’s expert team has answers. This webinar was presented by a cross-disciplinary team of web developers, designers, and strategists.
The transcript and a recording of the event are available on our blog:
https://www.mediacurrent.com/blog/website-accessibility-faqs-webinar-recording-and-transcript/
SilverStripe is a PHP web application framework and CMS that is comparable to WordPress and Joomla but it is leaner, more secure and enterprise ready. This presentations gives an overview of some of its features and includes a video demo.
How to Disrupt Digital Product Cultures by LearnVest VP of ProductProduct School
A big part of product management success is bringing various cultures together from people, process, and innovation. Vivek Bedi from LearnVest hosted the product and technology digital teams from Northwestern Mutual and LearnVest as they discussed over the past two years how they have brought two cultures together to come up with a bold, brave, yet balanced "third" culture.
The new culture is one of taking risks, being ok with failing, and focused on innovation while keeping focus on being at the center of clients' financial lives.
Product Development with Spotify's Product ManagerProduct School
Companies treat the role of product management differently. Miles Davis, Product Manager at Spotify, shared how they articulate the product development process at Spotify and the role and expectations of a PM.
User Experience: Building with Hypermedia for Other FolksNordic APIs
Why do certain technologies succeed in upending the development landscape while so many others fall to the wayside? Can we drive commercial success from technological choices we make on a daily basis?
SPA frameworks like React, and Angular, and opinionated libraries like Ruby on Rails, Spring and Django all share a common obsession with the user experience. Many of the worlds largest organizations grew relying on obsessive customer focus. What can we learn from this to enhance our API Design and Strategy?
In this talk we’ll explore how we can utilize hypermedia to improve experiences for our consumers and developers.
Every day, inspection managers, auditors, and safety and health engineers are tasked with monitoring risk, documenting incidents and maintaining compliance with OSHA and other industry standards for safety. Securing the accurate and ongoing execution of these standards is a challenge that seems to be expected from the job.
With QuickBase, building an Audit Management app that fits your existing audit processes exactly has never been easier. Ensure the accurate and ongoing execution of your audits and be confident that you’re running a safe and successful business.
How to Become a Versatile Product Manager by Google's PMProduct School
The pace of change in technology products is accelerating. As you build out your Swiss army knife of Product Manager skills, one key asset is an ability to be able to adapt to different types of products. Large companies look to hire generalist product managers who can navigate across product areas with ease. Some startups pivot from focusing on the consumer to becoming a B2B product. Are you prepared to be the versatile Product Manager that can be effective, no matter what?
In this session, Siddharth Bhai from Google took a look at three types of products, and discussed their distinct needs and strategies to succeed as a Product Manager in each:
Enterprise (Eg. Infrastructure/Deployment/IT)
Consumer (Eg. Apps/Websites)
Business (Eg. Sales/Marketing/Finance)
How to Build the Best Apps by Ticketmaster’s Sr. Product ManagerProduct School
When the Mobile Product team at Ticketmaster set out to re-envision the app, they thought a lot about how they could make the experience relevant, engaging and simple. They started product focus groups a few months ago and started bringing actual fans into our Hollywood office to answer the critical question, “What do consumers need right now that matters? What causes them to engage numerous times? What is important to them?” Their new app is built from the ground up on a foundation of empathy focused on increasing fan confidence in the app. It recognizes that their fans are ardent artist supporters, and they want to be rewarded for their loyalty.
Cecilia White, Senior Product Manager at Ticketmaster, talked about why they decided it was time to build a new Ticketmaster experience with new architecture and technologies.
AEM DataLayer IMMERSE 2017 Presentation by Dan KlcoDaniel Klco
Presentation at IMMERSE 2017 about AEM DataLayer, an Open-Source library, based on the Apache Sling framework, which makes it easy to create DataLayers using Adobe Experience Manager.
Lean & Agile: What Publishing Can Learn From Startupsrwillmer
This presentation was given by at the Edinburgh Publishing Conference held June 12, 2013 at the Edinburgh Business School in Edinburgh, Scotland. The conference examined the innovation, disruption and new business models that are helping to shape the future of publishing. In this presentation, Rachel Willmer, the founder of Luzme (a worldwide ebook search site) discussed how Lean & Agile practices learned from decades of software startups can be applied to building a successful business in the new disrupted future of publishing.
How to Design Inclusive Products by Google's Sr. Product ManagerProduct School
Product managers have to be user centric to build great products, but many Product Managers stop short and focus only on generic use cases. A great product that reaches the masses needs to be inclusive of the many different types of users that might use it.
Laura Holmes from Google talked about how to build inclusive products and discussed how biases can impact product design and the many tools for counteracting bias as you build the next unicorn.
Bullet Points on what Ravi Tadi, a Lead Software Engineer at eBay talked about were which mobile web app you should build, (PWA, Website and AMP), how to scale the app globally, and how to build the app with speed, network and usability in mind?
Myths and Illusions of Cross Device Testing - Elite Camp June 2015Craig Sullivan
A compendium of the most common mistakes and problems people encounter when trying to optimise or split test cross device experiences (mobile, tablet, desktop, app, tv etc.)
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to MeCraig Sullivan
An updated deck of a short talk (30m) given at the first Brighton CRO meetup. Contains useful AB testing tools as well as full speaker notes for most of the slides.
Surviving the hype cycle Shortcuts to split testing successCraig Sullivan
In this talk, I show the key shortcuts to stop doing stupid testing and move towards innovative and transformative design & build methodologies, including innovation through split testing exploration
#Measurecamp : 18 Simple Ways to F*** up Your AB TestingCraig Sullivan
An expanded deck of the top 18 blockers to getting successful AB or Multivariate test results. In this deck, you get a complete checklist of the stuff you need to prepare, watch, launch and monitor your testing, so it gets you the *right* conclusions.
12 Things to do Before Your Company Dies : Conversion Conference London - Oct...Craig Sullivan
A roundup of all the things to help you maintain a competitive edge in experience design and conversion optimisation. With examples of companies putting this stuff together, the tools they are using and their project management approaches, this presentation delves deeper into the cultural aspects of CRO.
Myths, Lies and Illusions of AB and Split TestingCraig Sullivan
What are the common assumptions about AB (split) testing that are wrong? What are the lies told by vendors, consultants and the stuff you have convinced yourself about. What is illusory - what can you trust - what's it really all about. 20 top myths debunked after asking fellow CRO professionals what is on THEIR top list.
20 Ways to Shaft your Split Tesring : Conversion ConferenceCraig Sullivan
This talk is the latest deck showing common problems that will easily break or skew your ab and multivariate testing results. Avoid these problems by following the simple advice in this deck!
Surviving the AB Testing Hype Cycle - Reaktor Breakpoint 2015Craig Sullivan
My Slides from Reaktor Breakpoint 2015 - This is by far the best deck (and hopefully talk) I've done this year. Masses of info, reading, articles, useful reports and more.
10 Easy Ways to Irritate Your Design Team
Slides from the NUX7 talk by Jane Austin, Friday 19th October 2018.
2018.nuxconf.uk / nuxuk.org
Synopsis
How can good design be integrated into your business profitably? Jane will answer this question by considering the ‘anti-problem’. She will share 10 ways designers and business people can guarantee their behaviours and activities will ensure they never see eye-to-eye, their efforts will be wasted and everyone involved will know it is not their fault.
You will probably recognise most of these techniques in action in your own organisation. That is the anti-pattern.
If things are going to change for the better, do the opposite.
Good Intentions and Bad Actors: Unleashing Our True Design Superpowers
Slides from the NUX7 talk by Lisa deBettencourt, Friday 19th October 2018.
2018.nuxconf.uk / nuxuk.org
Synopsis
As experience designers, we have unique superpowers to craft products and services in ways that can be wonderfully beneficial to people and integrate seamlessly into their lives. We are able to leverage our understanding of the human condition to transform technology into offerings that make millions of dollars for companies, while remaining idealistic about our goals of making people’s lives better. But there’s a gap: we don’t verify that we did move the needle. We don’t consider what things might just go sideways. We don’t invest in analyzing what might happen if our work is abused or consider how to prevent it. We just move onto the next problem statement and let the business figure it out.
I think this borders on negligence. We have a responsibility to ourselves, our profession, our customers, our colleagues, and the businesses who employ us to forecast the impact of our work at scale. And we need to develop the tools and the processes to do so properly. It’s time we hold our selves accountable and start to proactively identify the potential outcomes and unintended consequences of our work – both good and bad – as a regular phase in our design process. With this, we must also be prepared to influence the decision making bodies (including ourselves) to consider ways of mitigating those identified risks. This strategy, in my opinion, will allow us to engage our product and business colleagues as equals, thereby raising our own value as true business partners.
Everything Connected
Slides from the NUX7 talk by Christopher Murphy, Friday 19th October 2018.
2018.nuxconf.uk / nuxuk.org
Synopsis
It’s been nearly thirty years since the birth of the web and in that time our role as designers has changed dramatically.
In the 90s we designed for a desktop context, focused primarily on standalone experiences. A decade ago, with the launch of the iPhone, our remit expanded, embracing the challenge of designing for both desktop and mobile contexts. The recent emergence of a ‘connected landscape’ has transformed our industry once again. The challenge we now face as designers is to build ‘connected ecosystems’, considering: hardware and software; desktop and mobile; web and native….
As we race headlong into the future, I’ll explore the exciting opportunities ahead for designers working in a connected culture, identifying core principles we can embrace to keep up with the ever-shifting digital landscape.
It’s Complicated – Designing in The Age Of Emergence (by Christina Wodtke at ...Northern User Experience
It’s Complicated – Designing in The Age Of Emergence
Slides from the NUX7 talk by Christina Wodtke, Friday 19th October 2018.
2018.nuxconf.uk / nuxuk.org
Synopsis
The problem with unexpected consequences is that they are unexpected. The time of “move fast and break things” is over, as we have broken everything from hearts to democracy.
It’s time for designers, along with their partners – engineers and business – to embrace a new long term approach to bringing change into the world, that focuses less on disruption and more on evolution. In this talk, Christina will explore various approaches to designing more robust and compassionate change.
Google use 5-day design sprints to map, sketch, vote on ideas, prototype and test designs with users. The design sprint is their battle-tested way to quickly answer critical business questions.
Marc O’Connor and James Oliver talked about their experiences of using a design sprint. These slides broadly cover each day of the sprint, include a couple quick activities and show how they got team members and stakeholders to agree it was a good idea.
Ian Franklin from IdeaSmiths discussing fitting Usability Labs into Agile sprints.
Traditionally, usability labs took a long time to organise; often just a usability bug hunt and resulted in a lengthy report of recommendations that no one read and took weeks to produce.
This talk covers how to adapt the usability lab to include discovery and co-creation, yet still record results rigorously while completing analysis and reporting within a couple of days.
It also covers how to counter the common objections to user feedback (“its only 5 users”, “it’s just anecdotes”) and how to use the lab to get stakeholders on side.
User research assets: treasure or trash?
Slides from the NUX6 talk by Kate Towsey, Friday 27th October 2017.
2017.nuxconf.uk / nuxuk.org
Synopsis:
Hours of audio and video, photographs, notes, decks, matrices, various types of visual presentations, and even physical assets picked up in the field – and even walls! We make a lot of stuff in doing user research. Are these things potential treasure troves of knowledge for future research? Or are they things that, once used and acted upon, become more complicated to keep than to trash?
A couple of years ago, I spent several months researching how the GDS user research team and their colleagues felt about the stuff they made during user research. Off the back of that research, we ran a pilot for an A/V library. Then I wrote a blog post about the research results. Since then, I’ve had many conversations with organisations around the world trying to answer the same question: can we make our research assets useful in the long term?
In this talk, I’ll share what I learned at GDS, and what I’ve learned in talking to industry since. It’ll be an open-ended talk, but, I hope, a good starting point for cross-industry knowledge sharing and debate.
Slides from the NUX Leeds talk:
Witnessing health: impactful user research in the NHS
with Rochelle Gold, User Researcher, NHS Digital
This presentation will discuss approaches, challenges and barriers to conducting user research within health and how to overcome them. It will cover both clinician and patient user research and the value of being a ‘witness to experience’ and the impact that this can have.
About Rochelle
Rochelle Gold is a user researcher at NHS Digital. She has worked on a number of digital health services including NHS UK and the NHS e-referral service. Her work in the health space has focussed on a range of users from clinicians to patients. She previously led research for West Yorkshire Probation and is also experienced in research in social care and the private sector. Rochelle has also taught research methods at undergraduate level and has a background in occupational psychology.
Mixing methods abroad: A case study
Slides from the NUX5 talk by Karina van Schaardenburg, Friday 7th October 2016.
2016.nuxconf.uk / nuxuk.org
Synopsis:
As a UX researcher, sooner or later someone will ask you an unanswerable question, give you a tiny budget, and ask for results in practically no time. I’ll share a few tricks to help you get through it and have fun along the way.
Last summer I got an email from the executive team asking me “What do we know about Turkey? Can you put together a proposal?” After spending a few minutes in front of my computer muttering to myself that there was no way I could answer a question that broad in any kind of time frame, let alone the 8 weeks I was given, I took a deep breath and got to work.
In this talk you’ll learn how to tackle the big questions by combining several research methods. While we’re at it, I’ll also teach you how to avoid riot police during field studies and how to interview people while walking down some of the busiest streets in the world.
Security and User Experience: Pushing for Change in the Enterprise Environment
Slides from the NUX5 talk by Glenn A. Gustitus, Friday 7th October 2016.
2016.nuxconf.uk / nuxuk.org
Synopsis:
Pushing for change in an enterprise environment is a challenge. Improving the user experience of security solutions that historically have conflated being difficult to use with being more secure, is an even larger challenge. In this talk, Glenn is going to show you why security needs our help, and how to have a positive impact in an environment known for being especially change resilient.
Sometimes, we need to unite to bring UX to the fore. We need to work hard to demonstrate its true benefits to any business. Sometimes we need to cut through the bureaucracy and just make it happen.
There’s someone on our doorstep who’s managed to do just that.
In the fight to transition from a pre-internet catalogue business into the world class digital retailer that they are today, Shop Direct have created and embedded Test and Learn into the heart of their culture. They combine in-house experiments with their own flavours of Lean UX and Kanban methodologies.
What can we learn from them? During this talk, we’ll hear stories from the font-line; how a business became convinced that embedding UX can make a truly remarkable difference. We’ll get insight into building stronger UX teams ourselves and, most importantly, we’ll get some invaluable direction when it comes to selling User Experience to the people that lead our organisations.
Everybody Hurts: Content for Kindness (by Sara Wachter-Boettcher at #NUX4)Northern User Experience
We all want interfaces that feel human—where the content is friendly and everything flows right along. But being human isn’t just about being breezy.
Every user who interacts with your site comes there with personal histories—with pain and problems, with past traumas or present crises. How can we take our users’ vulnerabilities, triggers, and touchy subjects into account when we don’t even know what they are? What would it mean to optimize not just for seamlessness, but for kindness? This talk will show you how clear intentions and compassionate communication can strengthen everything from form questions to headlines to site structures.
http://2015.nuxconf.uk/speakers/sara-wachter-boettcher/
NUX Newcastle Sept 2015 event - James Oliver, a User Experience Consultant, offered useful tips & pointers for those looking to facilitate some user interview research sessions – for beginners as well as good reminders for those with some experience. This was followed by an activity where teams picked from a lucky dip of research topics, brainstorm questions and formulated these into interview scripts. After a few rounds of practicing interviewing, the talk will end with tips on how to analyse the results and what can be done next.
Wearables: a show & tell with user stories
with Amy Higgott @amyhiggott, James Medd @jamesmedd and Lucy Buykx @lucybuykx
NUX Manchester - 14 September 2015
NUX Leeds - 26/03/2015 - The Role of the Graphic Designer in UXD - Simon Jone...Northern User Experience
Simon shared his thoughts with NUX Leeds on March 26th 2015 on the role of the graphic designer in the UXD process. Simon's talk promoted and argued for an integration and synthesis of UXD and Graphic Design disciplines. The talk addressed various factors characteristic of a Graphic Designer’s experience and education that can support and enrich the UXD process.
ER(Entity Relationship) Diagram for online shopping - TAEHimani415946
https://bit.ly/3KACoyV
The ER diagram for the project is the foundation for the building of the database of the project. The properties, datatypes, and attributes are defined by the ER diagram.
Multi-cluster Kubernetes Networking- Patterns, Projects and GuidelinesSanjeev Rampal
Talk presented at Kubernetes Community Day, New York, May 2024.
Technical summary of Multi-Cluster Kubernetes Networking architectures with focus on 4 key topics.
1) Key patterns for Multi-cluster architectures
2) Architectural comparison of several OSS/ CNCF projects to address these patterns
3) Evolution trends for the APIs of these projects
4) Some design recommendations & guidelines for adopting/ deploying these solutions.
This 7-second Brain Wave Ritual Attracts Money To You.!nirahealhty
Discover the power of a simple 7-second brain wave ritual that can attract wealth and abundance into your life. By tapping into specific brain frequencies, this technique helps you manifest financial success effortlessly. Ready to transform your financial future? Try this powerful ritual and start attracting money today!
1.Wireless Communication System_Wireless communication is a broad term that i...JeyaPerumal1
Wireless communication involves the transmission of information over a distance without the help of wires, cables or any other forms of electrical conductors.
Wireless communication is a broad term that incorporates all procedures and forms of connecting and communicating between two or more devices using a wireless signal through wireless communication technologies and devices.
Features of Wireless Communication
The evolution of wireless technology has brought many advancements with its effective features.
The transmitted distance can be anywhere between a few meters (for example, a television's remote control) and thousands of kilometers (for example, radio communication).
Wireless communication can be used for cellular telephony, wireless access to the internet, wireless home networking, and so on.
3. BACK TO 1999
@OptimiseOrDie
• Now I’m known as ‘that testing guy’
• But I started life as a UX practitioner
• >600 hours moderating in 3 years
• Everything I did started here
• Where did it take me?
4. • UX, Analytics, Tools, blended.
• I coach people and teams on
how to experiment profitably
• I’m a plumber looking for
‘ leaks’ in the delight or revenue
for a business
• Most companies don’t know
• This is my job
@OptimiseOrDie
TODAY
5. Why do I get so angry?
Because We are
F***ing Stupid!
@OptimiseOrDie
9. Reddit Explains…
“If it comes off in one, it's gonna be
banging! If you’re picking plastic out
of your dinner for ten minutes, it's
probably gonna taste like shit.”
@OptimiseOrDie
10. Quick Calculation:
• £4.5Bn Sales @ £3.5 average price
• Assume 60% are failures
• Costs 90 seconds of wasted time
• 72514285714 seconds wasted
• 1208571428 minutes
• 20142857 hours
• 839,285 days of life - wasted on friction!
• What about injuries? Food wastage? Ennui?
@OptimiseOrDie
12. A Packaging Manifesto:
1. Packaging should never require a tool or knife to open
2. Packaging should not require finger control or strength
which discriminates against population groups
3. Any packaging must be capable of being returned to its
original state to preserve any unused contents
@OptimiseOrDie
18. @OptimiseOrDie
“We are a data driven and
customer centric organisation…”
(but none of us have watched,
read or listened to customer
feedback in a year)
19. @OptimiseOrDie
“We have Session Replay,
Heatmaps, Form Analytics and
Voice of Customer Feedback”
(we just don’t look or act
on what they tell us)
20. @OptimiseOrDie
“We have agile product
development teams”
(but we haven’t reformed
anywhere else - signoff
takes a month)
21. @OptimiseOrDie
“We have a huge Conversion
Optimisation Team of 6 people”
(but they’re working
in a Silo, tinkering with button
testing or trivial insights)
22. @OptimiseOrDie
“We apply lean thinking at all
levels of the organisation”
(but we haven’t
changed the way
teams and managers
actually work)
23. @OptimiseOrDie
“We have the best tools,
methodologies and team around”
(but absolutely nothing
useful happens)
37. The Ikea of Psychological Ninja Messaging?
• Like a ‘Franchise’ store
• Every space competing directly
• Maxed out on persuasion
• Point optimised
• Works ‘on average’
• Holistic Experience?
• How do I actually FEEL?
38. The Ikea of Psychological Ninja Messaging?
CMA to probe Hotels: bbc.in/2hfh70r
40. @OptimiseOrDie
• Clothing 1M per month, 2 bugs
• Travel 2M per month, 13 bugs
• Telecoms 1.4M per month, 3 bugs
• Travel 0.6M per month, 1 bug (iPad)
• Event Site 2.5M per month, 11 bugs
– These were only the first bugs we found
– < 5 days time to fix – an ROI of 91,150%
– Larger than the annual IT budget for some!
How much do product defects cost?
44. • We’re swamped with data
• The underlying data is often flawed or unreliable
• We don’t know what’s wrong with our products
• We change stuff without evidence or observation
• We build stuff nobody wants or needs
• Product changes are not measured or tested
• Nobody takes stuff away from the website
• We build what internal people want, not customers
• We don’t remove costly defects and wastage
• Lean & Agile have left us with new types of debt
• Ego is the enemy of all good work
• Much Internet design is infused and driven by Ego
@OptimiseOrDie
What is going wrong?
49. @OptimiseOrDie
• MVP approach
• Launch as alpha, beta, pilot,
phased rollout
• This approach includes
split testing to tune,
optimize or decide!
• 100s of releases a day!
• Like getting in a shower
• Read more at labs.ft.com
FT.COM – Release Methodology
50. @OptimiseOrDie
• Small teams with direct access to publish
• Ability to set and get metrics data directly
• Tools, Autonomy, Lack of interference
• No Project Managers or Business Analysts
• Stakeholders decoupled from work
FT.COM - Corporate Models bit.ly/2mZAxH7
51. @OptimiseOrDie
• Business wants: “15% increase in 12 months”
• Business defines ‘outcomes’ – teams deliver
• No long signoff chain
• No pesky meddling during execution
• Less time wasting meetings with morons!
• Outcome not feature driven optimization
FT.COM - Decoupling bit.ly/2mZAxH7
52. @OptimiseOrDie
• Most product changes we make are a waste of time!
• The Financial Times – 50-70% of product developer time
wasted in a siloed organisational structure
• Minimum project time was “At least 18 months” for anything
• Projects were always late, underperformed, didn’t shift
metrics as expected
• Post changes, every IT project was under time & budget
• Products were iterated to hack their way to success
FT.COM – Advantages
53. @OptimiseOrDie
“Product changes and AB tests are just the
same thing to us. Where we’re moving to is
measuring and testing everything we do.
This approach tells us what works, what
doesn’t, what to keep, what to remove and
what we need to iterate.”
Financial Times – NextFT project
FT.COM – Advantages
54. • Reform the Organisation, not the tools
• Invest in analytics and people skills
• Set people free to learn new disciplines and skills
• Stop delivering ‘features’ and start doing ‘outcomes’
• Validate everything - changes, tests, personalisation
• Test everything that *can* be tested
• Stop Ego from driving product – use insights & data
• Continuous improvement rather than large releases
• Use multiple product ‘horizons’ for strategy
• Blend Lean, Agile, Data, UX and AB testing
• Let’s give you some tips to take away and use!
@OptimiseOrDie
What can we do about it?
55. @OptimiseOrDie
Conversion Research in One Hour:
bit.ly/batmantesting
Session Replay Tools for Research:
bit.ly/decibelWAW & bit.ly/ReplayTools
The List of UX Tools to Rule Them All:
bit.ly/UxTools & bit.ly/uxresourcepack
Lean Research – Further Reading:
56. @OptimiseOrDie
Lean Organisations – resources:
How Booking.com tests & organises teams:
http://bit.ly/SFrisby
Growth Team Models & Explanations:
http://bit.ly/GHmodel
ING video on Lean Corporate:
http://bit.ly/ingvideo
57. 1. Find out your Testing Bandwidth - Can you run any tests at all?
2. Stop copying stuff blindly - Test or validate changes, don’t assume
3. Get with Statistics - Doing testing? You need stats skillz
4. Run a test Calculator - How long it takes and when to stop
5. Prioritise All the Testing - Do the right tests in the right order
6. Get a Decent Hypothesis - Forget this, forget your AB testing
7. Record the device experience - Store the screen & recordings
8. Simplify your Test Decisions - Stop overcomplicating test analysis
9. Avoid Toxic AB Testing - Defects ruin your work and decisions
10. Test Across 3 Horizons of Product - How to test ahead of yourself
@OptimiseOrDie
10 AB Testing Power-ups
58. >1200 tests a year
>1000 tests live
99% chance you’re in 10 tests
7000 tests in 2011
100,000 tests last year
@BartS
1: Find Out your Testing Bandwidth
59. 1: Do you have testing bandwidth?
• This is a little Amoeba
• It hasn’t evolved to ride a bike yet
• Do you have enough traffic?
• < 500 ‘conversions’ a month?
• Work on product/market fit!
• Work that user research!
@OptimiseOrDie
60. 2: Stop Copying Stuff Blindly…
• Your customers are not the same
• Your site is not the same
• Your platform is not the same
• Your advertising isn’t the same
• The traffic isn’t the same
• The UX is not the same
• Your Device Mix is not the same
• Your mistakes are different
bit.ly/BestPUnicorns
bit.ly/BPSuccess
bit.ly/BestpFAIL
@OptimiseOrDie
62. @OptimiseOrDie
“Why every Internet Marketer should be a Statistician”
http://bit.ly/1wMfs1G
“Statistical Significance does not equal Validity”
http://bit.ly/1wMfmY2
“Understanding the Cycles in your site”
http://mklnd.com/1pGSOUP
“Statistics for Dummies”
http://bit.ly/stats4dummies
3: Get With Statistics
63. @OptimiseOrDie
• Run a test calculator first
• If the answer is 9 Million years, do something else instead!
Online Dialogue Suite: bit.ly/CaLC1
VWO : bit.ly/CaLC2
Optimizely : bit.ly/CaLC3
Evan Miller : bit.ly/CaLC5
• Testing is trading time and effort vs. potential reward
4: Run a Test Calculator
65. @OptimiseOrDie
Target Users
per
week
CR % AOV Each 5% 5% li8
detected
sample
Min
Weeks
10% li8
detected
sample
Min
Weeks
15% li8
detected
sample
Min
weeks
Basket 100,000 5% £140 £35,000 48098 1 12301 1 5590 1
Landing 1 60,000 3% £190 £17,100 25566 3 6531 1 9528 1
Landing 2 18,000 0.6% £100 £540 419876 47 107513 12 48913 6
• How long will it take to see a difference of 5, 10 and 15%?
• How much sample are you going to need to ‘detect’ an effect you’re hoping for
• S-ck to tests that have decent sta-s-cal power, to save was-ng -me!
• Read these two ar-cles:
https://inbound.org/discuss/conversionxl-live-notes-slides-and-q-a-
slideshare-s-now-included#paulinemarol
https://conversionxl.com/better-way-prioritize-ab-tests/
5: Statistical Power & Money Model
68. @OptimiseOrDie
• Store the design layout in Google Analytics or other package
• Use this to segment the results by the size of the design seen!
7: Record the Design people ‘see’
72. 1. Get an Analytics Audit - Broken tills mean broken company
2. Make a Device List - Prove you know this please
3. Test and Fix Broken shit - Customers don’t self report problems
4. Do Rapid Usability testing - Low cost and vital for great ideas
5. Add Session Recording - See broken stuff, get evidence, fix it
6. Run a Customer Survey - Regular surveys provide long term insight
7. Install Voice of Customer tools - This asking people shit will never catch on
8. Hire a Copywriter - Best money you’ll ever spend
9. Invest in Analytics - Google Analytics is NOT free
10. Add Form Analytics - Stop guessing and know what happens
11. Check your Web Performance - Performance makes £££
@OptimiseOrDie
11 Optimisation Power-ups
73. @OptimiseOrDie
1: Get an Analytics Audit, NOW!
“Check the tills
are working AND
recording correctly!”
@OptimiseOrDie
@CharlesMeaden
74. • What’s YOUR testing list?
• Anyone checked if it’s true?
• Use Google Analytics to tell you!
• Tip – do these as a minimum:
• iPhone 5/6
• iPad late model
• Samsung late model
• Desktop (Chrome, Edge, Safari)
bit.ly/UltimateXDO
@OptimiseOrDie
2: WHAT do they ACTUALLY use
79. @OptimiseOrDie
4: Shitty User Research – Stop It!
What the f*** is going on here:
• Biased samples from recruitment & screening
• Ineffably bad or biased moderator scripts
• Focus on quantitative questions in qual research
• Biased online panels (serial testers, poor screening)
• Low cost does not mean good fidelity
• Moderation as a skill to me seems ‘less valued’
80. 1.5 Interviewing Tips
• Doing this stuff properly is hard
• Interviewing and testing tips:
“Don’t Make Me Think” amzn.to/1gIZEJn
“Rocket Surgery Made Easy” amzn.to/1e0hnUL
“Talking to Customers” bit.ly/1e0hT58
“Talking with Participants” bit.ly/1kKL3LE
“Don’t listen to Users” bit.ly/1cQpiIE
“Interviewing Tips” bit.ly/1fKqu03
“More interviewing Tips” bit.ly/1bmvGT
80
85. @OptimiseOrDie
8: The Economics of Copywriting
“Stop asking people to fill-in by writing
copy. Especially don’t ask developers to
do this! Hire staff or train them.
Bad copy on your site costs more money
than hiring someone. Good copy earns
tens or hundreds of times that cost..”
86. @OptimiseOrDie
9: Invest in Analytics
• Google Analytics is NOT free
• Your Car will not run without Oil
• Your Analytics will not run without Love
• Put budget into optimising the analytics!
It’s like writing a love note to your future self!
Do it today. Start writing it.
87. @OptimiseOrDie
10: Add Form Analytics
Formisimo
www.formisimo.com
Heap analytics
www.heapanalytics.com
Hotjar
www.hotjar.com
Google Tag Manager & Analytics
bit.ly/SimoGA
“This is so we can call you in
case there’s a problem
delivering your order.”
88. 11: Check your Web Performance
• Turn off Wi-Fi at all times!
• Use these performance tools:
Mobile & Desktop
Mobile Speed test
Google Pagespeed Insights:
• Google analytics TELLS you what’s slow:
• Google Statistics on Site Performance:
(< 2 seconds good, 2-3 just OK, 3+ bad)
@OptimiseOrDie
89. 1. Get an Analytics Audit - Broken tills mean broken company
2. Make a Device List - Prove you know this please
3. Test and Fix Broken shit - Customers don’t self report problems
4. Do Rapid Usability testing - Low cost and vital for great ideas
5. Add Session Recording - See broken stuff, get evidence, fix it
6. Run a Customer Survey - Regular surveys provide long term insight
7. Install Voice of Customer tools - This asking people shit will never catch on
8. Hire a Copywriter - Best money you’ll ever spend
9. Invest in Analytics - Google Analytics is NOT free
10. Add Form Analytics - Stop guessing and know what happens
11. Check your Web Performance - Performance makes £££
@OptimiseOrDie
11 Optimisation Power-ups
91. SECTION TITLE
1 MOST AB TESTING IS DOG POO
2 CROSS DEVICE EXPERIENCES SUCK
3 DEFECTS AND WASTAGE ARE HUGE
4 EONS ARE WASTED BUILDING USELESS STUFF
5 PEOPLE & CULTURE MAKE PROBLEMS, NOT TOOLS
6 DATA DRIVES NOTHING, PEOPLE ARE THE LENS
7 UX, ANALYTICS, TESTING & TOOLS = SUCCESS
8 TEAM PRODUCTIVITY & QUALITY STILL SUCK
9 REFORM THE COMPANY, NOT THE TECHNOLOGY
10 QUAL WITH QUANT TRIANGULATES & FOCUSES
SUMMARY
93. @OptimiseOrDie
The Experience Optimisation Engine
(1) Pre Model Checklist
Groundwork and common
sense checks before any
modelling or research begins
(2) Rapid Modelling
Basic sketching & modelling to
prioritise focal areas for
research, reduce scope
(3) Research or Heuristic
Use upfront & rapid analytics
insights to prioritise focal areas
for research time
(4) Model
Post research – model the site
around priorities from research,
analytics & more
(5) Streaming
This is where the big pile of
issues gets turned into different
project backlogs
(6) Triage & Triangulate
Where you cluster themes or
issues, triangulate clues from
multiple tools and run sizing
against test targets
(7) Prioritisation
Where you bubble the most
promising test ideas to the top
of the stack bit.ly/CRO4Agencies
95. CRAIG SULLIVAN
Senior Optimisation
Consultant
@OptimiseOrDie
24TH OCTOBER 2013
EMETRICS LONDONOptimiser Of
Everything
THANK YOU!
Manchester Workshop Next Week:
bit.ly/MancClass
20 hours of training for £380:
bit.ly/CRO4Agencies
Get this Deck:
http://bit.ly/ProductPoo
Read my stuff:
medium.com/@optimiseordie
@OptimiseOrDie