This document summarizes Craig Sullivan's presentation on UX and conversion rate optimization (CRO). Some of the key topics and tools discussed include: conducting guerrilla usability testing outside the office; using session replay tools to analyze user behavior; leveraging the voice of the customer through surveys and customer feedback; acting like a private investigator to research competitors; and experimenting with split testing tools and analytics to optimize conversions and revenue. Specific examples are provided of split testing people in photos and the effectiveness of different images in TV advertising. The presentation emphasizes the importance of blending UX techniques with analytics, testing, and data to create successful, customer-delighted products and services.
The Neuromarketing Toolkit - Chinwag Psych - 4 Feb 2014Craig Sullivan
A practical toolkit for getting inside customers heads, in order to design and create persuasive psychological approaches to copy, pages, buttons, designs and your entire service. Craig shows you here how to mine what you already have - to design a better bank balance and continuously improving future for your company, staff and your customers.
Cross Device Optimisation - Google Analytics ShortcutsCraig Sullivan
In this session, we explain how to mine GA for broken device experiences, flows, funnel blocks and more... Using a new grid tool we've developed, you can pull multi-dimensional segmented funnel and metric data from Google Analytics - we explain how it works, why you need it and what problems it solves. Find where your site is leaking money through data
Web Analytics Wednesday - Session Replay Tools are VitalCraig Sullivan
Session Replay or Screen Recording tools are now part of an arsenal of discovery toolkits that can drive optimisation, bug fixes, funnel and journey analysis - using qual and quant techniques. Without these tools, the analytics data misses emotion, frustration, friction and more - I've collated the best tips, tricks, tools and approaches to yield the most valuable insights for CRO / Growth Hacking.
12 Things to do Before Your Company Dies : Conversion Conference London - Oct...Craig Sullivan
A roundup of all the things to help you maintain a competitive edge in experience design and conversion optimisation. With examples of companies putting this stuff together, the tools they are using and their project management approaches, this presentation delves deeper into the cultural aspects of CRO.
Surviving the AB Testing Hype Cycle - Reaktor Breakpoint 2015Craig Sullivan
My Slides from Reaktor Breakpoint 2015 - This is by far the best deck (and hopefully talk) I've done this year. Masses of info, reading, articles, useful reports and more.
Why Does My Conversion Rate Suck? Craig Sullivan, Senior Optimisation Consult...PRWD
Craig Sullivan, Senior Optimisation Consultant covers the top 10 reasons why your conversion rate might suck. Packed with actionable tips and resources this presentation is for anyone wanting to improve their Conversion Optimisation. Craig covers common problems and topic areas such as issues with Google Analytics setup, inputs, tools, testing, testing cycles, product cycles, Photo UX, how to analyse statistics / Data, segmentation, multiple channel optimisation. The resource pack also include a maturity model, Crowd-sourced UX, collaborative tools, testing tools for CRO & QA, Belron Methodology example, and CRO and testing resources.
The Neuromarketing Toolkit - Chinwag Psych - 4 Feb 2014Craig Sullivan
A practical toolkit for getting inside customers heads, in order to design and create persuasive psychological approaches to copy, pages, buttons, designs and your entire service. Craig shows you here how to mine what you already have - to design a better bank balance and continuously improving future for your company, staff and your customers.
Cross Device Optimisation - Google Analytics ShortcutsCraig Sullivan
In this session, we explain how to mine GA for broken device experiences, flows, funnel blocks and more... Using a new grid tool we've developed, you can pull multi-dimensional segmented funnel and metric data from Google Analytics - we explain how it works, why you need it and what problems it solves. Find where your site is leaking money through data
Web Analytics Wednesday - Session Replay Tools are VitalCraig Sullivan
Session Replay or Screen Recording tools are now part of an arsenal of discovery toolkits that can drive optimisation, bug fixes, funnel and journey analysis - using qual and quant techniques. Without these tools, the analytics data misses emotion, frustration, friction and more - I've collated the best tips, tricks, tools and approaches to yield the most valuable insights for CRO / Growth Hacking.
12 Things to do Before Your Company Dies : Conversion Conference London - Oct...Craig Sullivan
A roundup of all the things to help you maintain a competitive edge in experience design and conversion optimisation. With examples of companies putting this stuff together, the tools they are using and their project management approaches, this presentation delves deeper into the cultural aspects of CRO.
Surviving the AB Testing Hype Cycle - Reaktor Breakpoint 2015Craig Sullivan
My Slides from Reaktor Breakpoint 2015 - This is by far the best deck (and hopefully talk) I've done this year. Masses of info, reading, articles, useful reports and more.
Why Does My Conversion Rate Suck? Craig Sullivan, Senior Optimisation Consult...PRWD
Craig Sullivan, Senior Optimisation Consultant covers the top 10 reasons why your conversion rate might suck. Packed with actionable tips and resources this presentation is for anyone wanting to improve their Conversion Optimisation. Craig covers common problems and topic areas such as issues with Google Analytics setup, inputs, tools, testing, testing cycles, product cycles, Photo UX, how to analyse statistics / Data, segmentation, multiple channel optimisation. The resource pack also include a maturity model, Crowd-sourced UX, collaborative tools, testing tools for CRO & QA, Belron Methodology example, and CRO and testing resources.
Surviving the hype cycle Shortcuts to split testing successCraig Sullivan
In this talk, I show the key shortcuts to stop doing stupid testing and move towards innovative and transformative design & build methodologies, including innovation through split testing exploration
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to MeCraig Sullivan
An updated deck of a short talk (30m) given at the first Brighton CRO meetup. Contains useful AB testing tools as well as full speaker notes for most of the slides.
Essential Tools for Product Managers and Marketers (Oct 2011)Jesse Gant
A refresh of the tools and resources (research/analysis, social monitoring, A/B testing, wireframing, SEO/SEM, etc.) that every Product Manager and Marketer should use or at least know about.
Slides to go with a talk on rapid, lightweight research you can do before tackling a landing page, funnel step or lead-gen form. Comes complete with all the Google Analytics reports you'll need to mine useful data to share! Less bullshit, more truth in meetings!
Product design is Poo - And how to fix it!Craig Sullivan
A look at why product design is still so poor, even after 22 years of digital design work. Why do these problems exist and how can we remove them from the way we build products? Lean corporate and startup growth models are explored in the solutions to this horrendous problem!
#Measurecamp : 18 Simple Ways to F*** up Your AB TestingCraig Sullivan
An expanded deck of the top 18 blockers to getting successful AB or Multivariate test results. In this deck, you get a complete checklist of the stuff you need to prepare, watch, launch and monitor your testing, so it gets you the *right* conclusions.
Myths and Illusions of Cross Device Testing - Elite Camp June 2015Craig Sullivan
A compendium of the most common mistakes and problems people encounter when trying to optimise or split test cross device experiences (mobile, tablet, desktop, app, tv etc.)
20 Ways to Shaft your Split Tesring : Conversion ConferenceCraig Sullivan
This talk is the latest deck showing common problems that will easily break or skew your ab and multivariate testing results. Avoid these problems by following the simple advice in this deck!
Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...Craig Sullivan
A summary of my 4 years of A/B and Split testing, with case studies of work, photography guidelines, and key advice on which elements of the page to test for quick wins.
I enjoyed giving this talk at the Online Retailer Conference in Sydney, which is a fine place to visit.
The presentation c.overs a really good 'pizza' analogy for explaining testing to senior management and budget holders. Then covering how you go about discovering good places to test on your site, and what tools will help you get that data.
Lastly, I explore what worked for me in testing, show some examples of how similar our winners are across the globe and then cover some cross channel testing. The last one here is a big growth area and involves optimising contact centres and channels, using the web as a tool. Some interesting work going on here and I show some of ours, as well as new things in the pipeline.
There are some great resources attached, including a list of remote user testing services and the best 'guides' I could find on 'Conversion Rate Optimisation'. Hope you enjoyed the talk and thank you Sydney.
Myths, Lies and Illusions of AB and Split TestingCraig Sullivan
What are the common assumptions about AB (split) testing that are wrong? What are the lies told by vendors, consultants and the stuff you have convinced yourself about. What is illusory - what can you trust - what's it really all about. 20 top myths debunked after asking fellow CRO professionals what is on THEIR top list.
Mobile presentation - Sydney Online Retailer - 26 Sep 2011Craig Sullivan
In this presentation, I use analytics data from our global mobile reach, to illustrate the trends that are driving growth, how to take opportunity from them and what to do with your own site. I present a case for device and user knowledge, to allow you to optimise conversion rates, revenue and delight for visitors.
The top reasons and solutions for not getting value out of your AB tests - some practical tips for designing insightful and correctly instrumented test
Product Design is Poo - And we're all going to dieCraig Sullivan
A humorous presentation about what is wrong with the current way of building digital products. Showing what is wrong, explaining the signs and giving you a checklist for reforming your company - are laid out with links, resources and further reading.
Did you know that you can develop awesome products with zero product specifications ? We have recently quantified the gains for a product we built using Lean Startup and MVP approach and were pleasantly surprised to find that we could quantify minimum 47% gain in time-to-market, 32% cost savings, 55% improvement in product quality and 40% gain in business value as compared to traditional product development methods.
AB Testing and UX - a love story with numbers and people (by Craig Sullivan a...Northern User Experience
AB Testing and UX - a love story with numbers and people
Slides from the NUX6 talk by Craig Sullivan, Friday 27th October 2017.
2017.nuxconf.uk / nuxuk.org
Synopsis:
What’s wrong with the web these days? The mobile experience sucks. The customer experience sucks. It doesn’t work. It’s too hard to use. The text is too small. Nobody measures this happening. The interaction patterns suck. Nobody ever calls up to complain but nobody does anything anyway. Millions of people lose countless days to friction, poor design and frustrating moments on their devices.
There may be thousands of things you can fix that look promising – but how do you know where to start? What if you could measure what sucked, where it sucked and how big the problem was? Using lightweight research methods and tools, you can stop making excuses and start knowing exactly what to do. Life becomes much simpler and easier with a scientific method of optimising growth or delight within your product.
Craig has trained over 500 people on how to measure and optimise their product experience, finding 100M of ‘lost revenue’ using just one of the techniques you will learn. With reports, checklists, downloadable templates and toolkits for every budget and stage of growth – you can stop guessing tomorrow.
Surviving the hype cycle Shortcuts to split testing successCraig Sullivan
In this talk, I show the key shortcuts to stop doing stupid testing and move towards innovative and transformative design & build methodologies, including innovation through split testing exploration
Brighton CRO Meetup #1 - Oh Boy These AB tests Sure Look Like Bullshit to MeCraig Sullivan
An updated deck of a short talk (30m) given at the first Brighton CRO meetup. Contains useful AB testing tools as well as full speaker notes for most of the slides.
Essential Tools for Product Managers and Marketers (Oct 2011)Jesse Gant
A refresh of the tools and resources (research/analysis, social monitoring, A/B testing, wireframing, SEO/SEM, etc.) that every Product Manager and Marketer should use or at least know about.
Slides to go with a talk on rapid, lightweight research you can do before tackling a landing page, funnel step or lead-gen form. Comes complete with all the Google Analytics reports you'll need to mine useful data to share! Less bullshit, more truth in meetings!
Product design is Poo - And how to fix it!Craig Sullivan
A look at why product design is still so poor, even after 22 years of digital design work. Why do these problems exist and how can we remove them from the way we build products? Lean corporate and startup growth models are explored in the solutions to this horrendous problem!
#Measurecamp : 18 Simple Ways to F*** up Your AB TestingCraig Sullivan
An expanded deck of the top 18 blockers to getting successful AB or Multivariate test results. In this deck, you get a complete checklist of the stuff you need to prepare, watch, launch and monitor your testing, so it gets you the *right* conclusions.
Myths and Illusions of Cross Device Testing - Elite Camp June 2015Craig Sullivan
A compendium of the most common mistakes and problems people encounter when trying to optimise or split test cross device experiences (mobile, tablet, desktop, app, tv etc.)
20 Ways to Shaft your Split Tesring : Conversion ConferenceCraig Sullivan
This talk is the latest deck showing common problems that will easily break or skew your ab and multivariate testing results. Avoid these problems by following the simple advice in this deck!
Condensed testing syrup - @OptimiseorDie @sydney sep 2011 - 4 years of testin...Craig Sullivan
A summary of my 4 years of A/B and Split testing, with case studies of work, photography guidelines, and key advice on which elements of the page to test for quick wins.
I enjoyed giving this talk at the Online Retailer Conference in Sydney, which is a fine place to visit.
The presentation c.overs a really good 'pizza' analogy for explaining testing to senior management and budget holders. Then covering how you go about discovering good places to test on your site, and what tools will help you get that data.
Lastly, I explore what worked for me in testing, show some examples of how similar our winners are across the globe and then cover some cross channel testing. The last one here is a big growth area and involves optimising contact centres and channels, using the web as a tool. Some interesting work going on here and I show some of ours, as well as new things in the pipeline.
There are some great resources attached, including a list of remote user testing services and the best 'guides' I could find on 'Conversion Rate Optimisation'. Hope you enjoyed the talk and thank you Sydney.
Myths, Lies and Illusions of AB and Split TestingCraig Sullivan
What are the common assumptions about AB (split) testing that are wrong? What are the lies told by vendors, consultants and the stuff you have convinced yourself about. What is illusory - what can you trust - what's it really all about. 20 top myths debunked after asking fellow CRO professionals what is on THEIR top list.
Mobile presentation - Sydney Online Retailer - 26 Sep 2011Craig Sullivan
In this presentation, I use analytics data from our global mobile reach, to illustrate the trends that are driving growth, how to take opportunity from them and what to do with your own site. I present a case for device and user knowledge, to allow you to optimise conversion rates, revenue and delight for visitors.
The top reasons and solutions for not getting value out of your AB tests - some practical tips for designing insightful and correctly instrumented test
Product Design is Poo - And we're all going to dieCraig Sullivan
A humorous presentation about what is wrong with the current way of building digital products. Showing what is wrong, explaining the signs and giving you a checklist for reforming your company - are laid out with links, resources and further reading.
Did you know that you can develop awesome products with zero product specifications ? We have recently quantified the gains for a product we built using Lean Startup and MVP approach and were pleasantly surprised to find that we could quantify minimum 47% gain in time-to-market, 32% cost savings, 55% improvement in product quality and 40% gain in business value as compared to traditional product development methods.
AB Testing and UX - a love story with numbers and people (by Craig Sullivan a...Northern User Experience
AB Testing and UX - a love story with numbers and people
Slides from the NUX6 talk by Craig Sullivan, Friday 27th October 2017.
2017.nuxconf.uk / nuxuk.org
Synopsis:
What’s wrong with the web these days? The mobile experience sucks. The customer experience sucks. It doesn’t work. It’s too hard to use. The text is too small. Nobody measures this happening. The interaction patterns suck. Nobody ever calls up to complain but nobody does anything anyway. Millions of people lose countless days to friction, poor design and frustrating moments on their devices.
There may be thousands of things you can fix that look promising – but how do you know where to start? What if you could measure what sucked, where it sucked and how big the problem was? Using lightweight research methods and tools, you can stop making excuses and start knowing exactly what to do. Life becomes much simpler and easier with a scientific method of optimising growth or delight within your product.
Craig has trained over 500 people on how to measure and optimise their product experience, finding 100M of ‘lost revenue’ using just one of the techniques you will learn. With reports, checklists, downloadable templates and toolkits for every budget and stage of growth – you can stop guessing tomorrow.
The tools used by the CRO masters round the world to optimise analytics, UX, VOC,insight and testing - all to optimise your insight or conversion figures.
Research and Discovery Tools for Experimentation - 17 Apr 2024 - v 2.3 (1).pdfVWO
You can utilize various forms of Generative Research to deepen your understanding of how people interact with your product or service.
Craig has amassed a vast toolkit of research methods, which he has employed to optimize websites and apps for over 500 companies. He'll share which methods yielded the highest return on investment, identified key customer pain points, and generated the best experiment ideas.
By sharing the top inspection methods essential for our work, Craig will provide advice for each technique. Anticipate insights on driving experiment hypotheses from research, a list of essential toolkit components for tomorrow, and additional resources for further reading.
Tips for would-be founders, technical or non-technical, before rolling up their sleeves and develop their products! From various ways of "pretotyping" to accurately gauge target customer's response, lean method, minimum viable product, feature selection, planning a product with robust data cycle, coping with delays, and guiding a team of rockstar engineers to build the right product and build the product right. Some personal experienced shared at the end as case studies.
How to Leverage Your Skill Set for Product by Google Product ManagerProduct School
Product managers love to apply frameworks to solving big thorny business challenges in their day to day. Interestingly enough, one can use a framework for the PM job itself to abstract away the details and optimize for success. Learn about the most important advice on how to leverage your skills here
Inside eCommerce - Micksgarage Masterclass - April 15th 2014.John Walsh
April 15th 2014 - Dublin
www.insideecommerce.ie
@insideecommerce
Inside eCommerce has partnered with online retailers, MicksGarage.com, to share their experiences in Building for Scale Internationally.
This one day event will provide invaluable insights into the strategy, innovation and technical implementation behind creating a successful eCommerce offering. Six speakers from the company’s top management team including the two founders will give masterclass sessions focusing on key areas of the business. Attendees will learn over the course of the day how all these functions fit together to form a well oiled machine.
MicksGarage, car parts experts and now one of Irelands leading “eTailers”, was started 10 years ago in the bedroom of company founder, Mick Crean. Mick and his brother, Ciaran, now ship over 1000 products daily to more than 70 countries worldwide and employ 48 people in their Dublin headquarters.
Agile and data driven product development oleh Dhiku VP Product KMK OnlineRein Mahatma
Di webinar ini Dhiku akan membawakan materi seputar tips product management, bagaimana proses membangun product digital dengan agile dan data driven. Dimulai dari memahami kebutuhan user, melakukan usability testing, menganalisa data, melakukan prioritas fitur dan perencanaan product roadmap, incremental deployment ke user, sampai evaluasi data untuk pengembangan product yang lebih baik.
Oleh http://www.startupbisnis.com dan http://www.codepolitan.com
Similar to Toolkits and tips for UX analytics CRO by Craig Sullivan (20)
Matthew and Jesmond will share their approach to understanding Lovehoney’s new customers. They’ll walk through their end-to-end approach: how they researched and built an experience map, then plotted the impact points and gaps, and used data analysis to form hypotheses and page redesigns.
Jonny will focus on the challenges of designing for stigmatised, vulnerable, disenfranchised people. He’ll explore how working on taboo subjects and with people that society tends to ignore, can lead to life changing design solutions.
"Making Accessibility Accessible" by Kirtika BhuvaUXPA UK
A talk given by Kirtika Bhuva at UXPA UK's May 2017 event covering "Global Accessibility Awareness Day".
http://uxpa-uk.org/events/uxpa-uk-gaad-2017/
Check out our Events page to see what's coming up in the future: http://uxpa-uk.org/events/
"Designing a Product with Mental Health in Mind" by Zander BradeUXPA UK
A talk given by Zander Brade at UXPA UK's May 2017 event covering "Global Accessibility Awareness Day".
http://uxpa-uk.org/events/uxpa-uk-gaad-2017/
Check out our Events page to see what's coming up in the future: http://uxpa-uk.org/events/
A talk given by Gavin Evans at UXPA UK's May 2017 event covering "Global Accessibility Awareness Day".
http://uxpa-uk.org/events/uxpa-uk-gaad-2017/
Check out our Events page to see what's coming up in the future: http://uxpa-uk.org/events/
"How to tie your customer design work into the enabling organisation" - by Jo...UXPA UK
A talk given by Joel Bailey at UXPA UK's April 2017 event covering "Investigating Service Design".
http://uxpa-uk.org/events/exploring-service-design/
Check out our Events page to see what's coming up in the future: http://uxpa-uk.org/events/
'Mainstream' UX and Games UX - Alistair Greo, Player ResearchUXPA UK
This was part of the UXPA UK January 2017 event. For videos of our recent talks, please check out our YouTube channel https://www.youtube.com/user/uxpauk
A talk given at UKPA UK's 'World Usability Day' event - 10 November 2016.
FoodCloud connects businesses that have too much food to charities in their communities that have too little. Using our technology platform, participating businesses can upload details of their surplus food. FoodCloud provides a simple way for food businesses to contribute to their communities in a meaningful and practical way and reduce their impact on the environment. Many retailers find themselves with perfectly good food that they cannot sell. This high quality food is often wasted at a large cost to businesses. Good food that can feed people should never be wasted. FoodCloud offers businesses a solution by using this food to support the work of the charity sector in Ireland and the UK. This solution has been developed through a close relationship with the business and charities to understand their needs.
Since the creation of FoodCloud in 2014 Co-Founders Iseult Ward and Aoibheann O’Brien were one of Time magazines Next Generation Leaders, Ben and Jerry’s Join Our Core Winner and winner of the 2016 Green Awards. Most recently FoodCloud’s UK partnership with FareShare and Tesco won the Sustainable Future Award at the IGD awards. The three-way partnership between FareShare, FoodCloud and Tesco is live across 900 stores and has already delivered the equivalent of 1.4 million meals to local organisations. By the end of next year, the organisations aim to send all of Tesco’s edible surplus food to charity. Fiona will outline FoodClouds journey so far and how they have perfected their solution.
Conservation & The Knowledge Chain - Paul-Jervis Heath, Modern HumanUXPA UK
A talk given at UKPA UK's 'World Usability Day' event - 10 November 2016.
In September Giant Pandas were reclassified from endangered to vulnerable. The news was less favourable for the Eastern Gorilla. At the same time they were reclassified as critically endangered. Their population has declined by 70% over the last 20 years. Globally, there has been a 52% average decline in the populations of mammals, birds, reptiles, amphibians and fish around the globe between 1970 and 2010. How do we know the global outlook for the conservation of threatened species? How do conservation organisations decide on the actions to protect those species? And, how is human-centred design being used to help secure funding for conservation research, to gather data about endangered species, to report on the fate of those sepcies and inform conservation decisions?
Paul-Jervis Heath talks about design research with Zoologists, Conservationists, with Park Rangers in Africa and fieldwork at London Zoo. He also talk about how Modern Human are using human-centred design to support conservation from the scientist gathering data about endangered species through to the conservationist planning conservation actions on the ground.
A talk given by Thoughtworks at UKPA UK's 'World Usability Day' event - 10 November 2016.
The challenge of reconnecting unaccompanied child refugees with their loved ones is a growing problem with the global refugee crisis. In Kakuma refugee camp filmmaker Lieven Corthouts sought out a solution after living there for 5 years and talking with refugees struggling to find their families. ThoughtWorks collaborated with Lieven to design and user test a ‘Find Me’ web application with refugees, which exposed the challenges of cultural barriers, limited technical literacy and the western bias applied within the design process.
Mike Gatman is a project manager and coach from ThoughtWorks who looked after the Find Me initiative. He is an agile/lean enthusiast who brings the user to the heart of every delivery, with a background in digital projects across media, telecommunications, banking and retail. Find Me was his first foray into the humanitarian sector.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
4. @OptimiseOrDie
Timeline
Tested stupid ideas, lots
Most AB or MVT tests are bullshit
Discovered AB testing
Triage, Triangulation,
Prioritisation, Maths
Zen Plumbing
AB Test Hype Cycle
8. Craig’s Cynical Quadrant
Improves
revenue
Improves UX
YesNo
No
Yes Client delighted
(and fires you for another UX agency)
Client fucking
delighted
Client absolutely
fucking furious
Client fires you
(then wins an award for your work)
9. Top Tools & Tips
#1 Get out of the office
#2 Immerse yourself
#3 Session Replay
#4 Voice of Customer
#5 Get the right inputs
#6 Act like a P.I.
#7 Experience testing
#8 Split testing tools
#9 Get performance
#10 Analytics health check
#11 Going agile
Examples
@OptimiseOrDie
13. Som, feedbackRemote UX tools (P=Panel, S=Site recruited, B=Both)
Usertesting (B) www.usertesting.com
Userlytics (B) www.userlytics.com
Userzoom (S) www.userzoom.com
Intuition HQ (S) www.intuitionhq.com
Mechanical turk (S) www.mechanicalturk.com
Loop11 (S) www.loop11.com
Open Hallway (S) www.openhallway.com
What Users Do (P) www.whatusersdo.com
Feedback army (P) www.feedbackarmy.com
User feel (P) www.userfeel.com
Ethnio (For Recruiting) www.ethnio.com
Feedback on Prototypes / Mockups
Pidoco www.pidoco.com
Verify from Zurb www.verifyapp.com
Five second test www.fivesecondtest.com
Conceptshare www.conceptshare.com
Usabilla www.usabilla.com
13
@OptimiseOrDie
1c : Crowdsourced Testing
16. @OptimiseOrDie
1f : The Secret Millionaire
• Tesco placed IT users in front line roles with product
• You have to to create this kind of feedback loop
• If it isn‟t there, you need to push/encourage
• Connect the team with pain points AND outcomes of
their work, split tests and changes
• Hugely motivational strategy
• One last tip – learn how to interview like a pro
• Read these:
“Don‟t Make Me Think” amzn.to/1gIZEJn
“Rocket Surgery Made Easy” amzn.to/1e0hnUL
“Talking to Customers” bit.ly/1e0hT58
“Talking with Participants” bit.ly/1kKL3LE
“Don‟t listen to Users” bit.ly/1cQpiIE
“Interviewing Tips” bit.ly/1fKqu03
“More interviewing Tips” bit.ly/1bmvGT
17. #2 : IMMERSE
YOURSELF
@OptimiseOrDie
• Test ALL key campaigns
• Use Real Devices
• Get your own emails
• Order your products
• Call the phone numbers
• Send an email
• Send 11 shoes back
• Be difficult
• Break things
• Experience the end-end
• Do the same for competitors
• Team are ALL mystery shoppers
• Wear the magical slippers
• Be careful about dogfood though!
18. • Vital for optimisers & fills in a ‘missing link’ for insight
• Rich source of data on visitor experiences
• Segment by browser, visitor type, behaviour, errors
• Forms Analytics (when instrumented) are awesome
• Can be used to optimise in real time!
Session replay tools
• Clicktale (Client) www.clicktale.com
• SessionCam (Client) www.sessioncam.com
• Mouseflow (Client) www.mouseflow.com
• Ghostrec (Client) www.ghostrec.com
• Usabilla (Client) www.usabilla.com
• Tealeaf (Hybrid) www.tealeaf.com
• UserReplay (Server) www.userreplay.com
@OptimiseOrDie
#3 : GET SESSION REPLAY
19. • Sitewide Omnipresent Feedback
• Triggered (Behavioural) Feedback
• Use of Features, Cancellation, Abandonment
• 4Q Task Gap Analysis very good
• Kampyle
www.kampyle.com
• Qualaroo
www.qualaroo.com
• Feedback Daddy
www.feedbackdaddy.com
• 4Q
4q.iperceptions.com
• Usabilla
www.usabilla.com
#4 : GET THEIR VOICE
20. • Make contact and feedback easy & encouraged
• Add contact & feedback to everything (e.g. all mails)
• Read Caroline Jarrett, run surveys (remember them?)
• Run regular NPS and behaviourally triggered surveys
• Get ratings on Service Metrics
• Find what drives the ‘level’ of delight
• Ask your frequent, high spend, zealous users questions
• Make the team spend ½ a day a month at the Call Centre
• Meet with your Sales and Support teams ALL the time
• Tip : Take them for Beers and encourage bitching
#4 : GET THEIR VOICE
21. Insight - Inputs
#FAIL
Competitor
copying
Guessing
Dice rolling
An article
the CEO
read
Competitor
change
Panic
Ego
Opinion
Cherished
notions
Marketing
whims Cosmic rays
Not ‘on
brand’
enough
IT
inflexibility
Internal
company
needs
Some
dumbass
consultant
Shiny
feature
blindness
Knee jerk
reactons
#5 : Your inputs are all wrong
@OptimiseOrDie
22. Insight - Inputs
Insight
Segmentation
Surveys
Sales and
Call Centre
Session
Replay
Social
analytics
Customer
contact
Eye tracking
Usability
testing
Forms
analytics
Search
analytics Voice of
Customer
Market
research
A/B and
MVT testing
Big &
unstructured
data
Web
analytics
Competitor
evalsCustomer
services
#5 : These are the inputs you need…
@OptimiseOrDie
23. • For your brand(s) and competitors
• Check review sites, Discussion boards, News
• Use Google Alerts on various brands & keywords
• See what tools they’re using (www.ghostery.com)
• Sign up for all competitor emails
• Run Cross Competitor surveys
• This was VITAL for LOVEFiLM
• Use Social & Competitor Monitoring tools :
slidesha.re/1k7bflG
#6 : ACT LIKE A PI
24. #4 – Test or Die!
Email testing www.litmus.com
www.returnpath.com
www.lyris.com
Browser testing www.crossbrowsertesting.com
www.browserstack.com
www.spoon.net
www.saucelabs.com
www.multibrowserviewer.com
Mobile devices www.appthwack.com
www.deviceanywhere.com
www.mobilexweb.com/emulators
www.opendevicelab.com
@OptimiseOrDie
#7 : MAKE MONEY FROM TESTING!
25. • Google Content Experiments
bit.ly/Ljg7Ds
• Optimizely
www.optimizely.com
• Visual Website Optimizer
www.visualwebsiteoptimizer.com
• Multi Armed Bandit Explanation
bit.ly/Xa80O8
• New Machine Learning Tools
www.conductrics.com
www.rekko.com
@OptimiseOrDie
#8 : MAKE MORE MONEY FROM TESTING!
30. #10 : Your analytics tool is broken!
@OptimiseOrDie
31. • Get a Health Check for your Analytics
– Mail me for a free pack
• Invest continually in instrumentation
– Aim for at least 5% of dev time to fix + improve
• Stop shrugging : plug your insight gaps
– Change „I don‟t know‟ to „I‟ll find out‟
• Look at event tracking (Google Analytics)
– If set up correctly, you get wonderful insights
• Would you use paper instead of a till?
– You wouldn‟t do it in retail so stop doing it online!
• How do you win F1 races?
– With the wrong performance data, you won‟t
@OptimiseOrDie
#10 : Your analytics tool is broken!
33. Methodologies - Lean UX
Positive
– Lightweight and very fast methods
– Realtime or rapid improvements
– Documentation light, value high
– Low on wastage and frippery
– Fast time to market, then optimise
– Allows you to pivot into new areas
Negative
– Often needs user test feedback to
steer the development, as data not
enough
– Bosses distrust stuff where the
outcome isn’t known
“The application of UX design methods into product
development, tailored to fit Build-Measure-Learn cycles.”
33
34. Agile UX / UCD / Collaborative Design
Positive
– User centric
– Goals met substantially
– Rapid time to market (especially when
using Agile iterations)
Negative
– Without quant data, user goals can
drive the show – missing the business
sweet spot
– Some people find it hard to integrate
with siloed teams
– Doesn’t’ work with waterfall IMHO
Wireframe
Prototype
TestAnalyse
Concept
Research
“An integration of User Experience Design and Agile*
Software Development Methodologies”
*Sometimes
34
36. Lean Optimisation
Positive
– A blend of several techniques
– Multiple sources of Qual and Quant data aids triangulation
– Focus on priority opportunities drives unearned value and
customer delight for all products
Negative
– Needs a one team approach with a strong PM who is a Polymath
(Commercial, Analytics, UX, Technical)
– Only works if your teams can take the pace – you might be
surprised though!
“A blend of User Experience Design, Agile PM, Rapid Lean UX
Build-Measure-Learn cycles, triangulated data sources, triage
and prioritisation.”
36
38. We believe that doing [A] for
People [B] will make
outcome [C] happen.
We’ll know this when we
observe data [D] and obtain
feedback [E]. (reverse)
@OptimiseOrDie
39. agile - Summary
• Design your own methodology
Experiment and optimise with your team
• Don’t be a slave
The methodology is the slave, not your master
http://tcrn.ch/1gPpUNo
• Collaborative working
– Harvard study into teams – it‟s an all the time thing
• Ask me later…
Questions – see me on Twitter, G+ or ask by mail
@OptimiseOrDie
42. • 20M+ visitor tests with People Images
• Some interesting stuff at Autoglass (Belron)
• Negative body language is a turnoff
• Uniforms and branding a positive (ball cap)
• Eye gaze and smile are crucial
• Hands are awkward without a prop
• Best prop tested was a clipboard
• Single image better than groups
• In most countries (out of 33) with strong
female and male images in test, female won
• So – a question about this test
@OptimiseOrDie
#2 : SPLIT TESTING PEOPLE
44. Terrible Stock Photos : headsethotties.com & awkwardstockphotos.com
Laughing at Salads : womenlaughingwithsalad.tumblr.com
Other Stock Memes : linkli.st/optimiseordie/7Fdxz
BBC Fake Smile Test : bbc.in/5rtnv @OptimiseOrDie
46. TV - Off TV - On
Isi went on to star in the TV slot and helped Autoglass grow recruitment of
female technicians, as well as proving a point!
#3 : TV ADVERTISING
48. @OptimiseOrDie
#4 : VOC, NPS, EXPERIMENTS
• Belron NPS programme is huge
• Millions of people every year, across the world
• 35% survey takeup, 6% dropout rate!
• (Try @lukew and @cjforms and @stickycontent)
• Higher scores than some consumer products
• Why? Measuring the drivers of delight
• Even on A/B tests, we could split NPS data
• We could see a new funnel drove a 5.5% rise
• Lovefilm beat their competitors using NPS
• How? Measuring key service metrics
• Regression to find high value investment areas
• Contact deflection using self service
• Analytics, split testing, UX
49. How is it working out for Craig?
• Methodologies are not Real Life ™
• It’s mainly about the mindset of the team and
managers, not the tools or methodologies used
• Not all my clients have all the working parts
• Use some, any techniques instead of ‘guessing’
• Bringing together UX techniques with the
excellent tools available – along with analytics
investment - will bring you successful and well-
loved products
• Blending Lean and Agile UX with conversion
optimisation techniques (analytics, split testing,
Kaizen, Kano) is my critical insight from the last 5
years.
• UX got hitched to numbers, they ran away and
lived happily ever after 49
50. If it isn‟t working, you‟re not doing it right
@OptimiseOrDie
52. RESOURCE PACK
• Maturity model
• Best CRO people on twitter
• Best Web resources
• Good recent books to read
• Triage and Triangulation
• The Bucket outcome methodology
• Belron methodology example
• CRO and testing resources
• Companies and people to watch
• Building a ring model
• Manual Models for Analytics
@OptimiseOrDie
53. Ad Hoc
Local Heroes
Chaotic Good
Level 1
Starter Level
Guessing
A/B testing
Basic tools
Analytics
Surveys
Contact Centre
Low budget
usability
Outline process
Small team
Low hanging fruit
+ Multi variate
Session replay
No segments
+Regular usability
testing/research
Prototyping
Session replay
Onsite feedback
________________________________________________________________________
_____________________ _
Dedicated team
Volume
opportunities
Cross silo team
Systematic tests
Ninja Team
Testing in the
DNA
Well developed Streamlined Company wide
+Funnel
optimisation
Call tracking
Some segments
Micro testing
Bounce rates
Big volume
landing pages
+ Funnel analysis
Low converting
& High loss pages
+ offline
integration
Single channel
picture
+ Funnel fixes
Forms analytics
Channel switches
+Cross channel
testing
Integrated CRO
and analytics
Segmentation
+Spread tool use
Dynamic adaptive
targeting
Machine learning
Realtime
Multichannel
funnels
Cross channel
synergy
________________________________________________________________________
_______________________
________________________________________________________________________
________________________
Testing
focus
Culture
Process
Analytics
focus
Insight
methods
+User Centered
Design
Layered feedback
Mini product tests
Get buyin
_________________________________________________________________________
_______________________Mission Prove ROI Scale the testing Mine value
Continual
improvement
+ Customer sat
scores tied to UX
Rapid iterative
testing and
design
+ All channel view
of customer
Driving offline
using online
All promotion
driven by testing
Level 2
Early maturity
Level 3
Serious testing
Level 4
Core business value
Level 5
You rock, awesomely
________________________________________________________________________
________________________
53
57. Triage and Triangulation
• Starts with the analytics data
• Then UX and user journey walkthrough from SERPS -> key paths
• Then back to analytics data for a whole range of reports:
• Segmented reporting, Traffic sources, Device viewport and
browser, Platform (tablet, mobile, desktop) and many more
• We use other tools or insight sources to help form hypotheses
• We triangulate with other data where possible
• We estimate the potential uplift of fixing/improving something
as well as the difficulty (time/resource/complexity/risk)
• A simple quadrant shows the value clusters
• We then WORK the highest and easiest scores by…
• Turning every opportunity spotted into an OUTCOME
“This is where the smarts of CRO are – in identifying the
easiest stuff to test or fix that will drive the largest uplift.”
@OptimiseOrDie
58. The Bucket Methodology
“Helps you to stream actions from the insights and prioritisation work.
Forces an action for every issue, a counter for every opportunity being lost.”
Test
If there is an obvious opportunity to shift behaviour, expose insight or
increase conversion – this bucket is where you place stuff for testing. If
you have traffic and leakage, this is the bucket for that issue.
Instrument
If an issue is placed in this bucket, it means we need to beef up the
analytics reporting. This can involve fixing, adding or improving tag or
event handling on the analytics configuration. We instrument both
structurally and for insight in the pain points we’ve found.
Hypothesise
This is where we’ve found a page, widget or process that’s just not working
well but we don’t see a clear single solution. Since we need to really shift
the behaviour at this crux point, we’ll brainstorm hypotheses. Driven by
evidence and data, we’ll create test plans to find the answers to the
questions and change the conversion or KPI figure in the desired direction.
Just Do It
JFDI (Just Do It) – is a bucket for issues where a fix is easy to identify or the
change is a no-brainer. Items marked with this flag can either be deployed
in a batch or as part of a controlled test. Stuff in here requires low effort
or are micro-opportunities to increase conversion and should be fixed.
Investigate You need to do some testing with particular devices or need more
information to triangulate a problem you spotted. If an item is in this
bucket, you need to ask questions or do further digging. 58
59. 5 - Belron example – Funnel replacement
Final
prototype
Usability
issues left
Final changes Release build
Legal review
kickoff
Cust services
review kickoff
Marketing
review
Test Plan
Signoff
(Legal,
Mktng, CCC)
Instrument
analytics
Instrument
Contact
Centre
Offline
tagging
QA testing
End-End
testing
Launch
90/10%
Monitor
Launch
80/20%
Monitor < 1
week
Launch
50/50%
Go live 100%
Analytics
review
Washup and
actions
New
hypotheses
New test
design
Rinse and
Repeat!
61. So you want examples?
Examples of companies putting this stuff together in a good way:
• Belron – Ed Colley
• Dell – Nazli Yuzak
• Shop Direct – Paul Postance (now with EE)
• Expedia – Oliver Paton
• Schuh – Stuart McMillan
• Soundcloud – Eleftherios Diakomichalis & Ole Bahlmann
• Gov.uk – Adam Bailin (now with the BBC)
Read the gov.uk principles : www.gov.uk/designprinciples
And my personal favourite of 2013 – Airbnb!@OptimiseOrDie
62. #1 Building a Model
#1 Avinash article
#2 The Ring Model
#3 3 examples
#4 Benefits
#5 Summary
62
63. 6.1 – Avinash “See-Think-Do”
• Avinash Kaushik, analytics guru, proposes a very nice model for marketing. A
brilliant article can be read here:
• http://www.kaushik.net/avinash/see-think-do-content-marketing-measurement-
business-framework/
• But this sort of thinking is also relevant to optimisation
• CRO often focuses on purely the ‘Do’ stage – rather than ‘See’ or ‘Think’ stages.
63
65. 6.2 – The Ring Model
• Simply looking at conversion points is not enough
• We need a way to look at the ‘layers’ or ‘levels’ reached
• So I developed a ring or engagement model
• This works for many (but not all) websites
• Focuses on depth of engagement, not pages viewed
• Helps to see the key loss steps, like a funnel
• It’s not a replacement for funnel diagrams
• It helps to see the ‘big picture’ involved
• So – let’s try some examples
65
71. 6.4 – Benefits
• Helps you see where flow is ‘stuck’
• Sorts out small opportunities from big wins
• Ignores pages in favour of ‘Macro’ and ‘Micro’ conversions
• Lets you show the client where focus should be
• Helps flush flow or traffic through to lower levels
• Avoids prioritising the wrong part of the model!
• Example – Shoprush problem is basket adds, not checkout
• If you had 300k product page views, 5k adds and 1k
checkouts – where would your problem be?
• If you had 300k product page views, 100k adds and 1k
checkouts – it’s a different place!
• Example – Google adwords site has bad traffic, not
conversion
71
72. 6.5 – Benefits contd.
• A nice simple way to visualise complex websites
• Does not rely on pages – more ‘steps’ or ‘layers’
• Helps you see where traffic is ‘stuck’ or ‘failing to engage
more deeply’
• The combination of traffic potential, UX and persuasion
issues combines to identify opportunity
• Avoids visual bias when doing an expert review
• In the e-commerce example, Rush have optimised product
page first, not homepage.
• Questions?
72
74. #5 By Hand Analytics
#1 When to use this method?
#2 How to use it
#3 Demo
#4 Limitations
74
75. 5.1 – When to use this method
• If goals are unreliable / broken / have no data
• If flows are mixed in funnels (mid stage joiners)
• If the conceptual model does not match site config
• When the data you need does not exist
75
76. 5.2 – How to use this method
• For example, with a funnel
• Use UNIQUE PAGEVIEWS (and events, if available)
• Do NOT mix with pageviews or visitor counts
• Step 1 – Basket UPVs
• Step 2 – Customer details
• Step 3 – Shipping
• Step 4 – Payment
• Step 5 – Thank you
• Use regex / advanced segments to aggregate or filter
• Gives you a unique count of people at steps
• Always be aware of time periods!
76
77. 5.3 – Limitations & Benefits
• Mixing and matching data can look nice but causes issues
• Time consuming and more complex
• Try to use in-page filters not advanced segments (sampling)
• Is not readily replayed by client
Some benefits though:
• Construct segmented funnels
• Split by other data attributes
• Very good way to spot variances inside funnels
• Vital for multi-device category websites
77
78. END SLIDES
78
Feel free to steal, re-use, appropriate or otherwise lift
stuff from this deck.
If it was useful to you – email me or tweet me and tell me
why – I‟d be DELIGHTED to hear!
Regards,
Craig.
Editor's Notes
And here’s a boring slide about me – and where I’ve been driving over 400M of additional revenue in the last few years. In two months this year alone, I’ve found an additional ¾ M pounds annual profit for clients. For the sharp eyed amongst you, you’ll see that Lean UX hasn’t been around since 2008. Many startups and teams were doing this stuff before it got a new name, even if the approach was slightly different. For the last 4 years, I’ve been optimising sites using the combination of techniques I’ll show you today.
These are the results of a live test on a site, where an artificial delay is introduced in the performance testing. I’ve done some testing like this myself on desktop and mobile sites and confirm this is true – you’re increasing bounce rate, decreasing conversion, site engagement…It doesn’t matter what metric you use, performance equals MONEY or if not measured, a HUGE LOSS.
Performance also harms the lifeblood of e-commerce and revenue generating websites – repeat visitors! The gap here in one second of delay is enormous over time. You’re basically sucking a huge portion of potential business out of your site, with every additional bit of waiting time you add.
These are all people on twitter who cover hybrid stuff – where usability, psychology, analytics and persuasive writing collide. If you follow this lot, you’ll be much smarter within a month, guaranteed.
And here are the most useful resources I regularly use or share with people. They have the best and most practical advice – cool insights but with practical applications.A special mention here to my friends at PRWD, who are one of the few companies blending Psychology, Split Testing and UX for superb gains in rapid time. Check out their resources section on their website.
So – what’s driving this change then? Well there have been great books on selling and persuading people – all the way back to ‘Scientific Advertising’ in 1923.And my favourite here is the Cialdini work – simply because it’s a great help for people to find practical uses for these techniques.I’ve also included some analytics and testing books here – primarily because they help so MUCH in augmenting our customer insight, testing and measurement efforts.There are lots of books with really cool examples, great stories and absolutely no fucking useful information you can use on your website – if you’ve read some of these, you’ll know exactly what I mean. These are the tomes I got most practical use from and I’d recommend you buy the whole lot – worth every penny.