At Booking.com we have been conducting evidenced based product development using online experiments for more than ten years. Our methods and infrastructure were designed from their inception to reflect Booking.com culture, that is, with democratization and decentralization of experimentation and decision making in mind.
In this talk, based on this paper with the same title, we explain how our approach has allowed such a large organization as Booking.com to truly and successfully democratize experimentation.
Using jobs-to-be-done to design better user experiences (UX Cambridge 2017)Neil Turner
"People don’t want to buy a quarter-inch drill. They want a quarter-inch hole." (Theodore Levitt, Harvard marketing professor). Jobs-to-be-done is one of those concepts that intuitively makes so much sense, and yet still isn’t that widely known or used. The idea that you should focus on the job that someone is trying to do, rather than just the means of achieving , is not a revolutionary one, but is nonetheless incredibly powerful and insightful. As Clay Christensen, one of the fellow architects of jobs-to-be-done, has said, "In hindsight the job to be done is usually as obvious as the air we breathe. Once they are known, what to improve (and not to improve) is just as obvious".
This interactive and hands-on workshop, from UX Cambridge 2017 covers how to use jobs-to-be-done to not only come up with innovative ideas, but to research and design better user experiences, regardless of whether someone is starting from a blank sheet, or improving an existing product or service.
It includes how to identify jobs-to-be-done, how to use job stories to help frame jobs-to-be-done and how to enhance personas, user journey maps and even user stories using jobs-to-be-done.
The Customer Job To Be Done Canvas - PrototypeHelge Tennø
At an increasing rate (according to IBM C-Suite studies) companies are seeing that they need to figure out ways to put the customer at the center of their attention and decisions. But do businesses have the data or insight to put them there?
In the MIT Sloan Management Review article Finding The Right Product For Your Product Clayton M. Christensen, Scott D. Anthony, Gerald Berstell and Denise Nitterhouse discusses the idea of understanding what jobs customers are trying to solve and then figuring out the reason people are pulling the product into these jobs.
As many others I am currently prototyping a tool for this theory (Work-In-Progress) and my work so far can be seen and downloaded here.
I'm employing the same strategies towards my own business as I do with my clients, therefore the tool is still just a prototype being redesigned and redesigned again. But hopefully there are people out there interested in trying the tool out, give feedback and help on the way forward. This tool is not a parking lot for an idea - but a continuous, hopefully never-ending process.
Do you want to understand what causes people to purchase, adopt and re-purchase products and services? Do you want to increase the success rate of your innovation efforts? This presentation gives you an introduction to Jobs-To-Be-Done—a theory of the market that seeks to answer these questions and more.
What do people use a service for? What problem are they trying to solve? This edition of Service Design Drinks introduced to a tool based on the increasingly popular jobs-to-be-done framework. It helps you to better understand problems with a fresh approach by examining contexts and describing desired outcomes.
This edition’s presenters Thomas Hütter, Hannes Jentsch and Martin Jordan are system and experience designers at HERE, a Nokia business. In the past year they reviewed the internal design processes and explored new tools that are worth sharing.
Jobs to Be Done :: Overview and Interview TechniqueBrian Rhea
Jobs to Be Done (JTBD) is a powerful product design framework that is gaining ground in startup communities across in the US. Companies like Basecamp and Intercom are using JTBD to heavily influence their product and marketing efforts with great success.
If you'd like to go deeper, visit https://hirebrianrhea.com/jobs-to-be-done-course to receive a free email course on Jobs to Be Done.
Who:
Brian Rhea (Product Lead at Revve) and Jason Hall (Chief Revenue Officer at Mocavo) have been actively practicing the JTBD framework and have implemented a number of their findings in their respective roles.
How:
In this workshop, we will present an overview of the JTBD framework, the main tools (forces diagram & timeline) and then conduct a JTBD interview with an audience participant to show you how it's done.
This deck was presented on 28th January 2017 at Chiang Mai Startup Events. It covers questions such as "What is JTBD framework"? and "How does JTBD help businesses understand the WHY rather than the WHAT?" It is based on Tony Ulwick's presentation.
Using jobs-to-be-done to design better user experiences (UX Cambridge 2017)Neil Turner
"People don’t want to buy a quarter-inch drill. They want a quarter-inch hole." (Theodore Levitt, Harvard marketing professor). Jobs-to-be-done is one of those concepts that intuitively makes so much sense, and yet still isn’t that widely known or used. The idea that you should focus on the job that someone is trying to do, rather than just the means of achieving , is not a revolutionary one, but is nonetheless incredibly powerful and insightful. As Clay Christensen, one of the fellow architects of jobs-to-be-done, has said, "In hindsight the job to be done is usually as obvious as the air we breathe. Once they are known, what to improve (and not to improve) is just as obvious".
This interactive and hands-on workshop, from UX Cambridge 2017 covers how to use jobs-to-be-done to not only come up with innovative ideas, but to research and design better user experiences, regardless of whether someone is starting from a blank sheet, or improving an existing product or service.
It includes how to identify jobs-to-be-done, how to use job stories to help frame jobs-to-be-done and how to enhance personas, user journey maps and even user stories using jobs-to-be-done.
The Customer Job To Be Done Canvas - PrototypeHelge Tennø
At an increasing rate (according to IBM C-Suite studies) companies are seeing that they need to figure out ways to put the customer at the center of their attention and decisions. But do businesses have the data or insight to put them there?
In the MIT Sloan Management Review article Finding The Right Product For Your Product Clayton M. Christensen, Scott D. Anthony, Gerald Berstell and Denise Nitterhouse discusses the idea of understanding what jobs customers are trying to solve and then figuring out the reason people are pulling the product into these jobs.
As many others I am currently prototyping a tool for this theory (Work-In-Progress) and my work so far can be seen and downloaded here.
I'm employing the same strategies towards my own business as I do with my clients, therefore the tool is still just a prototype being redesigned and redesigned again. But hopefully there are people out there interested in trying the tool out, give feedback and help on the way forward. This tool is not a parking lot for an idea - but a continuous, hopefully never-ending process.
Do you want to understand what causes people to purchase, adopt and re-purchase products and services? Do you want to increase the success rate of your innovation efforts? This presentation gives you an introduction to Jobs-To-Be-Done—a theory of the market that seeks to answer these questions and more.
What do people use a service for? What problem are they trying to solve? This edition of Service Design Drinks introduced to a tool based on the increasingly popular jobs-to-be-done framework. It helps you to better understand problems with a fresh approach by examining contexts and describing desired outcomes.
This edition’s presenters Thomas Hütter, Hannes Jentsch and Martin Jordan are system and experience designers at HERE, a Nokia business. In the past year they reviewed the internal design processes and explored new tools that are worth sharing.
Jobs to Be Done :: Overview and Interview TechniqueBrian Rhea
Jobs to Be Done (JTBD) is a powerful product design framework that is gaining ground in startup communities across in the US. Companies like Basecamp and Intercom are using JTBD to heavily influence their product and marketing efforts with great success.
If you'd like to go deeper, visit https://hirebrianrhea.com/jobs-to-be-done-course to receive a free email course on Jobs to Be Done.
Who:
Brian Rhea (Product Lead at Revve) and Jason Hall (Chief Revenue Officer at Mocavo) have been actively practicing the JTBD framework and have implemented a number of their findings in their respective roles.
How:
In this workshop, we will present an overview of the JTBD framework, the main tools (forces diagram & timeline) and then conduct a JTBD interview with an audience participant to show you how it's done.
This deck was presented on 28th January 2017 at Chiang Mai Startup Events. It covers questions such as "What is JTBD framework"? and "How does JTBD help businesses understand the WHY rather than the WHAT?" It is based on Tony Ulwick's presentation.
The concept of jobs to be done (JTBD) provides a lens for understanding value creation. It’s straightforward principle: people “hire” products to fulfill a need.
For instance, you might hire a new suit to make you look good at a job interview. Or, you hire Facebook to stay in touch with friends. You could also hire a chocolate bar to relieve stress.
Viewing customers in this way – as goal-driven actors in a given context – shifts focus from psycho-demographic aspects to needs and motivations.
Although the theory of JTBD is rich and has a long history, practical approaches to applying the approach are largely missing. In this presentation, Jim will highlight concrete ways to apply JTBD in your work. This will not only help you design better solutions, but also enable you to contribute to broader strategic conversations.
Capturing Contexts: A workshop with jobs-to-be-done tools / Service Experienc...Martin Jordan
Customers hire services and products to do a certain job. Once people spot a job in their life they start looking for a solution, an offering that helps them to get the job done. Which offering they eventually hire often depends on the circumstances in which the job occurs.
This workshop highlighted the importance of customers’ situations and contexts when creating new offerings. As circumstances are changing, people’s related needs and desired outcomes do too. Using the example of food-related services, the workshop at Service Experience Camp 2015 illustrated how all offerings fulfil the general need of feeding humans, but also which specific situations each service caters for.
The workshop was run by Andrej Balaz, Hannes Jentsch and Martin Jordan on November 14, 2015 at Service Experience Camp in Kalkscheune in Berlin-Mitte.
My motto this year is "Evolve & Disrupt". I did a couple of keynotes on the matter recently, so I'm sharing this presentation to illustrate how I handle the "fuzzy front-end" of product development, aside from the Lean Startup stuff everybody talks about. Don't be fooled by the funny (and a bit irreverent) cartoons; Jobs To Be Done is a major breakthrough with a lot of practical applications. I have been working solidly on it for the last year and it is totally influencing how I see the world.
Integrating JTBD into existing tools & frameworks / Jobs-to-be-Done Meetup Be...Martin Jordan
How do you link the Jobs-to-be-Done approach to the tools, methods and frameworks you are already using? After investigating the JTBD framework, the timeline, the four motivational forces and the retrospective interview technique, we spent an evening discussing the connections and possible integrations with related fields and disciplines, including:
• Value creation (marketing)
• Value proposition canvas & business model canvas (business design & modelling)
• Market segmentation (marketing)
• How might we questions (design thinking & ideation)
• Customer journey map (service design & development)
Service Design Drinks Warsaw #1 / Uncovering the job your service is hired forMartin Jordan
People are not interested in the service you are designing. They are interested in what it does for them – or which job it helps them to get done. They don’t really care about your banking, transportation or web service. But they do care about the outcome they are able to achieve with it. Today’s most successful services understand and address people’s key 'jobs', they support them in achieving their desired outcomes better than with other available solution.
The Jobs-to-be-Done (JTBD) perspective on service shifts the focus from service provision to enabling customers to accomplish a goal or resolve a problem. Customer jobs can not only have functional, but also social or personal aspects. For service managers, innovators and designers, a JTBD approach enriches existing tools and methods in research, design and marketing. These help them to understand customers better and eventually create significantly improved offerings.
This presentation was given on March 30, 2016 at first Service Design Drinks in Warsaw.
A talk I gave at UX People 2013 as an attempt to demystify the term 'Service Design'. I talked about the methodologies and tools that service designers use, as well as the attitudes and skills requires to practice the discipline.
Generating opportunity maps with customer jobs to-be-doneHutch Carpenter
Outlines a method for soliciting your customers' jobs-to-be-done. These customer insights then become an opportunity map for targeting high impact innovation.
Democratizing Online Controlled Experiments at Booking.com - Lukas VermeerSavage Marketing
There is extensive literature about online controlled experiments, both on the statistical methods available to analyze experiment results as well as on the infrastructure built by several large scale Internet companies but also on the organizational challenges of embracing online experiments to inform product development.
At Booking.com we have been conducting evidenced based product development using online experiments for more than ten years. Our methods and infrastructure were designed from their inception to reflect Booking.com culture, that is, with democratization and decentralization of experimentation and decision making in mind.
In this presentation, Lukas will explain how building a central repository of successes and failures to allow for knowledge sharing, having a generic and extensible code library which enforces a loose coupling between experimentation and business logic, monitoring closely and transparently the quality and the reliability of the data gathering pipelines to build trust in the experimentation infrastructure, and putting in place safeguards to enable anyone to have end to end ownership of their experiments have allowed such a large organization as Booking.com to truly and successfully democratize experimentation.
How To Drive Data Driven Change In A Legacy OrganizationJovi Pinon
LexisNexis was a pioneer in digitization of legal and journalistic documents, but it has not been a very data-driven organization. In this presentation I discuss how the Product Analytics team is pushing data-driven change in our organization. Being a legacy company, most product decisions were made based on the product owners’ experience or sales' understanding of what our customers want. Now we are taking a more evidence-based approach. I am going to share my experience of how we collaborate with the User Experience team to create customer centric product enhancements. This talk will give you an idea on how to understand the “What” and “Why” of customer problems and come up with solutions based on behavioral analytics and user experience data. Along with the success story this presentation will also highlight the constraints, intermediate failures, and lessons learnt.
The concept of jobs to be done (JTBD) provides a lens for understanding value creation. It’s straightforward principle: people “hire” products to fulfill a need.
For instance, you might hire a new suit to make you look good at a job interview. Or, you hire Facebook to stay in touch with friends. You could also hire a chocolate bar to relieve stress.
Viewing customers in this way – as goal-driven actors in a given context – shifts focus from psycho-demographic aspects to needs and motivations.
Although the theory of JTBD is rich and has a long history, practical approaches to applying the approach are largely missing. In this presentation, Jim will highlight concrete ways to apply JTBD in your work. This will not only help you design better solutions, but also enable you to contribute to broader strategic conversations.
Capturing Contexts: A workshop with jobs-to-be-done tools / Service Experienc...Martin Jordan
Customers hire services and products to do a certain job. Once people spot a job in their life they start looking for a solution, an offering that helps them to get the job done. Which offering they eventually hire often depends on the circumstances in which the job occurs.
This workshop highlighted the importance of customers’ situations and contexts when creating new offerings. As circumstances are changing, people’s related needs and desired outcomes do too. Using the example of food-related services, the workshop at Service Experience Camp 2015 illustrated how all offerings fulfil the general need of feeding humans, but also which specific situations each service caters for.
The workshop was run by Andrej Balaz, Hannes Jentsch and Martin Jordan on November 14, 2015 at Service Experience Camp in Kalkscheune in Berlin-Mitte.
My motto this year is "Evolve & Disrupt". I did a couple of keynotes on the matter recently, so I'm sharing this presentation to illustrate how I handle the "fuzzy front-end" of product development, aside from the Lean Startup stuff everybody talks about. Don't be fooled by the funny (and a bit irreverent) cartoons; Jobs To Be Done is a major breakthrough with a lot of practical applications. I have been working solidly on it for the last year and it is totally influencing how I see the world.
Integrating JTBD into existing tools & frameworks / Jobs-to-be-Done Meetup Be...Martin Jordan
How do you link the Jobs-to-be-Done approach to the tools, methods and frameworks you are already using? After investigating the JTBD framework, the timeline, the four motivational forces and the retrospective interview technique, we spent an evening discussing the connections and possible integrations with related fields and disciplines, including:
• Value creation (marketing)
• Value proposition canvas & business model canvas (business design & modelling)
• Market segmentation (marketing)
• How might we questions (design thinking & ideation)
• Customer journey map (service design & development)
Service Design Drinks Warsaw #1 / Uncovering the job your service is hired forMartin Jordan
People are not interested in the service you are designing. They are interested in what it does for them – or which job it helps them to get done. They don’t really care about your banking, transportation or web service. But they do care about the outcome they are able to achieve with it. Today’s most successful services understand and address people’s key 'jobs', they support them in achieving their desired outcomes better than with other available solution.
The Jobs-to-be-Done (JTBD) perspective on service shifts the focus from service provision to enabling customers to accomplish a goal or resolve a problem. Customer jobs can not only have functional, but also social or personal aspects. For service managers, innovators and designers, a JTBD approach enriches existing tools and methods in research, design and marketing. These help them to understand customers better and eventually create significantly improved offerings.
This presentation was given on March 30, 2016 at first Service Design Drinks in Warsaw.
A talk I gave at UX People 2013 as an attempt to demystify the term 'Service Design'. I talked about the methodologies and tools that service designers use, as well as the attitudes and skills requires to practice the discipline.
Generating opportunity maps with customer jobs to-be-doneHutch Carpenter
Outlines a method for soliciting your customers' jobs-to-be-done. These customer insights then become an opportunity map for targeting high impact innovation.
Democratizing Online Controlled Experiments at Booking.com - Lukas VermeerSavage Marketing
There is extensive literature about online controlled experiments, both on the statistical methods available to analyze experiment results as well as on the infrastructure built by several large scale Internet companies but also on the organizational challenges of embracing online experiments to inform product development.
At Booking.com we have been conducting evidenced based product development using online experiments for more than ten years. Our methods and infrastructure were designed from their inception to reflect Booking.com culture, that is, with democratization and decentralization of experimentation and decision making in mind.
In this presentation, Lukas will explain how building a central repository of successes and failures to allow for knowledge sharing, having a generic and extensible code library which enforces a loose coupling between experimentation and business logic, monitoring closely and transparently the quality and the reliability of the data gathering pipelines to build trust in the experimentation infrastructure, and putting in place safeguards to enable anyone to have end to end ownership of their experiments have allowed such a large organization as Booking.com to truly and successfully democratize experimentation.
How To Drive Data Driven Change In A Legacy OrganizationJovi Pinon
LexisNexis was a pioneer in digitization of legal and journalistic documents, but it has not been a very data-driven organization. In this presentation I discuss how the Product Analytics team is pushing data-driven change in our organization. Being a legacy company, most product decisions were made based on the product owners’ experience or sales' understanding of what our customers want. Now we are taking a more evidence-based approach. I am going to share my experience of how we collaborate with the User Experience team to create customer centric product enhancements. This talk will give you an idea on how to understand the “What” and “Why” of customer problems and come up with solutions based on behavioral analytics and user experience data. Along with the success story this presentation will also highlight the constraints, intermediate failures, and lessons learnt.
Selling people on the idea that analytics can be a catalyst for creative freedom isn't easy. We have been doing analytics in the "creative" environment of a communications agency for a while and whenever analytics and creative are thrown in the mix together the natural instinct is a right brain, left brain power struggle. Happily, we have found ways for analytics to help partner with the creative teams and the sparks created are usually bigger and richer ideas.
So software development has been broken for a long time due to the need to create a formal approach, however the approach that has generally been adopted didn't work and has never worked, but at least the people at the top had a modicum of control which created the illusion that everything was working fine.
So in conclusion, software development has been around for a relatively long time and due to that there are a hundred and one ways of doing apparently the same thing, creating software. However compared to the sciences, software development isn't yet out of its teens and as such there really isn't an empirical evidenced based approach to software testing.
So we just have to fumble along with the knowledge that we currently have and continue to improve.
Mobile DevOps Summit_ Shift before you Suffer - Future of building the right ...NITHIN S.S
The mobile app testing world has gone through a paradigm shift in which Quality Assurance is gradually becoming Quality Engineering, and testing is shifting to the left with the application of modern testing principles. This evolution has made it necessary for organizations to adapt to new trends and keep up with the times. Seamless end-user experience, Performance, Usability, and UX have become the top priority for all global mobile app companies, as it directly affects retention rates, conversions, and ultimately revenue.
When customer satisfaction can directly impact your app store ratings and ultimately your revenue, how do you ensure that you can deliver the best possible digital experiences to your users every time? Even if we deliver a brilliant feature, if it's not user-friendly, people will eventually stop using those apps, leading to a low rating on the app/play store. As high-performing apps are user favorites, testers and app developers should also adopt quality-centric strategies while implementing mobile apps.
In this talk, we will discuss how to align our testing strategies based on my personal experience working in a fast-paced fintech startup to build successful mobile apps.
4 key takeaways from this session:
1. How to deliver top-ranking Android and iOS apps and ensure you can keep those 5-star ratings rolling!
2.Shifting left phase of Mobile App testing(Modern testing principles applied)
3.Mobile App Testing Heuristics & Important metrics
4. Scalable & Sustainable test automation, Test insights and Analytics for prediction
Bundledarrows160 bit.ly/teamcaptainsguild
Only 5 percent of entrepreneurship is the big idea, the business model, the whiteboard strategizing, and the splitting up of the spoils.
The other 95 percent is the gritty work that is measured by innovation accounting: product prioritization decisions, deciding which customers to target or listen to, and having the courage to subject a grand vision to constant testing and feedback.
An introduction to the Jobs to Be Done customer research/insights framework, with a focus on how product managers can put Jobs to Be Done into practice with key tools such as customer interviews, surveys, prototyping, and A/B testing.
Show Me You Know Me - An Intro to UX and CROJeremy Hamman
August 2016 - Adobe IDUG Conference Phoenix
Introducing the value of user experience, conversion rate optimization, and some simple tools and resources to an audience of print designers. Talk focuses on methods for learning more about users, where they are in the conversion funnel, and how to meet them in their moment of need.
In this presentation, I share some ideas on how as a communication major you can develop the mindset of an analyst. I share insights gained from five personal career milestones
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick SoChris Goward
Go behind the curtain with WiderFunnel's Director of Strategy, Nick So, as he shares exclusive learnings from his experience building successful experimentation programs for companies like HP, Asics, Magento, and IBM. During this webinar, you’ll get an insider look at the frameworks and strategies that WiderFunnel developed to help clients scale experimentation and accelerate through the phases of maturity.
Research Rebooted: Market Research is Broken, How Lean Can Help Fix It #leand...The Difference Engine
The presentation from my talk at #LeanDayWest, September 17, 2013 in Portland, OR. Research Rebooted: Market Research is Broken, How Lean Can Help Fix It.
This was a 4-hour workshop that was given at World Usability Day Colombia. #wudco14
Summary:
Now more than ever is the survival of the easiest. Whether the product is a website or a handheld device, success depends largely on how easy it is to use. Usability testing is one of the most effective for creating an intuitive methods. By observing actual people when they use the product, you can get valuable insights if your design is easy to use. Attendees will learn how to conduct a usability test with end users of a product. This workshop is highly interactive and includes several practical exercises to give participants practical experience.
You will learn:
- How to plan a usability testing study
- How to define the goals and objectives
- Explore options (unmoderated usability testing vs. unmoderated & remote vs. in-person)
- How to recruit the right participants
- How to create tasks (Interview-based vs. predefined tasks)
- How to moderate a usability test
- How to analyze and report the results
Similar to Democratizing Online Controlled Experiments at Booking.com (20)
Show drafts
volume_up
Empowering the Data Analytics Ecosystem: A Laser Focus on Value
The data analytics ecosystem thrives when every component functions at its peak, unlocking the true potential of data. Here's a laser focus on key areas for an empowered ecosystem:
1. Democratize Access, Not Data:
Granular Access Controls: Provide users with self-service tools tailored to their specific needs, preventing data overload and misuse.
Data Catalogs: Implement robust data catalogs for easy discovery and understanding of available data sources.
2. Foster Collaboration with Clear Roles:
Data Mesh Architecture: Break down data silos by creating a distributed data ownership model with clear ownership and responsibilities.
Collaborative Workspaces: Utilize interactive platforms where data scientists, analysts, and domain experts can work seamlessly together.
3. Leverage Advanced Analytics Strategically:
AI-powered Automation: Automate repetitive tasks like data cleaning and feature engineering, freeing up data talent for higher-level analysis.
Right-Tool Selection: Strategically choose the most effective advanced analytics techniques (e.g., AI, ML) based on specific business problems.
4. Prioritize Data Quality with Automation:
Automated Data Validation: Implement automated data quality checks to identify and rectify errors at the source, minimizing downstream issues.
Data Lineage Tracking: Track the flow of data throughout the ecosystem, ensuring transparency and facilitating root cause analysis for errors.
5. Cultivate a Data-Driven Mindset:
Metrics-Driven Performance Management: Align KPIs and performance metrics with data-driven insights to ensure actionable decision making.
Data Storytelling Workshops: Equip stakeholders with the skills to translate complex data findings into compelling narratives that drive action.
Benefits of a Precise Ecosystem:
Sharpened Focus: Precise access and clear roles ensure everyone works with the most relevant data, maximizing efficiency.
Actionable Insights: Strategic analytics and automated quality checks lead to more reliable and actionable data insights.
Continuous Improvement: Data-driven performance management fosters a culture of learning and continuous improvement.
Sustainable Growth: Empowered by data, organizations can make informed decisions to drive sustainable growth and innovation.
By focusing on these precise actions, organizations can create an empowered data analytics ecosystem that delivers real value by driving data-driven decisions and maximizing the return on their data investment.
Adjusting primitives for graph : SHORT REPORT / NOTESSubhajit Sahu
Graph algorithms, like PageRank Compressed Sparse Row (CSR) is an adjacency-list based graph representation that is
Multiply with different modes (map)
1. Performance of sequential execution based vs OpenMP based vector multiply.
2. Comparing various launch configs for CUDA based vector multiply.
Sum with different storage types (reduce)
1. Performance of vector element sum using float vs bfloat16 as the storage type.
Sum with different modes (reduce)
1. Performance of sequential execution based vs OpenMP based vector element sum.
2. Performance of memcpy vs in-place based CUDA based vector element sum.
3. Comparing various launch configs for CUDA based vector element sum (memcpy).
4. Comparing various launch configs for CUDA based vector element sum (in-place).
Sum with in-place strategies of CUDA mode (reduce)
1. Comparing various launch configs for CUDA based vector element sum (in-place).
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...John Andrews
SlideShare Description for "Chatty Kathy - UNC Bootcamp Final Project Presentation"
Title: Chatty Kathy: Enhancing Physical Activity Among Older Adults
Description:
Discover how Chatty Kathy, an innovative project developed at the UNC Bootcamp, aims to tackle the challenge of low physical activity among older adults. Our AI-driven solution uses peer interaction to boost and sustain exercise levels, significantly improving health outcomes. This presentation covers our problem statement, the rationale behind Chatty Kathy, synthetic data and persona creation, model performance metrics, a visual demonstration of the project, and potential future developments. Join us for an insightful Q&A session to explore the potential of this groundbreaking project.
Project Team: Jay Requarth, Jana Avery, John Andrews, Dr. Dick Davis II, Nee Buntoum, Nam Yeongjin & Mat Nicholas
2. TL;DR.
Central repository of successes and failures
Descriptions of all experiment iterations and of the
final decision are available for all experimenters.
Genericity and extensibility
Experimental design is abstracted away. Reports
are automated and product agnostic.
Data which can be trusted
We monitor the validity of the data by computing
common metrics in two separate date pipelines.
Loose coupling
Business logic and experiment infrastructure are
purposefully kept decoupled.
Building safeguards
We encourage sound methodology and provide
data quality checks, but no rules or automation.
6. 1. Ask PR department for “pretty photos of
employees”.
2. Filter out non-experiment roles (dba,
support, management, etc).
3. Select six at random from the remainder.
4. Email them and ask “how do you use
experiments in your job”.
5. Copy paste replies onto slides.
6. Highlight key phrases.
7. Sprinkle in some context.
Method.
Sample
Survey
Results
10. Clyde Li.
Client Side Developer
“Data-driven is quite
common these days in tech
industry, however,
empowering everyone to
make data-driven decisions
independently is quite
unique in Booking.com.”
11. Nekeia Boone.
Senior UX Copywriter
“I can come up with an idea
over breakfast, bike to the
office and have it live well
before lunch. I’ve never
worked anywhere else that
gives me this level of
ownership and creative
freedom to validate my
ideas.”
12. Heloisa Biagi.
Client Side Developer
“I think it's great that the
company encourages
everyone to hack and test
ideas among the users. No
higher value opinions, no
centralization of decision
making, everyone is free to
have their own ideas and at
the end of the day, users are
the ones who decide what's
best for them.”
14. Hadeer Younis.
Full-Stack Software Developer
“Experimentation is a great
way to figure out if
something as small as a
copy change or something
as big as a whole book
process flow will help users,
but you can’t depend on it
as your only source of
product validation as this will
greatly hinder the product
development.”
15. “The plural of
anecdote is not data”
- Lots of misinformed speakers at conferences I’ve attended
18. A B
Website Optimisation.
Let’s change the button from yellow to blue and see if it increases the magic number.
Buy now! Buy now!
19. A B
Hypothesis Testing.
We observed in user research that some people have difficulty finding the “buy now”
button. We suspect this is caused by the low contrast between the font and the
background. To solve this user issue, we will change the button from yellow to blue. If this
solution works, we expect to see more users hover and click, and eventually purchase.
Buy now! Buy now!
21. Finn Hansen.
Product Owner
“We use experimentation to
help us validate hypotheses
with the goal of addressing
well defined user problems.
It's all about learning as fast
as possible in the most
rigorous way possible.”
22. Based on [prior] we believe [condition] for
[users] will encourage them to [behavior]
We will know this when we see [effects]
happen to [metrics]
This will be good for customers, partners
and our business because [motivation].
Hypothesis template.
Theory
Validation
Objective
23. Diogo Antunes.
Principal Developer & Fellow
“We work in a global scale.
By validating my changes
through experimentation I
continuously get challenged
on my assumptions and the
way I look into the
experience of our
customers.”
24. 9/10 tests fail.
“90% of product decisions have an
inconclusive or negative effect on a
product’s primary metric.”
- VWO (2016)
90%
10%
27. Take the biggest small step
so you can challenge your
riskiest assumptions quickly
28. The order of items can be improved.
The order of items matters to users.
The feature can be improved.
The feature matters to users.
The page can be improved.
What is on the page matters to users.
Assumptions.
Order
Feature
Page
