Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

of

NewMR Webinar - Factworks and Dynata 2019 Slide 1 NewMR Webinar - Factworks and Dynata 2019 Slide 2 NewMR Webinar - Factworks and Dynata 2019 Slide 3 NewMR Webinar - Factworks and Dynata 2019 Slide 4 NewMR Webinar - Factworks and Dynata 2019 Slide 5 NewMR Webinar - Factworks and Dynata 2019 Slide 6 NewMR Webinar - Factworks and Dynata 2019 Slide 7 NewMR Webinar - Factworks and Dynata 2019 Slide 8 NewMR Webinar - Factworks and Dynata 2019 Slide 9 NewMR Webinar - Factworks and Dynata 2019 Slide 10 NewMR Webinar - Factworks and Dynata 2019 Slide 11 NewMR Webinar - Factworks and Dynata 2019 Slide 12 NewMR Webinar - Factworks and Dynata 2019 Slide 13 NewMR Webinar - Factworks and Dynata 2019 Slide 14 NewMR Webinar - Factworks and Dynata 2019 Slide 15 NewMR Webinar - Factworks and Dynata 2019 Slide 16 NewMR Webinar - Factworks and Dynata 2019 Slide 17 NewMR Webinar - Factworks and Dynata 2019 Slide 18 NewMR Webinar - Factworks and Dynata 2019 Slide 19 NewMR Webinar - Factworks and Dynata 2019 Slide 20 NewMR Webinar - Factworks and Dynata 2019 Slide 21
Upcoming SlideShare
What to Upload to SlideShare
Next
Download to read offline and view in fullscreen.

0 Likes

Share

Download to read offline

NewMR Webinar - Factworks and Dynata 2019

Download to read offline

Finding the best name quickly – an intelligent algorithm for naming and concept tests
Nadja Böhme, CEO at Factworks & Graham Williams, Research Director at Dynata – sponsored presentation. Research on Research showing how machine learning has been applied to a naming test to generate results with efficiency gains of up to 20%.

Related Books

Free with a 30 day trial from Scribd

See all
  • Be the first to like this

NewMR Webinar - Factworks and Dynata 2019

  1. 1. 1 Nadja Böhme (Factworks), Graham Williams (Dynata) Webinar on NewMR, June 20th, 2019 The Death of Classical Monadic Designs A Self-Learning Algorithm for Concept Testing June 2019
  2. 2. Monadic designs are the gold standard (for name and concept tests)
  3. 3. CONCEPT 1 CONCEPT 2 CONCEPT 3 CONCEPT 4 CONCEPT 5 Monadic is cost-intensive and inefficient
  4. 4. Is there a more efficient way?
  5. 5. CONCEPT 1 CONCEPT 2 CONCEPT 3 CONCEPT 4 CONCEPT 5 From monadic design…
  6. 6. CONCEPT 1 CONCEPT 2 CONCEPT 3 CONCEPT 4 CONCEPT 5 with our self-learning algorithm …to adaptive design
  7. 7. Validation in an online survey CONCEPT 1 CONCEPT 2 CONCEPT 3 CONCEPT 4 CONCEPT 5CONCEPT 1 CONCEPT 2 CONCEPT 3 CONCEPT 4 CONCEPT 5 MONADIC DESIGN ADAPTIVE DESIGN VS
  8. 8. Representative study for age (18-65) and gender plus smartphone usage Programming partner: 20 questions UK Sep 2018 AB testing to find the best name Each ~1,500 for monadic/adaptive
  9. 9. …like a night in Las Vegas
  10. 10. Use cases for Bayesian Bandit Website optimization Evolution Clinical studies
  11. 11. 0 200 400 600 800 1000 1200 1400 0 250 500 750 1000 1250 1500 Bayesian Bandit in action CONCEPT 1 CONCEPT 2 CONCEPT 3 CONCEPT 4 CONCEPT 5 The winner takes it all Simulated data
  12. 12. Working on the algorithm 0 100 200 300 400 500 600 700 0 250 500 750 1000 1250 1500 CONCEPT 1 CONCEPT 2 CONCEPT 3 CONCEPT 4 CONCEPT 5 ➜ Starting sample size ➜ Min. sample size per concept ➜ Max. sample size per concept Gradually eliminating concepts that have been rated significantly worse than the best one Simulated data
  13. 13. More info about top concepts
  14. 14. Bigger sample sizes for top names 0 100 200 300 400 500 600 700 0 250 500 750 1000 1250 1500 Watch2Learn Did you know…? Knowly Apprendo Rubiko Concept Ranking 2. 1. 3. 4. 5.
  15. 15. More splits possible Male Female 18-24 25-34 35-44 45-54 55-65 18-24 25-34 35-44 45-54 55-65 18 29 25 33 24 26 34 35 45 32 19 32 39 35 31 19 30 31 30 34 Monadic design Adaptive design Smartphone Tablet Desktop 207 21 73 204 26 71 …when there are no alternatives. …but prefers established technology. …after it proves to be worthwhile. …before most others use it. …as soon as it‘s available. 40 115 92 42 12 38 118 84 48 13 Age/gender Watch2Learn Did you know…? Answered survey with Watch2Learn Did you know…? Uses new technology Watch2Learn Did you know…? Male Female 18-24 25-34 35-44 45-54 55-65 18-24 25-34 35-44 45-54 55-65 39 63 58 67 55 42 63 60 77 55 29 52 53 55 43 36 48 50 56 40 Smartphone Tablet Desktop 356 39 186 276 37 149 …when there are no alternatives. …but prefers established technology. …after it proves to be worthwhile. …before most others use it. …as soon as it‘s available. 88 208 157 92 36 67 156 144 73 22 N=too little N=enough
  16. 16. Reaching the goal faster
  17. 17. Reaching the goal with less sample 3.00 3.10 3.20 3.30 3.40 3.50 3.60 3.70 3.80 3.90 4.00 0 250 500 750 1000 1250 1500 Adaptive Final N=300 for Top 1 reached after 934 interviews Adaptive Final N=300 for Top 2 reached after 999 interviews Watch2Learn Did you know…?
  18. 18. Hardly any profile differences 41 41 Age Gender Profession New technology 57% 51% 83% 85% 18% 22% Daily app usage Smart TV Instagram Smartphone 85% 89% 49% 51% 39% 41% 69% 61% AdaptiveMonadic Top1 Watch2Learn M A
  19. 19. Significance More information for top concepts Feasibility Even when dealing with hard-to-reach target groups Flexibility More concepts, items, etc. possible Conclusion and outlook Speed Reaching the goal in less time
  20. 20. Interested in using our new tool? Come and talk to us! Nadja Böhme boehme@factworks.com Graham Williams Graham.williams@dynata.com
  21. 21. Q & A Ray Poynter NewMR June 2019 June 2019 Nadja Böhme Factworks Graham Williams Dynata

Finding the best name quickly – an intelligent algorithm for naming and concept tests Nadja Böhme, CEO at Factworks & Graham Williams, Research Director at Dynata – sponsored presentation. Research on Research showing how machine learning has been applied to a naming test to generate results with efficiency gains of up to 20%.

Views

Total views

345

On Slideshare

0

From embeds

0

Number of embeds

0

Actions

Downloads

6

Shares

0

Comments

0

Likes

0

×