SlideShare a Scribd company logo
Predictive Markets & the Wisdom of Crowds Experiments A Market Research Project by BrainJuicer ® Produced December 2005 The Mind Reading Agency
Extraordinary delusions   and the Madness of Crowds,  Charles MacKay (1841)
The Wisdom of Crowds   – How the Many Can Be Smarter than the Few, James Surowiecki (2004)
[object Object],[object Object],[object Object],Enables a crowd to be wise
Galton’s surprise findings. Collective Guess  = 1197 lbs Actual Weight  = 1198 lbs
How did the market know? Rockwell – Down 3% Lockheed – Down 3%  Martin Marietta – Down 3% Morton Thiokol – Down 12%
Qu.   Is there a more efficient alternative?
IEM -   The original decision market X 596 Polls (1988 - 2000)    ¾
French   – Referendum Non 53.6%  Oui  46.4% Non 54.9%  Oui 45.1% 29 th  May – Betting BetFair 30 th  May - Result (70% turn out) Non 51.0%  Oui 49.0% 28 th  May – Polls IPSOS
 
[object Object],[object Object],[object Object],3 hypotheses  to test on… Predictive Markets’ &  Wisdom of Crowds
The  Experiments Monadic Tests of 3, 10, 15 & 20 ideas, with matched targeted samples of 100 Predictive Markets of 3, 10, 15 & 20 ideas, with diverse ‘crowds’ of 500
Predictive Market 1 - UK    A diverse crowd will be as accurate as a targeted sample     A ‘Predictive Market’ will be as accurate as a monadic test     Answering for the market as accurate as answering for oneself Respondent Base Sizes: Monadic = 100 per cell / Predictive Market *No Betting = 507 *** 16 43 J 45 49 I *** 35 54 H *** 28 64 G *** 28 64 F 67 67 UK Norms (top 2 box) 70 74 E 86 78 D 80 81 C + 76 83 B 85 85 A Significant Differences Predictive Market 2* With diverse group of 500 people - *no betting (Top 2 Box Purchase Intent) Monadic Test with matched samples of 100 in the target market (Top 2 Box Purchase Intent) New Product Concepts Top Two Box Purchase Intention Results – Predictive Market 2* Respondent Base Sizes: Monadic = 100 per cell / Predictive Market *No Betting = 507 *** 16 43 J 45 49 I *** 35 54 H *** 28 64 G *** 28 64 F 67 67 UK Norms (top 2 box) 70 74 E 86 78 D 80 81 C + 76 83 B 85 85 A Significant Differences Predictive Market 2* With diverse group of 500 people - *no betting (Top 2 Box Purchase Intent) Monadic Test with matched samples of 100 in the target market (Top 2 Box Purchase Intent) New Product Concepts Top Two Box Purchase Intention Results – Predictive Market 2*
Predictive Market Experiment 2 - USA   *** 7 21 28 Snow Drapery 21 ** 18 20 40 Plug-in Lighting 20 * 27 19 45 Revitalight 19 + 62 11 45 Rise & Gently Shine 18   56 14 45 Sleep-ease 17   63 10 48 Bath & Spa Candle 16   45 16 50 Sky Scaper 15 * 32 17 52 Color Creator 14   64 9 52 Atmosphere Creator 13   48 15 54 Energizing Light 12 * 71 6 54 Permanent Outdoor Lighting System 11 ** 31 18 58 Light Stems 10   60 12 58 Cleaning Light 9   69 7 68 Voice Light 8   74 4 69 Solar Powered Holiday Lights 7   56 13 70 Two in One 6   71 5 72 Nightglow 5   76 3 74 Exit Alert 4   67 8 74 Garden Lights 3   78 2 76 Odor Eliminator 2   87 1 83 Fade Out 1 Monadic vs. Research Mkt Sig. Difference Predictive Market Def + Prob Buy Crowd of 500 Rank R.Mkt Monadic Def + Prob Buy 100 tgt per concept Concept Rank Mon.  ,[object Object],[object Object],Juicy  Bits
Predictive Market Experiment 3 - UK x   = Only tested in the 1 st  screener, so no comparative data available   *** 61 36 150 61 89 52 Marmite Barrel Nuts + 46 52 150 69 93 47 *** Marmite Cheese Bites 45 62 150 69 96 40 *** McCain Marmite Wedges 70 80 150 80 92 62 ** Marmite Mini Toasts 129 84 150 79 89 63 ** Marmite Squeezy ** 49 41 150 64 91 49 *** Marmite Seasoning + 62 50 150 64 x x Marmite Soldiers 48 50 150 64 x x Marmite Mini Rice Snacks *** *** *** + Significance Screener vs. Monadic 11 x 26 9 x x x 63 84 x 95 81 x Marmite R.Market Def + Prob Buy 152 x 82 107 x x x 87 31 x 40 57 x Base Crowd 500 *** *** *** *** Significance Monadic vs. R.Market 150 51 95 22 Marmite Brunch Bar x x 92 28 Marmite Rusk Soldiers 150 55 89 31 McCain Marmite Home Fries 150 59 91 38 Marmite Cream Cheese x x 99 39 Marmite Buttery Spread x x 96 43 Marmite Squeezable Portion Pack x x 93 55 Marmite Quavers 150 64 88 57 Marmite Marbled Cheddar 150 72 97 60 Marmite Crackers x x 90 61 Marmite Hula Hoops 150 73 88 65 Marmite Bites 150 73 87 71 Marmite Spreadable x x 95 72 Marmite Walkers Base Tgt 150 Marmite Monadic Def + Prob Buy Base Tgt 87-95 Marmite Screener Def + Prob Buy ,[object Object],[object Object],Juicy  Bits
Predictive Market Experiment 4 - Poland 55.3 53.6 73.3 R.Market (Sell / Buy  most shares ) Def + Prob Buy 235 194 225 Base Crowd 500 *** *** *** Significance Monadic vs. R.Market ( All Shares ) 61.5 58.5 75.7 R.Market (Sell / Buy  any shares ) Def + Prob Buy 366 313 341 Base Crowd 500 ** *** *** Significance Monadic vs. R.Market ( Any shares ) + 65 63.1 158 75 New Plus  91 69.2 150 73 New Sink & Pipe Unblocker 86.7 R.Market (Sell / Buy  All Shares ) Def + Prob Buy 75 Base Crowd 500 Significance Monadic vs. R.Market (All Shares) 151 87 New Cling-Gel  Base Tgt 150-158 Bases: Monadic Def + Prob Buy ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Juicy  Bits
[object Object],[object Object],Predictive Market Experiment 5 - Guatemala   99 92 92 92 89     Purchase Intention 22 29 29 38 49 56 65 69 83 Purchase Intention Monadic Predictive Markets 1 2 2 2 5 Rank 9 7 7 6 5 4 3 2 1 Rank *** 101 55 Be Light *** 101 97 7UP H2Oh! *** 100 100 Lipton Ice Tea 219 Pepsi Cappuccino 109 Flavour Splash   76 Juicy Punch *** 100 92 Propel *** 100 90 Tropicana Twister     166 7UP Bite Significant Difference Base Base  
[object Object]
The Size   of the Prize ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

More Related Content

Viewers also liked

Make your ibm connections deployment your own, customize it!
Make your ibm connections deployment your own, customize it!Make your ibm connections deployment your own, customize it!
Make your ibm connections deployment your own, customize it!Wannes Rams
 
Rock the activity stream api
Rock the activity stream api Rock the activity stream api
Rock the activity stream api Wannes Rams
 
How to be a lion tamer
How to be a lion tamerHow to be a lion tamer
How to be a lion tamerWannes Rams
 
Managing ldap changes in connections
Managing ldap changes in connectionsManaging ldap changes in connections
Managing ldap changes in connectionsWannes Rams
 
Managing ldap changes in connections
Managing ldap changes in connectionsManaging ldap changes in connections
Managing ldap changes in connectionsWannes Rams
 
Enrich your IBM Connections profiles by extending the profiles data model
Enrich your IBM Connections profiles by extending the profiles data modelEnrich your IBM Connections profiles by extending the profiles data model
Enrich your IBM Connections profiles by extending the profiles data modelWannes Rams
 
Speeding up Innovation
Speeding up InnovationSpeeding up Innovation
Speeding up Innovationfred325i
 
Cummings Quantitative Research Methods
Cummings Quantitative Research MethodsCummings Quantitative Research Methods
Cummings Quantitative Research MethodsGlenn E. Malone, EdD
 

Viewers also liked (11)

Make your ibm connections deployment your own, customize it!
Make your ibm connections deployment your own, customize it!Make your ibm connections deployment your own, customize it!
Make your ibm connections deployment your own, customize it!
 
10.11 Wildwood Opening
10.11 Wildwood Opening10.11 Wildwood Opening
10.11 Wildwood Opening
 
Rock the activity stream api
Rock the activity stream api Rock the activity stream api
Rock the activity stream api
 
How to be a lion tamer
How to be a lion tamerHow to be a lion tamer
How to be a lion tamer
 
Managing ldap changes in connections
Managing ldap changes in connectionsManaging ldap changes in connections
Managing ldap changes in connections
 
Managing ldap changes in connections
Managing ldap changes in connectionsManaging ldap changes in connections
Managing ldap changes in connections
 
Cottle ppt edpsych510
Cottle ppt edpsych510Cottle ppt edpsych510
Cottle ppt edpsych510
 
Enrich your IBM Connections profiles by extending the profiles data model
Enrich your IBM Connections profiles by extending the profiles data modelEnrich your IBM Connections profiles by extending the profiles data model
Enrich your IBM Connections profiles by extending the profiles data model
 
Bissonnette D2
Bissonnette D2Bissonnette D2
Bissonnette D2
 
Speeding up Innovation
Speeding up InnovationSpeeding up Innovation
Speeding up Innovation
 
Cummings Quantitative Research Methods
Cummings Quantitative Research MethodsCummings Quantitative Research Methods
Cummings Quantitative Research Methods
 

Recently uploaded

how to sell pi coins on Binance exchange
how to sell pi coins on Binance exchangehow to sell pi coins on Binance exchange
how to sell pi coins on Binance exchangeDOT TECH
 
Juspay Case study(Doubling Revenue Juspay's Success).pptx
Juspay Case study(Doubling Revenue Juspay's Success).pptxJuspay Case study(Doubling Revenue Juspay's Success).pptx
Juspay Case study(Doubling Revenue Juspay's Success).pptxaryan963438
 
Can a Pi network coin ever be sold out: I am ready to sell mine.
Can a Pi network coin ever be sold out: I am ready to sell mine.Can a Pi network coin ever be sold out: I am ready to sell mine.
Can a Pi network coin ever be sold out: I am ready to sell mine.DOT TECH
 
Greek trade a pillar of dynamic economic growth - European Business Review
Greek trade a pillar of dynamic economic growth - European Business ReviewGreek trade a pillar of dynamic economic growth - European Business Review
Greek trade a pillar of dynamic economic growth - European Business ReviewAntonis Zairis
 
9th issue of our inhouse magazine Ingenious May 2024.pdf
9th issue of our inhouse magazine Ingenious May 2024.pdf9th issue of our inhouse magazine Ingenious May 2024.pdf
9th issue of our inhouse magazine Ingenious May 2024.pdfAnkur Shah
 
Summary of financial results for 1Q2024
Summary of financial  results for 1Q2024Summary of financial  results for 1Q2024
Summary of financial results for 1Q2024InterCars
 
Most Profitable Cryptocurrency to Invest in 2024.pdf
Most Profitable Cryptocurrency to Invest in 2024.pdfMost Profitable Cryptocurrency to Invest in 2024.pdf
Most Profitable Cryptocurrency to Invest in 2024.pdfKezex (KZX)
 
Digital Finance Summit 2024 Partners Brochure
Digital Finance Summit 2024 Partners BrochureDigital Finance Summit 2024 Partners Brochure
Digital Finance Summit 2024 Partners BrochureFinTech Belgium
 
Falcon Invoice Discounting: Optimizing Returns with Minimal Risk
Falcon Invoice Discounting: Optimizing Returns with Minimal RiskFalcon Invoice Discounting: Optimizing Returns with Minimal Risk
Falcon Invoice Discounting: Optimizing Returns with Minimal RiskFalcon Invoice Discounting
 
how can I sell my pi coins in China 2024.
how can I sell my pi coins in China 2024.how can I sell my pi coins in China 2024.
how can I sell my pi coins in China 2024.DOT TECH
 
how to sell pi coins in Canada, Uk and Australia
how to sell pi coins in Canada, Uk and Australiahow to sell pi coins in Canada, Uk and Australia
how to sell pi coins in Canada, Uk and AustraliaDOT TECH
 
一比一原版Adelaide毕业证阿德莱德大学毕业证成绩单如何办理
一比一原版Adelaide毕业证阿德莱德大学毕业证成绩单如何办理一比一原版Adelaide毕业证阿德莱德大学毕业证成绩单如何办理
一比一原版Adelaide毕业证阿德莱德大学毕业证成绩单如何办理zsewypy
 
how can i use my minded pi coins I need some funds.
how can i use my minded pi coins I need some funds.how can i use my minded pi coins I need some funds.
how can i use my minded pi coins I need some funds.DOT TECH
 
what is a pi whale and how to access one.
what is a pi whale and how to access one.what is a pi whale and how to access one.
what is a pi whale and how to access one.DOT TECH
 
how can I sell/buy bulk pi coins securely
how can I sell/buy bulk pi coins securelyhow can I sell/buy bulk pi coins securely
how can I sell/buy bulk pi coins securelyDOT TECH
 
how can I transfer pi coins to someone in a different country.
how can I transfer pi coins to someone in a different country.how can I transfer pi coins to someone in a different country.
how can I transfer pi coins to someone in a different country.DOT TECH
 
how can I sell my locked pi coins safety.
how can I sell my locked pi coins safety.how can I sell my locked pi coins safety.
how can I sell my locked pi coins safety.DOT TECH
 
Isios-2024-Professional-Independent-Trustee-Survey.pdf
Isios-2024-Professional-Independent-Trustee-Survey.pdfIsios-2024-Professional-Independent-Trustee-Survey.pdf
Isios-2024-Professional-Independent-Trustee-Survey.pdfHenry Tapper
 
what is the future of Pi Network currency.
what is the future of Pi Network currency.what is the future of Pi Network currency.
what is the future of Pi Network currency.DOT TECH
 

Recently uploaded (20)

how to sell pi coins on Binance exchange
how to sell pi coins on Binance exchangehow to sell pi coins on Binance exchange
how to sell pi coins on Binance exchange
 
Juspay Case study(Doubling Revenue Juspay's Success).pptx
Juspay Case study(Doubling Revenue Juspay's Success).pptxJuspay Case study(Doubling Revenue Juspay's Success).pptx
Juspay Case study(Doubling Revenue Juspay's Success).pptx
 
Can a Pi network coin ever be sold out: I am ready to sell mine.
Can a Pi network coin ever be sold out: I am ready to sell mine.Can a Pi network coin ever be sold out: I am ready to sell mine.
Can a Pi network coin ever be sold out: I am ready to sell mine.
 
Greek trade a pillar of dynamic economic growth - European Business Review
Greek trade a pillar of dynamic economic growth - European Business ReviewGreek trade a pillar of dynamic economic growth - European Business Review
Greek trade a pillar of dynamic economic growth - European Business Review
 
Monthly Economic Monitoring of Ukraine No. 232, May 2024
Monthly Economic Monitoring of Ukraine No. 232, May 2024Monthly Economic Monitoring of Ukraine No. 232, May 2024
Monthly Economic Monitoring of Ukraine No. 232, May 2024
 
9th issue of our inhouse magazine Ingenious May 2024.pdf
9th issue of our inhouse magazine Ingenious May 2024.pdf9th issue of our inhouse magazine Ingenious May 2024.pdf
9th issue of our inhouse magazine Ingenious May 2024.pdf
 
Summary of financial results for 1Q2024
Summary of financial  results for 1Q2024Summary of financial  results for 1Q2024
Summary of financial results for 1Q2024
 
Most Profitable Cryptocurrency to Invest in 2024.pdf
Most Profitable Cryptocurrency to Invest in 2024.pdfMost Profitable Cryptocurrency to Invest in 2024.pdf
Most Profitable Cryptocurrency to Invest in 2024.pdf
 
Digital Finance Summit 2024 Partners Brochure
Digital Finance Summit 2024 Partners BrochureDigital Finance Summit 2024 Partners Brochure
Digital Finance Summit 2024 Partners Brochure
 
Falcon Invoice Discounting: Optimizing Returns with Minimal Risk
Falcon Invoice Discounting: Optimizing Returns with Minimal RiskFalcon Invoice Discounting: Optimizing Returns with Minimal Risk
Falcon Invoice Discounting: Optimizing Returns with Minimal Risk
 
how can I sell my pi coins in China 2024.
how can I sell my pi coins in China 2024.how can I sell my pi coins in China 2024.
how can I sell my pi coins in China 2024.
 
how to sell pi coins in Canada, Uk and Australia
how to sell pi coins in Canada, Uk and Australiahow to sell pi coins in Canada, Uk and Australia
how to sell pi coins in Canada, Uk and Australia
 
一比一原版Adelaide毕业证阿德莱德大学毕业证成绩单如何办理
一比一原版Adelaide毕业证阿德莱德大学毕业证成绩单如何办理一比一原版Adelaide毕业证阿德莱德大学毕业证成绩单如何办理
一比一原版Adelaide毕业证阿德莱德大学毕业证成绩单如何办理
 
how can i use my minded pi coins I need some funds.
how can i use my minded pi coins I need some funds.how can i use my minded pi coins I need some funds.
how can i use my minded pi coins I need some funds.
 
what is a pi whale and how to access one.
what is a pi whale and how to access one.what is a pi whale and how to access one.
what is a pi whale and how to access one.
 
how can I sell/buy bulk pi coins securely
how can I sell/buy bulk pi coins securelyhow can I sell/buy bulk pi coins securely
how can I sell/buy bulk pi coins securely
 
how can I transfer pi coins to someone in a different country.
how can I transfer pi coins to someone in a different country.how can I transfer pi coins to someone in a different country.
how can I transfer pi coins to someone in a different country.
 
how can I sell my locked pi coins safety.
how can I sell my locked pi coins safety.how can I sell my locked pi coins safety.
how can I sell my locked pi coins safety.
 
Isios-2024-Professional-Independent-Trustee-Survey.pdf
Isios-2024-Professional-Independent-Trustee-Survey.pdfIsios-2024-Professional-Independent-Trustee-Survey.pdf
Isios-2024-Professional-Independent-Trustee-Survey.pdf
 
what is the future of Pi Network currency.
what is the future of Pi Network currency.what is the future of Pi Network currency.
what is the future of Pi Network currency.
 

Predictive Markets & Experimental Results

  • 1. Predictive Markets & the Wisdom of Crowds Experiments A Market Research Project by BrainJuicer ® Produced December 2005 The Mind Reading Agency
  • 2. Extraordinary delusions and the Madness of Crowds, Charles MacKay (1841)
  • 3. The Wisdom of Crowds – How the Many Can Be Smarter than the Few, James Surowiecki (2004)
  • 4.
  • 5. Galton’s surprise findings. Collective Guess = 1197 lbs Actual Weight = 1198 lbs
  • 6. How did the market know? Rockwell – Down 3% Lockheed – Down 3% Martin Marietta – Down 3% Morton Thiokol – Down 12%
  • 7. Qu. Is there a more efficient alternative?
  • 8. IEM - The original decision market X 596 Polls (1988 - 2000)  ¾
  • 9. French – Referendum Non 53.6% Oui 46.4% Non 54.9% Oui 45.1% 29 th May – Betting BetFair 30 th May - Result (70% turn out) Non 51.0% Oui 49.0% 28 th May – Polls IPSOS
  • 10.  
  • 11.
  • 12. The Experiments Monadic Tests of 3, 10, 15 & 20 ideas, with matched targeted samples of 100 Predictive Markets of 3, 10, 15 & 20 ideas, with diverse ‘crowds’ of 500
  • 13. Predictive Market 1 - UK  A diverse crowd will be as accurate as a targeted sample  A ‘Predictive Market’ will be as accurate as a monadic test  Answering for the market as accurate as answering for oneself Respondent Base Sizes: Monadic = 100 per cell / Predictive Market *No Betting = 507 *** 16 43 J 45 49 I *** 35 54 H *** 28 64 G *** 28 64 F 67 67 UK Norms (top 2 box) 70 74 E 86 78 D 80 81 C + 76 83 B 85 85 A Significant Differences Predictive Market 2* With diverse group of 500 people - *no betting (Top 2 Box Purchase Intent) Monadic Test with matched samples of 100 in the target market (Top 2 Box Purchase Intent) New Product Concepts Top Two Box Purchase Intention Results – Predictive Market 2* Respondent Base Sizes: Monadic = 100 per cell / Predictive Market *No Betting = 507 *** 16 43 J 45 49 I *** 35 54 H *** 28 64 G *** 28 64 F 67 67 UK Norms (top 2 box) 70 74 E 86 78 D 80 81 C + 76 83 B 85 85 A Significant Differences Predictive Market 2* With diverse group of 500 people - *no betting (Top 2 Box Purchase Intent) Monadic Test with matched samples of 100 in the target market (Top 2 Box Purchase Intent) New Product Concepts Top Two Box Purchase Intention Results – Predictive Market 2*
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.