SlideShare a Scribd company logo
1 of 19
Copyright © 2008, SAS Institute Inc. All rights reserved.
Practical Design for
Discrete Choice
Experiments
Bradley Jones, SAS Institute
August 13, 2008
Copyright © 2008, SAS Institute Inc. All rights reserved.
DEMA 2008, August 2008,
Cambridge
2
 Respondents indicate the alternative they prefer most in
each choice set
 Alternatives are called profiles
 Each profile is a combination of attribute levels
 Choice sets typically consist of two, three or four profiles
Discrete Choice Experiment Setup
Copyright © 2008, SAS Institute Inc. All rights reserved.
Example: Marketing a new laptop computer
Attributes Levels
Hard Drive 40 GB 80 GB
Speed 1.5 GHz 2.0 GHz
Battery Life 4 hours6 hours
Price $1,000 $1,200 $1,500
DEMA 2008, August 2008,
Cambridge
3
Copyright © 2008, SAS Institute Inc. All rights reserved.
Sample Choice Set
Hard Disk Speed Battery Price
40Gig 1.5GHz 6hours $1,000
40Gig 2.0GHz 4hours $1,500
Check the box for the laptop you prefer.
Profile 1
Profile 2
4DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
5
multinomial logit model
based on the random utilities model
where xjs represents the attribute levels and β is the set of
parameter values
probability of choosing alternative j in choice set s
Statistical model
ε′= +js js jsU xβ
=1
option chosen
in choice set
js
ts
js J
t
j e
p
s e
′
′
 
= ÷
  ∑
xβ
xβ
DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
D criterion - minimize the determinant of the variance matrix of
the estimators:
( )( )1
det −
M Xβ,
Design optimality criterion
DEMA 2008, August 2008,
Cambridge
6
Equivalently – maximize the determinant of the
information matrix, M.
Copyright © 2008, SAS Institute Inc. All rights reserved.
7
Bayesian optimal designs:
• construct a prior distribution for the parameters
• find design that performs best on average
• Sándor & Wedel (2001, 2002, 2005)
Dependence on the unknown parameter, β
( ) ( ) ( ) ( )( )
1
,
S
s s s s s
s=
′ ′= −∑M Xβ X P β p β p β X
DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Design for Nonlinear Models
To design an informative experiment …..
You need to know something about the response function …..
And about the parameter values.
8DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Bayesian D-Optimal Design
Bayesian ideas are natural to cope with the fact that
the information matrix, M, depends on β.
Chaloner and Larntz (1986) developed a Bayesian D-
Optimality criterion:
Φ(d) = ∫ log det [M(β;d)] p(β) dβ
9DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Computing Bayesian D-Optimal Designs
A major impediment to Bayesian D-optimal design
has been COMPUTATIONAL.
The integral over β can be VERY SLOW.
It must be computed MANY TIMES in the course of
finding an optimal design.
10DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Bayesian Computations
Gotwalt, Jones and Steinberg (2007) use a quadrature
method, due to Mysovskikh.
This method is guaranteed to exactly integrate all
polynomials up to 5th degree and all odd-degree
monomials.
With p parameters, it requires just O(p2) function evaluations.
11DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Mysovskikh quadrature
Assume a normal prior with independence.
• Center the integral about the prior mean.
• Scale each variable by its standard deviation.
• Integrate over distance from the prior mean and, at
each distance, over a spherical shell.
12DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Mysovskikh quadrature continued…
Radial integral: Generalized Gauss-LaGuerre
quadrature, with an extra point at the origin.
Spherical integrals: The Mysovskikh quadrature
scheme.
13DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Spherical integral
A simplex, its edge midpoints on the sphere, and
the inverses of all of these points.
Simplex point weights: p(7-p)/2(p+1)2(p+2).
Mid-point weights: 2(p-1)2/p(p+1)2(p+2).
14DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Simplex point
Mid-point
Each point is both a simplex
point and a mid-point.
All weights equal1/6.
Quadrature points in two dimensions
15DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Study Description
16 Respondents – 8 developers 8 sales & marketing
9 Male 7 Female
2 Surveys with 6 choice sets in each
Respondents were assigned randomly to surveys
blocked by job function
16DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Software Demonstration
17DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
Conclusions
1) Discrete Choice Conjoint Experiments require design
methods for nonlinear models.
2) D-Optimal Bayesian designs reduce the dependence
of the design on the unknown parameters.
3) New quadrature methods make computation of these
designs much faster.
4) Commercial software makes carrying out such
studies simple and efficient.
18DEMA 2008, August 2008,
Cambridge
Copyright © 2008, SAS Institute Inc. All rights reserved.
References
Atkinson, A. C. and Donev, A. N. (1992). Optimum Experimental Designs, Oxford U.K.: Clarendon Press.
Cassity C.R., (1965) “Abscissas, Coefficients, and Error Term for the Generalized Gauss-Laguerre Quadrature Formula Using the Zero
Ordinate,” Mathematics ofComputation, 19, 287-296.
Chaloner, K. and Verdinelli, I. (1995). Bayesian experimental design: a re-view, Statistical Science 10: 273-304.
Grossmann, H., Holling, H. and Schwabe, R. (2002). Advances in optimum experimental design for conjoint analysis and discrete
choice models, in Advances in Econometrics, Econometric Models in Marketing, Vol. 16, Franses, P. H. and Montgomery, A. L.,
eds. Amsterdam: JAI Press, 93-117.
Gotwalt, C., Jones, B. and Steinberg, D. (2009) Fast Computation of Designs Robust to Parameter Uncertainty for Nonlinear Settings
accepted at Technometrics.
Huber, J. and Zwerina, K. (1996). The importance of utility balance in efficient choice designs, Journal of Marketing Research 33: 307-
317.
McFadden, D. (1974). Conditional logit analysis of qualitative choice behavior, in Frontiers in Econometrics, Zarembka, P., ed. New
York: Academic Press, 105-142.
Meyer, R. K. and Nachtsheim, C. J. (1995). The coordinate-exchange algorithm for constructing exact optimal experimental designs,
Technometrics 37: 60-69.
Monahan, J. and Genz, A. (1997). Spherical-radial integration rules for Bayesian computation, Journal of the American Statistical
Association 92: 664-674.
Sandor, Z. and Wedel, M. (2001). Designing conjoint choice experiments using managers' prior beliefs, Journal of Marketing Research
38: 430-444.
19DEMA 2008, August 2008,
Cambridge

More Related Content

Viewers also liked

Manuel & diana trips
Manuel & diana tripsManuel & diana trips
Manuel & diana tripsvaro99
 
Language presentation
Language presentationLanguage presentation
Language presentationmelodyschool
 
Pre production power point
Pre production power pointPre production power point
Pre production power pointecsmedia
 
Angle shots
Angle shotsAngle shots
Angle shotsecsmedia
 
Christmas!
Christmas!Christmas!
Christmas!K8lin
 
Should openness be the default approach in higher education? (ALT-C 2014)
Should openness be the default approach in higher education? (ALT-C 2014)Should openness be the default approach in higher education? (ALT-C 2014)
Should openness be the default approach in higher education? (ALT-C 2014)Liz Masterman
 
Sosiaalinen media ammatillisessa koulutuksessa
Sosiaalinen media ammatillisessa koulutuksessaSosiaalinen media ammatillisessa koulutuksessa
Sosiaalinen media ammatillisessa koulutuksessaHannu Kuusela
 
Healthy lifestyle's education - retrospectiva
Healthy lifestyle's education - retrospectivaHealthy lifestyle's education - retrospectiva
Healthy lifestyle's education - retrospectivacecisromania
 
Pre production power pont`
Pre production power pont`Pre production power pont`
Pre production power pont`ecsmedia
 
Highlights in the life of St. Anthony Mary Claret (for Claret School of Quezo...
Highlights in the life of St. Anthony Mary Claret (for Claret School of Quezo...Highlights in the life of St. Anthony Mary Claret (for Claret School of Quezo...
Highlights in the life of St. Anthony Mary Claret (for Claret School of Quezo...Arvin Lising
 
Personal Leadership rev 1
Personal Leadership rev 1Personal Leadership rev 1
Personal Leadership rev 1Rachmat Gunawan
 
Eurosocialnetwork ingles emod def
Eurosocialnetwork ingles emod defEurosocialnetwork ingles emod def
Eurosocialnetwork ingles emod defIrecoop Toscana
 
Guardians of the Leads Webinar
Guardians of the Leads WebinarGuardians of the Leads Webinar
Guardians of the Leads WebinarMarketStar Corp
 
The doula advantage in Vietnamese
The doula advantage in VietnameseThe doula advantage in Vietnamese
The doula advantage in VietnamesedoulaSON
 
Behaviorism slideshow Group 4
Behaviorism slideshow Group 4Behaviorism slideshow Group 4
Behaviorism slideshow Group 4markyd2010
 

Viewers also liked (20)

Manuel & diana trips
Manuel & diana tripsManuel & diana trips
Manuel & diana trips
 
Ipc overview
Ipc overviewIpc overview
Ipc overview
 
Pda charleston 2010
Pda charleston 2010Pda charleston 2010
Pda charleston 2010
 
Language presentation
Language presentationLanguage presentation
Language presentation
 
Pre production power point
Pre production power pointPre production power point
Pre production power point
 
Angle shots
Angle shotsAngle shots
Angle shots
 
Why Social Media?
Why Social Media?Why Social Media?
Why Social Media?
 
Christmas!
Christmas!Christmas!
Christmas!
 
Should openness be the default approach in higher education? (ALT-C 2014)
Should openness be the default approach in higher education? (ALT-C 2014)Should openness be the default approach in higher education? (ALT-C 2014)
Should openness be the default approach in higher education? (ALT-C 2014)
 
Sosiaalinen media ammatillisessa koulutuksessa
Sosiaalinen media ammatillisessa koulutuksessaSosiaalinen media ammatillisessa koulutuksessa
Sosiaalinen media ammatillisessa koulutuksessa
 
Healthy lifestyle's education - retrospectiva
Healthy lifestyle's education - retrospectivaHealthy lifestyle's education - retrospectiva
Healthy lifestyle's education - retrospectiva
 
Pre production power pont`
Pre production power pont`Pre production power pont`
Pre production power pont`
 
Highlights in the life of St. Anthony Mary Claret (for Claret School of Quezo...
Highlights in the life of St. Anthony Mary Claret (for Claret School of Quezo...Highlights in the life of St. Anthony Mary Claret (for Claret School of Quezo...
Highlights in the life of St. Anthony Mary Claret (for Claret School of Quezo...
 
Personal Leadership rev 1
Personal Leadership rev 1Personal Leadership rev 1
Personal Leadership rev 1
 
Eurosocialnetwork ingles emod def
Eurosocialnetwork ingles emod defEurosocialnetwork ingles emod def
Eurosocialnetwork ingles emod def
 
Guardians of the Leads Webinar
Guardians of the Leads WebinarGuardians of the Leads Webinar
Guardians of the Leads Webinar
 
Кашинка
КашинкаКашинка
Кашинка
 
20031009 053-002
20031009 053-00220031009 053-002
20031009 053-002
 
The doula advantage in Vietnamese
The doula advantage in VietnameseThe doula advantage in Vietnamese
The doula advantage in Vietnamese
 
Behaviorism slideshow Group 4
Behaviorism slideshow Group 4Behaviorism slideshow Group 4
Behaviorism slideshow Group 4
 

Similar to upload test

Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Anubhav Jain
 
Accelerated life testing
Accelerated life testingAccelerated life testing
Accelerated life testingSteven Li
 
Six Sigma Mechanical Tolerance Analysis 1
Six Sigma Mechanical Tolerance Analysis 1Six Sigma Mechanical Tolerance Analysis 1
Six Sigma Mechanical Tolerance Analysis 1David Panek
 
Big Data + Big Sim: Query Processing over Unstructured CFD Models
Big Data + Big Sim: Query Processing over Unstructured CFD ModelsBig Data + Big Sim: Query Processing over Unstructured CFD Models
Big Data + Big Sim: Query Processing over Unstructured CFD ModelsUniversity of Washington
 
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15MLconf
 
Chap 8. Optimization for training deep models
Chap 8. Optimization for training deep modelsChap 8. Optimization for training deep models
Chap 8. Optimization for training deep modelsYoung-Geun Choi
 
Hyperparameter optimization with approximate gradient
Hyperparameter optimization with approximate gradientHyperparameter optimization with approximate gradient
Hyperparameter optimization with approximate gradientFabian Pedregosa
 
Automated Machine Learning Applied to Diverse Materials Design Problems
Automated Machine Learning Applied to Diverse Materials Design ProblemsAutomated Machine Learning Applied to Diverse Materials Design Problems
Automated Machine Learning Applied to Diverse Materials Design ProblemsAnubhav Jain
 
theory of computation lecture 01
theory of computation lecture 01theory of computation lecture 01
theory of computation lecture 018threspecter
 
Sparse Isotropic Hashing
Sparse Isotropic HashingSparse Isotropic Hashing
Sparse Isotropic HashingIkuro Sato
 
Efficient evaluation of flatness error from Coordinate Measurement Data using...
Efficient evaluation of flatness error from Coordinate Measurement Data using...Efficient evaluation of flatness error from Coordinate Measurement Data using...
Efficient evaluation of flatness error from Coordinate Measurement Data using...Ali Shahed
 
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...gregoryg
 
A simulation based multi-objective design optimization of electronic packages...
A simulation based multi-objective design optimization of electronic packages...A simulation based multi-objective design optimization of electronic packages...
A simulation based multi-objective design optimization of electronic packages...Phuong Dx
 
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering AlgorithmIRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering AlgorithmIRJET Journal
 
A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...aimsnist
 

Similar to upload test (20)

Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...Software tools, crystal descriptors, and machine learning applied to material...
Software tools, crystal descriptors, and machine learning applied to material...
 
Accelerated life testing
Accelerated life testingAccelerated life testing
Accelerated life testing
 
Srikanta Mishra
Srikanta MishraSrikanta Mishra
Srikanta Mishra
 
Vldb14
Vldb14Vldb14
Vldb14
 
Six Sigma Mechanical Tolerance Analysis 1
Six Sigma Mechanical Tolerance Analysis 1Six Sigma Mechanical Tolerance Analysis 1
Six Sigma Mechanical Tolerance Analysis 1
 
Staad pro
Staad proStaad pro
Staad pro
 
Big Data + Big Sim: Query Processing over Unstructured CFD Models
Big Data + Big Sim: Query Processing over Unstructured CFD ModelsBig Data + Big Sim: Query Processing over Unstructured CFD Models
Big Data + Big Sim: Query Processing over Unstructured CFD Models
 
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
Jorge Silva, Sr. Research Statistician Developer, SAS at MLconf ATL - 9/18/15
 
Chap 8. Optimization for training deep models
Chap 8. Optimization for training deep modelsChap 8. Optimization for training deep models
Chap 8. Optimization for training deep models
 
Hyperparameter optimization with approximate gradient
Hyperparameter optimization with approximate gradientHyperparameter optimization with approximate gradient
Hyperparameter optimization with approximate gradient
 
Automated Machine Learning Applied to Diverse Materials Design Problems
Automated Machine Learning Applied to Diverse Materials Design ProblemsAutomated Machine Learning Applied to Diverse Materials Design Problems
Automated Machine Learning Applied to Diverse Materials Design Problems
 
theory of computation lecture 01
theory of computation lecture 01theory of computation lecture 01
theory of computation lecture 01
 
Sparse Isotropic Hashing
Sparse Isotropic HashingSparse Isotropic Hashing
Sparse Isotropic Hashing
 
Real Time Geodemographics
Real Time GeodemographicsReal Time Geodemographics
Real Time Geodemographics
 
Licentiate Defense Slide
Licentiate Defense SlideLicentiate Defense Slide
Licentiate Defense Slide
 
Efficient evaluation of flatness error from Coordinate Measurement Data using...
Efficient evaluation of flatness error from Coordinate Measurement Data using...Efficient evaluation of flatness error from Coordinate Measurement Data using...
Efficient evaluation of flatness error from Coordinate Measurement Data using...
 
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
Multi-criteria Decision Analysis for Customization of Estimation by Analogy M...
 
A simulation based multi-objective design optimization of electronic packages...
A simulation based multi-objective design optimization of electronic packages...A simulation based multi-objective design optimization of electronic packages...
A simulation based multi-objective design optimization of electronic packages...
 
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering AlgorithmIRJET- Review of Existing Methods in K-Means Clustering Algorithm
IRJET- Review of Existing Methods in K-Means Clustering Algorithm
 
A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...A Framework and Infrastructure for Uncertainty Quantification and Management ...
A Framework and Infrastructure for Uncertainty Quantification and Management ...
 

More from sahilsahoo85 (20)

sigproc-sp.pdf
sigproc-sp.pdfsigproc-sp.pdf
sigproc-sp.pdf
 
CHANGELOG.txt
CHANGELOG.txtCHANGELOG.txt
CHANGELOG.txt
 
testing_7.ppt
testing_7.ppttesting_7.ppt
testing_7.ppt
 
testing_6.ppt
testing_6.ppttesting_6.ppt
testing_6.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_5.ppt
testing_5.ppttesting_5.ppt
testing_5.ppt
 
testing_4.ppt
testing_4.ppttesting_4.ppt
testing_4.ppt
 
testing_3.ppt
testing_3.ppttesting_3.ppt
testing_3.ppt
 
testing_2.ppt
testing_2.ppttesting_2.ppt
testing_2.ppt
 
testing_1.ppt
testing_1.ppttesting_1.ppt
testing_1.ppt
 
testing_0.ppt
testing_0.ppttesting_0.ppt
testing_0.ppt
 
testing_0.ppt
testing_0.ppttesting_0.ppt
testing_0.ppt
 
questionnaries-theme.tpl_.php_.txt
questionnaries-theme.tpl_.php_.txtquestionnaries-theme.tpl_.php_.txt
questionnaries-theme.tpl_.php_.txt
 
ccccccc.ppt
ccccccc.pptccccccc.ppt
ccccccc.ppt
 
testing.ppt
testing.ppttesting.ppt
testing.ppt
 
testing_0.ppt
testing_0.ppttesting_0.ppt
testing_0.ppt
 
upload test2
upload test2upload test2
upload test2
 

Recently uploaded

Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 

Recently uploaded (20)

Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 

upload test

  • 1. Copyright © 2008, SAS Institute Inc. All rights reserved. Practical Design for Discrete Choice Experiments Bradley Jones, SAS Institute August 13, 2008
  • 2. Copyright © 2008, SAS Institute Inc. All rights reserved. DEMA 2008, August 2008, Cambridge 2  Respondents indicate the alternative they prefer most in each choice set  Alternatives are called profiles  Each profile is a combination of attribute levels  Choice sets typically consist of two, three or four profiles Discrete Choice Experiment Setup
  • 3. Copyright © 2008, SAS Institute Inc. All rights reserved. Example: Marketing a new laptop computer Attributes Levels Hard Drive 40 GB 80 GB Speed 1.5 GHz 2.0 GHz Battery Life 4 hours6 hours Price $1,000 $1,200 $1,500 DEMA 2008, August 2008, Cambridge 3
  • 4. Copyright © 2008, SAS Institute Inc. All rights reserved. Sample Choice Set Hard Disk Speed Battery Price 40Gig 1.5GHz 6hours $1,000 40Gig 2.0GHz 4hours $1,500 Check the box for the laptop you prefer. Profile 1 Profile 2 4DEMA 2008, August 2008, Cambridge
  • 5. Copyright © 2008, SAS Institute Inc. All rights reserved. 5 multinomial logit model based on the random utilities model where xjs represents the attribute levels and β is the set of parameter values probability of choosing alternative j in choice set s Statistical model ε′= +js js jsU xβ =1 option chosen in choice set js ts js J t j e p s e ′ ′   = ÷   ∑ xβ xβ DEMA 2008, August 2008, Cambridge
  • 6. Copyright © 2008, SAS Institute Inc. All rights reserved. D criterion - minimize the determinant of the variance matrix of the estimators: ( )( )1 det − M Xβ, Design optimality criterion DEMA 2008, August 2008, Cambridge 6 Equivalently – maximize the determinant of the information matrix, M.
  • 7. Copyright © 2008, SAS Institute Inc. All rights reserved. 7 Bayesian optimal designs: • construct a prior distribution for the parameters • find design that performs best on average • Sándor & Wedel (2001, 2002, 2005) Dependence on the unknown parameter, β ( ) ( ) ( ) ( )( ) 1 , S s s s s s s= ′ ′= −∑M Xβ X P β p β p β X DEMA 2008, August 2008, Cambridge
  • 8. Copyright © 2008, SAS Institute Inc. All rights reserved. Design for Nonlinear Models To design an informative experiment ….. You need to know something about the response function ….. And about the parameter values. 8DEMA 2008, August 2008, Cambridge
  • 9. Copyright © 2008, SAS Institute Inc. All rights reserved. Bayesian D-Optimal Design Bayesian ideas are natural to cope with the fact that the information matrix, M, depends on β. Chaloner and Larntz (1986) developed a Bayesian D- Optimality criterion: Φ(d) = ∫ log det [M(β;d)] p(β) dβ 9DEMA 2008, August 2008, Cambridge
  • 10. Copyright © 2008, SAS Institute Inc. All rights reserved. Computing Bayesian D-Optimal Designs A major impediment to Bayesian D-optimal design has been COMPUTATIONAL. The integral over β can be VERY SLOW. It must be computed MANY TIMES in the course of finding an optimal design. 10DEMA 2008, August 2008, Cambridge
  • 11. Copyright © 2008, SAS Institute Inc. All rights reserved. Bayesian Computations Gotwalt, Jones and Steinberg (2007) use a quadrature method, due to Mysovskikh. This method is guaranteed to exactly integrate all polynomials up to 5th degree and all odd-degree monomials. With p parameters, it requires just O(p2) function evaluations. 11DEMA 2008, August 2008, Cambridge
  • 12. Copyright © 2008, SAS Institute Inc. All rights reserved. Mysovskikh quadrature Assume a normal prior with independence. • Center the integral about the prior mean. • Scale each variable by its standard deviation. • Integrate over distance from the prior mean and, at each distance, over a spherical shell. 12DEMA 2008, August 2008, Cambridge
  • 13. Copyright © 2008, SAS Institute Inc. All rights reserved. Mysovskikh quadrature continued… Radial integral: Generalized Gauss-LaGuerre quadrature, with an extra point at the origin. Spherical integrals: The Mysovskikh quadrature scheme. 13DEMA 2008, August 2008, Cambridge
  • 14. Copyright © 2008, SAS Institute Inc. All rights reserved. Spherical integral A simplex, its edge midpoints on the sphere, and the inverses of all of these points. Simplex point weights: p(7-p)/2(p+1)2(p+2). Mid-point weights: 2(p-1)2/p(p+1)2(p+2). 14DEMA 2008, August 2008, Cambridge
  • 15. Copyright © 2008, SAS Institute Inc. All rights reserved. Simplex point Mid-point Each point is both a simplex point and a mid-point. All weights equal1/6. Quadrature points in two dimensions 15DEMA 2008, August 2008, Cambridge
  • 16. Copyright © 2008, SAS Institute Inc. All rights reserved. Study Description 16 Respondents – 8 developers 8 sales & marketing 9 Male 7 Female 2 Surveys with 6 choice sets in each Respondents were assigned randomly to surveys blocked by job function 16DEMA 2008, August 2008, Cambridge
  • 17. Copyright © 2008, SAS Institute Inc. All rights reserved. Software Demonstration 17DEMA 2008, August 2008, Cambridge
  • 18. Copyright © 2008, SAS Institute Inc. All rights reserved. Conclusions 1) Discrete Choice Conjoint Experiments require design methods for nonlinear models. 2) D-Optimal Bayesian designs reduce the dependence of the design on the unknown parameters. 3) New quadrature methods make computation of these designs much faster. 4) Commercial software makes carrying out such studies simple and efficient. 18DEMA 2008, August 2008, Cambridge
  • 19. Copyright © 2008, SAS Institute Inc. All rights reserved. References Atkinson, A. C. and Donev, A. N. (1992). Optimum Experimental Designs, Oxford U.K.: Clarendon Press. Cassity C.R., (1965) “Abscissas, Coefficients, and Error Term for the Generalized Gauss-Laguerre Quadrature Formula Using the Zero Ordinate,” Mathematics ofComputation, 19, 287-296. Chaloner, K. and Verdinelli, I. (1995). Bayesian experimental design: a re-view, Statistical Science 10: 273-304. Grossmann, H., Holling, H. and Schwabe, R. (2002). Advances in optimum experimental design for conjoint analysis and discrete choice models, in Advances in Econometrics, Econometric Models in Marketing, Vol. 16, Franses, P. H. and Montgomery, A. L., eds. Amsterdam: JAI Press, 93-117. Gotwalt, C., Jones, B. and Steinberg, D. (2009) Fast Computation of Designs Robust to Parameter Uncertainty for Nonlinear Settings accepted at Technometrics. Huber, J. and Zwerina, K. (1996). The importance of utility balance in efficient choice designs, Journal of Marketing Research 33: 307- 317. McFadden, D. (1974). Conditional logit analysis of qualitative choice behavior, in Frontiers in Econometrics, Zarembka, P., ed. New York: Academic Press, 105-142. Meyer, R. K. and Nachtsheim, C. J. (1995). The coordinate-exchange algorithm for constructing exact optimal experimental designs, Technometrics 37: 60-69. Monahan, J. and Genz, A. (1997). Spherical-radial integration rules for Bayesian computation, Journal of the American Statistical Association 92: 664-674. Sandor, Z. and Wedel, M. (2001). Designing conjoint choice experiments using managers' prior beliefs, Journal of Marketing Research 38: 430-444. 19DEMA 2008, August 2008, Cambridge