In this presentation, Prof. Dr. Christian Schlereth (Chair of Digital Marketing at WHU - Otto Beisheim School of Management) summarizes findings from his Management Science article (co-authored by Bernd Skiera, Goethe University Frankfurt) on the estimation of willingness to pay. He presents today’s use of data-collection methods to estimate willingness-to-pay. He also outlines three shortcomings with the estimation and proposes the new method separated adaptive dual response (SADR), which substantially improves the estimation of willingness-to-pay and overcomes these shortcomings.
Project Mangement - overview of the Procurement Management knowledge area within project management. Describes the 3 processes within Project Procurement Management and the process groups impacted.
Blog: https://agile-mercurial.com
YouTube: https://www.youtube.com/channel/UCPM82of2YuqIR1SgLGHa1eg
Twitter: https://twitter.com/agile_mercurial
Tumblr: https://agilemercurial.tumblr.com/
There are many concerns when facing quality management within organizations and big companies. There are always high risks in the supply chain. Furthermore, there are risks with internal infrastructure and the value chains (from distribution to retail to the consumer).
Flowchart to assist in evaluating nonconformance to be elevated to a CAPA ( Corrective Action Preventive Action).
FDA requires from their regulated industry to eliminate or reduce risk to the public. In the high risk industry such as Pharmaceuticals and Medical Devices any major nonconformance or customer complaints must be evaluated and if necessary investigated to identify the root cause, place an effective solution to eliminate or reduce risk for the public.
Decision Making Using the Analytic Hierarchy Process (AHP); A Step by Step A...Hamed Taherdoost
Analytical Hierarchy Process is one of the most inclusive system which is considered to make decisions with multiple criteria because this method gives to formulate the problem as a hierarchical and believe a mixture of quantitative and qualitative criteria as well. This presentation summarizes the process of conducting Analytical Hierarchy Process (AHP).
Project Mangement - overview of the Procurement Management knowledge area within project management. Describes the 3 processes within Project Procurement Management and the process groups impacted.
Blog: https://agile-mercurial.com
YouTube: https://www.youtube.com/channel/UCPM82of2YuqIR1SgLGHa1eg
Twitter: https://twitter.com/agile_mercurial
Tumblr: https://agilemercurial.tumblr.com/
There are many concerns when facing quality management within organizations and big companies. There are always high risks in the supply chain. Furthermore, there are risks with internal infrastructure and the value chains (from distribution to retail to the consumer).
Flowchart to assist in evaluating nonconformance to be elevated to a CAPA ( Corrective Action Preventive Action).
FDA requires from their regulated industry to eliminate or reduce risk to the public. In the high risk industry such as Pharmaceuticals and Medical Devices any major nonconformance or customer complaints must be evaluated and if necessary investigated to identify the root cause, place an effective solution to eliminate or reduce risk for the public.
Decision Making Using the Analytic Hierarchy Process (AHP); A Step by Step A...Hamed Taherdoost
Analytical Hierarchy Process is one of the most inclusive system which is considered to make decisions with multiple criteria because this method gives to formulate the problem as a hierarchical and believe a mixture of quantitative and qualitative criteria as well. This presentation summarizes the process of conducting Analytical Hierarchy Process (AHP).
Survey Methodology and Questionnaire Design Theory Part IQualtrics
Do you know what's going on in your respondents' heads as they take your survey? How can you design your questionnaire to collect better data? Understanding the answers to these questions can help you design surveys that collect high quality insights you can depend on.
Dave Vannette, principal research scientist at Qualtrics, shares his best hacks for designing surveys that will help you get quality data. In this presentation, Dave also highlights what your respondents are thinking when they take your surveys, and how your survey design can affect the responses you collect.
Project describes the use of Analytic hierarchy process (AHP) by taking bollywood songs of different era and finding the best song out of the listed options based on different parameters.
CBC versus ACBC (empirical findings, recommendations and best practices)Salah Ben Slamia
This presentation provides an overview of the main differences between the CBC and ACBC conjoint analysis in terms of implementation and practical issues.
Most research in economics studies agents somehow motivated by outcomes. Here, we study agents motivated by procedures instead, where procedures are de ned independently of an outcome. To that end, we design procedures which yield the same expected outcomes or carry the same information on others' intentions while they have di erent outcome-invariant properties. Agents are experimentally con rmed to exhibit preferences over these which link to psychological attributes of their moral judgment.
Identify each of the following as examples of nominal, ordinal, inte.docxscuttsginette
Identify each of the following as examples of nominal, ordinal, interval, or ratio scales of measurement. (4 points each)
A poll of registered voters in Florida asking which candidate they support
The length of time required for a wound to heal when using a new medicine
The number of telephone calls arriving at a switchboard per five-minute period
The distance first-year college football players can kick a ball
Mental health diagnoses present in an elderly population
The rankings of employees on their job performance
(Points : 24)
Question 2.
2.
Two hundred raffle tickets are sold. Your friend has five people in her family who each bought two raffle tickets. What is the probability that someone from her family will win the raffle?
(Points : 4)
Question 3.
3.
Jolie has 45 minutes to do her statistics homework. If the mean is 38 minutes and the standard deviation is 3, calculate Jolie's z score. Once calculated, interpret your findings in terms of Jolie's performance.
(
HINT:
use the normal distribution and the probability that other students performed better or worse.) (Points : 8)
Question 4.
4.
A psychologist measures units of change for a memory test after students are given an opportunity to sleep only four hours. The following change units were obtained: 7, -12, 4, -7, 3, -10. Find the a) mean, b) median, c) mode, d) standard deviation, e) range, and f) variance. (Points : 24)
Question 5.
5.
A student scored 81 on a chemistry test and 75 on a history test. For the chemistry test, the mean was 70 and the standard deviation was 20. For the history test, the mean was 65 and the standard deviation was 8. Did the student do better on the chemistry test or the history test? Explain your answer. (Points : 12)
Question 6.
6.
Suppose you want to figure out what to do with your degree in psychology. You ask some fellow students from your psychology program who recently graduated to find out what they are doing with their degree and how much it pays. What type of sampling is this? What are the limitations of this sampling approach? (Points : 8)
Question 7.
7.
Variables in which the values are categories are known as (Points : 4)
Interval variables
Nominal variables
Ordinal variables
Ratio variables
Question 8.
8.
Before the researcher can conduct a statistical test, the research question must be translated into (Points : 4)
A testable hypothesis
Additional observations
Mathematical symbols
Numbers
Question 9.
9.
The hypothesis stating that there are no differences, effects, or relationships is (Points : 4)
The alternative hypothesis
The baseline hypothesis
The null hypothesis
The reasonable hypothesis
Question 10.
10.
A group of students made the following scores on a 10-item quiz in psychological statistics: {5, 6, 7, 7, 7, 8, 8, 9, 9, 10, 10} What is the mean score? (Points : 4)
6.6.
Decision Tree Analysis for statistical tool. The deck provides understanding on the Decision Analysis.
It provides practical application and limited theory. Will be useful for MBA students.
Dr Con Menictas and Brian Fine present 'Exclusive Research How to Successfull...Brittany Ferdinands
Dr Con Menictas and Brian Fine present 'Exclusive Research How to Successfully Market Products and Services In Times of Economic Instability' at Mumbrella360 2022.
Survey Methodology and Questionnaire Design Theory Part IQualtrics
Do you know what's going on in your respondents' heads as they take your survey? How can you design your questionnaire to collect better data? Understanding the answers to these questions can help you design surveys that collect high quality insights you can depend on.
Dave Vannette, principal research scientist at Qualtrics, shares his best hacks for designing surveys that will help you get quality data. In this presentation, Dave also highlights what your respondents are thinking when they take your surveys, and how your survey design can affect the responses you collect.
Project describes the use of Analytic hierarchy process (AHP) by taking bollywood songs of different era and finding the best song out of the listed options based on different parameters.
CBC versus ACBC (empirical findings, recommendations and best practices)Salah Ben Slamia
This presentation provides an overview of the main differences between the CBC and ACBC conjoint analysis in terms of implementation and practical issues.
Most research in economics studies agents somehow motivated by outcomes. Here, we study agents motivated by procedures instead, where procedures are de ned independently of an outcome. To that end, we design procedures which yield the same expected outcomes or carry the same information on others' intentions while they have di erent outcome-invariant properties. Agents are experimentally con rmed to exhibit preferences over these which link to psychological attributes of their moral judgment.
Identify each of the following as examples of nominal, ordinal, inte.docxscuttsginette
Identify each of the following as examples of nominal, ordinal, interval, or ratio scales of measurement. (4 points each)
A poll of registered voters in Florida asking which candidate they support
The length of time required for a wound to heal when using a new medicine
The number of telephone calls arriving at a switchboard per five-minute period
The distance first-year college football players can kick a ball
Mental health diagnoses present in an elderly population
The rankings of employees on their job performance
(Points : 24)
Question 2.
2.
Two hundred raffle tickets are sold. Your friend has five people in her family who each bought two raffle tickets. What is the probability that someone from her family will win the raffle?
(Points : 4)
Question 3.
3.
Jolie has 45 minutes to do her statistics homework. If the mean is 38 minutes and the standard deviation is 3, calculate Jolie's z score. Once calculated, interpret your findings in terms of Jolie's performance.
(
HINT:
use the normal distribution and the probability that other students performed better or worse.) (Points : 8)
Question 4.
4.
A psychologist measures units of change for a memory test after students are given an opportunity to sleep only four hours. The following change units were obtained: 7, -12, 4, -7, 3, -10. Find the a) mean, b) median, c) mode, d) standard deviation, e) range, and f) variance. (Points : 24)
Question 5.
5.
A student scored 81 on a chemistry test and 75 on a history test. For the chemistry test, the mean was 70 and the standard deviation was 20. For the history test, the mean was 65 and the standard deviation was 8. Did the student do better on the chemistry test or the history test? Explain your answer. (Points : 12)
Question 6.
6.
Suppose you want to figure out what to do with your degree in psychology. You ask some fellow students from your psychology program who recently graduated to find out what they are doing with their degree and how much it pays. What type of sampling is this? What are the limitations of this sampling approach? (Points : 8)
Question 7.
7.
Variables in which the values are categories are known as (Points : 4)
Interval variables
Nominal variables
Ordinal variables
Ratio variables
Question 8.
8.
Before the researcher can conduct a statistical test, the research question must be translated into (Points : 4)
A testable hypothesis
Additional observations
Mathematical symbols
Numbers
Question 9.
9.
The hypothesis stating that there are no differences, effects, or relationships is (Points : 4)
The alternative hypothesis
The baseline hypothesis
The null hypothesis
The reasonable hypothesis
Question 10.
10.
A group of students made the following scores on a 10-item quiz in psychological statistics: {5, 6, 7, 7, 7, 8, 8, 9, 9, 10, 10} What is the mean score? (Points : 4)
6.6.
Decision Tree Analysis for statistical tool. The deck provides understanding on the Decision Analysis.
It provides practical application and limited theory. Will be useful for MBA students.
Dr Con Menictas and Brian Fine present 'Exclusive Research How to Successfull...Brittany Ferdinands
Dr Con Menictas and Brian Fine present 'Exclusive Research How to Successfully Market Products and Services In Times of Economic Instability' at Mumbrella360 2022.
Preference and Desirability Testing: Measuring Emotional Response to Guide De...Paul Doncaster
(From UPA 2011-Atlanta) Usability practitioners have a variety of methods and techniques to inform interaction design and identify usability problems. However, these tools are not as effective at evaluating the visceral and emotional response generated by visual design and aesthetics. This presentation will discuss why studying visual design is important, review considerations for preference and desirability testing and present two alternative approaches to user studies of visual designs in the form of case studies.
1. What type of research uses numeric measurement data (Points .docxjackiewalcutt
1. What type of research uses numeric measurement data? (Points : 3)
2. What type of research uses a research hypothesis? (Points : 3)
3. What type of research does not use statistical data analysis? (Points : 3)
4. What type of research preempts all other types of research endeavors? (Points : 3)
5. Business research is a type of ________________ inquiry. (Points : 3)
6. What are the three main types of non-probability sampling used in business research? (Points : 3)
7. In a situation where in a confidence level .01 what percent of the measurement results are left to chance? (Points : 3)
8. What is the most important ingredient in a statistical testing procedure? (Points : 3)
9. If a production manager wanted to determine whether or not the first shift was processing more widgets than the second shift, what type of statistical process would be used? (Points : 3)
10. What type of t test seeks to determine whether or not a relationship exists in one sample over two conditions? _______________ (Points : 3)
11.
Which of the examples below represent the Ratio level of scaling?
A) A high temperature of 83 degrees Fahrenheit
B) A survey result that 24 students work full time, 36, part time.
C) Bill is consistently rated most effective communicator of his group.
D) Gallup says that 60% of the voters support the incumbent.
E) Pick up three pounds of ground beef please.
F) Patty acts as expected based on her first-born family position.
G) Seattle at an altitude of 67 feet is higher than Death Valley at an altitude of – 120.
H) The door is 37 inches wide, the door frame is 36 inches wide.
(Points : 3)
B, C and F
D, E and G
C, F and H
A, E and H
12. Select those issues that only relate to selecting a specific statistical test. (Do not select items common to all tests or not applying to statistical tests.) (Points : 3)
The distribution (shape) of the population (e.g., normal, skewed, flat, etc.)
The measurement scale/nature of the data being evaluated (nominal, ordinal, interval or ratio)
The size of the population (assuming it is much larger than any samples)
The level of significance (_) you wish to place on the test results
Whether you have matched/related or unmatched/unrelated samples
The degrees of freedom (sample size) associated with your sample(s)
The statement of the null and research hypotheses
Whether the sample was stratified or not
13.
Which of the following apply to Populations?
A) parameter
B) “Roman” letters, i.e.: x, s
C) A bounded, defined complete group (people, objects, etc.) having something in common to be described in its totality
D) “Greek” letters, i.e.: μ, σ
E) One or more subsets of a larger defined group, used to represent the larger group
F) 170 Republicans selected randomly from King County voter records
G) All Democrats in the state of Washington (totality)
(Points : 3)
A, B, ...
MAT 510 Effective Communication - tutorialrank.comBartholomew46
For more course tutorials visit
www.tutorialrank.com
MAT 510 Final Exam Set 1
Question 1
Improvement is needed for an organization to survive because:
Question 2
For more course tutorials visit
www.newtonhelp.com
MAT 510 Final Exam Set 1
Question 1
Improvement is needed for an organization to survive because:
Question 2
The Statistical Thinking Strategy has significant commonality with the scientific method. Which of the following statistical thinking principles is NOT generally associated with the scientific method?
Question 3
Similar to Measuring willingness to pay with our new method separated adaptive dual response (SADR) (20)
This presentation explores a brief idea about the structural and functional attributes of nucleotides, the structure and function of genetic materials along with the impact of UV rays and pH upon them.
Phenomics assisted breeding in crop improvementIshaGoswami9
As the population is increasing and will reach about 9 billion upto 2050. Also due to climate change, it is difficult to meet the food requirement of such a large population. Facing the challenges presented by resource shortages, climate
change, and increasing global population, crop yield and quality need to be improved in a sustainable way over the coming decades. Genetic improvement by breeding is the best way to increase crop productivity. With the rapid progression of functional
genomics, an increasing number of crop genomes have been sequenced and dozens of genes influencing key agronomic traits have been identified. However, current genome sequence information has not been adequately exploited for understanding
the complex characteristics of multiple gene, owing to a lack of crop phenotypic data. Efficient, automatic, and accurate technologies and platforms that can capture phenotypic data that can
be linked to genomics information for crop improvement at all growth stages have become as important as genotyping. Thus,
high-throughput phenotyping has become the major bottleneck restricting crop breeding. Plant phenomics has been defined as the high-throughput, accurate acquisition and analysis of multi-dimensional phenotypes
during crop growing stages at the organism level, including the cell, tissue, organ, individual plant, plot, and field levels. With the rapid development of novel sensors, imaging technology,
and analysis methods, numerous infrastructure platforms have been developed for phenotyping.
Seminar of U.V. Spectroscopy by SAMIR PANDASAMIR PANDA
Spectroscopy is a branch of science dealing the study of interaction of electromagnetic radiation with matter.
Ultraviolet-visible spectroscopy refers to absorption spectroscopy or reflect spectroscopy in the UV-VIS spectral region.
Ultraviolet-visible spectroscopy is an analytical method that can measure the amount of light received by the analyte.
DERIVATION OF MODIFIED BERNOULLI EQUATION WITH VISCOUS EFFECTS AND TERMINAL V...Wasswaderrick3
In this book, we use conservation of energy techniques on a fluid element to derive the Modified Bernoulli equation of flow with viscous or friction effects. We derive the general equation of flow/ velocity and then from this we derive the Pouiselle flow equation, the transition flow equation and the turbulent flow equation. In the situations where there are no viscous effects , the equation reduces to the Bernoulli equation. From experimental results, we are able to include other terms in the Bernoulli equation. We also look at cases where pressure gradients exist. We use the Modified Bernoulli equation to derive equations of flow rate for pipes of different cross sectional areas connected together. We also extend our techniques of energy conservation to a sphere falling in a viscous medium under the effect of gravity. We demonstrate Stokes equation of terminal velocity and turbulent flow equation. We look at a way of calculating the time taken for a body to fall in a viscous medium. We also look at the general equation of terminal velocity.
Richard's aventures in two entangled wonderlandsRichard Gill
Since the loophole-free Bell experiments of 2020 and the Nobel prizes in physics of 2022, critics of Bell's work have retreated to the fortress of super-determinism. Now, super-determinism is a derogatory word - it just means "determinism". Palmer, Hance and Hossenfelder argue that quantum mechanics and determinism are not incompatible, using a sophisticated mathematical construction based on a subtle thinning of allowed states and measurements in quantum mechanics, such that what is left appears to make Bell's argument fail, without altering the empirical predictions of quantum mechanics. I think however that it is a smoke screen, and the slogan "lost in math" comes to my mind. I will discuss some other recent disproofs of Bell's theorem using the language of causality based on causal graphs. Causal thinking is also central to law and justice. I will mention surprising connections to my work on serial killer nurse cases, in particular the Dutch case of Lucia de Berk and the current UK case of Lucy Letby.
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...University of Maribor
Slides from talk:
Aleš Zamuda: Remote Sensing and Computational, Evolutionary, Supercomputing, and Intelligent Systems.
11th International Conference on Electrical, Electronics and Computer Engineering (IcETRAN), Niš, 3-6 June 2024
Inter-Society Networking Panel GRSS/MTT-S/CIS Panel Session: Promoting Connection and Cooperation
https://www.etran.rs/2024/en/home-english/
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...University of Maribor
Slides from:
11th International Conference on Electrical, Electronics and Computer Engineering (IcETRAN), Niš, 3-6 June 2024
Track: Artificial Intelligence
https://www.etran.rs/2024/en/home-english/
Salas, V. (2024) "John of St. Thomas (Poinsot) on the Science of Sacred Theol...Studia Poinsotiana
I Introduction
II Subalternation and Theology
III Theology and Dogmatic Declarations
IV The Mixed Principles of Theology
V Virtual Revelation: The Unity of Theology
VI Theology as a Natural Science
VII Theology’s Certitude
VIII Conclusion
Notes
Bibliography
All the contents are fully attributable to the author, Doctor Victor Salas. Should you wish to get this text republished, get in touch with the author or the editorial committee of the Studia Poinsotiana. Insofar as possible, we will be happy to broker your contact.
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...Sérgio Sacani
We characterize the earliest galaxy population in the JADES Origins Field (JOF), the deepest
imaging field observed with JWST. We make use of the ancillary Hubble optical images (5 filters
spanning 0.4−0.9µm) and novel JWST images with 14 filters spanning 0.8−5µm, including 7 mediumband filters, and reaching total exposure times of up to 46 hours per filter. We combine all our data
at > 2.3µm to construct an ultradeep image, reaching as deep as ≈ 31.4 AB mag in the stack and
30.3-31.0 AB mag (5σ, r = 0.1” circular aperture) in individual filters. We measure photometric
redshifts and use robust selection criteria to identify a sample of eight galaxy candidates at redshifts
z = 11.5 − 15. These objects show compact half-light radii of R1/2 ∼ 50 − 200pc, stellar masses of
M⋆ ∼ 107−108M⊙, and star-formation rates of SFR ∼ 0.1−1 M⊙ yr−1
. Our search finds no candidates
at 15 < z < 20, placing upper limits at these redshifts. We develop a forward modeling approach to
infer the properties of the evolving luminosity function without binning in redshift or luminosity that
marginalizes over the photometric redshift uncertainty of our candidate galaxies and incorporates the
impact of non-detections. We find a z = 12 luminosity function in good agreement with prior results,
and that the luminosity function normalization and UV luminosity density decline by a factor of ∼ 2.5
from z = 12 to z = 14. We discuss the possible implications of our results in the context of theoretical
models for evolution of the dark matter halo mass function.
Earliest Galaxies in the JADES Origins Field: Luminosity Function and Cosmic ...
Measuring willingness to pay with our new method separated adaptive dual response (SADR)
1. Two New Features in Discrete Choice
Experiments to Improve Willingness to Pay
Estimation that Result in SDR and SADR:
Separated (Adaptive) Dual Response
Management Science (2017), 63(3), 829-842
Christian Schlereth
WHU – Otto Beisheim School of Management
Bernd Skiera
Goethe University Frankfurt
2. Carson et al. (1994); Dhar (1997); Louviere et al. (2000); Haaijer et al. (2001); Vermeulen et al. (2008)
Choice-based conjoint nowadays one of the most important method
to measure willingness to pay
A B C
Do not
purchase
any of the
three
Attribute 1
Attribute 2
Attribute 3
…
Choice-based conjoint
Free-choice questions only, i.e., each choice-sets contains a no-purchase option
No-purchase option provides:
- Clear reference point
- Realistic experimental setting
- Allows prediction of market penetration
2
3. Information gained when choosing a product
A B C
Do not
purchase
any of the
three
Attribute 1
Attribute 2
Attribute 3
…
Purchase decision Selection decision
B > 0
Product B provides sufficient utility for a
purchase
B > A; C
Choice-based conjoint
3
4. Information gained when choosing no-purchase option
A B C
Do not
purchase
any of the
three
Attribute 1
Attribute 2
Attribute 3
…
Not enough data to learn about individual preferences
Purchase decision Selection decision
0 > A; B; C
None of the products provide sufficient utility
for a purchase
No information about relative attractiveness
of attributes
Choice-based conjoint
4
5. Dual response: Selection decisions are also observed when no-
purchase option is chosen
Dual ResponseA B C
Attribute 1
Attribute 2
Attribute 3
…
Purchase most preferred
Do not purchase most
preferred
Forced choice question
Free choice question
Purchase decision Selection decision
0 > A; B; C
From free choice question From forced choice question
Selection decision is always observable; thus: more accurate estimation of preferences
But higher cognitive effort for a respondent due to double amount of questions
B > A; C
Dhar & Simonson (2003); Dhar & Nowlis (2004); Brazell et al. (2006)
Dual response
5
6. Shortcoming: Context effects in choice-based conjoint
Examples:
Attraction Effect:
No-purchase option is chosen less frequently, if a dominant product alternative exists
Similarity Effect:
No-purchase option is chosen more frequently, if similar attractive product alternatives exists, as an “easy way out”
Huber, Payne, and Puto (1982); Tversky and Shafir (1992); Dhar (1997); Rooderkerk, Van Heerde, and Bijmolt (2011);
A B C
Do not
purchase
any of the
three
Attribute 1
Attribute 2
Attribute 3
…
6
• Whether products provide sufficient utility for a purchase is not the only reason for a respondent
to pick the no-purchase option
• Context effects typically neglected in estimation
7. Shortcoming: Context effects in dual response
Other empirical findings
- Higher share of chosen no-purchase option (Dhar and Simonson 2003; Dhar and Nowlis 2004; Brazell et al.
2006)
- Artificial time delay between selection decisions and purchase decisions reduces no-purchase share
(Dhar and Simonson 2003)
A B C
Attribute 1
Attribute 2
Attribute 3
…
Purchase most
preferred
Do not purchase
most preferred
7
• Context effects also exist for dual response
• As a result, willingness to pay estimates are substantially lower compared to choice-based conjoint
8. Shortcoming: Extreme response behavior
Extreme response behavior (Gensler et al. 2012)
• Respondent always chooses no-purchase option
• No information when respondent will start buying
• WTP might be estimated too low
• Respondent never chooses no-purchase option
• No information, when respondent will stop buying
• WTP might be estimated too high
Extreme response behavior in previous studies (if reported) :
Choice-Based Conjoint
• 58% in Gensler et al. (2012)
• 64% in Parker and Schrift (2011)
• 22% in Wlömert and Eggers (2014)
• Up to 56% in our studies
Dual Response
• 31% in Wlömert and Eggers (2014)
• Up to 36% in our studies
8
9. Shortcoming: Impact of purchase probability on measurement accuracy
9
Implication: Companies estimate willingness to pay more accurately for a respondent who
does not intend to buy their product
If a choice-set contains more than one alternative, likelihood increases that a respondent
compares a rather attractive alternative against the no-purchase option purchase
decisions are less informative for a respondent with high purchase probability
10. Aims of paper
Development of SDR: “Separated Dual Response“, which
1. Avoids context effects by imposing a strict separation between all forced and free choice questions
Development of SADR: “Separated (Adaptive) Dual Response“, which also
2. Avoids extreme response behavior
by imposing a strict separation between all forced and free choice questions
through an adaptive mechanism that captures heterogeneity in willingness to pay
3. Ensures similar accuracy in measured willingness to pay, independent of a respondent‘s purchase probability
10
11. Agenda
11
Mechanism of SDR and SADR
Simulation study to analyze
dependence between willingness to pay accuracy
and purchase probability
Tests of statistical and behavioral endogeneity
Insights from three empirical studies
12. SADR (Separated Adaptive Dual Response):
In addition to feature 1 („strict separation“), we use
decisions in forced choice questions to adaptively
identify fewer, but more informative free choice
questions
Two new features for discrete choice experiments
resulting in SDR and SADR
12
Feature 1:
Strictly separating forced and
free choice questions
Feature 2:
Adaptive mechanism to select fewer, but more
informative, free choice questions
SDR (Separated Dual Response):
We ask all forced choice questions first and then all
free choice questions. Thus, we introduce a time
delay between a forced and a free choice question
Separated Dual
Response
(SDR)
...
A1 B1 C1
Buy
Selected1
Do not
buy
A2 B2 C2
Buy
Selected2
Do not
buy
...
Separated Adaptive Dual
Response
(SADR)
...
A1 B1 C1
Buy A 1
Do not
buy
A2 B2 C2
Buy A 2
Do not
buy
...
13. Adaptive mechanism of SADR – Separated Adaptive Dual Response
13
Information
gap
1. Forced choice block
Use efficient choice design for all respondents (e.g. D-optimal)
Use linear probability model to approximate individual preference order
(Heckman & Snyder 1997)
Simulate preference order of all products in full factorial design
2. Free choice block
"Smartly“ select n products for inclusion in purchase questions
Use binary logit model to select next area, which provides most information
about purchase decision making
Iterate m times
Select A, Select B, Select C
Select A, Select B, Select C
…
SADR
Purchase Presented, Purchase None
…
Estimate preliminary preference order
Most preferred productLeast preferred product 75%50%25%
Preference order
0% (= No Purchase)
Probability of a purchase
100% (= Purchase)
14. A respondent‘s perspective - screenshots of SADR
Forced Choice Block:
(“pick one of the products“)
j forced choice questions
A1 B1 C1
A2 B2 C2
...
A3 B3 C3
A4 B4 C4
A5 B5 C5
Free Choice Block:
(“buy or not buy product“)
Block 1 of n free choice questions
Buy D1' Do not buy D1'
Buy D2' Do not buy D2'
Buy ... Do not buy ...
Buy ... Do not buy ...
...
Block 2 of n free choice questions
14
15. Summary of studied discrete choice experiments
15
Choice-Based Conjoint
(CBC)
Dual Response
(DR)
Separated Dual
Response
(SDR)
Separated Adaptive Dual
Response
(SADR)
A1 B1 C1
Do not
buy
A1 B1 C1
...
Buy
Selected1
Do not
buyA2 B2 C2
Do not
buy
A2 B2 C2
Buy
Selected2
Do not
buy
...
A1 B1 C1
Buy
Selected1
Do not
buy
A2 B2 C2
Buy
Selected2
Do not
buy
...
...
A1 B1 C1
Buy A 1
Do not
buy
A2 B2 C2
Buy A 2
Do not
buy
...
Mechanism
Shortcomings
Context effects
Extreme response
behavior
Impact of purchase probability
on accuracy of WTP
X
X
X
X
X
X
X
X
-- --
--
--
16. Estimation
Scale-extended model
DR-2Max-model (Diener, Orme, and Yardley 2006)
Extended to account for differences in consistency between selection and
purchase decisions (Swait and Andrews 2003)
Force choice questions Free choice questions
Estimation
Multinomial logit model using Hierarchical Bayes
All models implemented in Matlab
A B C
Attribute 1
Attribute 2
Attribute 3
…
Buy product D
Do not buy product D
A B C
Attribute 1
Attribute 2
Attribute 3
…
A B C
Attribute 1
Attribute 2
Attribute 3
…
Buy product D
Do not buy product D
Buy product D
Do not buy product D
h,i,j
h,i ',j'
j j'
d
d
1 h,i 2 h,i'
h
j J i C j' J' i' C 2 0 2 h,i'1 h,j
J
exp V exp V
L
exp V exp Vexp V
16
17. Agenda
17
Mechanism of SDR and SADR
Simulation study to analyze
dependence between willingness to pay
accuracy and purchase probability
Tests of statistical and behavioral endogeneity
Insights from three empirical studies
18. Monte carlo simulation study
18
Set-up based on:
18 choice sets with
4 attributes and
4 levels each
Setup similar to:
• Aurora and Huber (2001)
• Toubia et al. (2004)
Experimental Conditions Number of Levels Values
Types of Discrete Choice
Experiments
7
Choice-Based Conjoint ( 0 separate free choice questions)
Dual response, SDR (18 separate free choice questions)
SADR [m=1, n=9] ( 9 separate free choice questions)
SADR [m=9, n=1] ( 9 separate free choice questions)
SADR [m=3, n=3] ( 9 separate free choice questions)
SADR [m=2, n=2] ( 4 separate free choice questions)
SADR [m=4, n=4] (16 separate free choice questions)
4
4
5
6
7
2
= .5 (low accuracy)
= 3 (high accuracy)
2
σ² = .5 (low heterogeneity)
σ² = 3 (high heterogeneity)
3
γ = .6 (low: ~10% no-purchase decisions)
γ = -.8 (medium: ~30% no-purchase decisions)
γ = -1.75 (high: ~50% no-purchase decisions)
Number of conditions 4 ∙ 2 ∙ 2 ∙ 3 = 48
Number of types of discrete
choice experiments
7
Number of replications 5
Total number of studies 48 ∙ 7 ∙5 = 1,680
Notes: 100 respondents; SADR = separated adaptive dual response; m = number of iterations in free choice block of SADR,
each of which consists of n free choice questions.
19. Comparison of ability to recover constant in utility function
19
Purchase
Probability
Share of No-
Purchases
Choice-
Based
Conjoint
Dual
Response &
SDR
SADR
[m=1,n=9] [m=9,n=1] [m=3,n=3] [m=2,n=2] [m=4,n=4]
LOW HIGH .56 .58 .71 .70 .70 .83 .61
MIDDLE MIDDLE .63 .68 .73 .71 .72 .85 .62
HIGH LOW .82 .89 .74 .72 .73 .86 .63
Mean .67 .72 .73 .71 .72 .85 .62
Notes: RMSE = root mean squared error; lower values indicate better ability. SDR = separated dual response; SADR= separated adaptive dual response; m =
number of iterations in free choice block, each of which consists of n free choice questions.
• Ability to recover constant in utility function (RMSE)
• serves to predict the error of the probability that a respondent will buy a product or not
• varies with purchase probability for choice-based conjoint and dual response, but not for
SADR
20. Agenda
20
Mechanism of SDR and SADR
Simulation study to analyze
dependence between willingness to pay accuracy
and purchase probability
Tests of statistical and behavioral endogeneity
Insights from three empirical studies
21. Examination of endogeneity
Violation of assumption of independence of
choices, because design of free choice
questions depend upon previous choices and
therefore on realizations of error term
Hauser and Toubia (2005); Liu, Otter, and Allenby
(2007)
Statistical Perspective Behavioral Perspective
Adaptive nature of free choice questions might
affects a respondent’s choices and cause
anchoring or framing effects
DeShazo (2002); Alberini, Kanninen, and Carson (1997);
Hanemann, Loomis, and Kanninen (1991)
Xforced choices
β, σ²
Forced Choice Block Free Choice Block
Yforced choices Xfree choices Yfree choices
Examined using approach of
Alberini, Kanninen, and Carson (1997)
Examined using approach of
Liu, Otter, and Allenby‘s (2007)
21
22. 0 500 1000 1500 2000 2500 3000 3500 4000 4500 5000
-2.6
-2.4
-2.2
0 500 1000 1500 2000 2500 3000 3500 4000 4500 5000
-2.6
-2.4
-2.2
SADR with adaptive design
SADR with fixed design
MCMC iteration
MCMC iteration
EstimateofconstantEstimateofconstant
Statistical concerns of endogeneity can be ignored
Mechanism of creating Xfree choice can be ignored if (Liu, Otter, and Allenby‘2007):
• estimation method adheres to likelihood principle
• Xfree choice does not contain information that is beyond Yforced choice and Yfree choice
Demonstration
• Comparison of recovery accuracy of SADR with
adaptive free choice question design and a
fixed (D-optimal) design
• 18 Choice-Sets, 44-design, 16 free choice
questions
• Sampled parameter values of 1000 consumers
drawn from normal distribution
• Mean (StdDev) of constant: -2.40 (2.45)
-2.40 (1.98)
-2.43 (1.93)
22
23. Behavioral concerns of endogeneity can be ignored
Indications of behavioral concerns of endogeneity, studied in the double bounded dichotomous
choice literature
Downward shift in WTP through follow-up free choice questions (e.g., from $250 to $150)
See further Alberini, Kanninen, and Carson (1997), Hanemann, Loomis, and Kanninen (1991), and McFadden and Leonard (1995)
Recommendations to avoid behavioral endogeneity
Well-balanced, symmetric designs result in very modest bias, even if anchoring is strong (Veronesi, Alberini, and Cooper
2011)
Testing for structural shifts in WTP by estimating additional term δ·ln(pos∙) in utility function (Alberini, Kanninen, and Carson
1997)
Applying Alberini, Kanninen, and Carson’s (1997) test in our empirical studies detects no structural
shift in WTP for later free choice questions
23
24. Agenda
24
Mechanism of SDR and SADR
Simulation study to analyze
dependence between willingness to pay accuracy
and purchase probability
Tests of statistical and behavioral endogeneity
Insights from three empirical studies
25. Description of three empirical studies to compare (SDR and) SADR
against choice-based conjoint and dual response
Study 2:
Basketball tickets
• N = 880 (customers of market leader)
• 52·4·3·2 Balanced Design
Study 1:
Tablets
• N = 459 (fans of a major league
basketball team)
• 43 Balanced Design
Choice-
Based
Conjoint
Dual
Response
SADR
Force Choice
Questions
-- 18 18
Free Choice
Questions
18 18 9
Study 3:
Video-on-demand
Choice-
Based
Conjoint
Dual
Response
SADR
Force Choice
Questions
-- 12 12
Free Choice
Questions
12 12 6
Choice-
Based
Conjoint
Dual
Response
SDR SADR
Force Choice
Questions
-- 12 12 12
Free Choice
Questions
12 12 12 6
• N = 1,425
• 4·32·23 Balanced Design
25
33. Comparison of demand functions against the one derived from self-
stated willingness to pay
33
Study 2: Basketball Tickets Study 3: Video-on-Demand
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
5 € 7 € 9 € 11 € 13 € 15 € 17 € 19 € 21 €
Shareofcustomerspurchasingatpricep
Price for the self-customized VoD plan
Choice-Based Conjoint
Dual Response
SADR
Directly stated
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
9 € 14 € 19 € 24 € 29 €
Shareofcustomerspurchasingatpricep
Price for the self-customized basketball ticket
Choice-Based Conjoint
Dual Response
SADR
Directly Stated
34. External validity
Study 2 – basketball tickets
Approach
• Comparison 1: Comparison of actual and predicted choice proportions in four ticket categories
in season before and after study
• Comparison 2: Comparison of actual and predicted number of viewers after price increase of 2 €
between seasons
NOTE: Price categories were sold out in only 8.09 % of all games
CBC Dual Response SADR
Choice proportions in four price categories N=160 N=146 N=153
RMSE season before study .099 .095 .059
RMSE season after study .102 .098 .061
Change in number of viewers after price increase
RMSE .041 .038 .034
34
35. External validity
Study 3 – video-on-demand
“with reference to external validity, (…) one should measure the attributes of real choice alternatives (e.g.,
real brands) faced by each subject and observe their reported (…) most recent choice” (Batsell and Louviere
1991)
Comparison of each subject’s self-reported answer, whether they previously purchased VoDs and how
much they paid for them on average.
Choice-Based Conjoint Dual Response SADR
N=267 N=308 N=305
stated ↔ predicted stated ↔ predicted stated ↔ predicted
Share of Paying Customers 67.04% ↔ 40.82% 67.86% ↔ 29.54% 69.18% ↔ 62.95%
RMSE 0.55 0.59 0.50
35
36. Summary
SDR and especially SADR with unique features to better measure willingness to pay
Unique feature of SDR & SADR:
Avoidance of context effects through strict separation of forced and free choice questions into two blocks
Unique additional features of SADR:
Avoidance of extreme response behavior through adaptive free choice questions
Independence between purchase probability and accuracy in measuring willingness to pay through selecting free
choice alternatives from the whole range of the preference order
Reduction of number of redundant purchase questions (about 20% less effort)
Empirical findings
SADR offers higher internal predictive, convergent, and external validity; large parts of increase in predictive validity
stem from the separation feature as implemented in SDR
SADR requires less cognitive effort than Dual Response, but respondents spend the same amount of time
Better "balanced“ and more informative decisions than in choice-based conjoint and dual response
36
37. Thank you for your attention!
Christian Schlereth
Chair of Digital Marketing
WHU – Otto Beisheim School of
Management
+49 (0) 261 6509 455
+49 (0) 261 6509 509
christian.schlereth@whu.edu
Bernd Skiera
Chair of Electronic Commerce
Department of Marketing
Goethe University Frankfurt
+49 (0) 69798 34649
+49 (0) 69798 35001
skiera@skiera.de
37
Demo: http://www.dise-online.net/demo.aspx
38. Implementation of SDR and SADR in DISE (Dynamic Intelligent Survey Engine)
Part 1: forced choice block
38
<predefinedPages markID="1003">
<cbc percentageStart="25" percentageEnd="60">
<choiceSetQuestion>Which of the tablets would you prefer most?</choiceSetQuestion>
<attributes>
<attribute>
<name>Brand and operating system</name>
<isNominal />
<levels>
<level><text>Apple (iOS)</text><baseValue>150</baseValue></level>
<level><text>Samsung (Android)</text><baseValue>50</baseValue></level>
<level><text>Smarttab (Android)</text><baseValue>0</baseValue></level>
</levels>
</attribute>
<attribute>
<name>Screen size</name>
<isNominal />
<levels>
<level><text>7 inch</text></level>
<level><text>10 inch</text></level>
</levels>
</attribute>
...
</attributes>
<cbcDesign>
1,1,1,2,2,4;
3,2,2,1,1,3;
...
</cbcDesign>
<configuration>
<noChoiceSetsPerPage>1</noChoiceSetsPerPage>
<noProductsPerChoiceSet>3</noProductsPerChoiceSet>
<hasNoChoice>false</hasNoChoice>
<noSortedCompleteFactorialDesign>false</noSortedCompleteFactorialDesign>
</configuration>
</cbc>
</predefinedPages>
Specify all attributes and levels
(here, a brand specific base price
is specified)
Include choice design
Specify number of alternatives
per choice set as well that choice
sets contain forced choice
questions, i.e., without a no-
purchase option
Assign ID “1003“ to forced choice
block
SDR & SADR – Separated (adaptive) dual response
Demo: http://www.dise-online.net/demo.aspx
39. Implementation of SDR and SADR in DISE (Dynamic Intelligent Survey Engine)
Part 2: free choice block
39
<predefinedPages>
<freeChoiceBlock percentageStart="65" percentageEnd="90">
<question>Would you actually buy the presented tablet?</question>
<configuration>
<cbcMarkID>1003</cbcMarkID>
<noAttributesInCbc>6</noAttributesInCbc>
<presentSelectedCbcProducts>true</presentSelectedCbcProducts>
</configuration>
</freeChoiceBlock>
</predefinedPages>
<predefinedPages>
<freeChoiceBlock percentageStart=“65“ percentageEnd="90">
<question>Would you actually buy the presented tablet?</question>
<configuration>
<cbcMarkID>1003</cbcMarkID>
<noAttributesInCbc>6</noAttributesInCbc>
<noQuestionsPerIteration>2</noQuestionsPerIteration>
<noIterations>3</noIterations>
</configuration>
</freeChoiceBlock>
</predefinedPages>
SDR – Separated dual response
SADR – Separated adaptive dual response
Create link to forced choice block
Use mechanism that just shows
the chosen alternatives from
forced choice block
Create link to forced choice block
Assign n = 2 and m = 3
Demo: http://www.dise-online.net/demo.aspx