SlideShare a Scribd company logo
1 of 12
Download to read offline
Quality & Quantity 36: 43ā€“53, 2002.
Ā© 2002 Kluwer Academic Publishers. Printed in the Netherlands.
43
Revisiting the Quantitative-Qualitative Debate:
Implications for Mixed-Methods Research
JOANNA E. M. SALE
Institute for Work & Health; Health Research Methodology Program, Department of Clinical
Epidemiology & Biostatistics, McMaster University
LYNNE H. LOHFELD
St. Josephā€™s Hospital and Home; Department of Clinical Epidemiology & Biostatistics, McMaster
University
KEVIN BRAZIL
St. Josephā€™s Health Care System Research Network, St. Josephā€™s Community Health Centre;
Department of Clinical Epidemiology & Biostatistics, McMaster University
Abstract. Health care research includes many studies that combine quantitative and qualitative
methods. In this paper, we revisit the quantitative-qualitative debate and review the arguments for
and against using mixed-methods. In addition, we discuss the implications stemming from our view,
that the paradigms upon which the methods are based have a different view of reality and therefore
a different view of the phenomenon under study. Because the two paradigms do not study the same
phenomena, quantitative and qualitative methods cannot be combined for cross-validation or trian-
gulation purposes. However, they can be combined for complementary purposes. Future standards
for mixed-methods research should clearly reļ¬‚ect this recommendation.
Key words: mixed-methodology, quantitative-qualitative debate, qualitative methods, quantitative
methods, scientiļ¬c paradigms
1. Introduction
Health care research includes many studies that combine quantitative and qual-
itative methods, as seen in numerous articles and books published in the last
decade (Caracelli and Greene, 1993; Caracelli and Riggin, 1994; Casebeer and
Verhoef, 1997; Datta, 1997; Droitcour, 1997; Greene and Caracelli, 1997; House,
1994; Morgan, 1998; Morse, 1991; Tashakkori and Teddlie, 1998). As many crit-
ics have noted, this is not without its problems. In this paper, we revisit the
quantitative-qualitative debate which ļ¬‚ourished in the 1970s and 1980s and review
the arguments for and against using mixed-methods. In addition, we present what
we believe to be a fundamental point in this debate.
Corresponding author: Joanna E. M. Sale, Institute for Work & Health, 481 University Ave.,
Suite 800, Toronto, ON, Canada M5G 2E9. E-mail: jsale@interlog.com
44 JOANNA E. M. SALE ET AL.
Some people would say that we are beyond the debate and can now freely use
mixed- method designs to carry out relevant and valuable research. According to
Carey (1993), quantitative and qualitative techniques are merely tools; integrating
them allows us to answer questions of substantial importance. However, just be-
cause they are often combined does not mean that it is always appropriate to do
so.
We believe that mixed-methods research is now being adopted uncritically by
a new generation of researchers who have overlooked the underlying assumptions
behind the qualitative-quantitative debate. In short, the philosophical distinctions
between them have become so blurred that researchers are left with the impression
that the differences between the two are merely technical (Smith and Heshius,
1986).
OBJECTIVE
Combining qualitative and quantitative methods in a single study is widely prac-
ticed and accepted in many areas of health care research. Despite the arguments
presented for integrating methods, we will demonstrate that each of these methods
is based on a particular paradigm, a patterned set of assumptions concerning reality
(ontology), knowledge of that reality (epistemology), and the particular ways of
knowing that reality (methodology) (Guba, 1990). In fact, based on their paradig-
matic assumptions, the two methods do not study the same phenomena. Evidence
of this is reļ¬‚ected by the notion that quantitative methods cannot access some of
the phenomena that health researchers are interested in, such as lived experiences
as a patient, social interactions, and the patientsā€™ perspective of doctor-patient inter-
actions. The information presented in this paper is not new in the sense that we are
making a ā€œnewā€ case for or against the debate. Rather, based on the paradigmatic
differences concerning the phenomenon under study, we propose a "new" solution
for using mixed-methods in research that we believe is both methodologically and
philosophically sound.
2. The Two Paradigms
The quantitative paradigm is based on positivism. Science is characterized by
empirical research; all phenomena can be reduced to empirical indicators which
represent the truth. The ontological position of the quantitative paradigm is that
there is only one truth, an objective reality that exists independent of human
perception. Epistemologically, the investigator and investigated are independent
entities. Therefore, the investigator is capable of studying a phenomenon without
inļ¬‚uencing it or being inļ¬‚uenced by it; ā€œinquiry takes place as through a one
way mirrorā€ (Guba and Lincoln, 1994: 110). The goal is to measure and analyze
causal relationships between variables within a value-free framework (Denzin and
Lincoln, 1994). Techniques to ensure this include randomization, blinding, highly
REVISITING THE QUANTITATIVE-QUALITATIVE DEBATE 45
structured protocols, and written or orally administered questionnaires with a lim-
ited range of predetermined responses. Sample sizes are much larger than those
used in qualitative research so that statistical methods to ensure that samples are
representative can be used (Carey, 1993).
In contrast, the qualitative paradigm is based on interpretivism (Altheide and
Johnson, 1994; Kuzel and Like, 1991; Secker et al., 1995) and constructivism
(Guba and Lincoln, 1994). Ontologically speaking, there are multiple realities
or multiple truths based on oneā€™s construction of reality. Reality is socially con-
structed (Berger and Luckmann, 1966) and so is constantly changing. On an
epistemological level, there is no access to reality independent of our minds, no
external referent by which to compare claims of truth (Smith, 1983). The invest-
igator and the object of study are interactively linked so that ļ¬ndings are mutually
created within the context of the situation which shapes the inquiry (Guba and
Lincoln, 1994; Denzin and Lincoln, 1994). This suggests that reality has no exist-
ence prior to the activity of investigation, and reality ceases to exist when we no
longer focus on it (Smith, 1983). The emphasis of qualitative research is on process
and meanings. Techniques used in qualitative studies include in-depth and focus
group interviews and participant observation. Samples are not meant to repres-
ent large populations. Rather, small, purposeful samples of articulate respondents
are used because they can provide important information, not because they are
representative of a larger group (Reid, 1996).
The underlying assumptions of the quantitative and qualitative paradigms result
in differences which extend beyond philosophical and methodological debates. The
two paradigms have given rise to different journals, different sources of funding,
different expertise, and different methods. There are even differences in scientiļ¬c
language used to describe them. For example, the term ā€œobservational workā€ may
refer to case control studies for a quantitative researcher, but to a qualitative re-
searcher it would refer to ethnographic immersion in a culture. ā€œValidityā€ to a
quantitative researcher would mean that results correspond to how things really are
out there in the world, whereas to a qualitative researcher ā€œvalidā€ is a label applied
to an interpretation or description with which one agrees (Smith and Heshusius,
1986). Similarly, the phrase ā€œresearch has shown . . . ā€ or ā€œthe results of research
indicate . . . ā€ refers to an accurate reļ¬‚ection of reality to the quantitative researcher,
but to a qualitative researcher it announces an interpretation that itself becomes
reality (Smith and Heshusius, 1986).
The different assumptions of the quantitative and qualitative paradigms ori-
ginated in the positivism-idealism debate of the late 19th century (Smith, 1983).
The inherent differences rarely are discussed or acknowledged by those using
mixed-method designs. The reasons why may be because the positivist paradigm
has become the predominant frame of reference in the physical and social sci-
ences. In addition, research methods are presented as not belonging to or reļ¬‚ecting
paradigms. Caracelli and Greene (1993) refer to mixed-method designs as those
where neither type of method is inherently linked to a particular inquiry paradigm
46 JOANNA E. M. SALE ET AL.
or philosophy. Guba and Lincoln (1989) claim that questions of method are second-
ary to questions of paradigms. We argue that methods are shaped by and represent
paradigms that reļ¬‚ect a particular belief about reality. We also maintain that the
assumptions of the qualitative paradigm are based on a worldview not represented
by the quantitative paradigm.
3. Arguments Presented for Mixed-Method Research
Having discussed some of the basic philosophical assumptions of the two
paradigms, we are better able to address the arguments given for combining quant-
itative and qualitative methods in a single study. There are several viewpoints as
to why qualitative and quantitative methods can be combined. First, the two ap-
proaches can be combined because they share the goal of understanding the world
in which we live (Haase and Myers, 1988). King et al. (1994) claim that both
qualitative and quantitative research share a uniļ¬ed logic, and that the same rules
of inference apply to both.
Second, the two paradigms are thought to be compatible because they share
the tenets of theory-ladenness of facts, fallibility of knowledge, indetermination
of theory by fact, and a value-ladened inquiry process. They are also united by a
shared commitment to understanding and improving the human condition, a com-
mon goal of disseminating knowledge for practical use, and a shared commitment
for rigor, conscientiousness, and critique in the research process (Reichardt and
Rallis, 1994). In fact, Casebeer and Verhoef (1997) argue we should view qual-
itative and quantitative methods as part of a continuum of research with speciļ¬c
techniques selected based on the research objective.
Third, as noted by Clarke and Yaros (1988), combining research methods is
useful in some areas of research, such as nursing, because the complexity of
phenomena requires data from a large number of perspectives. Similarly, some re-
searchers have argued that the complexities of most public health problems (Baum,
1995) or social interventions, such as health education and health promotion pro-
grams (Steckler et al., 1992), require the use of a broad spectrum of qualitative and
quantitative methods.
Fourth, others claim that researchers should not be preoccupied with the
quantitative-qualitative debate because it will not be resolved in the near future,
and that epistemological purity does not get research done (Miles and Huberman,
1984).
None of these arguments adequately addresses the underlying assumptions be-
hind the paradigmatic differences between qualitative and quantitative research.
However, Reichardt and Rallis (1994) acknowledge the possibility of contention
between the two paradigms concerning the nature of reality by conceding that the
two paradigms are incompatible if the qualitative paradigm assumes that there are
no external referents for understanding reality. We have argued that the qualitative
paradigm does assume that there are no external referents for understanding reality.
REVISITING THE QUANTITATIVE-QUALITATIVE DEBATE 47
Therefore, we propose that in addressing this fundamental assumption, Reichardt
and Rallis dismiss their own claim of compatibility between methodological
camps.
An interesting argument has been made by Howe (1988) who suggests that
researchers should forge ahead with what works. Truth, he states, is a normative
concept, like good. Truth is what works. This appears to be the prevalent attitude in
mixed- methods research. Howeā€™s argument seems to suggest that only pragmatists,
or those not wedded to either paradigm, would attempt to combine research meth-
ods across paradigms. But this does not address the issue of differing ontological
assumptions of the two paradigms.
A more interesting and complicated issue is the explanation of results from
studies using qualitative and quantitative methods which appear to agree. How can
the results be similar if the two paradigms are supposedly looking at different phe-
nomena? Achieving similar results may be merely a matter of perception. In order
to synthesize results obtained via multiple methods research, people often simplify
the situation under study, highlighting and packaging results to reļ¬‚ect what they
think is happening. The truth is we rarely know the extent of disagreement between
qualitative and quantitative results because that is often not reported. Another pos-
sibility which may account for seemingly concordant results could be that both
are, in fact, quantitative. Conducting a frequency count on responses to open-ended
questions is not qualitative research. Given the overwhelming predominance of the
positivist worldview in health care research, this is not surprising. This often trans-
lates to the misapplication of the canons of good ā€œscienceā€ (quantitative research)
to qualitative studies (see Sandelowski, 1986).
Perhaps the only convincing argument for mixing qualitative and quantitative
research methods in a single study would be to challenge the underlying assump-
tions of the two paradigms themselves. A sound argument would be that both
qualitative and quantitative paradigms are based on the tenets of positivism, not
constructivism or interpretivism. Howe (1992) gives the impression of making this
argument by denying there is an ā€œeither-orā€ choice to be made. Rather, he claims,
both quantitative and qualitative researchers should embrace positivism coloured
by a certain degree of interpretivism, an adjustment which he proposes is made
possible by the critical social research model (or the critical educational research
model) which eschews the positivist-interpretivist split in favour of compatibility.
A legitimate argument would have been for Howe and others who appear to
be leaning toward this position (e.g. Reichardt and Rallis, 1994) to claim that the
paradigmatic debate was oversimpliļ¬ed by a positivism-interpretivism split, and
that the qualitative paradigm actually espoused positivism. If we take the position
that qualitative researchers operate within a positivist world, we could argue that
such a position actually negates or undermines the quantitative-qualitative debate
in the ļ¬rst place because it does away with the beliefs about reality from which
qualitative research arose. We believe, however, that one cannot be both a positivist
and an interpretivist or constructivist.
48 JOANNA E. M. SALE ET AL.
Closely tied to the arguments for integrating qualitative and quantitative ap-
proaches are the reasons given for legitimately combining them. Two reasons
for this are prevalent in the literature. The ļ¬rst is to achieve cross-validation or
triangulation ā€“ combining two or more theories or sources of data to study the
same phenomenon in order to gain a more complete understanding of it (Denzin,
1970). The second is to achieve complementary results by using the strengths of
one method to enhance the other (Morgan, 1998). The former position maintains
that research methods are interdependent (combinant); the latter, that they are in-
dependent (additive). Although these two reasons are often used interchangeably
in the literature, it is important to make a distinction between them.
4. The Phenomenon of Study
It is probably safe to say that certain phenomena lend themselves to quantitative as
opposed to qualitative inquiry and vice versa in other instances. Both quantitative
and qualitative researchers often appear to study the same phenomena. However,
these researchersā€™ deļ¬nition of what the phenomena are and how they can best be
described or known differ. Both paradigms may label phenomena identically, but in
keeping with their paradigmatic assumptions, these labels refer to different things.
For the quantitative researcher, a label refers to an external referent; to a qual-
itative researcher, a label refers to a personal interpretation or meaning attached
to phenomena. For example, a quantitative researcher might use a factory record
as if it were representative of what actually happens in the workplace, whereas a
qualitative researcher might interpret it as one of the ways that people in a factory
view their work environment (Needleman and Needleman, 1996). Because there
is no external referent with which to gauge what the truth is, there is no interest
in assessing the record as representative of the one and only reality in the work-
place. Rather, the ways people use and describe it are expected to vary due to
peopleā€™s differing realities based on such characteristics as gender, age, or role
(e.g., employer, manager, worker). Another example is surgical waiting lists. To a
quantitative researcher, the list is like a bus queue; patients are taken off the list
based on the urgency of need for surgery or some other factors. To a qualitative
researcher, the key to understanding the meaning of the list rests with determining
how it is organized, managed and used by the people who actively create and
maintain it (Pope and Mays, 1993).
These two examples demonstrate that although qualitative and quantitative
paradigms may use common labels to refer to phenomena, what the labels refer to
is not the same. There are differences of phenomena within each paradigm as well.
However, the differences in phenomena between the two paradigms are philosoph-
ical differences, whereas the difference in phenomena within each paradigm are
not. Within the quantitative paradigm, we may compare the results of a magnetic
resonance imaging (MRI) scan to those of a computed tomography (CT) scan.
Although they may appear to reveal different realities, the use of the scans assumes
REVISITING THE QUANTITATIVE-QUALITATIVE DEBATE 49
that there is something to measure that exists independent of our minds. Both
scans are trying to approximate or capture the one reality which correlates with
the phenomenon of interest. Within the qualitative paradigm, one may compare
the results of a phenomenological study to those of a grounded theory study on
how nurses cope with the deaths of their patients. These two types of qualitative
studies do not assume that external referents for coping skills exist independent of
our minds.
Having taken the position that the quantitative and qualitative paradigms do not
study the same phenomena, it follows that combining the two methods for cross-
validation/triangulation purposes is not a viable option. (Cross validation refers to
combining the two approaches to study the same phenomenon). Ironically, in a
comprehensive review of mixed-method evaluation studies, Greene and Caracelli
(1989) found that methodological triangulation was actually quite rare in mixed-
method research, used by only 3 of 57 studies. Combining the two approaches
in a complementary fashion is also not advisable if the ultimate goal is to study
different aspects of the same phenomenon because, as we argue, mixed-methods re-
search cannot claim to enrich the same phenomenon under study. The phenomenon
under study is not the same across methods. Not only does cross-validation and
complementarity in the above context violate paradigmatic assumptions, but it also
misrepresents data. Loss of information is a particular risk when attempts are made
to unite results from the two paradigms because it often promotes the selective
search for similarities in data.
5. Further Considerations in Mixed-Method Research Designs
The most frequently used mixed-method designs start with a qualitative pilot
study followed by quantitative research (Morgan, 1998). This promotes the mis-
perception that qualitative research is only exploratory, cannot stand on its own,
and must be validated by quantitative work because the latter is ā€œscientiļ¬cā€ and
studies truth. In response, qualitative researchers have increasingly tried to defend
their work using quantitative criteria, such as validity and reliability, as deļ¬ned
in quantitative studies. They also increasingly use computer programs speciļ¬c-
ally designed for analysing qualitative data, such as NUD.IST or Ethnograph, in
quantitative (counting) ways. These practices seriously violate the assumptions
of the qualitative paradigm(s). For research to be valid or reliable in the narrow
(quantitative) sense requires that what is studied be independent of the inquirer and
be described without distortion by her interests, values, or purposes (Smith and
Heshusius, 1986). This is not how qualitative studies unfold. They are based on the
minimum distance between the investigator and the investigated, and seek multiple
deļ¬nitions of reality embedded in various respondentsā€™ experiences. Therefore, it
is more appropriate for qualitative researchers to apply parallel but distinct canons
of rigor appropriate to qualitative studies (Strauss and Corbin, 1990).
50 JOANNA E. M. SALE ET AL.
It is difļ¬cult to say whether the growing trend of quantifying qualitative research
is a direct result of mixing quantitative and qualitative approaches. It does seem to
be a result of researchers from the two paradigms attempting to work together, or
the desire for qualitative research to be ā€œtaken seriouslyā€ in the world of positivist
research, such as is commonly found in medicine. In our opinion, mixing research
methods across paradigms, as is currently practiced, often diminishes the value of
both methods. Pressure is being exerted from the quantitative camp for qualitative
research to ā€œmeasure upā€ to its standards without understanding the basic premises
of qualitative investigations. Proponents of the qualitative paradigm need to ad-
dress this pressure, but ā€œwithout slipping on the mantle of quantitative inquiryā€
(Smith and Heshusius, 1986: 10). This pressure will no doubt continue to escalate
as combined methods research becomes more common.
6. Our Solution
The key issues in the quantitative-qualitative debate are ontological and epistem-
ological. Quantitative researchers perceive truth as something which describes an
objective reality, separate from the observer and waiting to be discovered. Qualit-
ative researchers are concerned with the changing nature of reality created through
peopleā€™s experiences ā€“ an evolving reality in which the researcher and researched
are mutually interactive and inseparable (Phillips, 1988b). Because quantitative and
qualitative methods represent two different paradigms, they are incommensurate.
As Guba states, ā€œthe one [paradigm] precludes the other just as surely belief in a
round world precludes belief in a ļ¬‚at oneā€ (1987: 31). Fundamental to this view-
point is that qualitative and quantitative researchers do not, in fact, study the same
phenomena.
We propose a solution to mixed-methods research and the quantitative-
qualitative debate. Qualitative and quantitative research methods have grown out
of, and still represent, different paradigms. However, the fact that the approaches
are incommensurate does not mean that multiple methods cannot be combined
in a single study if it is done for complementary purposes. Each method studies
different phenomena. The distinction of phenomena in mixed-methods research
is crucial and can be clariļ¬ed by labelling the phenomenon examined by each
method. For example, a mixed-methods study to develop a measure of burnout ex-
perienced by nurses could be described as a qualitative study of the lived experience
of burnout to inform a quantitative measure of burnout. Although the phenomenon
ā€˜burnoutā€™ may appear the same across methods, the distinction between ā€œlived
experienceā€ and ā€œmeasureā€ reconciles the phenomenon to its respective method
and paradigm.
This solution differs from that of merely using the strengths of each method to
bolster the weaknesses of the other(s), or capturing various aspects of the same phe-
nomena. This implies an additive outcome for mutual research partners. Based on
REVISITING THE QUANTITATIVE-QUALITATIVE DEBATE 51
this assertion, qualitative and quantitative work can be carried out simultaneously
or sequentially in a single study or series of investigations.
7. Implications
Given that we have returned to debate in a no-debate world, what is the outlook
for mixed-paradigm research? As Phillips (1988a) points out, it may be that quant-
itative and qualitative approaches are inadequate to the task of understanding the
emerging science of wholeness because they give an incomplete view of people
in their environments. Perhaps in a ā€œKuhnianā€ sense, a new paradigm is in order,
one with a new ontology, epistemology, and methodology. Alternatively, we have
proposed seeking complementarity which we believe is both philosophically and
practically sound. This solution lends itself to new standards for mixed-paradigm
research. We hope that future guidelines which assess the quality of such research
consider this recommendation.
References
Altheide, D. L. & Johnson, J. M. (1994). Criteria for assessing interpretive validity in qualitative
research. In: Denzin, N. K. & Lincoln, Y. S. (eds), Handbook of Qualitative Research. Thousand
Oaks, CA: Sage Publications, pp. 485ā€“499.
Baum, F. (1995). Researching public health: Behind the qualitative-quantitative methodological
debate. Social Science and Medicine 40: 459ā€“468.
Berger, P. L. & Luckmann, T. (1966). The Social Construction of Reality: A Treatise in the Sociology
of Knowledge. Garden City, NY: Doubleday.
Caracelli, V. J. & Greene, J. C. (1993). Data analysis strategies for mixed-method evaluation designs.
Educational Evaluation and Policy Analysis 15: 195ā€“207.
Caracelli, V. J. & Riggin, L. J. C. (1994). Mixed-method evaluation: Developing quality criteria
through concept mapping. Evaluation Practice 15: 139ā€“152.
Carey, J. W. (1993). Linking qualitative and quantitative methods: Integrating cultural factors into
public health. Qualitative Health Research 3: 298ā€“318.
Casebeer, A. L. & Verhoef, M. J. (1997). Combining qualitative and quantitative research methods:
Considering the possibilities for enhancing the study of chronic diseases. Chronic Diseases in
Canada 18: 130ā€“135.
Clarke, P. N. & Yaros, P. S. (1988). Research blenders: Commentary and response. Nursing Science
Quarterly 1: 147ā€“149.
Creswell, J.W. (1998). Qualitative Inquiry and Research Design: Choosing Among Five Traditions.
Thousand Oaks, CA: Sage Publications.
Datta, L. (1997). Multimethod evaluations: Using case studies together with other methods. In: E.
Chelimsky & W. R. Shadish (eds.), Evaluation for the 21st Century: A Handbook. Thousand
Oaks, CA: Sage Publications, pp. 344ā€“359.
Denzin, N. K. (1970). The Research Act in Sociology. London: Butterworth.
Denzin, N. K. & Lincoln, Y. S. (1994). Introduction: Entering the ļ¬eld of qualitative research. In: N.
K. Denzin & Y. S. Lincoln (eds.), Handbook of Qualitative Research. Thousand Oaks, CA: Sage,
pp. 1ā€“17.
Droitcour, J. A. (1997). Cross design synthesis: Concept and application. In: E. Chelimsky, &
Shadish, W. R. (eds), Evaluation for the 21st Century: A Handbook. Thousand Oaks, CA: Sage
Publications, pp. 360ā€“372.
52 JOANNA E. M. SALE ET AL.
Greene, J. C. & Caracelli, V. J. (eds) (1997). Advances in Mixed-Method Evaluation: The Challenges
and Beneļ¬ts of Integrating Diverse Paradigms. San Francisco: Jossey-Bass Publishers.
Greene, J. C., Caracelli, V. J. & Graham, W. F. (1989). Toward a conceptual framework for mixed-
method evaluation designs. Educational Evaluation and Policy Analysis 11: 255ā€“274.
Guba, E. (1987). What have we learned about naturalistic evaluation? Evaluation Practice 8: 23ā€“43.
Guba, E. G. (1990). The alternative paradigm dialog. In: E. G. Guba (ed.), The Paradigm Dialog.
Newbury Park, CA: Sage, pp. 17ā€“30.
Guba, E. G. & Lincoln, Y. S. (1989). Fourth Generation Evaluation. Newbury Park, CA: Sage
Publications.
Guba, E. G. & Lincoln, Y. S. (1994). Competing paradigms in qualitative research. In: N. K. Denzin
& Y. S. Lincoln (eds), Handbook of Qualitative Research. Thousand Oaks, CA: Sage, pp. 105ā€“
117.
Haase, J. E. & Myers, S. T. (1988). Reconciling paradigm assumptions of qualitative and quantitative
research. Western Journal of Nursing Research 10: 128ā€“137.
House, E. R. (1994). Integrating the quantitative and qualitative. In: C. S. Reichardt & S. F. Rallis
(eds), The Qualitative-Quantitative Debate: New Perspectives. San Francisco: Jossey-Bass, pp.
13ā€“22.
Howe, K. R. (1988). Against the quantitative-qualitative incompatibility thesis or dogmas die hard.
Educational Researcher 17: 10ā€“16.
Howe, K. R. (1992). Getting over the quantitative-qualitative debate. American Journal of Education
100: 236ā€“257.
King, G., Keohane, R. O. & Verba, S. (1994). Designing Social Inquiry: Scientiļ¬c Inference in
Qualitative Research. Princeton: Princeton University Press.
Kuzel, A. J. & Like, R. C. (1991). Standards of trustworthiness for qualitative studies in primary
care. In: P. G. Norton, M. Steward, F. Tudiver, M. J. Bass & E. V. Dunn (eds.), Primary Care
Research. Newbury Park, CA: Sage Publications, pp. 138ā€“158.
Miles, M. & Huberman, A. (1984). Drawing valid meaning from qualitative data: Toward a shared
craft. Educational Researcher 13: 20ā€“30.
Morgan, D. L. (1998). Practical strategies for combining qualitative and quantitative methods:
Applications to health research. Qualitative Health Research 8: 362ā€“376.
Morse, J. M. (1991). Approaches to qualitative-quantitative methodological triangulation. Nursing
Research 40: 120ā€“123.
Needleman, C. & Needleman, M. L. (1996). Qualitative methods for intervention research. American
Journal of Industrial Medicine 29: 329ā€“337.
Phillips, J. R. (1988a). Diggers of deeper holes. Nursing Science Quarterly 1: 149ā€“151.
Phillips, J. R. (1988b). Research blenders. Nursing Science Quarterly 1: 4ā€“5.
Pope, C. & Mays, N. (1993). Opening the black box: An encounter in the corridors of health sciences
research. British Medical Journal 306: 315ā€“318.
Reichardt, C. S. & Rallis, S. F. (1994). Qualitative and quantitative inquiries are not incompatible: A
call for a new partnership. New Directions for Program Evaluation 61: 85ā€“91.
Reid, A. J. (1996). What we want: Qualitative research. Canadian Family Physician 42: 387ā€“389.
Sandelowski, M. (1986). The problem of rigour in qualitative research. Advances in Nursing Science
8: 27ā€“37.
Secker, J., Wimbush, E., Watson, J. & Milburn, K. (1995). Qualitative methods in health promotion
research: Some criteria for quality. Health Education Journal 54: 74ā€“87.
Smith, J. K. (1983). Quantitative versus qualitative research: An attempt to clarify the issue.
Educational Researcher 12: 6ā€“13.
Smith, J. K. & Heshusius, L. (1986). Closing down the conversation: The end of the quantitative-
qualitative debate among educational inquiries. Educational Researcher 15: 4ā€“12.
REVISITING THE QUANTITATIVE-QUALITATIVE DEBATE 53
Steckler, A., McLeroy, K. R., Goodman, R. M., Bird, S. T. & McCormick, L. (1992). Toward in-
tegrating qualitative and quantitative methods: An introduction. Health Education Quarterly 19:
1ā€“8.
Strauss, A. & Corbin, J. (1990). Chapter 1: Introduction. Basics of Qualitative Research: Grounded
Theory Procedures and Techniques. Newbury Park, CA: Sage Publications, pp. 23ā€“32.
Tashakkori, A. & Teddlie, C. (1998). Mixed Methodology: Combining Qualitative and Quantitative
Approaches. Thousand Oaks, CA: Sage Publications.
Sale mixed methods

More Related Content

What's hot

05 chap 4 research methodology and design
05 chap 4 research methodology and design05 chap 4 research methodology and design
05 chap 4 research methodology and designELIMENG
Ā 
Cress well mix method design chapter 1
Cress well mix method design chapter 1Cress well mix method design chapter 1
Cress well mix method design chapter 1Rehmanzaib1
Ā 
Oxford hapinees questionaire
Oxford hapinees questionaireOxford hapinees questionaire
Oxford hapinees questionaireSolercanto
Ā 
Chapter 5 theory and methodology
Chapter 5 theory and methodology Chapter 5 theory and methodology
Chapter 5 theory and methodology grainne
Ā 
Research Metodology
Research MetodologyResearch Metodology
Research MetodologyJairo Gomez
Ā 
Lunenburg, fred c the generation & verification of theory a bridge to nfeasj ...
Lunenburg, fred c the generation & verification of theory a bridge to nfeasj ...Lunenburg, fred c the generation & verification of theory a bridge to nfeasj ...
Lunenburg, fred c the generation & verification of theory a bridge to nfeasj ...William Kritsonis
Ā 
E)pistemological Awareness, Instantiation of Methods, and Uninformed Methodol...
E)pistemological Awareness, Instantiation of Methods, and Uninformed Methodol...E)pistemological Awareness, Instantiation of Methods, and Uninformed Methodol...
E)pistemological Awareness, Instantiation of Methods, and Uninformed Methodol...Abdullah Saleem
Ā 
Epidemiologic measures and policy formulation lessons from potential outcomes...
Epidemiologic measures and policy formulation lessons from potential outcomes...Epidemiologic measures and policy formulation lessons from potential outcomes...
Epidemiologic measures and policy formulation lessons from potential outcomes...Bsie
Ā 
On Pragmatism and Scientific Freedom
On Pragmatism and Scientific FreedomOn Pragmatism and Scientific Freedom
On Pragmatism and Scientific FreedomAntonio Severien
Ā 
Research
ResearchResearch
Researchabhi5166
Ā 
Qualitative methods in Psychology Research
Qualitative methods in Psychology ResearchQualitative methods in Psychology Research
Qualitative methods in Psychology ResearchDr. Chinchu C
Ā 
Grounded Theory and the Constant Comparative Method
Grounded Theory and the Constant Comparative MethodGrounded Theory and the Constant Comparative Method
Grounded Theory and the Constant Comparative MethodSharon M. Kolb, PhD
Ā 
Role of theory in research by priyadarshinee pradhan
Role of theory in research by priyadarshinee pradhanRole of theory in research by priyadarshinee pradhan
Role of theory in research by priyadarshinee pradhanPriya Das
Ā 

What's hot (20)

05 chap 4 research methodology and design
05 chap 4 research methodology and design05 chap 4 research methodology and design
05 chap 4 research methodology and design
Ā 
Cress well mix method design chapter 1
Cress well mix method design chapter 1Cress well mix method design chapter 1
Cress well mix method design chapter 1
Ā 
David Buchanan (University of Massachusetts)
David Buchanan (University of Massachusetts)David Buchanan (University of Massachusetts)
David Buchanan (University of Massachusetts)
Ā 
Oxford hapinees questionaire
Oxford hapinees questionaireOxford hapinees questionaire
Oxford hapinees questionaire
Ā 
Chapter 5 theory and methodology
Chapter 5 theory and methodology Chapter 5 theory and methodology
Chapter 5 theory and methodology
Ā 
Theory
TheoryTheory
Theory
Ā 
Research Metodology
Research MetodologyResearch Metodology
Research Metodology
Ā 
Definitions of Knowledge
Definitions of Knowledge Definitions of Knowledge
Definitions of Knowledge
Ā 
Lunenburg, fred c the generation & verification of theory a bridge to nfeasj ...
Lunenburg, fred c the generation & verification of theory a bridge to nfeasj ...Lunenburg, fred c the generation & verification of theory a bridge to nfeasj ...
Lunenburg, fred c the generation & verification of theory a bridge to nfeasj ...
Ā 
Final book -_rm
Final book -_rmFinal book -_rm
Final book -_rm
Ā 
E)pistemological Awareness, Instantiation of Methods, and Uninformed Methodol...
E)pistemological Awareness, Instantiation of Methods, and Uninformed Methodol...E)pistemological Awareness, Instantiation of Methods, and Uninformed Methodol...
E)pistemological Awareness, Instantiation of Methods, and Uninformed Methodol...
Ā 
Epidemiologic measures and policy formulation lessons from potential outcomes...
Epidemiologic measures and policy formulation lessons from potential outcomes...Epidemiologic measures and policy formulation lessons from potential outcomes...
Epidemiologic measures and policy formulation lessons from potential outcomes...
Ā 
Computer Science
Computer ScienceComputer Science
Computer Science
Ā 
On Pragmatism and Scientific Freedom
On Pragmatism and Scientific FreedomOn Pragmatism and Scientific Freedom
On Pragmatism and Scientific Freedom
Ā 
Introduction to research
Introduction to researchIntroduction to research
Introduction to research
Ā 
Research
ResearchResearch
Research
Ā 
Qualitative methods in Psychology Research
Qualitative methods in Psychology ResearchQualitative methods in Psychology Research
Qualitative methods in Psychology Research
Ā 
Grounded Theory and the Constant Comparative Method
Grounded Theory and the Constant Comparative MethodGrounded Theory and the Constant Comparative Method
Grounded Theory and the Constant Comparative Method
Ā 
Phil med kings
Phil med kingsPhil med kings
Phil med kings
Ā 
Role of theory in research by priyadarshinee pradhan
Role of theory in research by priyadarshinee pradhanRole of theory in research by priyadarshinee pradhan
Role of theory in research by priyadarshinee pradhan
Ā 

Viewers also liked

Copia de presentaciĆ³n inteligencia artificial
Copia de presentaciĆ³n inteligencia artificialCopia de presentaciĆ³n inteligencia artificial
Copia de presentaciĆ³n inteligencia artificialerikasuansalamanca
Ā 
EcodiseƱO Metodologia E InformaciĆ³N
EcodiseƱO Metodologia E InformaciĆ³NEcodiseƱO Metodologia E InformaciĆ³N
EcodiseƱO Metodologia E InformaciĆ³NJordi Miro
Ā 
Inteligencia Artificial
Inteligencia ArtificialInteligencia Artificial
Inteligencia Artificialyuvenny
Ā 
Friendship presentationfor-you
Friendship presentationfor-youFriendship presentationfor-you
Friendship presentationfor-youSirajRock
Ā 
Copia de presentaciĆ³n inteligencia artificial
Copia de presentaciĆ³n inteligencia artificialCopia de presentaciĆ³n inteligencia artificial
Copia de presentaciĆ³n inteligencia artificialerikasuansalamanca
Ā 
Otras perspectivas2
Otras perspectivas2Otras perspectivas2
Otras perspectivas2camiloernesto2
Ā 
Codigodedefensasocialdelestadolibreysoberanodepuebla
CodigodedefensasocialdelestadolibreysoberanodepueblaCodigodedefensasocialdelestadolibreysoberanodepuebla
CodigodedefensasocialdelestadolibreysoberanodepueblaAlejandro Amador
Ā 

Viewers also liked (7)

Copia de presentaciĆ³n inteligencia artificial
Copia de presentaciĆ³n inteligencia artificialCopia de presentaciĆ³n inteligencia artificial
Copia de presentaciĆ³n inteligencia artificial
Ā 
EcodiseƱO Metodologia E InformaciĆ³N
EcodiseƱO Metodologia E InformaciĆ³NEcodiseƱO Metodologia E InformaciĆ³N
EcodiseƱO Metodologia E InformaciĆ³N
Ā 
Inteligencia Artificial
Inteligencia ArtificialInteligencia Artificial
Inteligencia Artificial
Ā 
Friendship presentationfor-you
Friendship presentationfor-youFriendship presentationfor-you
Friendship presentationfor-you
Ā 
Copia de presentaciĆ³n inteligencia artificial
Copia de presentaciĆ³n inteligencia artificialCopia de presentaciĆ³n inteligencia artificial
Copia de presentaciĆ³n inteligencia artificial
Ā 
Otras perspectivas2
Otras perspectivas2Otras perspectivas2
Otras perspectivas2
Ā 
Codigodedefensasocialdelestadolibreysoberanodepuebla
CodigodedefensasocialdelestadolibreysoberanodepueblaCodigodedefensasocialdelestadolibreysoberanodepuebla
Codigodedefensasocialdelestadolibreysoberanodepuebla
Ā 

Similar to Sale mixed methods

Quantitativeresearch final
Quantitativeresearch finalQuantitativeresearch final
Quantitativeresearch finalClaudia
Ā 
Assignment Research Methods
Assignment Research MethodsAssignment Research Methods
Assignment Research MethodsNat Rice
Ā 
Difference Between Quantitative And Qualitative Research
Difference Between Quantitative And Qualitative ResearchDifference Between Quantitative And Qualitative Research
Difference Between Quantitative And Qualitative ResearchMelanie Smith
Ā 
Cross-Cultural Psychology
Cross-Cultural PsychologyCross-Cultural Psychology
Cross-Cultural PsychologyMonica Carter
Ā 
Methodological quality.pptx
Methodological quality.pptxMethodological quality.pptx
Methodological quality.pptxArunRajJayarajan
Ā 
Analyze Quantitative And Qualitative Research
Analyze Quantitative And Qualitative ResearchAnalyze Quantitative And Qualitative Research
Analyze Quantitative And Qualitative ResearchAmy Roman
Ā 
ANYTIME YOU COMPLETE A PAPERESSAY in this course you must follow .docx
ANYTIME YOU COMPLETE A PAPERESSAY in this course you must follow .docxANYTIME YOU COMPLETE A PAPERESSAY in this course you must follow .docx
ANYTIME YOU COMPLETE A PAPERESSAY in this course you must follow .docxfestockton
Ā 
Using Grounded Theory In Research
Using Grounded Theory In ResearchUsing Grounded Theory In Research
Using Grounded Theory In ResearchAlyssa Dennis
Ā 
STDEV . I3.pdf
STDEV . I3.pdfSTDEV . I3.pdf
STDEV . I3.pdfmaxinesfiles2
Ā 
Qualitative Research and Family Psychology by Jane F. Gilgun
Qualitative Research and Family Psychology by Jane F. GilgunQualitative Research and Family Psychology by Jane F. Gilgun
Qualitative Research and Family Psychology by Jane F. GilgunJim Bloyd
Ā 
Assignment.docx
Assignment.docxAssignment.docx
Assignment.docxJOSEPHASAFO3
Ā 
difference between the qualitative and quantitative researcher, variables, co...
difference between the qualitative and quantitative researcher, variables, co...difference between the qualitative and quantitative researcher, variables, co...
difference between the qualitative and quantitative researcher, variables, co...laraib asif
Ā 
Presentation on-Resarch-paradigms.pptx
Presentation on-Resarch-paradigms.pptxPresentation on-Resarch-paradigms.pptx
Presentation on-Resarch-paradigms.pptxBenjaminKumi
Ā 
Chapter 3(methodology) Rough
Chapter  3(methodology) RoughChapter  3(methodology) Rough
Chapter 3(methodology) RoughRam Prasad Adhikari
Ā 

Similar to Sale mixed methods (20)

Quantitativeresearch final
Quantitativeresearch finalQuantitativeresearch final
Quantitativeresearch final
Ā 
Assignment Research Methods
Assignment Research MethodsAssignment Research Methods
Assignment Research Methods
Ā 
Philosophy of-research
Philosophy of-researchPhilosophy of-research
Philosophy of-research
Ā 
Difference Between Quantitative And Qualitative Research
Difference Between Quantitative And Qualitative ResearchDifference Between Quantitative And Qualitative Research
Difference Between Quantitative And Qualitative Research
Ā 
Cross-Cultural Psychology
Cross-Cultural PsychologyCross-Cultural Psychology
Cross-Cultural Psychology
Ā 
Week 12 mixed methods
Week 12   mixed methodsWeek 12   mixed methods
Week 12 mixed methods
Ā 
Methodological quality.pptx
Methodological quality.pptxMethodological quality.pptx
Methodological quality.pptx
Ā 
Analyze Quantitative And Qualitative Research
Analyze Quantitative And Qualitative ResearchAnalyze Quantitative And Qualitative Research
Analyze Quantitative And Qualitative Research
Ā 
Qualitative Research Papers
Qualitative Research PapersQualitative Research Papers
Qualitative Research Papers
Ā 
ANYTIME YOU COMPLETE A PAPERESSAY in this course you must follow .docx
ANYTIME YOU COMPLETE A PAPERESSAY in this course you must follow .docxANYTIME YOU COMPLETE A PAPERESSAY in this course you must follow .docx
ANYTIME YOU COMPLETE A PAPERESSAY in this course you must follow .docx
Ā 
Using Grounded Theory In Research
Using Grounded Theory In ResearchUsing Grounded Theory In Research
Using Grounded Theory In Research
Ā 
STDEV . I3.pdf
STDEV . I3.pdfSTDEV . I3.pdf
STDEV . I3.pdf
Ā 
The Goal Of Qualitative Research Essay
The Goal Of Qualitative Research EssayThe Goal Of Qualitative Research Essay
The Goal Of Qualitative Research Essay
Ā 
Qualitative Research and Family Psychology by Jane F. Gilgun
Qualitative Research and Family Psychology by Jane F. GilgunQualitative Research and Family Psychology by Jane F. Gilgun
Qualitative Research and Family Psychology by Jane F. Gilgun
Ā 
Assignment.docx
Assignment.docxAssignment.docx
Assignment.docx
Ā 
difference between the qualitative and quantitative researcher, variables, co...
difference between the qualitative and quantitative researcher, variables, co...difference between the qualitative and quantitative researcher, variables, co...
difference between the qualitative and quantitative researcher, variables, co...
Ā 
rose
roserose
rose
Ā 
Hypothesis
HypothesisHypothesis
Hypothesis
Ā 
Presentation on-Resarch-paradigms.pptx
Presentation on-Resarch-paradigms.pptxPresentation on-Resarch-paradigms.pptx
Presentation on-Resarch-paradigms.pptx
Ā 
Chapter 3(methodology) Rough
Chapter  3(methodology) RoughChapter  3(methodology) Rough
Chapter 3(methodology) Rough
Ā 

Recently uploaded

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
Ā 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
Ā 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdfChristopherTHyatt
Ā 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
Ā 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
Ā 
Finology Group ā€“ Insurtech Innovation Award 2024
Finology Group ā€“ Insurtech Innovation Award 2024Finology Group ā€“ Insurtech Innovation Award 2024
Finology Group ā€“ Insurtech Innovation Award 2024The Digital Insurer
Ā 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
Ā 
šŸ¬ The future of MySQL is Postgres šŸ˜
šŸ¬  The future of MySQL is Postgres   šŸ˜šŸ¬  The future of MySQL is Postgres   šŸ˜
šŸ¬ The future of MySQL is Postgres šŸ˜RTylerCroy
Ā 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
Ā 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
Ā 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
Ā 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
Ā 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
Ā 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
Ā 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
Ā 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
Ā 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
Ā 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
Ā 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
Ā 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
Ā 

Recently uploaded (20)

The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
Ā 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
Ā 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
Ā 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Ā 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
Ā 
Finology Group ā€“ Insurtech Innovation Award 2024
Finology Group ā€“ Insurtech Innovation Award 2024Finology Group ā€“ Insurtech Innovation Award 2024
Finology Group ā€“ Insurtech Innovation Award 2024
Ā 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Ā 
šŸ¬ The future of MySQL is Postgres šŸ˜
šŸ¬  The future of MySQL is Postgres   šŸ˜šŸ¬  The future of MySQL is Postgres   šŸ˜
šŸ¬ The future of MySQL is Postgres šŸ˜
Ā 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
Ā 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Ā 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
Ā 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
Ā 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
Ā 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
Ā 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Ā 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
Ā 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
Ā 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Ā 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
Ā 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
Ā 

Sale mixed methods

  • 1. Quality & Quantity 36: 43ā€“53, 2002. Ā© 2002 Kluwer Academic Publishers. Printed in the Netherlands. 43 Revisiting the Quantitative-Qualitative Debate: Implications for Mixed-Methods Research JOANNA E. M. SALE Institute for Work & Health; Health Research Methodology Program, Department of Clinical Epidemiology & Biostatistics, McMaster University LYNNE H. LOHFELD St. Josephā€™s Hospital and Home; Department of Clinical Epidemiology & Biostatistics, McMaster University KEVIN BRAZIL St. Josephā€™s Health Care System Research Network, St. Josephā€™s Community Health Centre; Department of Clinical Epidemiology & Biostatistics, McMaster University Abstract. Health care research includes many studies that combine quantitative and qualitative methods. In this paper, we revisit the quantitative-qualitative debate and review the arguments for and against using mixed-methods. In addition, we discuss the implications stemming from our view, that the paradigms upon which the methods are based have a different view of reality and therefore a different view of the phenomenon under study. Because the two paradigms do not study the same phenomena, quantitative and qualitative methods cannot be combined for cross-validation or trian- gulation purposes. However, they can be combined for complementary purposes. Future standards for mixed-methods research should clearly reļ¬‚ect this recommendation. Key words: mixed-methodology, quantitative-qualitative debate, qualitative methods, quantitative methods, scientiļ¬c paradigms 1. Introduction Health care research includes many studies that combine quantitative and qual- itative methods, as seen in numerous articles and books published in the last decade (Caracelli and Greene, 1993; Caracelli and Riggin, 1994; Casebeer and Verhoef, 1997; Datta, 1997; Droitcour, 1997; Greene and Caracelli, 1997; House, 1994; Morgan, 1998; Morse, 1991; Tashakkori and Teddlie, 1998). As many crit- ics have noted, this is not without its problems. In this paper, we revisit the quantitative-qualitative debate which ļ¬‚ourished in the 1970s and 1980s and review the arguments for and against using mixed-methods. In addition, we present what we believe to be a fundamental point in this debate. Corresponding author: Joanna E. M. Sale, Institute for Work & Health, 481 University Ave., Suite 800, Toronto, ON, Canada M5G 2E9. E-mail: jsale@interlog.com
  • 2. 44 JOANNA E. M. SALE ET AL. Some people would say that we are beyond the debate and can now freely use mixed- method designs to carry out relevant and valuable research. According to Carey (1993), quantitative and qualitative techniques are merely tools; integrating them allows us to answer questions of substantial importance. However, just be- cause they are often combined does not mean that it is always appropriate to do so. We believe that mixed-methods research is now being adopted uncritically by a new generation of researchers who have overlooked the underlying assumptions behind the qualitative-quantitative debate. In short, the philosophical distinctions between them have become so blurred that researchers are left with the impression that the differences between the two are merely technical (Smith and Heshius, 1986). OBJECTIVE Combining qualitative and quantitative methods in a single study is widely prac- ticed and accepted in many areas of health care research. Despite the arguments presented for integrating methods, we will demonstrate that each of these methods is based on a particular paradigm, a patterned set of assumptions concerning reality (ontology), knowledge of that reality (epistemology), and the particular ways of knowing that reality (methodology) (Guba, 1990). In fact, based on their paradig- matic assumptions, the two methods do not study the same phenomena. Evidence of this is reļ¬‚ected by the notion that quantitative methods cannot access some of the phenomena that health researchers are interested in, such as lived experiences as a patient, social interactions, and the patientsā€™ perspective of doctor-patient inter- actions. The information presented in this paper is not new in the sense that we are making a ā€œnewā€ case for or against the debate. Rather, based on the paradigmatic differences concerning the phenomenon under study, we propose a "new" solution for using mixed-methods in research that we believe is both methodologically and philosophically sound. 2. The Two Paradigms The quantitative paradigm is based on positivism. Science is characterized by empirical research; all phenomena can be reduced to empirical indicators which represent the truth. The ontological position of the quantitative paradigm is that there is only one truth, an objective reality that exists independent of human perception. Epistemologically, the investigator and investigated are independent entities. Therefore, the investigator is capable of studying a phenomenon without inļ¬‚uencing it or being inļ¬‚uenced by it; ā€œinquiry takes place as through a one way mirrorā€ (Guba and Lincoln, 1994: 110). The goal is to measure and analyze causal relationships between variables within a value-free framework (Denzin and Lincoln, 1994). Techniques to ensure this include randomization, blinding, highly
  • 3. REVISITING THE QUANTITATIVE-QUALITATIVE DEBATE 45 structured protocols, and written or orally administered questionnaires with a lim- ited range of predetermined responses. Sample sizes are much larger than those used in qualitative research so that statistical methods to ensure that samples are representative can be used (Carey, 1993). In contrast, the qualitative paradigm is based on interpretivism (Altheide and Johnson, 1994; Kuzel and Like, 1991; Secker et al., 1995) and constructivism (Guba and Lincoln, 1994). Ontologically speaking, there are multiple realities or multiple truths based on oneā€™s construction of reality. Reality is socially con- structed (Berger and Luckmann, 1966) and so is constantly changing. On an epistemological level, there is no access to reality independent of our minds, no external referent by which to compare claims of truth (Smith, 1983). The invest- igator and the object of study are interactively linked so that ļ¬ndings are mutually created within the context of the situation which shapes the inquiry (Guba and Lincoln, 1994; Denzin and Lincoln, 1994). This suggests that reality has no exist- ence prior to the activity of investigation, and reality ceases to exist when we no longer focus on it (Smith, 1983). The emphasis of qualitative research is on process and meanings. Techniques used in qualitative studies include in-depth and focus group interviews and participant observation. Samples are not meant to repres- ent large populations. Rather, small, purposeful samples of articulate respondents are used because they can provide important information, not because they are representative of a larger group (Reid, 1996). The underlying assumptions of the quantitative and qualitative paradigms result in differences which extend beyond philosophical and methodological debates. The two paradigms have given rise to different journals, different sources of funding, different expertise, and different methods. There are even differences in scientiļ¬c language used to describe them. For example, the term ā€œobservational workā€ may refer to case control studies for a quantitative researcher, but to a qualitative re- searcher it would refer to ethnographic immersion in a culture. ā€œValidityā€ to a quantitative researcher would mean that results correspond to how things really are out there in the world, whereas to a qualitative researcher ā€œvalidā€ is a label applied to an interpretation or description with which one agrees (Smith and Heshusius, 1986). Similarly, the phrase ā€œresearch has shown . . . ā€ or ā€œthe results of research indicate . . . ā€ refers to an accurate reļ¬‚ection of reality to the quantitative researcher, but to a qualitative researcher it announces an interpretation that itself becomes reality (Smith and Heshusius, 1986). The different assumptions of the quantitative and qualitative paradigms ori- ginated in the positivism-idealism debate of the late 19th century (Smith, 1983). The inherent differences rarely are discussed or acknowledged by those using mixed-method designs. The reasons why may be because the positivist paradigm has become the predominant frame of reference in the physical and social sci- ences. In addition, research methods are presented as not belonging to or reļ¬‚ecting paradigms. Caracelli and Greene (1993) refer to mixed-method designs as those where neither type of method is inherently linked to a particular inquiry paradigm
  • 4. 46 JOANNA E. M. SALE ET AL. or philosophy. Guba and Lincoln (1989) claim that questions of method are second- ary to questions of paradigms. We argue that methods are shaped by and represent paradigms that reļ¬‚ect a particular belief about reality. We also maintain that the assumptions of the qualitative paradigm are based on a worldview not represented by the quantitative paradigm. 3. Arguments Presented for Mixed-Method Research Having discussed some of the basic philosophical assumptions of the two paradigms, we are better able to address the arguments given for combining quant- itative and qualitative methods in a single study. There are several viewpoints as to why qualitative and quantitative methods can be combined. First, the two ap- proaches can be combined because they share the goal of understanding the world in which we live (Haase and Myers, 1988). King et al. (1994) claim that both qualitative and quantitative research share a uniļ¬ed logic, and that the same rules of inference apply to both. Second, the two paradigms are thought to be compatible because they share the tenets of theory-ladenness of facts, fallibility of knowledge, indetermination of theory by fact, and a value-ladened inquiry process. They are also united by a shared commitment to understanding and improving the human condition, a com- mon goal of disseminating knowledge for practical use, and a shared commitment for rigor, conscientiousness, and critique in the research process (Reichardt and Rallis, 1994). In fact, Casebeer and Verhoef (1997) argue we should view qual- itative and quantitative methods as part of a continuum of research with speciļ¬c techniques selected based on the research objective. Third, as noted by Clarke and Yaros (1988), combining research methods is useful in some areas of research, such as nursing, because the complexity of phenomena requires data from a large number of perspectives. Similarly, some re- searchers have argued that the complexities of most public health problems (Baum, 1995) or social interventions, such as health education and health promotion pro- grams (Steckler et al., 1992), require the use of a broad spectrum of qualitative and quantitative methods. Fourth, others claim that researchers should not be preoccupied with the quantitative-qualitative debate because it will not be resolved in the near future, and that epistemological purity does not get research done (Miles and Huberman, 1984). None of these arguments adequately addresses the underlying assumptions be- hind the paradigmatic differences between qualitative and quantitative research. However, Reichardt and Rallis (1994) acknowledge the possibility of contention between the two paradigms concerning the nature of reality by conceding that the two paradigms are incompatible if the qualitative paradigm assumes that there are no external referents for understanding reality. We have argued that the qualitative paradigm does assume that there are no external referents for understanding reality.
  • 5. REVISITING THE QUANTITATIVE-QUALITATIVE DEBATE 47 Therefore, we propose that in addressing this fundamental assumption, Reichardt and Rallis dismiss their own claim of compatibility between methodological camps. An interesting argument has been made by Howe (1988) who suggests that researchers should forge ahead with what works. Truth, he states, is a normative concept, like good. Truth is what works. This appears to be the prevalent attitude in mixed- methods research. Howeā€™s argument seems to suggest that only pragmatists, or those not wedded to either paradigm, would attempt to combine research meth- ods across paradigms. But this does not address the issue of differing ontological assumptions of the two paradigms. A more interesting and complicated issue is the explanation of results from studies using qualitative and quantitative methods which appear to agree. How can the results be similar if the two paradigms are supposedly looking at different phe- nomena? Achieving similar results may be merely a matter of perception. In order to synthesize results obtained via multiple methods research, people often simplify the situation under study, highlighting and packaging results to reļ¬‚ect what they think is happening. The truth is we rarely know the extent of disagreement between qualitative and quantitative results because that is often not reported. Another pos- sibility which may account for seemingly concordant results could be that both are, in fact, quantitative. Conducting a frequency count on responses to open-ended questions is not qualitative research. Given the overwhelming predominance of the positivist worldview in health care research, this is not surprising. This often trans- lates to the misapplication of the canons of good ā€œscienceā€ (quantitative research) to qualitative studies (see Sandelowski, 1986). Perhaps the only convincing argument for mixing qualitative and quantitative research methods in a single study would be to challenge the underlying assump- tions of the two paradigms themselves. A sound argument would be that both qualitative and quantitative paradigms are based on the tenets of positivism, not constructivism or interpretivism. Howe (1992) gives the impression of making this argument by denying there is an ā€œeither-orā€ choice to be made. Rather, he claims, both quantitative and qualitative researchers should embrace positivism coloured by a certain degree of interpretivism, an adjustment which he proposes is made possible by the critical social research model (or the critical educational research model) which eschews the positivist-interpretivist split in favour of compatibility. A legitimate argument would have been for Howe and others who appear to be leaning toward this position (e.g. Reichardt and Rallis, 1994) to claim that the paradigmatic debate was oversimpliļ¬ed by a positivism-interpretivism split, and that the qualitative paradigm actually espoused positivism. If we take the position that qualitative researchers operate within a positivist world, we could argue that such a position actually negates or undermines the quantitative-qualitative debate in the ļ¬rst place because it does away with the beliefs about reality from which qualitative research arose. We believe, however, that one cannot be both a positivist and an interpretivist or constructivist.
  • 6. 48 JOANNA E. M. SALE ET AL. Closely tied to the arguments for integrating qualitative and quantitative ap- proaches are the reasons given for legitimately combining them. Two reasons for this are prevalent in the literature. The ļ¬rst is to achieve cross-validation or triangulation ā€“ combining two or more theories or sources of data to study the same phenomenon in order to gain a more complete understanding of it (Denzin, 1970). The second is to achieve complementary results by using the strengths of one method to enhance the other (Morgan, 1998). The former position maintains that research methods are interdependent (combinant); the latter, that they are in- dependent (additive). Although these two reasons are often used interchangeably in the literature, it is important to make a distinction between them. 4. The Phenomenon of Study It is probably safe to say that certain phenomena lend themselves to quantitative as opposed to qualitative inquiry and vice versa in other instances. Both quantitative and qualitative researchers often appear to study the same phenomena. However, these researchersā€™ deļ¬nition of what the phenomena are and how they can best be described or known differ. Both paradigms may label phenomena identically, but in keeping with their paradigmatic assumptions, these labels refer to different things. For the quantitative researcher, a label refers to an external referent; to a qual- itative researcher, a label refers to a personal interpretation or meaning attached to phenomena. For example, a quantitative researcher might use a factory record as if it were representative of what actually happens in the workplace, whereas a qualitative researcher might interpret it as one of the ways that people in a factory view their work environment (Needleman and Needleman, 1996). Because there is no external referent with which to gauge what the truth is, there is no interest in assessing the record as representative of the one and only reality in the work- place. Rather, the ways people use and describe it are expected to vary due to peopleā€™s differing realities based on such characteristics as gender, age, or role (e.g., employer, manager, worker). Another example is surgical waiting lists. To a quantitative researcher, the list is like a bus queue; patients are taken off the list based on the urgency of need for surgery or some other factors. To a qualitative researcher, the key to understanding the meaning of the list rests with determining how it is organized, managed and used by the people who actively create and maintain it (Pope and Mays, 1993). These two examples demonstrate that although qualitative and quantitative paradigms may use common labels to refer to phenomena, what the labels refer to is not the same. There are differences of phenomena within each paradigm as well. However, the differences in phenomena between the two paradigms are philosoph- ical differences, whereas the difference in phenomena within each paradigm are not. Within the quantitative paradigm, we may compare the results of a magnetic resonance imaging (MRI) scan to those of a computed tomography (CT) scan. Although they may appear to reveal different realities, the use of the scans assumes
  • 7. REVISITING THE QUANTITATIVE-QUALITATIVE DEBATE 49 that there is something to measure that exists independent of our minds. Both scans are trying to approximate or capture the one reality which correlates with the phenomenon of interest. Within the qualitative paradigm, one may compare the results of a phenomenological study to those of a grounded theory study on how nurses cope with the deaths of their patients. These two types of qualitative studies do not assume that external referents for coping skills exist independent of our minds. Having taken the position that the quantitative and qualitative paradigms do not study the same phenomena, it follows that combining the two methods for cross- validation/triangulation purposes is not a viable option. (Cross validation refers to combining the two approaches to study the same phenomenon). Ironically, in a comprehensive review of mixed-method evaluation studies, Greene and Caracelli (1989) found that methodological triangulation was actually quite rare in mixed- method research, used by only 3 of 57 studies. Combining the two approaches in a complementary fashion is also not advisable if the ultimate goal is to study different aspects of the same phenomenon because, as we argue, mixed-methods re- search cannot claim to enrich the same phenomenon under study. The phenomenon under study is not the same across methods. Not only does cross-validation and complementarity in the above context violate paradigmatic assumptions, but it also misrepresents data. Loss of information is a particular risk when attempts are made to unite results from the two paradigms because it often promotes the selective search for similarities in data. 5. Further Considerations in Mixed-Method Research Designs The most frequently used mixed-method designs start with a qualitative pilot study followed by quantitative research (Morgan, 1998). This promotes the mis- perception that qualitative research is only exploratory, cannot stand on its own, and must be validated by quantitative work because the latter is ā€œscientiļ¬cā€ and studies truth. In response, qualitative researchers have increasingly tried to defend their work using quantitative criteria, such as validity and reliability, as deļ¬ned in quantitative studies. They also increasingly use computer programs speciļ¬c- ally designed for analysing qualitative data, such as NUD.IST or Ethnograph, in quantitative (counting) ways. These practices seriously violate the assumptions of the qualitative paradigm(s). For research to be valid or reliable in the narrow (quantitative) sense requires that what is studied be independent of the inquirer and be described without distortion by her interests, values, or purposes (Smith and Heshusius, 1986). This is not how qualitative studies unfold. They are based on the minimum distance between the investigator and the investigated, and seek multiple deļ¬nitions of reality embedded in various respondentsā€™ experiences. Therefore, it is more appropriate for qualitative researchers to apply parallel but distinct canons of rigor appropriate to qualitative studies (Strauss and Corbin, 1990).
  • 8. 50 JOANNA E. M. SALE ET AL. It is difļ¬cult to say whether the growing trend of quantifying qualitative research is a direct result of mixing quantitative and qualitative approaches. It does seem to be a result of researchers from the two paradigms attempting to work together, or the desire for qualitative research to be ā€œtaken seriouslyā€ in the world of positivist research, such as is commonly found in medicine. In our opinion, mixing research methods across paradigms, as is currently practiced, often diminishes the value of both methods. Pressure is being exerted from the quantitative camp for qualitative research to ā€œmeasure upā€ to its standards without understanding the basic premises of qualitative investigations. Proponents of the qualitative paradigm need to ad- dress this pressure, but ā€œwithout slipping on the mantle of quantitative inquiryā€ (Smith and Heshusius, 1986: 10). This pressure will no doubt continue to escalate as combined methods research becomes more common. 6. Our Solution The key issues in the quantitative-qualitative debate are ontological and epistem- ological. Quantitative researchers perceive truth as something which describes an objective reality, separate from the observer and waiting to be discovered. Qualit- ative researchers are concerned with the changing nature of reality created through peopleā€™s experiences ā€“ an evolving reality in which the researcher and researched are mutually interactive and inseparable (Phillips, 1988b). Because quantitative and qualitative methods represent two different paradigms, they are incommensurate. As Guba states, ā€œthe one [paradigm] precludes the other just as surely belief in a round world precludes belief in a ļ¬‚at oneā€ (1987: 31). Fundamental to this view- point is that qualitative and quantitative researchers do not, in fact, study the same phenomena. We propose a solution to mixed-methods research and the quantitative- qualitative debate. Qualitative and quantitative research methods have grown out of, and still represent, different paradigms. However, the fact that the approaches are incommensurate does not mean that multiple methods cannot be combined in a single study if it is done for complementary purposes. Each method studies different phenomena. The distinction of phenomena in mixed-methods research is crucial and can be clariļ¬ed by labelling the phenomenon examined by each method. For example, a mixed-methods study to develop a measure of burnout ex- perienced by nurses could be described as a qualitative study of the lived experience of burnout to inform a quantitative measure of burnout. Although the phenomenon ā€˜burnoutā€™ may appear the same across methods, the distinction between ā€œlived experienceā€ and ā€œmeasureā€ reconciles the phenomenon to its respective method and paradigm. This solution differs from that of merely using the strengths of each method to bolster the weaknesses of the other(s), or capturing various aspects of the same phe- nomena. This implies an additive outcome for mutual research partners. Based on
  • 9. REVISITING THE QUANTITATIVE-QUALITATIVE DEBATE 51 this assertion, qualitative and quantitative work can be carried out simultaneously or sequentially in a single study or series of investigations. 7. Implications Given that we have returned to debate in a no-debate world, what is the outlook for mixed-paradigm research? As Phillips (1988a) points out, it may be that quant- itative and qualitative approaches are inadequate to the task of understanding the emerging science of wholeness because they give an incomplete view of people in their environments. Perhaps in a ā€œKuhnianā€ sense, a new paradigm is in order, one with a new ontology, epistemology, and methodology. Alternatively, we have proposed seeking complementarity which we believe is both philosophically and practically sound. This solution lends itself to new standards for mixed-paradigm research. We hope that future guidelines which assess the quality of such research consider this recommendation. References Altheide, D. L. & Johnson, J. M. (1994). Criteria for assessing interpretive validity in qualitative research. In: Denzin, N. K. & Lincoln, Y. S. (eds), Handbook of Qualitative Research. Thousand Oaks, CA: Sage Publications, pp. 485ā€“499. Baum, F. (1995). Researching public health: Behind the qualitative-quantitative methodological debate. Social Science and Medicine 40: 459ā€“468. Berger, P. L. & Luckmann, T. (1966). The Social Construction of Reality: A Treatise in the Sociology of Knowledge. Garden City, NY: Doubleday. Caracelli, V. J. & Greene, J. C. (1993). Data analysis strategies for mixed-method evaluation designs. Educational Evaluation and Policy Analysis 15: 195ā€“207. Caracelli, V. J. & Riggin, L. J. C. (1994). Mixed-method evaluation: Developing quality criteria through concept mapping. Evaluation Practice 15: 139ā€“152. Carey, J. W. (1993). Linking qualitative and quantitative methods: Integrating cultural factors into public health. Qualitative Health Research 3: 298ā€“318. Casebeer, A. L. & Verhoef, M. J. (1997). Combining qualitative and quantitative research methods: Considering the possibilities for enhancing the study of chronic diseases. Chronic Diseases in Canada 18: 130ā€“135. Clarke, P. N. & Yaros, P. S. (1988). Research blenders: Commentary and response. Nursing Science Quarterly 1: 147ā€“149. Creswell, J.W. (1998). Qualitative Inquiry and Research Design: Choosing Among Five Traditions. Thousand Oaks, CA: Sage Publications. Datta, L. (1997). Multimethod evaluations: Using case studies together with other methods. In: E. Chelimsky & W. R. Shadish (eds.), Evaluation for the 21st Century: A Handbook. Thousand Oaks, CA: Sage Publications, pp. 344ā€“359. Denzin, N. K. (1970). The Research Act in Sociology. London: Butterworth. Denzin, N. K. & Lincoln, Y. S. (1994). Introduction: Entering the ļ¬eld of qualitative research. In: N. K. Denzin & Y. S. Lincoln (eds.), Handbook of Qualitative Research. Thousand Oaks, CA: Sage, pp. 1ā€“17. Droitcour, J. A. (1997). Cross design synthesis: Concept and application. In: E. Chelimsky, & Shadish, W. R. (eds), Evaluation for the 21st Century: A Handbook. Thousand Oaks, CA: Sage Publications, pp. 360ā€“372.
  • 10. 52 JOANNA E. M. SALE ET AL. Greene, J. C. & Caracelli, V. J. (eds) (1997). Advances in Mixed-Method Evaluation: The Challenges and Beneļ¬ts of Integrating Diverse Paradigms. San Francisco: Jossey-Bass Publishers. Greene, J. C., Caracelli, V. J. & Graham, W. F. (1989). Toward a conceptual framework for mixed- method evaluation designs. Educational Evaluation and Policy Analysis 11: 255ā€“274. Guba, E. (1987). What have we learned about naturalistic evaluation? Evaluation Practice 8: 23ā€“43. Guba, E. G. (1990). The alternative paradigm dialog. In: E. G. Guba (ed.), The Paradigm Dialog. Newbury Park, CA: Sage, pp. 17ā€“30. Guba, E. G. & Lincoln, Y. S. (1989). Fourth Generation Evaluation. Newbury Park, CA: Sage Publications. Guba, E. G. & Lincoln, Y. S. (1994). Competing paradigms in qualitative research. In: N. K. Denzin & Y. S. Lincoln (eds), Handbook of Qualitative Research. Thousand Oaks, CA: Sage, pp. 105ā€“ 117. Haase, J. E. & Myers, S. T. (1988). Reconciling paradigm assumptions of qualitative and quantitative research. Western Journal of Nursing Research 10: 128ā€“137. House, E. R. (1994). Integrating the quantitative and qualitative. In: C. S. Reichardt & S. F. Rallis (eds), The Qualitative-Quantitative Debate: New Perspectives. San Francisco: Jossey-Bass, pp. 13ā€“22. Howe, K. R. (1988). Against the quantitative-qualitative incompatibility thesis or dogmas die hard. Educational Researcher 17: 10ā€“16. Howe, K. R. (1992). Getting over the quantitative-qualitative debate. American Journal of Education 100: 236ā€“257. King, G., Keohane, R. O. & Verba, S. (1994). Designing Social Inquiry: Scientiļ¬c Inference in Qualitative Research. Princeton: Princeton University Press. Kuzel, A. J. & Like, R. C. (1991). Standards of trustworthiness for qualitative studies in primary care. In: P. G. Norton, M. Steward, F. Tudiver, M. J. Bass & E. V. Dunn (eds.), Primary Care Research. Newbury Park, CA: Sage Publications, pp. 138ā€“158. Miles, M. & Huberman, A. (1984). Drawing valid meaning from qualitative data: Toward a shared craft. Educational Researcher 13: 20ā€“30. Morgan, D. L. (1998). Practical strategies for combining qualitative and quantitative methods: Applications to health research. Qualitative Health Research 8: 362ā€“376. Morse, J. M. (1991). Approaches to qualitative-quantitative methodological triangulation. Nursing Research 40: 120ā€“123. Needleman, C. & Needleman, M. L. (1996). Qualitative methods for intervention research. American Journal of Industrial Medicine 29: 329ā€“337. Phillips, J. R. (1988a). Diggers of deeper holes. Nursing Science Quarterly 1: 149ā€“151. Phillips, J. R. (1988b). Research blenders. Nursing Science Quarterly 1: 4ā€“5. Pope, C. & Mays, N. (1993). Opening the black box: An encounter in the corridors of health sciences research. British Medical Journal 306: 315ā€“318. Reichardt, C. S. & Rallis, S. F. (1994). Qualitative and quantitative inquiries are not incompatible: A call for a new partnership. New Directions for Program Evaluation 61: 85ā€“91. Reid, A. J. (1996). What we want: Qualitative research. Canadian Family Physician 42: 387ā€“389. Sandelowski, M. (1986). The problem of rigour in qualitative research. Advances in Nursing Science 8: 27ā€“37. Secker, J., Wimbush, E., Watson, J. & Milburn, K. (1995). Qualitative methods in health promotion research: Some criteria for quality. Health Education Journal 54: 74ā€“87. Smith, J. K. (1983). Quantitative versus qualitative research: An attempt to clarify the issue. Educational Researcher 12: 6ā€“13. Smith, J. K. & Heshusius, L. (1986). Closing down the conversation: The end of the quantitative- qualitative debate among educational inquiries. Educational Researcher 15: 4ā€“12.
  • 11. REVISITING THE QUANTITATIVE-QUALITATIVE DEBATE 53 Steckler, A., McLeroy, K. R., Goodman, R. M., Bird, S. T. & McCormick, L. (1992). Toward in- tegrating qualitative and quantitative methods: An introduction. Health Education Quarterly 19: 1ā€“8. Strauss, A. & Corbin, J. (1990). Chapter 1: Introduction. Basics of Qualitative Research: Grounded Theory Procedures and Techniques. Newbury Park, CA: Sage Publications, pp. 23ā€“32. Tashakkori, A. & Teddlie, C. (1998). Mixed Methodology: Combining Qualitative and Quantitative Approaches. Thousand Oaks, CA: Sage Publications.