This document provides an overview of research design concepts for a PhD course. It defines research design as having two levels: the overall logic/structure of the research, and the specific data collection methods. Common research designs discussed include cross-sectional, longitudinal, experimental, and case study approaches. Descriptive and exploratory research are contrasted, and factors like internal/external validity, sampling strategies, and causal inference are examined in the context of sound research design. The document serves as a study guide for understanding key elements involved in defining a research problem and collecting quality evidence to address it.
1. PHD COURSE WORK EXAM STUDY MATERIALS
1. What is research design?
Research design is often confused with choice of research method – the decision to use
qualitative or quantitative methods, for example, or to use face-to-face interviews rather than
telephone, or an omnibus survey rather than a tailor-made one. All these decisions are part of the
research design process but they are not the whole of it. It is easiest to think of research design
as having two levels. At the first level, research design is about the logic of the research, its
framework or structure. It is at this level, given what we know about the nature of the research
enquiry (exploratory, descriptive or explanatory) that we make decisions about whether to use a
cross-sectional, a longitudinal, an experimental design or a case study – or a combination of
these. At the second level it is about the ‘mechanics’ of the research – what type of data
(primary or secondary, qualitative or quantitative or a combination), what method of data
collection, what sampling strategy, and so on. The first level is about designing the overall
structure of the research so that it delivers the evidence needed to answer the research problem;
the second level concerns decisions about how to collect that evidence.
Q. What is involved in:
(a) first level of research design?
Defining the research problem
Thinking about the end use of the data
Deciding on the sort of evidence you need
Deciding on the logic and structure of the research
Choosing the research design that will deliver the evidence you need
(b) second level of research design?
Deciding on the type of data and the method of data collection:
Primary or secondary or both
Quantitative or qualitative or both
Face-to-face, telephone, groups, in-depth interviews and so on
Designing a sampling strategy:
Identifying the target population
Identifying the sampling units and the sample elements
Choosing a sampling approach
Choosing a sample size
Designing the data collection instrument:
Defining the concepts, choosing indicators, operationalising the concepts
Designing the questionnaire or discussion guide
2. Why is research design important?
2. Research design is important because we rely on it to deliver the evidence necessary to answer
the research problem as accurately, clearly and unequivocally as possible. A sound research
design is the framework on which good quality research is built.
3. What do the following terms mean: internal validity and external validity?
Validity is a key concept in assessing the quality of research. It refers to how well a research
design (and the research method and the measures or questions used) measures what it claims to
measure – in other words, how well it gives us clear and unequivocal evidence with which to
answer the research problem.
Internal validity in the context of research design refers to the ability of the research to deliver
credible evidence to address the research problem. Put another way, the job of the research
design is to ensure that the research has internal validity. In causal or explanatory research, for
example, it is about the ability of the research design to allow us to make links or associations
between variables, to rule out alternative explanations or rival hypotheses and to make inferences
about causality. Internal validity is important when designing questions and questionnaires. In
this context, internal validity refers to the ability of the questions to measure what it is we think
they are measuring.
When a piece of research has external validity it means that we can generalise from the research
conducted among the sample (or in the specific setting) to the wider population (or setting).
4. Describe what is meant by exploratory and descriptive research. Give examples of each type
of enquiry.
Exploratory research enquiry, as its name suggests, aims to explore. It is used, for example, to
identify a problem, clarify the nature of it and define the scope of it, to look for insights, develop
propositions and hypotheses for further research, to reach a greater understanding of an issue. It
contributes to the development of a research design and should be thought of as a first stage in
the research design process.
Descriptive research is about finding the answers to the Who? What? Where? When? How? and
How many? questions. In descriptive research, in comparison to exploratory research, you have
a clearer idea of what is needed and are looking for answers to more clearly defined questions.
Descriptive studies might tell you, for example, the size of a market, the structure of the market,
developments over time, attitudes of particular groups of people and so on.
5. What is the aim of causal research?
The aim of causal research is to provide explanations. It is also known as explanatory research
for that reason. For example, it might be used to find out why people buy brand A and not brand
B or why some people are in favour of capital punishment and others are not. It can be used to
rule out rival explanations and come to a conclusion.
6. To make sound causal inferences what sort of evidence must a research design provide?
In order to make sound inferences about cause, we must make sure that the research design
allows us to:
look for the presence of association, covariance or correlation
3. look for an appropriate time sequence
rule out other variables as the cause
come to plausible or common sense conclusions.
7. Describe:
(a) what is involved in a cross-sectional research design; give examples.
Cross-sectional research design allows you to collect data from a cross-section of a population at
one point in time. A single cross-sectional design involves only one wave or round of data
collection – data are collected from a sample on one occasion only. A repeated cross-sectional
design involves conducting more than one wave of (more or less) the same research with an
independent or fresh sample each time. The use of an independent sample at each round of data
collection is what distinguishes repeated cross-sectional design from longitudinal research. In
longitudinal research, data are collected from the same sample on more than one occasion.
A cross-sectional design can be used to provide data for an exploratory or descriptive research
enquiry – to understand the health information needs of older people, for example. It can also be
used to look for and examine relationships between variables; to test out ideas and hypotheses; to
help decide which explanation or theory best fits with the data; and to help establish causal
direction but not to prove cause. For example, it might be used to determine what factors are
involved in the decision to take out critical illness benefit insurance, and the relationship between
the factors.
(b) what is involved in a longitudinal research design; give examples.
Longitudinal research involves collecting data from the same sample (of individuals or
organisations, for example) on more than one occasion. The number and frequency of the
snapshots or data collection points depends largely on the research objectives. For example, if
the purpose of the research is to look at the immediate, short-term impact of an advertising
campaign, a relatively small number of data collection points, fairly closely spaced in time, may
suffice; to examine the longer term impact of advertising on a brand may require a relatively
large number of data collection points over many years.
The main application of longitudinal design is to monitor changes in the marketing or social
environment, changes that occur in the normal course of things and events that are planned, for
example, changes as a result of an advertising campaign, a new product launch or an election.
Longitudinal design can be used to provide data for descriptive research enquiry. Although it
cannot be used to prove cause, it can be used to:
explore and examine relationships between variables
establish the time order of events or changes, and age or historical effects
help decide which explanation or theory best fits with the data
help establish causal direction (rather than prove cause).
(c) what distinguishes a repeated cross-sectional design from a longitudinal design.
What distinguishes longitudinal designs from repeated cross-sectional designs is that in
longitudinal designs data are collected from the same sample on more than one occasion, rather
than from independent or fresh samples each time.
4. 8. Describe the main stages in an experimental research design. Give an example of the
application of an experimental design.
Two identical samples or groups are recruited: one is known as the test group, the other is the
control group. The test and control groups are matched on key criteria – in other words, the two
are the same on all key characteristics. The independent variable – the one that is thought to
cause or explain the change – is manipulated to see the effect that this change has on the
dependent variable. This is referred to as the treatment. The treatment is applied to the test
group but not to the control group. The purpose of the test group is to observe the effect of the
treatment; the purpose of the control group is to act as a comparison. Since the treatment is not
applied to the control group, any changes that take place will not be due to the independent
variable but to some other factor(s). The design of the experiment should be such that the effect
of other factors is limited or controlled. Comparison of the test and control group allows us to
determine the extent of the change that is due to the independent variable only. This type of
experimental design is called the ‘after with a control group’. There are variations to this
design: when the independent variable and the dependent variable are measured in both groups
before the ‘treatment’ takes place the design is called a ‘before and after’; if a control group is
used it is called, not surprisingly, a ‘before and after with a control’.
The main application of experimental research designs is to determine whether a causal
relationship exists and the nature of the relationship, and to rule out the effects of other variables
and to establish the time order or sequence of events (which is the cause and which is the effect).
It is used in marketing experiments, for example, to make decisions about elements of the
marketing mix, to evaluate effectiveness of advertisement A or B, or the weight of advertising
spend, or the combination of media to be used in a campaign.
An experimental design was used to examine the effects of monetary incentives on response
rates to a mail survey. More specifically, to examine the relative effectiveness of pre-paid cash
incentives, a prize draw for cash and a prize draw for an equivalent value non-cash prize, as
methods of increasing mail survey response rates (Brennan, Hoek and Astridge, 1991).
9. What is case study research? What methods of data collection are suited to a case study
approach?
A case study is an in-depth investigation of a ‘case’ for exploratory, descriptive or explanatory
research purposes, or a combination. A ‘case’ might be, for example, a household, an
organisation, a situation, an event, or an individual's experience. Case study research may
involve examining all aspects of a case – the case as a whole and its constituent parts. For
example, a case study of a particular household may involve data collection from individual
members; in an organisation the elements of the case might be departments and individuals
within departments. A case study design might be made up of several case studies, not just one.
A variety of methods of data collection can be used in a case study, including analysis of
documents, observation and qualitative and quantitative interviewing.
10. What type(s) of research design are suitable for a descriptive research enquiry?
With the exception of experimental designs, which are limited in the descriptive data they can
deliver, all research designs can produce descriptive data. The choice of a particular design, or
5. combination of designs, depends on the precise requirements of the descriptive research enquiry.
Descriptive research (and the design you choose for it) is not limited to a particular research
method or technique. It can involve analysis of secondary data or the collection of primary data,
or a combination of both. Quantitative or qualitative methods or both can be used. Any method
of data collection, from observation to interviewing, is suitable.