1.2 Study Designs,
Data Types,
Choosing Statistical
Tests, Data Analysis
Checklist
Dr. Mohamed Ayoub Mortagy, MD
www.simpleresearch.net
info@simpleresearch.net
Pyramid of evidence
Source: wikipedia
https://dobifipanasidi.balmettes.com/what-is-a-
research-design-16228lt.html
Observational
vs
interventional
(experimental)
studies
Similarity: both study relation
between risk factor / exposure and
outcome
Observational studies: exposure is
not assigned by investigators
Interventional studies: exposure is
assigned by investigators
Case
Report and
case series
Discusses only 1 patient case with a rare finding or outcome or
atypical case
Low evidence
No generalization / inference
No statistics involved
Case report example:
https://pubmed.ncbi.nlm.nih.gov/32923205/
Case series example:
https://www.cdc.gov/mmwr/preview/mmwrhtml/june_5.htm
Analytical
observational
studies
No intervention
Stronger evidence level than case
reports and series
Analysis using statistics
Measures relation between
exposure / risk factor and outcome
Analytical
observational
studies
Cross-sectional / survey
studies (one point of time)
Case control study
(retrospective)
Cohort (prospective or
retrospective)
Cross
sectional
study design
• https://journal.chestnet.org/article/S0012-3692(20)30462-1/fulltext
Cross sectional
study design
• https://deakin.libguides.com/q
uantitative-study-designs/cross-
sectional
Cross sectional
results
• https://slideplayer.com/slide/44
01625/
Cross sectional Pros and Cons
Pros
Cheap
Simple
Quick
Ethically safe
Cons
• Establish association not
causality
• Recall bias (e.g., surveys)
• Confounders
• Unequal group sizes
https://www.sciencedirect.com/topics/pharmacol
ogy-toxicology-and-pharmaceutical-
science/confounder
Cross sectional
study example
https://pubmed.ncbi.nlm.nih.gov/3
2657323/
How to
avoid
confounding
During study design:
randomization and/or
matching
During study analysis:
multivariate regression
analysis to statistically adjust
for confounders
Case control
study Design
• https://deakin.libguides.com/
quantitative-study-
designs/casecontrol
Case control
results
Case Control Pros and Cons
Pros
Quick
Cheap
Suitable for rare disorders
Fewer subjects needed than cross-sectional
studies
Cons
• Rely on recall or record
• Confounders
• Selection of control group is
difficult
• Selection bias may be present
Case control study
example
https://pubmed.ncbi.nlm.nih.gov/32
463179/
Prospective cohort study design
• https://deakin.libguide
s.com/quantitative-
study-
designs/cohortstudies
Retrospective
cohort study
design
• https://deakin.libguides.com/
quantitative-study-
designs/cohortstudies
Cohort Study
results
• https://slidetodoc.com/cohor
t-study-designs-ahmed-mandil-
dept-of-family/
Cohort Pros and Cons
Pros
Ethically safe
Matching of subjects
Standardized eligibility criteria
and outcome assessment
Cons
• Exposure may be linked to a
hidden confounder
• Blinding is difficult
• No randomization
• Not suitable for rare diseases
Cohort Study
example
https://pubmed.ncbi.nlm.nih.gov/3
3450302/
Analytical
observational
studies summary
• https://www.nature.com/arti
cles/6400436
Randomized
controlled
trial study
design
• https://www.ebmconsult.co
m/articles/randomized-
controlled-trial-rct
Randomization
• https://www.cancerresearc
huk.org/find-a-clinical-
trial/what-clinical-trials-
are/randomised-trials
Double
blinding
• https://www.medindia.net/
news/healthinfocus/cause-of-
disease-should-be-considered-
in-randomized-double-blind-
clinical-trials-153394-1.htm
Source:
Wikipedia
RCT Pros and Cons
Pros
• Blinding
• Randomization
• less confounding
Cons
Expensive
Time consuming
Ethical issues
Randomized
trial design
types
Parallel trials
Cross-over trial
Matched pair trial
Withdrawal trials
Factorial trials
https://toolbox.eupati.eu/resources/clinical-trial-designs
https://toolbox.eupati.eu/resources/clinical-trial-designs
https://toolbox.eupati.eu/resources/clinical-trial-designs
https://toolbox.eupati.eu/resources/clinical-trial-designs
Randomized controlled trial example
https://pubmed.ncbi.nlm.nih.gov/32492084/
https://fadic.net/Less
ons/what-is-
systematic-review-
and-meta-analysis-
2/systematic-and-
literature-review/
https://uj.ac.za.libguides.com/c.php?g=1001386
https://libguides.uwf.edu/c.php?g=815337&p=5818571
https://libguides.uwf.edu/c.php?g=815337&p=5818571
Reviews
example Narrative / literature review:
https://pubmed.ncbi.nlm.nih.gov/32850602/
Systematic review:
https://pubmed.ncbi.nlm.nih.gov/32725955/
Metanalysis:
https://pubmed.ncbi.nlm.nih.gov/32860962/
Data variables
types
• https://present5.com/looking
-at-data-clinical-data-example-
n/
• https://bolt.mph.ufl.e
du/2013/06/14/types-
of-variables/
https://revisesociology.com/2019/10/11/variables-in-quantitative-reserach/
https://www.intellspot.com/data-types/
Quantitative
(numerical
data)
Types
Continuous Discrete (counts)
Examples: Age, blood
pressure, BMI, Pulse
Categorical
Binary examples: dead / alive –
treatment / placebo – disease / no
disease – exposed / not exposed
Nominal (unordered) examples: blood
types – marital status
Ordinal (ordered) examples: cancer
staging – ratings on likert scale – age
in categories
Time
to
event
variables Time taken for an event to
happen
Examples: time to death – time
to heart attack – time to
chronic kidney disease – time
to cancer mortality
https://www.bmj.co
m/about-
bmj/resources-
readers/publications
/statistics-square-
one/1-data-display-
and-summary
Dependent vs. independent variables
• https://www.tobiipro.co
m/learn-and-
support/learn/steps-in-an-
eye-tracking-
study/design/what-are-
experimental-variables/
Choosing statistical test
Outcome variable Independent or Paired observations? Non parametric tests
Independent Paired
Continuous T test (2 groups)
ANOVA (> 2 groups)
Linear correlation
Linear regression
Paired T test
Repeated measures anova
GEE model
Wilcoxon signed rank test
Wilcoxon rank sum test
Kruskal wallis test
Spearman rank correlation coefficient
Binary or categorical Risk difference or relative risk
Chi square test
Logistic regression
Mcnemar’s test
Conditional logistic regression
Fischer’s exact test
Mcnemar’s exact test
Counts Rate ratio
Poisson regression
GEE model Negative binomial regression
Time to event Rate ratio
Kaplan Meier statistics
Cox regression
Counting process model Time varying effects
https://miro.medium.com/focal/1200/900/2/
2/1*dg_yj0Zr_6EJtHLVJgf29g.jpeg
Data analysis check list
Prepare the
data
1
Check the data
2
Study your
variables
3
Deal with
missing data
4
Explore simple
relations and
assumptions
5
Prepare a
descriptive
table
6
Test the main
hypothesis
7
Build final
models and
accompanying
graphics
8
Perform
sensitivity
analysis
9
Prepare final
code and
procedure
documents
10
1.2 study designs, data types, choosing statistical tests, data analysis checklist

1.2 study designs, data types, choosing statistical tests, data analysis checklist