SlideShare a Scribd company logo
1 of 33
Commonly used statistical tests
in research
Dr Naqeeb Ullah Khan
Types of Statistics
 Descriptive statistics deals with enumeration,
organization and graphical representation of the data,
e.g. Census data.
 Inferential statistics is concerned with making
conclusions about population characteristics using
information contained in a sample, that is , generalizing
from the specific e.g. an opinion poll, such as the Gallop
Poll.
Population is the set of all measurements of
interest to the researcher.
Sample is any subset of measurements
selected from the population.
Population and Sample
Population and Sample
Population Sample
Examples of Population
1. Average Income of households in Pakistan.
2. Households in Islamabad who own at least
one car.
3. Patients coming to PIMS Hospital
Characteristic of Population and Sample
• Parameter: The set of measurements in a
population may be summarized by a
descriptive characteristic, called a parameter.
e.g. average income of household in Pakistan.
• Statistic: The set of measurements in a sample
may be summarized by a descriptive
characteristic, called a statistic. e.g. sample
mean
Measurement Scales
 Nominal Scale
Male-Female, Well-Sick, Child-Adult, Married-Unmarried
 Ordinal Scale
Unimproved, Improved, Much Improved.
Above average, average, below average etc.
 Intervals Scale
Arbitrary Zero and unit distance e.g. temperature.
 Ratio Scale
Height, weight and length etc.
Hypothesis Testing Decision Chart
Null Hypothesis (H0 ) is true
Alternative Hypothesis (H1)
is true
Reject (H0 )
Type I error
()
typically .05 or .01
Correct decision
(Power = 1 - )
typically .80
Don’t reject (H0 )
Correct decision
(1 - )
typically .95 or .99
Type II error
()
typically .20
Reality
Decision

1.96
Critical value
Region of nonrejection Region of rejection
Area=
Testing a mean 0 against a true alternative 1
0
Critical value
1
Region of nonrejection Region of rejection
Sampling distribution of
means when H0 is true
Sampling distribution of
means when H1 is true
Area=
Area=1-
Area=
Level of Measurement
Number of samples Nominal Ordinal Interval/Ratio
1 sample 2 test
Kolmogorov-Smirnoff 1
sample test
1 sample t-test
2 independent samples
2 test
Mann-Whitney U test 2 samples t-test
2 dependent samples McNemar test Wilcoxon test Paired t-test
>2 independent samples 2 test Kruskal-Wallis test ANOVA
>2 dependent samples Cochran Q test Friedman ranks test
Repeated
measures ANOVA
Some Commonly Used Statistical Tests
t-test
A test which compare means two 2 groups
When should the t-distribution be used?
When data variables are continuous
when sample size is small
when population SD is not known.
If you know population SD or your sample size exceeds
25, feel free to use the Standard Normal Distribution
Example: A gynecologist at PIMS feels that pregnant
women coming to the hospital are mostly anemic. She
takes a random sample of 25 pregnant women and test
their Hb level.
Is this average Hb level less than the Hb level of normal
women population? Which is 13.
H0: μ = 13 Ha: μ < 13
Significance level α = 0.5
Test Statistic: t= X- μ0
S⁄√n
X = 11.8 g/dl μ0=13
S = 2.6
t= 11.8 - 13 = -1.2 = -2.32
2.6⁄√25 0.52
-3 -2 -1 0 1 2 3
= 0.25-1.96
ANOVA
When there are more than 2 groups
then we use
ANOVA
(Analysis of Variances)
Multiple Comparison Test
After ANOVA test, to detect which group is
different, many types of test can be
performed.
Among these the most Powerful are
1. Duncan’s Test
2. Tukey’s HSD Test
MANOVA
When we are comparing more than
one variable in more than two groups
Than we use
MANOVA
(Multivariate Analysis of Variances)
ANCOVA
In ANOVA table when there is a
Co-Variant then we use
ANCOVA
(Analysis of Co Variants)
MANCOVA
In ANCOVA table when there are
more than one
Co-Variant then we use
MANCOVA
(Multivariate Analysis of Co Variants)
Chi-square Test
The chi-square test is the most
commonly used method for comparing
frequencies or proportions.
It is a statistical test used to determine if
observed data deviate from those
expected.
χ2 = Σ (O-E)2
E
Observed Expected Total
Heads 108 100 208
Tails 92 100 192
Total 200 200 400
Types of Chi-Square Test
• Chi Square Test Goodness-of-fit
• Chi Square Test of independence
• Chi Square Test of Homogeneity
Normal Distribution
4 5 6 7 8 9 10 11 12
8
7
6
5
4
3
2
1
Age groups in years
Frequency
Standard Deviation
It is the mean deviation of the data
points from the mean
and
by far the most useful measure of
variation
Normal Distribution Curve
Normal Distribution Curve
If the average height for adult men in Pakistan is
70” with a SD of 3”.
― 68% have a height within 67–73 inches
―95% have a height within 64–76 inches
―99.9% have a height within 61-79 inches
If the SD were 0, then all men would be exactly
70”high.
Example: Mean reaction time of a particular drug X
is 10 minutes with SD of 2 minutes .
1) Find 50th percentile reaction time.
Ans: 10 minutes
2) Find 99.9 Percentile reaction time.
X= 3.09 x 2 + 10 = 16.18 minutes
=10
Relationship Between Alpha(),
Sample Size (n), and Power (1-)
Sample Size per Group
20 40 60 80 100 120
Power
50
60
70
80
90
100
Two group t-test of equal means (equal n's)
Æ= 0.025 ( 2) Ê= 0.500
Æ= 0.050 ( 2) Ê= 0.500
Æ= 0.100 ( 2) Ê= 0.500α
α
α δ
δ
δ
n=51 n=64 n=78
power=.80
Example: The mean serum creatinine level measured in 36
patients 24 hours after they received a newly proposed
antibiotic was 1.2 mg/dl. If the mean and standard deviation of
serum creatinine in the general population are 1.0 and 0.4
mg/dl, respectively, then, using a significance level of 0.5, test if
the mean serum creatinine level in this group is different from
that of general population.
H0: μ = 1 Ha: μ ≠ 1
Significance level α = 0.5
Test Statistic: Z = X- μ0
σ⁄√n
X = 1.2 mg/dl σ = 0.4
Z = 1.2 - 1 = 0.2 x 6 = 3
0.4⁄√36 0.4
-3 -2 -1 0 1 2 3
1.96
= 0.25
-1.96
= 0.25
Without data, all you are just
another person with an opinion.
— Unknown
TheEND
Interval Scale Example

More Related Content

What's hot

Parametric vs Nonparametric Tests: When to use which
Parametric vs Nonparametric Tests: When to use whichParametric vs Nonparametric Tests: When to use which
Parametric vs Nonparametric Tests: When to use whichGönenç Dalgıç
 
Inferential statistics.ppt
Inferential statistics.pptInferential statistics.ppt
Inferential statistics.pptNursing Path
 
Sample size calculation
Sample  size calculationSample  size calculation
Sample size calculationSwati Singh
 
Null hypothesis AND ALTERNAT HYPOTHESIS
Null hypothesis AND ALTERNAT HYPOTHESISNull hypothesis AND ALTERNAT HYPOTHESIS
Null hypothesis AND ALTERNAT HYPOTHESISADESH MEDICAL COLLEGE
 
Levels of Measurement
Levels of MeasurementLevels of Measurement
Levels of MeasurementSarfraz Ahmad
 
Inferential Statistics
Inferential StatisticsInferential Statistics
Inferential Statisticsewhite00
 
Normal Distribution
Normal DistributionNormal Distribution
Normal DistributionCIToolkit
 
Sampling distribution
Sampling distributionSampling distribution
Sampling distributionswarna dey
 
Type i and type ii errors
Type i and type ii errorsType i and type ii errors
Type i and type ii errorsp24ssp
 
Statistical Estimation
Statistical Estimation Statistical Estimation
Statistical Estimation Remyagharishs
 
Parametric and nonparametric test
Parametric and nonparametric testParametric and nonparametric test
Parametric and nonparametric testponnienselvi
 
How to choose a right statistical test
How to choose a right statistical testHow to choose a right statistical test
How to choose a right statistical testKhalid Mahmood
 
Types of random sampling
Types of random samplingTypes of random sampling
Types of random samplingStudying
 

What's hot (20)

Parametric vs Nonparametric Tests: When to use which
Parametric vs Nonparametric Tests: When to use whichParametric vs Nonparametric Tests: When to use which
Parametric vs Nonparametric Tests: When to use which
 
Statistical analysis
Statistical  analysisStatistical  analysis
Statistical analysis
 
Inferential statistics.ppt
Inferential statistics.pptInferential statistics.ppt
Inferential statistics.ppt
 
Sample size calculation
Sample  size calculationSample  size calculation
Sample size calculation
 
Null hypothesis AND ALTERNAT HYPOTHESIS
Null hypothesis AND ALTERNAT HYPOTHESISNull hypothesis AND ALTERNAT HYPOTHESIS
Null hypothesis AND ALTERNAT HYPOTHESIS
 
Levels of Measurement
Levels of MeasurementLevels of Measurement
Levels of Measurement
 
Inferential Statistics
Inferential StatisticsInferential Statistics
Inferential Statistics
 
Normal Distribution
Normal DistributionNormal Distribution
Normal Distribution
 
Sampling distribution
Sampling distributionSampling distribution
Sampling distribution
 
Chi squared test
Chi squared testChi squared test
Chi squared test
 
Type i and type ii errors
Type i and type ii errorsType i and type ii errors
Type i and type ii errors
 
Statistical Estimation
Statistical Estimation Statistical Estimation
Statistical Estimation
 
Non parametric tests
Non parametric testsNon parametric tests
Non parametric tests
 
Confidence Intervals
Confidence IntervalsConfidence Intervals
Confidence Intervals
 
Parametric and nonparametric test
Parametric and nonparametric testParametric and nonparametric test
Parametric and nonparametric test
 
How to choose a right statistical test
How to choose a right statistical testHow to choose a right statistical test
How to choose a right statistical test
 
Types of random sampling
Types of random samplingTypes of random sampling
Types of random sampling
 
Tests of significance
Tests of significanceTests of significance
Tests of significance
 
Standard error
Standard error Standard error
Standard error
 
Inferential statistics
Inferential statisticsInferential statistics
Inferential statistics
 

Viewers also liked

Statistical Process Control & Control Chart
Statistical Process Control  & Control ChartStatistical Process Control  & Control Chart
Statistical Process Control & Control ChartShekhar Verma
 
Statistical tests for data involving quantitative data
Statistical tests for data involving quantitative dataStatistical tests for data involving quantitative data
Statistical tests for data involving quantitative dataRizwan S A
 
purposes of assessment
 purposes of assessment purposes of assessment
purposes of assessmentNeilson Silva
 
Chapter 3 research methodology
Chapter 3 research methodologyChapter 3 research methodology
Chapter 3 research methodologyNeilson Silva
 
Choosing appropriate statistical test RSS6 2104
Choosing appropriate statistical test RSS6 2104Choosing appropriate statistical test RSS6 2104
Choosing appropriate statistical test RSS6 2104RSS6
 
Chosing the appropriate_statistical_test
Chosing the appropriate_statistical_testChosing the appropriate_statistical_test
Chosing the appropriate_statistical_testBRAJESH KUMAR PARASHAR
 
Introduction to Practical research
Introduction to Practical research Introduction to Practical research
Introduction to Practical research Neilson Silva
 
Test of significance in Statistics
Test of significance in StatisticsTest of significance in Statistics
Test of significance in StatisticsVikash Keshri
 
Parametric and non parametric test
Parametric and non parametric testParametric and non parametric test
Parametric and non parametric testAjay Malpani
 
Introduction to Elementary statistics
Introduction to Elementary statisticsIntroduction to Elementary statistics
Introduction to Elementary statisticskrizza joy dela cruz
 
Analysis of variance (ANOVA)
Analysis of variance (ANOVA)Analysis of variance (ANOVA)
Analysis of variance (ANOVA)Sneh Kumari
 

Viewers also liked (14)

Statistics in research
Statistics in research Statistics in research
Statistics in research
 
Statistical Process Control & Control Chart
Statistical Process Control  & Control ChartStatistical Process Control  & Control Chart
Statistical Process Control & Control Chart
 
Statistical tests for data involving quantitative data
Statistical tests for data involving quantitative dataStatistical tests for data involving quantitative data
Statistical tests for data involving quantitative data
 
Data analysis
Data analysisData analysis
Data analysis
 
purposes of assessment
 purposes of assessment purposes of assessment
purposes of assessment
 
Chapter 3 research methodology
Chapter 3 research methodologyChapter 3 research methodology
Chapter 3 research methodology
 
Choosing appropriate statistical test RSS6 2104
Choosing appropriate statistical test RSS6 2104Choosing appropriate statistical test RSS6 2104
Choosing appropriate statistical test RSS6 2104
 
Chosing the appropriate_statistical_test
Chosing the appropriate_statistical_testChosing the appropriate_statistical_test
Chosing the appropriate_statistical_test
 
Introduction to Practical research
Introduction to Practical research Introduction to Practical research
Introduction to Practical research
 
Test of significance in Statistics
Test of significance in StatisticsTest of significance in Statistics
Test of significance in Statistics
 
Parametric and non parametric test
Parametric and non parametric testParametric and non parametric test
Parametric and non parametric test
 
Introduction to Elementary statistics
Introduction to Elementary statisticsIntroduction to Elementary statistics
Introduction to Elementary statistics
 
Analysis of variance (ANOVA)
Analysis of variance (ANOVA)Analysis of variance (ANOVA)
Analysis of variance (ANOVA)
 
Statistical ppt
Statistical pptStatistical ppt
Statistical ppt
 

Similar to Commonly used statistical tests in research

Anova single factor
Anova single factorAnova single factor
Anova single factorDhruv Patel
 
Parametric tests seminar
Parametric tests seminarParametric tests seminar
Parametric tests seminardrdeepika87
 
slides Testing of hypothesis.pptx
slides Testing  of  hypothesis.pptxslides Testing  of  hypothesis.pptx
slides Testing of hypothesis.pptxssuser504dda
 
Hypothesis testing: A single sample test
Hypothesis testing: A single sample testHypothesis testing: A single sample test
Hypothesis testing: A single sample testUmme Salma Tuli
 
inferentialstatistics-210411214248.pdf
inferentialstatistics-210411214248.pdfinferentialstatistics-210411214248.pdf
inferentialstatistics-210411214248.pdfChenPalaruan
 
Chapter 5 experimental design for sbh
Chapter 5 experimental design for sbhChapter 5 experimental design for sbh
Chapter 5 experimental design for sbhRione Drevale
 
10. sampling and hypotehsis
10. sampling and hypotehsis10. sampling and hypotehsis
10. sampling and hypotehsisKaran Kukreja
 
Inferential Statistics.pdf
Inferential Statistics.pdfInferential Statistics.pdf
Inferential Statistics.pdfShivakumar B N
 
Hypothesis testing for nonparametric data
Hypothesis testing for nonparametric data Hypothesis testing for nonparametric data
Hypothesis testing for nonparametric data KwambokaLeonidah
 
Presentation chi-square test & Anova
Presentation   chi-square test & AnovaPresentation   chi-square test & Anova
Presentation chi-square test & AnovaSonnappan Sridhar
 
2_5332511410507220042.ppt
2_5332511410507220042.ppt2_5332511410507220042.ppt
2_5332511410507220042.pptnedalalazzwy
 
Sample determinants and size
Sample determinants and sizeSample determinants and size
Sample determinants and sizeTarek Tawfik Amin
 
Chi square test social research refer.ppt
Chi square test social research refer.pptChi square test social research refer.ppt
Chi square test social research refer.pptSnehamurali18
 
Anova single factor
Anova single factorAnova single factor
Anova single factorDhruv Patel
 

Similar to Commonly used statistical tests in research (20)

Anova single factor
Anova single factorAnova single factor
Anova single factor
 
Parametric tests seminar
Parametric tests seminarParametric tests seminar
Parametric tests seminar
 
slides Testing of hypothesis.pptx
slides Testing  of  hypothesis.pptxslides Testing  of  hypothesis.pptx
slides Testing of hypothesis.pptx
 
Anova, ancova
Anova, ancovaAnova, ancova
Anova, ancova
 
Test of significance
Test of significanceTest of significance
Test of significance
 
Shovan anova main
Shovan anova mainShovan anova main
Shovan anova main
 
Hypothesis testing: A single sample test
Hypothesis testing: A single sample testHypothesis testing: A single sample test
Hypothesis testing: A single sample test
 
1 ANOVA.ppt
1 ANOVA.ppt1 ANOVA.ppt
1 ANOVA.ppt
 
spss
spss spss
spss
 
inferentialstatistics-210411214248.pdf
inferentialstatistics-210411214248.pdfinferentialstatistics-210411214248.pdf
inferentialstatistics-210411214248.pdf
 
Chapter 5 experimental design for sbh
Chapter 5 experimental design for sbhChapter 5 experimental design for sbh
Chapter 5 experimental design for sbh
 
10. sampling and hypotehsis
10. sampling and hypotehsis10. sampling and hypotehsis
10. sampling and hypotehsis
 
Inferential Statistics.pdf
Inferential Statistics.pdfInferential Statistics.pdf
Inferential Statistics.pdf
 
Hypothesis testing for nonparametric data
Hypothesis testing for nonparametric data Hypothesis testing for nonparametric data
Hypothesis testing for nonparametric data
 
Presentation chi-square test & Anova
Presentation   chi-square test & AnovaPresentation   chi-square test & Anova
Presentation chi-square test & Anova
 
Inferential statistics
Inferential  statisticsInferential  statistics
Inferential statistics
 
2_5332511410507220042.ppt
2_5332511410507220042.ppt2_5332511410507220042.ppt
2_5332511410507220042.ppt
 
Sample determinants and size
Sample determinants and sizeSample determinants and size
Sample determinants and size
 
Chi square test social research refer.ppt
Chi square test social research refer.pptChi square test social research refer.ppt
Chi square test social research refer.ppt
 
Anova single factor
Anova single factorAnova single factor
Anova single factor
 

Commonly used statistical tests in research

  • 1. Commonly used statistical tests in research Dr Naqeeb Ullah Khan
  • 2. Types of Statistics  Descriptive statistics deals with enumeration, organization and graphical representation of the data, e.g. Census data.  Inferential statistics is concerned with making conclusions about population characteristics using information contained in a sample, that is , generalizing from the specific e.g. an opinion poll, such as the Gallop Poll.
  • 3. Population is the set of all measurements of interest to the researcher. Sample is any subset of measurements selected from the population. Population and Sample
  • 5. Examples of Population 1. Average Income of households in Pakistan. 2. Households in Islamabad who own at least one car. 3. Patients coming to PIMS Hospital
  • 6. Characteristic of Population and Sample • Parameter: The set of measurements in a population may be summarized by a descriptive characteristic, called a parameter. e.g. average income of household in Pakistan. • Statistic: The set of measurements in a sample may be summarized by a descriptive characteristic, called a statistic. e.g. sample mean
  • 7. Measurement Scales  Nominal Scale Male-Female, Well-Sick, Child-Adult, Married-Unmarried  Ordinal Scale Unimproved, Improved, Much Improved. Above average, average, below average etc.  Intervals Scale Arbitrary Zero and unit distance e.g. temperature.  Ratio Scale Height, weight and length etc.
  • 8. Hypothesis Testing Decision Chart Null Hypothesis (H0 ) is true Alternative Hypothesis (H1) is true Reject (H0 ) Type I error () typically .05 or .01 Correct decision (Power = 1 - ) typically .80 Don’t reject (H0 ) Correct decision (1 - ) typically .95 or .99 Type II error () typically .20 Reality Decision
  • 9.  1.96 Critical value Region of nonrejection Region of rejection Area=
  • 10. Testing a mean 0 against a true alternative 1 0 Critical value 1 Region of nonrejection Region of rejection Sampling distribution of means when H0 is true Sampling distribution of means when H1 is true Area= Area=1- Area=
  • 11.
  • 12. Level of Measurement Number of samples Nominal Ordinal Interval/Ratio 1 sample 2 test Kolmogorov-Smirnoff 1 sample test 1 sample t-test 2 independent samples 2 test Mann-Whitney U test 2 samples t-test 2 dependent samples McNemar test Wilcoxon test Paired t-test >2 independent samples 2 test Kruskal-Wallis test ANOVA >2 dependent samples Cochran Q test Friedman ranks test Repeated measures ANOVA Some Commonly Used Statistical Tests
  • 13. t-test A test which compare means two 2 groups When should the t-distribution be used? When data variables are continuous when sample size is small when population SD is not known. If you know population SD or your sample size exceeds 25, feel free to use the Standard Normal Distribution
  • 14. Example: A gynecologist at PIMS feels that pregnant women coming to the hospital are mostly anemic. She takes a random sample of 25 pregnant women and test their Hb level. Is this average Hb level less than the Hb level of normal women population? Which is 13. H0: μ = 13 Ha: μ < 13 Significance level α = 0.5 Test Statistic: t= X- μ0 S⁄√n X = 11.8 g/dl μ0=13 S = 2.6 t= 11.8 - 13 = -1.2 = -2.32 2.6⁄√25 0.52 -3 -2 -1 0 1 2 3 = 0.25-1.96
  • 15. ANOVA When there are more than 2 groups then we use ANOVA (Analysis of Variances)
  • 16. Multiple Comparison Test After ANOVA test, to detect which group is different, many types of test can be performed. Among these the most Powerful are 1. Duncan’s Test 2. Tukey’s HSD Test
  • 17. MANOVA When we are comparing more than one variable in more than two groups Than we use MANOVA (Multivariate Analysis of Variances)
  • 18. ANCOVA In ANOVA table when there is a Co-Variant then we use ANCOVA (Analysis of Co Variants)
  • 19. MANCOVA In ANCOVA table when there are more than one Co-Variant then we use MANCOVA (Multivariate Analysis of Co Variants)
  • 20. Chi-square Test The chi-square test is the most commonly used method for comparing frequencies or proportions. It is a statistical test used to determine if observed data deviate from those expected. χ2 = Σ (O-E)2 E
  • 21. Observed Expected Total Heads 108 100 208 Tails 92 100 192 Total 200 200 400
  • 22. Types of Chi-Square Test • Chi Square Test Goodness-of-fit • Chi Square Test of independence • Chi Square Test of Homogeneity
  • 23. Normal Distribution 4 5 6 7 8 9 10 11 12 8 7 6 5 4 3 2 1 Age groups in years Frequency
  • 24. Standard Deviation It is the mean deviation of the data points from the mean and by far the most useful measure of variation
  • 27.
  • 28. If the average height for adult men in Pakistan is 70” with a SD of 3”. ― 68% have a height within 67–73 inches ―95% have a height within 64–76 inches ―99.9% have a height within 61-79 inches If the SD were 0, then all men would be exactly 70”high.
  • 29. Example: Mean reaction time of a particular drug X is 10 minutes with SD of 2 minutes . 1) Find 50th percentile reaction time. Ans: 10 minutes 2) Find 99.9 Percentile reaction time. X= 3.09 x 2 + 10 = 16.18 minutes =10
  • 30. Relationship Between Alpha(), Sample Size (n), and Power (1-) Sample Size per Group 20 40 60 80 100 120 Power 50 60 70 80 90 100 Two group t-test of equal means (equal n's) Æ= 0.025 ( 2) Ê= 0.500 Æ= 0.050 ( 2) Ê= 0.500 Æ= 0.100 ( 2) Ê= 0.500α α α δ δ δ n=51 n=64 n=78 power=.80
  • 31. Example: The mean serum creatinine level measured in 36 patients 24 hours after they received a newly proposed antibiotic was 1.2 mg/dl. If the mean and standard deviation of serum creatinine in the general population are 1.0 and 0.4 mg/dl, respectively, then, using a significance level of 0.5, test if the mean serum creatinine level in this group is different from that of general population. H0: μ = 1 Ha: μ ≠ 1 Significance level α = 0.5 Test Statistic: Z = X- μ0 σ⁄√n X = 1.2 mg/dl σ = 0.4 Z = 1.2 - 1 = 0.2 x 6 = 3 0.4⁄√36 0.4 -3 -2 -1 0 1 2 3 1.96 = 0.25 -1.96 = 0.25
  • 32. Without data, all you are just another person with an opinion. — Unknown TheEND