SlideShare a Scribd company logo
1 of 2
Download to read offline
LITERATURE REFERENCE JUSTIFICATIONS FOR 
                           TRANSFORMATIONS TO NORMALITY 
                  Copyright 2012 by John N. Zorich Jr., and Zorich Consulting & Training 
 
Whenever a statistical method is chosen to analyze product data that has been generated by a 
verification or validation study, it is essential that that analysis be preceded by an evaluation of whether 
or not the distribution of the data violates the assumption of the statistical method. When that 
method's distribution assumption is normality, and when non‐normality is suspected, a legitimate 
option is to transform the data into as close to normality as possible; subsequently, the originally chosen 
statistical method is used as if the transformed data were the original data, when compared to the 
similarly transformed study criteria. Here are several relevant quotes (all underlining below was added): 
 
         "Most of the statistical methodology presented in this section ["Basic Statistical Methods"] 
         assumes that the quality characteristic follows a known probability distribution. The analysis and 
         conclusions that result are, of course, valid only to the extent that the distribution assumption is 
         correct....Sometimes a set of data does not fit one of the standard distributions such as the 
         normal distribution. One approach uses 'distribution‐free' statistical methods...Some other 
         approaches to analysis are....Make a transformation of the original characteristic to a new 
         characteristic that is normally distributed." 
         [ J. M. Juran & F. M. Gryna's Juran's Quality Control Handbook, edition IV, 1988 by McGraw‐Hill, 
         Inc.; pages 23.91‐23.92, in the section entitled "Transformations of Data" ] 
          
         "Essentially, all the standard techniques for statistical analysis and interpretation of 
         measurement data...are based upon assumed normality of the underlying distribution 
         involved....Real‐life data do not always conform to the conditions required....When this is the 
         case, a transformation (change of scale) applied to the raw data may put the data in such form 
         that the appropriate conventional analysis can be performed validly."  
         [M. G. Natrella, Experimental Statistics, 1963 by the National Bureau of Standards as "Handbook 
         91"; Chapter 20 (entitled "The Use of Transformations"), page 20‐1 ] 
          
         "After the transformation is made and the mean and standard deviation have been computed, 
         standard methods applicable to normally distributed variables can be used to determine 
         reliability‐confidence relationships. The reliability numbers are directly applied to the original 
         data without modification."  
         [ B. L. Amstadter, Reliability Mathematics, 1971 by McGraw‐Hill, Inc., page 90 ]    
          
         "Many physical situations produce data that are normally distributed; others, data that follow 
         some other known distribution; and still others, data that can be transformed to normal 
         data....An easy way to decide whether one of these transformations is likely to produce 
         normality is to make use of [a normal probability plot]."  
         [ E. L. Crow, et. al., Statistics Manual, 1960 by Dover Publications, Inc., in a section entitled 
         "Transformations to Obtain Normality", pages 88‐90 ]      
          
         [Regarding the method of Linear Regression that is used to create a "normal probability plot", 
         the degree of linearity of which is positively correlated with the degree of normality of a data 
         set...] "From a graph of the observations, it will often be obvious that the regression curve 
         cannot be a straight line. In many cases, however, it is possible by simple transformations of the 

               Transformations to Normality, Copyright 2012, by John Zorich,   Page 1 of 2 
 
variables to represent the regression curve as a linear relationship between transformed 
    variables.... If the points (x, y), when transformed to points (g(x),f(y)) are grouped about a 
    straight line such that f(y) is normally distributed...then the theory of linear regression may be 
    applied to the transformed observations."  
    [ A. Hald, Statistical Theory with Engineering Applications, 1952 by John Wiley  & Sons, Inc, page 
    558 ] 
     
    "Non‐normality is a way of life, since no characteristic (height, weight, etc.) will have exactly a 
    normal distribution. One strategy to make non‐normal data resemble normal data is by using a 
    transformation....[one such transformation is called "Box‐Cox", which involves determining the 
    best power coefficient, "λ"  ].... "The criterion used to choose λ for the Box‐Cox linearity plot is 
    the value of λ that maximizes the correlation between the transformed x‐values and the y‐
    values when making a normal probability plot of the (transformed) data."  
    [ US National Institute of Standards and Technology, NIST,  Engineering Statistics Handbook 
    website found (October 31, 2012) at   
    www.itl.nist.gov/div898/handbook/pmc/section5/pmc52.htm    
    in section 6.5.2, entitled "What to do when data are non‐normal?" ] 
     
     
     
                                          
     
 




           Transformations to Normality, Copyright 2012, by John Zorich,   Page 2 of 2 
 

More Related Content

What's hot

Branches of statistics
Branches of statisticsBranches of statistics
Branches of statisticscalltutors
 
Exploratory data analysis
Exploratory data analysisExploratory data analysis
Exploratory data analysisgokulprasath06
 
Introduction to statistics
Introduction to statisticsIntroduction to statistics
Introduction to statisticsSantosh Bhandari
 
Characteristics of statistics
Characteristics of statistics Characteristics of statistics
Characteristics of statistics Sarfraz Ahmad
 
CHE Seminar 20 November 2013
CHE Seminar 20 November 2013CHE Seminar 20 November 2013
CHE Seminar 20 November 2013cheweb1
 
Data analysis and Interpretation
Data analysis and InterpretationData analysis and Interpretation
Data analysis and InterpretationMehul Gondaliya
 
Statistical analysis and interpretation
Statistical analysis and interpretationStatistical analysis and interpretation
Statistical analysis and interpretationDave Marcial
 
Statistical Analysis Overview
Statistical Analysis OverviewStatistical Analysis Overview
Statistical Analysis OverviewEcumene
 
Types of Statistics Descriptive and Inferential Statistics
Types of Statistics Descriptive and Inferential StatisticsTypes of Statistics Descriptive and Inferential Statistics
Types of Statistics Descriptive and Inferential StatisticsDr. Amjad Ali Arain
 
Statistics as a discipline
Statistics as a disciplineStatistics as a discipline
Statistics as a disciplineRosalinaTPayumo
 
Level of Measurement, Frequency Distribution,Stem & Leaf
Level of Measurement, Frequency Distribution,Stem & Leaf   Level of Measurement, Frequency Distribution,Stem & Leaf
Level of Measurement, Frequency Distribution,Stem & Leaf Qasim Raza
 
Sergio S Statistics
Sergio S StatisticsSergio S Statistics
Sergio S Statisticsteresa_soto
 
Data Visualization in Exploratory Data Analysis
Data Visualization in Exploratory Data AnalysisData Visualization in Exploratory Data Analysis
Data Visualization in Exploratory Data AnalysisEva Durall
 

What's hot (20)

Branches of statistics
Branches of statisticsBranches of statistics
Branches of statistics
 
Exploratory data analysis
Exploratory data analysisExploratory data analysis
Exploratory data analysis
 
Introduction to statistics
Introduction to statisticsIntroduction to statistics
Introduction to statistics
 
Eda sri
Eda sriEda sri
Eda sri
 
Characteristics of statistics
Characteristics of statistics Characteristics of statistics
Characteristics of statistics
 
CHE Seminar 20 November 2013
CHE Seminar 20 November 2013CHE Seminar 20 November 2013
CHE Seminar 20 November 2013
 
Data analysis and Interpretation
Data analysis and InterpretationData analysis and Interpretation
Data analysis and Interpretation
 
Intro to stats
Intro to statsIntro to stats
Intro to stats
 
Inferential Statistics
Inferential StatisticsInferential Statistics
Inferential Statistics
 
Statistical analysis and interpretation
Statistical analysis and interpretationStatistical analysis and interpretation
Statistical analysis and interpretation
 
Analysis and Interpretation of Data
Analysis and Interpretation of DataAnalysis and Interpretation of Data
Analysis and Interpretation of Data
 
Descriptive statistics
Descriptive statisticsDescriptive statistics
Descriptive statistics
 
Statistical Analysis Overview
Statistical Analysis OverviewStatistical Analysis Overview
Statistical Analysis Overview
 
Types of Statistics Descriptive and Inferential Statistics
Types of Statistics Descriptive and Inferential StatisticsTypes of Statistics Descriptive and Inferential Statistics
Types of Statistics Descriptive and Inferential Statistics
 
Statistics as a discipline
Statistics as a disciplineStatistics as a discipline
Statistics as a discipline
 
Burns And Bush Chapter 15
Burns And Bush Chapter 15Burns And Bush Chapter 15
Burns And Bush Chapter 15
 
Level of Measurement, Frequency Distribution,Stem & Leaf
Level of Measurement, Frequency Distribution,Stem & Leaf   Level of Measurement, Frequency Distribution,Stem & Leaf
Level of Measurement, Frequency Distribution,Stem & Leaf
 
Sergio S Statistics
Sergio S StatisticsSergio S Statistics
Sergio S Statistics
 
Data Visualization in Exploratory Data Analysis
Data Visualization in Exploratory Data AnalysisData Visualization in Exploratory Data Analysis
Data Visualization in Exploratory Data Analysis
 
Presentation1
Presentation1Presentation1
Presentation1
 

Viewers also liked

Viewers also liked (8)

Imputation techniques for missing data in clinical trials
Imputation techniques for missing data in clinical trialsImputation techniques for missing data in clinical trials
Imputation techniques for missing data in clinical trials
 
Stat 4 the normal distribution & steps of testing hypothesis
Stat 4 the normal distribution & steps of testing hypothesisStat 4 the normal distribution & steps of testing hypothesis
Stat 4 the normal distribution & steps of testing hypothesis
 
Testing for normality
Testing for normalityTesting for normality
Testing for normality
 
Lesson 1 normality
Lesson 1   normalityLesson 1   normality
Lesson 1 normality
 
Student's T-Test
Student's T-TestStudent's T-Test
Student's T-Test
 
Student t-test
Student t-testStudent t-test
Student t-test
 
Introduction to t-tests (statistics)
Introduction to t-tests (statistics)Introduction to t-tests (statistics)
Introduction to t-tests (statistics)
 
T test
T testT test
T test
 

Similar to Transformation To Normality, References

Explain how confusing the two (population and a sample) can lead to .pdf
Explain how confusing the two (population and a sample) can lead to .pdfExplain how confusing the two (population and a sample) can lead to .pdf
Explain how confusing the two (population and a sample) can lead to .pdfrastogiarun
 
Levels of Measurement.pdf
Levels of Measurement.pdfLevels of Measurement.pdf
Levels of Measurement.pdfAlemAyahu
 
Chi squared test
Chi squared testChi squared test
Chi squared testDhruv Patel
 
On Confidence Intervals Construction for Measurement System Capability Indica...
On Confidence Intervals Construction for Measurement System Capability Indica...On Confidence Intervals Construction for Measurement System Capability Indica...
On Confidence Intervals Construction for Measurement System Capability Indica...IRJESJOURNAL
 
Pt2520 Unit 6 Data Mining Project
Pt2520 Unit 6 Data Mining ProjectPt2520 Unit 6 Data Mining Project
Pt2520 Unit 6 Data Mining ProjectJoyce Williams
 
Data Analysis & Interpretation and Report Writing
Data Analysis & Interpretation and Report WritingData Analysis & Interpretation and Report Writing
Data Analysis & Interpretation and Report WritingSOMASUNDARAM T
 
BRM_Data Analysis, Interpretation and Reporting Part II.ppt
BRM_Data Analysis, Interpretation and Reporting Part II.pptBRM_Data Analysis, Interpretation and Reporting Part II.ppt
BRM_Data Analysis, Interpretation and Reporting Part II.pptAbdifatahAhmedHurre
 
Statistics From Wikipedia, the free encyclopedia Jump to navigation.pdf
  Statistics From Wikipedia, the free encyclopedia Jump to navigation.pdf  Statistics From Wikipedia, the free encyclopedia Jump to navigation.pdf
Statistics From Wikipedia, the free encyclopedia Jump to navigation.pdfARYAN20071
 
Data Science - Part III - EDA & Model Selection
Data Science - Part III - EDA & Model SelectionData Science - Part III - EDA & Model Selection
Data Science - Part III - EDA & Model SelectionDerek Kane
 
The Importance Of Quantitative Research Designs
The Importance Of Quantitative Research DesignsThe Importance Of Quantitative Research Designs
The Importance Of Quantitative Research DesignsNicole Savoie
 
A Critique Of Anscombe S Work On Statistical Analysis Using Graphs (2013 Home...
A Critique Of Anscombe S Work On Statistical Analysis Using Graphs (2013 Home...A Critique Of Anscombe S Work On Statistical Analysis Using Graphs (2013 Home...
A Critique Of Anscombe S Work On Statistical Analysis Using Graphs (2013 Home...Simar Neasy
 
TYPESOFDATAANALYSIS research methodology .pdf
TYPESOFDATAANALYSIS research methodology .pdfTYPESOFDATAANALYSIS research methodology .pdf
TYPESOFDATAANALYSIS research methodology .pdfMounika711622
 
Inferential Statistics - DAY 4 - B.Ed - AIOU
Inferential Statistics - DAY 4 - B.Ed - AIOUInferential Statistics - DAY 4 - B.Ed - AIOU
Inferential Statistics - DAY 4 - B.Ed - AIOUEqraBaig
 
A Review Of Statistic
A Review Of StatisticA Review Of Statistic
A Review Of Statisticjesulito1716
 
ANALYTIC GENERALIZATION VALIDATING THEORIES THROUGH RESEARCH BY MANAGEMENT P...
ANALYTIC GENERALIZATION  VALIDATING THEORIES THROUGH RESEARCH BY MANAGEMENT P...ANALYTIC GENERALIZATION  VALIDATING THEORIES THROUGH RESEARCH BY MANAGEMENT P...
ANALYTIC GENERALIZATION VALIDATING THEORIES THROUGH RESEARCH BY MANAGEMENT P...Mary Calkins
 
TPCMFinalACone
TPCMFinalAConeTPCMFinalACone
TPCMFinalAConeAdam Cone
 

Similar to Transformation To Normality, References (20)

Nm
NmNm
Nm
 
Explain how confusing the two (population and a sample) can lead to .pdf
Explain how confusing the two (population and a sample) can lead to .pdfExplain how confusing the two (population and a sample) can lead to .pdf
Explain how confusing the two (population and a sample) can lead to .pdf
 
Lessons learnt in statistics essay
Lessons learnt in statistics essayLessons learnt in statistics essay
Lessons learnt in statistics essay
 
Levels of Measurement.pdf
Levels of Measurement.pdfLevels of Measurement.pdf
Levels of Measurement.pdf
 
Chi squared test
Chi squared testChi squared test
Chi squared test
 
Presentation1
Presentation1Presentation1
Presentation1
 
Descriptive Analysis.pptx
Descriptive Analysis.pptxDescriptive Analysis.pptx
Descriptive Analysis.pptx
 
On Confidence Intervals Construction for Measurement System Capability Indica...
On Confidence Intervals Construction for Measurement System Capability Indica...On Confidence Intervals Construction for Measurement System Capability Indica...
On Confidence Intervals Construction for Measurement System Capability Indica...
 
Pt2520 Unit 6 Data Mining Project
Pt2520 Unit 6 Data Mining ProjectPt2520 Unit 6 Data Mining Project
Pt2520 Unit 6 Data Mining Project
 
Data Analysis & Interpretation and Report Writing
Data Analysis & Interpretation and Report WritingData Analysis & Interpretation and Report Writing
Data Analysis & Interpretation and Report Writing
 
BRM_Data Analysis, Interpretation and Reporting Part II.ppt
BRM_Data Analysis, Interpretation and Reporting Part II.pptBRM_Data Analysis, Interpretation and Reporting Part II.ppt
BRM_Data Analysis, Interpretation and Reporting Part II.ppt
 
Statistics From Wikipedia, the free encyclopedia Jump to navigation.pdf
  Statistics From Wikipedia, the free encyclopedia Jump to navigation.pdf  Statistics From Wikipedia, the free encyclopedia Jump to navigation.pdf
Statistics From Wikipedia, the free encyclopedia Jump to navigation.pdf
 
Data Science - Part III - EDA & Model Selection
Data Science - Part III - EDA & Model SelectionData Science - Part III - EDA & Model Selection
Data Science - Part III - EDA & Model Selection
 
The Importance Of Quantitative Research Designs
The Importance Of Quantitative Research DesignsThe Importance Of Quantitative Research Designs
The Importance Of Quantitative Research Designs
 
A Critique Of Anscombe S Work On Statistical Analysis Using Graphs (2013 Home...
A Critique Of Anscombe S Work On Statistical Analysis Using Graphs (2013 Home...A Critique Of Anscombe S Work On Statistical Analysis Using Graphs (2013 Home...
A Critique Of Anscombe S Work On Statistical Analysis Using Graphs (2013 Home...
 
TYPESOFDATAANALYSIS research methodology .pdf
TYPESOFDATAANALYSIS research methodology .pdfTYPESOFDATAANALYSIS research methodology .pdf
TYPESOFDATAANALYSIS research methodology .pdf
 
Inferential Statistics - DAY 4 - B.Ed - AIOU
Inferential Statistics - DAY 4 - B.Ed - AIOUInferential Statistics - DAY 4 - B.Ed - AIOU
Inferential Statistics - DAY 4 - B.Ed - AIOU
 
A Review Of Statistic
A Review Of StatisticA Review Of Statistic
A Review Of Statistic
 
ANALYTIC GENERALIZATION VALIDATING THEORIES THROUGH RESEARCH BY MANAGEMENT P...
ANALYTIC GENERALIZATION  VALIDATING THEORIES THROUGH RESEARCH BY MANAGEMENT P...ANALYTIC GENERALIZATION  VALIDATING THEORIES THROUGH RESEARCH BY MANAGEMENT P...
ANALYTIC GENERALIZATION VALIDATING THEORIES THROUGH RESEARCH BY MANAGEMENT P...
 
TPCMFinalACone
TPCMFinalAConeTPCMFinalACone
TPCMFinalACone
 

More from John Zorich, MS, CQE

Better_Alternatives_to_Sampling_Plans
Better_Alternatives_to_Sampling_PlansBetter_Alternatives_to_Sampling_Plans
Better_Alternatives_to_Sampling_PlansJohn Zorich, MS, CQE
 
Reasonable confidence limits for binomial proportions
Reasonable confidence limits for binomial proportionsReasonable confidence limits for binomial proportions
Reasonable confidence limits for binomial proportionsJohn Zorich, MS, CQE
 
Teaching the Correlation Coefficient
Teaching the Correlation CoefficientTeaching the Correlation Coefficient
Teaching the Correlation CoefficientJohn Zorich, MS, CQE
 

More from John Zorich, MS, CQE (6)

Better AOQ (and AOQL) Formulas
Better AOQ (and AOQL) FormulasBetter AOQ (and AOQL) Formulas
Better AOQ (and AOQL) Formulas
 
Better_Alternatives_to_Sampling_Plans
Better_Alternatives_to_Sampling_PlansBetter_Alternatives_to_Sampling_Plans
Better_Alternatives_to_Sampling_Plans
 
Reasonable confidence limits for binomial proportions
Reasonable confidence limits for binomial proportionsReasonable confidence limits for binomial proportions
Reasonable confidence limits for binomial proportions
 
Reliability Plotting Explained
Reliability Plotting ExplainedReliability Plotting Explained
Reliability Plotting Explained
 
Teaching the Correlation Coefficient
Teaching the Correlation CoefficientTeaching the Correlation Coefficient
Teaching the Correlation Coefficient
 
The Prehistory Of Probability
The Prehistory Of ProbabilityThe Prehistory Of Probability
The Prehistory Of Probability
 

Transformation To Normality, References

  • 1. LITERATURE REFERENCE JUSTIFICATIONS FOR  TRANSFORMATIONS TO NORMALITY  Copyright 2012 by John N. Zorich Jr., and Zorich Consulting & Training    Whenever a statistical method is chosen to analyze product data that has been generated by a  verification or validation study, it is essential that that analysis be preceded by an evaluation of whether  or not the distribution of the data violates the assumption of the statistical method. When that  method's distribution assumption is normality, and when non‐normality is suspected, a legitimate  option is to transform the data into as close to normality as possible; subsequently, the originally chosen  statistical method is used as if the transformed data were the original data, when compared to the  similarly transformed study criteria. Here are several relevant quotes (all underlining below was added):    "Most of the statistical methodology presented in this section ["Basic Statistical Methods"]  assumes that the quality characteristic follows a known probability distribution. The analysis and  conclusions that result are, of course, valid only to the extent that the distribution assumption is  correct....Sometimes a set of data does not fit one of the standard distributions such as the  normal distribution. One approach uses 'distribution‐free' statistical methods...Some other  approaches to analysis are....Make a transformation of the original characteristic to a new  characteristic that is normally distributed."  [ J. M. Juran & F. M. Gryna's Juran's Quality Control Handbook, edition IV, 1988 by McGraw‐Hill,  Inc.; pages 23.91‐23.92, in the section entitled "Transformations of Data" ]    "Essentially, all the standard techniques for statistical analysis and interpretation of  measurement data...are based upon assumed normality of the underlying distribution  involved....Real‐life data do not always conform to the conditions required....When this is the  case, a transformation (change of scale) applied to the raw data may put the data in such form  that the appropriate conventional analysis can be performed validly."   [M. G. Natrella, Experimental Statistics, 1963 by the National Bureau of Standards as "Handbook  91"; Chapter 20 (entitled "The Use of Transformations"), page 20‐1 ]    "After the transformation is made and the mean and standard deviation have been computed,  standard methods applicable to normally distributed variables can be used to determine  reliability‐confidence relationships. The reliability numbers are directly applied to the original  data without modification."   [ B. L. Amstadter, Reliability Mathematics, 1971 by McGraw‐Hill, Inc., page 90 ]       "Many physical situations produce data that are normally distributed; others, data that follow  some other known distribution; and still others, data that can be transformed to normal  data....An easy way to decide whether one of these transformations is likely to produce  normality is to make use of [a normal probability plot]."   [ E. L. Crow, et. al., Statistics Manual, 1960 by Dover Publications, Inc., in a section entitled  "Transformations to Obtain Normality", pages 88‐90 ]         [Regarding the method of Linear Regression that is used to create a "normal probability plot",  the degree of linearity of which is positively correlated with the degree of normality of a data  set...] "From a graph of the observations, it will often be obvious that the regression curve  cannot be a straight line. In many cases, however, it is possible by simple transformations of the  Transformations to Normality, Copyright 2012, by John Zorich,   Page 1 of 2   
  • 2. variables to represent the regression curve as a linear relationship between transformed  variables.... If the points (x, y), when transformed to points (g(x),f(y)) are grouped about a  straight line such that f(y) is normally distributed...then the theory of linear regression may be  applied to the transformed observations."   [ A. Hald, Statistical Theory with Engineering Applications, 1952 by John Wiley  & Sons, Inc, page  558 ]    "Non‐normality is a way of life, since no characteristic (height, weight, etc.) will have exactly a  normal distribution. One strategy to make non‐normal data resemble normal data is by using a  transformation....[one such transformation is called "Box‐Cox", which involves determining the  best power coefficient, "λ"  ].... "The criterion used to choose λ for the Box‐Cox linearity plot is  the value of λ that maximizes the correlation between the transformed x‐values and the y‐ values when making a normal probability plot of the (transformed) data."   [ US National Institute of Standards and Technology, NIST,  Engineering Statistics Handbook  website found (October 31, 2012) at    www.itl.nist.gov/div898/handbook/pmc/section5/pmc52.htm     in section 6.5.2, entitled "What to do when data are non‐normal?" ]                          Transformations to Normality, Copyright 2012, by John Zorich,   Page 2 of 2