SlideShare a Scribd company logo
1 of 8
Download to read offline
Dealing with outliers 2012
Produced By Mr. Sunil Kumar Sharma,
Published in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition Page 1
Dealing with Outliers is a difficult task in spinning industry. There are so many questions arises when we plan to
deal with outliers. We are trying to answers all these questions through this article.
Q.1. What is an Outlier and it’s definition?
Ans. An outliers can be understand through following definitions : -
 Outlier is a scientific term to describe things or phenomena that lie outside
normal experience.
 In statistics, an outlier is an observation that is numerically distant from the rest
of the data.
 An outlying observation, or outlier, is one that appears to deviate markedly from
other members of the sample in which it occurs.
 An extreme deviation from the mean.
 An outlier is an observation that lies an abnormal distance from other values in a
random sample from a population.
From the above definitions we can understand that an outlier value does not
belongs to the normal population and it is different with others members or
readings of a distribution. In a sense, this definition leaves it up to the analyst (or a
consensus process) to decide what will be considered abnormal. Before abnormal
observations can be singled out, it is necessary to characterize normal observations.
Q. 2. Why outliers to be detected and removed from process?
Ans. Outliers arises due to changes in system behaviour, fraudulent behaviour,
human error, instrument error or simply through natural deviations in populations. A
sample may have been contaminated with elements from outside the population being
examined. Outlier detection has been used to detect and, where appropriate, remove
anomalous observations from data. Outlier detection can identify system faults before
they escalate with potentially catastrophic consequences. Outliers should be
investigated carefully. Often they contain valuable information about the process
under investigation or the data gathering and recording process. Before considering
the possible elimination of these points from the data, one should try to understand
why they appeared and whether it is likely similar values will continue to appear. Of
Dealing with outliers 2012
Produced By Mr. Sunil Kumar Sharma,
Published in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition Page 2
course, outliers are often bad data points. An outlier is the abnormal reading which is
significantly different from most of the population of a normal distribution. This
significant different characteristic of outlier creates major variation in process or in
ultimate product characteristics. In spinning process there are many factors creates
variation in process. These variations considered as spinning abnormalities and
causing defects in yarn or fabric. One defective yarn package may spoil the thousand
meters of fabric length. A defect in spinning preparatory process may disturb the
working of whole spinning mill. Hence it is better to identify & remove such
abnormalities in early stages before they create problems. Systematic outlier detection
and it’s detail analysis up to root cause and finally eliminating the origin of outlier
reduces the variation significantly in downstream with better Yarn & fabric Quality.
Q. 3. How to identify or calculate outliers?
Ans. : There is no rigid mathematical definition of what constitutes an outlier;
determining whether or not an observation is an outlier is ultimately a subjective
exercise. There are several methods for detection of outliers, however in spinning
mills commonly used method for identification & detection of outliers are based on
mean and standard deviation. Hence here we explain this method only.
A Standard Deviation is a measuring stick used to describe how data are dispersed
around their average. A normal distribution, which takes the shape of a nice “bell
curve, one Standard Deviation encompasses about 68.27% of all observation data
represented with dark blue colour in fig.-1. Two Standard Deviations includes about
95.45% of all observations represented with dark blue & medium blue colour. And
three Standard Deviations encompass nearly all values i.e. 99.73% of all observations
represented with dark blue, medium & light blue colours. A graphical representation
of a normal deviation is shows below in fig.1: -
Dealing with outliers
Produced By Mr. Sunil Kumar Sharma,
Published in Spinning Textiles Magazine, Vol.
Fig. 1 : Graphical Representation of a Normal Distribution with different Standard deviation level.
Where x is an observation from a normally distributed
its standard deviation:
Thus reading outside the two sigma (i.e. 2 S.D.)
be considered as outlier depending upon the no. of occurrences
total number of readings observed
Chart : 1 : % Population & expected frequency of
Range % Population in range
μ ± 1σ
μ ± 1.5σ
μ ± 2σ
μ ± 2.5σ
μ ± 3σ
It is clear with above table
should be 22 in case of two sigma limit (i.e. 2 SD) & 370 for three sigma (i.e. 3 SD)
limits. Hence for a spinning mill two sigma limit
Dealing with outliers
ublished in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition
Fig. 1 : Graphical Representation of a Normal Distribution with different Standard deviation level.
is an observation from a normally distributed random variable, μ is the mean of the distribution, and
two sigma (i.e. 2 S.D.) or three sigma (i.e. 3 SD)
depending upon the no. of occurrences for outside range
total number of readings observed.
% Population & expected frequency of outliers for different standard deviation range.
Population in range Expected frequency outside range
68.27
86.64
95.45
98.76
99.73
It is clear with above table that minimum observation for identifying the outliers
should be 22 in case of two sigma limit (i.e. 2 SD) & 370 for three sigma (i.e. 3 SD)
Hence for a spinning mill two sigma limits are more appropriate & practical for
2012
Page 3
Fig. 1 : Graphical Representation of a Normal Distribution with different Standard deviation level.
is the mean of the distribution, and σ is
or three sigma (i.e. 3 SD) limits may
for outside range and
outliers for different standard deviation range.
Expected frequency outside range
1 in 3
1 in 7
1 in 22
1 in 81
1 in 370
that minimum observation for identifying the outliers
should be 22 in case of two sigma limit (i.e. 2 SD) & 370 for three sigma (i.e. 3 SD)
more appropriate & practical for
Dealing with outliers 2012
Produced By Mr. Sunil Kumar Sharma,
Published in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition Page 4
outlier detection instead of three sigma limit. 2 sigma limits provide us opportunity to
review & analysis approx. 4.55 % readings from total observation for further
improvement.
Q. 4 : In spinning Quality control, how we can utilize these principles and
implement the 2 σ theory for detection of outliers?
Ans. : - In spinning Quality control we generate lot of data during daily testing of in-
process & finished material. For Outliers detection through two sigma analysis we
require minimum 22 no. of readings, hence this analysis is practicable & beneficial for
speed frame & ring frame section where we obtain maximum test readings on daily
basis through spindle wise testing. Following critical parameters & test results may be
analyzed for outliers detection with two sigma limits : -
1. Spindle wise Roving Hank measurement.
2. Spindle wise Roving U %.
3. Spindle wise count measurement of Ring frame.
4. Spindle wise U %, Imperfection level & Hairiness index of ring frame.
5. Spindle wise single yarn strength & Elongation %.
6. Or any report may be analyzed for outlier analysis, where minimum no. of
readings should be more than 22.
Dealing with outliers 2012
Produced By Mr. Sunil Kumar Sharma,
Published in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition Page 5
Chart – 2 : A reference UT-5 test report for outlier detection through 2 sigma limit.
Dealing with outliers 2012
Produced By Mr. Sunil Kumar Sharma,
Published in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition Page 6
Methodology : - Chart – 2, illustrates a reference UT-5 test report in which outliers
being identified for U % & Hairiness index by applying two sigma limits. In given
report total 30 No. of samples were tested from identified ring frames spindles. Frame
no. & spindle numbers mentioned in first column of the test report.
1. Detection of outliers for U % : -
 The average U % of total 30 readings is 8.88 & standards deviation is 0.20.
 Hence 2 σ limit will be = 0.20 x 2 = 0.40 i.e. 8.88 ± 0.40 = 8.48 to 9.28.
 Now see the total readings of U %, where test no.- 29 observed beyond this
limit, which belong to RF No.- 14 RHS, Spdl No.- 612. Which is an outlier
reading for U %. Highlighted with yellow colour in test report.
2. Detection of outliers for Hairiness Index i.e. H : -
 The average of all readings for H is 5.09 & standard deviation is 0.16.
 Hence 2 σ limit will be = 0.16 x2 = 0.32 i.e. 5.09 ± 0.32 = 4.77 to 5.41.
 Test No.-2 observed beyond this range, which belong to RF No.-13 RHS, Spdl.
No.-108, which is an outlier reading for hairiness index. Highlighted in orange
colour in test report.
Fig. 2 : - Graphical representation of outliers for U %
8.5
8.6
8.7
8.8
8.9
9
9.1
9.2
9.3
9.4
9.5
9.6
9.7
0 5 10 15 20 25 30
U%
No. of Readings
Outlier
Dealing with outliers 2012
Produced By Mr. Sunil Kumar Sharma,
Published in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition Page 7
Fig. 3 : - Graphical representation of outliers for Hairiness Index
Conclusion : - An outlier is a distinct observation from the mean value, which
represent different characteristics with most of others members of a normal
distribution. Hence these observations should be detected, removed and detailed
analyzed up to the root cause of abnormality and to be corrected. A defect in spinning
preparatory process may disturb the working of whole spinning mill or a defects of
spinning process may causes huge losses in downstream processes, hence to detect the
prominent outliers at spinning stage itself and eliminating it’s root cause will
significantly reduce the rejection in next processes. There are several methods for
detection of outliers but for spinning process, outlier detection through two sigma
limit is more practicable and easy method. Outlier’s detection through two sigma
limits covers minimum 4.55 % observation for at least more than 22 No. of reading,
which provides opportunity to correct & analyzed at-least 4.55 % observations and
reduces the variation. However if No. of readings are more than 370 and there is huge
variation in process, than 3 σ limit may be applied, which covers total 99.73 %
readings and approx. 0.27 % no. of readings will be outside the limit which will be
considered as outliers. Methodology of outlier detection through 2 σ or 3 σ is very
simple as now days most of the reports generated through PC based instruments
which itself provide the standard deviation.
4.6
4.7
4.8
4.9
5
5.1
5.2
5.3
5.4
5.5
5.6
0 5 10 15 20 25 30
HairinessIndex
No. of Readings
Outlier
Dealing with outliers 2012
Produced By Mr. Sunil Kumar Sharma,
Published in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition Page 8
Produced by : Mr. Sunil Kumar Sharma, Manager – QAD,
Mobile No. : – 09552596742, 09921417107
E_mail : - sunil_ku67@yahoo.com
Loknayak Jayprakash Narayan Shetkari Sahakari Soot Girni Ltd.
Kamalnagar, Untawad – Hol, Shahada,
Tal. : - Shahada, Dist. : - Nandurbar (MS)
Pin : - 425409

More Related Content

What's hot

LATEST DEVELOPMENT IN YARN EVENNESS TESTING MACHINE ...
LATEST DEVELOPMENT IN YARN EVENNESS TESTING MACHINE                          ...LATEST DEVELOPMENT IN YARN EVENNESS TESTING MACHINE                          ...
LATEST DEVELOPMENT IN YARN EVENNESS TESTING MACHINE ...Praveen Rams
 
Importance, Effect & Testing of Yarn Evenness
Importance, Effect & Testing of Yarn EvennessImportance, Effect & Testing of Yarn Evenness
Importance, Effect & Testing of Yarn EvennessAmirul Eahsan
 
yarn irregularity & its effect on cloth appearance
yarn irregularity & its effect on cloth appearanceyarn irregularity & its effect on cloth appearance
yarn irregularity & its effect on cloth appearanceSourabh arora
 
Textile Fiber & Yarn
Textile Fiber & Yarn Textile Fiber & Yarn
Textile Fiber & Yarn faruq2013
 
DMAIC Yarn manufacturing report
DMAIC Yarn manufacturing reportDMAIC Yarn manufacturing report
DMAIC Yarn manufacturing reportBibekananda Swain
 
Yarn quality part 3 yarn evenness
Yarn quality part 3 yarn evennessYarn quality part 3 yarn evenness
Yarn quality part 3 yarn evennessRavikeerthi Rao
 
005 characterization-of-yarn-diameter-measured-on-different
005 characterization-of-yarn-diameter-measured-on-different005 characterization-of-yarn-diameter-measured-on-different
005 characterization-of-yarn-diameter-measured-on-differentaqeel ahmed
 
Textile spinning
Textile spinningTextile spinning
Textile spinningtanveersahb
 
Fabric preparatory process (FPP) Presentation , BUTex
Fabric preparatory process (FPP) Presentation , BUTexFabric preparatory process (FPP) Presentation , BUTex
Fabric preparatory process (FPP) Presentation , BUTexHasibul Islam Bappi
 
Yarn unevenness and its empact on quality
Yarn unevenness and its empact on qualityYarn unevenness and its empact on quality
Yarn unevenness and its empact on qualityArNesto WaHid
 
Fiber configuration at different stages of spinning department
Fiber configuration at different stages of spinning departmentFiber configuration at different stages of spinning department
Fiber configuration at different stages of spinning departmentsandeepsharma1099
 

What's hot (20)

LATEST DEVELOPMENT IN YARN EVENNESS TESTING MACHINE ...
LATEST DEVELOPMENT IN YARN EVENNESS TESTING MACHINE                          ...LATEST DEVELOPMENT IN YARN EVENNESS TESTING MACHINE                          ...
LATEST DEVELOPMENT IN YARN EVENNESS TESTING MACHINE ...
 
Yarn Realization
Yarn RealizationYarn Realization
Yarn Realization
 
Importance, Effect & Testing of Yarn Evenness
Importance, Effect & Testing of Yarn EvennessImportance, Effect & Testing of Yarn Evenness
Importance, Effect & Testing of Yarn Evenness
 
Yarn Quality part 1
Yarn Quality part 1Yarn Quality part 1
Yarn Quality part 1
 
yarn irregularity & its effect on cloth appearance
yarn irregularity & its effect on cloth appearanceyarn irregularity & its effect on cloth appearance
yarn irregularity & its effect on cloth appearance
 
Yarn quality and customer satisfaction
Yarn quality and customer satisfactionYarn quality and customer satisfaction
Yarn quality and customer satisfaction
 
Hairiness of-yarns
Hairiness of-yarnsHairiness of-yarns
Hairiness of-yarns
 
Fabric barre
Fabric barreFabric barre
Fabric barre
 
Textile Fiber & Yarn
Textile Fiber & Yarn Textile Fiber & Yarn
Textile Fiber & Yarn
 
Process control and yarn quality in spinning woodhead publishing-karthik
Process control and yarn quality in spinning woodhead publishing-karthikProcess control and yarn quality in spinning woodhead publishing-karthik
Process control and yarn quality in spinning woodhead publishing-karthik
 
Test for Yarn Dr.Ash
Test for Yarn Dr.AshTest for Yarn Dr.Ash
Test for Yarn Dr.Ash
 
DMAIC Yarn manufacturing report
DMAIC Yarn manufacturing reportDMAIC Yarn manufacturing report
DMAIC Yarn manufacturing report
 
Yarn quality part 3 yarn evenness
Yarn quality part 3 yarn evennessYarn quality part 3 yarn evenness
Yarn quality part 3 yarn evenness
 
005 characterization-of-yarn-diameter-measured-on-different
005 characterization-of-yarn-diameter-measured-on-different005 characterization-of-yarn-diameter-measured-on-different
005 characterization-of-yarn-diameter-measured-on-different
 
FIBER LENGTH
FIBER LENGTHFIBER LENGTH
FIBER LENGTH
 
Textile spinning
Textile spinningTextile spinning
Textile spinning
 
Fabric preparatory process (FPP) Presentation , BUTex
Fabric preparatory process (FPP) Presentation , BUTexFabric preparatory process (FPP) Presentation , BUTex
Fabric preparatory process (FPP) Presentation , BUTex
 
Yarn unevenness and its empact on quality
Yarn unevenness and its empact on qualityYarn unevenness and its empact on quality
Yarn unevenness and its empact on quality
 
Fiber configuration at different stages of spinning department
Fiber configuration at different stages of spinning departmentFiber configuration at different stages of spinning department
Fiber configuration at different stages of spinning department
 
Spinning parameters
Spinning  parameters   Spinning  parameters
Spinning parameters
 

Similar to Dealing with Outliers

Measures of dispersion qt pgdm 1st trisemester
Measures of dispersion qt pgdm 1st trisemester Measures of dispersion qt pgdm 1st trisemester
Measures of dispersion qt pgdm 1st trisemester Karan Kukreja
 
ERRORS-IN-MEASUREMENT-slide 5.pdf
ERRORS-IN-MEASUREMENT-slide 5.pdfERRORS-IN-MEASUREMENT-slide 5.pdf
ERRORS-IN-MEASUREMENT-slide 5.pdfShree242780
 
Identification of Outliersin Time Series Data via Simulation Study
Identification of Outliersin Time Series Data via Simulation StudyIdentification of Outliersin Time Series Data via Simulation Study
Identification of Outliersin Time Series Data via Simulation Studyiosrjce
 
Fuzzy Regression Model for Knee Osteoarthritis Disease Diagnosis
Fuzzy Regression Model for Knee Osteoarthritis Disease DiagnosisFuzzy Regression Model for Knee Osteoarthritis Disease Diagnosis
Fuzzy Regression Model for Knee Osteoarthritis Disease DiagnosisIRJET Journal
 
Measure of dispersion by Neeraj Bhandari ( Surkhet.Nepal )
Measure of dispersion by Neeraj Bhandari ( Surkhet.Nepal )Measure of dispersion by Neeraj Bhandari ( Surkhet.Nepal )
Measure of dispersion by Neeraj Bhandari ( Surkhet.Nepal )Neeraj Bhandari
 
2014-mo444-final-project
2014-mo444-final-project2014-mo444-final-project
2014-mo444-final-projectPaulo Faria
 
Measure of dispersion part II ( Standard Deviation, variance, coefficient of ...
Measure of dispersion part II ( Standard Deviation, variance, coefficient of ...Measure of dispersion part II ( Standard Deviation, variance, coefficient of ...
Measure of dispersion part II ( Standard Deviation, variance, coefficient of ...Shakehand with Life
 
Iris recognition for personal identification using lamstar neural network
Iris recognition for personal identification using lamstar neural networkIris recognition for personal identification using lamstar neural network
Iris recognition for personal identification using lamstar neural networkijcsit
 
IRJET- Analysis of Alzheimer’s Disease on MRI Image using Transform and Featu...
IRJET- Analysis of Alzheimer’s Disease on MRI Image using Transform and Featu...IRJET- Analysis of Alzheimer’s Disease on MRI Image using Transform and Featu...
IRJET- Analysis of Alzheimer’s Disease on MRI Image using Transform and Featu...IRJET Journal
 
Lecture 7 guidelines_and_assignment
Lecture 7 guidelines_and_assignmentLecture 7 guidelines_and_assignment
Lecture 7 guidelines_and_assignmentDaria Bogdanova
 
Uncertainties & Error.ppt
Uncertainties & Error.pptUncertainties & Error.ppt
Uncertainties & Error.pptKhalil Alhatab
 
Paper id 312201522
Paper id 312201522Paper id 312201522
Paper id 312201522IJRAT
 
Concept of Limit of Detection (LOD)
Concept of Limit of Detection (LOD)Concept of Limit of Detection (LOD)
Concept of Limit of Detection (LOD)GH Yeoh
 
1.0 Descriptive statistics.pdf
1.0 Descriptive statistics.pdf1.0 Descriptive statistics.pdf
1.0 Descriptive statistics.pdfthaersyam
 

Similar to Dealing with Outliers (20)

3.2 Measures of variation
3.2 Measures of variation3.2 Measures of variation
3.2 Measures of variation
 
Measures of dispersion qt pgdm 1st trisemester
Measures of dispersion qt pgdm 1st trisemester Measures of dispersion qt pgdm 1st trisemester
Measures of dispersion qt pgdm 1st trisemester
 
ERRORS-IN-MEASUREMENT-slide 5.pdf
ERRORS-IN-MEASUREMENT-slide 5.pdfERRORS-IN-MEASUREMENT-slide 5.pdf
ERRORS-IN-MEASUREMENT-slide 5.pdf
 
Identification of Outliersin Time Series Data via Simulation Study
Identification of Outliersin Time Series Data via Simulation StudyIdentification of Outliersin Time Series Data via Simulation Study
Identification of Outliersin Time Series Data via Simulation Study
 
6 Sigma - Chapter3
6 Sigma - Chapter36 Sigma - Chapter3
6 Sigma - Chapter3
 
Errors in measurement
Errors in measurementErrors in measurement
Errors in measurement
 
Fuzzy Regression Model for Knee Osteoarthritis Disease Diagnosis
Fuzzy Regression Model for Knee Osteoarthritis Disease DiagnosisFuzzy Regression Model for Knee Osteoarthritis Disease Diagnosis
Fuzzy Regression Model for Knee Osteoarthritis Disease Diagnosis
 
Measure of dispersion by Neeraj Bhandari ( Surkhet.Nepal )
Measure of dispersion by Neeraj Bhandari ( Surkhet.Nepal )Measure of dispersion by Neeraj Bhandari ( Surkhet.Nepal )
Measure of dispersion by Neeraj Bhandari ( Surkhet.Nepal )
 
2014-mo444-final-project
2014-mo444-final-project2014-mo444-final-project
2014-mo444-final-project
 
Measure of dispersion part II ( Standard Deviation, variance, coefficient of ...
Measure of dispersion part II ( Standard Deviation, variance, coefficient of ...Measure of dispersion part II ( Standard Deviation, variance, coefficient of ...
Measure of dispersion part II ( Standard Deviation, variance, coefficient of ...
 
Iris recognition for personal identification using lamstar neural network
Iris recognition for personal identification using lamstar neural networkIris recognition for personal identification using lamstar neural network
Iris recognition for personal identification using lamstar neural network
 
IRJET- Analysis of Alzheimer’s Disease on MRI Image using Transform and Featu...
IRJET- Analysis of Alzheimer’s Disease on MRI Image using Transform and Featu...IRJET- Analysis of Alzheimer’s Disease on MRI Image using Transform and Featu...
IRJET- Analysis of Alzheimer’s Disease on MRI Image using Transform and Featu...
 
Lecture 7 guidelines_and_assignment
Lecture 7 guidelines_and_assignmentLecture 7 guidelines_and_assignment
Lecture 7 guidelines_and_assignment
 
Corrleation and regression
Corrleation and regressionCorrleation and regression
Corrleation and regression
 
Uncertainties & Error.ppt
Uncertainties & Error.pptUncertainties & Error.ppt
Uncertainties & Error.ppt
 
Paper id 312201522
Paper id 312201522Paper id 312201522
Paper id 312201522
 
Concept of Limit of Detection (LOD)
Concept of Limit of Detection (LOD)Concept of Limit of Detection (LOD)
Concept of Limit of Detection (LOD)
 
Spc training
Spc training Spc training
Spc training
 
1.0 Descriptive statistics.pdf
1.0 Descriptive statistics.pdf1.0 Descriptive statistics.pdf
1.0 Descriptive statistics.pdf
 
Measures of dispersion
Measures of dispersionMeasures of dispersion
Measures of dispersion
 

More from Sunil Kumar Sharma

Talk with Sunil Kumar Sharma, Deputy General Manager, Loknayak JPNSSSG Ltd
Talk with Sunil Kumar Sharma, Deputy General Manager, Loknayak JPNSSSG LtdTalk with Sunil Kumar Sharma, Deputy General Manager, Loknayak JPNSSSG Ltd
Talk with Sunil Kumar Sharma, Deputy General Manager, Loknayak JPNSSSG LtdSunil Kumar Sharma
 
Spinning Rings & Ring Travellers
Spinning Rings & Ring TravellersSpinning Rings & Ring Travellers
Spinning Rings & Ring TravellersSunil Kumar Sharma
 
Contamination Controlled Cotton & Yarn
Contamination Controlled Cotton & YarnContamination Controlled Cotton & Yarn
Contamination Controlled Cotton & YarnSunil Kumar Sharma
 
On Line Quality Monitoring.PDF
On Line Quality Monitoring.PDFOn Line Quality Monitoring.PDF
On Line Quality Monitoring.PDFSunil Kumar Sharma
 

More from Sunil Kumar Sharma (7)

Spinning Waste & Cost Control
Spinning Waste & Cost ControlSpinning Waste & Cost Control
Spinning Waste & Cost Control
 
Outlook 2014.PDF
Outlook 2014.PDFOutlook 2014.PDF
Outlook 2014.PDF
 
Talk with Sunil Kumar Sharma, Deputy General Manager, Loknayak JPNSSSG Ltd
Talk with Sunil Kumar Sharma, Deputy General Manager, Loknayak JPNSSSG LtdTalk with Sunil Kumar Sharma, Deputy General Manager, Loknayak JPNSSSG Ltd
Talk with Sunil Kumar Sharma, Deputy General Manager, Loknayak JPNSSSG Ltd
 
Spinning Rings & Ring Travellers
Spinning Rings & Ring TravellersSpinning Rings & Ring Travellers
Spinning Rings & Ring Travellers
 
Spg Textiles_Jan_Feb.2015.PDF
Spg Textiles_Jan_Feb.2015.PDFSpg Textiles_Jan_Feb.2015.PDF
Spg Textiles_Jan_Feb.2015.PDF
 
Contamination Controlled Cotton & Yarn
Contamination Controlled Cotton & YarnContamination Controlled Cotton & Yarn
Contamination Controlled Cotton & Yarn
 
On Line Quality Monitoring.PDF
On Line Quality Monitoring.PDFOn Line Quality Monitoring.PDF
On Line Quality Monitoring.PDF
 

Recently uploaded

Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfjimielynbastida
 
Bluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdfBluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdfngoud9212
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentationphoebematthew05
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 

Recently uploaded (20)

Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort ServiceHot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
 
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptxVulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdf
 
Bluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdfBluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdf
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentation
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 

Dealing with Outliers

  • 1. Dealing with outliers 2012 Produced By Mr. Sunil Kumar Sharma, Published in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition Page 1 Dealing with Outliers is a difficult task in spinning industry. There are so many questions arises when we plan to deal with outliers. We are trying to answers all these questions through this article. Q.1. What is an Outlier and it’s definition? Ans. An outliers can be understand through following definitions : -  Outlier is a scientific term to describe things or phenomena that lie outside normal experience.  In statistics, an outlier is an observation that is numerically distant from the rest of the data.  An outlying observation, or outlier, is one that appears to deviate markedly from other members of the sample in which it occurs.  An extreme deviation from the mean.  An outlier is an observation that lies an abnormal distance from other values in a random sample from a population. From the above definitions we can understand that an outlier value does not belongs to the normal population and it is different with others members or readings of a distribution. In a sense, this definition leaves it up to the analyst (or a consensus process) to decide what will be considered abnormal. Before abnormal observations can be singled out, it is necessary to characterize normal observations. Q. 2. Why outliers to be detected and removed from process? Ans. Outliers arises due to changes in system behaviour, fraudulent behaviour, human error, instrument error or simply through natural deviations in populations. A sample may have been contaminated with elements from outside the population being examined. Outlier detection has been used to detect and, where appropriate, remove anomalous observations from data. Outlier detection can identify system faults before they escalate with potentially catastrophic consequences. Outliers should be investigated carefully. Often they contain valuable information about the process under investigation or the data gathering and recording process. Before considering the possible elimination of these points from the data, one should try to understand why they appeared and whether it is likely similar values will continue to appear. Of
  • 2. Dealing with outliers 2012 Produced By Mr. Sunil Kumar Sharma, Published in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition Page 2 course, outliers are often bad data points. An outlier is the abnormal reading which is significantly different from most of the population of a normal distribution. This significant different characteristic of outlier creates major variation in process or in ultimate product characteristics. In spinning process there are many factors creates variation in process. These variations considered as spinning abnormalities and causing defects in yarn or fabric. One defective yarn package may spoil the thousand meters of fabric length. A defect in spinning preparatory process may disturb the working of whole spinning mill. Hence it is better to identify & remove such abnormalities in early stages before they create problems. Systematic outlier detection and it’s detail analysis up to root cause and finally eliminating the origin of outlier reduces the variation significantly in downstream with better Yarn & fabric Quality. Q. 3. How to identify or calculate outliers? Ans. : There is no rigid mathematical definition of what constitutes an outlier; determining whether or not an observation is an outlier is ultimately a subjective exercise. There are several methods for detection of outliers, however in spinning mills commonly used method for identification & detection of outliers are based on mean and standard deviation. Hence here we explain this method only. A Standard Deviation is a measuring stick used to describe how data are dispersed around their average. A normal distribution, which takes the shape of a nice “bell curve, one Standard Deviation encompasses about 68.27% of all observation data represented with dark blue colour in fig.-1. Two Standard Deviations includes about 95.45% of all observations represented with dark blue & medium blue colour. And three Standard Deviations encompass nearly all values i.e. 99.73% of all observations represented with dark blue, medium & light blue colours. A graphical representation of a normal deviation is shows below in fig.1: -
  • 3. Dealing with outliers Produced By Mr. Sunil Kumar Sharma, Published in Spinning Textiles Magazine, Vol. Fig. 1 : Graphical Representation of a Normal Distribution with different Standard deviation level. Where x is an observation from a normally distributed its standard deviation: Thus reading outside the two sigma (i.e. 2 S.D.) be considered as outlier depending upon the no. of occurrences total number of readings observed Chart : 1 : % Population & expected frequency of Range % Population in range μ ± 1σ μ ± 1.5σ μ ± 2σ μ ± 2.5σ μ ± 3σ It is clear with above table should be 22 in case of two sigma limit (i.e. 2 SD) & 370 for three sigma (i.e. 3 SD) limits. Hence for a spinning mill two sigma limit Dealing with outliers ublished in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition Fig. 1 : Graphical Representation of a Normal Distribution with different Standard deviation level. is an observation from a normally distributed random variable, μ is the mean of the distribution, and two sigma (i.e. 2 S.D.) or three sigma (i.e. 3 SD) depending upon the no. of occurrences for outside range total number of readings observed. % Population & expected frequency of outliers for different standard deviation range. Population in range Expected frequency outside range 68.27 86.64 95.45 98.76 99.73 It is clear with above table that minimum observation for identifying the outliers should be 22 in case of two sigma limit (i.e. 2 SD) & 370 for three sigma (i.e. 3 SD) Hence for a spinning mill two sigma limits are more appropriate & practical for 2012 Page 3 Fig. 1 : Graphical Representation of a Normal Distribution with different Standard deviation level. is the mean of the distribution, and σ is or three sigma (i.e. 3 SD) limits may for outside range and outliers for different standard deviation range. Expected frequency outside range 1 in 3 1 in 7 1 in 22 1 in 81 1 in 370 that minimum observation for identifying the outliers should be 22 in case of two sigma limit (i.e. 2 SD) & 370 for three sigma (i.e. 3 SD) more appropriate & practical for
  • 4. Dealing with outliers 2012 Produced By Mr. Sunil Kumar Sharma, Published in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition Page 4 outlier detection instead of three sigma limit. 2 sigma limits provide us opportunity to review & analysis approx. 4.55 % readings from total observation for further improvement. Q. 4 : In spinning Quality control, how we can utilize these principles and implement the 2 σ theory for detection of outliers? Ans. : - In spinning Quality control we generate lot of data during daily testing of in- process & finished material. For Outliers detection through two sigma analysis we require minimum 22 no. of readings, hence this analysis is practicable & beneficial for speed frame & ring frame section where we obtain maximum test readings on daily basis through spindle wise testing. Following critical parameters & test results may be analyzed for outliers detection with two sigma limits : - 1. Spindle wise Roving Hank measurement. 2. Spindle wise Roving U %. 3. Spindle wise count measurement of Ring frame. 4. Spindle wise U %, Imperfection level & Hairiness index of ring frame. 5. Spindle wise single yarn strength & Elongation %. 6. Or any report may be analyzed for outlier analysis, where minimum no. of readings should be more than 22.
  • 5. Dealing with outliers 2012 Produced By Mr. Sunil Kumar Sharma, Published in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition Page 5 Chart – 2 : A reference UT-5 test report for outlier detection through 2 sigma limit.
  • 6. Dealing with outliers 2012 Produced By Mr. Sunil Kumar Sharma, Published in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition Page 6 Methodology : - Chart – 2, illustrates a reference UT-5 test report in which outliers being identified for U % & Hairiness index by applying two sigma limits. In given report total 30 No. of samples were tested from identified ring frames spindles. Frame no. & spindle numbers mentioned in first column of the test report. 1. Detection of outliers for U % : -  The average U % of total 30 readings is 8.88 & standards deviation is 0.20.  Hence 2 σ limit will be = 0.20 x 2 = 0.40 i.e. 8.88 ± 0.40 = 8.48 to 9.28.  Now see the total readings of U %, where test no.- 29 observed beyond this limit, which belong to RF No.- 14 RHS, Spdl No.- 612. Which is an outlier reading for U %. Highlighted with yellow colour in test report. 2. Detection of outliers for Hairiness Index i.e. H : -  The average of all readings for H is 5.09 & standard deviation is 0.16.  Hence 2 σ limit will be = 0.16 x2 = 0.32 i.e. 5.09 ± 0.32 = 4.77 to 5.41.  Test No.-2 observed beyond this range, which belong to RF No.-13 RHS, Spdl. No.-108, which is an outlier reading for hairiness index. Highlighted in orange colour in test report. Fig. 2 : - Graphical representation of outliers for U % 8.5 8.6 8.7 8.8 8.9 9 9.1 9.2 9.3 9.4 9.5 9.6 9.7 0 5 10 15 20 25 30 U% No. of Readings Outlier
  • 7. Dealing with outliers 2012 Produced By Mr. Sunil Kumar Sharma, Published in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition Page 7 Fig. 3 : - Graphical representation of outliers for Hairiness Index Conclusion : - An outlier is a distinct observation from the mean value, which represent different characteristics with most of others members of a normal distribution. Hence these observations should be detected, removed and detailed analyzed up to the root cause of abnormality and to be corrected. A defect in spinning preparatory process may disturb the working of whole spinning mill or a defects of spinning process may causes huge losses in downstream processes, hence to detect the prominent outliers at spinning stage itself and eliminating it’s root cause will significantly reduce the rejection in next processes. There are several methods for detection of outliers but for spinning process, outlier detection through two sigma limit is more practicable and easy method. Outlier’s detection through two sigma limits covers minimum 4.55 % observation for at least more than 22 No. of reading, which provides opportunity to correct & analyzed at-least 4.55 % observations and reduces the variation. However if No. of readings are more than 370 and there is huge variation in process, than 3 σ limit may be applied, which covers total 99.73 % readings and approx. 0.27 % no. of readings will be outside the limit which will be considered as outliers. Methodology of outlier detection through 2 σ or 3 σ is very simple as now days most of the reports generated through PC based instruments which itself provide the standard deviation. 4.6 4.7 4.8 4.9 5 5.1 5.2 5.3 5.4 5.5 5.6 0 5 10 15 20 25 30 HairinessIndex No. of Readings Outlier
  • 8. Dealing with outliers 2012 Produced By Mr. Sunil Kumar Sharma, Published in Spinning Textiles Magazine, Vol.7, Issue-2, March – April 2013 Edition Page 8 Produced by : Mr. Sunil Kumar Sharma, Manager – QAD, Mobile No. : – 09552596742, 09921417107 E_mail : - sunil_ku67@yahoo.com Loknayak Jayprakash Narayan Shetkari Sahakari Soot Girni Ltd. Kamalnagar, Untawad – Hol, Shahada, Tal. : - Shahada, Dist. : - Nandurbar (MS) Pin : - 425409