The document discusses method validation requirements in clinical laboratories. It defines validation as testing a measurement procedure to assess its performance and determine acceptability. Method validation involves characterizing six key elements: reportable range, precision, accuracy, reference intervals, sensitivity, and specificity. The degree of validation depends on whether a test is FDA-approved, modified, or non-FDA approved. Common validation studies include precision, accuracy, method comparison, linearity, reference intervals, and sensitivity testing. Validation ensures a test method is fit for its intended use and identifies potential sources of error.
Validation of lab instruments and quantitative test methods Mostafa Mahmoud
This lecture shows the procedures applied when going to validate your laboratory instruments and quantitative test methods also either FDA approved or laboratory developed tests.
Validation of lab instruments and quantitative test methods Mostafa Mahmoud
This lecture shows the procedures applied when going to validate your laboratory instruments and quantitative test methods also either FDA approved or laboratory developed tests.
Quality in clinical laboratory is a continuous journey of improving processes through team work, innovative solutions, regulatory compliance with final objective to meet the evolving needs of clinicians & patients.
Quality control lecture CPath master 2014 Ain ShamsAdel Elazab Elged
Basics of quality management or assurance program detailing values of internal quality control material analysis and interpretation and external quality control or proficiency testing programs in medical laboratories
Troubleshooting Poor EQA/QC Performance in the Laboratory Randox
Step by step guide for clinical laboratories wishing to troubleshoot poor QC or EQA performance. Tips on how to distinguish between random error and systematic error. Suggested corrective actions are also provided.
Quality control, or QC for short, is a process by which entities review the quality of all factors involved in the production. ISO 9000 defines quality control as "A part of quality management focused on fulfilling quality requirements"
This presentation gives a brief idea of Quality control and how to execute it.
Troubleshooting QC Problems: Your QC has failed, what do you do next?Randox
Randox Quality Control's next 'Improving Laboratory Performance Through Quality Control' educational guide has been published with helpful tips that your laboratory can use in order to ensure it has effective troubleshooting procedures in place.
So you ran QC this morning and realised that one of your analytes has been flagged as 'out-of-control', what do you do next? Do you ignore the warning and continue patient testing, repeat the control until it's within range or do you halt patient testing and investigate the source of the error?
When it comes to troubleshooting QC errors, unfortunately there is no easy path to take. However, it's important that you have standard operating procedures in place, outlining what to do in the event of an out-of control error. Errors occur in laboratories all over the world. A lab with effective troubleshooting procedures in place will still have errors but will be able to detect them, quickly reducing their impact and reducing the risk of wasting both time and money.
Laboratory Internal Quality Control presentation master revision, 2014Adel Elazab Elged
Short presentation about using internal quality control material in clinical laboratory to ensure analytical quality laboratory results for the sake of better patient care and minimizing errors in diagnosis, management, and follow up.
Internal quality control (IQC) in coagulation labAnkit Raiyani
In the haematology laboratory it is essential to ensure that the right test is carried out on the right specimen and that the correct results are delivered to the appropriate recipient without delay.
Quality control (QC) is defined as measures that must be included during each assay run to verify that the test is working properly.
Internal quality control (IQC) is monitoring the haematology test procedures to ensure continual evaluation of the reliability of the daily work of the laboratory with validation of tests before reports are released
Quality in clinical laboratory is a continuous journey of improving processes through team work, innovative solutions, regulatory compliance with final objective to meet the evolving needs of clinicians & patients.
Quality control lecture CPath master 2014 Ain ShamsAdel Elazab Elged
Basics of quality management or assurance program detailing values of internal quality control material analysis and interpretation and external quality control or proficiency testing programs in medical laboratories
Troubleshooting Poor EQA/QC Performance in the Laboratory Randox
Step by step guide for clinical laboratories wishing to troubleshoot poor QC or EQA performance. Tips on how to distinguish between random error and systematic error. Suggested corrective actions are also provided.
Quality control, or QC for short, is a process by which entities review the quality of all factors involved in the production. ISO 9000 defines quality control as "A part of quality management focused on fulfilling quality requirements"
This presentation gives a brief idea of Quality control and how to execute it.
Troubleshooting QC Problems: Your QC has failed, what do you do next?Randox
Randox Quality Control's next 'Improving Laboratory Performance Through Quality Control' educational guide has been published with helpful tips that your laboratory can use in order to ensure it has effective troubleshooting procedures in place.
So you ran QC this morning and realised that one of your analytes has been flagged as 'out-of-control', what do you do next? Do you ignore the warning and continue patient testing, repeat the control until it's within range or do you halt patient testing and investigate the source of the error?
When it comes to troubleshooting QC errors, unfortunately there is no easy path to take. However, it's important that you have standard operating procedures in place, outlining what to do in the event of an out-of control error. Errors occur in laboratories all over the world. A lab with effective troubleshooting procedures in place will still have errors but will be able to detect them, quickly reducing their impact and reducing the risk of wasting both time and money.
Laboratory Internal Quality Control presentation master revision, 2014Adel Elazab Elged
Short presentation about using internal quality control material in clinical laboratory to ensure analytical quality laboratory results for the sake of better patient care and minimizing errors in diagnosis, management, and follow up.
Internal quality control (IQC) in coagulation labAnkit Raiyani
In the haematology laboratory it is essential to ensure that the right test is carried out on the right specimen and that the correct results are delivered to the appropriate recipient without delay.
Quality control (QC) is defined as measures that must be included during each assay run to verify that the test is working properly.
Internal quality control (IQC) is monitoring the haematology test procedures to ensure continual evaluation of the reliability of the daily work of the laboratory with validation of tests before reports are released
This presentation include general introduction to validation of analytical method . analytical method validation include following points such as :
Introduction
Objective ,Types of analytical procedures to be validated,Validation parameters as per ICH and USP , cleaning validation , procedure , validation data, accuracy , range , precision, LOD, LOQ ,linearity, ruggedness , robustness
Understanding of Analytical Method Validation Approach in Pharmaceutical Industry. Analytical method validation Verification is a wide chapter and a huge scope of applicability. In different types of methods, instrument, measurement approach all can effect the validation effort. However the basic fundamental will remains same, the parameters, acceptance criteria, functionality may vary depending upon the type of method, instrument etc.
Analytical method validation as per ich and usp shreyas B R
Analytical method validation is a process of documenting/ proving that an analytical method provides analytical data acceptable for the intended use.After the development of an analytical procedure, it is must important to assure that the procedure will consistently produce the intended a precise result with high degree of accuracy. The method should give a specific result that may not be affected by external matters. This creates a requirement to validate the analytical procedures. The validation procedures consists of some characteristics parameters that makes the method acceptable with addition of statistical tools.
What is Validation?
Methods validation is the process of demonstrating that analytical procedures are suitable for their intended use-Guidance for Industry
Validation is a process-risk will determine the effort
High Risk:Total validation
Moderate Risk:Testing,Documentation
Low Risk:Testing the change
Accuracy
ICH defines accuracy of an analytical procedure as the closeness of agreement between the conventional true value or an accepted reference value and the value found.
% Accuracy = Experimental- True Value * 100
True Value
Precision
Precision of analytical procedure is defined as closeness of agreement in values between a series of measurements. As per ICH, precision is considered at three different levels:
Repeatability or intra—assay precision: precision data are obtained by repeatedly analyzing, in one lab on one day, aliquots of a homogeneous sample.
Intermediate precision: precision obtained when the assay is performed by multiple analysts, multiple instruments, and multiple days in one lab.
Reproducibility: precision between laboratories.
Specificity
Specificity is the ability of the method to accurately measure the analyte response in the presence of all potential sample components.
It is very important in the analysis of complex mixtures by GC, HPLC, AA, ICP, etc.
Limit of Detection (LOD)
Limit of Detection (LOD) is the lowest amount of analyte in a sample which can be reliably detected but not necessarily accurately or precisely measured.
Signal/Noise = 2 to 3
Limit of Quantitation (LOQ)
Limit of Quantitation (LOQ) is the lowest amount of an analyte that can be quantitatively determined with suitable precision and accuracy.
Signal/Noise = 10 to 20
Linearity and Range
Linearity of an analytical procedure is its ability (within a given range) to obtain test results which are directly proportional to the concentration (amount) of analyte in the sample.
Range: Interval from the upper to the lower concentration (amounts) of analyte in the sample (including these concentrations) for which it has been demonstrated that the analytical procedure has a suitable level of precision, accuracy and linearity
Must cover 80-120% of product claims
Usually evaluated from the same data set as linearity, precision, accuracy
Want to learn more about analytical method validation, FDA requirements and best practices to comply with them? ComplianceOnline webinars and seminars are a great training resource. Check out the following links:
ICH, FDA and USP Requirements for Method Validation
How to Validate Analytical Methods and Procedures
Validation of Analytical Methods and Procedures
Eliminate the Confusion - Analytical Method Qualification and Validation
Lifecycle Approach to Analytical Methods with QbD Elements
Analytical Instrument Qualification and System Validation
Lifecycle Approach to Analytical Methods for Drug Products
For details vis
CHAPTER 1 SEMESTER V PREVENTIVE-PEDIATRICS.pdfSachin Sharma
This content provides an overview of preventive pediatrics. It defines preventive pediatrics as preventing disease and promoting children's physical, mental, and social well-being to achieve positive health. It discusses antenatal, postnatal, and social preventive pediatrics. It also covers various child health programs like immunization, breastfeeding, ICDS, and the roles of organizations like WHO, UNICEF, and nurses in preventive pediatrics.
ICH Guidelines for Pharmacovigilance.pdfNEHA GUPTA
The "ICH Guidelines for Pharmacovigilance" PDF provides a comprehensive overview of the International Council for Harmonisation of Technical Requirements for Pharmaceuticals for Human Use (ICH) guidelines related to pharmacovigilance. These guidelines aim to ensure that drugs are safe and effective for patients by monitoring and assessing adverse effects, ensuring proper reporting systems, and improving risk management practices. The document is essential for professionals in the pharmaceutical industry, regulatory authorities, and healthcare providers, offering detailed procedures and standards for pharmacovigilance activities to enhance drug safety and protect public health.
Defecation
Normal defecation begins with movement in the left colon, moving stool toward the anus. When stool reaches the rectum, the distention causes relaxation of the internal sphincter and an awareness of the need to defecate. At the time of defecation, the external sphincter relaxes, and abdominal muscles contract, increasing intrarectal pressure and forcing the stool out
The Valsalva maneuver exerts pressure to expel faeces through a voluntary contraction of the abdominal muscles while maintaining forced expiration against a closed airway. Patients with cardiovascular disease, glaucoma, increased intracranial pressure, or a new surgical wound are at greater risk for cardiac dysrhythmias and elevated blood pressure with the Valsalva maneuver and need to avoid straining to pass the stool.
Normal defecation is painless, resulting in passage of soft, formed stool
CONSTIPATION
Constipation is a symptom, not a disease. Improper diet, reduced fluid intake, lack of exercise, and certain medications can cause constipation. For example, patients receiving opiates for pain after surgery often require a stool softener or laxative to prevent constipation. The signs of constipation include infrequent bowel movements (less than every 3 days), difficulty passing stools, excessive straining, inability to defecate at will, and hard feaces
IMPACTION
Fecal impaction results from unrelieved constipation. It is a collection of hardened feces wedged in the rectum that a person cannot expel. In cases of severe impaction the mass extends up into the sigmoid colon.
DIARRHEA
Diarrhea is an increase in the number of stools and the passage of liquid, unformed feces. It is associated with disorders affecting digestion, absorption, and secretion in the GI tract. Intestinal contents pass through the small and large intestine too quickly to allow for the usual absorption of fluid and nutrients. Irritation within the colon results in increased mucus secretion. As a result, feces become watery, and the patient is unable to control the urge to defecate. Normally an anal bag is safe and effective in long-term treatment of patients with fecal incontinence at home, in hospice, or in the hospital. Fecal incontinence is expensive and a potentially dangerous condition in terms of contamination and risk of skin ulceration
HEMORRHOIDS
Hemorrhoids are dilated, engorged veins in the lining of the rectum. They are either external or internal.
FLATULENCE
As gas accumulates in the lumen of the intestines, the bowel wall stretches and distends (flatulence). It is a common cause of abdominal fullness, pain, and cramping. Normally intestinal gas escapes through the mouth (belching) or the anus (passing of flatus)
FECAL INCONTINENCE
Fecal incontinence is the inability to control passage of feces and gas from the anus. Incontinence harms a patient’s body image
PREPARATION AND GIVING OF LAXATIVESACCORDING TO POTTER AND PERRY,
An enema is the instillation of a solution into the rectum and sig
Explore our infographic on 'Essential Metrics for Palliative Care Management' which highlights key performance indicators crucial for enhancing the quality and efficiency of palliative care services.
This visual guide breaks down important metrics across four categories: Patient-Centered Metrics, Care Efficiency Metrics, Quality of Life Metrics, and Staff Metrics. Each section is designed to help healthcare professionals monitor and improve care delivery for patients facing serious illnesses. Understand how to implement these metrics in your palliative care practices for better outcomes and higher satisfaction levels.
The Importance of Community Nursing Care.pdfAD Healthcare
NDIS and Community 24/7 Nursing Care is a specific type of support that may be provided under the NDIS for individuals with complex medical needs who require ongoing nursing care in a community setting, such as their home or a supported accommodation facility.
Deep Leg Vein Thrombosis (DVT): Meaning, Causes, Symptoms, Treatment, and Mor...The Lifesciences Magazine
Deep Leg Vein Thrombosis occurs when a blood clot forms in one or more of the deep veins in the legs. These clots can impede blood flow, leading to severe complications.
Empowering ACOs: Leveraging Quality Management Tools for MIPS and BeyondHealth Catalyst
Join us as we delve into the crucial realm of quality reporting for MSSP (Medicare Shared Savings Program) Accountable Care Organizations (ACOs).
In this session, we will explore how a robust quality management solution can empower your organization to meet regulatory requirements and improve processes for MIPS reporting and internal quality programs. Learn how our MeasureAble application enables compliance and fosters continuous improvement.
1. Method Validation
To understand College of American Pathologists
(CAP) requirements of method validation in a clinical
laboratory
Dr. Sibtain Ahmed
2. What is validation?
• “Validation is the process of testing a measurement
procedure to assess its performance and to determine
whether that performance is acceptable.” [CLSI]
3. Method Validation
Why must we validate?
When should we validate?
What should we validate?
What is method validation?
4. What is Method Validation?
–Method validation and/or verification is the process
by which a method is determined to be fit for
purpose and intended use.
–Although method validation/verification are often
used interchangeably, validation is usually
performed on in-house and/or modified methods,
while verification is taking a marketed/unmodified
assay and verifying its performance.
5. Purposes of Method Validation Studies
To quantifiably characterize system performance
To assess potential for error
To identify method-to-method differences
To meet regulatory guidelines
6. When to Do Method Validation Studies
When considering purchasing a new system
When placing a new system into service
At regular intervals to assess on-going system performance
When troubleshooting questionable system performance
7. Tests to Validate
• Waived tests are approved by the FDA for home use and by definition are
simple to perform (i.e., pregnancy test) – do not require validation.
• Non-waived tests included moderately and highly complex tests – requires
validation
• Degree of validation/verification depends on status of the test method (FDA-
approved/Non-FDA-approved/Modified/Unmodified)
• Unmodified FDA-approved: using as intended by the manufacturer and
licensed for use by the FDA
• Modified or Non-FDA approved: using test kit for indications other than as
intended by the manufacturer; not licensed for use by the FDA.
8. The 6 Elements of Method
Validation:
•If FDA-approved/Unmodified
– only Reportable Range,
Precision, Accuracy and
Reference Intervals need to be
verified.
•If Non-FDA
approved/Modified – all 6
elements must be performed,
including sensitivity and
specificity.
9. samples are analyzed according to any number of schemes depending
upon the analyte availability:
Twice a day in duplicate for 10 days.
Once a day for 20 days.
Twice a day in quadruplicate for 5 days.
Select sufficient material at two levels:
Patient samples
QC material
Reference materials
Standards
Suitable materials that have a known value.
Precision
Multiple measurements are close to each others
i.e. Reproducibility
Gives information related to random error
Introduction
What is
needed
How we
perform the
testing
10. Experiment Design :
Run one sample 20 time once a day for within run precision and for between run
precision run one sample 2-4 times per day.
Data Input Requirements :
20 reading of single specimen,
allowable total error
allowable random error
Statistics:
MEAN
SD
CV
2SD RANGE
SD GOAL
Interpretation :The precision test pass if computed SD below the SD goal.
11. Accuracy
How close to the true value Comparison of methods
Closeness of the agreement between the result
of a measurement and a true value of the
measurand. [CLSI]
Gives information related to systematic error
Introduction
40 different specimens
Cover reportable range of method
What is
needed
Duplicate measurements of each specimen
on each method
Minimum of five days, prefer over 20
(since replicate testing is same)
How we
perform the
testing
12. Accuracy studies
Test results from the new
method against an existing
method which is known to
be accurate
Two or more samples in which the concentration of the
selected analyte concentrations spans but does not exceed
the analytical measuring interval of the assay.
Comparison of Method/ Instrument
Recovery of expected values
from assigned values
13. what is needed for accuracy studies ?
A control sample or certified reference material
Proficiency testing material
Materials provided by the method manufacturer for verification of
trueness or quality control.
14. Method comparison
• WHEN IT IS
PERFORMED?
To validate a new method being brought into
the lab, by demonstrating that it is
statistically identical to the method currently
in use.
HOW IT IS PERFORMED?
Assay about 20-40 patient samples on
both instruments. The specimens should
be somewhat evenly-distributed across
the analytes reportable range.
15. Purpose: To validate a new method being brought into the lab, by demonstrating that it is
statistically identical to the method currently in use.
Experiment Design Requirements:
Run 20-40 specimens that cover reportable range properly on both instruments.
Statistics:
Correlation coefficient(R)
SLOPE
INTERCEPT
Interpretation:
CORELATION COFICIENT SHOULD BE >0.9
95% confidence interval for the Deming Slope includes 1.000
95% confidence interval for the Deming Intercept includes 0.000
Alternate method comparison
16. Purpose:
The Two Instrument Comparison (2IC) procedure will satisfy the CLIA requirement for a lab to compare
instruments performing the same test on a semi-annual basis
Experiment Design:
Select 5-10 Specimens that cover reportable range and run on both instruments one time.
Data Requirements:
5-10 reading of specimens
Total allowable error
Reportable range
Statistics:
Average error index
Slope
Intercept
standard error estimate
Interpretation:
Test passes, when error index of each pair (x-y) is between 1.0 to -1.0
Test fails ,when error index of any pair greater than 1.0 or less than -1.0.
Two instrument comparison
17. Purpose: Multiple Instrument Comparison (MIC) compares 3 or more instruments to determine whether
they are within Total Allowable Error (TEa) of the target.
Experiment Design Requirements:
Select 3-19 instrument and run 3-5 specimens on each instrument that cover reportable range of test.
Select one instrument as a target instrument.
Data Requirements:
3-5 reading of each instrument
Total allowable error
Reportable range
Statistics:
OBSERVE ERROR
ERROR INDEX
ALLOWABLE ERROR
Interpretation:
The experiment passes if every non target instrument is within error index limit of -1 to 1 .
Multi instrument comparison
18. Reportable Range / Linearity
Lowest and highest test results that are reliable
Especially important with two point calibrations
Analytical Measurement Range (AMR) and derived Clinical Reportable Range (CRR)
Introduction
What is
needed
How we
perform the
testing
Material manufactured specially for linearity checking.
CAP linearity survey or validation materials
Quality control or calibration material.
Single Patient samples.
Pool patient sample.
Spiked patient samples
Run 3-11 (5 is sufficient) specimens in triplicate with known concentration
spread across the reportable range; ideally the lowest and highest
specimen should challenge the limit of range.
19. Verifying reportable range
• AMR must be verified before method introduced, and at least
every 6 months (and after recalibration or major maintenance)
while in use
• CRR is a clinical decision by lab director, and does not require
experiments or re-validation; however, dilution or
concentration protocols must be specified in methods
20. How we evaluate linearity ?
Reportable/Analytical measuring range(linearity) is verified if two
conditions are met:
Assigned values of the lowest and highest specimen should be
within proximity limits of the reportable range limit.
These two specimens are acceptably accurate with respect to total
allowable error.
21. Experiment Design :
Select 3-5 specimens that cover reportable range/AMR and run 3-5 times each specimen
Data In put Requirements :
Low and high reportable range of analyte
Proximity limits
3-5 reading of each specimens
Target value of each specimen(mean)
Allowable error
Statistics
Mean
Slope
Intercept
Error
Percent
Recovery
Interpretation :
The midpoints of target ranges for the lowest and highest specimens respectively are with in
the proximity limit s of the reportable range limits
These two specimens also pass accuracy.
The method is linear if it is possible to draw straight line that passes within a user defined
allowable error of each specimen point.
22. Reference Intervals
Normal range in healthy population
Used for diagnosis/clinical interpretation of results
Introduction
• Test and compare to manufacturer: If all 20 specimens fall within the specified range, the
reference ranges have been verified and you can adopt manufacturer suggestions and
incorporate into your SOP. If not, need to establish reference ranges for your population
(240 specimens: 120 each of male and female).
• Another lab may have established reference ranges that can be used for verification
purposes; must be documented.
What is
needed
How we
perform the
testing
Enter the readings in EP evualtor along with, the
"proposed" reference interval that is to be verified.
23. PURPOSE: Reference interval verification with respect to population
Experiment Design Requirements:
Select 20 specimens of healthy individuals and run one time per specimen
Data Requirements:
20 reading of health individual specimens
Proposed Reference interval range
Statistics:
MEAN
SD
MEDIAN
RANGE
Frequency
Interpretation:
If more than 10% of results are out side the proposed reference interval which mean verification fail,
otherwise passes.
24. Sensitivity
Lowest reliable value; lower limit of
detection, especially of interest in drug testing
and tumor markers
Different terminologies used by different
manufacturers
Introduction
Blank solution: ( often use the zero calibrator)
Low level of positive sample (slightly above
the manufacture's stated lowest detection limit)
What is
needed
Run 20 blanks or low level samples;
How we
perform the
testing
25. Purpose: To verify the vendor claim sensitivity
Experiment Design Requirements :
Replicate response measurements are made for two specimens
blank or zero concentration sample minimum 10 replicate
And 2nd sample of known low concentration minimum 3 replicate
Data Requirements :
10 reading of zero concentration sample
3 reading of low concentration sample
manufacturer’s claim sensitivity
Statistics:
Mean
SD
2 SD 95% confidence interval for Limit of Blank
Interpretation :
Manufacture sensitivity claim is verified when the computed LOB is less than manufacturer ‘s
claim.
26. Specificity
Determination of how well a method measures the
analyte of interest accompanied by potential
interfering materials
Introduction
Standard solutions, participant specimens
or pools
Interferer solutions (standard solutions, if
possible; otherwise, pools or specimens)
added at high concentrations
What is
needed
Duplicate measurements.
The lab can use the manufacturer’s provided list
How we
perform the
testing
27. Specificity: How We Evaluate the Data
Tabulate results for pairs of samples
(dilution and interferent)
Calculate means for each (dilution
and interferent)
Calculate the differences
Calculate the average interference of
all specimens tested at a given
concentration of interference
28. Carry Over
Carryover” in laboratory testing, is defined as “the
contamination of a specimen by the previous one”.
Select specimens for the analytes to be tested.
Select one patient/control specimen with a very low level of
the analyte and one with a very high level.
Select specimens with enough volume so that they can each be
run approximately 10 to 11 times.
WHAT IS NEEDED ?
29. when to perform carry over studies?
Study must be performed, as applicable, as a part of initial
evaluation of an instrument.
Study is repeated after major maintenance or repair of the
pipetting assembly of instrument.
Evaluation for carryover is not required for automatic
pipettes that use disposable tips.
The instrument must be dedicated to the analysis of one
analyte during this experiment and must do this experiment
for one analyte at a time.
Routine performance of tests must be suspended.
30. How to perform carry over?
Run in following order :
3 Low specimens
2 High specimens
1Low specimen
2 High specimens
4 Low specimens
2 High specimens
1 Low Specimen
2 High specimens
1 Low Specimen
2 High specimens
1 Low Specimen
31. Experiment design: Two specimen are prepared ,one with very high concentration and one with very
low concentration .these specimens are aliquot out in to a total of 21 samples :11 with low and 10 with
high concentration.
Run sample in following sequence on analyzer.
LLLHHLHHLLLLHHLHHLHHL
Data Requirements:
21 reading of low and high specimen as above sequence.
Statistics
SD
Mean
Error Limit
Carry over
carry over: The mean of H-L results minus the mean of L-L results
Error limit: Three times the SD of L-L results
Interpretation :Carry over test passes if carry over is less than error limit.
33. Precision for qualitative assay
Runs of specimens with analyte concentrations near the cutoff
point .
Three specimens, one at cutoff, one just below cutoff, and one
just above cutoff (± 20% recommended) .
Replicate measurements of each of three specimens (20 each,
minimum).
34. How to evaluate?
The results obtained from the negative and positive controls
will be used to calculate the CV and compared to the
manufacturer’s claims for reproducibility.
The laboratory CV should be less than or equal to the
manufacturer’s stated CV. In the event that an assay does not
perform as expected
35. What is needed for accuracy studies for
qualitative testing?
Samples with known values, such as :
proficiency testing samples or commercial standards, may be
used as the reference method.
use of EQA samples or other commercially prepared
reference material with known values.
36. accuracy/method comparison for qualitative
testing
What is needed ?
• A minimum of 10 samples for each expected result.
For example, if a test method gives results of
“Positive/Negative”, the accuracy study must include 10
known positives and 10 known negatives.
• Two levels of quality control must be run each day that testing
is performed, not including controls internal to the kit
cartridge/testing device.
37. How it is performed?
• The performance of qualitative tests is most commonly
described in terms of sensitivity and specificity.
• By using a contingency table:
Method being Validated
Diagnostic Sensitivity and Specificity
(Results from Comparison Study) Total
Positive Negative
Positive # true positive (TP) # false positive (FP) TP+FP
Negative # false negative (FN) # true negative (TN) FN+TN
Total TP+FN FP+TN N
38. How it is evaluated?
Compare the results calculated above with the manufacturer’s
stated claims for Sensitivity, Specificity and Agreement found
in the test kit package insert.
Results must be equal to, or greater than, the manufacturer’s
claims for the method to be considered accurate
39. PURPOSE: To compare two qualitative method are correlated to each other
Experiment Design Requirements:
Run 20-40 specimen from both method which consist off positive ,negative and borderline results
equally.
Data Requirements :
20-40 reading of specimens
Statistics:
Total agreement
Positive agreement
Negative agreement
Cohen kappa agreement
Interpretation :
Cohen kappa agreement should be >75% passes.
Total agreement should be >90%
qualitative/semi qualitatine method comparision
What is Method Validation?
Method validation and/or verification is the process by which a method is determined to be fit for purpose and intended use. Although method validation/verification are often used interchangeably, validation is usually performed on in-house and/or modified methods, while verification is taking a marketed/unmodified assay and verifying its performance.
Why is it important?
Different testing environment, need to demonstrate that the test method performs in your lab environment as the manufacturer states it should
Need to prove to yourself that the results reported by the manufacturer are reliable.
When?
Initially, before releasing patient results, and after any manufacturer changes/modifications and/or movement of the equipment.
Measure of the reproducibility of the assay.
Provides information related to random error.
How do you verify precision?
Must repeat testing on 20 samples over one day (short term) and over a period of 20 days (long term).
Within 20 days we hope to see good among of variation in terms of how the test performed and exposure to a variety of environmental conditions.
How does the new method compare to the reference method or standard?
Testing should be performed in duplicate over at least 5 days in order to account for analyzer variations over the specified time period.
Precision gives you information related to random error; Accuracy gives you information related to systematic error.
Linearity may be misnomer; hence the terminology of Analytical Measurement Range and derived Clinical Reportable Range.
For each reagent or kit, need to establish reference intervals to assist clinicians in interpretation of results.
Based on normal “healthy” population.
Test and compare to manufacturer: If all 20 specimens fall within the specified range, the reference ranges have been verified and you can adopt manufacturer suggestions and incorporate into your SOP. If not, need to establish reference ranges for your population (240 specimens: 120 each of male and female).
Another lab may have established reference ranges that can be used for verification purposes; must be documented.
Not required for FDA approved/ unmodified assay.
If FDA approved/Unmodified, information can be used directly and incorporated in the your SOP.
Need to adopt values in your SOP as evidence for sponsor/audit.
Ability of your method to accurately measure an analyte within the presence of potential interfering substances.
Not required for FDA approved/ unmodified assay.
If FDA approved/Unmodified, adopt values in your SOP as evidence for sponsor/audit.
What else can cause interferences? Drugs/medication/hemolysis/lipemia.
Run assay with specimen diluted with blank (saline) and compare to same specimen diluted with potential interfering substance.