SlideShare a Scribd company logo
 Introduction
 Analytical Quality by Design (AQbD)
 Implementation of AQbD- Practical
aspects
 Case study
 Conclusion
 References
Dept. of Quality Assurance, DLHHCOP 2
3Dept. of Quality Assurance, DLHHCOP
Introduction
Dept. of Quality Assurance, DLHHCOP 4
AQbD- Key components
 Role of analytical methods in drug developmentRole of analytical methods in drug development
processprocess
5Dept. of Quality Assurance, DLHHCOP
AQbD- Drug Development Process
Dept. of Quality Assurance, DLHHCOP 6
AQbD- Benefits
7Dept. of Quality Assurance, DLHHCOP
Traditional versus AQbD
Steps Synthetic development (QbD) Analytical development (AQbD)
1 QTPP identification ATP (Analytical Target
Profile) identification
2 CQA/CMA identification,
Risk Assessment
CQA identification, Initial
Risk Assessment
3 Define product design space
with DoE
Method Optimization and
development with DOE
4 Refine product design space MODR (Method Operable
Design Region)
5 Control Strategy with Risk
Assessment
Control Strategy with Risk
Assessment
6 Process validation AQbD Method Validation
7 Continuous process Monitoring Continuous process Monitoring
 QbD tools for synthetic development and analytical development.
8Dept. of Quality Assurance, DLHHCOP
Traditional versus AQbD
9Dept. of Quality Assurance, DLHHCOP
AQbD Workflow
 Analytical Target Profile (ATP)
 Analytical Method Performance Characteristics
S. No. Method performance
characteristics
Defined by ICH and
USP
1 Accuracy, specificity, and
linearity
Systematic variability
2 Precision, detection limit, and
quantification limit
Inherent random variability
3 Range and robustness Not applicable
10Dept. of Quality Assurance, DLHHCOP
AQbD Practical Aspects
 Selection of Analytical Techniques
 Risk Assessment
 Design of Experiments (DoE)
› Screening
› Optimization
› Selection of DOE Tools
› Method Operable Design Region (MODR) and Surface Plots
› Model Validation
Risk factor = Severity × Occurrence × Detestability
11Dept. of Quality Assurance, DLHHCOP
AQbD Practical Aspects
 Design of Experiments (DoE)
› Screening, Optimization and Selection of DoE tools
Design Number of variables
and usage
Advantage Disadvantage
Full factorial
design
Optimization/2–5 variables Identifying the main and
interaction effect without
any confounding
Experimental runs
increase with increase in
number of variables
Fractional factorial
design or Taguchi
methods
Optimization/and screening
variables
Requiring lower number
of experimental runs
Resolving confounding
effects of interactions is a
difficult job
Plackett-Burman
method
Screening/or identifying vital
few factors from large number
of variables
Requiring very few runs
for large number of
variables
It does not reveal
interaction effect
Pseudo-Monte Carlo
sampling
(pseudorandom
sampling) method
Quantitative risk
analysis/optimization
Behaviour and changes to
the model can be
investigated with great
ease and speed. This is
preferred where exact
calculation is possible
For nonconvex design
spaces, this method of
sampling can be more
difficult to employ.
Random numbers that
can be produced from a
random number
generating algorithm
Full factorial
design
Optimization/ 2–5 variables Identifying the main and
interaction effect without
any confounding
Experimental runs
increase with increase in
number of variables
12Dept. of Quality Assurance, DLHHCOP
AQbD Practical Aspects
› Method Operable Design Region (MODR) and Surface Plot
› Model Validation
Contour plot for MODR
Systematic simulation graph for
retention time (X2-axis) as method
response at constant X3 (0.8 
mL/min as flow rate) with change
in pH (X1--axis).
(Graph shows significant
correlation between the
predicted retention time and
actual (experimental)
retention time with good
correlation coefficient.
13Dept. of Quality Assurance, DLHHCOP
Method Operable Design Region (MODR) and Surface Plot Model Validation
AQbD Practical Aspects
 Method Verification/Validation
 Control Strategy- Continuous Method Monitoring
14Dept. of Quality Assurance, DLHHCOP
AQbD Practical Aspects
S.
No.
Pharmaceutic
al testing
Control strategy
1 Raw material
testing
Specification based on product QTPP and CQA
Effects of variability, including supplier variations,
on process and method development are
understood
2 In-process
testing
Real time (at-, on-, or in-line) measurements
Active control of process to minimize product
variation Criteria based on multivariate process
understanding
3 Release
testing
Quality attributes predictable from process inputs
(design space)Specification is only part of the
quality control strategy
Specification based on patient needs (quality,
safety, efficacy, and performance)
4 Stability
testing
Predictive models at release minimize stability
failures
Specification set on desired product performance
with time
Real-time Blend
Uniformity by
using
TruProcess™
Analyzer
15Dept. of Quality Assurance, DLHHCOP
PAT and AQbD
Analytical Quality by Design Approach in RP-HPLC Method
Development for the Assay of Etofenamate in Dosage
Forms
Step 1: Target measurement
16Dept. of Quality Assurance, DLHHCOP
AQbD- Case Study
Step 2: DoE:Design of Experiment
(Method Optimization and Development)
17Dept. of Quality Assurance, DLHHCOP
Experimental Design
AQbD- Case Study
Step 3: Method Operable Design Region
pH of aqueous phase versus % of aqueous phase contour at
1.2ml/min flow rate of mobile phase
18Dept. of Quality Assurance, DLHHCOP
AQbD- Case Study
Quadratic model was obtained on application of
SigmaTech software with the polynomial equation:
Y=5.8778-0.0025X1+2.9925X2–0.8088X3–0.4925X1X2
0.075X1X3-0.125X2X3+0.1178X12 +1.1803X22+0.2768X32
19Dept. of Quality Assurance, DLHHCOP
Step 4: DoE: Model validation using regression analysis
Developed
Chromatogram
AQbD- Case Study
20Dept. of Quality Assurance, DLHHCOP
Step 5: : Method validation
AQbD- Case Study
 In a nutshell……
Parameter Traditional Product QbD AQbD
Approach Based on empirical
approach
Based on systematic approach Based on systematic
approach
Quality Quality is assured by end
product testing
Quality is built in the product
and process by design and
scientific approach
Robustness and
reproducibility of the
method built in method
development stage
FDA submission Including only data for
submission
Submission with product
knowledge and process
understanding
Submission with product
knowledge and assuring
by analytical target
profile
Specifications Specifications are based
on batch history
Specifications are based on
product performance
requirements
Based on method
performance to ATP
criteria
Process Process is frozen and
discourages changes
Flexible process with design
space allows continuous
improvement
Method flexibility with
MODR and allowing
continuous improvement
Targeted response Focusing on
reproducibility, ignoring
variation
Focusing on robustness which
understands control variation
Focus on robust and cost
effective method
Advantage Limited and simple It is expended process
analytical technology (PAT)
tool that replaces the need for
end product testing
Replacing the need of
revalidation and
minimizing OOT and OOS
21Dept. of Quality Assurance, DLHHCOP
AQbD- Summary
Dept. of Quality Assurance, DLHHCOP 22
%ofresearch
AQbD- Summary
 AQbD requires the right ATP and Risk
Assessment and usage of right tools and
performing the appropriate quantity of
work within proper timelines.
‘RIGHT ANALYTICS AT THE RIGHT TIME’
23Dept. of Quality Assurance, DLHHCOP
AQbD- Conclusion
 Raman, N. V. V. S. S.; Mallu, U. R.; Bapatu, H. R. J. Chem.2014, 2015 (1), 8.
 Torbeck L. D.J. Pharm.Tech.35 (10), 2011,46–47
 ICH Harmon. Tripart. Guidel. 2009, 8 (August), 1–28.
 Jackson, P. 2013, Technical note,
http://www.gmpcompliance.org/daten/training/ECA_QbD_in_Analysis_2013 (accessed
Oct 23, 2016).
 Warf S. F. 2013, Conference note; http:// www.ISPE.org/2013QbDConference (accessed
Oct 23, 2016).
 Jadhav, M. L.; Tambe, S. R. Chromatogr. Res. Int. 2013, 2013 (2), 1–9.
 Borman, P.; Roberts, J.; Jones, C.; Hanna-Brown, M.; Szucs, R.; Bale, nd S. 2010, 2 (7), 2–4.
 Hanna-brown, M.; Borman, P.; Bale, S.; Szucs, R. Sep. Sci. 2010, 2, 12–20.
 Nethercote P.; Borman P.; Bennett T.; Martin G.; McGregor P. 2010, 1–9.
 Vogt, F. G.; Kord, A. S. Pharm. Sci. 2011, 100 (3), 797–812.
 Bhatt, D. A.; Rane, S. I. Int. J. Pharm. Pharm. Sci. 2011, 3 (1), 179–187.
 Swartz, M.; Lukulay, P. H.; Krull, I.; Joseph, T. LCGC North Am. 2008, 26 (12), 1190–1197.
 Meyer, C.; Soldo,T.; Kettenring, U. Chim. Int. J. Chem. 2010, 64 (11), 825–825.
 McBrien, M. A.; Ling, S.. The Column 2011, 7 (5), 16–20.
 Molnár, I.; Rieger, H. J.; Monks, K. E. J. Chromatogr. A 2010, 1217 (19), 3193–3200.
 Karmarkar, S.; Garber, R.; Genchanok, Y.; George, S.; Yang, X.; Hammond, R. J.
Chromatogr. Sci. 2011, 49 (6), 439–446..
 Monks, K. E.; Rieger, H.-J.; Molnár, I. J. Pharm. Biomed. Anal. 2011, 56 (5), 874–879.
 Reid G. L., Cheng G., Fortin et al D. T. J. Liq. Chromatogr. Relat. Tecnhologies 2013, 36
(18), 2612–2638.
Dept. of Quality Assurance, DLHHCOP 24
References
 Monks, K.; Molnár, I.; Rieger, H. J.; Bogáti, B.; Szabó, E. J. Chromatogr. A 2012, 1232, 218–230.
 Orlandini, S.; Pinzauti, S.; Furlanetto, S. Anal. Bioanal. Chem. 2013, 405 (2–3), 443–450.
 Musters, J.; Van Den Bos, L.; Kellenbach, E. Org. Process Res. Dev. 2013, 17 (1), 87–96.
 Xavier, C. M.; Basavaiah, K.; Vinay, K. B.; Swamy, N. ISRN Chromatogr. 2013, 2013, 1–10..
 Xavier, C. M.; Basavaiah, K.; Xavier, C. M.; Basavaiah, K. ISRN Chromatogr. 2012, 2012, 1–11.
 Dasare, P.
http://sspcmsn.org/yahoo_site_admin/assets/docs/Analytical_approach_in_QbD_SSPC.4416180
8.pdf (accessed on Oct 26, 2016).
 Chatterjee, S. IFPAC Annu. Meet.2013
 Morgado, J.; Barnett, K.; Ph, D.; Harrington, B.; Wang, J.; Ph, D.; Harwood, J. 2013, 2, 1–14.
 Elder, D.; Borman, P. Pharm. Outsourcing 2013.
 Zlota, A. A.; Zlota, T.; Llc, C. 2014..
 ASME. 2010, https://www.asme.org/products/codesstandards/b89731-2001guidelines decision-
rules-considering (accessed on Oct 26, 2016).
 Guide, C.; Edition, F. Interpret. A J. Bible Theol. 2007, 18.
 Burnett K. L., Harrington B., and Graul T. W. 2013.
 Jadhav, M. L.; Tambe, S. R. Chromatogr. Res. Int. 2013, 2013, 1–9.
 ICH Expert Working Group. ICH Harmon. Tripart. Guidel. 2005, No. November, 1–23.
http://www.ssciinc.com/DrugSubstance/PATandPharmaceuticalQualityByDesign/
tabid/86/Default.aspx (accessed on Oct 26, 2016).
 Patel, G. M.; Shelat, P. K.; Lalwani, A. N. Eur. J. Pharm. Sci.2016.
 Li, Y.; Liu, D. Q.; Yang, S.; Sudini, R.; McGuire, M. A.; Bhanushali, D. S.; Kord, A. S. J. Pharm.
Biomed. Anal.2010, 52 (4), 493–507.
Dept. of Quality Assurance, DLHHCOP 25
References
26Dept. of Quality Assurance, DLHHCOP

More Related Content

What's hot

Ich q10
Ich q10Ich q10
Quality by design (QbD) and process analytical technology (PAT)
Quality by design (QbD) and process analytical technology (PAT)Quality by design (QbD) and process analytical technology (PAT)
Quality by design (QbD) and process analytical technology (PAT)
shreyashChaudhari6
 
Process Validation of Liquid Orals
Process Validation of Liquid OralsProcess Validation of Liquid Orals
Process Validation of Liquid Orals
Aasawaree Yadav
 
CDER
CDERCDER
Quality by Design
Quality by DesignQuality by Design
NEW ERA OF DRUG PRODUCT: OPPORTUNITIES AND CHALLENGES
NEW ERA OF DRUG PRODUCT: OPPORTUNITIES AND CHALLENGESNEW ERA OF DRUG PRODUCT: OPPORTUNITIES AND CHALLENGES
NEW ERA OF DRUG PRODUCT: OPPORTUNITIES AND CHALLENGES
ganpat420
 
Issue facing modern drug packaging, selection & evaluation of pharmaceuti...
Issue facing modern drug packaging, selection & evaluation of pharmaceuti...Issue facing modern drug packaging, selection & evaluation of pharmaceuti...
Issue facing modern drug packaging, selection & evaluation of pharmaceuti...
HEALY LAD
 
Process validation and its types
Process validation and its typesProcess validation and its types
Process validation and its types
Anjali9410
 
ICH Q10
ICH Q10ICH Q10
Qualification of manufacturing equipment.
Qualification of manufacturing equipment.Qualification of manufacturing equipment.
Qualification of manufacturing equipment.
KhushbooKunkulol
 
QUALIFICATION OF MANUFACTURING EQUIPMENTS
QUALIFICATION OF MANUFACTURING EQUIPMENTSQUALIFICATION OF MANUFACTURING EQUIPMENTS
QUALIFICATION OF MANUFACTURING EQUIPMENTS
ANKUSH JADHAV
 
Analytical quality by design
Analytical quality by designAnalytical quality by design
Analytical quality by design
Annalisa Forlenza
 
Cleaning validation
Cleaning validationCleaning validation
Cleaning validation
Sagar Savale
 
Distribution, Electronic data handling and controlled documentation by Khushb...
Distribution, Electronic data handling and controlled documentation by Khushb...Distribution, Electronic data handling and controlled documentation by Khushb...
Distribution, Electronic data handling and controlled documentation by Khushb...
KhushbooKunkulol
 
AUDITING OF AUALITY ASSURANCE AND ENGINEERING DEPARTMENT
AUDITING OF AUALITY ASSURANCE AND ENGINEERING DEPARTMENT AUDITING OF AUALITY ASSURANCE AND ENGINEERING DEPARTMENT
AUDITING OF AUALITY ASSURANCE AND ENGINEERING DEPARTMENT
HemlataMore3
 
Qualification of laboratory equipments by Mayuri Soni
Qualification of laboratory equipments by Mayuri SoniQualification of laboratory equipments by Mayuri Soni
Qualification of laboratory equipments by Mayuri Soni
Mayuri Soni
 
Process validation of Tablets and Lquids
Process validation of Tablets and LquidsProcess validation of Tablets and Lquids
Process validation of Tablets and Lquids
Raheem Kurikkal
 
Qualification of Friability Test Apparatus.pptx
Qualification of Friability Test Apparatus.pptxQualification of Friability Test Apparatus.pptx
Qualification of Friability Test Apparatus.pptx
GNIPST
 
ICH Q8 GUIDELINES OF QUALITY BY DESIGN(PRODUCT DEVELOPEMENT)
ICH Q8 GUIDELINES OF QUALITY BY DESIGN(PRODUCT DEVELOPEMENT)ICH Q8 GUIDELINES OF QUALITY BY DESIGN(PRODUCT DEVELOPEMENT)
ICH Q8 GUIDELINES OF QUALITY BY DESIGN(PRODUCT DEVELOPEMENT)
ROHIT
 
cGMP Guidelines According to Schedule M
cGMP Guidelines According to Schedule McGMP Guidelines According to Schedule M
cGMP Guidelines According to Schedule M
ANKUSH JADHAV
 

What's hot (20)

Ich q10
Ich q10Ich q10
Ich q10
 
Quality by design (QbD) and process analytical technology (PAT)
Quality by design (QbD) and process analytical technology (PAT)Quality by design (QbD) and process analytical technology (PAT)
Quality by design (QbD) and process analytical technology (PAT)
 
Process Validation of Liquid Orals
Process Validation of Liquid OralsProcess Validation of Liquid Orals
Process Validation of Liquid Orals
 
CDER
CDERCDER
CDER
 
Quality by Design
Quality by DesignQuality by Design
Quality by Design
 
NEW ERA OF DRUG PRODUCT: OPPORTUNITIES AND CHALLENGES
NEW ERA OF DRUG PRODUCT: OPPORTUNITIES AND CHALLENGESNEW ERA OF DRUG PRODUCT: OPPORTUNITIES AND CHALLENGES
NEW ERA OF DRUG PRODUCT: OPPORTUNITIES AND CHALLENGES
 
Issue facing modern drug packaging, selection & evaluation of pharmaceuti...
Issue facing modern drug packaging, selection & evaluation of pharmaceuti...Issue facing modern drug packaging, selection & evaluation of pharmaceuti...
Issue facing modern drug packaging, selection & evaluation of pharmaceuti...
 
Process validation and its types
Process validation and its typesProcess validation and its types
Process validation and its types
 
ICH Q10
ICH Q10ICH Q10
ICH Q10
 
Qualification of manufacturing equipment.
Qualification of manufacturing equipment.Qualification of manufacturing equipment.
Qualification of manufacturing equipment.
 
QUALIFICATION OF MANUFACTURING EQUIPMENTS
QUALIFICATION OF MANUFACTURING EQUIPMENTSQUALIFICATION OF MANUFACTURING EQUIPMENTS
QUALIFICATION OF MANUFACTURING EQUIPMENTS
 
Analytical quality by design
Analytical quality by designAnalytical quality by design
Analytical quality by design
 
Cleaning validation
Cleaning validationCleaning validation
Cleaning validation
 
Distribution, Electronic data handling and controlled documentation by Khushb...
Distribution, Electronic data handling and controlled documentation by Khushb...Distribution, Electronic data handling and controlled documentation by Khushb...
Distribution, Electronic data handling and controlled documentation by Khushb...
 
AUDITING OF AUALITY ASSURANCE AND ENGINEERING DEPARTMENT
AUDITING OF AUALITY ASSURANCE AND ENGINEERING DEPARTMENT AUDITING OF AUALITY ASSURANCE AND ENGINEERING DEPARTMENT
AUDITING OF AUALITY ASSURANCE AND ENGINEERING DEPARTMENT
 
Qualification of laboratory equipments by Mayuri Soni
Qualification of laboratory equipments by Mayuri SoniQualification of laboratory equipments by Mayuri Soni
Qualification of laboratory equipments by Mayuri Soni
 
Process validation of Tablets and Lquids
Process validation of Tablets and LquidsProcess validation of Tablets and Lquids
Process validation of Tablets and Lquids
 
Qualification of Friability Test Apparatus.pptx
Qualification of Friability Test Apparatus.pptxQualification of Friability Test Apparatus.pptx
Qualification of Friability Test Apparatus.pptx
 
ICH Q8 GUIDELINES OF QUALITY BY DESIGN(PRODUCT DEVELOPEMENT)
ICH Q8 GUIDELINES OF QUALITY BY DESIGN(PRODUCT DEVELOPEMENT)ICH Q8 GUIDELINES OF QUALITY BY DESIGN(PRODUCT DEVELOPEMENT)
ICH Q8 GUIDELINES OF QUALITY BY DESIGN(PRODUCT DEVELOPEMENT)
 
cGMP Guidelines According to Schedule M
cGMP Guidelines According to Schedule McGMP Guidelines According to Schedule M
cGMP Guidelines According to Schedule M
 

Similar to Analytical QbD

QbD and PAT Presentation
QbD and PAT PresentationQbD and PAT Presentation
QbD and PAT Presentation
sunp994
 
1ST REVIEW
1ST REVIEW1ST REVIEW
1ST REVIEW
chandu chatla
 
JPBA published-a platform aQbD approach for multiple methods development
JPBA published-a platform aQbD approach for multiple methods developmentJPBA published-a platform aQbD approach for multiple methods development
JPBA published-a platform aQbD approach for multiple methods developmentJianmei Kochling
 
Quality by design for Pharmaceutical Industries: An introduction
Quality by design for Pharmaceutical Industries: An introductionQuality by design for Pharmaceutical Industries: An introduction
Quality by design for Pharmaceutical Industries: An introduction
Covello Luca
 
Pharmaceutical Quality by Design (QbD)
Pharmaceutical Quality by Design (QbD)Pharmaceutical Quality by Design (QbD)
Pharmaceutical Quality by Design (QbD)
AnupriyaNR
 
Analytical QBD -CPHI 25-27 July R00
Analytical QBD  -CPHI 25-27 July R00Analytical QBD  -CPHI 25-27 July R00
Analytical QBD -CPHI 25-27 July R00Vijay Dhonde
 
QbD.pptx
QbD.pptxQbD.pptx
QbD.pptx
AJETHGJ
 
Quality by Design
Quality by Design Quality by Design
Quality by Design
GauravRane20
 
Quality by Design
Quality by DesignQuality by Design
Quality by Design
Kahnu charan panigrahi
 
Qbd continued
Qbd continuedQbd continued
Generic product development and technology transfer : At a glance
Generic product development and technology transfer : At a glanceGeneric product development and technology transfer : At a glance
Generic product development and technology transfer : At a glance
Dr. Girish S Sonar
 
Quality by Design (QbD)
Quality by Design (QbD)Quality by Design (QbD)
Quality by Design (QbD)
MohammadAbuzar19
 
Quality by design, B.PHARMACY, 6TH SEM, PHARMACEUTICAL QUALITY ASSURANCE, UNIT-I
Quality by design, B.PHARMACY, 6TH SEM, PHARMACEUTICAL QUALITY ASSURANCE, UNIT-IQuality by design, B.PHARMACY, 6TH SEM, PHARMACEUTICAL QUALITY ASSURANCE, UNIT-I
Quality by design, B.PHARMACY, 6TH SEM, PHARMACEUTICAL QUALITY ASSURANCE, UNIT-I
snigdharanibehera
 
Considering Quality by Design (QbD) in Analytical Development for Protein The...
Considering Quality by Design (QbD) in Analytical Development for Protein The...Considering Quality by Design (QbD) in Analytical Development for Protein The...
Considering Quality by Design (QbD) in Analytical Development for Protein The...
Weijun Li
 
Quality by design
Quality by design Quality by design
Quality by design
JyotsnaMalunjkar
 
Q8_Pharma_development_JL.Robert.pdf
Q8_Pharma_development_JL.Robert.pdfQ8_Pharma_development_JL.Robert.pdf
Q8_Pharma_development_JL.Robert.pdf
DivyashreePatil3
 
Risk-based Analytical Method Validation and Maintenance Strategies SK-Sep13
Risk-based Analytical Method Validation and Maintenance Strategies SK-Sep13Risk-based Analytical Method Validation and Maintenance Strategies SK-Sep13
Risk-based Analytical Method Validation and Maintenance Strategies SK-Sep13Stephan O. Krause, PhD
 
5-Scientific Approach to Validation.pptx
5-Scientific Approach to Validation.pptx5-Scientific Approach to Validation.pptx
5-Scientific Approach to Validation.pptx
AllanThomas30
 
Analytical method- Content, Development, validation, Transfer & Life Cycle Ma...
Analytical method- Content, Development, validation, Transfer & Life Cycle Ma...Analytical method- Content, Development, validation, Transfer & Life Cycle Ma...
Analytical method- Content, Development, validation, Transfer & Life Cycle Ma...
Md. Mizanur Rahman Miajee
 

Similar to Analytical QbD (20)

QbD and PAT Presentation
QbD and PAT PresentationQbD and PAT Presentation
QbD and PAT Presentation
 
1ST REVIEW
1ST REVIEW1ST REVIEW
1ST REVIEW
 
JPBA published-a platform aQbD approach for multiple methods development
JPBA published-a platform aQbD approach for multiple methods developmentJPBA published-a platform aQbD approach for multiple methods development
JPBA published-a platform aQbD approach for multiple methods development
 
Quality by design for Pharmaceutical Industries: An introduction
Quality by design for Pharmaceutical Industries: An introductionQuality by design for Pharmaceutical Industries: An introduction
Quality by design for Pharmaceutical Industries: An introduction
 
Pharmaceutical Quality by Design (QbD)
Pharmaceutical Quality by Design (QbD)Pharmaceutical Quality by Design (QbD)
Pharmaceutical Quality by Design (QbD)
 
Analytical QBD -CPHI 25-27 July R00
Analytical QBD  -CPHI 25-27 July R00Analytical QBD  -CPHI 25-27 July R00
Analytical QBD -CPHI 25-27 July R00
 
QbD.pptx
QbD.pptxQbD.pptx
QbD.pptx
 
Quality by Design
Quality by Design Quality by Design
Quality by Design
 
Quality by Design
Quality by DesignQuality by Design
Quality by Design
 
Qbd continued
Qbd continuedQbd continued
Qbd continued
 
Generic product development and technology transfer : At a glance
Generic product development and technology transfer : At a glanceGeneric product development and technology transfer : At a glance
Generic product development and technology transfer : At a glance
 
Quality by Design (QbD)
Quality by Design (QbD)Quality by Design (QbD)
Quality by Design (QbD)
 
Quality by design, B.PHARMACY, 6TH SEM, PHARMACEUTICAL QUALITY ASSURANCE, UNIT-I
Quality by design, B.PHARMACY, 6TH SEM, PHARMACEUTICAL QUALITY ASSURANCE, UNIT-IQuality by design, B.PHARMACY, 6TH SEM, PHARMACEUTICAL QUALITY ASSURANCE, UNIT-I
Quality by design, B.PHARMACY, 6TH SEM, PHARMACEUTICAL QUALITY ASSURANCE, UNIT-I
 
Considering Quality by Design (QbD) in Analytical Development for Protein The...
Considering Quality by Design (QbD) in Analytical Development for Protein The...Considering Quality by Design (QbD) in Analytical Development for Protein The...
Considering Quality by Design (QbD) in Analytical Development for Protein The...
 
Quality by design
Quality by design Quality by design
Quality by design
 
Q8_Pharma_development_JL.Robert.pdf
Q8_Pharma_development_JL.Robert.pdfQ8_Pharma_development_JL.Robert.pdf
Q8_Pharma_development_JL.Robert.pdf
 
Risk-based Analytical Method Validation and Maintenance Strategies SK-Sep13
Risk-based Analytical Method Validation and Maintenance Strategies SK-Sep13Risk-based Analytical Method Validation and Maintenance Strategies SK-Sep13
Risk-based Analytical Method Validation and Maintenance Strategies SK-Sep13
 
AMV final 20Jun17
AMV final 20Jun17AMV final 20Jun17
AMV final 20Jun17
 
5-Scientific Approach to Validation.pptx
5-Scientific Approach to Validation.pptx5-Scientific Approach to Validation.pptx
5-Scientific Approach to Validation.pptx
 
Analytical method- Content, Development, validation, Transfer & Life Cycle Ma...
Analytical method- Content, Development, validation, Transfer & Life Cycle Ma...Analytical method- Content, Development, validation, Transfer & Life Cycle Ma...
Analytical method- Content, Development, validation, Transfer & Life Cycle Ma...
 

Recently uploaded

Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
AzmatAli747758
 
Fish and Chips - have they had their chips
Fish and Chips - have they had their chipsFish and Chips - have they had their chips
Fish and Chips - have they had their chips
GeoBlogs
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
EverAndrsGuerraGuerr
 
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdfESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
Fundacja Rozwoju Społeczeństwa Przedsiębiorczego
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
MIRIAMSALINAS13
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
beazzy04
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
GeoBlogs
 
The Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve ThomasonThe Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve Thomason
Steve Thomason
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
Jisc
 
Basic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumersBasic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumers
PedroFerreira53928
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS Module
Celine George
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
Balvir Singh
 
Polish students' mobility in the Czech Republic
Polish students' mobility in the Czech RepublicPolish students' mobility in the Czech Republic
Polish students' mobility in the Czech Republic
Anna Sz.
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
Col Mukteshwar Prasad
 
Sectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdfSectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdf
Vivekanand Anglo Vedic Academy
 
Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)
rosedainty
 
Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
MysoreMuleSoftMeetup
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
siemaillard
 
How to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERPHow to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERP
Celine George
 

Recently uploaded (20)

Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
 
Fish and Chips - have they had their chips
Fish and Chips - have they had their chipsFish and Chips - have they had their chips
Fish and Chips - have they had their chips
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
 
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdfESC Beyond Borders _From EU to You_ InfoPack general.pdf
ESC Beyond Borders _From EU to You_ InfoPack general.pdf
 
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXXPhrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
Phrasal Verbs.XXXXXXXXXXXXXXXXXXXXXXXXXX
 
Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345Sha'Carri Richardson Presentation 202345
Sha'Carri Richardson Presentation 202345
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
 
The Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve ThomasonThe Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve Thomason
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
 
Basic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumersBasic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumers
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS Module
 
Operation Blue Star - Saka Neela Tara
Operation Blue Star   -  Saka Neela TaraOperation Blue Star   -  Saka Neela Tara
Operation Blue Star - Saka Neela Tara
 
Polish students' mobility in the Czech Republic
Polish students' mobility in the Czech RepublicPolish students' mobility in the Czech Republic
Polish students' mobility in the Czech Republic
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
 
Sectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdfSectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdf
 
Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)
 
Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
How to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERPHow to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERP
 

Analytical QbD

  • 1.
  • 2.  Introduction  Analytical Quality by Design (AQbD)  Implementation of AQbD- Practical aspects  Case study  Conclusion  References Dept. of Quality Assurance, DLHHCOP 2
  • 3. 3Dept. of Quality Assurance, DLHHCOP Introduction
  • 4. Dept. of Quality Assurance, DLHHCOP 4 AQbD- Key components
  • 5.  Role of analytical methods in drug developmentRole of analytical methods in drug development processprocess 5Dept. of Quality Assurance, DLHHCOP AQbD- Drug Development Process
  • 6. Dept. of Quality Assurance, DLHHCOP 6 AQbD- Benefits
  • 7. 7Dept. of Quality Assurance, DLHHCOP Traditional versus AQbD
  • 8. Steps Synthetic development (QbD) Analytical development (AQbD) 1 QTPP identification ATP (Analytical Target Profile) identification 2 CQA/CMA identification, Risk Assessment CQA identification, Initial Risk Assessment 3 Define product design space with DoE Method Optimization and development with DOE 4 Refine product design space MODR (Method Operable Design Region) 5 Control Strategy with Risk Assessment Control Strategy with Risk Assessment 6 Process validation AQbD Method Validation 7 Continuous process Monitoring Continuous process Monitoring  QbD tools for synthetic development and analytical development. 8Dept. of Quality Assurance, DLHHCOP Traditional versus AQbD
  • 9. 9Dept. of Quality Assurance, DLHHCOP AQbD Workflow
  • 10.  Analytical Target Profile (ATP)  Analytical Method Performance Characteristics S. No. Method performance characteristics Defined by ICH and USP 1 Accuracy, specificity, and linearity Systematic variability 2 Precision, detection limit, and quantification limit Inherent random variability 3 Range and robustness Not applicable 10Dept. of Quality Assurance, DLHHCOP AQbD Practical Aspects
  • 11.  Selection of Analytical Techniques  Risk Assessment  Design of Experiments (DoE) › Screening › Optimization › Selection of DOE Tools › Method Operable Design Region (MODR) and Surface Plots › Model Validation Risk factor = Severity × Occurrence × Detestability 11Dept. of Quality Assurance, DLHHCOP AQbD Practical Aspects
  • 12.  Design of Experiments (DoE) › Screening, Optimization and Selection of DoE tools Design Number of variables and usage Advantage Disadvantage Full factorial design Optimization/2–5 variables Identifying the main and interaction effect without any confounding Experimental runs increase with increase in number of variables Fractional factorial design or Taguchi methods Optimization/and screening variables Requiring lower number of experimental runs Resolving confounding effects of interactions is a difficult job Plackett-Burman method Screening/or identifying vital few factors from large number of variables Requiring very few runs for large number of variables It does not reveal interaction effect Pseudo-Monte Carlo sampling (pseudorandom sampling) method Quantitative risk analysis/optimization Behaviour and changes to the model can be investigated with great ease and speed. This is preferred where exact calculation is possible For nonconvex design spaces, this method of sampling can be more difficult to employ. Random numbers that can be produced from a random number generating algorithm Full factorial design Optimization/ 2–5 variables Identifying the main and interaction effect without any confounding Experimental runs increase with increase in number of variables 12Dept. of Quality Assurance, DLHHCOP AQbD Practical Aspects
  • 13. › Method Operable Design Region (MODR) and Surface Plot › Model Validation Contour plot for MODR Systematic simulation graph for retention time (X2-axis) as method response at constant X3 (0.8  mL/min as flow rate) with change in pH (X1--axis). (Graph shows significant correlation between the predicted retention time and actual (experimental) retention time with good correlation coefficient. 13Dept. of Quality Assurance, DLHHCOP Method Operable Design Region (MODR) and Surface Plot Model Validation AQbD Practical Aspects
  • 14.  Method Verification/Validation  Control Strategy- Continuous Method Monitoring 14Dept. of Quality Assurance, DLHHCOP AQbD Practical Aspects S. No. Pharmaceutic al testing Control strategy 1 Raw material testing Specification based on product QTPP and CQA Effects of variability, including supplier variations, on process and method development are understood 2 In-process testing Real time (at-, on-, or in-line) measurements Active control of process to minimize product variation Criteria based on multivariate process understanding 3 Release testing Quality attributes predictable from process inputs (design space)Specification is only part of the quality control strategy Specification based on patient needs (quality, safety, efficacy, and performance) 4 Stability testing Predictive models at release minimize stability failures Specification set on desired product performance with time
  • 15. Real-time Blend Uniformity by using TruProcess™ Analyzer 15Dept. of Quality Assurance, DLHHCOP PAT and AQbD
  • 16. Analytical Quality by Design Approach in RP-HPLC Method Development for the Assay of Etofenamate in Dosage Forms Step 1: Target measurement 16Dept. of Quality Assurance, DLHHCOP AQbD- Case Study
  • 17. Step 2: DoE:Design of Experiment (Method Optimization and Development) 17Dept. of Quality Assurance, DLHHCOP Experimental Design AQbD- Case Study
  • 18. Step 3: Method Operable Design Region pH of aqueous phase versus % of aqueous phase contour at 1.2ml/min flow rate of mobile phase 18Dept. of Quality Assurance, DLHHCOP AQbD- Case Study
  • 19. Quadratic model was obtained on application of SigmaTech software with the polynomial equation: Y=5.8778-0.0025X1+2.9925X2–0.8088X3–0.4925X1X2 0.075X1X3-0.125X2X3+0.1178X12 +1.1803X22+0.2768X32 19Dept. of Quality Assurance, DLHHCOP Step 4: DoE: Model validation using regression analysis Developed Chromatogram AQbD- Case Study
  • 20. 20Dept. of Quality Assurance, DLHHCOP Step 5: : Method validation AQbD- Case Study
  • 21.  In a nutshell…… Parameter Traditional Product QbD AQbD Approach Based on empirical approach Based on systematic approach Based on systematic approach Quality Quality is assured by end product testing Quality is built in the product and process by design and scientific approach Robustness and reproducibility of the method built in method development stage FDA submission Including only data for submission Submission with product knowledge and process understanding Submission with product knowledge and assuring by analytical target profile Specifications Specifications are based on batch history Specifications are based on product performance requirements Based on method performance to ATP criteria Process Process is frozen and discourages changes Flexible process with design space allows continuous improvement Method flexibility with MODR and allowing continuous improvement Targeted response Focusing on reproducibility, ignoring variation Focusing on robustness which understands control variation Focus on robust and cost effective method Advantage Limited and simple It is expended process analytical technology (PAT) tool that replaces the need for end product testing Replacing the need of revalidation and minimizing OOT and OOS 21Dept. of Quality Assurance, DLHHCOP AQbD- Summary
  • 22. Dept. of Quality Assurance, DLHHCOP 22 %ofresearch AQbD- Summary
  • 23.  AQbD requires the right ATP and Risk Assessment and usage of right tools and performing the appropriate quantity of work within proper timelines. ‘RIGHT ANALYTICS AT THE RIGHT TIME’ 23Dept. of Quality Assurance, DLHHCOP AQbD- Conclusion
  • 24.  Raman, N. V. V. S. S.; Mallu, U. R.; Bapatu, H. R. J. Chem.2014, 2015 (1), 8.  Torbeck L. D.J. Pharm.Tech.35 (10), 2011,46–47  ICH Harmon. Tripart. Guidel. 2009, 8 (August), 1–28.  Jackson, P. 2013, Technical note, http://www.gmpcompliance.org/daten/training/ECA_QbD_in_Analysis_2013 (accessed Oct 23, 2016).  Warf S. F. 2013, Conference note; http:// www.ISPE.org/2013QbDConference (accessed Oct 23, 2016).  Jadhav, M. L.; Tambe, S. R. Chromatogr. Res. Int. 2013, 2013 (2), 1–9.  Borman, P.; Roberts, J.; Jones, C.; Hanna-Brown, M.; Szucs, R.; Bale, nd S. 2010, 2 (7), 2–4.  Hanna-brown, M.; Borman, P.; Bale, S.; Szucs, R. Sep. Sci. 2010, 2, 12–20.  Nethercote P.; Borman P.; Bennett T.; Martin G.; McGregor P. 2010, 1–9.  Vogt, F. G.; Kord, A. S. Pharm. Sci. 2011, 100 (3), 797–812.  Bhatt, D. A.; Rane, S. I. Int. J. Pharm. Pharm. Sci. 2011, 3 (1), 179–187.  Swartz, M.; Lukulay, P. H.; Krull, I.; Joseph, T. LCGC North Am. 2008, 26 (12), 1190–1197.  Meyer, C.; Soldo,T.; Kettenring, U. Chim. Int. J. Chem. 2010, 64 (11), 825–825.  McBrien, M. A.; Ling, S.. The Column 2011, 7 (5), 16–20.  Molnár, I.; Rieger, H. J.; Monks, K. E. J. Chromatogr. A 2010, 1217 (19), 3193–3200.  Karmarkar, S.; Garber, R.; Genchanok, Y.; George, S.; Yang, X.; Hammond, R. J. Chromatogr. Sci. 2011, 49 (6), 439–446..  Monks, K. E.; Rieger, H.-J.; Molnár, I. J. Pharm. Biomed. Anal. 2011, 56 (5), 874–879.  Reid G. L., Cheng G., Fortin et al D. T. J. Liq. Chromatogr. Relat. Tecnhologies 2013, 36 (18), 2612–2638. Dept. of Quality Assurance, DLHHCOP 24 References
  • 25.  Monks, K.; Molnár, I.; Rieger, H. J.; Bogáti, B.; Szabó, E. J. Chromatogr. A 2012, 1232, 218–230.  Orlandini, S.; Pinzauti, S.; Furlanetto, S. Anal. Bioanal. Chem. 2013, 405 (2–3), 443–450.  Musters, J.; Van Den Bos, L.; Kellenbach, E. Org. Process Res. Dev. 2013, 17 (1), 87–96.  Xavier, C. M.; Basavaiah, K.; Vinay, K. B.; Swamy, N. ISRN Chromatogr. 2013, 2013, 1–10..  Xavier, C. M.; Basavaiah, K.; Xavier, C. M.; Basavaiah, K. ISRN Chromatogr. 2012, 2012, 1–11.  Dasare, P. http://sspcmsn.org/yahoo_site_admin/assets/docs/Analytical_approach_in_QbD_SSPC.4416180 8.pdf (accessed on Oct 26, 2016).  Chatterjee, S. IFPAC Annu. Meet.2013  Morgado, J.; Barnett, K.; Ph, D.; Harrington, B.; Wang, J.; Ph, D.; Harwood, J. 2013, 2, 1–14.  Elder, D.; Borman, P. Pharm. Outsourcing 2013.  Zlota, A. A.; Zlota, T.; Llc, C. 2014..  ASME. 2010, https://www.asme.org/products/codesstandards/b89731-2001guidelines decision- rules-considering (accessed on Oct 26, 2016).  Guide, C.; Edition, F. Interpret. A J. Bible Theol. 2007, 18.  Burnett K. L., Harrington B., and Graul T. W. 2013.  Jadhav, M. L.; Tambe, S. R. Chromatogr. Res. Int. 2013, 2013, 1–9.  ICH Expert Working Group. ICH Harmon. Tripart. Guidel. 2005, No. November, 1–23. http://www.ssciinc.com/DrugSubstance/PATandPharmaceuticalQualityByDesign/ tabid/86/Default.aspx (accessed on Oct 26, 2016).  Patel, G. M.; Shelat, P. K.; Lalwani, A. N. Eur. J. Pharm. Sci.2016.  Li, Y.; Liu, D. Q.; Yang, S.; Sudini, R.; McGuire, M. A.; Bhanushali, D. S.; Kord, A. S. J. Pharm. Biomed. Anal.2010, 52 (4), 493–507. Dept. of Quality Assurance, DLHHCOP 25 References
  • 26. 26Dept. of Quality Assurance, DLHHCOP