SlideShare a Scribd company logo
1 of 22
Workshop on
Direct Observation of Procedural
Skills (DOPS)
MEU
AIMSR
Learning Objectives
By the end of the workshop the learner should
understand
• What is DOPS
• Structure of DOPS
• Where and when it has to be conducted
• Feedback
• Role of Assessor
• Role of Trainee
MILLERS PYRAMID
DIRECT OBSERVATION OF PROCEDURAL
SKILLS(DOPS)
• Work place based assessment
• Formative assessment
• A concise and validated method of observation
and evaluation of a procedural skill(technical or
practical skills) performed by a trainee on a real
patient
• Supplemented with a developmental feedback
• Strong learning environment
• Positive effect on the students performance and
self confidence
NOT AN EXAM
Why??
• Patients safety and standards
• Part of CBME
• To develop Trainees practical skill
• Develops Independence during assessment
• Prompts a deeper and higher reflective approach
• Higher satisfaction
HOW???
The trainee is responsible for planning when a DOPS will occur
in consultation with the assessor
• The trainee and assessor determine the assessment criteria
to be considered during the DOPS.
• The assessor observes the trainee conducting a procedural
skill : 10-15 mins
• Following observation, a DOPS form should be completed by
the assessor with the trainee present
• The feedback session occurs immediately after the
observation: 5-10 mins
• Maintenance of records
What??
I-Independently performed
O-Observed in patients or on simulations
D-Demonstration on patients or simulators and performance under supervision
NMC CBME UG CURRICULUM-SKILL TRAINING MODULE-PG 4-6
PG CURRICULUM
DOPS Rating Form
WHERE ???WHEN??
• OT
• OP
• ER
• Wards
• ICU
6-8 Assessments/year
WHO???
• HOD
• Professors
• Associates
• Assistants
• Senior Residents
ROLE OF ASSESSORS
• Clinically competent
• Familiar with DOPS process
• Smooth conduction
• Observe the procedure without interruption
• FEEDBACK
STEPS FOR EFFECTIVE FEEDBACK
PREPARE
COMPLIMENT
COACH-PRESENT
THE FACTS
ENCOURAGE
FOLLOW UP LATER
1
2
3
4
5
FEEDBACK LOOP
• Where are you going ?
• Where are you now ?
• How are you going to get there ?
ROLE OF TRAINEES
• S- Spread assessments through job
• A-As many assessors as possible
• F-Feedback as well as scores
• E-Evidence it all up(follow up actions)
• R-Reflect on what they do
• https://youtu.be/RWkpJ-K78XI
• https://youtu.be/hLbY-PjytmY
• https://youtu.be/3_DKx6EoYVo
REFERENCES
• Erfani Khanghahi M, Ebadi Fard Azar F. Direct observation of procedural
skills (DOPS) evaluation method: Systematic review of evidence. Med J
Islam Repub Iran. 2018 Jun 3;32:45. doi: 10.14196/mjiri.32.45. PMID:
30159296; PMCID: PMC6108252
• Lagoo JY, Joshi SB. Introduction of direct observation of procedural skills
(DOPS) as a formative assessment tool during postgraduate training in
anaesthesiology: Exploration of perceptions. Indian J Anaesth. 2021
Mar;65(3):202-209
• Kara CO, Mengi E, Tümkaya F, Topuz B, Ardıç FN. Direct Observation of
Procedural Skills in Otorhinolaryngology Training. Turkish Archives of
Otorhinolaryngology. 2018 Mar;56(1):7-14.

More Related Content

Similar to WORKPLACE BASED ASSESSMENT-DIRECTLY OBSERVED PROCEDURAL SKILLS

Educational supervision presentation
Educational supervision presentationEducational supervision presentation
Educational supervision presentationuniversity of karachi
 
Evaluation the many faces
Evaluation   the many facesEvaluation   the many faces
Evaluation the many facesleesha roberts
 
peer observation - workshop modified .pptx
peer observation - workshop modified .pptxpeer observation - workshop modified .pptx
peer observation - workshop modified .pptxMerajuddinAhmed3
 
Choosing and Implementing a New LMS: Lessons Learned from St. Petersburg College
Choosing and Implementing a New LMS: Lessons Learned from St. Petersburg CollegeChoosing and Implementing a New LMS: Lessons Learned from St. Petersburg College
Choosing and Implementing a New LMS: Lessons Learned from St. Petersburg CollegeD2L
 
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...ExamSoft
 
Kirpatrick model of evaluation
Kirpatrick model of evaluationKirpatrick model of evaluation
Kirpatrick model of evaluationSajan Ks
 
Ludka Kotarska Mid-term self-assessment revisited - making the most of the Ea...
Ludka Kotarska Mid-term self-assessment revisited - making the most of the Ea...Ludka Kotarska Mid-term self-assessment revisited - making the most of the Ea...
Ludka Kotarska Mid-term self-assessment revisited - making the most of the Ea...eaquals
 
Jan 15 How Do You Know It Works Final Read Only
Jan 15 How Do You Know It Works Final Read OnlyJan 15 How Do You Know It Works Final Read Only
Jan 15 How Do You Know It Works Final Read Onlyfelicitymorgan
 
Training session on presentation skills for corporate professionals
Training session on presentation skills for corporate professionalsTraining session on presentation skills for corporate professionals
Training session on presentation skills for corporate professionalsTirthankar Sutradhar
 
Investment in Assessment: How Students Intern and Learn
Investment in Assessment: How Students Intern and LearnInvestment in Assessment: How Students Intern and Learn
Investment in Assessment: How Students Intern and LearnSymplicity Corporation
 
Ne learning support intellectual wrap up-11-28-16
Ne learning support intellectual wrap up-11-28-16Ne learning support intellectual wrap up-11-28-16
Ne learning support intellectual wrap up-11-28-16Houston Community College
 
Assessment Types - Beauty Educator Training and Teaching Diploma Presentation...
Assessment Types - Beauty Educator Training and Teaching Diploma Presentation...Assessment Types - Beauty Educator Training and Teaching Diploma Presentation...
Assessment Types - Beauty Educator Training and Teaching Diploma Presentation...victoria333875
 
Evaluation – concepts and principles
Evaluation – concepts and principlesEvaluation – concepts and principles
Evaluation – concepts and principlesAruna Ap
 
Probation Assessment 2013 Marian petre
Probation Assessment 2013   Marian petreProbation Assessment 2013   Marian petre
Probation Assessment 2013 Marian petreVreckaScott
 

Similar to WORKPLACE BASED ASSESSMENT-DIRECTLY OBSERVED PROCEDURAL SKILLS (20)

HE Course and Module Evaluation Conference - Catherine Ormand
HE Course and Module Evaluation Conference - Catherine OrmandHE Course and Module Evaluation Conference - Catherine Ormand
HE Course and Module Evaluation Conference - Catherine Ormand
 
HE Course and Module Evaluation Conference -
HE Course and Module Evaluation Conference - HE Course and Module Evaluation Conference -
HE Course and Module Evaluation Conference -
 
Educational supervision presentation
Educational supervision presentationEducational supervision presentation
Educational supervision presentation
 
Portfolio
PortfolioPortfolio
Portfolio
 
Evaluation the many faces
Evaluation   the many facesEvaluation   the many faces
Evaluation the many faces
 
peer observation - workshop modified .pptx
peer observation - workshop modified .pptxpeer observation - workshop modified .pptx
peer observation - workshop modified .pptx
 
Choosing and Implementing a New LMS: Lessons Learned from St. Petersburg College
Choosing and Implementing a New LMS: Lessons Learned from St. Petersburg CollegeChoosing and Implementing a New LMS: Lessons Learned from St. Petersburg College
Choosing and Implementing a New LMS: Lessons Learned from St. Petersburg College
 
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
Utilizing Multiple Grader Rubrics for Practical Assessment of Student Perform...
 
Kirpatrick model of evaluation
Kirpatrick model of evaluationKirpatrick model of evaluation
Kirpatrick model of evaluation
 
Ludka Kotarska Mid-term self-assessment revisited - making the most of the Ea...
Ludka Kotarska Mid-term self-assessment revisited - making the most of the Ea...Ludka Kotarska Mid-term self-assessment revisited - making the most of the Ea...
Ludka Kotarska Mid-term self-assessment revisited - making the most of the Ea...
 
Jan 15 How Do You Know It Works Final Read Only
Jan 15 How Do You Know It Works Final Read OnlyJan 15 How Do You Know It Works Final Read Only
Jan 15 How Do You Know It Works Final Read Only
 
Assessment
AssessmentAssessment
Assessment
 
Training session on presentation skills for corporate professionals
Training session on presentation skills for corporate professionalsTraining session on presentation skills for corporate professionals
Training session on presentation skills for corporate professionals
 
Investment in Assessment: How Students Intern and Learn
Investment in Assessment: How Students Intern and LearnInvestment in Assessment: How Students Intern and Learn
Investment in Assessment: How Students Intern and Learn
 
Ne learning support intellectual wrap up-11-28-16
Ne learning support intellectual wrap up-11-28-16Ne learning support intellectual wrap up-11-28-16
Ne learning support intellectual wrap up-11-28-16
 
Assessment Types - Beauty Educator Training and Teaching Diploma Presentation...
Assessment Types - Beauty Educator Training and Teaching Diploma Presentation...Assessment Types - Beauty Educator Training and Teaching Diploma Presentation...
Assessment Types - Beauty Educator Training and Teaching Diploma Presentation...
 
ASSESSMENT.pptx
ASSESSMENT.pptxASSESSMENT.pptx
ASSESSMENT.pptx
 
Dr. Jamil 8625 Day 5.pdf
Dr. Jamil 8625 Day 5.pdfDr. Jamil 8625 Day 5.pdf
Dr. Jamil 8625 Day 5.pdf
 
Evaluation – concepts and principles
Evaluation – concepts and principlesEvaluation – concepts and principles
Evaluation – concepts and principles
 
Probation Assessment 2013 Marian petre
Probation Assessment 2013   Marian petreProbation Assessment 2013   Marian petre
Probation Assessment 2013 Marian petre
 

Recently uploaded

An overview of Muir Wood Adolescent and Family Services teen treatment progra...
An overview of Muir Wood Adolescent and Family Services teen treatment progra...An overview of Muir Wood Adolescent and Family Services teen treatment progra...
An overview of Muir Wood Adolescent and Family Services teen treatment progra...pdamico1
 
An overview of Muir Wood Adolescent and Family Services teen treatment programs.
An overview of Muir Wood Adolescent and Family Services teen treatment programs.An overview of Muir Wood Adolescent and Family Services teen treatment programs.
An overview of Muir Wood Adolescent and Family Services teen treatment programs.pdamico1
 
Session-1-MBFHI-A-part-of-the-Global-Strategy.ppt
Session-1-MBFHI-A-part-of-the-Global-Strategy.pptSession-1-MBFHI-A-part-of-the-Global-Strategy.ppt
Session-1-MBFHI-A-part-of-the-Global-Strategy.pptMedidas Medical Center INC
 
Technology transfer documentation and strategies
Technology transfer documentation and strategiesTechnology transfer documentation and strategies
Technology transfer documentation and strategiesNidhi Joshi
 
Lion's Mane Mushroom: Benefits for Athletes and Active Individuals
Lion's Mane Mushroom: Benefits for Athletes and Active IndividualsLion's Mane Mushroom: Benefits for Athletes and Active Individuals
Lion's Mane Mushroom: Benefits for Athletes and Active IndividualsMyCo Planet
 
clostridiumbotulinum- BY Muzammil Ahmed Siddiqui.pptx
clostridiumbotulinum- BY Muzammil Ahmed Siddiqui.pptxclostridiumbotulinum- BY Muzammil Ahmed Siddiqui.pptx
clostridiumbotulinum- BY Muzammil Ahmed Siddiqui.pptxMuzammil Ahmed Siddiqui
 
Mike Lowe’s cancer fight lowe strong shirt
Mike Lowe’s cancer fight lowe strong shirtMike Lowe’s cancer fight lowe strong shirt
Mike Lowe’s cancer fight lowe strong shirtrahman018755
 
Bobath Technique (Samrth Pareta) .ppt.pptx
Bobath Technique (Samrth Pareta) .ppt.pptxBobath Technique (Samrth Pareta) .ppt.pptx
Bobath Technique (Samrth Pareta) .ppt.pptxSamrth Pareta
 
obat aborsi bali wa 081313339699 jual obat aborsi cytotec asli di bali
obat aborsi bali wa 081313339699 jual obat aborsi cytotec asli di baliobat aborsi bali wa 081313339699 jual obat aborsi cytotec asli di bali
obat aborsi bali wa 081313339699 jual obat aborsi cytotec asli di balinitatalita796
 
Antiepileptic-Drugs-and-Congenital-Anomalies copy.pptx
Antiepileptic-Drugs-and-Congenital-Anomalies copy.pptxAntiepileptic-Drugs-and-Congenital-Anomalies copy.pptx
Antiepileptic-Drugs-and-Congenital-Anomalies copy.pptxdrdeepikaj
 
Healthcare Market Overview, May 2024: Funding, Financing and M&A, from Oppenh...
Healthcare Market Overview, May 2024: Funding, Financing and M&A, from Oppenh...Healthcare Market Overview, May 2024: Funding, Financing and M&A, from Oppenh...
Healthcare Market Overview, May 2024: Funding, Financing and M&A, from Oppenh...Levi Shapiro
 
Etiology for RRT and Code Blue Workshop.
Etiology for RRT and Code Blue Workshop.Etiology for RRT and Code Blue Workshop.
Etiology for RRT and Code Blue Workshop.Brian Locke
 
Spauldings classification ppt by Dr C P PRINCE
Spauldings classification ppt by Dr C P PRINCESpauldings classification ppt by Dr C P PRINCE
Spauldings classification ppt by Dr C P PRINCEDR.PRINCE C P
 
Leading large scale change: a life at the interface between theory and practice
Leading large scale change: a life at the interface between theory and practiceLeading large scale change: a life at the interface between theory and practice
Leading large scale change: a life at the interface between theory and practiceHelenBevan4
 
" HAMIL 6 BULAN " CARA MENGGUGURKAN KANDUNGAN USIA 6 BULAN (087776558899]
" HAMIL 6 BULAN " CARA MENGGUGURKAN KANDUNGAN USIA 6 BULAN (087776558899]" HAMIL 6 BULAN " CARA MENGGUGURKAN KANDUNGAN USIA 6 BULAN (087776558899]
" HAMIL 6 BULAN " CARA MENGGUGURKAN KANDUNGAN USIA 6 BULAN (087776558899]Obat Cytotec
 
Top 20 Famous Indian Female Pornstars Name List 2024
Top 20 Famous Indian Female Pornstars Name List 2024Top 20 Famous Indian Female Pornstars Name List 2024
Top 20 Famous Indian Female Pornstars Name List 2024minkseocompany
 
obat aborsi jogja wa 081313339699 jual obat aborsi cytotec asli di jogja
obat aborsi jogja wa 081313339699 jual obat aborsi cytotec asli di jogjaobat aborsi jogja wa 081313339699 jual obat aborsi cytotec asli di jogja
obat aborsi jogja wa 081313339699 jual obat aborsi cytotec asli di jogjanitatalita796
 
End of Response issues - Code and Rapid Response Workshop
End of Response issues - Code and Rapid Response WorkshopEnd of Response issues - Code and Rapid Response Workshop
End of Response issues - Code and Rapid Response WorkshopBrian Locke
 
Top^Clinic ^%[+27785538335__Safe*Abortion Pills For Sale In Soweto
Top^Clinic ^%[+27785538335__Safe*Abortion Pills For Sale In SowetoTop^Clinic ^%[+27785538335__Safe*Abortion Pills For Sale In Soweto
Top^Clinic ^%[+27785538335__Safe*Abortion Pills For Sale In Sowetodoctorjoe1984
 

Recently uploaded (20)

An overview of Muir Wood Adolescent and Family Services teen treatment progra...
An overview of Muir Wood Adolescent and Family Services teen treatment progra...An overview of Muir Wood Adolescent and Family Services teen treatment progra...
An overview of Muir Wood Adolescent and Family Services teen treatment progra...
 
An overview of Muir Wood Adolescent and Family Services teen treatment programs.
An overview of Muir Wood Adolescent and Family Services teen treatment programs.An overview of Muir Wood Adolescent and Family Services teen treatment programs.
An overview of Muir Wood Adolescent and Family Services teen treatment programs.
 
Session-1-MBFHI-A-part-of-the-Global-Strategy.ppt
Session-1-MBFHI-A-part-of-the-Global-Strategy.pptSession-1-MBFHI-A-part-of-the-Global-Strategy.ppt
Session-1-MBFHI-A-part-of-the-Global-Strategy.ppt
 
Technology transfer documentation and strategies
Technology transfer documentation and strategiesTechnology transfer documentation and strategies
Technology transfer documentation and strategies
 
Lion's Mane Mushroom: Benefits for Athletes and Active Individuals
Lion's Mane Mushroom: Benefits for Athletes and Active IndividualsLion's Mane Mushroom: Benefits for Athletes and Active Individuals
Lion's Mane Mushroom: Benefits for Athletes and Active Individuals
 
Cara menggugurkan kandungan paling ampuh 08561234742
Cara menggugurkan kandungan paling ampuh 08561234742Cara menggugurkan kandungan paling ampuh 08561234742
Cara menggugurkan kandungan paling ampuh 08561234742
 
clostridiumbotulinum- BY Muzammil Ahmed Siddiqui.pptx
clostridiumbotulinum- BY Muzammil Ahmed Siddiqui.pptxclostridiumbotulinum- BY Muzammil Ahmed Siddiqui.pptx
clostridiumbotulinum- BY Muzammil Ahmed Siddiqui.pptx
 
Mike Lowe’s cancer fight lowe strong shirt
Mike Lowe’s cancer fight lowe strong shirtMike Lowe’s cancer fight lowe strong shirt
Mike Lowe’s cancer fight lowe strong shirt
 
Bobath Technique (Samrth Pareta) .ppt.pptx
Bobath Technique (Samrth Pareta) .ppt.pptxBobath Technique (Samrth Pareta) .ppt.pptx
Bobath Technique (Samrth Pareta) .ppt.pptx
 
obat aborsi bali wa 081313339699 jual obat aborsi cytotec asli di bali
obat aborsi bali wa 081313339699 jual obat aborsi cytotec asli di baliobat aborsi bali wa 081313339699 jual obat aborsi cytotec asli di bali
obat aborsi bali wa 081313339699 jual obat aborsi cytotec asli di bali
 
Antiepileptic-Drugs-and-Congenital-Anomalies copy.pptx
Antiepileptic-Drugs-and-Congenital-Anomalies copy.pptxAntiepileptic-Drugs-and-Congenital-Anomalies copy.pptx
Antiepileptic-Drugs-and-Congenital-Anomalies copy.pptx
 
Healthcare Market Overview, May 2024: Funding, Financing and M&A, from Oppenh...
Healthcare Market Overview, May 2024: Funding, Financing and M&A, from Oppenh...Healthcare Market Overview, May 2024: Funding, Financing and M&A, from Oppenh...
Healthcare Market Overview, May 2024: Funding, Financing and M&A, from Oppenh...
 
Etiology for RRT and Code Blue Workshop.
Etiology for RRT and Code Blue Workshop.Etiology for RRT and Code Blue Workshop.
Etiology for RRT and Code Blue Workshop.
 
Spauldings classification ppt by Dr C P PRINCE
Spauldings classification ppt by Dr C P PRINCESpauldings classification ppt by Dr C P PRINCE
Spauldings classification ppt by Dr C P PRINCE
 
Leading large scale change: a life at the interface between theory and practice
Leading large scale change: a life at the interface between theory and practiceLeading large scale change: a life at the interface between theory and practice
Leading large scale change: a life at the interface between theory and practice
 
" HAMIL 6 BULAN " CARA MENGGUGURKAN KANDUNGAN USIA 6 BULAN (087776558899]
" HAMIL 6 BULAN " CARA MENGGUGURKAN KANDUNGAN USIA 6 BULAN (087776558899]" HAMIL 6 BULAN " CARA MENGGUGURKAN KANDUNGAN USIA 6 BULAN (087776558899]
" HAMIL 6 BULAN " CARA MENGGUGURKAN KANDUNGAN USIA 6 BULAN (087776558899]
 
Top 20 Famous Indian Female Pornstars Name List 2024
Top 20 Famous Indian Female Pornstars Name List 2024Top 20 Famous Indian Female Pornstars Name List 2024
Top 20 Famous Indian Female Pornstars Name List 2024
 
obat aborsi jogja wa 081313339699 jual obat aborsi cytotec asli di jogja
obat aborsi jogja wa 081313339699 jual obat aborsi cytotec asli di jogjaobat aborsi jogja wa 081313339699 jual obat aborsi cytotec asli di jogja
obat aborsi jogja wa 081313339699 jual obat aborsi cytotec asli di jogja
 
End of Response issues - Code and Rapid Response Workshop
End of Response issues - Code and Rapid Response WorkshopEnd of Response issues - Code and Rapid Response Workshop
End of Response issues - Code and Rapid Response Workshop
 
Top^Clinic ^%[+27785538335__Safe*Abortion Pills For Sale In Soweto
Top^Clinic ^%[+27785538335__Safe*Abortion Pills For Sale In SowetoTop^Clinic ^%[+27785538335__Safe*Abortion Pills For Sale In Soweto
Top^Clinic ^%[+27785538335__Safe*Abortion Pills For Sale In Soweto
 

WORKPLACE BASED ASSESSMENT-DIRECTLY OBSERVED PROCEDURAL SKILLS

  • 1. Workshop on Direct Observation of Procedural Skills (DOPS) MEU AIMSR
  • 2. Learning Objectives By the end of the workshop the learner should understand • What is DOPS • Structure of DOPS • Where and when it has to be conducted • Feedback • Role of Assessor • Role of Trainee
  • 4. DIRECT OBSERVATION OF PROCEDURAL SKILLS(DOPS) • Work place based assessment • Formative assessment • A concise and validated method of observation and evaluation of a procedural skill(technical or practical skills) performed by a trainee on a real patient • Supplemented with a developmental feedback • Strong learning environment • Positive effect on the students performance and self confidence
  • 6. Why?? • Patients safety and standards • Part of CBME • To develop Trainees practical skill • Develops Independence during assessment • Prompts a deeper and higher reflective approach • Higher satisfaction
  • 7. HOW??? The trainee is responsible for planning when a DOPS will occur in consultation with the assessor • The trainee and assessor determine the assessment criteria to be considered during the DOPS. • The assessor observes the trainee conducting a procedural skill : 10-15 mins • Following observation, a DOPS form should be completed by the assessor with the trainee present • The feedback session occurs immediately after the observation: 5-10 mins • Maintenance of records
  • 9.
  • 10. I-Independently performed O-Observed in patients or on simulations D-Demonstration on patients or simulators and performance under supervision NMC CBME UG CURRICULUM-SKILL TRAINING MODULE-PG 4-6 PG CURRICULUM
  • 12. WHERE ???WHEN?? • OT • OP • ER • Wards • ICU 6-8 Assessments/year
  • 13. WHO??? • HOD • Professors • Associates • Assistants • Senior Residents
  • 14. ROLE OF ASSESSORS • Clinically competent • Familiar with DOPS process • Smooth conduction • Observe the procedure without interruption • FEEDBACK
  • 15.
  • 16. STEPS FOR EFFECTIVE FEEDBACK PREPARE COMPLIMENT COACH-PRESENT THE FACTS ENCOURAGE FOLLOW UP LATER 1 2 3 4 5
  • 17. FEEDBACK LOOP • Where are you going ? • Where are you now ? • How are you going to get there ?
  • 18.
  • 19. ROLE OF TRAINEES • S- Spread assessments through job • A-As many assessors as possible • F-Feedback as well as scores • E-Evidence it all up(follow up actions) • R-Reflect on what they do
  • 20.
  • 22. REFERENCES • Erfani Khanghahi M, Ebadi Fard Azar F. Direct observation of procedural skills (DOPS) evaluation method: Systematic review of evidence. Med J Islam Repub Iran. 2018 Jun 3;32:45. doi: 10.14196/mjiri.32.45. PMID: 30159296; PMCID: PMC6108252 • Lagoo JY, Joshi SB. Introduction of direct observation of procedural skills (DOPS) as a formative assessment tool during postgraduate training in anaesthesiology: Exploration of perceptions. Indian J Anaesth. 2021 Mar;65(3):202-209 • Kara CO, Mengi E, Tümkaya F, Topuz B, Ardıç FN. Direct Observation of Procedural Skills in Otorhinolaryngology Training. Turkish Archives of Otorhinolaryngology. 2018 Mar;56(1):7-14.