SlideShare a Scribd company logo
1 of 26
|||
Medical Council of Canada 103rd Annual Meeting
Pushing the Boundaries of
Medical Licensing
Examinations by Applying a
Programmatic Framework
Objectives
1. Review the assessment needs in order to fulfill the new
Blueprint
2. Describe the elements of programmatic assessment
3. Propose a model for national programmatic approach to
our assessment
Speakers
Claire Touchie, MD, MHPE, FRCPC
• Chief Medical Education Advisor, MCC
Cees van der Vleuten, PhD
• Professor, Director, School of Health Professions Education,
University of Maastricht
André De Champlain, PhD
• Director, Psychometric and Assessment Services, MCC
|||
Claire Touchie, MD, MHPE, FRCPC
September 27, 2015
Where are the gaps?
Beyond the MCCQE Part
I and Part II exams to
better meet our Blueprint:
Setting the scene
• Where we are
• Where the new Blueprint is taking us
• What are the gaps?
• How can we address them?
Today’s MCC Examination Landscape
• Blueprint: Based on discipline
Part I
196
MCQs
36 CDM
Cases
Part II
12 OSCE
Stations
Assessment Continuum
UGME PGME Practice
Part I Part II
NAC OSCE
Certification
Dimensions of Care
Health
Promotion
and Illness
Prevention
Acute Chronic Psychosocial Aspects
PhysicianActivities
Assessment/
Diagnosis
Management
Communication
Professional
Behaviors
New MCC Blueprint
8
9
Decision 1
Entry to residency
MCCQE Part I
Decision 1: Entry into residency
Dimensions of Care
Health
Promotion
and Illness
Prevention
Acute Chronic Psychosocial
Aspects
Row
Percent
PhysicianActivities
Assessment/
Diagnosis 30
Management 20
Communication 30
Professional
Behaviors 20
Column Percent 20 30 30 20 100
Entry to residency
11
Dimensions of Care
Health
Promotion
and Illness
Prevention
Acute Chronic Psychosocial
Aspects
Row
Percent
PhysicianActivities
Assessment/
Diagnosis 45±5
Management 35±5
Communication 10±5
Professional
Behaviors 10±5
Column Percent 20±5 35±5 30±5 15±5 100
Part I – Test Specifications
12
These weights were approved by CEC in June 2015
Dimensions of Care
Health
Promotion
and Illness
Prevention
Acute Chronic Psychosocial
Aspects
Row
Percent Part I Gap
Physician
Activities
Assessment/
Diagnosis 30±5 45±5 
Management 20±5 35±5 
Communication 30±5 10±5 
Professional
Behaviours 20±5 10±5 
Column Percent 20±5 30±5 30±5 20±5 100
Part I 20±5 35±5 30±5 15±5
Gap    
Entry into Residency - Gaps
14
New MCC Blueprint
15
Decision 1
Entry to residency
MCCQE Part I
Other
Assessments?
How can we fill the gap?
UGME Retreat – June 2015
Workplace-based type assessments?
• ? Reflections
• ?Multisource feedback
• ?school OSCE
Other national projects
• Pan-Canadian Entrustable Professional Activities at the
UGME/PGME Transition
Decision 2 – Entry to independent practice
Dimensions of Care
Health
Promotion
and Illness
Prevention
Acute Chronic Psychosocial
Aspects
Row
Percent
PhysicianActivities
Assessment/
Diagnosis 25
Management 35
Communication 20
Professional
Behaviors 20
Column Percent 20 25 35 20 100
Entry to Independent practice
18
Dimensions of Care
Health
Promotion
and Illness
Prevention
Acute Chronic Psychosocial
Aspects
Row
Percent
PhysicianActivities
Assessment/
Diagnosis 48
Management 13
Communication 34
Professional
Behaviors 5
Column Percent 10 70 14 6 100
Part II Gap Analysis
19
Decision 2 – Entry to independent practice
20
Decision 2
Entry to independent
practice
MCCQE Part II
Other
assessments?
Decision 2 – Entry to independent practice
21
MCCQE Part II
OSCE
Other
Assessments
Decision 2
Entry to independent
practice
Assessments informing the licentiate
Assessment Continuum
UGME PGME Practice
Part I Part II
NAC OSCE
Certification
WBA
OSCE
Licensure Decision ?
How should we put this all together to make
high stakes decisions for licensure?
As you listen to our next two speaker:
1. What are the advantages, in your view, of MCC adopting a
programmatic assessment approach?
2. What are the challenges and possible barriers to going
beyond the 2 point-in-time examiantions presently required
for the LMCC (MCCQE Part I and Part II)
|||
THANK YOU!THANK YOU!
Questions?

More Related Content

What's hot

Importance of M&E
Importance of M&EImportance of M&E
Importance of M&Eclearsateam
 
Effective course evaluation
Effective course evaluationEffective course evaluation
Effective course evaluationsurveyresults
 
Planning, monitoring & evaluation of health care program
Planning, monitoring & evaluation of health care programPlanning, monitoring & evaluation of health care program
Planning, monitoring & evaluation of health care programarijitkundu88
 
Capturing Student Learning: ePortfolio for Physical Therapist Assistants Phys...
Capturing Student Learning: ePortfolio for Physical Therapist Assistants Phys...Capturing Student Learning: ePortfolio for Physical Therapist Assistants Phys...
Capturing Student Learning: ePortfolio for Physical Therapist Assistants Phys...Jiyeon Lee
 
Questions and Challenges for Quality Management in Language Education
Questions and Challenges for Quality Management in Language EducationQuestions and Challenges for Quality Management in Language Education
Questions and Challenges for Quality Management in Language Educationeaquals
 
Evaluation methods in heathcare systems
Evaluation methods in heathcare systemsEvaluation methods in heathcare systems
Evaluation methods in heathcare systemsMarsa Gholamzadeh
 
A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...
A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...
A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...MEASURE Evaluation
 
Learning from Evaluation
Learning from EvaluationLearning from Evaluation
Learning from EvaluationOlivier Serrat
 
Supervision, monitoring and evaluation of research
Supervision, monitoring and evaluation of researchSupervision, monitoring and evaluation of research
Supervision, monitoring and evaluation of researchAshok Pandey
 
Program evaluation
Program evaluationProgram evaluation
Program evaluationspanishpvs
 
A Novel Approach for Developing Rating Scales for a Practice Ready OSCE
A Novel Approach for Developing Rating Scales for a Practice Ready OSCE A Novel Approach for Developing Rating Scales for a Practice Ready OSCE
A Novel Approach for Developing Rating Scales for a Practice Ready OSCE Saad Chahine
 
Management-Oriented Evaluation Approaches
Management-Oriented Evaluation ApproachesManagement-Oriented Evaluation Approaches
Management-Oriented Evaluation ApproachesLarry Weas
 
EDLD808 Program Evaluation Final Project - Online Education
EDLD808 Program Evaluation Final Project - Online EducationEDLD808 Program Evaluation Final Project - Online Education
EDLD808 Program Evaluation Final Project - Online EducationPaul Gruhn
 
Family planning 170706
Family planning 170706Family planning 170706
Family planning 170706kristofferryan
 
Conducting Programme Evaluation
Conducting Programme EvaluationConducting Programme Evaluation
Conducting Programme EvaluationPuja Shrivastav
 
National Quality Improvement & Clinical Audit Network (NQICAN) Annual Report ...
National Quality Improvement & Clinical Audit Network (NQICAN) Annual Report ...National Quality Improvement & Clinical Audit Network (NQICAN) Annual Report ...
National Quality Improvement & Clinical Audit Network (NQICAN) Annual Report ...Carl Walker
 

What's hot (20)

Importance of M&E
Importance of M&EImportance of M&E
Importance of M&E
 
Evaluation seminar1
Evaluation seminar1Evaluation seminar1
Evaluation seminar1
 
Effective course evaluation
Effective course evaluationEffective course evaluation
Effective course evaluation
 
Planning, monitoring & evaluation of health care program
Planning, monitoring & evaluation of health care programPlanning, monitoring & evaluation of health care program
Planning, monitoring & evaluation of health care program
 
Functions of evaluation
Functions of evaluationFunctions of evaluation
Functions of evaluation
 
Capturing Student Learning: ePortfolio for Physical Therapist Assistants Phys...
Capturing Student Learning: ePortfolio for Physical Therapist Assistants Phys...Capturing Student Learning: ePortfolio for Physical Therapist Assistants Phys...
Capturing Student Learning: ePortfolio for Physical Therapist Assistants Phys...
 
Questions and Challenges for Quality Management in Language Education
Questions and Challenges for Quality Management in Language EducationQuestions and Challenges for Quality Management in Language Education
Questions and Challenges for Quality Management in Language Education
 
Evaluation methods in heathcare systems
Evaluation methods in heathcare systemsEvaluation methods in heathcare systems
Evaluation methods in heathcare systems
 
A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...
A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...
A Systematic Approach to the Planning, Implementation, Monitoring, and Evalua...
 
Learning from Evaluation
Learning from EvaluationLearning from Evaluation
Learning from Evaluation
 
Supervision, monitoring and evaluation of research
Supervision, monitoring and evaluation of researchSupervision, monitoring and evaluation of research
Supervision, monitoring and evaluation of research
 
Program evaluation
Program evaluationProgram evaluation
Program evaluation
 
A Novel Approach for Developing Rating Scales for a Practice Ready OSCE
A Novel Approach for Developing Rating Scales for a Practice Ready OSCE A Novel Approach for Developing Rating Scales for a Practice Ready OSCE
A Novel Approach for Developing Rating Scales for a Practice Ready OSCE
 
Management-Oriented Evaluation Approaches
Management-Oriented Evaluation ApproachesManagement-Oriented Evaluation Approaches
Management-Oriented Evaluation Approaches
 
EDLD808 Program Evaluation Final Project - Online Education
EDLD808 Program Evaluation Final Project - Online EducationEDLD808 Program Evaluation Final Project - Online Education
EDLD808 Program Evaluation Final Project - Online Education
 
Family planning 170706
Family planning 170706Family planning 170706
Family planning 170706
 
Conducting Programme Evaluation
Conducting Programme EvaluationConducting Programme Evaluation
Conducting Programme Evaluation
 
Guidance on CRP Commissioned Evalautions
Guidance on CRP Commissioned EvalautionsGuidance on CRP Commissioned Evalautions
Guidance on CRP Commissioned Evalautions
 
"Assessing Outcomes in CGIAR: Practical Approaches and Methods"
"Assessing Outcomes in CGIAR: Practical Approaches and Methods""Assessing Outcomes in CGIAR: Practical Approaches and Methods"
"Assessing Outcomes in CGIAR: Practical Approaches and Methods"
 
National Quality Improvement & Clinical Audit Network (NQICAN) Annual Report ...
National Quality Improvement & Clinical Audit Network (NQICAN) Annual Report ...National Quality Improvement & Clinical Audit Network (NQICAN) Annual Report ...
National Quality Improvement & Clinical Audit Network (NQICAN) Annual Report ...
 

Similar to Pushing the Boundaries of Medical Licensing

The New Blueprint: challenging the comfort zone
The New Blueprint: challenging the comfort zoneThe New Blueprint: challenging the comfort zone
The New Blueprint: challenging the comfort zoneMedCouncilCan
 
Defining the New MCC Blueprint
Defining the New MCC Blueprint Defining the New MCC Blueprint
Defining the New MCC Blueprint MedCouncilCan
 
State of Michigan HIE Update (without Tina Scott)
State of Michigan HIE Update (without Tina Scott)State of Michigan HIE Update (without Tina Scott)
State of Michigan HIE Update (without Tina Scott)mihinpr
 
Meaningful Use Final Rule Updates 2015
Meaningful Use Final Rule Updates 2015Meaningful Use Final Rule Updates 2015
Meaningful Use Final Rule Updates 2015Ben Quirk
 
JCI Accreditation Status and way-forward in Saudi Arabia in 2013 by Mumtaz Ahmed
JCI Accreditation Status and way-forward in Saudi Arabia in 2013 by Mumtaz AhmedJCI Accreditation Status and way-forward in Saudi Arabia in 2013 by Mumtaz Ahmed
JCI Accreditation Status and way-forward in Saudi Arabia in 2013 by Mumtaz AhmedMumtaz Ahmed
 
Paying For performance in Health care
Paying For performance in Health carePaying For performance in Health care
Paying For performance in Health caredrnishantkumar2000
 
2016 ANZED Conference Workshop
2016 ANZED Conference Workshop2016 ANZED Conference Workshop
2016 ANZED Conference WorkshopLynn Faulkner
 
Modifed Stage 2 2015
Modifed Stage 2 2015Modifed Stage 2 2015
Modifed Stage 2 2015Melisa Pierce
 
MiPCT Webinar 1/22/2014
MiPCT Webinar 1/22/2014MiPCT Webinar 1/22/2014
MiPCT Webinar 1/22/2014mednetone
 
The Evolution of Continuing Medical Education: Implications for Navigating Ne...
The Evolution of Continuing Medical Education: Implications for Navigating Ne...The Evolution of Continuing Medical Education: Implications for Navigating Ne...
The Evolution of Continuing Medical Education: Implications for Navigating Ne...TristanLG
 
Using Lean concept in DM clinic Thailand
Using Lean concept  in DM clinic ThailandUsing Lean concept  in DM clinic Thailand
Using Lean concept in DM clinic ThailandSuthee Saritsiri
 
PYA Looks Beyond Meaningful Use at AHIMA
 PYA Looks Beyond Meaningful Use at AHIMA PYA Looks Beyond Meaningful Use at AHIMA
PYA Looks Beyond Meaningful Use at AHIMAPYA, P.C.
 
Findings from the REACHOUT Bangladesh team
Findings from the REACHOUT Bangladesh teamFindings from the REACHOUT Bangladesh team
Findings from the REACHOUT Bangladesh teamREACHOUTCONSORTIUMSLIDES
 
Meaningful Use: Programs, Penalities, and Payments
Meaningful Use: Programs, Penalities, and PaymentsMeaningful Use: Programs, Penalities, and Payments
Meaningful Use: Programs, Penalities, and PaymentsBen Quirk
 
Coding tips for busy orthopaedic practices
Coding tips for busy orthopaedic practicesCoding tips for busy orthopaedic practices
Coding tips for busy orthopaedic practicesReimbursementMD
 

Similar to Pushing the Boundaries of Medical Licensing (20)

The New Blueprint: challenging the comfort zone
The New Blueprint: challenging the comfort zoneThe New Blueprint: challenging the comfort zone
The New Blueprint: challenging the comfort zone
 
The
The The
The
 
Defining the New MCC Blueprint
Defining the New MCC Blueprint Defining the New MCC Blueprint
Defining the New MCC Blueprint
 
State of Michigan HIE Update (without Tina Scott)
State of Michigan HIE Update (without Tina Scott)State of Michigan HIE Update (without Tina Scott)
State of Michigan HIE Update (without Tina Scott)
 
Meaningful Use Mini-Camp Presentation
Meaningful Use Mini-Camp PresentationMeaningful Use Mini-Camp Presentation
Meaningful Use Mini-Camp Presentation
 
Meaningful Use Final Rule Updates 2015
Meaningful Use Final Rule Updates 2015Meaningful Use Final Rule Updates 2015
Meaningful Use Final Rule Updates 2015
 
JCI Accreditation Status and way-forward in Saudi Arabia in 2013 by Mumtaz Ahmed
JCI Accreditation Status and way-forward in Saudi Arabia in 2013 by Mumtaz AhmedJCI Accreditation Status and way-forward in Saudi Arabia in 2013 by Mumtaz Ahmed
JCI Accreditation Status and way-forward in Saudi Arabia in 2013 by Mumtaz Ahmed
 
Paying For performance in Health care
Paying For performance in Health carePaying For performance in Health care
Paying For performance in Health care
 
2016 ANZED Conference Workshop
2016 ANZED Conference Workshop2016 ANZED Conference Workshop
2016 ANZED Conference Workshop
 
Modifed Stage 2 2015
Modifed Stage 2 2015Modifed Stage 2 2015
Modifed Stage 2 2015
 
MiPCT Webinar 1/22/2014
MiPCT Webinar 1/22/2014MiPCT Webinar 1/22/2014
MiPCT Webinar 1/22/2014
 
The Evolution of Continuing Medical Education: Implications for Navigating Ne...
The Evolution of Continuing Medical Education: Implications for Navigating Ne...The Evolution of Continuing Medical Education: Implications for Navigating Ne...
The Evolution of Continuing Medical Education: Implications for Navigating Ne...
 
Using Lean concept in DM clinic Thailand
Using Lean concept  in DM clinic ThailandUsing Lean concept  in DM clinic Thailand
Using Lean concept in DM clinic Thailand
 
Scaling up MedRec Measurement – Experiences from Alberta
Scaling up MedRec Measurement – Experiences from AlbertaScaling up MedRec Measurement – Experiences from Alberta
Scaling up MedRec Measurement – Experiences from Alberta
 
Webinar: Comprehensive Primary Care Plus - Health IT Vendor Overview
Webinar: Comprehensive Primary Care Plus - Health IT Vendor OverviewWebinar: Comprehensive Primary Care Plus - Health IT Vendor Overview
Webinar: Comprehensive Primary Care Plus - Health IT Vendor Overview
 
PYA Looks Beyond Meaningful Use at AHIMA
 PYA Looks Beyond Meaningful Use at AHIMA PYA Looks Beyond Meaningful Use at AHIMA
PYA Looks Beyond Meaningful Use at AHIMA
 
Findings from the REACHOUT Bangladesh team
Findings from the REACHOUT Bangladesh teamFindings from the REACHOUT Bangladesh team
Findings from the REACHOUT Bangladesh team
 
Meaningful Use: Programs, Penalities, and Payments
Meaningful Use: Programs, Penalities, and PaymentsMeaningful Use: Programs, Penalities, and Payments
Meaningful Use: Programs, Penalities, and Payments
 
Webinar: CMS Innovation Center Update
Webinar: CMS Innovation Center UpdateWebinar: CMS Innovation Center Update
Webinar: CMS Innovation Center Update
 
Coding tips for busy orthopaedic practices
Coding tips for busy orthopaedic practicesCoding tips for busy orthopaedic practices
Coding tips for busy orthopaedic practices
 

More from MedCouncilCan

Séance d'orientation pour les candidats de l'examen de la CNE 2015
Séance d'orientation pour les candidats de l'examen de la CNE 2015Séance d'orientation pour les candidats de l'examen de la CNE 2015
Séance d'orientation pour les candidats de l'examen de la CNE 2015MedCouncilCan
 
2015 NAC candidate orientation presentation
2015 NAC candidate orientation presentation2015 NAC candidate orientation presentation
2015 NAC candidate orientation presentationMedCouncilCan
 
Surveying the landscape: An overview of tools for direct observation and asse...
Surveying the landscape: An overview of tools for direct observation and asse...Surveying the landscape: An overview of tools for direct observation and asse...
Surveying the landscape: An overview of tools for direct observation and asse...MedCouncilCan
 
Séance d'orientation pour les candidats de l'examen de la CNE de 2014
Séance d'orientation pour les candidats de l'examen de la CNE de 2014Séance d'orientation pour les candidats de l'examen de la CNE de 2014
Séance d'orientation pour les candidats de l'examen de la CNE de 2014MedCouncilCan
 
2014 NAC candidate orientation presentation
2014 NAC candidate orientation presentation2014 NAC candidate orientation presentation
2014 NAC candidate orientation presentationMedCouncilCan
 
NAC PRA update - 2014 Ottawa Conference
NAC PRA update - 2014 Ottawa ConferenceNAC PRA update - 2014 Ottawa Conference
NAC PRA update - 2014 Ottawa ConferenceMedCouncilCan
 
Blueprinting update - 2014 Ottawa Conference
Blueprinting update - 2014 Ottawa ConferenceBlueprinting update - 2014 Ottawa Conference
Blueprinting update - 2014 Ottawa ConferenceMedCouncilCan
 
Orientation à l’intention des candidats au format ECOS (2014)
Orientation à l’intention des candidats au format ECOS (2014)Orientation à l’intention des candidats au format ECOS (2014)
Orientation à l’intention des candidats au format ECOS (2014)MedCouncilCan
 
2014 Candidate Orientation Presentation - Certification Examination in Family...
2014 Candidate Orientation Presentation - Certification Examination in Family...2014 Candidate Orientation Presentation - Certification Examination in Family...
2014 Candidate Orientation Presentation - Certification Examination in Family...MedCouncilCan
 
Présentation d'orientation de 2014 - EACMC, partie II
Présentation d'orientation de 2014 - EACMC, partie IIPrésentation d'orientation de 2014 - EACMC, partie II
Présentation d'orientation de 2014 - EACMC, partie IIMedCouncilCan
 
Présentation d'orientation - Examen de la CNE 2014
Présentation d'orientation - Examen de la CNE 2014Présentation d'orientation - Examen de la CNE 2014
Présentation d'orientation - Examen de la CNE 2014MedCouncilCan
 
2014 NAC candidate orientation presentation
2014 NAC candidate orientation presentation 2014 NAC candidate orientation presentation
2014 NAC candidate orientation presentation MedCouncilCan
 
Pre-Exam Orientation for Candidates taking the Certification Examination in F...
Pre-Exam Orientation for Candidates taking the Certification Examination in F...Pre-Exam Orientation for Candidates taking the Certification Examination in F...
Pre-Exam Orientation for Candidates taking the Certification Examination in F...MedCouncilCan
 
Pre-Exam Candidate Orientation
Pre-Exam Candidate OrientationPre-Exam Candidate Orientation
Pre-Exam Candidate OrientationMedCouncilCan
 
Practice Ready Assessment for IMG Physicians
Practice Ready Assessment for IMG PhysiciansPractice Ready Assessment for IMG Physicians
Practice Ready Assessment for IMG PhysiciansMedCouncilCan
 
Competency-based assessment: The good, the bad, and the puzzling
Competency-based assessment:The good, the bad, and the puzzlingCompetency-based assessment:The good, the bad, and the puzzling
Competency-based assessment: The good, the bad, and the puzzlingMedCouncilCan
 
Certification Examination in Family Medicine Pre-Exam Orientation for candidates
Certification Examination in Family Medicine Pre-Exam Orientation for candidatesCertification Examination in Family Medicine Pre-Exam Orientation for candidates
Certification Examination in Family Medicine Pre-Exam Orientation for candidatesMedCouncilCan
 
MCCQE Part II Pre-Exam Candidate Orientation
MCCQE Part II Pre-Exam Candidate OrientationMCCQE Part II Pre-Exam Candidate Orientation
MCCQE Part II Pre-Exam Candidate OrientationMedCouncilCan
 
MCCQE Part II: Candidate orientation
MCCQE Part II: Candidate orientationMCCQE Part II: Candidate orientation
MCCQE Part II: Candidate orientationMedCouncilCan
 
Format ECOS, nouvel examen de Certification
Format ECOS, nouvel examen de CertificationFormat ECOS, nouvel examen de Certification
Format ECOS, nouvel examen de CertificationMedCouncilCan
 

More from MedCouncilCan (20)

Séance d'orientation pour les candidats de l'examen de la CNE 2015
Séance d'orientation pour les candidats de l'examen de la CNE 2015Séance d'orientation pour les candidats de l'examen de la CNE 2015
Séance d'orientation pour les candidats de l'examen de la CNE 2015
 
2015 NAC candidate orientation presentation
2015 NAC candidate orientation presentation2015 NAC candidate orientation presentation
2015 NAC candidate orientation presentation
 
Surveying the landscape: An overview of tools for direct observation and asse...
Surveying the landscape: An overview of tools for direct observation and asse...Surveying the landscape: An overview of tools for direct observation and asse...
Surveying the landscape: An overview of tools for direct observation and asse...
 
Séance d'orientation pour les candidats de l'examen de la CNE de 2014
Séance d'orientation pour les candidats de l'examen de la CNE de 2014Séance d'orientation pour les candidats de l'examen de la CNE de 2014
Séance d'orientation pour les candidats de l'examen de la CNE de 2014
 
2014 NAC candidate orientation presentation
2014 NAC candidate orientation presentation2014 NAC candidate orientation presentation
2014 NAC candidate orientation presentation
 
NAC PRA update - 2014 Ottawa Conference
NAC PRA update - 2014 Ottawa ConferenceNAC PRA update - 2014 Ottawa Conference
NAC PRA update - 2014 Ottawa Conference
 
Blueprinting update - 2014 Ottawa Conference
Blueprinting update - 2014 Ottawa ConferenceBlueprinting update - 2014 Ottawa Conference
Blueprinting update - 2014 Ottawa Conference
 
Orientation à l’intention des candidats au format ECOS (2014)
Orientation à l’intention des candidats au format ECOS (2014)Orientation à l’intention des candidats au format ECOS (2014)
Orientation à l’intention des candidats au format ECOS (2014)
 
2014 Candidate Orientation Presentation - Certification Examination in Family...
2014 Candidate Orientation Presentation - Certification Examination in Family...2014 Candidate Orientation Presentation - Certification Examination in Family...
2014 Candidate Orientation Presentation - Certification Examination in Family...
 
Présentation d'orientation de 2014 - EACMC, partie II
Présentation d'orientation de 2014 - EACMC, partie IIPrésentation d'orientation de 2014 - EACMC, partie II
Présentation d'orientation de 2014 - EACMC, partie II
 
Présentation d'orientation - Examen de la CNE 2014
Présentation d'orientation - Examen de la CNE 2014Présentation d'orientation - Examen de la CNE 2014
Présentation d'orientation - Examen de la CNE 2014
 
2014 NAC candidate orientation presentation
2014 NAC candidate orientation presentation 2014 NAC candidate orientation presentation
2014 NAC candidate orientation presentation
 
Pre-Exam Orientation for Candidates taking the Certification Examination in F...
Pre-Exam Orientation for Candidates taking the Certification Examination in F...Pre-Exam Orientation for Candidates taking the Certification Examination in F...
Pre-Exam Orientation for Candidates taking the Certification Examination in F...
 
Pre-Exam Candidate Orientation
Pre-Exam Candidate OrientationPre-Exam Candidate Orientation
Pre-Exam Candidate Orientation
 
Practice Ready Assessment for IMG Physicians
Practice Ready Assessment for IMG PhysiciansPractice Ready Assessment for IMG Physicians
Practice Ready Assessment for IMG Physicians
 
Competency-based assessment: The good, the bad, and the puzzling
Competency-based assessment:The good, the bad, and the puzzlingCompetency-based assessment:The good, the bad, and the puzzling
Competency-based assessment: The good, the bad, and the puzzling
 
Certification Examination in Family Medicine Pre-Exam Orientation for candidates
Certification Examination in Family Medicine Pre-Exam Orientation for candidatesCertification Examination in Family Medicine Pre-Exam Orientation for candidates
Certification Examination in Family Medicine Pre-Exam Orientation for candidates
 
MCCQE Part II Pre-Exam Candidate Orientation
MCCQE Part II Pre-Exam Candidate OrientationMCCQE Part II Pre-Exam Candidate Orientation
MCCQE Part II Pre-Exam Candidate Orientation
 
MCCQE Part II: Candidate orientation
MCCQE Part II: Candidate orientationMCCQE Part II: Candidate orientation
MCCQE Part II: Candidate orientation
 
Format ECOS, nouvel examen de Certification
Format ECOS, nouvel examen de CertificationFormat ECOS, nouvel examen de Certification
Format ECOS, nouvel examen de Certification
 

Recently uploaded

ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYKayeClaireEstoconing
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4MiaBumagat1
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...Postal Advocate Inc.
 
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfJemuel Francisco
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designMIPLM
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)lakshayb543
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Celine George
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Seán Kennedy
 
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...JojoEDelaCruz
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPCeline George
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfVanessa Camilleri
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptxmary850239
 
4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptxmary850239
 
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptxBarangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptxCarlos105
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...Nguyen Thanh Tu Collection
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxHumphrey A Beña
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17Celine George
 

Recently uploaded (20)

YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptxYOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
 
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
 
ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4ANG SEKTOR NG agrikultura.pptx QUARTER 4
ANG SEKTOR NG agrikultura.pptx QUARTER 4
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
 
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
 
Keynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-designKeynote by Prof. Wurzer at Nordex about IP-design
Keynote by Prof. Wurzer at Nordex about IP-design
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17
 
Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...Student Profile Sample - We help schools to connect the data they have, with ...
Student Profile Sample - We help schools to connect the data they have, with ...
 
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
ENG 5 Q4 WEEk 1 DAY 1 Restate sentences heard in one’s own words. Use appropr...
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERP
 
ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdf
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx
 
4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx
 
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptxBarangay Council for the Protection of Children (BCPC) Orientation.pptx
Barangay Council for the Protection of Children (BCPC) Orientation.pptx
 
Raw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptxRaw materials used in Herbal Cosmetics.pptx
Raw materials used in Herbal Cosmetics.pptx
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
 
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptxINTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
INTRODUCTION TO CATHOLIC CHRISTOLOGY.pptx
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17
 

Pushing the Boundaries of Medical Licensing

  • 1. ||| Medical Council of Canada 103rd Annual Meeting Pushing the Boundaries of Medical Licensing Examinations by Applying a Programmatic Framework
  • 2. Objectives 1. Review the assessment needs in order to fulfill the new Blueprint 2. Describe the elements of programmatic assessment 3. Propose a model for national programmatic approach to our assessment
  • 3. Speakers Claire Touchie, MD, MHPE, FRCPC • Chief Medical Education Advisor, MCC Cees van der Vleuten, PhD • Professor, Director, School of Health Professions Education, University of Maastricht André De Champlain, PhD • Director, Psychometric and Assessment Services, MCC
  • 4. ||| Claire Touchie, MD, MHPE, FRCPC September 27, 2015 Where are the gaps? Beyond the MCCQE Part I and Part II exams to better meet our Blueprint:
  • 5. Setting the scene • Where we are • Where the new Blueprint is taking us • What are the gaps? • How can we address them?
  • 6. Today’s MCC Examination Landscape • Blueprint: Based on discipline Part I 196 MCQs 36 CDM Cases Part II 12 OSCE Stations
  • 7. Assessment Continuum UGME PGME Practice Part I Part II NAC OSCE Certification
  • 8. Dimensions of Care Health Promotion and Illness Prevention Acute Chronic Psychosocial Aspects PhysicianActivities Assessment/ Diagnosis Management Communication Professional Behaviors New MCC Blueprint 8
  • 9. 9 Decision 1 Entry to residency MCCQE Part I
  • 10. Decision 1: Entry into residency
  • 11. Dimensions of Care Health Promotion and Illness Prevention Acute Chronic Psychosocial Aspects Row Percent PhysicianActivities Assessment/ Diagnosis 30 Management 20 Communication 30 Professional Behaviors 20 Column Percent 20 30 30 20 100 Entry to residency 11
  • 12. Dimensions of Care Health Promotion and Illness Prevention Acute Chronic Psychosocial Aspects Row Percent PhysicianActivities Assessment/ Diagnosis 45±5 Management 35±5 Communication 10±5 Professional Behaviors 10±5 Column Percent 20±5 35±5 30±5 15±5 100 Part I – Test Specifications 12 These weights were approved by CEC in June 2015
  • 13.
  • 14. Dimensions of Care Health Promotion and Illness Prevention Acute Chronic Psychosocial Aspects Row Percent Part I Gap Physician Activities Assessment/ Diagnosis 30±5 45±5  Management 20±5 35±5  Communication 30±5 10±5  Professional Behaviours 20±5 10±5  Column Percent 20±5 30±5 30±5 20±5 100 Part I 20±5 35±5 30±5 15±5 Gap     Entry into Residency - Gaps 14
  • 15. New MCC Blueprint 15 Decision 1 Entry to residency MCCQE Part I Other Assessments?
  • 16. How can we fill the gap? UGME Retreat – June 2015 Workplace-based type assessments? • ? Reflections • ?Multisource feedback • ?school OSCE Other national projects • Pan-Canadian Entrustable Professional Activities at the UGME/PGME Transition
  • 17. Decision 2 – Entry to independent practice
  • 18. Dimensions of Care Health Promotion and Illness Prevention Acute Chronic Psychosocial Aspects Row Percent PhysicianActivities Assessment/ Diagnosis 25 Management 35 Communication 20 Professional Behaviors 20 Column Percent 20 25 35 20 100 Entry to Independent practice 18
  • 19. Dimensions of Care Health Promotion and Illness Prevention Acute Chronic Psychosocial Aspects Row Percent PhysicianActivities Assessment/ Diagnosis 48 Management 13 Communication 34 Professional Behaviors 5 Column Percent 10 70 14 6 100 Part II Gap Analysis 19
  • 20. Decision 2 – Entry to independent practice 20 Decision 2 Entry to independent practice MCCQE Part II Other assessments?
  • 21. Decision 2 – Entry to independent practice 21 MCCQE Part II OSCE Other Assessments Decision 2 Entry to independent practice
  • 23. Assessment Continuum UGME PGME Practice Part I Part II NAC OSCE Certification WBA OSCE Licensure Decision ?
  • 24. How should we put this all together to make high stakes decisions for licensure?
  • 25. As you listen to our next two speaker: 1. What are the advantages, in your view, of MCC adopting a programmatic assessment approach? 2. What are the challenges and possible barriers to going beyond the 2 point-in-time examiantions presently required for the LMCC (MCCQE Part I and Part II)