This document discusses the development of an assessment for Assisted Reproductive Technology (ART) Laboratory Professionals. A committee of 5 experienced ART laboratory directors and Canadian Fertility and Andrology Society members created items to evaluate competencies in safe work practices, gamete and embryo processing, communication, quality management, and critical thinking. The items underwent field testing by 13 ART professionals who provided feedback. Based on analysis, 14 of the 82 multiple choice questions required revision. The next challenge was translating the questions into French as the first exam is scheduled for this spring. The main challenge for the committee was learning how to write multiple choice questions that effectively assess practical competencies, with guidance provided by Touchstone.

1. Marie-Claude Léveillé
Plenary III Panel Discussion:
Content Development: From
Blueprinting to Scoring
“Why measure the competency of ART Laboratory Professionals?”
University of Ottawa

2. Who are ART Laboratory Professionals?
2
How did we develop items for the assessment?
ART Laboratory Professionals are people working in Assisted
Reproductive Technology (ART) laboratories of Fertility Clinics
Competency Profile:
• Safe Work Practices
• Obtaining and Processing of Gametes and Embryos
• Communication
• Quality and Risk Management
• Critical Thinking
Marie-Claude Léveillé, Ottawa Fertility Centre
A committee of 5 volunteers was created to develop the items for the exam
• Experienced ART Lab Professionals
• Many years as an ART Laboratory Director
• Members of the Canadian Fertility and Andrology Society

3. What challenges did we face?
Field Testing and Scoring
• To assess relevance and adjust items if needed
• 13 experienced ART Lab Professionals from the Toronto area tested the exam
• Survey sent out to participants the week following the field test
• The participants felt that most MCQs were relevant to the work that is
encountered in the laboratory
• 14/82 items needed some review based on the post test analysis done by
Touchstone
• Next challenge was to translate the items in French
• First exam will take place this spring….
Marie-Claude Léveillé, Ottawa Fertility Centre 3
Did we achieve what we set out to achieve?
• Little experience in writing exams
• Main challenge was to learn how to write multiple choice questions to
assess practical competencies
• Guidance and training was provided by Touchstone

4. 2018 Perspectives Symposium
January 22, 2018
#TSINPerspectives2018