SlideShare a Scribd company logo
1 of 5
Download to read offline
 
               

                       The Transcription of Grades: A
                            Background Paper
              The landscape of medicine is constantly changing with societal influences affecting the direction
              of the profession. Medical education must keep pace with this ever-changing vista and train
              physicians with the skills necessary to meet the needs of Canadians. To this end, the Faculty of
              Medicine at the University of Toronto is currently engaged in a high level review of the
              curriculum. One of the many aspects being examined is a change in the transcription of grades
              from Honours/Pass/Fail to Pass/Fail. (This specifically would be transcripted as “Credit”/“No
              Credit” using the terminology of the University of Toronto). The initial impetus for the change
              came from medical students frustrated with the current system of grade transcription. After
              focus groups and informal surveys showed broad- based support for the change, the Faculty
              began to consider more carefully the issue of grade transcription (1, 2). While the details of such
              a change will have to be discussed at, and ultimately approved by Faculty Council, the Faculty
              of Medicine is inviting students to participate in the conversation by casting their vote in an
              upcoming referendum. This background paper hopes to provide students with a distilled
              version the arguments for and against a change in transcription.* While each of these choices is
              inherently uncertain in terms of a desired outcome, I encourage you to discuss and debate the
              claims presented here with your peers. The alternative is to accept or reject this change in a knee
              jerk fashion, dismissing to the realm of chance or happenstance a very important aspect of your
              curriculum.
               
              Andrew Brown
              Senior Vice President of Education (Medical Society)
              Faculty of Medicine - Class of 2011
              andrewdale.brown@utoronto.ca




*Over the past few years, the change in transcription has been described and debated in a number of forums: UTMJ articles
“How Honours/Pass/Fail Grading is Failing Students” and “Toronto’s Honours/Pass/Fail Debate: The Minority Position”
2008, a review by the Faculty of Medicine (Honour/Pass/Fail Grading Policy TASK FORCE 2006) and student focus groups held
in the spring of 2008 as part of the paper: “Guiding Principles for Medical Education: A Student Review of the UME Curriculum
at the University of Toronto Faculty of Medicine.”

 

 
Q. What is Honours/Pass/Fail?
A. Honours, Pass, Fail (H/P/F) is the current three interval paradigm of grade transcription used at the University
of Toronto, Faculty of Medicine, MD program. Standing in a course is based on a summation of evaluations
within the course. When converted to percentages: Honours (80%), Pass (79-60%), Fail (<60%). The three
interval system provides opportunity to stratify students based on academic achievement.

Q. What is Credit/No Credit?
A. Credit/No-Credit (C/NC) is a two interval grade transcription paradigm. It is synonymous with a Pass/Fail
(P/F) system of grade transcription. The University of Toronto grading policy recommends that Credit/No Credit
be assigned for courses in which only very broad evaluative distinctions in assessing the quality of student
performance are judged appropriate. As medical education focuses more on a competency-based model of
education, a two interval system is seen by many as the most appropriate way to acknowledge if a competency
has been achieved (3). Briefly, competency-based models of education focus on what learners are able to do, i.e.
their mastery of an objective, rather than what they are expected to learn about.

Q. What is transcription?
A. Transcription is a component of grading policy. Transcription is the recording of a student’s final mark for
each course on their Official Transcript, this is currently done as H, P or F. The purpose of the Official Transcript
is to provide evaluation data about students for record purposes and future use. (e.g., in applications to post-
graduate training programs (CaRMS). It is important to note that this is separate from evaluation methodology,
which is concerned with what material is being tested, what methods of evaluation are employed and how
evaluations are graded.

Q. What is the proposed change?
A. The Faculty of Medicine at the University of Toronto is considering changing the way student’s grades are
transcribed from an H/P/F system, to C/NC for all four years. This will not affect the way students are tested or
the material that will be evaluated. Students will still receive feedback on their test performance after tests and
exams, as they had been. Examinations and assessments will continue to fulfill their purpose of certifying that
students have successfully mastered education objectives, reached defined levels of competency and provide
feedback for students and faculty.

Q. How will this process proceed at an institutional level?
A. The change in transcription has already been debated at a number of Faculty Undergraduate Medical Education
committees including the Undergraduate Medical Education (UME) Curriculum Committee, the Preclerkship and
Clerkship committees as well as the Examination and Student Assessment Committee (ESAC) and will be
recommended to the Education Committee of Faculty Council for debate after the student referendum.

Q. What are the referendum questions?
1. Are you adequately informed to make a choice? Yes/No
2. Are you in favour of replacing the current form of grade transcription (Honours, Pass, Fail) with Credit/No
credit for all four years of your medical education? Yes/No

Requirements for a valid referendum result:
Minimum class response rate: 80% for years I &II; 60% for year III &IV
“Voted Yes” threshold: minimum 50% of each class population; 75% of overall student body
“Well informed” ballots: If > 20% of any class do not feel adequately informed the referendum will be postponed

This is a non-binding referendum and is merely consultative.


 

 
Q. What would a Credit/No Credit system look like?
A. In a Credit/No-Credit system the course content and evaluations would remain the same; the only change
would be the transcription of students’ final marks at the end of a course. The threshold for what defines
achieving the required level of competency might be adjusted and will likely be higher than the current 60%. The
Medical Student Performance Record (MSPR), or “Dean’s report”, will likely have to be adjusted for the new
transcription system. A change in grading policy may require an alternative means of conveying student
qualifications, i.e. an elaborated Dean’s letter, to complement the information provided to postgraduate program
directors by the Transcript. This may include additional ways of recognizing student excellence.
 




Presented here are the arguments for and against a change to Credit /No Credit. Contentious issues are presented
by both sides. I encourage you to scrutinize the primary literature to further examine the claims made below. One
caveat, articles preceding the early 1990’s may not be as relevant as innovations like problem-based learning
(PBL) were not widely used – both positions present some data predating the 1990’s.

Arguments for Honours/Pass/Fail
Excellence is an overriding criterion of this University, and
excellence should be incorporated in our educational programs.
The University strives for excellence in students and in courses
(4).

Consider Student A, who achieves a final mark of 79% in a
course, and Student B, who has 80%. Though the difference
between these two students might have been something as small as
2 or 3 questions correct on a test, the transcript will show Student
A with a Pass and Student B with an Honours. While this result
does illustrate one of the flaws of the H/P/F system, it is an
intrinsic problem with categorical transcription of grades. No
matter where the cut-off is made, there will always be people
slightly above and slightly below it (5).

Does C/NC really reduce stress: The decreased stress and                 Fig. 1 Postgraduate Directors Survey
competition surrounding academic achievement is balanced by the
increased stress and competition of finding alternate means of           Postgraduate directors at the University of
distinction, be it leadership positions, research productivity, or       Toronto prefer as much information as possible
reference letters. Perhaps it can be argued that students will now       but are prepared to make selections without
be engaging in a more well-rounded pursuit of achievement, but           such information. Currently Honours standing is
the initial goal of reducing student stress and competition may not      consistently seen as advantageous. The
be attained (5).                                                         weighting of Honours standing/grades in
                                                                         general varies among programs (4).
As grade reporting progresses from a scale with multiple intervals to a scale that merely reports that a student has
passed, information is lost and candidates appear more and more homogenous. A survey of directors of general
surgery residency programs found that 81% believed that the evaluation system used by medical schools affects
students’ abilities to obtain the residency position of their choice. Furthermore, the study also indicated that a P/F
system is detrimental to applicants because it makes it harder to identify the students who performed best in the
Pass category (5).

 

 
Jefferson Medical College Study: suggests that 1st year GPA was highly significantly associated with 2nd year
GPA, 3rd year clinical exam grades, rating of clinical competence in core clerkship courses in 3rd year, and
medical school rank (5).

The impact of instituting a P/F system will be different for each type of student. However, overall, it has been
reported that students perform worse on examinations where a P/F system is used. While there are numerous
studies relating medical school performance to other measures like USMLE Step 1, 2, and 3, undergraduate GPA,
MCAT, and interview scores, there are not many studies investigating medical school performance and
postgraduate clinical competence. One study of surgical residents did show that those from a P/F school
accounted for 82% of surgical residents ranking below the 15th percentile and none ranking above the 87th
percentile (5).

Arguments for Credit/No Credit System

Subjective nature of
evaluations in clerkship: every
clinical rotation of clerkship
includes a portion of the grade
allotted to ongoing clinical
assessment, allowing
preceptors to provide a
subjective evaluation of the
Clerk’s performance. This
component can account for
between 10% - 60% of the
student’s final grade depending
on the rotation. (6).               Fig. 2 Breakdown of evaluation by rotation
Preclerkship courses have an         On average, the subjective ward evaluation comprises 40.3% of a student’s
approximate 80% average and
6% standard deviation which          third year grades or 46.2% of a student’s fourth year grades (6).
means that over half the class lies within 5% of the Honours cutoff. In fact, assuming a normal distribution of
marks, around 38% of students would fall within the range of 77-83%, either just above or below the cusp of
Honours. The same situation exists in Clerkship courses as last year’s overall third year and fourth year averages
were 80.15% and 79.74% respectively (1). Some have argued that Honours has little meaning with much of the
class achieving Honours and exaggerating the difference between those who receive Honours and those who do
not.

The University of Michigan switched from a letter grade system to a pass/fail system in 1993. It was reported that
the students in a Pass/Fail system were found to be significantly less stressed, less competitive, involved in more
group work, and more cooperative. Most importantly (because that is the argument often raised), there was no
evidence of ‘just passing behaviour’ and the test scores did not drop. When compared, the students in a Pass/Fail
system showed an equally strong commitment to their medical education as those in a grading system (4).

Changing grading policy (how final marks are recorded on the transcript) would likely reduce anxiety over marks
particularly in light of the University of Toronto policy of only transcripting final grades and not recording
initial/preliminary grades (4). Research at other institutions suggests that changing to a Credit/No Credit grading
system would have the benefit of encouraging collaboration among students and reducing stress with students
performing no different on objective measures of scholastic performance (7).

 

 
A change in grade transcription would assist in standardizing grading across the province and nation, removing a
potential disadvantage during the CARMS application process for the majority of students who will not achieve
Honours in all courses, particularly for those without backgrounds in the relevant material (1). Currently,
Western, McMaster, Northern, and Ottawa (Clerkship) are Credit/No Credit Schools. Toronto and Ottawa
(Preclerkship) are Honours/Pass/Fail Schools. Queen’s is debating a change to Credit/No Credit.

A close examination of the Jefferson Medical College study suggests the top 10% performed statistically better
than all other groups while the bottom 10% performed significantly worse. A statistical difference was also
observed between 60-70th percentile, while no statistical difference was observed between any other deciles.
Apart from the one significant decile difference observed in the Jefferson study, it would seem to indicate that
there is no statistical difference in future ability for those who do not fall into the top or bottom categories (1).

The move to a competency-based curriculum (e.g. CanMEDS) in undergraduate medical education is not
conceptually supported by maintaining an interval transcription methodology (3).

References:

    1. Homuth, D. “How Honours/Pass/Fail Grading is Failing Students.” UTMJ 85.2 (2008)

    2. Brown, A., Torbicki K.,Wagg I., and Yudin J. Guiding Principles for Medical Education: A
       Student Review of the UME Curriculum at the University of Toronto Faculty of Medicine. 2008.

    3. Litzelman DK., Cottingham AH. “The new formal competency-based curriculum and informal
       curriculum at Indiana University School of Medicine: overview and five-year analysis.”Acad Med.
       82.4 (2007)

    4. Pittini, R. Honour/Pass/Fail Grading Policy Taskforce. 2006.

    5. Guo R. and Muir J. “Toronto’s Honours/Pass/Fail Debate: The Minority Position.” UTMJ 85.2
       (2008)

    6. Homuth, D. Credit/No Credit Proposal: Clerkship Supplement. 2008.

    7. Rohe, D.E. et al. “The Benefits of Pass-Fail Grading on Stress, Mood, and Group Cohesion in Medical
       Students.” Mayo Clinic proceedings 81.11 (2006)




 

 

More Related Content

What's hot

OSCE Tool for Improving B. Sc. Nursing Students' Antenatal , Examination
OSCE Tool for Improving B. Sc. Nursing Students' Antenatal , ExaminationOSCE Tool for Improving B. Sc. Nursing Students' Antenatal , Examination
OSCE Tool for Improving B. Sc. Nursing Students' Antenatal , Examinationiosrjce
 
Documenting Your Clinical Efforts In a Way that Counts
Documenting Your Clinical Efforts In a Way that CountsDocumenting Your Clinical Efforts In a Way that Counts
Documenting Your Clinical Efforts In a Way that Countstatetomika
 
1 reflection4reflection (thorax and l
1 reflection4reflection (thorax and l1 reflection4reflection (thorax and l
1 reflection4reflection (thorax and lVivan17
 
Transplant White Paper Final
Transplant White Paper FinalTransplant White Paper Final
Transplant White Paper FinalMarianne Dailey
 
HE teaching tool poster
HE teaching tool posterHE teaching tool poster
HE teaching tool posterDavid Cox
 
Care guidelines developing clinical case reporting recommendations – pubrica
Care guidelines developing clinical case reporting recommendations – pubricaCare guidelines developing clinical case reporting recommendations – pubrica
Care guidelines developing clinical case reporting recommendations – pubricaPubrica
 
Care guidelines developing clinical case reporting recommendations – pubrica
Care guidelines developing clinical case reporting recommendations – pubricaCare guidelines developing clinical case reporting recommendations – pubrica
Care guidelines developing clinical case reporting recommendations – pubricaPubrica
 
Patient Reported Experience Measures
Patient Reported Experience MeasuresPatient Reported Experience Measures
Patient Reported Experience MeasuresVaikunthan Rajaratnam
 
Sentiments Toward the Islamic State on Twitter Across Canada
Sentiments Toward the Islamic State on Twitter Across CanadaSentiments Toward the Islamic State on Twitter Across Canada
Sentiments Toward the Islamic State on Twitter Across CanadaSIMAdmin
 
Interdesciplinary interactions and communication
Interdesciplinary interactions and communicationInterdesciplinary interactions and communication
Interdesciplinary interactions and communicationJanitha R.Kondala
 
22 personal philosophy and theoretical co
22 personal philosophy and theoretical co22 personal philosophy and theoretical co
22 personal philosophy and theoretical coVivan17
 
Pcori final writeup
Pcori final writeupPcori final writeup
Pcori final writeuphbocian14
 
Perspectives 2017: Ivy Lynn Bourgeault
Perspectives 2017: Ivy Lynn BourgeaultPerspectives 2017: Ivy Lynn Bourgeault
Perspectives 2017: Ivy Lynn BourgeaultTouchstone Institute
 

What's hot (20)

Pre-Med FAQ Workshop
Pre-Med FAQ WorkshopPre-Med FAQ Workshop
Pre-Med FAQ Workshop
 
OSCE Tool for Improving B. Sc. Nursing Students' Antenatal , Examination
OSCE Tool for Improving B. Sc. Nursing Students' Antenatal , ExaminationOSCE Tool for Improving B. Sc. Nursing Students' Antenatal , Examination
OSCE Tool for Improving B. Sc. Nursing Students' Antenatal , Examination
 
Documenting Your Clinical Efforts In a Way that Counts
Documenting Your Clinical Efforts In a Way that CountsDocumenting Your Clinical Efforts In a Way that Counts
Documenting Your Clinical Efforts In a Way that Counts
 
1 reflection4reflection (thorax and l
1 reflection4reflection (thorax and l1 reflection4reflection (thorax and l
1 reflection4reflection (thorax and l
 
Secondary Data Analysis
Secondary Data AnalysisSecondary Data Analysis
Secondary Data Analysis
 
Transplant White Paper Final
Transplant White Paper FinalTransplant White Paper Final
Transplant White Paper Final
 
HSC poster5
HSC poster5HSC poster5
HSC poster5
 
Objective Structured Clinical Examination
Objective Structured Clinical ExaminationObjective Structured Clinical Examination
Objective Structured Clinical Examination
 
ANDERFebruary2016
ANDERFebruary2016ANDERFebruary2016
ANDERFebruary2016
 
HE teaching tool poster
HE teaching tool posterHE teaching tool poster
HE teaching tool poster
 
Care guidelines developing clinical case reporting recommendations – pubrica
Care guidelines developing clinical case reporting recommendations – pubricaCare guidelines developing clinical case reporting recommendations – pubrica
Care guidelines developing clinical case reporting recommendations – pubrica
 
Care guidelines developing clinical case reporting recommendations – pubrica
Care guidelines developing clinical case reporting recommendations – pubricaCare guidelines developing clinical case reporting recommendations – pubrica
Care guidelines developing clinical case reporting recommendations – pubrica
 
Patient Reported Experience Measures
Patient Reported Experience MeasuresPatient Reported Experience Measures
Patient Reported Experience Measures
 
Sentiments Toward the Islamic State on Twitter Across Canada
Sentiments Toward the Islamic State on Twitter Across CanadaSentiments Toward the Islamic State on Twitter Across Canada
Sentiments Toward the Islamic State on Twitter Across Canada
 
Interdesciplinary interactions and communication
Interdesciplinary interactions and communicationInterdesciplinary interactions and communication
Interdesciplinary interactions and communication
 
Changing trends in the medical examinations
Changing trends in the medical examinationsChanging trends in the medical examinations
Changing trends in the medical examinations
 
22 personal philosophy and theoretical co
22 personal philosophy and theoretical co22 personal philosophy and theoretical co
22 personal philosophy and theoretical co
 
AP_report
AP_reportAP_report
AP_report
 
Pcori final writeup
Pcori final writeupPcori final writeup
Pcori final writeup
 
Perspectives 2017: Ivy Lynn Bourgeault
Perspectives 2017: Ivy Lynn BourgeaultPerspectives 2017: Ivy Lynn Bourgeault
Perspectives 2017: Ivy Lynn Bourgeault
 

Similar to University of toronto transcription background paper

A Holistic Review Of The Medical School Admission Process Examining Correlat...
A Holistic Review Of The Medical School Admission Process  Examining Correlat...A Holistic Review Of The Medical School Admission Process  Examining Correlat...
A Holistic Review Of The Medical School Admission Process Examining Correlat...Angelina Johnson
 
The transcription of grades SCEC
The transcription of grades SCECThe transcription of grades SCEC
The transcription of grades SCECAndrew Brown
 
ACA Advisory Council Statement on 4 year Graduation Rates
ACA Advisory Council Statement on 4 year Graduation RatesACA Advisory Council Statement on 4 year Graduation Rates
ACA Advisory Council Statement on 4 year Graduation RatesUT Austin: ACA
 
Alumni: The Ultimate Outcome Measure of your Training Program
Alumni: The Ultimate Outcome Measure of your Training ProgramAlumni: The Ultimate Outcome Measure of your Training Program
Alumni: The Ultimate Outcome Measure of your Training ProgramAmy Motta
 
The US Residency Selection Process After the United States Medical Licensing ...
The US Residency Selection Process After the United States Medical Licensing ...The US Residency Selection Process After the United States Medical Licensing ...
The US Residency Selection Process After the United States Medical Licensing ...Ahmad Ozair
 
Well, no one could say that it was dull, thought Dr. Jeff Fore.docx
Well, no one could say that it was dull, thought Dr. Jeff Fore.docxWell, no one could say that it was dull, thought Dr. Jeff Fore.docx
Well, no one could say that it was dull, thought Dr. Jeff Fore.docxalanfhall8953
 
Well, no one could say that it was dull, thought Dr. Jeff Fo.docx
Well, no one could say that it was dull, thought Dr. Jeff Fo.docxWell, no one could say that it was dull, thought Dr. Jeff Fo.docx
Well, no one could say that it was dull, thought Dr. Jeff Fo.docxalanfhall8953
 
Well, no one could say that it was dull, thought Dr. Jeff Fo.docx
Well, no one could say that it was dull, thought Dr. Jeff Fo.docxWell, no one could say that it was dull, thought Dr. Jeff Fo.docx
Well, no one could say that it was dull, thought Dr. Jeff Fo.docxphilipnelson29183
 
developing standardized tests.docx
developing standardized tests.docxdeveloping standardized tests.docx
developing standardized tests.docx4934bk
 
Bridging the Continuum Between UME and GME
Bridging the Continuum Between UME and GMEBridging the Continuum Between UME and GME
Bridging the Continuum Between UME and GMENicholas Kman, MD, FACEP
 
mentorship in an academic medical center
mentorship in an academic medical centermentorship in an academic medical center
mentorship in an academic medical centerPhilip Binkley MD, MPH
 
Example Final Defense Power Point Slide
Example Final Defense Power Point SlideExample Final Defense Power Point Slide
Example Final Defense Power Point SlideDr. Vince Bridges
 
Assessment in ME
Assessment in MEAssessment in ME
Assessment in MES A Tabish
 
MSNFP 6109 Capella University Technology Impact Statement for Assessment Pape...
MSNFP 6109 Capella University Technology Impact Statement for Assessment Pape...MSNFP 6109 Capella University Technology Impact Statement for Assessment Pape...
MSNFP 6109 Capella University Technology Impact Statement for Assessment Pape...bkbk37
 
ADEA 2010 Competency Based Evaluation Of Predental Applicants
ADEA 2010 Competency Based Evaluation Of Predental ApplicantsADEA 2010 Competency Based Evaluation Of Predental Applicants
ADEA 2010 Competency Based Evaluation Of Predental ApplicantsEmil Chuck
 
The Sutton Trust's Making a Statement Research - Jan 2016
The Sutton Trust's Making a Statement Research - Jan 2016The Sutton Trust's Making a Statement Research - Jan 2016
The Sutton Trust's Making a Statement Research - Jan 2016Sir Peter Lampl
 
Example Dissertation Proposal Defense Power Point Slide
Example Dissertation Proposal Defense Power Point SlideExample Dissertation Proposal Defense Power Point Slide
Example Dissertation Proposal Defense Power Point SlideDr. Vince Bridges
 

Similar to University of toronto transcription background paper (20)

A Holistic Review Of The Medical School Admission Process Examining Correlat...
A Holistic Review Of The Medical School Admission Process  Examining Correlat...A Holistic Review Of The Medical School Admission Process  Examining Correlat...
A Holistic Review Of The Medical School Admission Process Examining Correlat...
 
The transcription of grades SCEC
The transcription of grades SCECThe transcription of grades SCEC
The transcription of grades SCEC
 
ACA Advisory Council Statement on 4 year Graduation Rates
ACA Advisory Council Statement on 4 year Graduation RatesACA Advisory Council Statement on 4 year Graduation Rates
ACA Advisory Council Statement on 4 year Graduation Rates
 
The impact of relocation
The impact of relocationThe impact of relocation
The impact of relocation
 
Alumni: The Ultimate Outcome Measure of your Training Program
Alumni: The Ultimate Outcome Measure of your Training ProgramAlumni: The Ultimate Outcome Measure of your Training Program
Alumni: The Ultimate Outcome Measure of your Training Program
 
The US Residency Selection Process After the United States Medical Licensing ...
The US Residency Selection Process After the United States Medical Licensing ...The US Residency Selection Process After the United States Medical Licensing ...
The US Residency Selection Process After the United States Medical Licensing ...
 
Well, no one could say that it was dull, thought Dr. Jeff Fore.docx
Well, no one could say that it was dull, thought Dr. Jeff Fore.docxWell, no one could say that it was dull, thought Dr. Jeff Fore.docx
Well, no one could say that it was dull, thought Dr. Jeff Fore.docx
 
Well, no one could say that it was dull, thought Dr. Jeff Fo.docx
Well, no one could say that it was dull, thought Dr. Jeff Fo.docxWell, no one could say that it was dull, thought Dr. Jeff Fo.docx
Well, no one could say that it was dull, thought Dr. Jeff Fo.docx
 
Well, no one could say that it was dull, thought Dr. Jeff Fo.docx
Well, no one could say that it was dull, thought Dr. Jeff Fo.docxWell, no one could say that it was dull, thought Dr. Jeff Fo.docx
Well, no one could say that it was dull, thought Dr. Jeff Fo.docx
 
developing standardized tests.docx
developing standardized tests.docxdeveloping standardized tests.docx
developing standardized tests.docx
 
Bridging the Continuum Between UME and GME
Bridging the Continuum Between UME and GMEBridging the Continuum Between UME and GME
Bridging the Continuum Between UME and GME
 
mentorship in an academic medical center
mentorship in an academic medical centermentorship in an academic medical center
mentorship in an academic medical center
 
Example Final Defense Power Point Slide
Example Final Defense Power Point SlideExample Final Defense Power Point Slide
Example Final Defense Power Point Slide
 
Assessment in ME
Assessment in MEAssessment in ME
Assessment in ME
 
MSNFP 6109 Capella University Technology Impact Statement for Assessment Pape...
MSNFP 6109 Capella University Technology Impact Statement for Assessment Pape...MSNFP 6109 Capella University Technology Impact Statement for Assessment Pape...
MSNFP 6109 Capella University Technology Impact Statement for Assessment Pape...
 
ADEA 2010 Competency Based Evaluation Of Predental Applicants
ADEA 2010 Competency Based Evaluation Of Predental ApplicantsADEA 2010 Competency Based Evaluation Of Predental Applicants
ADEA 2010 Competency Based Evaluation Of Predental Applicants
 
The Sutton Trust's Making a Statement Research - Jan 2016
The Sutton Trust's Making a Statement Research - Jan 2016The Sutton Trust's Making a Statement Research - Jan 2016
The Sutton Trust's Making a Statement Research - Jan 2016
 
N523 Gap Analysis
N523 Gap AnalysisN523 Gap Analysis
N523 Gap Analysis
 
Outcomes of Curricular Enhancement in a Health Program: LPU CAMP Experience
Outcomes of Curricular  Enhancement in a Health Program:   LPU CAMP Experience Outcomes of Curricular  Enhancement in a Health Program:   LPU CAMP Experience
Outcomes of Curricular Enhancement in a Health Program: LPU CAMP Experience
 
Example Dissertation Proposal Defense Power Point Slide
Example Dissertation Proposal Defense Power Point SlideExample Dissertation Proposal Defense Power Point Slide
Example Dissertation Proposal Defense Power Point Slide
 

Recently uploaded

The byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptxThe byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptxShobhayan Kirtania
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesFatimaKhan178732
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)eniolaolutunde
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docxPoojaSen20
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...fonyou31
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphThiyagu K
 
social pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajansocial pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajanpragatimahajan3
 

Recently uploaded (20)

The byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptxThe byproduct of sericulture in different industries.pptx
The byproduct of sericulture in different industries.pptx
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and Actinides
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)Software Engineering Methodologies (overview)
Software Engineering Methodologies (overview)
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docx
 
Advance Mobile Application Development class 07
Advance Mobile Application Development class 07Advance Mobile Application Development class 07
Advance Mobile Application Development class 07
 
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
Ecosystem Interactions Class Discussion Presentation in Blue Green Lined Styl...
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
social pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajansocial pharmacy d-pharm 1st year by Pragati K. Mahajan
social pharmacy d-pharm 1st year by Pragati K. Mahajan
 

University of toronto transcription background paper

  • 1.     The Transcription of Grades: A Background Paper The landscape of medicine is constantly changing with societal influences affecting the direction of the profession. Medical education must keep pace with this ever-changing vista and train physicians with the skills necessary to meet the needs of Canadians. To this end, the Faculty of Medicine at the University of Toronto is currently engaged in a high level review of the curriculum. One of the many aspects being examined is a change in the transcription of grades from Honours/Pass/Fail to Pass/Fail. (This specifically would be transcripted as “Credit”/“No Credit” using the terminology of the University of Toronto). The initial impetus for the change came from medical students frustrated with the current system of grade transcription. After focus groups and informal surveys showed broad- based support for the change, the Faculty began to consider more carefully the issue of grade transcription (1, 2). While the details of such a change will have to be discussed at, and ultimately approved by Faculty Council, the Faculty of Medicine is inviting students to participate in the conversation by casting their vote in an upcoming referendum. This background paper hopes to provide students with a distilled version the arguments for and against a change in transcription.* While each of these choices is inherently uncertain in terms of a desired outcome, I encourage you to discuss and debate the claims presented here with your peers. The alternative is to accept or reject this change in a knee jerk fashion, dismissing to the realm of chance or happenstance a very important aspect of your curriculum.   Andrew Brown Senior Vice President of Education (Medical Society) Faculty of Medicine - Class of 2011 andrewdale.brown@utoronto.ca *Over the past few years, the change in transcription has been described and debated in a number of forums: UTMJ articles “How Honours/Pass/Fail Grading is Failing Students” and “Toronto’s Honours/Pass/Fail Debate: The Minority Position” 2008, a review by the Faculty of Medicine (Honour/Pass/Fail Grading Policy TASK FORCE 2006) and student focus groups held in the spring of 2008 as part of the paper: “Guiding Principles for Medical Education: A Student Review of the UME Curriculum at the University of Toronto Faculty of Medicine.”    
  • 2. Q. What is Honours/Pass/Fail? A. Honours, Pass, Fail (H/P/F) is the current three interval paradigm of grade transcription used at the University of Toronto, Faculty of Medicine, MD program. Standing in a course is based on a summation of evaluations within the course. When converted to percentages: Honours (80%), Pass (79-60%), Fail (<60%). The three interval system provides opportunity to stratify students based on academic achievement. Q. What is Credit/No Credit? A. Credit/No-Credit (C/NC) is a two interval grade transcription paradigm. It is synonymous with a Pass/Fail (P/F) system of grade transcription. The University of Toronto grading policy recommends that Credit/No Credit be assigned for courses in which only very broad evaluative distinctions in assessing the quality of student performance are judged appropriate. As medical education focuses more on a competency-based model of education, a two interval system is seen by many as the most appropriate way to acknowledge if a competency has been achieved (3). Briefly, competency-based models of education focus on what learners are able to do, i.e. their mastery of an objective, rather than what they are expected to learn about. Q. What is transcription? A. Transcription is a component of grading policy. Transcription is the recording of a student’s final mark for each course on their Official Transcript, this is currently done as H, P or F. The purpose of the Official Transcript is to provide evaluation data about students for record purposes and future use. (e.g., in applications to post- graduate training programs (CaRMS). It is important to note that this is separate from evaluation methodology, which is concerned with what material is being tested, what methods of evaluation are employed and how evaluations are graded. Q. What is the proposed change? A. The Faculty of Medicine at the University of Toronto is considering changing the way student’s grades are transcribed from an H/P/F system, to C/NC for all four years. This will not affect the way students are tested or the material that will be evaluated. Students will still receive feedback on their test performance after tests and exams, as they had been. Examinations and assessments will continue to fulfill their purpose of certifying that students have successfully mastered education objectives, reached defined levels of competency and provide feedback for students and faculty. Q. How will this process proceed at an institutional level? A. The change in transcription has already been debated at a number of Faculty Undergraduate Medical Education committees including the Undergraduate Medical Education (UME) Curriculum Committee, the Preclerkship and Clerkship committees as well as the Examination and Student Assessment Committee (ESAC) and will be recommended to the Education Committee of Faculty Council for debate after the student referendum. Q. What are the referendum questions? 1. Are you adequately informed to make a choice? Yes/No 2. Are you in favour of replacing the current form of grade transcription (Honours, Pass, Fail) with Credit/No credit for all four years of your medical education? Yes/No Requirements for a valid referendum result: Minimum class response rate: 80% for years I &II; 60% for year III &IV “Voted Yes” threshold: minimum 50% of each class population; 75% of overall student body “Well informed” ballots: If > 20% of any class do not feel adequately informed the referendum will be postponed This is a non-binding referendum and is merely consultative.    
  • 3. Q. What would a Credit/No Credit system look like? A. In a Credit/No-Credit system the course content and evaluations would remain the same; the only change would be the transcription of students’ final marks at the end of a course. The threshold for what defines achieving the required level of competency might be adjusted and will likely be higher than the current 60%. The Medical Student Performance Record (MSPR), or “Dean’s report”, will likely have to be adjusted for the new transcription system. A change in grading policy may require an alternative means of conveying student qualifications, i.e. an elaborated Dean’s letter, to complement the information provided to postgraduate program directors by the Transcript. This may include additional ways of recognizing student excellence.   Presented here are the arguments for and against a change to Credit /No Credit. Contentious issues are presented by both sides. I encourage you to scrutinize the primary literature to further examine the claims made below. One caveat, articles preceding the early 1990’s may not be as relevant as innovations like problem-based learning (PBL) were not widely used – both positions present some data predating the 1990’s. Arguments for Honours/Pass/Fail Excellence is an overriding criterion of this University, and excellence should be incorporated in our educational programs. The University strives for excellence in students and in courses (4). Consider Student A, who achieves a final mark of 79% in a course, and Student B, who has 80%. Though the difference between these two students might have been something as small as 2 or 3 questions correct on a test, the transcript will show Student A with a Pass and Student B with an Honours. While this result does illustrate one of the flaws of the H/P/F system, it is an intrinsic problem with categorical transcription of grades. No matter where the cut-off is made, there will always be people slightly above and slightly below it (5). Does C/NC really reduce stress: The decreased stress and Fig. 1 Postgraduate Directors Survey competition surrounding academic achievement is balanced by the increased stress and competition of finding alternate means of Postgraduate directors at the University of distinction, be it leadership positions, research productivity, or Toronto prefer as much information as possible reference letters. Perhaps it can be argued that students will now but are prepared to make selections without be engaging in a more well-rounded pursuit of achievement, but such information. Currently Honours standing is the initial goal of reducing student stress and competition may not consistently seen as advantageous. The be attained (5). weighting of Honours standing/grades in general varies among programs (4). As grade reporting progresses from a scale with multiple intervals to a scale that merely reports that a student has passed, information is lost and candidates appear more and more homogenous. A survey of directors of general surgery residency programs found that 81% believed that the evaluation system used by medical schools affects students’ abilities to obtain the residency position of their choice. Furthermore, the study also indicated that a P/F system is detrimental to applicants because it makes it harder to identify the students who performed best in the Pass category (5).    
  • 4. Jefferson Medical College Study: suggests that 1st year GPA was highly significantly associated with 2nd year GPA, 3rd year clinical exam grades, rating of clinical competence in core clerkship courses in 3rd year, and medical school rank (5). The impact of instituting a P/F system will be different for each type of student. However, overall, it has been reported that students perform worse on examinations where a P/F system is used. While there are numerous studies relating medical school performance to other measures like USMLE Step 1, 2, and 3, undergraduate GPA, MCAT, and interview scores, there are not many studies investigating medical school performance and postgraduate clinical competence. One study of surgical residents did show that those from a P/F school accounted for 82% of surgical residents ranking below the 15th percentile and none ranking above the 87th percentile (5). Arguments for Credit/No Credit System Subjective nature of evaluations in clerkship: every clinical rotation of clerkship includes a portion of the grade allotted to ongoing clinical assessment, allowing preceptors to provide a subjective evaluation of the Clerk’s performance. This component can account for between 10% - 60% of the student’s final grade depending on the rotation. (6). Fig. 2 Breakdown of evaluation by rotation Preclerkship courses have an On average, the subjective ward evaluation comprises 40.3% of a student’s approximate 80% average and 6% standard deviation which third year grades or 46.2% of a student’s fourth year grades (6). means that over half the class lies within 5% of the Honours cutoff. In fact, assuming a normal distribution of marks, around 38% of students would fall within the range of 77-83%, either just above or below the cusp of Honours. The same situation exists in Clerkship courses as last year’s overall third year and fourth year averages were 80.15% and 79.74% respectively (1). Some have argued that Honours has little meaning with much of the class achieving Honours and exaggerating the difference between those who receive Honours and those who do not. The University of Michigan switched from a letter grade system to a pass/fail system in 1993. It was reported that the students in a Pass/Fail system were found to be significantly less stressed, less competitive, involved in more group work, and more cooperative. Most importantly (because that is the argument often raised), there was no evidence of ‘just passing behaviour’ and the test scores did not drop. When compared, the students in a Pass/Fail system showed an equally strong commitment to their medical education as those in a grading system (4). Changing grading policy (how final marks are recorded on the transcript) would likely reduce anxiety over marks particularly in light of the University of Toronto policy of only transcripting final grades and not recording initial/preliminary grades (4). Research at other institutions suggests that changing to a Credit/No Credit grading system would have the benefit of encouraging collaboration among students and reducing stress with students performing no different on objective measures of scholastic performance (7).    
  • 5. A change in grade transcription would assist in standardizing grading across the province and nation, removing a potential disadvantage during the CARMS application process for the majority of students who will not achieve Honours in all courses, particularly for those without backgrounds in the relevant material (1). Currently, Western, McMaster, Northern, and Ottawa (Clerkship) are Credit/No Credit Schools. Toronto and Ottawa (Preclerkship) are Honours/Pass/Fail Schools. Queen’s is debating a change to Credit/No Credit. A close examination of the Jefferson Medical College study suggests the top 10% performed statistically better than all other groups while the bottom 10% performed significantly worse. A statistical difference was also observed between 60-70th percentile, while no statistical difference was observed between any other deciles. Apart from the one significant decile difference observed in the Jefferson study, it would seem to indicate that there is no statistical difference in future ability for those who do not fall into the top or bottom categories (1). The move to a competency-based curriculum (e.g. CanMEDS) in undergraduate medical education is not conceptually supported by maintaining an interval transcription methodology (3). References: 1. Homuth, D. “How Honours/Pass/Fail Grading is Failing Students.” UTMJ 85.2 (2008) 2. Brown, A., Torbicki K.,Wagg I., and Yudin J. Guiding Principles for Medical Education: A Student Review of the UME Curriculum at the University of Toronto Faculty of Medicine. 2008. 3. Litzelman DK., Cottingham AH. “The new formal competency-based curriculum and informal curriculum at Indiana University School of Medicine: overview and five-year analysis.”Acad Med. 82.4 (2007) 4. Pittini, R. Honour/Pass/Fail Grading Policy Taskforce. 2006. 5. Guo R. and Muir J. “Toronto’s Honours/Pass/Fail Debate: The Minority Position.” UTMJ 85.2 (2008) 6. Homuth, D. Credit/No Credit Proposal: Clerkship Supplement. 2008. 7. Rohe, D.E. et al. “The Benefits of Pass-Fail Grading on Stress, Mood, and Group Cohesion in Medical Students.” Mayo Clinic proceedings 81.11 (2006)