Your SlideShare is downloading. ×
0
APPLICATION OF ASSESSMENT ANDEVALUATION DATA TO IMPROVE A DYNAMIC    GRADUATE MEDICAL EDUCATION             CURRICULUM    ...
A LAYOUT OF THE PRESENTATION   Setting the Scene       – The Task       – The Complexities   Explanation of the tools crea...
SETTING THE     SCENESystems thinking andcomplexity concepts as frameworks for   conceptualizing     interventions    (Pat...
THE TASK The creation of a blanket syllabus and set of learningobjectives for research design and statistics that can be  ...
THE COMPLEXITIES• Target Audience  – Time constraint  – Intrinsic motivation toward research• Accreditation and Accountabi...
THE PROCESS• What did we start with?• What is it like to be without a formal set of  objectives or a syllabus?• What do we...
FIRST: AN ASSESSMENT TOOL• Implementation of an initial assessment for  the purposes of understanding:  – Student baseline...
SECOND: A PRE-COURSE TOOL• The initiation of a pre-course survey   – What do our students want to get out of the course?  ...
THIRD: CLASSROOM ACTIVITIES AND                HOMEWORK• New classroom activities related to applying what  they’ve learne...
FOURTH: AN EVALUATION TOOL• Development of a post-course survey to assess:  – Change in perceptions  – Change in attitudes...
A Constant Process of Fine-Tuning
THE RESULT OF OUR EFFORTS TO UNDERSTAND AND OPERATE IN A DYNAMIC               SYSTEM     We implemented all of these swee...
HOW THIS PROCESS     INFORMS OUR TASK• As this academic year’s workshops get  underway, there will be a constant turning o...
A LESSON                      Learning objectives, like many things,cannot be looked at like a   logic model,with rigidit...
SUGGESTIONS
Promote feedback and utilization of results
Remember the nature of the organization
Collaborate with colleagues
Use reflection for improvement and            development
Think outside the box
THANK YOU!QUESTIONS?
Upcoming SlideShare
Loading in...5
×

Application of assessment and evaluation data to improve a dynamic graduate medical education curriculum smith et al 2012

318

Published on

Published in: Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
318
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
10
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Application of assessment and evaluation data to improve a dynamic graduate medical education curriculum smith et al 2012"

  1. 1. APPLICATION OF ASSESSMENT ANDEVALUATION DATA TO IMPROVE A DYNAMIC GRADUATE MEDICAL EDUCATION CURRICULUM TIFFANY L. SMITH, PATRICK B. BARLOW, ROBERT E. HEIDEL, & WILLIAM METHENY
  2. 2. A LAYOUT OF THE PRESENTATION Setting the Scene – The Task – The Complexities Explanation of the tools created and the process of creating them 1. Assessment Tool 2. Precourse Tool 3. Classroom Activities and Homework 4. An Evaluation Tool 5. Fine-Tuning The Result of Our Efforts – How this process informs our task – A lesson – Suggestions Questions
  3. 3. SETTING THE SCENESystems thinking andcomplexity concepts as frameworks for conceptualizing interventions (Patton, 2010)
  4. 4. THE TASK The creation of a blanket syllabus and set of learningobjectives for research design and statistics that can be worked into any lecture series.
  5. 5. THE COMPLEXITIES• Target Audience – Time constraint – Intrinsic motivation toward research• Accreditation and Accountability• Absence of Materials• Stakeholder Buy-In
  6. 6. THE PROCESS• What did we start with?• What is it like to be without a formal set of objectives or a syllabus?• What do we do to change? Where do we go from here?...
  7. 7. FIRST: AN ASSESSMENT TOOL• Implementation of an initial assessment for the purposes of understanding: – Student baseline knowledge – Student progress at the completion of the series
  8. 8. SECOND: A PRE-COURSE TOOL• The initiation of a pre-course survey – What do our students want to get out of the course? – Who are they? – What are their interests? – Perceptions of the usefulness of the course
  9. 9. THIRD: CLASSROOM ACTIVITIES AND HOMEWORK• New classroom activities related to applying what they’ve learned• New homework assignments to assess their ability to apply course content outside of the classroom• A final research proposal project – Incorporating the course content into an oral presentation
  10. 10. FOURTH: AN EVALUATION TOOL• Development of a post-course survey to assess: – Change in perceptions – Change in attitudes – Evaluation of instructor contribution – Utility of the modules
  11. 11. A Constant Process of Fine-Tuning
  12. 12. THE RESULT OF OUR EFFORTS TO UNDERSTAND AND OPERATE IN A DYNAMIC SYSTEM We implemented all of these sweeping curriculum and measurement changes almost exactly one year after our first experienceteaching the material, and it was universally themost successful and rigorous workshop to date.
  13. 13. HOW THIS PROCESS INFORMS OUR TASK• As this academic year’s workshops get underway, there will be a constant turning of the feedback wheel• Utilization of data• Constant adaptation is KEY• Constant, critical reflection on our own work (Stevahn, King, Ghere, & Minnema, 2005)• Must remember the complex nature of the task• This was not only an implementation of a course. Not just the implementation of a new assessment.• It was also the implementation of evaluation into the process of course development and modification.
  14. 14. A LESSON  Learning objectives, like many things,cannot be looked at like a logic model,with rigidity and fixedness, but instead like a process that will change over time.
  15. 15. SUGGESTIONS
  16. 16. Promote feedback and utilization of results
  17. 17. Remember the nature of the organization
  18. 18. Collaborate with colleagues
  19. 19. Use reflection for improvement and development
  20. 20. Think outside the box
  21. 21. THANK YOU!QUESTIONS?
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×