Lackadaisical Larry - a virtual learner. Study on using virtual patients to convey the troubles seen with some challenged learners. Also 'Cultural Competencies', another virtual learners case, presented at Ottawa Conference and CCME, 2014, Ottawa, Canada. Doug Myhre, Maureen Topps, David Topps, University of Calgary.

1. D. Myhre, M.Topps, D.Topps
University of Calgary

2.  No conflicts to disclose
 Use of third party material in this
presentation falls under fair dealing in the
Copyright Act
http://library.ucalgary.ca/copyright/fair-dealing

3.  Conversion of virtual patients to virtual
learners
 Situational JudgmentTesting construct as a
methodology to assess non medical expert
roles
 Passing bias

4.  Residents in difficulty create large challenges
 Increasingly decentralized med ed
 Community based preceptors may feel especially
isolated.
 Intrinsic competencies are difficult to assess.
 There is often more than one acceptable
response

5.  Adapted concept of virtual patients
 Open source virtual patient platform
 Open Labyrinth
 Created series of on-line virtual learners from
preceptor examples
 Allows preceptors to explore scenarios
without personal risk

6.  Measurement methodology
 Presents realistic virtual scenarios and asks
the individual to rank the provided responses
in the order they feel is most effective

7.  Content highly relevant
 Responses are drawn from preceptor
experience
 Easily disseminated
 Less threatening to the preceptor
 Responses are situation specific
 Practice will not improve performance
 Construct variety is emphasized

8.  Scenarios are brief
 Responses may not align with preceptor’s
preferences
 Text boxes allow the responses to evolve over time
 SJT criticized in summative assessment as
multidimensional
 Difficult to separate them for assessment
 Best suited for assessing multiple constructs
 Best suited for point in time feedback

10. Scrubbed clean

11.  Observation of responses has raised
questions
 Rankings are not reflected in the scoring system
 Most consideration on first two positions

12.  Qualitative responses on shortVL’s
 "I believe these kind of questions are very important for the
[preceptors] to work through. It would be interesting to analyze
their answers to get a sense of how answers relate to where
they were trained…”
 "Wow - super interesting! Found myself sometimes choosing
what I felt was the right thing to do, but not being sure I'd
always have the 'guts' to actually do it. A lot of things to think
about there! "
 "Loved the short cases on cultural competencies - lots of fun. I
know you are looking at the tool and the SJT, but these would
be fun to do in a group with other preceptors."

14.  Conversion of virtual patients to virtual
leaners
 Situational JudgmentTesting construct as a
methodology to assess non medical expert
roles
 Within safe virtual environment, experienced
preceptors fail to fail

15.  tinyurl.com/VLLarry –VL Larry
 tinyurl.com/VLcomps – VL Cultural Competencies
 dmyhre@ucalgary.ca
 mtopps@ucalgary.ca
 topps@ucalgary.ca