Integrating Open Source Web 2.0 and Smartphone Technologies to Automate Academic CME Presented at: 2011 Medicine 2.0 Confe...
Disclosures and Acknowledgements <ul><li>Mila Kostic has no interest in selling a technology, program, product or service ...
Setting the Stage: 2003-2010 <ul><li>10 FTEs </li></ul><ul><li>Developed large online presence housed in separate content ...
2010: The RSS Problem <ul><li>90 weekly sessions. </li></ul><ul><li>112,500 attendees to be recorded (from RSS alone) </li...
2010: The Learning Platform Problem <ul><li>Educational portfolio advanced to include much more interactive curricula - wi...
Major Goals and Solutions Needs Solutions Import, organize and house large amounts of learner participation data Open-sour...
EthosCE LMS <ul><li>Full-featured, open source content-learning management system </li></ul><ul><li>Designed specifically ...
Technology Development Process <ul><li>Interviewed key UPenn stakeholders to analyze current “pain points” and workflow </...
Mobile SMS Attendance Tracking Workflow
Web-based CME Process
Creating RSS Workflow
RSS Coordinator Dashboard
UPenn RSS Platform
User Feedback <ul><li>Positive adoption rates and feedback from HCPs regarding new RSS mobile system </li></ul><ul><li>All...
Website/User Interface
Learning Groups/Communities
Major Goals and Solutions Needs Solutions Import, organize and house large amounts of learner participation data Open-sour...
Lessons Learned <ul><li>After many pathways…go with an integrated LMS/CMS system </li></ul><ul><ul><ul><li>No easy solutio...
Lessons Learned  (cont’d) <ul><li>Significant Savings </li></ul><ul><ul><ul><li>One point of entry for all activities, all...
Upcoming SlideShare
Loading in …5
×

741: Integrating Open Source Web 2.0 and Smartphone Technologies to Automate Academic CME

1,156 views

Published on

Published in: Health & Medicine, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,156
On SlideShare
0
From Embeds
0
Number of Embeds
52
Actions
Shares
0
Downloads
14
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

741: Integrating Open Source Web 2.0 and Smartphone Technologies to Automate Academic CME

  1. 1. Integrating Open Source Web 2.0 and Smartphone Technologies to Automate Academic CME Presented at: 2011 Medicine 2.0 Conference # 741 Mila Kostic, Perelman School of Medicine at the University of Pennsylvania, Office of CME Jeremy C. Lundberg, MSW, DLC Solutions and Ethos CE
  2. 2. Disclosures and Acknowledgements <ul><li>Mila Kostic has no interest in selling a technology, program, product or service to the audience. </li></ul><ul><li>Jeremy Lundberg has an interest in selling a technology, product or service to CME professionals. </li></ul><ul><li>Grateful to Rod Campbell at Penn CME for data and project leadership </li></ul>
  3. 3. Setting the Stage: 2003-2010 <ul><li>10 FTEs </li></ul><ul><li>Developed large online presence housed in separate content management system (CMS) </li></ul><ul><li>2009 </li></ul><ul><ul><li>5,431 activities (live, self study online, RSS, other) </li></ul></ul><ul><ul><li>734,815 certificates issued </li></ul></ul><ul><ul><li>Leased new database - Eventually replaced by another as program grew </li></ul></ul><ul><li>2010 </li></ul><ul><ul><li>1,000,000 MD and 500,000 non-MD records </li></ul></ul><ul><ul><li>96 RSS </li></ul></ul><ul><ul><li>Over 5,500 web-based self-study CME activities </li></ul></ul><ul><ul><li>Growing number of PI-CME </li></ul></ul><ul><ul><li>Database administered manually </li></ul></ul><ul><ul><li>Attendance collected using barcode scanning </li></ul></ul>
  4. 4. 2010: The RSS Problem <ul><li>90 weekly sessions. </li></ul><ul><li>112,500 attendees to be recorded (from RSS alone) </li></ul><ul><li>6 month backlog to enter attendance into database. </li></ul><ul><li>2 FTEs + required to: </li></ul><ul><ul><li>Review applications </li></ul></ul><ul><ul><li>Monitor disclosures and handouts </li></ul></ul><ul><ul><li>Conduct onsite visits </li></ul></ul><ul><ul><li>Enter attendees into database </li></ul></ul><ul><ul><li>Training and approvals </li></ul></ul><ul><ul><li>Monitoring peer-review process </li></ul></ul>
  5. 5. 2010: The Learning Platform Problem <ul><li>Educational portfolio advanced to include much more interactive curricula - with no adequate LMS solutions </li></ul><ul><ul><li>Housed programs off-site </li></ul></ul><ul><ul><li>Expensive to develop advanced case-based modules, simulations </li></ul></ul><ul><li>Need for communities of practice in virtual environment </li></ul><ul><ul><li>By practice setting </li></ul></ul><ul><ul><li>By specialty/content category </li></ul></ul><ul><ul><li>PI CME </li></ul></ul><ul><li>Need for good user interface </li></ul><ul><li>Need for integration with EMRs for PI/QI CME projects </li></ul>
  6. 6. Major Goals and Solutions Needs Solutions Import, organize and house large amounts of learner participation data Open-source solution allowing for standards-based XML data exchange (web services), use of mobile text messaging (SMS) technology Allow easy creation of interactive modular content Modular SCORM-compliant LMS allowing for easy development and import of content Friendly user interface Drupal CMS, roles-based interface for administrators and relational and filtered views for learners Enable multidirectional learning and blending of CME with non educational exchange Learning Groups and Communities of Practice (to include data exchange) Integration with other institutional LMSs and EMR XML data exchange and communities-based QI interventions Internal and external reporting of data and educational outcomes (research, regulatory, and scholarly exchange) PARS reporting to ACCME (regulatory) based on MedBiq XML standard; views and integration with 3-rd party reporting tools for large evaluation of outcomes reporting and display
  7. 7. EthosCE LMS <ul><li>Full-featured, open source content-learning management system </li></ul><ul><li>Designed specifically for continuing medical education </li></ul><ul><li>ACCME PARS compliant </li></ul><ul><li>No licensing fees or user restrictions </li></ul><ul><li>Organizations retain complete access to source code </li></ul><ul><li>Personalized, Web 2.0 learning environment </li></ul><ul><li>Automates and streamlines “back office” administration </li></ul><ul><li>Role-based permissions and security protocols </li></ul><ul><li>Flexible outcomes and compliance reporting engine </li></ul><ul><li>Integrates with 3rd party applications </li></ul>
  8. 8. Technology Development Process <ul><li>Interviewed key UPenn stakeholders to analyze current “pain points” and workflow </li></ul><ul><li>Recommended new automated workflow using mobile text messaging (SMS) technology </li></ul><ul><li>Configured EthosCE Attendance Tracking Module </li></ul><ul><li>Modified Drupal SMS Module, Mobivity </li></ul><ul><li>Created custom API between SMS and Attendance Tracking Modules </li></ul>
  9. 9. Mobile SMS Attendance Tracking Workflow
  10. 10. Web-based CME Process
  11. 11. Creating RSS Workflow
  12. 12. RSS Coordinator Dashboard
  13. 13. UPenn RSS Platform
  14. 14. User Feedback <ul><li>Positive adoption rates and feedback from HCPs regarding new RSS mobile system </li></ul><ul><li>Allows for instant RSS attendance credit to “My CME” transcripts and ACCME PARS </li></ul><ul><li>CME office staff and series-level coordinators see RSS Online Workflow screens as “very useful” </li></ul><ul><li>RSS workflow enables complete attendance management for registered and non-registered HCPs </li></ul><ul><li>Attendance admin screen allows flexibility in record keeping </li></ul><ul><li>Study participants asked to rate the following on a 5-point Likert scale (1=Poor, 5=Excellent) </li></ul><ul><ul><li>Ease of Use: 4.5 average rating </li></ul></ul><ul><ul><li>Clarity of Instructions: 4.5 average rating </li></ul></ul><ul><ul><li>Credit Monitoring: 4.6 average rating </li></ul></ul>
  15. 15. Website/User Interface
  16. 16. Learning Groups/Communities
  17. 17. Major Goals and Solutions Needs Solutions Import, organize and house large amounts of learner participation data Open-source solution allowing for standards-based XML data exchange (web services), use of mobile text messaging (SMS) technology  Allow easy creation of interactive modular content Modular SCORM-compliant LMS allowing for easy development and import of content  Friendly user interface Drupal CMS, roles-based interface for administrators and relational and filtered views for learners  Enable multidirectional learning and blending of CME with non educational exchange Learning Groups and Communities of Practice (to include data exchange) +/- Integration with other institutional LMSs and EMR XML data exchange and communities-based QI interventions +/- Internal and external reporting of data and educational outcomes (research, regulatory, and scholarly exchange) PARS reporting to ACCME (regulatory) based on MedBiq XML standard; views and integration with 3-rd party reporting tools for large evaluation of outcomes reporting and display +/-
  18. 18. Lessons Learned <ul><li>After many pathways…go with an integrated LMS/CMS system </li></ul><ul><ul><ul><li>No easy solutions for large data imports from old databases (re-register users) </li></ul></ul></ul><ul><ul><ul><li>Critical to have solid internal resource to guide project management with vendors and partners </li></ul></ul></ul><ul><ul><ul><li>Get the process right (from needs, through case studies, solutions, testing, improving to launch and continuous assessment and improvement) </li></ul></ul></ul><ul><ul><ul><ul><li>Internal integration allows for easier integration with other stakeholders (partners for content and reporting, EMR for continuous data and practice outcomes exchange ) </li></ul></ul></ul></ul>
  19. 19. Lessons Learned (cont’d) <ul><li>Significant Savings </li></ul><ul><ul><ul><li>One point of entry for all activities, all users, and links to internal and external resources </li></ul></ul></ul><ul><li>Automated attendance records controlled by learners </li></ul><ul><ul><li>Less room for error </li></ul></ul><ul><ul><li>Instant availability of records on transcript </li></ul></ul><ul><ul><li>Instant reporting capabilities for administrators and coordinators </li></ul></ul><ul><ul><li>Value added to other regulatory bodies at departments and institution-level </li></ul></ul><ul><li>Less issues with session documentation approval timelines </li></ul><ul><ul><ul><li>Time and effort savings </li></ul></ul></ul><ul><ul><ul><li>One, integrated CME administrative process </li></ul></ul></ul><ul><ul><ul><li>Can provide limited administrative privileges to internal and external collaborators </li></ul></ul></ul><ul><ul><ul><li>Peer-review process </li></ul></ul></ul><ul><ul><ul><li>CME Coordination </li></ul></ul></ul><ul><ul><ul><li>Easy assessment and evaluation data collection, analysis and reporting </li></ul></ul></ul>

×