The document discusses how the implementation of radiology data mining software (Illuminate) impacted scholarly activity at a university medical center radiology department. After installing the software, residents were 3-4 times more likely to author abstracts and manuscripts. The department saw a large increase in resident publications and presentations after using the software. While not proving causation, the results suggest that data mining software can increase research efficiency and output by reducing time barriers to conducting research.

1. The Effect of Radiology Data Mining Softwareon
Departmental Scholarly Activity
Bourgeois AC, Pasciak AS, *Patel NJ, Syed M, Heidel RE, BradleyYC, *McKinney JM
Department of Radiology, Graduate School of Medicine
University ofTennessee Medical Center, Knoxville
*Department of Radiology, Mayo Clinic, Jacksonville
University of Tennessee Medical Center, Knoxville

2. Conflicts of Interest
 None

3. Introduction
 The ACGME common program requirements stipulate
that programs provide education to advance residents’
knowledge of the basic principles of research, including
how research is conducted, evaluated, explained to
patients, and applied to patient care
 Resident and clinical faculty involvement in research
differs among institutions
 Variable access to resources, incentives, and differences in institutional
culture.
 Despite mandatory requirements to participate in
research and quality improvement, establishing these
endeavors as a departmental priority is often challenging.

4. Background
 Pubmed: >10 publications per year regarding
scholarly activity in medical education.
 Much of the current literature examines barriers to
increased productivity, economic impact of scholarly
activity, and specific programs that increase
research.
 Some clear associations are evident.

5. Residency Setting/Model Matters:
Increased Resources in University Programs
Crawford, P. & Seehusen, D. Scholarly activity in family medicine residency programs:
a national survey. Fam Med 43, 311–317 (2011).

6. Clearly Defined Barriers to Research
Rivera, J. A., Levine, R. B. & Wright, S. M. Brief report: Completing a scholarly project
during residency training. J Gen Intern Med 20, 366–369 (2005).

7. Factors that Improve Research Participation
 Incentives
 Culture
 Resources

8. Factors that Improve Research Participation
 Incentives
Crawford, P. & Seehusen, D. Scholarly activity in family medicine residency programs:
a national survey. Fam Med 43, 311–317 (2011).

9. Factors that Improve Research Participation
 Culture
Crawford, P. & Seehusen, D. Scholarly activity in family medicine residency programs:
a national survey. Fam Med 43, 311–317 (2011).

10. Factors that Improve Research Participation
 Resources: Time and Money
+++==
Crawford, P. & Seehusen, D. Scholarly activity in family medicine residency programs:
a national survey. Fam Med 43, 311–317 (2011).

11. Factors that Improve Research Participation
 Resources: Time and Money
 Sakai showed average cost of supporting
residents at national meetings averages
$1424 and required missing 60 clinical
cases
Sakai,T. Residents' scholarly activity: a cost analysis with regard to its effects on
departments. Curr Opin Anaesthesiol 28, 180–185 (2015).

12. Resources
 Potentially important resources are numerous and
include:
 Research assistants
 Collaborators and data miners
 IRB personnel
 The ease of data collection from existing medical
record systems is also a time barrier to research.
 Systems that improve the efficiency of data collection
are potentially powerful research tools.

13. About Illuminate®

15. Study design
 Single-institution retrospective review of departmental
faculty and resident files of 69 consecutive months.
 National and international abstract presentations and
scientific publications were included before and after
Illuminate (Soktek®, Inc., Prairie Village, KS) software
was installed throughout the department on month 35.
 Residents, clinical faculty, and research faculty were
analyzed on aggregate and independent basis with
regard to total scientific manuscript production, abstract
presentation, and rate of collaboration with other
departments.

16. Practice setting
 University of Tennessee Medical Center, Knoxville
 Private group
 21 DR, 3 IR physicians
 23 residents (5 Pgy-5, 6 in other classes)
 Secretary to aid IRB paperwork
 Basic science research department that functions
separately but publishes under the department
 GSM funds 1 conference/yr per resident at $2,250 each
University of Tennessee Medical Center, Knoxville

17. Methods
 Results stratified to include projects in which
residents did and didn't participate.
 Non-clinical research faculty were analyzed on an
aggregate and individual basis.
 An “impact score” comprised of the number of
departmental authors on each scientific manuscript
multiplied by the respective journal impact factors
were compared.

18. Results
 Residents were 4.4 times (95% CI 2.23 – 8.81) to author a
scientific manuscript with DMS.
 DMS was associated with increased clinical faculty and resident
scientific manuscripts. (p=0.001)
 Resident manuscripts: 11 before, 48 after
 Clinical faculty were 3.9 times more likely to be part of a presentation after
DMS implementation (95%CI 1.3 – 11.7)
 Residents were 3.2 times more likely to author an abstract
following DMS implementation. (95% CI 1.2 – 11.6)
 Resident abstracts: 57 before, 181 after
 DMS was associated with no statistically significant change in
total departmental “impact score” or increased
interdepartmental collaboration in both abstract presentation
(p=0.53) and manuscript publication. (p=0.77)

19. Results: IncreasedPublications & Abstract Presentations
3.2x
4.4x
Post DMS, abstract presentations averaged >3 per resident per year

20. Conclusions
 A number of factors affect the scholarly activity
production in academic medical centers.
 Software platforms such as Softek Illuminate®
increase data mining efficiency, saving the residents
time, the factor reported as the most significant
barrier to research.
 In our case, scholarly activity profoundly increased
shorty after the installation of Illuminate.

21. Conclusions
 These data should be taken in context.
 This does not prove correlation.
 Simultaneous culture shift both within the department
and GSM to emphasize, recognize, and award
scholarly activity.
 2 residents accounted for over half of the abstract
presentations and nearly 75% of the publications.
 Future multisite studies could help determine the
reproducible impact of DMS on scholarly activity and
collaboration.

22. References
• Seehusen, D. A., Asplund, C. A. & Friedman, M. A point system for resident scholarly activity.
Fam Med 41, 467–469 (2009).
• Grady, E. C. et al. Defining Scholarly Activity in Graduate Medical Education. Journal of
Graduate Medical Education 4, 558–561 (2012).
• Levine, R. B., Hebert, R. S. & Wright, S. M. Resident research and scholarly activity in
internal medicine residency training programs. J Gen Intern Med 20, 155–159 (2005).
• Penrose, L. L., Yeomans, E. R., Praderio, C. & Prien, S. D. An Incremental Approach to
Improving Scholarly Activity. Journal of Graduate Medical Education 4, 496–499 (2012).
• Sakai, T. et al. Facilitation of Resident Scholarly Activity. Anesthesiology 120, 111–119
(2014).
• Ledford, C. J. W., Seehusen, D. A., Villagran, M. M., Cafferty, L. A. & Childress, M. A.
Resident Scholarship Expectations and Experiences: Sources of Uncertainty as Barriers to
Success. Journal of Graduate Medical Education 5, 564–569 (2013).
• Crawford, P. & Seehusen, D. Scholarly activity in family medicine residency programs: a
national survey. Fam Med 43, 311–317 (2011).
• Carek, P. J., Dickerson, L. M., Diaz, V. A. & Steyer, T. E. Addressing the Scholarly Activity
Requirements for Residents: One Program's Solution. Journal of Graduate Medical
Education 3, 379–382 (2011).
• Rivera, J. A., Levine, R. B. & Wright, S. M. Brief report: Completing a scholarly project during
residency training. J Gen Intern Med 20, 366–369 (2005).
• Takahashi, O. et al. Residents’ Experience of Scholarly Activities is Associated with Higher
Satisfaction with Residency Training. J Gen Intern Med 24, 716–720 (2009).
• Sakai, T. Residents' scholarly activity: a cost analysis with regard to its effects on
departments. Curr Opin Anaesthesiol 28, 180–185 (2015).