A presentation on the panoramic dashboard developed at SMC to communicate impact of faculty research. Presented by Dr. Larisa Genin and Sarah Vital at the AACSB Annual Accreditation Conference: Asia Pacific. (Singapore, May 31, 2016)

1. AACSB Annual Accreditation Conference: Asia Pacific
Title: Research and Intellectual Contribution Impact
May 29-31, 2016 Singapore
SCHOOL OF ECONOMICS AND
BUSINESS ADMINISTRATION

2. PRESENTATION OUTLINE
Who we are
Strategic partnership
Streamlined process
Latest tools
The Panoramic Dashboard
Benefits

3. Dr. Larisa Genin, Associate Dean,
Accreditation and Undergraduate Programs,
School of Economics and Business Administration,
Saint Mary’s College of California
PRESENTERS/AUTHORS
Sarah Vital, Business Librarian,
Saint Mary’s College of California
Dr. Zhan Li, Dean,
School of Economics and Business
Administration, Saint Mary’s College of
California

4. Private, Catholic, Liberal
Arts, Lasallian University
Founded in 1863
Located in the San
Francisco Bay Area
2,800 undergraduates &
1,300 graduate students
SAINT MARY’S COLLEGE OF CALIFORNIA:
AT A GLANCE

5. Faculty: 55 full-time and
50 part-time
Students: 770
undergraduate & 300
graduate
Academic Programs: 3
undergraduate & 7
graduate
Discipline Departments: 6
“Think Globally. Lead Responsibly.”
SCHOOL OF ECONOMICS AND BUSINESS ADMINISTRATION:
AT A GLANCE

6. “Think Globally. Lead Responsibly.”
Strategic Foci:
Global and
Responsible
Research Types:
Practice relevant,
pedagogical, and
discipline based
Received AACSB
accreditation in
2014
School of Economics and Business Administration
at a Glance

7. Brought
• Knowledge of faculty
research
• Understanding of impact
factors to be captured
• Expertise in AACSB
accreditation requirements
LibrarySEBA
OUR UNIQUE STRATEGIC PARTNERSHIP
Brought
• Knowledge of the changing
scholarly metrics landscape
• Understanding tools of that
capture desired data
• Expertise in database
searching and researching
SEBA
Saint Mary’s
Library

8. Annual Faculty CV update process;
Standardized CVs
External data: Used various tools to
collect external quantitative metrics
Internal data: Allowed faculty to self-
report on strategic foci, research type,
and other relevant qualitative information
STREAMLINED PROCESS
Faculty CV
Updates
Faculty Self-Report
Data Collection

9. FACULTY CV UPDATES
Standardized CV template
Annually updated
Files collected by the Associate Dean
Data in CVs used to populate the Impact of Research
Dashboard

10. • AACSB Faculty Qualifications
• Education
• Academic Work Experience
• Courses Taught In The Past Five Years
• Professional Work Experience
• Intellectual Contributions
• College And School Service
• Professional Activities
• Consulting
• Board Affiliations
• Grants
• Invited Presentations
• Editorial Reviewing
• Honors/Awards
• Memberships
• Media Coverage
• Other Professional Activities
FACULTY CV UPDATES

11. Standard
Journal Metrics
Newer Journal
Metrics
Alt
Metrics
EXTERNAL DATA COLLECTIONS
Latest Tools

12. Standard Journal Metrics
Journal Citation Reports
• Journal Impact Factor, a widely recognized
measurement from Thomson Reuters, developed
to rank and compare journals based on the times a
typical article is cited.
DATA COLLECTIONS
Cabell’s International
• Journal acceptance rate
• Cabell's Classification Index (CCI) reports the influence of
a journal in a particular discipline
WorldCat
• Reported holdings / ownership from libraries and
institutions worldwide

13. DATA COLLECTIONS
Newer Journal Metrics
SCIamgo Journal Rank (SJR)
• A newer measure of journal influence, SJR measures
both article citation counts, but also the influence of the
other journals that those citations are in.
SNIP
• One of the newest metrics, SNIP Indicator
(Source Normalized Impact per Paper) aims to
compare typical citation metrics but compared
within the field only.

14. • Used by over 250 schools worldwide.
• In 2014, Plum Analytics became a part of
EBSCO
http://plumanalytics.com/
Alt Metrics
DATA COLLECTIONS

15. Research Artifacts
• Articles
• Blog posts
• Book chapters
• Books
• Cases
• Clinical Trials
• Conference Papers
• Data Sets
• Figures
• Grants
• Interviews
• Letters
• Media
• Patents
• Posters
• Presentations
• Reports
• Source Code
• Theses /
Dissertations
• Videos
• Web Pages
DATA COLLECTIONS

16. Some of PlumX’s Sources
Amazon
Bit.ly
CrossRef
Delicious
Dryad
dSpace
EBSCO
ePrints
Facebook
figshare
Github
Goodreads
Google+
Medwave
Mendeley
PLOS
PubMed Central
Reddit
Research Blogging
Scopus
SlideShare
SourceForge
Stack Overflow
Twitter
USPTO
Vimeo
Wikipedia
Worldcat (OCLC)
YouTube
DATA COLLECTIONS

17. PlumX Metrics Categories
USAGE
(clicks, downloads, views, library
holdings, video plays)
CAPTURES
(bookmarks, code forks, favorites,
readers, watchers)
MENTIONS
(blog posts, comments, reviews,
Wikipedia links)
SOCIAL MEDIA
(+1s, likes, shares, tweets)
CITATIONS
(PubMed Central, Scopus, patents)
DATA COLLECTIONS

18. • Is anyone reading our work?
• Did anyone watch our videos?
• Usage is the #1 stat researchers want to know after
Citation counts
• PlumX is the only product that includes Usage
clicks, downloads, views,
library holdings, video
plays
DATA COLLECTIONS

19. DATA COLLECTIONS
• Captures indicate that someone wants to come back to
the work
• Early indicator of future citations
bookmarks, favorites,
readers, watchers

20. • This category measures people truly engaging with your
research
• Automatically uncover the conversations about your
research
• Discover feedback, opinions, etc.
blog posts, comments,
reviews, Wikipedia links
DATA COLLECTIONS

21. DATA COLLECTIONS
• Social media measures how well a researcher is
promoting their work
• This is especially important for early career researchers
to measure and understand
• Track the buzz and attention around your research
output
+1s, likes, shares,
tweets

22. DATA COLLECTIONS
• Citations still a standard of long-term impact
• Including citations enables side-by-side analysis with
other metrics categories
PubMed Central,
Scopus, patents

23. DATA COLLECTIONS
The “Plum Print”
Quickly, visually represent
the reach of an piece of
research

24. DATA COLLECTIONS

25. FACULTY SELF-REPORT
Dashboard, complete with data, is returned to
faculty.
Faculty are asked to:
Determine strategic foci that are applicable to
each publication (Global, Responsible)
Indicate research types that apply to each
publication (Discipline, Pedagogy, Practice)
Comment on each publication
Has the publication
received awards or
recognition?
Has the research led to
media coverage?
Are there testimonials of how
this research has affected
teaching or industry?

26. RESULTS: IMPACT OF RESEARCH DASHBOARD

27. Faculty CV
Updates
Data
Collection
(External /
Quantitative)
Faculty Self-
Report
(Internal /
Qualitative )
RESULTS: IMPACT OF RESEARCH DASHBOARD

28. Simplified system for impact of research
tracking
Standardized format
Streamlined process
Go-to document for regional and specialized
accreditations, institutional assessment, and
professional development purposes
‣ Identify gaps, opportunities for more
research, new research streams
‣ Get faculty excited about the impact of their
work
‣ Opportunities for reflections with Chairs,
Dean during 1:1 meetings
BENEFITS OF THE PANORAMIC DASHBOARD

29. Sarah Vital, Business Librarian
Saint Mary’s College of California Library
svital@stmarys-ca.edu
Dr. Larisa Genin, Associate Dean,
Accreditation and Undergraduate Programs,
School of Economics and Business Administration
lgenin@stmarys-ca.edu
QUESTIONS?
Dr. Zhan Li, Dean
School of Economics and Business Administration
zgl1@stmarys-ca.edu