SlideShare a Scribd company logo
1 of 3
Download to read offline
Medical School Management Software 509 Richards Street, 3rd Floor, Vancouver, BC, V6B 2Z6 | www.one45.com
ENCOUNTER LOGS
CLERKSHIP
LOTTERIES
CURRICULUM
MANAGEMENT
EVALUATIONS
SCHEDULES
ACCREDITATION
REPORTS
GRADES
BEST PRACTICES GUIDE
How to visually represent
competency: spider
graphs & radar plots
As more and more education programs seek to
implement competency-based education, they
are finding that the fundamental way in which
they assess and monitor student performance
is changing.
Visualizing competencies
Since a “competent” professional should be
competent in many dimensions, like Knowledge,
Professionalism, Patient Care, and so on,
the best visual representation of a person’s
competence will allow you to see at a glance
where that person sits along each dimension of
competency.
This guide will explore one innovative way to
visualize a person’s competence: spider graphs.
We will discuss what they are, how to create
them, and some pros and cons of using spider
graphs.
What is a spider graph
Spider graphs are also known as spider charts,
radar plots, or competency reports. Each axis of
the graph represents one of the competencies
you are interested in measuring, for example,
CanMEDs roles or ACGME competencies. The
scale on each axis represents the level of that
competency, and it typically follows the Dreyfus
model of skill acquisition: Novice, Advanced
Beginner, Competent, Proficient, and Expert. The
“web” of lines that links the axes shows how the
person rates on each competency.
Medical School Management Software 509 Richards Street, 3rd Floor, Vancouver, BC, V6B 2Z6 | www.one45.com
BEST PRACTICES GUIDE
ENCOUNTER LOGS
CLERKSHIP
LOTTERIES
CURRICULUM
MANAGEMENT
EVALUATIONS
SCHEDULES
ACCREDITATION
REPORTS
GRADES
How to create a spider graph
To put a spider graph together, you need to
collect assessment data specifically on student
competency levels. A common way to do this is
by using Likert questions.
To use Likert questions to build spider graphs,
you need to create questions about particular
competencies, and use answer options that
correspond to the stages of competency you’re
interested in measuring.
Once you receive assessment data from these
questions, you can plot the values on a spider
graph.
Benefits of using spider graphs
Benefit 1: They provide a very easy way to see if
someone is competent or not
By overlaying multiple “webs” on a spider graph,
you can do visual comparisons against reference
data sets very easily. For example, you could
compare a student to his peer group by overlaying
the average spider graph from the entire class on
top of his personal spider graph.
Another option is to use a web that is standardized
for a particular level of trainee. You could overlay the
web for a junior trainee, or a full professional, and
see how your student stacks up.
Comparing one learner’s spider graph (orange) to a
class average (pink)
Comparing a junior trainee’s spider graph (dark blue) to a
full professional (light blue)
Medical School Management Software 509 Richards Street, 3rd Floor, Vancouver, BC, V6B 2Z6 | www.one45.com
BEST PRACTICES GUIDE
ENCOUNTER LOGS
CLERKSHIP
LOTTERIES
CURRICULUM
MANAGEMENT
EVALUATIONS
SCHEDULES
ACCREDITATION
REPORTS
GRADES
Benefit 2: They are great input in the
development of learning plans
Clear deficiencies or strengths in performance are
easy to see on spider graphs. When someone is
far above or below a standard, you will be able to
observe a clear “balloon out” or “cave in” pattern.
This makes it easier for time-crunched advisors to
find and address issues when they’re working with
students. It also makes it easy to identify performers
who stand out above the average. These top
performers may be able to help others in areas
where they are particularly strong. In addition, it
may highlight trainees who should move to more
advanced levels of training more quickly.
Drawbacks of using spider
graphs
Drawback #1: Subtle issues are hard to see
At one45, we see thousands of spider graphs
from our clients. The vast majority of graphs look
almost the same — they’re round webs of average
performance. A clear problem will show itself, but
subtle issues are often hidden under the weight
of average ratings, rater issues, and the inevitable
simplification that occurs when you lump a
multifaceted competency such as Professionalism
into one general rating.
Drawback #2: They’re hard to read for detail
Spider graphs are most effective when comparing
one person’s performance against a standard or a
group’s performance. However, the graph becomes
much more confusing once you have more than two
webs, or if you have many axes. For that reason,
spider graphs should be considered and used
judiciously – or not at all.
For a more in-depth read on some disadvantages
of spider graphs, check out the article “A Critique
of Radar Charts” at http://www.scottlogic.com/
blog/2011/09/23/a-critique-of-radar-charts.html
Tips and concluding thoughts
There are pros and cons to almost any type of
report or data visualization. Spider graphs offer
an interesting way of looking at competence, and
they provide the great advantage of being easy
to understand quickly. However, they have some
disadvantages, too.
If you are interested in generating some
spider graphs for your program, start small! Try
generating a spider graph by hand and see if
it is useful to you or others who are interested
in the data. If the exercise proves useful and if
you want to move the process forward, consider
using technology to speed things up. For
example, consider using one45’s reporting tool to
generate custom spider graphs for each student.
For more information, feel free to contact us at
consultation@one45.com. We’d be happy to help.

More Related Content

What's hot

Customer journey map
Customer journey mapCustomer journey map
Customer journey map
Rolly Seth
 
Du business process modeling pour orchestrer des microservices julien cognet
Du business process modeling pour orchestrer des microservices   julien cognetDu business process modeling pour orchestrer des microservices   julien cognet
Du business process modeling pour orchestrer des microservices julien cognet
Julien Cognet
 
Business plan workshop
Business plan workshopBusiness plan workshop
Business plan workshop
anif Adenan
 
Business model canvas building blocks complete
Business model canvas building blocks completeBusiness model canvas building blocks complete
Business model canvas building blocks complete
Astadi Pangarso
 
Service operation ppt
Service operation pptService operation ppt
Service operation ppt
Bhaskar Das
 

What's hot (20)

Customer journey map
Customer journey mapCustomer journey map
Customer journey map
 
Operating Rhythm PowerPoint Presentation Slides
Operating Rhythm PowerPoint Presentation Slides Operating Rhythm PowerPoint Presentation Slides
Operating Rhythm PowerPoint Presentation Slides
 
Killer Business Models
Killer Business ModelsKiller Business Models
Killer Business Models
 
Mckinsey 7s Strategic Management PowerPoint Presentation Slides
Mckinsey 7s Strategic Management PowerPoint Presentation Slides Mckinsey 7s Strategic Management PowerPoint Presentation Slides
Mckinsey 7s Strategic Management PowerPoint Presentation Slides
 
Du business process modeling pour orchestrer des microservices julien cognet
Du business process modeling pour orchestrer des microservices   julien cognetDu business process modeling pour orchestrer des microservices   julien cognet
Du business process modeling pour orchestrer des microservices julien cognet
 
Business Model Innovation
Business Model InnovationBusiness Model Innovation
Business Model Innovation
 
Module 2 ..Valur Chain Analysis.pptx
Module 2 ..Valur Chain Analysis.pptxModule 2 ..Valur Chain Analysis.pptx
Module 2 ..Valur Chain Analysis.pptx
 
Customer Acquisition Cost Complete PowerPoint Deck With Sides
Customer Acquisition Cost Complete PowerPoint Deck With SidesCustomer Acquisition Cost Complete PowerPoint Deck With Sides
Customer Acquisition Cost Complete PowerPoint Deck With Sides
 
Business plan workshop
Business plan workshopBusiness plan workshop
Business plan workshop
 
Transform Your HR Processes with Oracle HCM Cloud and Digital Tools
Transform Your HR Processes with Oracle HCM Cloud and Digital ToolsTransform Your HR Processes with Oracle HCM Cloud and Digital Tools
Transform Your HR Processes with Oracle HCM Cloud and Digital Tools
 
Chapter 5 Process Management
Chapter 5 Process ManagementChapter 5 Process Management
Chapter 5 Process Management
 
Business model Innovation
Business model InnovationBusiness model Innovation
Business model Innovation
 
Value Proposition
Value PropositionValue Proposition
Value Proposition
 
Value proposition design
Value proposition designValue proposition design
Value proposition design
 
Business model canvas building blocks complete
Business model canvas building blocks completeBusiness model canvas building blocks complete
Business model canvas building blocks complete
 
Sales Process Map Ppt Visual Aids Example File
Sales Process Map Ppt Visual Aids Example FileSales Process Map Ppt Visual Aids Example File
Sales Process Map Ppt Visual Aids Example File
 
Service operation ppt
Service operation pptService operation ppt
Service operation ppt
 
Customer Service Management Proposal PowerPoint Presentation Slides
Customer Service Management Proposal PowerPoint Presentation SlidesCustomer Service Management Proposal PowerPoint Presentation Slides
Customer Service Management Proposal PowerPoint Presentation Slides
 
Talent Management Framework Performance Management
Talent Management Framework Performance Management Talent Management Framework Performance Management
Talent Management Framework Performance Management
 
Circuit City Presentation
Circuit City  PresentationCircuit City  Presentation
Circuit City Presentation
 

Similar to How to visually represent competency: spider graphs & radar plots

Rev. 2 06142017 1 System Development Life Cycle .docx
Rev. 2 06142017  1  System Development Life Cycle .docxRev. 2 06142017  1  System Development Life Cycle .docx
Rev. 2 06142017 1 System Development Life Cycle .docx
ronak56
 
kdd2015-feed (1)
kdd2015-feed (1)kdd2015-feed (1)
kdd2015-feed (1)
Guy Lebanon
 
Dad (Data Analysis And Design)
Dad (Data Analysis And Design)Dad (Data Analysis And Design)
Dad (Data Analysis And Design)
Jill Lyons
 
Taxonomy_DDTA2016
Taxonomy_DDTA2016Taxonomy_DDTA2016
Taxonomy_DDTA2016
Tyler Mehay
 

Similar to How to visually represent competency: spider graphs & radar plots (20)

Measurement And Validation
Measurement And ValidationMeasurement And Validation
Measurement And Validation
 
data-science-lifecycle-ebook.pdf
data-science-lifecycle-ebook.pdfdata-science-lifecycle-ebook.pdf
data-science-lifecycle-ebook.pdf
 
10 Years - 10 Quantum Leaps
10 Years - 10 Quantum Leaps10 Years - 10 Quantum Leaps
10 Years - 10 Quantum Leaps
 
Quality Overview1.Ppt
Quality Overview1.PptQuality Overview1.Ppt
Quality Overview1.Ppt
 
Rev. 2 06142017 1 System Development Life Cycle .docx
Rev. 2 06142017  1  System Development Life Cycle .docxRev. 2 06142017  1  System Development Life Cycle .docx
Rev. 2 06142017 1 System Development Life Cycle .docx
 
kdd2015-feed (1)
kdd2015-feed (1)kdd2015-feed (1)
kdd2015-feed (1)
 
Laravel school management system: The ultimate pathway to success
Laravel school management system: The ultimate pathway to successLaravel school management system: The ultimate pathway to success
Laravel school management system: The ultimate pathway to success
 
QQ Plot.pptx
QQ Plot.pptxQQ Plot.pptx
QQ Plot.pptx
 
Dad (Data Analysis And Design)
Dad (Data Analysis And Design)Dad (Data Analysis And Design)
Dad (Data Analysis And Design)
 
Classification
ClassificationClassification
Classification
 
Slack EduRooms
Slack EduRoomsSlack EduRooms
Slack EduRooms
 
Be a S.U.R.E. Learner by NLB Singapore
Be a S.U.R.E. Learner by NLB SingaporeBe a S.U.R.E. Learner by NLB Singapore
Be a S.U.R.E. Learner by NLB Singapore
 
Lime
LimeLime
Lime
 
Learn to Rank search results
Learn to Rank search resultsLearn to Rank search results
Learn to Rank search results
 
Post Graduate Admission Prediction System
Post Graduate Admission Prediction SystemPost Graduate Admission Prediction System
Post Graduate Admission Prediction System
 
Easy Analytics on AWS with Amazon Redshift, Amazon QuickSight, and Amazon Mac...
Easy Analytics on AWS with Amazon Redshift, Amazon QuickSight, and Amazon Mac...Easy Analytics on AWS with Amazon Redshift, Amazon QuickSight, and Amazon Mac...
Easy Analytics on AWS with Amazon Redshift, Amazon QuickSight, and Amazon Mac...
 
Skillset Talent Management System [Dec. 3 Community Call]
Skillset Talent Management System [Dec. 3 Community Call]Skillset Talent Management System [Dec. 3 Community Call]
Skillset Talent Management System [Dec. 3 Community Call]
 
Taxonomy_DDTA2016
Taxonomy_DDTA2016Taxonomy_DDTA2016
Taxonomy_DDTA2016
 
Exploratory Data Analysis
Exploratory Data AnalysisExploratory Data Analysis
Exploratory Data Analysis
 
Kelly saleh howey_proposal
Kelly saleh howey_proposalKelly saleh howey_proposal
Kelly saleh howey_proposal
 

Recently uploaded

Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
PECB
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
Chris Hunter
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 

Recently uploaded (20)

Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
Role Of Transgenic Animal In Target Validation-1.pptx
Role Of Transgenic Animal In Target Validation-1.pptxRole Of Transgenic Animal In Target Validation-1.pptx
Role Of Transgenic Animal In Target Validation-1.pptx
 
Asian American Pacific Islander Month DDSD 2024.pptx
Asian American Pacific Islander Month DDSD 2024.pptxAsian American Pacific Islander Month DDSD 2024.pptx
Asian American Pacific Islander Month DDSD 2024.pptx
 

How to visually represent competency: spider graphs & radar plots

  • 1. Medical School Management Software 509 Richards Street, 3rd Floor, Vancouver, BC, V6B 2Z6 | www.one45.com ENCOUNTER LOGS CLERKSHIP LOTTERIES CURRICULUM MANAGEMENT EVALUATIONS SCHEDULES ACCREDITATION REPORTS GRADES BEST PRACTICES GUIDE How to visually represent competency: spider graphs & radar plots As more and more education programs seek to implement competency-based education, they are finding that the fundamental way in which they assess and monitor student performance is changing. Visualizing competencies Since a “competent” professional should be competent in many dimensions, like Knowledge, Professionalism, Patient Care, and so on, the best visual representation of a person’s competence will allow you to see at a glance where that person sits along each dimension of competency. This guide will explore one innovative way to visualize a person’s competence: spider graphs. We will discuss what they are, how to create them, and some pros and cons of using spider graphs. What is a spider graph Spider graphs are also known as spider charts, radar plots, or competency reports. Each axis of the graph represents one of the competencies you are interested in measuring, for example, CanMEDs roles or ACGME competencies. The scale on each axis represents the level of that competency, and it typically follows the Dreyfus model of skill acquisition: Novice, Advanced Beginner, Competent, Proficient, and Expert. The “web” of lines that links the axes shows how the person rates on each competency.
  • 2. Medical School Management Software 509 Richards Street, 3rd Floor, Vancouver, BC, V6B 2Z6 | www.one45.com BEST PRACTICES GUIDE ENCOUNTER LOGS CLERKSHIP LOTTERIES CURRICULUM MANAGEMENT EVALUATIONS SCHEDULES ACCREDITATION REPORTS GRADES How to create a spider graph To put a spider graph together, you need to collect assessment data specifically on student competency levels. A common way to do this is by using Likert questions. To use Likert questions to build spider graphs, you need to create questions about particular competencies, and use answer options that correspond to the stages of competency you’re interested in measuring. Once you receive assessment data from these questions, you can plot the values on a spider graph. Benefits of using spider graphs Benefit 1: They provide a very easy way to see if someone is competent or not By overlaying multiple “webs” on a spider graph, you can do visual comparisons against reference data sets very easily. For example, you could compare a student to his peer group by overlaying the average spider graph from the entire class on top of his personal spider graph. Another option is to use a web that is standardized for a particular level of trainee. You could overlay the web for a junior trainee, or a full professional, and see how your student stacks up. Comparing one learner’s spider graph (orange) to a class average (pink) Comparing a junior trainee’s spider graph (dark blue) to a full professional (light blue)
  • 3. Medical School Management Software 509 Richards Street, 3rd Floor, Vancouver, BC, V6B 2Z6 | www.one45.com BEST PRACTICES GUIDE ENCOUNTER LOGS CLERKSHIP LOTTERIES CURRICULUM MANAGEMENT EVALUATIONS SCHEDULES ACCREDITATION REPORTS GRADES Benefit 2: They are great input in the development of learning plans Clear deficiencies or strengths in performance are easy to see on spider graphs. When someone is far above or below a standard, you will be able to observe a clear “balloon out” or “cave in” pattern. This makes it easier for time-crunched advisors to find and address issues when they’re working with students. It also makes it easy to identify performers who stand out above the average. These top performers may be able to help others in areas where they are particularly strong. In addition, it may highlight trainees who should move to more advanced levels of training more quickly. Drawbacks of using spider graphs Drawback #1: Subtle issues are hard to see At one45, we see thousands of spider graphs from our clients. The vast majority of graphs look almost the same — they’re round webs of average performance. A clear problem will show itself, but subtle issues are often hidden under the weight of average ratings, rater issues, and the inevitable simplification that occurs when you lump a multifaceted competency such as Professionalism into one general rating. Drawback #2: They’re hard to read for detail Spider graphs are most effective when comparing one person’s performance against a standard or a group’s performance. However, the graph becomes much more confusing once you have more than two webs, or if you have many axes. For that reason, spider graphs should be considered and used judiciously – or not at all. For a more in-depth read on some disadvantages of spider graphs, check out the article “A Critique of Radar Charts” at http://www.scottlogic.com/ blog/2011/09/23/a-critique-of-radar-charts.html Tips and concluding thoughts There are pros and cons to almost any type of report or data visualization. Spider graphs offer an interesting way of looking at competence, and they provide the great advantage of being easy to understand quickly. However, they have some disadvantages, too. If you are interested in generating some spider graphs for your program, start small! Try generating a spider graph by hand and see if it is useful to you or others who are interested in the data. If the exercise proves useful and if you want to move the process forward, consider using technology to speed things up. For example, consider using one45’s reporting tool to generate custom spider graphs for each student. For more information, feel free to contact us at consultation@one45.com. We’d be happy to help.