SlideShare a Scribd company logo
Christopher Stokes
Dental Education
Journal Club July '13
Briefly...
• 2 research goals:
• Quality and quantity of reflection of
professional behaviour in a web-based
portfolio vs. 'classic' paper-based
• Feasibility, flexibility and acceptability of
each approach
Background
• Professionalism increasingly central in UG
and PG training
• Self-assessment and direct observation of
professionalism are the current norm (e.g.
Singer et al 1996, van de Vleuten and Schuwirth, 1995)
• Poor validity of self-assessment (Eva and
Regehr, 2005)
• Peer assessment could be used?
Assumption...
• "Medical students usually know which of their
classmates they would trust to treat their
family members" (Dannefer et al, 2005)
• Intrinsic potential of peer assessment
Methodology
• The study involved all 2nd year medical students enrolled in a ten-week
course (n=307, 198/109 m/f)Each tutorial group consists of ten students on
average and a tutor/facilitator, and each meeting lasts 2 hours.
• For the purpose of this study, the students were divided into two groups
(effectively randomly)
• The rst group used a web-based instrument to assess professionalfi
behaviour
• The other group used the 'classic' method with a paper assessment form.
• Questionnaire at end of study
Observable
behaviours
Observable
behaviours
The web-based
system
• Used same questions as 'classic' method
• Email-link led (click to complete)
• Completed twice
• Students invited 5 random peer reviews +
tutor (paper not clear on allocation method)
• Student received printable reports
Analysis
• Blind analysis
• Commonly used feedback rules used to score
each statement (Pendleton and Scho eldfi
1984; Branch and Paranjape 2002)
Results summary
• + Amount of feedback in all categories for
web-based group
• No difference in feedback scores between the
systems
• - Interpersonal contact for web-based system,
and more time consuming
Discussion
• The study reveals that the number of comments was
signi cantly higher in the web-based group compared with thefi
paper-based group. The quality of the feedback, however, did
not parallel the quantitative increase.
• When considering the aggregated scores on the ve feedbackfi
criteria no differences in quality of feedback was found
between the groups
• Nevertheless, the feedback provided by the web-based group
showed poorer quality in relation to several feedback criteria
(e.g. was unrelated to the observed behaviour; data not
shown) - Ctrl+V?
• However, the statistical signi cance revealed by thesefi
individual analyses is questionable. No gender bias reported?

More Related Content

What's hot

Rothenberg Assessment Report 2009 S A S T A P S Y Conf 10
Rothenberg  Assessment  Report 2009  S A S T A  P S Y  Conf 10Rothenberg  Assessment  Report 2009  S A S T A  P S Y  Conf 10
Rothenberg Assessment Report 2009 S A S T A P S Y Conf 10
cyberspaced educator
 
Retention Convention 2010
Retention Convention 2010Retention Convention 2010
Retention Convention 2010
Sarah_Lawther
 
Integrating EBM into Medical School
Integrating EBM into Medical SchoolIntegrating EBM into Medical School
Integrating EBM into Medical School
russkie69
 
Transforming Your Educational Efforts into Scholarship
Transforming Your Educational Efforts into ScholarshipTransforming Your Educational Efforts into Scholarship
Transforming Your Educational Efforts into Scholarship
Department of Learning Health Sciences, University of Michigan Medical School
 
present of power point
present of power point present of power point
present of power point
varisha arain
 
EBD session 3
EBD session 3EBD session 3
EBD session 3
PaulaFunnell
 
Standardized Deception: Examining the Debilitating Effects of Standardized Te...
Standardized Deception: Examining the Debilitating Effects of Standardized Te...Standardized Deception: Examining the Debilitating Effects of Standardized Te...
Standardized Deception: Examining the Debilitating Effects of Standardized Te...
petermanr22
 
Wonca ws ece maja
Wonca ws ece majaWonca ws ece maja
Threats to validity
Threats to validityThreats to validity
Threats to validity
Roji Maharjan
 
No Title
No TitleNo Title
2015-10-28 research seminar
2015-10-28 research seminar2015-10-28 research seminar
2015-10-28 research seminar
ifi8106tlu
 
WPACommunicating
WPACommunicatingWPACommunicating
WPACommunicating
Krystal Miguel
 
Paper 12 ELT
Paper 12 ELTPaper 12 ELT
Paper 12 ELT
vanita0806
 
Curriculum-Integrated Library Instruction for PA Students (EBP)
Curriculum-Integrated Library Instruction for PA Students (EBP)Curriculum-Integrated Library Instruction for PA Students (EBP)
Curriculum-Integrated Library Instruction for PA Students (EBP)
Library
 
Entrepreneurship and Mentorship in Online Courses
Entrepreneurship and Mentorship in Online CoursesEntrepreneurship and Mentorship in Online Courses
Entrepreneurship and Mentorship in Online Courses
Greg Bybee
 
Constructing Subjective type of Achievement Test
Constructing Subjective type of Achievement TestConstructing Subjective type of Achievement Test
Constructing Subjective type of Achievement Test
HennaAnsari
 
81 muster2014 Roberton
81 muster2014 Roberton81 muster2014 Roberton
81 muster2014 Roberton
Muster2014
 
Faculty Research Opportunity
Faculty Research OpportunityFaculty Research Opportunity
Faculty Research Opportunity
Julie Delello
 
Comprehensive Reading Instruction for Children with ASD
Comprehensive Reading Instruction for Children with ASDComprehensive Reading Instruction for Children with ASD
Comprehensive Reading Instruction for Children with ASD
Michigan State University Research
 

What's hot (19)

Rothenberg Assessment Report 2009 S A S T A P S Y Conf 10
Rothenberg  Assessment  Report 2009  S A S T A  P S Y  Conf 10Rothenberg  Assessment  Report 2009  S A S T A  P S Y  Conf 10
Rothenberg Assessment Report 2009 S A S T A P S Y Conf 10
 
Retention Convention 2010
Retention Convention 2010Retention Convention 2010
Retention Convention 2010
 
Integrating EBM into Medical School
Integrating EBM into Medical SchoolIntegrating EBM into Medical School
Integrating EBM into Medical School
 
Transforming Your Educational Efforts into Scholarship
Transforming Your Educational Efforts into ScholarshipTransforming Your Educational Efforts into Scholarship
Transforming Your Educational Efforts into Scholarship
 
present of power point
present of power point present of power point
present of power point
 
EBD session 3
EBD session 3EBD session 3
EBD session 3
 
Standardized Deception: Examining the Debilitating Effects of Standardized Te...
Standardized Deception: Examining the Debilitating Effects of Standardized Te...Standardized Deception: Examining the Debilitating Effects of Standardized Te...
Standardized Deception: Examining the Debilitating Effects of Standardized Te...
 
Wonca ws ece maja
Wonca ws ece majaWonca ws ece maja
Wonca ws ece maja
 
Threats to validity
Threats to validityThreats to validity
Threats to validity
 
No Title
No TitleNo Title
No Title
 
2015-10-28 research seminar
2015-10-28 research seminar2015-10-28 research seminar
2015-10-28 research seminar
 
WPACommunicating
WPACommunicatingWPACommunicating
WPACommunicating
 
Paper 12 ELT
Paper 12 ELTPaper 12 ELT
Paper 12 ELT
 
Curriculum-Integrated Library Instruction for PA Students (EBP)
Curriculum-Integrated Library Instruction for PA Students (EBP)Curriculum-Integrated Library Instruction for PA Students (EBP)
Curriculum-Integrated Library Instruction for PA Students (EBP)
 
Entrepreneurship and Mentorship in Online Courses
Entrepreneurship and Mentorship in Online CoursesEntrepreneurship and Mentorship in Online Courses
Entrepreneurship and Mentorship in Online Courses
 
Constructing Subjective type of Achievement Test
Constructing Subjective type of Achievement TestConstructing Subjective type of Achievement Test
Constructing Subjective type of Achievement Test
 
81 muster2014 Roberton
81 muster2014 Roberton81 muster2014 Roberton
81 muster2014 Roberton
 
Faculty Research Opportunity
Faculty Research OpportunityFaculty Research Opportunity
Faculty Research Opportunity
 
Comprehensive Reading Instruction for Children with ASD
Comprehensive Reading Instruction for Children with ASDComprehensive Reading Instruction for Children with ASD
Comprehensive Reading Instruction for Children with ASD
 

Similar to Web Assisted Assessment of Professional Behaviour

Top Articles in Medical Education 2016
Top Articles in Medical Education 2016Top Articles in Medical Education 2016
Top Articles in Medical Education 2016
dsandro1
 
Chapter 2 class version b
Chapter 2 class version bChapter 2 class version b
Chapter 2 class version b
jbnx
 
Modesofinquiry
ModesofinquiryModesofinquiry
Modesofinquiry
Carla Piper
 
ARLG 2019: Myer have we made a difference
ARLG 2019: Myer have we made a differenceARLG 2019: Myer have we made a difference
ARLG 2019: Myer have we made a difference
CILIP ARLG Academic and Research Libraries Group
 
Affective relationships between users & libraries in times of economic stress
Affective relationships between users & libraries in times of economic stressAffective relationships between users & libraries in times of economic stress
Affective relationships between users & libraries in times of economic stress
Giannis Tsakonas
 
Introduction to Usability Testing for Survey Research
Introduction to Usability Testing for Survey ResearchIntroduction to Usability Testing for Survey Research
Introduction to Usability Testing for Survey Research
Caroline Jarrett
 
Action Research Plan
Action Research PlanAction Research Plan
Action Research Plan
Ariana Linger Gasiglia
 
Educational research basic Steps
Educational research basic Steps Educational research basic Steps
Educational research basic Steps
Fahid Fadi
 
Introduction to Qualitative Research-Week 1.pptx
Introduction to Qualitative Research-Week 1.pptxIntroduction to Qualitative Research-Week 1.pptx
Introduction to Qualitative Research-Week 1.pptx
kiranhashmi
 
Measuring the effectiveness of library information literacy instruction
Measuring the effectiveness of library information literacy instructionMeasuring the effectiveness of library information literacy instruction
Measuring the effectiveness of library information literacy instruction
Elise Wong
 
quantitative nor qualitative research.docx
quantitative nor qualitative research.docxquantitative nor qualitative research.docx
quantitative nor qualitative research.docx
write22
 
quantitative nor qualitative research.docx
quantitative nor qualitative research.docxquantitative nor qualitative research.docx
quantitative nor qualitative research.docx
stirlingvwriters
 
Research methodology 101
Research methodology 101Research methodology 101
Research methodology 101
home
 
Oral versus written assessments
Oral versus written assessmentsOral versus written assessments
Oral versus written assessments
Chris Willmott
 
TESTA to FASTECH Presentation
TESTA to FASTECH PresentationTESTA to FASTECH Presentation
TESTA to FASTECH Presentation
Tansy_Jessop
 
Top Articles in Medical Education 2017
Top Articles in Medical Education 2017Top Articles in Medical Education 2017
Top Articles in Medical Education 2017
dsandro1
 
Research methodology 101
Research methodology 101Research methodology 101
Research methodology 101
narman1402
 
مقاله للترجمه
مقاله للترجمهمقاله للترجمه
مقاله للترجمه
rubaatat
 
Group1 Assessment
Group1 AssessmentGroup1 Assessment
Group1 Assessment
Azhar Alramadan
 
Quis custodiet ipsos custodes? - Enhancement of Supervision and Examination P...
Quis custodiet ipsos custodes? - Enhancement of Supervision and Examination P...Quis custodiet ipsos custodes? - Enhancement of Supervision and Examination P...
Quis custodiet ipsos custodes? - Enhancement of Supervision and Examination P...
Luigi Vanfretti
 

Similar to Web Assisted Assessment of Professional Behaviour (20)

Top Articles in Medical Education 2016
Top Articles in Medical Education 2016Top Articles in Medical Education 2016
Top Articles in Medical Education 2016
 
Chapter 2 class version b
Chapter 2 class version bChapter 2 class version b
Chapter 2 class version b
 
Modesofinquiry
ModesofinquiryModesofinquiry
Modesofinquiry
 
ARLG 2019: Myer have we made a difference
ARLG 2019: Myer have we made a differenceARLG 2019: Myer have we made a difference
ARLG 2019: Myer have we made a difference
 
Affective relationships between users & libraries in times of economic stress
Affective relationships between users & libraries in times of economic stressAffective relationships between users & libraries in times of economic stress
Affective relationships between users & libraries in times of economic stress
 
Introduction to Usability Testing for Survey Research
Introduction to Usability Testing for Survey ResearchIntroduction to Usability Testing for Survey Research
Introduction to Usability Testing for Survey Research
 
Action Research Plan
Action Research PlanAction Research Plan
Action Research Plan
 
Educational research basic Steps
Educational research basic Steps Educational research basic Steps
Educational research basic Steps
 
Introduction to Qualitative Research-Week 1.pptx
Introduction to Qualitative Research-Week 1.pptxIntroduction to Qualitative Research-Week 1.pptx
Introduction to Qualitative Research-Week 1.pptx
 
Measuring the effectiveness of library information literacy instruction
Measuring the effectiveness of library information literacy instructionMeasuring the effectiveness of library information literacy instruction
Measuring the effectiveness of library information literacy instruction
 
quantitative nor qualitative research.docx
quantitative nor qualitative research.docxquantitative nor qualitative research.docx
quantitative nor qualitative research.docx
 
quantitative nor qualitative research.docx
quantitative nor qualitative research.docxquantitative nor qualitative research.docx
quantitative nor qualitative research.docx
 
Research methodology 101
Research methodology 101Research methodology 101
Research methodology 101
 
Oral versus written assessments
Oral versus written assessmentsOral versus written assessments
Oral versus written assessments
 
TESTA to FASTECH Presentation
TESTA to FASTECH PresentationTESTA to FASTECH Presentation
TESTA to FASTECH Presentation
 
Top Articles in Medical Education 2017
Top Articles in Medical Education 2017Top Articles in Medical Education 2017
Top Articles in Medical Education 2017
 
Research methodology 101
Research methodology 101Research methodology 101
Research methodology 101
 
مقاله للترجمه
مقاله للترجمهمقاله للترجمه
مقاله للترجمه
 
Group1 Assessment
Group1 AssessmentGroup1 Assessment
Group1 Assessment
 
Quis custodiet ipsos custodes? - Enhancement of Supervision and Examination P...
Quis custodiet ipsos custodes? - Enhancement of Supervision and Examination P...Quis custodiet ipsos custodes? - Enhancement of Supervision and Examination P...
Quis custodiet ipsos custodes? - Enhancement of Supervision and Examination P...
 

Recently uploaded

Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
alexjohnson7307
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AstuteBusiness
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
saastr
 
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
FREE A4 Cyber Security Awareness  Posters-Social Engineering part 3FREE A4 Cyber Security Awareness  Posters-Social Engineering part 3
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
Data Hops
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
tolgahangng
 
A Comprehensive Guide to DeFi Development Services in 2024
A Comprehensive Guide to DeFi Development Services in 2024A Comprehensive Guide to DeFi Development Services in 2024
A Comprehensive Guide to DeFi Development Services in 2024
Intelisync
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 
AWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptxAWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptx
HarisZaheer8
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
Postman
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
SAP S/4 HANA sourcing and procurement to Public cloud
SAP S/4 HANA sourcing and procurement to Public cloudSAP S/4 HANA sourcing and procurement to Public cloud
SAP S/4 HANA sourcing and procurement to Public cloud
maazsz111
 
Public CyberSecurity Awareness Presentation 2024.pptx
Public CyberSecurity Awareness Presentation 2024.pptxPublic CyberSecurity Awareness Presentation 2024.pptx
Public CyberSecurity Awareness Presentation 2024.pptx
marufrahmanstratejm
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 

Recently uploaded (20)

Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
 
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
FREE A4 Cyber Security Awareness  Posters-Social Engineering part 3FREE A4 Cyber Security Awareness  Posters-Social Engineering part 3
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
 
A Comprehensive Guide to DeFi Development Services in 2024
A Comprehensive Guide to DeFi Development Services in 2024A Comprehensive Guide to DeFi Development Services in 2024
A Comprehensive Guide to DeFi Development Services in 2024
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 
AWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptxAWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptx
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
SAP S/4 HANA sourcing and procurement to Public cloud
SAP S/4 HANA sourcing and procurement to Public cloudSAP S/4 HANA sourcing and procurement to Public cloud
SAP S/4 HANA sourcing and procurement to Public cloud
 
Public CyberSecurity Awareness Presentation 2024.pptx
Public CyberSecurity Awareness Presentation 2024.pptxPublic CyberSecurity Awareness Presentation 2024.pptx
Public CyberSecurity Awareness Presentation 2024.pptx
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 

Web Assisted Assessment of Professional Behaviour

  • 2. Briefly... • 2 research goals: • Quality and quantity of reflection of professional behaviour in a web-based portfolio vs. 'classic' paper-based • Feasibility, flexibility and acceptability of each approach
  • 3. Background • Professionalism increasingly central in UG and PG training • Self-assessment and direct observation of professionalism are the current norm (e.g. Singer et al 1996, van de Vleuten and Schuwirth, 1995) • Poor validity of self-assessment (Eva and Regehr, 2005) • Peer assessment could be used?
  • 4. Assumption... • "Medical students usually know which of their classmates they would trust to treat their family members" (Dannefer et al, 2005) • Intrinsic potential of peer assessment
  • 5. Methodology • The study involved all 2nd year medical students enrolled in a ten-week course (n=307, 198/109 m/f)Each tutorial group consists of ten students on average and a tutor/facilitator, and each meeting lasts 2 hours. • For the purpose of this study, the students were divided into two groups (effectively randomly) • The rst group used a web-based instrument to assess professionalfi behaviour • The other group used the 'classic' method with a paper assessment form. • Questionnaire at end of study
  • 7. The web-based system • Used same questions as 'classic' method • Email-link led (click to complete) • Completed twice • Students invited 5 random peer reviews + tutor (paper not clear on allocation method) • Student received printable reports
  • 8. Analysis • Blind analysis • Commonly used feedback rules used to score each statement (Pendleton and Scho eldfi 1984; Branch and Paranjape 2002)
  • 9.
  • 10. Results summary • + Amount of feedback in all categories for web-based group • No difference in feedback scores between the systems • - Interpersonal contact for web-based system, and more time consuming
  • 11.
  • 12.
  • 13. Discussion • The study reveals that the number of comments was signi cantly higher in the web-based group compared with thefi paper-based group. The quality of the feedback, however, did not parallel the quantitative increase. • When considering the aggregated scores on the ve feedbackfi criteria no differences in quality of feedback was found between the groups • Nevertheless, the feedback provided by the web-based group showed poorer quality in relation to several feedback criteria (e.g. was unrelated to the observed behaviour; data not shown) - Ctrl+V? • However, the statistical signi cance revealed by thesefi individual analyses is questionable. No gender bias reported?