SlideShare a Scribd company logo
1 of 1
Download to read offline
The Dark Side of Practice: Outcomes Associated w/ Poor Practice Performance
Kaeley N. Timmel, Lyndsea A. Smith, Kelly A. Cave, Keaton A. Fletcher, & Wendy L. Bedwell, Ph.D.
Department of Psychology, University of South Florida
Training Reactions Psychological Strain
B SE(B) β ΔR2
p B SE(B) β ΔR2
p
Step 1 .08 .001
Mindfulness 0.28 0.08 .28 .001 -0.61 0.10 -.44 <.001
Step 2
.07
<.
001
Mindfulness
0.28 0.08 .28
<.
001
-0.61 .10 -.44 <.001
Errors -0.01 0.00 -0.27 <.001 0.01 0.01 .15 .04
Abstract
Introduction MethodsResults
Conclusions
Results
This study examines the effects of trait mindfulness, a dispositional factor, and training performance on (1) psychological distress post-training performance and (2) training utility reactions (N = 140). Participants were
trained on a card sorting task, in which they use a checklist to sort a deck of sixty cards from the card game. Multiple hierarchical regression suggests that trait mindfulness is a significant negative predictor of
psychological strain and a significant positive predictor of training reactions. Overall, these findings suggest that individuals who perform poorly during training practice experienced increased psychological distress and
saw less utility of the actual training program. Thus, despite the evidence suggesting practice is an important component of effective training, it may not always yield beneficial outcomes.
• 155 undergraduate psychology students
• Participants trained on card sorting task, in which they
used a checklist to sort a deck of sixty cards
• Included an online training video that provided
information about the task and a demonstration
• Given 1 minute to familiarize themselves with the cards
• Then given 10 minutes to practice completing the
sorting task with a new deck.
• Upon completion, the experimenter provided feedback,
walking the participant through the scoring, explaining
mistakes and methods of improving
• Following feedback, participants were asked to rate their
satisfaction with the overall training as well as their
psychological strain
Science of Training
• Efficient training programs provide information, demonstration,
practice, and feedback (Kraiger & Aguinis 2001; Salas & Cannon-Bowers, 2001)
• Information: What to do, why it is important
• Demonstration: How to do it (how not to do it)
• Practice: Try doing it using provided information
• Feedback: What to change and what to keep doing
Objectives
• Address the gap that existing research has not yet examined
regarding the strain risks associated with training
• Investigate what effect does practice performance and
feedback have on strain outcomes
• Examine the effects of trait mindfulness and training on
psychological distress and utility training reactions post
training performance
• Individuals who perform poorly during training practice
and received negative feedback experienced increased
psychological distress and saw less utility of the actual
training program.
• These effects suggest that after accounting for
psychological resources trainees have coming into the
training session, their negative performance during training
can still explain negative strain outcomes.
• Future studies should examine whether it is the negative
feedback or the poor performance that leads to negative
strain outcomes
• Future training programs should consider better preparing
trainees for practice performance episodes, or better equip
them with potential psychological resources.
• Trait mindfulness is a significant, negative predictor of
psychological strain (R2
= .20, p < .001, B = -0.61, SE(B)
= 0.10, β = -.44).
• The number of errors made during the training
performance session positively predicts psychological
strain above and beyond the effects of mindfulness (ΔR2
= .02, p = .04, b = 0.01, SE(b) = 0.01, β = .15)
• Trait mindfulness is a significant, positive predictor of
training reactions (R2
= .08, p = .001, B = 0.28, SE(B) =
0.08, β = .28)
• The number of errors made during the training
performance session negatively predicts utility reactions
above and beyond trait mindfulness (ΔR2
= .08, p < .001,
B = -0.01, SE(B) = 0.00, β = -.27)
References available upon request
UNIVERSITY OF SOUTH FLORIDA
COLLEGE OF ARTS & SCIENCES
This research was supported in part by the Sunshine Education and Research Center at the University of South Florida. The Center is supported by Training
Grant No. T42-OH008438 from the Centers for Disease Control and Prevention/National Institute for Occupational Safety and Health (NIOSH).

More Related Content

What's hot

Learning from Evaluation
Learning from EvaluationLearning from Evaluation
Learning from EvaluationOlivier Serrat
 
ADAA Poster_MUH_NRF_03_28_16
ADAA Poster_MUH_NRF_03_28_16ADAA Poster_MUH_NRF_03_28_16
ADAA Poster_MUH_NRF_03_28_16M. Usama Hindiyeh
 
Interactive Metronome: Training to Win
Interactive Metronome: Training to WinInteractive Metronome: Training to Win
Interactive Metronome: Training to WinDr Nancy Doreo, DC
 
HFES 2008 Proceedings Presentation
HFES 2008 Proceedings PresentationHFES 2008 Proceedings Presentation
HFES 2008 Proceedings Presentationcmkelley
 
ADAA 2016 CALM Open Trial 2016
ADAA 2016 CALM Open Trial 2016ADAA 2016 CALM Open Trial 2016
ADAA 2016 CALM Open Trial 2016Nancy Driska
 
Me? or meds?  subjective symptoms in medicated and unmedicated adults with adhd
Me? or meds?  subjective symptoms in medicated and unmedicated adults with adhd Me? or meds?  subjective symptoms in medicated and unmedicated adults with adhd
Me? or meds?  subjective symptoms in medicated and unmedicated adults with adhd Jhovana Cervantes
 
Effects of self talk
Effects of self talkEffects of self talk
Effects of self talkAnn Bernard
 
The Effects of Study Skills Training and Peer Coaching of At-Risk Students on...
The Effects of Study Skills Training and Peer Coaching of At-Risk Students on...The Effects of Study Skills Training and Peer Coaching of At-Risk Students on...
The Effects of Study Skills Training and Peer Coaching of At-Risk Students on...Lehman Teaching & Learning Commons
 
Uid formative evaluation
Uid formative evaluationUid formative evaluation
Uid formative evaluationPen Lister
 
Enhancing Awareness of Yoga in Health Professions Education Students through ...
Enhancing Awareness of Yoga in Health Professions Education Students through ...Enhancing Awareness of Yoga in Health Professions Education Students through ...
Enhancing Awareness of Yoga in Health Professions Education Students through ...Yogacharya AB Bhavanani
 
Trendsinassessment
TrendsinassessmentTrendsinassessment
Trendsinassessmentlv2sign
 
Functional treatment
Functional treatment Functional treatment
Functional treatment scbarthelme2
 
Evaluation and making modification phase - OD process
Evaluation and making modification phase -  OD processEvaluation and making modification phase -  OD process
Evaluation and making modification phase - OD processmanumelwin
 
What makes mindfulness training provided by an employer sustainable for an in...
What makes mindfulness training provided by an employer sustainable for an in...What makes mindfulness training provided by an employer sustainable for an in...
What makes mindfulness training provided by an employer sustainable for an in...Cranfield University
 

What's hot (19)

Learning from Evaluation
Learning from EvaluationLearning from Evaluation
Learning from Evaluation
 
ADAA Poster_MUH_NRF_03_28_16
ADAA Poster_MUH_NRF_03_28_16ADAA Poster_MUH_NRF_03_28_16
ADAA Poster_MUH_NRF_03_28_16
 
Interactive Metronome: Training to Win
Interactive Metronome: Training to WinInteractive Metronome: Training to Win
Interactive Metronome: Training to Win
 
HFES 2008 Proceedings Presentation
HFES 2008 Proceedings PresentationHFES 2008 Proceedings Presentation
HFES 2008 Proceedings Presentation
 
Job satisfaction
Job satisfactionJob satisfaction
Job satisfaction
 
ADAA 2016 CALM Open Trial 2016
ADAA 2016 CALM Open Trial 2016ADAA 2016 CALM Open Trial 2016
ADAA 2016 CALM Open Trial 2016
 
Icmiplenary1a
Icmiplenary1aIcmiplenary1a
Icmiplenary1a
 
APS 2016
APS 2016APS 2016
APS 2016
 
Me? or meds?  subjective symptoms in medicated and unmedicated adults with adhd
Me? or meds?  subjective symptoms in medicated and unmedicated adults with adhd Me? or meds?  subjective symptoms in medicated and unmedicated adults with adhd
Me? or meds?  subjective symptoms in medicated and unmedicated adults with adhd
 
Effects of self talk
Effects of self talkEffects of self talk
Effects of self talk
 
Kibe is8
Kibe is8Kibe is8
Kibe is8
 
Feedback
FeedbackFeedback
Feedback
 
The Effects of Study Skills Training and Peer Coaching of At-Risk Students on...
The Effects of Study Skills Training and Peer Coaching of At-Risk Students on...The Effects of Study Skills Training and Peer Coaching of At-Risk Students on...
The Effects of Study Skills Training and Peer Coaching of At-Risk Students on...
 
Uid formative evaluation
Uid formative evaluationUid formative evaluation
Uid formative evaluation
 
Enhancing Awareness of Yoga in Health Professions Education Students through ...
Enhancing Awareness of Yoga in Health Professions Education Students through ...Enhancing Awareness of Yoga in Health Professions Education Students through ...
Enhancing Awareness of Yoga in Health Professions Education Students through ...
 
Trendsinassessment
TrendsinassessmentTrendsinassessment
Trendsinassessment
 
Functional treatment
Functional treatment Functional treatment
Functional treatment
 
Evaluation and making modification phase - OD process
Evaluation and making modification phase -  OD processEvaluation and making modification phase -  OD process
Evaluation and making modification phase - OD process
 
What makes mindfulness training provided by an employer sustainable for an in...
What makes mindfulness training provided by an employer sustainable for an in...What makes mindfulness training provided by an employer sustainable for an in...
What makes mindfulness training provided by an employer sustainable for an in...
 

Similar to Dark Side of Practice Outcomes.pptx

Evaluating the quality of quality improvement training in healthcare
Evaluating the quality of quality improvement training in healthcareEvaluating the quality of quality improvement training in healthcare
Evaluating the quality of quality improvement training in healthcareDaniel McLinden
 
tutor2u Strong Foundations A Level Psychology
tutor2u Strong Foundations A Level Psychologytutor2u Strong Foundations A Level Psychology
tutor2u Strong Foundations A Level Psychologytutor2u
 
解決志向コーチングに基づくセルフ・コーチングの介入プログラム効果検証 Development and Evaluation of a Self-Coach...
解決志向コーチングに基づくセルフ・コーチングの介入プログラム効果検証 Development and Evaluation of a Self-Coach...解決志向コーチングに基づくセルフ・コーチングの介入プログラム効果検証 Development and Evaluation of a Self-Coach...
解決志向コーチングに基づくセルフ・コーチングの介入プログラム効果検証 Development and Evaluation of a Self-Coach...Yoga Tokuyoshi
 
Development and evaluation of an intervention program based on Solution Focus...
Development and evaluation of an intervention program based on Solution Focus...Development and evaluation of an intervention program based on Solution Focus...
Development and evaluation of an intervention program based on Solution Focus...Yoga Tokuyoshi
 
Assessment- Introduction, Internal & CIA, (Formative/Summative), Planning of ...
Assessment- Introduction, Internal & CIA, (Formative/Summative), Planning of ...Assessment- Introduction, Internal & CIA, (Formative/Summative), Planning of ...
Assessment- Introduction, Internal & CIA, (Formative/Summative), Planning of ...Prof. Dr. Hironmoy Roy
 
Psychological depression prevention programs for 5-10 year olds: What’s the e...
Psychological depression prevention programs for 5-10 year olds: What’s the e...Psychological depression prevention programs for 5-10 year olds: What’s the e...
Psychological depression prevention programs for 5-10 year olds: What’s the e...Health Evidence™
 
Qualitative Biomechanical Analysis In Physical Education. pptx
Qualitative Biomechanical Analysis In Physical Education. pptxQualitative Biomechanical Analysis In Physical Education. pptx
Qualitative Biomechanical Analysis In Physical Education. pptxNorieta Langpawen
 
Evaluation assignment 5 paper
Evaluation assignment 5 paperEvaluation assignment 5 paper
Evaluation assignment 5 papersedunham
 
Categorical Data Analysis Survey Data
Categorical Data Analysis Survey DataCategorical Data Analysis Survey Data
Categorical Data Analysis Survey Dataguest47a77bd
 
#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...
#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...
#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...Dennis Kappen
 
Level1trainingevaluation
Level1trainingevaluationLevel1trainingevaluation
Level1trainingevaluationSandy Clare
 
Performance management
Performance managementPerformance management
Performance managementanuj kalsi
 
Giving effective feedback and feedforward
Giving effective feedback and feedforwardGiving effective feedback and feedforward
Giving effective feedback and feedforwardSheila MacNeill
 
PPT.Diagnostic Testing.pptx
PPT.Diagnostic Testing.pptxPPT.Diagnostic Testing.pptx
PPT.Diagnostic Testing.pptxSATINDER DHILLON
 
2016 Conference - GCSE reforms: helping you choose the right exam board
2016 Conference - GCSE reforms: helping you choose the right exam board2016 Conference - GCSE reforms: helping you choose the right exam board
2016 Conference - GCSE reforms: helping you choose the right exam boardYouth Sport Trust
 
Research article on peer assesment
Research article on peer assesmentResearch article on peer assesment
Research article on peer assesmentHadia Tayyab
 

Similar to Dark Side of Practice Outcomes.pptx (20)

Evaluating the quality of quality improvement training in healthcare
Evaluating the quality of quality improvement training in healthcareEvaluating the quality of quality improvement training in healthcare
Evaluating the quality of quality improvement training in healthcare
 
Training Evaluation Essay
Training Evaluation EssayTraining Evaluation Essay
Training Evaluation Essay
 
tutor2u Strong Foundations A Level Psychology
tutor2u Strong Foundations A Level Psychologytutor2u Strong Foundations A Level Psychology
tutor2u Strong Foundations A Level Psychology
 
解決志向コーチングに基づくセルフ・コーチングの介入プログラム効果検証 Development and Evaluation of a Self-Coach...
解決志向コーチングに基づくセルフ・コーチングの介入プログラム効果検証 Development and Evaluation of a Self-Coach...解決志向コーチングに基づくセルフ・コーチングの介入プログラム効果検証 Development and Evaluation of a Self-Coach...
解決志向コーチングに基づくセルフ・コーチングの介入プログラム効果検証 Development and Evaluation of a Self-Coach...
 
Development and evaluation of an intervention program based on Solution Focus...
Development and evaluation of an intervention program based on Solution Focus...Development and evaluation of an intervention program based on Solution Focus...
Development and evaluation of an intervention program based on Solution Focus...
 
Authentic tasksss
Authentic tasksssAuthentic tasksss
Authentic tasksss
 
Assessment- Introduction, Internal & CIA, (Formative/Summative), Planning of ...
Assessment- Introduction, Internal & CIA, (Formative/Summative), Planning of ...Assessment- Introduction, Internal & CIA, (Formative/Summative), Planning of ...
Assessment- Introduction, Internal & CIA, (Formative/Summative), Planning of ...
 
Psychological depression prevention programs for 5-10 year olds: What’s the e...
Psychological depression prevention programs for 5-10 year olds: What’s the e...Psychological depression prevention programs for 5-10 year olds: What’s the e...
Psychological depression prevention programs for 5-10 year olds: What’s the e...
 
Qualitative Biomechanical Analysis In Physical Education. pptx
Qualitative Biomechanical Analysis In Physical Education. pptxQualitative Biomechanical Analysis In Physical Education. pptx
Qualitative Biomechanical Analysis In Physical Education. pptx
 
Evaluation assignment 5 paper
Evaluation assignment 5 paperEvaluation assignment 5 paper
Evaluation assignment 5 paper
 
Categorical Data Analysis Survey Data
Categorical Data Analysis Survey DataCategorical Data Analysis Survey Data
Categorical Data Analysis Survey Data
 
#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...
#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...
#Gamification of Older Adults’ Physical Activity: An Experimental Study (HICS...
 
Level1trainingevaluation
Level1trainingevaluationLevel1trainingevaluation
Level1trainingevaluation
 
Performance management
Performance managementPerformance management
Performance management
 
Giving effective feedback and feedforward
Giving effective feedback and feedforwardGiving effective feedback and feedforward
Giving effective feedback and feedforward
 
PPT.Diagnostic Testing.pptx
PPT.Diagnostic Testing.pptxPPT.Diagnostic Testing.pptx
PPT.Diagnostic Testing.pptx
 
2016 Conference - GCSE reforms: helping you choose the right exam board
2016 Conference - GCSE reforms: helping you choose the right exam board2016 Conference - GCSE reforms: helping you choose the right exam board
2016 Conference - GCSE reforms: helping you choose the right exam board
 
Signature choice assignment ppt
Signature choice assignment pptSignature choice assignment ppt
Signature choice assignment ppt
 
Assessment Centre Ratings
Assessment Centre RatingsAssessment Centre Ratings
Assessment Centre Ratings
 
Research article on peer assesment
Research article on peer assesmentResearch article on peer assesment
Research article on peer assesment
 

Dark Side of Practice Outcomes.pptx

  • 1. The Dark Side of Practice: Outcomes Associated w/ Poor Practice Performance Kaeley N. Timmel, Lyndsea A. Smith, Kelly A. Cave, Keaton A. Fletcher, & Wendy L. Bedwell, Ph.D. Department of Psychology, University of South Florida Training Reactions Psychological Strain B SE(B) β ΔR2 p B SE(B) β ΔR2 p Step 1 .08 .001 Mindfulness 0.28 0.08 .28 .001 -0.61 0.10 -.44 <.001 Step 2 .07 <. 001 Mindfulness 0.28 0.08 .28 <. 001 -0.61 .10 -.44 <.001 Errors -0.01 0.00 -0.27 <.001 0.01 0.01 .15 .04 Abstract Introduction MethodsResults Conclusions Results This study examines the effects of trait mindfulness, a dispositional factor, and training performance on (1) psychological distress post-training performance and (2) training utility reactions (N = 140). Participants were trained on a card sorting task, in which they use a checklist to sort a deck of sixty cards from the card game. Multiple hierarchical regression suggests that trait mindfulness is a significant negative predictor of psychological strain and a significant positive predictor of training reactions. Overall, these findings suggest that individuals who perform poorly during training practice experienced increased psychological distress and saw less utility of the actual training program. Thus, despite the evidence suggesting practice is an important component of effective training, it may not always yield beneficial outcomes. • 155 undergraduate psychology students • Participants trained on card sorting task, in which they used a checklist to sort a deck of sixty cards • Included an online training video that provided information about the task and a demonstration • Given 1 minute to familiarize themselves with the cards • Then given 10 minutes to practice completing the sorting task with a new deck. • Upon completion, the experimenter provided feedback, walking the participant through the scoring, explaining mistakes and methods of improving • Following feedback, participants were asked to rate their satisfaction with the overall training as well as their psychological strain Science of Training • Efficient training programs provide information, demonstration, practice, and feedback (Kraiger & Aguinis 2001; Salas & Cannon-Bowers, 2001) • Information: What to do, why it is important • Demonstration: How to do it (how not to do it) • Practice: Try doing it using provided information • Feedback: What to change and what to keep doing Objectives • Address the gap that existing research has not yet examined regarding the strain risks associated with training • Investigate what effect does practice performance and feedback have on strain outcomes • Examine the effects of trait mindfulness and training on psychological distress and utility training reactions post training performance • Individuals who perform poorly during training practice and received negative feedback experienced increased psychological distress and saw less utility of the actual training program. • These effects suggest that after accounting for psychological resources trainees have coming into the training session, their negative performance during training can still explain negative strain outcomes. • Future studies should examine whether it is the negative feedback or the poor performance that leads to negative strain outcomes • Future training programs should consider better preparing trainees for practice performance episodes, or better equip them with potential psychological resources. • Trait mindfulness is a significant, negative predictor of psychological strain (R2 = .20, p < .001, B = -0.61, SE(B) = 0.10, β = -.44). • The number of errors made during the training performance session positively predicts psychological strain above and beyond the effects of mindfulness (ΔR2 = .02, p = .04, b = 0.01, SE(b) = 0.01, β = .15) • Trait mindfulness is a significant, positive predictor of training reactions (R2 = .08, p = .001, B = 0.28, SE(B) = 0.08, β = .28) • The number of errors made during the training performance session negatively predicts utility reactions above and beyond trait mindfulness (ΔR2 = .08, p < .001, B = -0.01, SE(B) = 0.00, β = -.27) References available upon request UNIVERSITY OF SOUTH FLORIDA COLLEGE OF ARTS & SCIENCES This research was supported in part by the Sunshine Education and Research Center at the University of South Florida. The Center is supported by Training Grant No. T42-OH008438 from the Centers for Disease Control and Prevention/National Institute for Occupational Safety and Health (NIOSH).