In the mid-2000's OPRA, together with Dr. Duncan Jackson, conducted some cutting edge research into assessments centres. The purpose: to establish what assessment centres really measure and how to maximise prediction of performance. The research has been published globally and these slides cover the key findings of this work.
Feedback is an effective tool to use in different context, highly useful in training activities, team buildings but also organizational teams and business.
Giving and receiving feedback are tough for everyone. Who wants to criticize others or be criticized? Although managers have a duty to give honest feedback to staff and peers, many people resist change or differ on how to change—leading to interpersonal conflicts and impacting deliverables.
These are the slides from a workshop I am running, it definitely doesn't quite translate to self paced online, but you get an idea of some of the stuff. Please provide comments if you have any feedback!
Feedback is an effective tool to use in different context, highly useful in training activities, team buildings but also organizational teams and business.
Giving and receiving feedback are tough for everyone. Who wants to criticize others or be criticized? Although managers have a duty to give honest feedback to staff and peers, many people resist change or differ on how to change—leading to interpersonal conflicts and impacting deliverables.
These are the slides from a workshop I am running, it definitely doesn't quite translate to self paced online, but you get an idea of some of the stuff. Please provide comments if you have any feedback!
Do you think you get enough feedback about how you can be more effective from your boss?.... Your team probably thinks the same about you.
Receiving good feedback gives you powerful information that can dramatically decreases the time required to master a skill or help you blow down the barriers that prevent you from getting to the next level. If only you knew.
Effective people management can not only influence productivity but also has a direct correlation with morale of employees and their motivation to work harder and smarter
Members of Connect: Professional Women’s Network share advice for effectively delivering the good, bad and ugly.
Connect: Professional Women’s Network is online community with more than 300,000 members that discusses issues relevant to women and their success. The free LinkedIn group powered by Citi also features videos interviews with influential businesswomen, live Q&As with experts and slideshows with career advice. To learn more and join the conversation in the largest women's group on LinkedIn, visit http://www.linkedin.com/womenconnect.
Keeping Employees Engaged In The WorkplaceJumpstart:HR
Jumpstart:HR is your trusted HR Outsourcing and Strategic Counseling partner. We work with your organization as a virtual and on-site service provider to solve your HR challenges, alleviate your burdens and free up your time.
Visit us at http://www.jumpstart-hr.com to learn more about how we can save your organization time and bring about a greater ROI on your Human Capital Management strategy.
Twitter: http://www.twitter.com/jumpstarthr
Facebook: https://www.facebook.com/jumpstarthr
LinkedIn: http://www.linkedin.com/company/jumpstart-hr
Sign up for our newsletter and learn "What HR Can Learn from Steve Jobs.": http://www.eepurl.com/jAbNf
An able supervisor can make or break the performance of a team. A herd of sheep lead by a lion wins, while a pride of lions lead by a sheep fails. The management has to invest in developing their supervisors to excel in their managerial skills. This presentation lists the skills that are required to excel as a supervisor.
Presentation from DCCI Business Institute training on Team Building. The presentation gives salient points on importance and implication of teamwork in workplace, what makes a team effectual, as well barriers to team-building and remedies to that.
Performance Coaching PowerPoint Presentation Slides are designed to showcase performance management process and practices. The performance planning PowerPoint complete deck displays creative and professional looking slides such as performance management program, core performance criteria, performance planning, guidelines, goal setting process types of goals and priorities, performance coaching, employees’ responsibilities, supervisors responsibilities, do’s and don’ts, performance feedback, multiple sources of feedback, feedback forms, performance review and development, performance assessment, ratings, improvement plan, supervisors comments, employee development program, performance management KPIs and dashboard etc. It has professionally designed templates with relevant visuals and subject driven content. Managers can use performance management PPT visuals to align company goals with goals of employees and teams in order to improve the efficiency, productivity, and profitability. Download performance measurement presentation layout to create transparency in the achievement of company goals.
Optimal Consulting Group is a multi-dimensional assessment company in Singapore helps to select and better identification of young talents for your organization. For more details call at 65 65497745.
Pearl Interactive Network's Virtual Insurance Apprenticeship Program provides an opportunity for entry-level insurance employees to progress through a career path in the insurance industry -- receiving on-the-job training while taking online courses toward an insurance certification.
Do you think you get enough feedback about how you can be more effective from your boss?.... Your team probably thinks the same about you.
Receiving good feedback gives you powerful information that can dramatically decreases the time required to master a skill or help you blow down the barriers that prevent you from getting to the next level. If only you knew.
Effective people management can not only influence productivity but also has a direct correlation with morale of employees and their motivation to work harder and smarter
Members of Connect: Professional Women’s Network share advice for effectively delivering the good, bad and ugly.
Connect: Professional Women’s Network is online community with more than 300,000 members that discusses issues relevant to women and their success. The free LinkedIn group powered by Citi also features videos interviews with influential businesswomen, live Q&As with experts and slideshows with career advice. To learn more and join the conversation in the largest women's group on LinkedIn, visit http://www.linkedin.com/womenconnect.
Keeping Employees Engaged In The WorkplaceJumpstart:HR
Jumpstart:HR is your trusted HR Outsourcing and Strategic Counseling partner. We work with your organization as a virtual and on-site service provider to solve your HR challenges, alleviate your burdens and free up your time.
Visit us at http://www.jumpstart-hr.com to learn more about how we can save your organization time and bring about a greater ROI on your Human Capital Management strategy.
Twitter: http://www.twitter.com/jumpstarthr
Facebook: https://www.facebook.com/jumpstarthr
LinkedIn: http://www.linkedin.com/company/jumpstart-hr
Sign up for our newsletter and learn "What HR Can Learn from Steve Jobs.": http://www.eepurl.com/jAbNf
An able supervisor can make or break the performance of a team. A herd of sheep lead by a lion wins, while a pride of lions lead by a sheep fails. The management has to invest in developing their supervisors to excel in their managerial skills. This presentation lists the skills that are required to excel as a supervisor.
Presentation from DCCI Business Institute training on Team Building. The presentation gives salient points on importance and implication of teamwork in workplace, what makes a team effectual, as well barriers to team-building and remedies to that.
Performance Coaching PowerPoint Presentation Slides are designed to showcase performance management process and practices. The performance planning PowerPoint complete deck displays creative and professional looking slides such as performance management program, core performance criteria, performance planning, guidelines, goal setting process types of goals and priorities, performance coaching, employees’ responsibilities, supervisors responsibilities, do’s and don’ts, performance feedback, multiple sources of feedback, feedback forms, performance review and development, performance assessment, ratings, improvement plan, supervisors comments, employee development program, performance management KPIs and dashboard etc. It has professionally designed templates with relevant visuals and subject driven content. Managers can use performance management PPT visuals to align company goals with goals of employees and teams in order to improve the efficiency, productivity, and profitability. Download performance measurement presentation layout to create transparency in the achievement of company goals.
Optimal Consulting Group is a multi-dimensional assessment company in Singapore helps to select and better identification of young talents for your organization. For more details call at 65 65497745.
Pearl Interactive Network's Virtual Insurance Apprenticeship Program provides an opportunity for entry-level insurance employees to progress through a career path in the insurance industry -- receiving on-the-job training while taking online courses toward an insurance certification.
A Simple Guide to the Item Response Theory (IRT) and Rasch ModelingOpenThink Labs
This document, which is a practical introduction to Item Response Theory (IRT) and Rasch modeling, is
composed of five parts:
I. Item calibration and ability estimation
II. Item Characteristic Curve in one to three parameter models
III. Item Information Function and Test Information Function
IV. Item-Person Map
V. Misfit
Effective Implementation of Psychometrics in Talent Acquisition and Management The HR Observer
Ever bring on a new employee, only to realise by the end of the first week that this new hire was a huge mistake? Every organisation is unique and has a DNA of its own. To build great teams, you must hire the right talent and make sure you manage and nurture this talent to its fullest potential. This journey begins with the “Job fit” concept which is critical to ensure maximum productivity, employee motivation and job satisfaction. You will learn how to select the right assessment tool and ensure effective integration of psychometrics into your recruitment process.
Oussama Mansour, CEO, Profiles International
Best Practices in Recruiting Today - High-Impact Talent AcquisitionJosh Bersin
Preliminary findings for Bersin by Deloitte 2013 High-Impact Talent Acquisition research. What drives business impact in corporate recruiting today? What are the top practices to focus on? Presented at iRecruit conference June 2013.
Here are my slides for my report for my Advanced Measurements and Evaluation subject on Educational Measurement and Evaluation. #Polytechnic University of the Philippines. #GraduateSchool
Human Resource Policies and Practices, Chapter 18, Organizational BehaviorDr.Amrinder Singh
Human Resource Policies and Practices, Chapter 18-Organizational Behavior
This PPT is based on the Organizational Behavior Book Written By Stephen P. Robbins & Timothy A. Judge, Edition -12th, Publisher Pearson
Reconstructing Grit: Potential for maladaptivity and the role of self-efficacyOPRA Psychology Group
Paper presented by Yong Jia Yin and Dr Paul Englert during the 9th Aotearoa New Zealand Organisational Psychology and Organisational Behaviour Conference on 27 November, 2020.
Positive illusion has been postulated to contribute to mental well-being, the ability to care and the capacity for productive and creative work. Proponents of positive illusions maintain that mild, and not delusional, levels of distortion are essential for mental health and do not detract from adaptive behaviours bound to objective reality. Opponents note that a distorted appraisal of reality and negative events could lead to misjudgment, risk-taking action, and perhaps longer-term negative consequences. Inline with more contemporary approaches to well-being, such as acceptance and mindfulness, we will propose a theoretical framework to establish appropriate parameters between actual reality vs. realistic appraisal. Moreover, we will argue that the missing link in the well-being research is the external and holistic measurement of optimal functioning; a dependent variable that psychology has tended to steer omit. We contend that while positive illusion contributes to mental health, an illusion-free appraisal can contribute to further well-being through courageous objectivity, and growth mindsets resulting in closer alignment to models of fully-functioning, measured by both external and internal criteria. This was presented at the 2016 International Conference on Well-being in Singapore.
OPRA’s Managing Psychologist, Ben Hainsworth, represents a thought leader in Safety Psychological Profiling and presented findings of a 3 year Longitudinal Study at the 2015 Australian Psychological Society’s 11th Industrial and Organisational Psychology Conference. The research conducted with Australia’s oldest Apprenticeship Training company, Hunter Valley Training Company, highlighted the value of best practice psychometric assessments and the resulting impact on reducing injuries and associated insurance costs.
Dr Stephen Williams was one of the true pioneers in the area of occupational stress diagnostics and stress management. OPRA began our relationship with Dr Williams back in the late 1990’s and this continued up to his unfortunate passing in the mid 2000’s. During this time Dr. Williams did many presentations across our regions discussing the benefits of a proactive approach to managing stress at work. The following is a key note address on the topic that he gave at the 2003 HRINZ Conference: Releasing individual potential through employee wellbeing.
Assumptions in I/O Psych to be tested: A blue print for progressing the disci...OPRA Psychology Group
OPRA is a proud team of organisational psychologists. Our acronym stands for Occupational Psychology Research Associates.
Being true to our field, we admit both the strengths and limitations of our discipline. The following presentation, from 2007, discusses some of the common half truths that are permeated within our field.
Only by understanding the limitations of psychology will its true benefit to business be realized. This remains the goal of the OPRA Group.
EI is at the heart of job performance. This presentation discusses research indicating the link and how you can use EI to maximise organisational success.
For many organisations employee career development and career coaching is a missing component of their L&D strategy. The following SlideShare, presented in 2005, discusses the commercial driver for internal career coaching and some steps that can be taken to increase its effectiveness. In a world where the nature of work is changing daily, these lessons are more pertinent than ever.
Due to skill-shortages the world is in a war for talent. Companies and countries alike want to attract, develop and keep the most talented individuals. This is a trend OPRA first commented on back in 2007. While the situation has only gotten worse since then, the messages in this presentation are as poignant as ever.
Surveying has long been a core arm of OPRA’s offering. Whether it be standardised surveys of culture such as the Denison, or bespoke 360 and stakeholder surveys, OPRA have a solution. The following SlideShare builds on over 15 years of survey experience, discussing the benefits of organisational surveying as well as how to make your organisational surveys a success.
In the age of big data, it has become mandatory for strategic HR professionals to have strong qualiitative skills. The following presentation conducted in 2004, predicted this shift and outlined why and how HR can stay ahead of the data revolution.
Competencies are a common part of HR language but do they have measurable qualities? In this presentation from 2005, Dr Paul Englert, discusses competencies and their more rigorous precursor job analysis. The presentation poses the following question, ‘Are competencies a bit of a con?’
Integrity testing is a current hot topic in HR. However, the idea of understanding and eliminating deviant behaviour in the workplace is certainly nothing new. This SlideShare discusses the research in the area and measures that can be taken to minimize counterproductive workplace behaviour.
An examination of the evidence supporting the idea that people may make up for lower cognitive ability by being more conscientious. This presentation, covering research in 2009, looks at the two different paths people can take to being high performers.
The Staffing Equation: Strategies to Address Key Workforce Risks and Close th...OPRA Psychology Group
Delivered by Dr Paul Wood (Head trainer at OPRA in New Zealand at the time) at the CIO Summit in New Zealand in 2010, this presentation discusses the strategy to attract and retain the most talented and valuable staff, who are incidentally the most mobile in a competitive market. The strategic use of technology and tools in selection was relevant then, remains so today, and continues to be part of OPRA’s approach to empowering our clients in their talent management.
OPRA Develop was launched in 2008 to meet the demand for evidence-based development courses for progressive companies. OPRA Develop comprises of 5 key programmes, with this presentation an introduction to the now acclaimed Healthy Thinking Programme.
The OPRA Group have been working with GENOS on Emotional Intelligence (EI) since the early 2000s. This gives us a unique perspective on how EI theory has developed and been applied to maximise organisational success.
The following presentation discusses the basics, and basis, of the GENOS model of EI. This is now the foundation of the award winning leadership programmes offered by OPRA.
A step-by-step guide to best practice selection methodology. This presentation, given in the late 90's across New Zealand, is still relevant nearly 20 years on.
An overview of part of the OPRA Develop programme. Self-esteem is one of the non-negotiables to performing to the best of your ability. Nathaniel Branden's seminal work is as relevant today as it was when first released in the late 60's. We hope you enjoy this brief overview.
3. • ACs involve the participation of [often] a group of candidates in multiple exercises,
who are observed and rated by a team of trained assessors on a predetermined
task related behaviours and/or dimensions (Ballantyne & Povah, 1995)
• They often include supplementary psychometric tests in the hope of adding
incremental validity
• E.g., personality, cognitive ability
• I will focus on the simulation component
Assessment Centres Defined
4. Debate has raged about ACs since 1982
Issues akin to the notion of adding apples and oranges
A Measurement Issue
5. Assessment Centres
• Participants in ACs receive overall scores, based on trait-measures
(called dimensions)
• When factor analysed, we find that measure of the same dimension
(e.g., tolerance) do not fit together well
6. Simple Example
• Mechanic’s position
• Three different exercises
• Three dimensions
• Communication
• Persistence
• Tolerance
7. Simple Example
Group Exercise
Communication = 5
Persistence = 5
Tolerance = 5
Work Sample
Communication = 1
Persistence = 1
Tolerance = 1
Inspection Report
Communication = 3
Persistence = 3
Tolerance = 3
8. Multitrait-Multimethod Problem
• We often find that correlations across the same dimension are
moderate (monotrait-heteromethod)
• And correlations among different dimensions within exercises are
strong (heterotrait-monomethod)
9. Dimension as Traits
• Note that the aim in traditional ACs is to measure dimensions as
though they are stable traits
• That is, they are treated as characteristics that will be more or less
stable across situations
10. An AC from practice
• Entry-level customer service role
• AC used for employee selection
• 208 job applicants
• Team of trained assessors who were experienced on the focal job
11. Steps in an AC Approach
Behavioral
Responses to
Exercises
Overall
Assessment
Ratings
Underlying
Trait-Based
Dimensions
Step 1
Using behavioural
observations and ideally
classifying these into
behavioural checklists
Step 2
Inferring trait-based
variables from
behavioural data gained
at step 1
Step 3
Pooling information
from step 2 either
statistically or by
discussion
Figure 1. Assessment Steps, Chronoligically, During an Assessment Center
12. Example from a Real AC
• Three exercises
• Group discussion/problem solving format
1. Approaching customers (Ex 1)
2. Closing Sales (Ex 2)
3. Returning Goods (Ex 3)
Note: Each exercise had an associated 10-Item behavioural checklist All variables were
scored on a 1-6 scale.
13. Example from a Real AC
• Five Dimensions
1. Comprehension (D1)
2. Oral expression (D2)
3. Tolerance (D3)
4. Teamwork (D4)
5. Customer focus (D5)
14.
15. Which resulted in factor analyses
(and confirmatory factor analyses)
that look like…
16. This is a well known effect: The exercise effect
• See Lance et al. (2004, JAP) and Jackson, et
al. (2005, HP).
• The question remains: If ACs don’t measure
what they should, then why are they
predictive?
17. Note
In personality theory, exercise effects are thought of as
indicating:
• Halo effects
• Method- related error
The traditional and prevailing view is that exercise effects
are similarly indicative of error in ACs
• Strikes me as slightly odd and mysterious, given, at their heart,
they are behavioural measures …
19. Overall Assessment Ratings (OARs)
• Often it is OARs that are used to predict performance
• No known research has looked at the inside workings of OARs
21. Steps in an AC Approach
Behavioral
Responses to
Exercises
Overall
Assessment
Ratings
Underlying
Trait-Based
Dimensions
Step 1
Using behavioural
observations and ideally
classifying these into
behavioural checklists
Step 2
Inferring trait-based
variables from
behavioural data gained
at step 1
Step 3
Pooling information
from step 2 either
statistically or by
discussion
Figure 1. Assessment Steps, Chronologically, During an Assessment Center
22. What do OARs reflect?
• We know about exercise effects
• Could OARs simply reflect behavioural
performance?
23. What is the relationship between Step 1
and Step 3?
Behavioral
Responses to
Exercises
Overall
Assessment
Ratings
Underlying
Trait-Based
Dimensions
Step 1
Using behavioural
observations and ideally
classifying these into
behavioural checklists
Step 2
Inferring trait-based
variables from
behavioural data gained
at step 1
Step 3
Pooling information
from step 2 either
statistically or by
discussion
Figure 1. Assessment Steps, Chronologically, During an Assessment Center
24. • Or put another way, how much variation in
dimension-based OARs can be explained by
behavioural checklist scores?
• These OARs are supposed to be based on dimension
assessments across exercises
• In this case, the OAR was based on an integration
discussion
26. MLR
• IVs = Average scores on three
behavioural checklists
• DV = Dimension-based OAR
• Adjusted R2 = .90
• ß(Ex1) = .37
• ß(Ex2) = .31
• ß(Ex3) = .51
Note: All coefficients p < .001
27. HUH????? .90?????
• I mean, you would expect some shared
variance, but 90%?
• I couldn’t believe the relationship could be
that strong!
28. How about r ?
•What is the simple correlation between:
1. Average ratings across the three
behavioural checklists (x) and…
2. Discussion-based OARs (y)
33. Implications for practice 1
No matter how we try to transpose AC ratings into dimension
categories, we cannot escape a behavioural assessment that is
specific to exercises
• Which implies …
34. Implications for practice 2
Categorising behavioural information from ACs into
dimension categories is possibly misleading and a
waste of time
37. On that note
• Worked with Dr. Duncan Jackson
• Correlation between scores on a behavioural DC and work performance (N
= 106)
• Uncorrected correlation of .42
• When corrected for attenuation due to unreliability and range restriction, the
estimated correlation was .52
• Meta-analyses of traditional ACs/DCs report corrected correlations of around .36 or
.37
39. Implications for practice 3
That assessor discussions may not add value to the information obtained
from ACs
• This adds to a growing body of literature specific to ACs, but also in other areas of
psychology, e.g.,
• White, Michael J.; Spengler, Paul M.; Maugherman, Alan S.; Anderson, Linda A.; Cook, Robert S.;
Nichols, Cassandra N.; Lampropoulos, Georgios K.; Walker, Blain S.; Cohen, Genna; Rush, Jeffrey
D.(May, 2006) The Meta - Analysis of Clinical Judgment Project: Fifty -Six Years of Accumulated
Research on Clinical Versus Statistical Prediction Stefanía Ægisdóttir. Counseling Psychologist ,
vol. 34, no. 3, pp. 341-382.
• I think you guys need another author or two…
40. Questions
• The MTMM problem implies that AC dimensions
are treated like traits.
• Should we focus on behavioural checklists and do
away with the trait inferences?
• Do we need to encourage trait-like assessment in
ACs?
• Are companies opening themselves up to legal
challenges?
• Does this suggest a wider problem about the use of
competencies in HRM!!?
41. Are we doing the right thing?
• I do not believe that current practice,
in this regard, is best practice
• I also believe that it’s up to
practitioners to take action
42. Light Reading:
Jackson, D. J. R., Stillman, J. A., & Atkins, S. G. (2005). Rating tasks versus
dimensions in assessment centers: A psychometric comparison. Human
Performance, 18, 213-241.
Jackson, D. J. R., Barney, A. R., Stillman, J. A., & Kirkley, W. (in press). When traits
are behaviors : The relationship between behavioral responses and trait-based
overall assessment center ratings. Human Performance.
Lance, C. E. (in press). Why assessment centers don't work the way they're
supposed to. InteractI/On.
Stillman, J. & Jackson, D. J. R. (2005). A detection theory approach to the evaluation
of assessors in assessment centres. Journal of Occupational and Organizational
Psychology, 78, 581-594.