Your SlideShare is downloading. ×
CONNECT 13 - Calibration Process
Upcoming SlideShare
Loading in...5

Thanks for flagging this SlideShare!

Oops! An error has occurred.


Saving this for later?

Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime - even offline.

Text the download link to your phone

Standard text messaging rates apply

CONNECT 13 - Calibration Process


Published on

This session presents best practices in calibration and scoring. Learn answers to “How often should I calibrate?" and "Who should be included in my calibration meeting?” Learn why calibration is vital …

This session presents best practices in calibration and scoring. Learn answers to “How often should I calibrate?" and "Who should be included in my calibration meeting?” Learn why calibration is vital to quality assurance, the importance of creating a QSDD document, identifying when calibration is needed, the process for establishing a calibration practice, best practices for conducting calibration sessions and answers to common questions about calibration frequency, ownership of the process and measuring effectiveness!

Published in: Technology, Business

  • Be the first to comment

  • Be the first to like this

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

No notes for slide


  • 1. | Calibration Process Lou Cockerham Education Specialist
  • 2. Call Calibration • A process designed to ensure consistent evaluation of same call across two or more people • A tool for reducing the number of quality evaluation challenges/disputes within your organization • Maintains the internal integrity of the quality evaluation process
  • 3. Benefits • Agent – Fairness, regardless of who completes evaluation – Consistency in scoring, especially when QA assignments rotate – Developmental tool • Supervisor – Ease of coaching scored evaluations – Shows consistency in scoring – Measures everyone in same fashion • Manager – Maintains integrity of QA department – Reinforces quality culture – Identification of knowledge gaps
  • 4. Before You Calibrate • Before starting calibration process, check – Is your Quality Evaluation Form in place? – QSDD (Quality Standards Definition Document)? – Training on QA form and QSDD for anyone involved in evaluation process?
  • 5. Calibration Process • Decision Points – How often should you calibrate? – Who should facilitate sessions? – Who owns calibration process? – How should calls be selected for calibration? – Who owns change process for materials needing updates due to calibration – QSDD and QA Form? – How measure effectiveness of calibrating?
  • 6. How Often Calibrate? • Recommendations – Weekly at initial rollout – Bi-weekly once Standard Deviation goal is met • Factors that influence change in calibration frequency – Changes in business – Updates to QA form – Updates to QSDD – New staff – PTO
  • 7. Who Facilitates Sessions? • Facilitators are not responsible for decisions • Facilitators are responsible for enabling process • Facilitators handle – Logistics (where, when, and for how long you are meeting) – Booking rooms – Setting up technology – Sending out the e-mail with the record IDs to be calibrated on • Facilitators keep group on track and on target • Facilitators have leadership and facilitation skills • Facilitator role may be filled on a rotating basis
  • 8. Who Owns Calibration Process? • Calibration process owner needs – Project management skill – Delegation skill – Authority to enforce session attendance – Communication skill to report results and issues
  • 9. How Select Calls to Calibrate? • Calls selected for calibration may be – Nominated – Randomly selected • Nominated calls must have Record ID and justification e- mailed to facilitator prior to session • Calls randomly selected should use multi-step filter, randomizer option, with other selection criteria, to generate batch of calls as basis for calibration
  • 10. Who Owns Change Process? • Will you need management approval to make changes? • How will updates be communicated to team? – Agents – Supervisors – Managers • Who will update QSDD and QA forms? • Where does the ‗buck‘ stop?
  • 11. How Measure Effectiveness? • Set your standard deviation goal • Compile results of sessions • Track progress toward goal • Present results during sessions and in management meetings • Adjust standard deviation goal as appropriate
  • 12. Calibration Participants • Who should be included? – QA staff – Supervisors (staff representative if supervisors not scoring) – Management – Agents • Pros of agents in sessions – Inputs from front line – Reduces ―Us‖ versus ―Them‖ feeling – Personal development • Cons of agents in sessions – Potential confidentiality issues – Takes agents away from working calls
  • 13. Calibration Recommendations • Session length should be one hour • Group size: four minimum and 15 maximum participants • If agents participating, get their permission share their calls • Calibrate departments separately • Calibrate different locations separately frequently and collectively quarterly
  • 14. Calculating Standard Deviation • Steps 1. Calculate average of all evaluation scores 2. Subtract average from each score – some will be negative 3. Square each number and add them together 4. Divide total by number of evaluations 5. Take square root of that number, which is your Standard Deviation
  • 15. 15 • Let Excel help – Enter evaluation score – Enter formula = STDEVP Calculating Standard Deviation
  • 16. Recommended Standard Deviation • SD = 5 – Great starting point if center is new to QA • SD = 3 – Most contact centers • SD = 2 – Contact centers considered very well calibrated
  • 17. Before Conducting Sessions • Create duplicate of your live scoring form in Discover, name it CALIBRATION – use version numbering scheme • Select calls for calibration and send ID numbers to participants two days prior to session • Participants should score selected calls on CALIBRATION forms prior to session
  • 18. Conducting Calibration Sessions • Establish ground rules • Maintain confidentiality – especially important to enforce if agents are included in the process • Listen without reacting • Focus on how it should be, not on being right • Allow others a chance to have their say
  • 19. Conducting Calibration Sessions • Review calibration goals – Review results from prior session – Review progress toward SD goal
  • 20. Conducting Calibration Sessions • Replay first call – Share no reactions—physical or verbal – Score on paper in actual session • Ok to have differences in paper and digital forms – Identify differences between paper and digital versions
  • 21. Conducting Calibration Sessions • Gather feedback from group – Positive – Areas for improvement – Ideal situation • Facilitator must keep feedback moving and focused – Ensure everyone expresses their views
  • 22. Conducting Calibration Sessions • Review QSDD – Make sure definitions are accurate and describe how to best evaluate – Make note of any potential changes or additions • Who is responsible for making these changes?
  • 23. Conducting Calibration Sessions • Repeat for the next call(s) – Replay call – Review scores – Provide feedback – Validate definitions • Process drives group‘s calibration and success in reaching SD goal
  • 24. Conducting Calibration Sessions • Leader uses Discover‘s reporting tools to explore and validate calibration group‘s experiences
  • 25. Conducting Calibration Sessions
  • 26. Conducting Calibration Sessions • Recap and close – Identify action items and their owners – Communicate and apply updates to process – Schedule next session – Assign dedicated facilitator as necessary