CBT @ Selor
Past, present & future
  EPSO Seminar 19 October 2012
AGENDA
Intro: Testing @ Selor
1. History
2. Present
        Selor Screening Model
        Testing Process
        Portfolio
3. Future Innovations
4. Selor Centre of Expertise
1. INTRO: TESTING @ SELOR




What some people think we     What some candidates think       What society & media
          do                           we do                       think we do




        What some clients think we do                  What we actually do
History
2. HISTORY




                                      CBT (Selor
                                      screening
                                      model)
                        CBT
                        (competency
                        management)

       Knowledge
       (paper/pencil)
1. HISTORY


             First PC-testing:
             early 90ies


                Mass exams


                Knowledge
                based


             Paper & pencil
1. HISTORY



             2004 - 2011


               Competency
               based


               Full CBT


             Function based
1. HISTORY



             2011 - …


               Competency
               based


               CBT


             Screening model
Present
SELOR SCREENING MODEL
2. PRESENT: SCREENING MODEL
2. PRESENT: SCREENING MODEL


       Module            Module        Module
         0                 1             2


                          Generic      Specific
       Entry ticket or   Screening    Screening
      degree/diploma
                            PC       PC/interview
2. PRESENT: SCREENING MODEL


      Module           Module           Module
        0                1                2


         “Basic competencies and cognitive
       abilities proven by a degree of a certain
        level or the equivalent of the degree”
2. PRESENT: SCREENING MODEL


      Module          Module          Module
        0               1               2


       “Generic competencies and cognitive
         abilities equivalent to the level of
                     functioning””
2. PRESENT: SCREENING MODEL


      Module           Module           Module
        0                1                2


          “Specific abilities, fit, motivation,
       experience, competencies, knowledge
            necessary for the function”
2. PRESENT: SCREENING MODEL



      Module        Module        Module
        0             1             2

       Exemption     Exemption
                                     No
      Development   Development   exemption
         Buffer        Buffer

                                  Ranking




       Pass/Fail     Pass/Fail
Present
TESTING PROCESS
2. PRESENT: TESTING PROCESS
                                Levels: D  A5
            Competencies
Information
Management


Task
Management


People
Management


Interpersonal
Management


Personal
Management

                           f.i. File Manager     f.i. Teamleader
2. PRESENT: TESTING PROCESS




                              File Manager:
                              Level C
2. PRESENT: TESTING PROCESS




                              Job description
2. PRESENT: TESTING PROCESS
                     Overview of the requirements for the job




                           Competencies: generic
                           and technical




                           Other requirements:
                           degree and if necessary
                           for the job: job experience
2. PRESENT: TESTING PROCESS
                     Overview of the selection procedure




                             First step: computer-
                             based tests




                            Second step: interview
2. PRESENT: TESTING PROCESS

 Client has a vacancy: A2 Teamleader (IT development)

 Selor and client determine based on the function
 description:
   • Profile
           • Competencies
           • Degree
           • Experience
   • Testing procedure
2. PRESENT: TESTING PROCESS
                                                Manager A2
    Information               Task                    People                Interpersonal             Personal
    Management             Management               Management              Management               Management
     Understanding          Executing tasks             Sharing               Communicating      *    Showing respect
      information                                    knowledge and
                                                       know-how
         Treating           Structuring tasks          Supporting             Active Listening   *       Adapting
       information
x       Analysing      x    Problem solving           Managing        K         Teamwork         K       Showing
       information                                    employees                                         reliability
X      Integrating     X    Decision taking           Motivating      K         Acting in a      *       Showing
       information                                    employees              service-oriented          commitment
                                                                                 manner
       Innovating              Organising       X     Developing      X          Advising        *    Managing stress
                                                       employees
     Conceptualising         Managing the            Building teams   ///       Influencing      K      Developing
                                service                                                                   oneself
      Insight in the         Managing the            Leading teams             Establishing      K       Achieving
       organisation           organisation                                     relationships             objectives
      Developing a           Controlling the           Inspiring                Networking                Showing
          vision              organisation                                                             organizational
                                                                                                        commitment
2. PRESENT: TESTING PROCESS
     Competencies            Module 0   Module 1   Case   Interview
Integrating information         X          X
Decision taking                 X          X        X

Developing employees                                         X
Acting service-oriented                    X                 X

Advising                                            X

Influencing                                         X

Developing oneself                         X
Achieving objectives                       X                 X

Oral communication                                           X

Technical competencies (IT                          X
Projectmanagement, JAVA,
.NET,…)
2. PRESENT: TESTING PROCESS
 Generic part (module 0 and 1) of the selection
 procedure, computer-based tests evaluating:
   •   Abstract reasoning
   •   Information management
   •   Task management
   •   Key competencies: Teamwork, Acting in a service-
       oriented manner, Showing reliability, Developing
       oneself, Achieving objectives

 Specific part (module 2) of the selection
  procedure, all sorts of testing methods of our test
  portfolio

 For each level a set of tests that corresponds to the
  difficulty and competencies of each level
2. PRESENT: TESTING PROCESS
                   CANDIDATE ONLINE SUBSCRIPTION




                              PHASE 1

        PC-check                         Diploma / Experience / Exemption


                              PHASE 2
                                                                            Competition
      Quality check                 Q check Diploma / Q-check Experience    Closing Date


                              GENERIC
                                                                              + 8 days
       Module 0/1                                   On-going


                              SPECIFIC

     Module 2.1 / 2.2



                        RESERVE LIST  CLIENT
Uniformity
Efficiency
            Teamwork

Acting in a service-oriented manner

        Showing reliability

        Developing oneself

        Achieving objectives


                               PC-Testing
Efficiency
Ongoing module 0 + 1
Present
PORTFOLIO
2. PRESENT: PORTFOLIO
2. PRESENT: PORTFOLIO
 Generic part (module 0 and 1) of the selection
 procedure, computer-based tests evaluating:
   •   Abstract reasoning
   •   Information management
   •   Task management
   •   Key competencies: Teamwork, Acting in a service-
       oriented manner, Showing reliability, Developing
       oneself, Achieving objectives

 Specific part (module 2) of the selection
  procedure, all sorts of testing methods of our test
  portfolio

 For each level a set of tests that corresponds to the
  difficulty and competencies of each level
2. PRESENT: PORTFOLIO




    SJT         SJT
    ABS        PCIB     EVENT   EVENT
                          1       2
                ABS
                         PC     INTERVIEW
e.g. A-LEVEL: SJT + ABS
 Information          Task              People          Interpersonal       Personal
 Management        Management         Management        Management         Management

Understanding     Executing tasks        Sharing       Communicating      Showing respect
 information                          knowledge and
                                        know-how
     Treating     Structuring tasks    Supporting      Active Listening      Adapting
  information
    Analysing     Problem solving      Managing          Teamwork           Showing
  information                          employees                            reliability
   Integrating    Decision taking      Motivating         Acting in a        Showing
  information                          employees       service-oriented    commitment
                                                           manner
  Innovating        Organising         Developing          Advising       Managing stress
                                       employees
Conceptualising    Managing the       Building teams     Influencing        Developing
                      service                                                 oneself
 Insight in the    Managing the       Leading teams      Establishing        Achieving
 organisation       organisation                         relationships       objectives
 Developing a      Controlling the      Inspiring         Networking          Showing
     vision         organisation                                           organizational
                                                                            commitment


Abstract Reasoning (ABS)
e.g. A-LEVEL: SJT + ABS + PCIB
 Information          Task              People          Interpersonal       Personal
 Management        Management         Management        Management         Management

Understanding     Executing tasks        Sharing       Communicating      Showing respect
 information                          knowledge and
                                        know-how
     Treating     Structuring tasks    Supporting      Active Listening      Adapting
  information
    Analysing     Problem solving      Managing          Teamwork           Showing
  information                          employees                            reliability
   Integrating    Decision taking      Motivating         Acting in a        Showing
  information                          employees       service-oriented    commitment
                                                           manner
  Innovating        Organising         Developing          Advising       Managing stress
                                       employees
Conceptualising    Managing the       Building teams     Influencing        Developing
                      service                                                 oneself
 Insight in the    Managing the       Leading teams      Establishing        Achieving
 organisation       organisation                         relationships       objectives
 Developing a      Controlling the      Inspiring         Networking          Showing
     vision         organisation                                           organizational
                                                                            commitment


Abstract Reasoning (ABS)
&
ABS: Abstract Reasoning
ABS: Abstract Reasoning
ABS: Abstract Reasoning
PCIB: Computer-based in tray excercice
PCIB: Computer-based in tray excercice
SJT: Situational Judgement Test
SJT: Situational Judgement Test
SJT: Situational Judgement Test
EVENT   EVENT
  1       2
Module 2: testportfolio



              Abilities                 Personality



                          Measurement
                           objective



       Technical competencies    Generic competencies
Module 2: testportfolio
Future Innovations
3. FUTURE INNOVATIONS

          Decentralization of testing

 SELOR              CLIENTS             @ HOME




         CERTIFICATION! 100% DIGITAL!
3. FUTURE INNOVATIONS




    Q1   Q2   Q3
              ?
         ?
              ?
     ?
              ?
         ?
              ?
                           VIDEO BASED
  ADAPTIVE TESTING      (some tests already
     ITEM BANK              developed)
                         SERIOUS GAMING
3. FUTURE INNOVATIONS

 Full web accessibility for people with disabilities




        SELOR CENTRE OF EXPERTISE
Selor Centre of
  Expertise
Centre of Expertise
Diversity      Research

  Screening     Rekrutering


   Test-Communicatie
                  Screenings-
  Screeningsmethodologie
       Testontwikkeling
           Diversiteit
           Expertise
ontwikkeling     methodologie
                 Rekruterings-
                 product
                    Selor
   Expertise     op maat
                  Academy
Communicatie       Andere
   Employer branding
CONTACT

                   Vincent Van Malderen
          Product manager Centre of Expertise Selor


                   www.selor.be (B2B)


                   vincent.vanmalderen@selor.be


                   02/788.66.52

                   @vincentvm


                   http://be.linkedin.com/in/vincentvanmalderen

Computer Based Testing at Selor

  • 1.
    CBT @ Selor Past,present & future EPSO Seminar 19 October 2012
  • 2.
    AGENDA Intro: Testing @Selor 1. History 2. Present Selor Screening Model Testing Process Portfolio 3. Future Innovations 4. Selor Centre of Expertise
  • 3.
    1. INTRO: TESTING@ SELOR What some people think we What some candidates think What society & media do we do think we do What some clients think we do What we actually do
  • 4.
  • 5.
    2. HISTORY CBT (Selor screening model) CBT (competency management) Knowledge (paper/pencil)
  • 6.
    1. HISTORY First PC-testing: early 90ies Mass exams Knowledge based Paper & pencil
  • 7.
    1. HISTORY 2004 - 2011 Competency based Full CBT Function based
  • 8.
    1. HISTORY 2011 - … Competency based CBT Screening model
  • 9.
  • 10.
  • 11.
    2. PRESENT: SCREENINGMODEL Module Module Module 0 1 2 Generic Specific Entry ticket or Screening Screening degree/diploma PC PC/interview
  • 12.
    2. PRESENT: SCREENINGMODEL Module Module Module 0 1 2 “Basic competencies and cognitive abilities proven by a degree of a certain level or the equivalent of the degree”
  • 13.
    2. PRESENT: SCREENINGMODEL Module Module Module 0 1 2 “Generic competencies and cognitive abilities equivalent to the level of functioning””
  • 14.
    2. PRESENT: SCREENINGMODEL Module Module Module 0 1 2 “Specific abilities, fit, motivation, experience, competencies, knowledge necessary for the function”
  • 15.
    2. PRESENT: SCREENINGMODEL Module Module Module 0 1 2 Exemption Exemption No Development Development exemption Buffer Buffer Ranking Pass/Fail Pass/Fail
  • 16.
  • 17.
    2. PRESENT: TESTINGPROCESS Levels: D  A5 Competencies Information Management Task Management People Management Interpersonal Management Personal Management f.i. File Manager f.i. Teamleader
  • 18.
    2. PRESENT: TESTINGPROCESS File Manager: Level C
  • 19.
    2. PRESENT: TESTINGPROCESS Job description
  • 20.
    2. PRESENT: TESTINGPROCESS Overview of the requirements for the job Competencies: generic and technical Other requirements: degree and if necessary for the job: job experience
  • 21.
    2. PRESENT: TESTINGPROCESS Overview of the selection procedure First step: computer- based tests Second step: interview
  • 22.
    2. PRESENT: TESTINGPROCESS Client has a vacancy: A2 Teamleader (IT development) Selor and client determine based on the function description: • Profile • Competencies • Degree • Experience • Testing procedure
  • 23.
    2. PRESENT: TESTINGPROCESS Manager A2 Information Task People Interpersonal Personal Management Management Management Management Management Understanding Executing tasks Sharing Communicating * Showing respect information knowledge and know-how Treating Structuring tasks Supporting Active Listening * Adapting information x Analysing x Problem solving Managing K Teamwork K Showing information employees reliability X Integrating X Decision taking Motivating K Acting in a * Showing information employees service-oriented commitment manner Innovating Organising X Developing X Advising * Managing stress employees Conceptualising Managing the Building teams /// Influencing K Developing service oneself Insight in the Managing the Leading teams Establishing K Achieving organisation organisation relationships objectives Developing a Controlling the Inspiring Networking Showing vision organisation organizational commitment
  • 24.
    2. PRESENT: TESTINGPROCESS Competencies Module 0 Module 1 Case Interview Integrating information X X Decision taking X X X Developing employees X Acting service-oriented X X Advising X Influencing X Developing oneself X Achieving objectives X X Oral communication X Technical competencies (IT X Projectmanagement, JAVA, .NET,…)
  • 25.
    2. PRESENT: TESTINGPROCESS Generic part (module 0 and 1) of the selection procedure, computer-based tests evaluating: • Abstract reasoning • Information management • Task management • Key competencies: Teamwork, Acting in a service- oriented manner, Showing reliability, Developing oneself, Achieving objectives Specific part (module 2) of the selection procedure, all sorts of testing methods of our test portfolio For each level a set of tests that corresponds to the difficulty and competencies of each level
  • 26.
    2. PRESENT: TESTINGPROCESS CANDIDATE ONLINE SUBSCRIPTION PHASE 1 PC-check Diploma / Experience / Exemption PHASE 2 Competition Quality check Q check Diploma / Q-check Experience Closing Date GENERIC + 8 days Module 0/1 On-going SPECIFIC Module 2.1 / 2.2 RESERVE LIST  CLIENT
  • 27.
  • 28.
    Efficiency Teamwork Acting in a service-oriented manner Showing reliability Developing oneself Achieving objectives PC-Testing
  • 29.
  • 30.
  • 31.
  • 32.
    2. PRESENT: PORTFOLIO Generic part (module 0 and 1) of the selection procedure, computer-based tests evaluating: • Abstract reasoning • Information management • Task management • Key competencies: Teamwork, Acting in a service- oriented manner, Showing reliability, Developing oneself, Achieving objectives Specific part (module 2) of the selection procedure, all sorts of testing methods of our test portfolio For each level a set of tests that corresponds to the difficulty and competencies of each level
  • 33.
    2. PRESENT: PORTFOLIO SJT SJT ABS PCIB EVENT EVENT 1 2 ABS PC INTERVIEW
  • 34.
    e.g. A-LEVEL: SJT+ ABS Information Task People Interpersonal Personal Management Management Management Management Management Understanding Executing tasks Sharing Communicating Showing respect information knowledge and know-how Treating Structuring tasks Supporting Active Listening Adapting information Analysing Problem solving Managing Teamwork Showing information employees reliability Integrating Decision taking Motivating Acting in a Showing information employees service-oriented commitment manner Innovating Organising Developing Advising Managing stress employees Conceptualising Managing the Building teams Influencing Developing service oneself Insight in the Managing the Leading teams Establishing Achieving organisation organisation relationships objectives Developing a Controlling the Inspiring Networking Showing vision organisation organizational commitment Abstract Reasoning (ABS)
  • 35.
    e.g. A-LEVEL: SJT+ ABS + PCIB Information Task People Interpersonal Personal Management Management Management Management Management Understanding Executing tasks Sharing Communicating Showing respect information knowledge and know-how Treating Structuring tasks Supporting Active Listening Adapting information Analysing Problem solving Managing Teamwork Showing information employees reliability Integrating Decision taking Motivating Acting in a Showing information employees service-oriented commitment manner Innovating Organising Developing Advising Managing stress employees Conceptualising Managing the Building teams Influencing Developing service oneself Insight in the Managing the Leading teams Establishing Achieving organisation organisation relationships objectives Developing a Controlling the Inspiring Networking Showing vision organisation organizational commitment Abstract Reasoning (ABS)
  • 36.
  • 37.
  • 38.
  • 39.
  • 40.
  • 41.
  • 42.
  • 43.
  • 44.
  • 45.
    EVENT EVENT 1 2
  • 46.
    Module 2: testportfolio Abilities Personality Measurement objective Technical competencies Generic competencies
  • 47.
  • 48.
  • 50.
    3. FUTURE INNOVATIONS Decentralization of testing SELOR CLIENTS @ HOME CERTIFICATION! 100% DIGITAL!
  • 51.
    3. FUTURE INNOVATIONS Q1 Q2 Q3 ? ? ? ? ? ? ? VIDEO BASED ADAPTIVE TESTING (some tests already ITEM BANK developed) SERIOUS GAMING
  • 52.
    3. FUTURE INNOVATIONS Full web accessibility for people with disabilities SELOR CENTRE OF EXPERTISE
  • 53.
  • 54.
  • 56.
    Diversity Research Screening Rekrutering Test-Communicatie Screenings- Screeningsmethodologie Testontwikkeling Diversiteit Expertise ontwikkeling methodologie Rekruterings- product Selor Expertise op maat Academy Communicatie Andere Employer branding
  • 57.
    CONTACT Vincent Van Malderen Product manager Centre of Expertise Selor www.selor.be (B2B) vincent.vanmalderen@selor.be 02/788.66.52 @vincentvm http://be.linkedin.com/in/vincentvanmalderen

Editor's Notes