Integrating Knowledge Management in the Context of Evidence Based Learning:Two concept models for facilitating the assessment and acquisition of job knowledge Stefan T. Mol Gabor Kismihok Fazel Ansari Mareike Dornhöfer May 13th 2012 ISDT 2012, Mallorca, Spain
Contents• Context• The Med-Assess Concept• The Meta Practitioner Concept• Challenges• Synthesis• Questions / comments
Point of departure“…people who are more intelligent learnmore job knowledge and learn it faster, themajor determinant of job performance isnot GMA but job knowledge” (Schmidt andHunter, 2001). Job GMA Job knowledge Performance
Job Knowledge: A tentative definitionThe oftentimes job idiosyncratic and specificallydefined know-how or evidence that is requiredof and by the job-holder to make sounddecisions and thereby demonstrate successfuljob performance.
Introducing Med-Assess• MED-ASSESS is a personnel selection and training platform that takes an individualized approach to the assessment and development of job specific knowledge.• Based on cutting edge semantic technology, MED-ASESS provides detailed personalized assessment and training of essential technical competencies and related job knowledge elements that are required for a particular job.
What will MED-ASSESS offer?• General Mental Ability test• Customizable, adaptive job knowledge test for medical employees (e.g., ward nurses, medical imaging nurses)• Applicant ranking based on integrated Job Knowledge and GMA test performance• Automatic and tailored e-Learning content delivery on the basis of test results• Cutting-edge semantic technology for job knowledge structuring, testing, and evaluation
Benefits of MED-ASSESS to Organizations• Efficient applicant screening• Greater person – job fit.• Cuts in selection and initial training costs• Fully customizable tests and training modules• Based on ONTO-HR (see www.ontohr.eu)
Benefits of MED-ASSESS to individuals• Easy to access, online interface• Easy to use and straightforward test environment• Comprehensive presentation of results• Personalized learning plan for knowledge deficiencies• Fair and ethical testing
The MED-ASSESS ConceptUndeniably Job General Unequivocally Job Specific (albeit more portable for more related occupations) Job Job GMA Knowledge Performance Education Job Specific – Job General
The META-PRACTITIONER Concept Unequivocally Job Specific (albeit more portable for more related occupations) Job Job Knowledge Performance Education Job Specific – Job General
Evidence based management…is based on the belief that facing the hardfacts about what works and what doesn’t,understanding the dangerous half-truths thatconstitute so much conventional wisdom aboutmanagement, and rejecting the total nonsensethat too often passes for sound advice will helporganizations perform better. Pfeffer & Sutton (2006)
Meta-Practitioner• Aimed at facilitating practitioner access to academically accrued evidence through the automated conduct of meta-analysis
Systematic Reviews: Meta-analysisMeta-analysis is a statistical technique ofsummarizing and aggregating the findings oflarge numbers of previous investigations intothe strength of the relationship between two ormore variables (for instance the correlationbetween general mental ability and jobperformance).
Systematic Reviews: Meta-analysis Shaffer et al. 2006
Conclusions• The importance and centrality of job knowledge in today’s knowledge based economy is undeniable• Multidisciplinary approaches are needed to tackle the challenges inherent to modeling job knowledge
Research challenges– both systems are currently mainly concerned with explicit knowledge that has in some way shape or form been documented. One challenge that awaits here is facilitating the automated processing and mapping into the ontologies of such knowledge.– It should be recognized that job incumbents are likely to have significant know-how, and incorporating this latent knowledge into either system will be another significant challenge.
Research challengesTechnological challenges:– (semi) automated ontology development– Content development– Validation– Integration • Into existing learning environments • With educational programs– Engaging stakeholders
Job Knowledge as Matchmaker• Connecting: – HRM, eLearning & Knowledge Management (foster collaboration) – Academia and industry (Science and practice) – Employees and workplaces (Enhanced Matching) – Policy and Education (Training) – Government and Labor Market (Needs analysis) http://www.ontohr.eu
Dr. Stefan T. MolAssistant Professor in Organizational BehaviorRm. M-2.36 | Plantage Muidergracht 121018 TV Amsterdam | The NetherlandsT +31 20 525 5490 | F +31 20 525 4182E email@example.com | I www.abs.uva.nl/pp/stmol