Rob Arntsen presents on MyKnowledgeMap's work developing new approaches to assessment learning technology. He discusses observational assessments using mobile devices, which can provide faster feedback and capture evidence through video and audio. He then proposes further innovations like allowing individuals to own and curate all their assessment materials and evidence over their lifetime, and showcase their skills and competencies in various formats like with a CV. This could be offered for free as a personal showcase service. Institutions could also provide this service for users.
1. Inspired assessment learning technology&
Rob Arntsen – Chairman and Founder, MyKnowledgeMap
rob.arntsen@myknowledgemap.com
www.myknowledgemap.com
The e-Assessment Question Conference London, March 26th 2015
Developing New Approaches
2. Inspired assessment learning technology&
Developing New Approaches
Observational
Assessments
The Learner
What do they
get?
3. Inspired assessment learning technology&
A bit about MKM
- One of the most well established UK learning technology
companies; formed in 2000, based in York, mix of large
bespoke client projects and assessment related products.
- Working on assessment in workplace since 2007
- Using mobile smartphones and tablets
- Won series of awards with our mobile assessment
projects 2009-11
- Evolved into product called Myprogress
- Now used in UK and many countries:USA, Europe,
South East Asia
- Includes high stakes observational assessment: GMC
- Recent addition is cloud based evidence store for an
individual, called Myshowcase.me
Developing New Approaches
5. Inspired assessment learning technology&
Sharing our experiences about observational
assessments……..
• All try and assess an individuals’ performance in a certain area based on
skill, ability, behaviour and outcome.
• Flexible & Alternative Workflows
• Which device, who owns device?
• Connectivity – ability to work without connection
• Feedback rules, moderation rules
• Verification and fidelity
• Dynamic user engagement – users unknown to system
• Multiple roles
• Variable rubrics
6. Inspired assessment learning technology&
WHY MOBILE?.......Key benefit opportunity areas
• Faster feedback gives better student support and more time for
practice and achievement
• Reduce cost, errors and delays of paper based systems
• It can be physically the best/only method in many situations
• You can also capture video, photos, audio as evidence
• Responsive, authentic and immediate
• Improve security and fidelity of evidence
• Improve communication/support between student and assessor
• Monitor progress of remote students and intervene earlier
7. Inspired assessment learning technology&
So what about a bit more innovation?
- Lets think about the individual?
- Save their stuff – and its theirs – they own it
- Gather and merge with other stuff
- Organise and use their stuff very flexibly
- Save and curate for life
- Map and remap to multiple frameworks
- Showcase their ability/competence in all sorts of ways, and in
different formats/layouts
- Use with a CV/Resume
- Use to prove CPD later
- Use to evidence competence/ability for employer or
professional body
- Showcase activity on projects – project updates
8. Inspired assessment learning technology&
So what about a bit more innovation?
- Lets think about the individual?
- Save their stuff – and its theirs – they own it
- Gather and merge with other stuff
- Organise and use their stuff very flexibly
- Save and curate for life
- Map and remap to multiple frameworks
- Showcase their ability/competence in all sorts of ways, and in
different formats/layouts
- Use with a CV/Resume
- Use to prove CPD later
- Use to evidence competence/ability for employer or
professional body
- Showcase activity on projects – project updates
- Link with their personal social media tools of choice
- Offer as a FREE service for life
- Now that is value-add!!!
11. Inspired assessment learning technology&
11
Storage
Storage
Community
Showcase
Library
Engage with,
Collaborate with,
Communicate with.
Release
Policy
Collaboration
• Multiple Community
memberships
• Multiple Group membership
within each Community
• Community/Group workspaces
• Community/Group showcase
support
Customisation
• Community collection sources
• Community showcase
templates
• Community controlled
showcase audience
• Community controlled hosted
storage (UK Domicile)
• Release Policy and Rules
• Look and Feel
• Terminology
Communities
• Formal: Sponsorship
• Informal: Group of colleagues or
friends
• Customisable: Policy , Rules,
Roles and Functionality
• Collaborative
• Boundaries
Release
Policy
Collaboration
Community
Individual
Individual
2
Individual 1
Individual
3
Community
A
Community
B
Roles
Community
C
Individual
or Group
Public Library
Reports
Individual Showcase Library
18. Inspired assessment learning technology&
Institutional Use
Provide this service to all your users (and stay in touch with
them).
Relevant for…..
- Training providers
- Awarding bodies
- Professional associations
- Employers
- LMS vendors
There is a small charge for institutional use.
19. Inspired assessment learning technology&
Rob Arntsen – Chairman and Founder, MyKnowledgeMap
rob.arntsen@myknowledgemap.com
www.myknowledgemap.com
The e-Assessment Question Conference London, March 26th 2015
Developing New Approaches