Measuring social learning in SharePoint with assessments
John Kleeman, Questionmark, UK
The world of corporate learning is moving toward the 70+20+10% model. This suggests about 70% of learning happens on the job, 20% via feedback from colleagues and peers and 10% in formal training. SharePoint is one of the key enablers of this move, with its widespread use for blogging, wikis and document repositories. Assessments (quizzes, surveys, tests and exams) are a critical part of learning – helping diagnose what you need to learn, giving feedback on learning, measuring and reinforcing what you have learned. Assessments are also useful in SharePoint for those using it for more formal training and also to keep track of compliance with regulations within SharePoint.
This presentation from a vendor-neutral perspective :
Describes the business benefits of embedding assessments within SharePoint
Gives some examples of how companies are using assessments within SharePoint
Explains how assessments can be used to measure the impact of social and informal learning
Tells about options for including assessments in SharePoint 2010
Shows how it’s possible to very easily include an assessment on almost any SharePoint page
Shares examples of how this is useful
Demonstrates how to report and manage assessment results in SharePoint
Explores how to use assessment results to interpret what is happening and identify needed improvements
By attending this session, you will learn why assessments are useful in social learning and how to apply them within SharePoint, both for social learning and more conventional training and compliance uses.
Adapted for SlideShare from presentation at the European SharePoint Conference, October 2011, Berlin
SharePoint is a key part of 70+20+10 in many organizations because it is the place you can learn from others – via Search, Wikis, Blogs and Discussions. It’s often also the place you can learn from experience.
Assessments prepare for learning by creating intrigue and by informing instructors how much needs learning. Assessments in/as learning give evidence to guide instructors and learners into what needs to be learned and what has been learned. Assessments of learning provide evidence of learning.
Needs analysis assessments identify what you already know, it’s very boring to get training on something that you already know, and in the 70+20+10 world, we are learning from all places. Job task analysis surveys identify what we should be teaching and assessing, they survey existing practitioners. And course evaluations give feedback on the quality of the training.
This study compared two groups of students, one group studied only and the other studied and took a test within the same total time. The group who took a test retained more a week later.
Questions before learning create intrigue. Questions during learning strengthen memory and give information to direct learning. Questions after learning reduce forgetting.
See http://technet.microsoft.com/en-us/library/hh285756.aspx for more on this use of SharePoint
Since SharePoint web parts are different sizes, important whatever assessment system you use that the assessment system auto-sizes quizzes, tests and surveys to fit well in the web part.
Advantages and disadvantages of different approaches
Illustration of including a quiz side-by-side with learning content in SharePoint 2010
Illustration of Single Sign On using Active Directory from SharePoint to Questionmark Perception
Measuring social learning in SharePoint with assessments
Measuring Social Learning inSharePoint with Assessments John KleemanChairman, Questionmark (www.questionmark.com) Twitter: @johnkleeman Email : john at questionmark.com
Learning is ChangingSign up • Academic model worked for 2500 years Learn • Internet changing things – “Google it” Test – Changing work roles – Deeper understanding of Do work learning
Learning from your Only ~10% of learning mentors, conversations comes from study with peers and meetings (reading, researching, courses, etc.) (if you pay attention and ask questions) 70+20+10 Formal Learning model ofLearning From Others 10% learning Learning By 20% Doing On-The-Job learning by making mistakes, taking 70% time for retrospectives and learning from the experience.
Internet allows us to more easily share knowledge. We have moved from clear definitions of Publishers/Producers/Consumers to Prosumers Publisher model ProSumer model (books, courses) (wikis, blogs, search) Producer ProSumer Consumer ProSumer
70+20+10 model for learning • Learn from experience ~70% from Experience • Learn from others • SharePoint Search, Wikis, Blogs, Discussions ~20% from Others ~10% from Study
Sometimes you just need to know!• Do you want pilot to • Or doctor to check Google as flies plane? anatomy during surgery?
Assessments?• Assessments are a critical part of learning – Quizzes (memory recall) – Surveys (needs analysis) – Tests (measure knowledge/skills) – Exams (more formal tests)• This presentation shows: – Why assessments useful in learning – What applications work in SharePoint – How? Where to learn more?
Assessments Through Learning Process Learning Collaborative Mentoring Instructor & E-learning Work Place Prepare For Windows CD In/As Learning Windows CD Of-Learning Windows CD Learning Assessments Assessments Evidence Accumulated
Job Task Windows CD Course Windows CD Analysis Evaluations Learning Collaborative Slow Forgetting Windows CDNeeds Analysis Windows CD Mentoring Instructor & E-learning Work Place Curve Prepare For Windows CD In/As Learning Windows CD Of Learning Windows CD Learning Assessments Assessments Evidence Accumulated
Quizzes and tests slow forgetting curve• Taking a quiz or test Knowledge Retained gives retrieval practice 100%• Reinforces mental 80% After 5 pathways to make 60% mins 56% future recall more likely 40% 42% After 1 20% weekData from Test-Enhanced Learning, Roediger and 0%Karpicke 2006. Psychological Science Study only Study, Test
Quizzes and tests are also objective evidence someone understands• Is getting someone to sign they’ve read a document good enough?• US Appeals Court 2005: – “merely having an individual sign a form acknowledging his responsibility to read the safety manual is insufficient to insure that the detailed instructions contained therein have actually been communicated”
Questions Through the Learning Process Reduce Forgetting Create IntrigueKnowledge/Skills Strengthen Memory Questions Questions Questions Questions Questions Time
WHAT ASSESSMENT APPLICATIONSWORK WELL WITH SHAREPOINT?
Formal learning • Expose pre-course and post- course assessments at right time • End of module quizzes to confirm understanding & reduce forgetting • Diagnostic tests - misconceptions & direct learning • Course evaluation surveys • Authenticate examsUniversity of Lund, Sweden
Employee / partner portal• Sales channel verification – Do you have the right sales skills to sell my product?• Technical verification – Do you know how to maintain or describe our products? Typical social learning techniques• Knowledge check quizzes, e.g. every Mon morning• Evaluation surveys• User-generated quizzes
Regulatory Compliance e.g. safety, financial services, pharmaceuticals• Knowledge check to confirm understanding of training• Tests to confirm competency• Survey employees to find problems before they hit you• Analyze data to see trends
Other common applications• Community of practice – Engage interest / validate moderators / survey practice• Performance support – Just in time diagnostic quizzes that direct to learning• Report on scores – Report scores from assessments in SharePoint – Use SharePoint to collate results
Approach #1 : Inbuilt SharePoint• Good for basic surveys• Works OOTB• Not quizzes & tests – Scoring – Security – Shuffling – Feedback – Reporting
Approach #3Embed Flash apps• Easy to do (if you have the tool)• Results not usually stored• Won’t work on iPads/iPhones• Possible for simple quizzes
Approach #4: Embed web apps• Embed assessment management systems• Easy to do and appropriate
Assessment must Software packages the size to fit space in Assessment for Device/Browser/iframe SharePoint Sends HTML Auto-Sizesenses pixel size of window
Surveys? Quizzes & OOTB? Work in Deliver on tests? cloud? mobiles? AuthorInbuilt DeliverSharePoint Report AuthorCustom Deliverweb parts Report AuthorEmbed DeliverFlash apps Report AuthorEmbed web Deliverapps Report
Where to learn more• 70+20+10 model – White paper by Charles Jennings www.duntroon.com• SharePoint and Assessments blog – http://blog.sharepointlearn.com – Gives technical how-tos & comments on SharePoint and assessment• Learning and Assessment on SharePoint white paper – www.questionmark.com/whitepapers• Learn by doing – Start a pilot project and learn as you go
If you have questionsEmail john at questionmark.comTwitter @johnkleeman