Downloaded 12 times
Uploaded byJon Brasted
Compliance Training Done Well Using Mobile and the xAPI
This document discusses improving compliance training in the workplace using mobile learning and xAPI. It begins with an introduction to Qualcomm's employee landscape and mobile learning focus. Some key compliance training challenges are outlined, including making the most of limited time, engaging modern learners, and budget constraints. A case study is presented on a mobile web app for preventing sexual harassment training. Tips are provided for future compliance training, such as ensuring accessibility on mobile and automatic progress synchronization. Lessons learned emphasize getting stakeholder buy-in, clear auditing, and testing technical connections. The document concludes by inviting the audience to a demo of Qualcomm's patent wall mobile application.
More Related Content
Similar to Compliance Training Done Well Using Mobile and the xAPI
Compliance Training Done Well Using Mobile and the xAPI
- 1. 807 - ComplianceTraining Done Well Using Mobile and the xAPI mLearnCon 2015, Austin, TX Jon Brasted Staff Mobile Learning Engineer, Qualcomm
- 2. 2 Agenda Discussion: How canyou improve compliance training in your workplace? Case study: Preventing Sexual Harassment web app Tips for your future compliance training Introduction Compliance Training challenges 1 3 4 6 Lessons learnt5 2
- 3. 3 Qualcomm employee landscape Over31,000 employees ~65% have engineering backgrounds 181 worldwide locations Headquartered in San Diego, CA 65% of employees located in USA 35% of employees located internationally
- 4. 4 Qualcomm mobile learningteam focus Developing and licensing apps to make work life easier Supporting other teams with mobile initiatives, like compliance training Making mobile content available wherever and whenever our employees
- 5. 5 Agenda Discussion: How canyou improve compliance training in your workplace? Case study: Preventing Sexual Harassment web app Tips for your future compliance training Introduction Compliance Training challenges 3 4 6 Lessons learnt5 1 2
- 6.
- 7. 7 Challenge 1: ComplianceTraining and auditing is critical to every organization 1 http://www.ponemon.org/local/upload/file/True_Cost_of_Compliance_Report_copy.pdf 2 http://www.trainingmag.com/importance-improving-quality-compliance-training Non-compliance is very expensive1 A recent study by the Brandon Hall Group showed that 49% of organizations surveyed considered compliance training to be either a priority or critical to their business2 Compliance Training challenges
- 8. 8 Challenge 2: Decision-makershave limited hours available for training How do you best use your learner’s time? 53% of decision makers listed having limited time for training * Time restrictions for training compliance In-person and online often requires a fixed block of time Compliance Training challenges * http://blog.navexglobal.com/2014/05/28/four-surprising-ethics-compliance-training-statistics Image credit: http://previews.123rf.com/images/dirkercken/dirkercken1110/dirkercken111000046/10806627-time-limit-icon-tight-schedule-limited-hours-and-urgent-deadline-clock-indicating-countdown-Sto
- 9. 9 Challenge 3: E-learningand course vendors are often not adapting quickly enough Hard to find good vendors who produce engaging, mobile-ready courses A lot of courses are only available via desktop Compliance Training challenges There are a few very promising vendors that we have recently started to work with. inkling – great authoring tool and content delivery platform: mobile-ready, mobile responsive Image credit: https://upload.wikimedia.org/wikipedia/en/1/1c/Inkling_company_logo.png
- 10. 10 Challenge 4: Newgeneration of constantly mobile connected learners The old training paradigms are not be as well accepted as before Why only offer in-person or desktop courses? Learners are used to bite-sized, ‘on-the-go’ training Compliance Training challenges Image credit: http://cdn.makeuseof.com/wp-content/uploads/2015/02/bite-sized-learning-
- 11. 11 Challenge 5: Budgetconstraints How do you best use your budget to deliver your desired training outcomes? Budgets are shrinking or staying flat Vendor-provided solutions often incur ongoing license costs Compliance Training challenges Image credit: http://westorlandonews.com/wp-content/uploads/2011/07/budget-cuts-.jpg
- 12. 12 Agenda Discussion: How canyou improve compliance training in your workplace? Case study: Preventing Sexual Harassment web app Tips for your future compliance training Introduction Compliance Training challenges 4 6 Lessons learnt5 1 3 2
- 13. 13 Case study: PreventingSexual Harassment web app California requires mandatory Preventing Sexual Harassment training All managers with direct reports Two hours training every two years Qualcomm has over 4500 line-managers in California Image credit: http://www.nclc.org/images/graphics/issues/california.png
- 14. 14 Case study: PreventingSexual Harassment web app Solution one – commission in-person training Two hour in-person group session taught by Qualcomm Legal representatives − Challenging to arrange time for 20 to 30 managers to meet concurrently − Hard to retain concentration and engagement Image credit: http://piciandpici.com/wp-content/uploads/2013/04/bored-people1.jpg
- 15. 15 Case study: PreventingSexual Harassment web app Solution two – buy online (desktop) training Two hour e-learning desktop course (from third party vendor) − Have to complete in one sitting – cannot pause and resume − Hard to retain concentration and engagement − Six-figure annual license cost for a company like Qualcomm Image credit: http://www.freeimages.com/pic/m/l/le/len-k-a/328927_working_with_laptop_3.jpg
- 16. 16 Case study: PreventingSexual Harassment web app Accessible on mobile any time, anywhere 2 hour course content split into 12 easy-to-digest chapters Course content delivered through videos and quizzes created by Qualcomm Legal representatives − Use it as an opportunity to teach Qualcomm culture and values − Easy for Qualcomm to update the content Automatically synchronizes user progress across multiple devices Utilizes Experience API (xAPI) for detailed compliance tracking Records completed progress in Qualcomm’s LMS Solution three – build our own mobile web app course
- 17. 17 Case study: PreventingSexual Harassment web app Uses Rustici Software’s TinCanJS1 and Rustici SCORM Engine2 Utilizes verbs from ADL's xAPI Vocabulary3 and W3C Activity Vocabulary4 We use verbs like: − initiated − launched − read − played and paused − satisfied − completed Uses xAPI Extensions to store detailed tracking data − Video duration 1 https://github.com/RusticiSoftware/TinCanJS 2 http://scorm.com/scorm-solved/scorm-engine/ 3 http://adlnet.gov/expapi/index.html 4 http://www.w3.org/TR/activitystreams-vocabulary Solution three – build our own mobile web app course
- 18. 18 Employees can accesscontent, and courses from both mobile, and non-mobile devices. Transition between devices is fluid, as all progress data is stored in the Qualcomm cloud, in the Learning Record Store (LRS). Mobile progress data from the LRS can be synced regularly with traditional, internal HR systems for full compliance monitoring LRS LMS Company Firewall / Network App Server Case study: Preventing Sexual Harassment web app Solution three – build our own mobile web app course
- 19. 19 Agenda Discussion: How canyou improve compliance training in your workplace? Case study: Preventing Sexual Harassment web app Tips for your future compliance training Introduction Compliance Training challenges 6 Lessons learnt5 1 2 4 3
- 20. 20 Tips for yourfuture compliance training What you should expect / request from a vendor Availability on mobile any time, anywhere Easily digestible material split into bite-sized chunks (video: 4 – 12 mins max) Make the content interesting − Can be used as an opportunity for teach about additional topics Auto-resume content (video, audio, application page/position)
- 21. 21 Tips for yourfuture compliance training Allow users to start, pause and resume the training Automatically synchronize user progress across all devices Utilize Experience API (xAPI) for detailed compliance tracking − Use well defined verb lists − ADL's xAPI Vocabulary − W3C Activity Vocabulary − CMI5 when it is available later this year − Store detailed tracking data with xAPI Extensions What you should expect / request from a vendor
- 22. 22 Agenda Discussion: How canyou improve compliance training in your workplace? Case study: Preventing Sexual Harassment web app Tips for your future compliance training Introduction Compliance Training challenges 6 Lessons learnt 4 1 2 3 5
- 23. 23 Lessons learnt We haveexperienced some struggles… Get buy-in from your HR, Legal and compliance teams − Make them part of the decision process − Encourage them to take ownership / part-credit, if possible Show the ability for clear auditing − Experience API − Analytics Image credit: http://www.adlnet.gov/wp-content/uploads/2013/06/xAPI-transparent_300px.png Image credit: http://marketingland.com/wp-content/ml-loads/2014/02/analytics-600.jpg
- 24. 24 Lessons learnt We haveexperienced some struggles… Test and then re-test the technical connections between the training application and your LMS − Initial design: send data directly to LRS − Data messages are small, but critical − One lost message could be the flag to mark completion − Sometimes the tracking messages got “lost” in transit LRS LMS Company Firewall / Network App Server
- 25. 25 Agenda Discussion: How canyou improve compliance training in your workplace? Case study: Preventing Sexual Harassment web app Tips for your future compliance training Introduction Compliance Training challenges 5 Lessons learnt 4 1 2 3 6
- 26. 26 How can youimprove compliance training in your workplace?
- 27. 27 WorkLearnMobile.org Case Studies Trends andideas News & Views Insights from Qualcomm’s m- learning team Resources Links to m-learning info Expert Insights Free advice from experts
- 28. 28 A small plug… Joinme and a colleague for DemoFest, 5pm to 7pm Qualcomm’s Patent Wall Experience – Jon Brasted and Anurag Jain − Demo and explanation of our Patent Wall Experience application, powered by Qualcomm’s Vuforia mobile vision platform and Unity3D. Image credit: http://www.elearningguild.com/assets/images/MLC15/logos/mlearning-demofest-
- 29.
Editor's Notes
- #4 Over 31,000 employees ~65% have engineering backgrounds 181 worldwide locations Headquartered in San Diego, CA 65% of employees located in USA 35% of employees located internationally
- #5 Developing and licensing apps to make work life easier Supporting other teams with mobile initiatives, like compliance training Making mobile content available wherever and whenever our employees need it
- #7 I’m sure that last thing you think when you hear the words ‘compliance training’ is “fun”, but here’s a funny and quite apt Dilbert cartoon…
- #8 Non-compliance is very expensive $500 vs 2000 A recent study by the Brandon Hall Group showed that 49% of organizations surveyed considered compliance training to be either a priority or critical to their business
- #9 How do you best use your learner’s time? 53% of decision makers listed having limited time for training * Time restrictions for training compliance In-person and online require a fixed block of time
- #10 The old training paradigms may not be as well accepted as before Why only offer in-person or desktop courses? Learners are used to bite-sized, ‘on-the-go’ training
- #11 Wouldn’t we all like to complete a long training course over a number of days / weeks? The old training paradigms may not be as well accepted as before Why only offer in-person or desktop courses? Learners are used to bite-sized, ‘on-the-go’ training
- #12 How do you best use your budget to deliver your desired training outcomes? Budgets are shrinking or staying flat Vendor-provided solutions often incur ongoing license costs Some compliance training programs might have six figure renewal fees
- #15 I’m sure we can all relate to these people… I know that I can…
- #16 I’m sure we can all relate to this lady…
- #17 Accessible on mobile any time, anywhere 2 hour course content split into 12 easy-to-digest chapters Course content delivered through videos and quizzes created by Qualcomm Legal representatives Use it as an opportunity to teach Qualcomm culture and values Easy for Qualcomm to update the content Automatically synchronizes user progress across multiple devices Utilizes Experience API (xAPI) for detailed compliance tracking Records completed progress in Qualcomm’s LMS
- #18 Uses Rustici Software’s TinCanJS1 and Rustici SCORM Engine2 Utilizes verbs from ADL's xAPI Vocabulary3 and W3C Activity Vocabulary4 We use verbs like: initiated launched read played, paused, stopped satisfied completed Uses xAPI Extensions to store detailed tracking data Video duration
- #19 Android only apps
- #21 We realize that not many people can make something in-house so here’s some tips… Availability on mobile any time, anywhere Make it easy for your users to access the training Easily digestible material split into small chunks (video: 4 – 12 mins max) Auto-resume content (video, audio, application page/position) Allow users to start, pause and resume the training Automatically synchronize user progress across all devices Don’t force users to complete a long training on one single device Bite-sized chunks Utilize Experience API (xAPI) for detailed compliance tracking Use well defined verb lists ADL's xAPI Vocabulary W3C Activity Vocabulary CMI5 when it is available later this year Store detailed tracking data with xAPI Extensions
- #22 Allow users to start, pause and resume the training San Diego colleagues – lots use the Coaster train – lots of time to do some work Automatically synchronize user progress across all devices Don’t force users to complete a long training on one single device Bite-sized chunks Utilize Experience API (xAPI) for detailed compliance tracking Use well defined verb lists ADL's xAPI Vocabulary W3C Activity Vocabulary CMI5 when it is available later this year Store detailed tracking data with xAPI Extensions
- #24 Get buy-in from your HR, Legal and compliance teams Make them part of the decision process Encourage them to take ownership / part-credit, if possible Show the ability for clear auditing Experience API Analytics
- #25 Test and then re-test the technical connections between the training application and your LMS We initially designed the application to send tracking data straight to the LRS The messages are small, but critical – one lost message could contain the all important “completed training” signal, for example Sometimes the tracking messages got “lost” in transit Perhaps user went offline or out of signal as the training was completed We did not have a way to recover from this at first so we developed a custom data synchronization solution Custom tracking messages from web app are received and confirmed by the server Server translates received tracking messages into xAPI statements and submits them to the LRS When LRS server confirms the message was successfully received, the server marks the statement as successfully sent The xAPI statements to the LRS can be retransmitted by the server at any time