This document discusses improving compliance training in the workplace using mobile learning and xAPI. It begins with an introduction to Qualcomm's employee landscape and mobile learning focus. Some key compliance training challenges are outlined, including making the most of limited time, engaging modern learners, and budget constraints. A case study is presented on a mobile web app for preventing sexual harassment training. Tips are provided for future compliance training, such as ensuring accessibility on mobile and automatic progress synchronization. Lessons learned emphasize getting stakeholder buy-in, clear auditing, and testing technical connections. The document concludes by inviting the audience to a demo of Qualcomm's patent wall mobile application.
Compliance Training Done Well Using Mobile and the xAPI
1. 807 - Compliance Training Done Well
Using Mobile and the xAPI
mLearnCon 2015, Austin, TX
Jon Brasted
Staff Mobile Learning Engineer, Qualcomm
2. 2
Agenda
Discussion: How can you improve compliance
training in your workplace?
Case study: Preventing Sexual Harassment web app
Tips for your future compliance training
Introduction
Compliance Training challenges
1
3
4
6
Lessons learnt5
2
3. 3
Qualcomm employee landscape
Over 31,000
employees
~65% have
engineering
backgrounds
181 worldwide
locations
Headquartered in
San Diego, CA
65% of employees
located in USA
35% of employees
located
internationally
4. 4
Qualcomm mobile learning team focus
Developing and licensing apps
to make work life easier
Supporting other teams with
mobile initiatives, like
compliance training
Making mobile content
available wherever and
whenever our employees
5. 5
Agenda
Discussion: How can you improve compliance
training in your workplace?
Case study: Preventing Sexual Harassment web app
Tips for your future compliance training
Introduction
Compliance Training challenges
3
4
6
Lessons learnt5
1
2
7. 7
Challenge 1: Compliance Training and auditing is critical to every organization
1 http://www.ponemon.org/local/upload/file/True_Cost_of_Compliance_Report_copy.pdf
2 http://www.trainingmag.com/importance-improving-quality-compliance-training
Non-compliance is very expensive1
A recent study by the Brandon Hall Group
showed that 49% of organizations surveyed
considered compliance training to be either
a priority or critical to their business2
Compliance Training challenges
8. 8
Challenge 2: Decision-makers have limited hours available for training
How do you best use your learner’s time?
53% of decision makers listed having limited time for
training *
Time restrictions for training compliance
In-person and online often requires a fixed block of time
Compliance Training challenges
* http://blog.navexglobal.com/2014/05/28/four-surprising-ethics-compliance-training-statistics
Image credit: http://previews.123rf.com/images/dirkercken/dirkercken1110/dirkercken111000046/10806627-time-limit-icon-tight-schedule-limited-hours-and-urgent-deadline-clock-indicating-countdown-Sto
9. 9
Challenge 3: E-learning and course vendors are often not adapting quickly enough
Hard to find good vendors who produce engaging, mobile-ready courses
A lot of courses are only available via desktop
Compliance Training challenges
There are a few very promising vendors that we have recently started to work with.
inkling – great authoring tool and content delivery platform: mobile-ready, mobile responsive
Image credit: https://upload.wikimedia.org/wikipedia/en/1/1c/Inkling_company_logo.png
10. 10
Challenge 4: New generation of constantly mobile connected learners
The old training paradigms are not be as well accepted as
before
Why only offer in-person or desktop courses?
Learners are used to bite-sized, ‘on-the-go’ training
Compliance Training challenges
Image credit: http://cdn.makeuseof.com/wp-content/uploads/2015/02/bite-sized-learning-
11. 11
Challenge 5: Budget constraints
How do you best use your budget to deliver your
desired training outcomes?
Budgets are shrinking or staying flat
Vendor-provided solutions often incur ongoing
license costs
Compliance Training challenges
Image credit: http://westorlandonews.com/wp-content/uploads/2011/07/budget-cuts-.jpg
12. 12
Agenda
Discussion: How can you improve compliance
training in your workplace?
Case study: Preventing Sexual Harassment web app
Tips for your future compliance training
Introduction
Compliance Training challenges
4
6
Lessons learnt5
1
3
2
13. 13
Case study: Preventing Sexual Harassment web app
California requires mandatory Preventing Sexual Harassment training
All managers with direct reports
Two hours training every two years
Qualcomm has over 4500 line-managers in
California
Image credit: http://www.nclc.org/images/graphics/issues/california.png
14. 14
Case study: Preventing Sexual Harassment web app
Solution one – commission in-person training
Two hour in-person group session taught by
Qualcomm Legal representatives
− Challenging to arrange time for 20 to 30
managers to meet concurrently
− Hard to retain concentration and engagement
Image credit: http://piciandpici.com/wp-content/uploads/2013/04/bored-people1.jpg
15. 15
Case study: Preventing Sexual Harassment web app
Solution two – buy online (desktop) training
Two hour e-learning desktop course (from
third party vendor)
− Have to complete in one sitting – cannot
pause and resume
− Hard to retain concentration and engagement
− Six-figure annual license cost for a company
like Qualcomm
Image credit: http://www.freeimages.com/pic/m/l/le/len-k-a/328927_working_with_laptop_3.jpg
16. 16
Case study: Preventing Sexual Harassment web app
Accessible on mobile any time, anywhere
2 hour course content split into 12 easy-to-digest
chapters
Course content delivered through videos and
quizzes created by Qualcomm Legal
representatives
− Use it as an opportunity to teach Qualcomm culture and values
− Easy for Qualcomm to update the content
Automatically synchronizes user progress across
multiple devices
Utilizes Experience API (xAPI) for detailed
compliance tracking
Records completed progress in Qualcomm’s LMS
Solution three – build our own mobile web app course
17. 17
Case study: Preventing Sexual Harassment web app
Uses Rustici Software’s TinCanJS1 and Rustici
SCORM Engine2
Utilizes verbs from ADL's xAPI Vocabulary3 and W3C
Activity Vocabulary4
We use verbs like:
− initiated
− launched
− read
− played and paused
− satisfied
− completed
Uses xAPI Extensions to store detailed tracking data
− Video duration
1 https://github.com/RusticiSoftware/TinCanJS
2 http://scorm.com/scorm-solved/scorm-engine/
3 http://adlnet.gov/expapi/index.html
4 http://www.w3.org/TR/activitystreams-vocabulary
Solution three – build our own mobile web app course
18. 18
Employees can access content, and courses from both
mobile, and non-mobile devices. Transition between devices
is fluid, as all progress data is stored in the Qualcomm cloud,
in the Learning Record Store (LRS).
Mobile progress data from the LRS can be
synced regularly with traditional, internal HR
systems for full compliance monitoring
LRS LMS
Company
Firewall /
Network
App
Server
Case study: Preventing Sexual Harassment web app
Solution three – build our own mobile web app course
19. 19
Agenda
Discussion: How can you improve compliance
training in your workplace?
Case study: Preventing Sexual Harassment web app
Tips for your future compliance training
Introduction
Compliance Training challenges
6
Lessons learnt5
1
2
4
3
20. 20
Tips for your future compliance training
What you should expect / request from a vendor
Availability on mobile any time, anywhere
Easily digestible material split into bite-sized
chunks (video: 4 – 12 mins max)
Make the content interesting
− Can be used as an opportunity for teach about
additional topics
Auto-resume content (video, audio, application
page/position)
21. 21
Tips for your future compliance training
Allow users to start, pause and resume the
training
Automatically synchronize user progress across all
devices
Utilize Experience API (xAPI) for detailed
compliance tracking
− Use well defined verb lists
− ADL's xAPI Vocabulary
− W3C Activity Vocabulary
− CMI5 when it is available later this year
− Store detailed tracking data with xAPI Extensions
What you should expect / request from a vendor
22. 22
Agenda
Discussion: How can you improve compliance
training in your workplace?
Case study: Preventing Sexual Harassment web app
Tips for your future compliance training
Introduction
Compliance Training challenges
6
Lessons learnt
4
1
2
3
5
23. 23
Lessons learnt
We have experienced some struggles…
Get buy-in from your HR, Legal and compliance teams
− Make them part of the decision process
− Encourage them to take ownership / part-credit, if possible
Show the ability for clear auditing
− Experience API
− Analytics
Image credit: http://www.adlnet.gov/wp-content/uploads/2013/06/xAPI-transparent_300px.png
Image credit: http://marketingland.com/wp-content/ml-loads/2014/02/analytics-600.jpg
24. 24
Lessons learnt
We have experienced some struggles…
Test and then re-test the technical connections between the training application and your LMS
− Initial design: send data directly to LRS
− Data messages are small, but critical
− One lost message could be the flag to mark completion
− Sometimes the tracking messages got “lost” in transit
LRS LMS
Company
Firewall /
Network
App Server
25. 25
Agenda
Discussion: How can you improve compliance
training in your workplace?
Case study: Preventing Sexual Harassment web app
Tips for your future compliance training
Introduction
Compliance Training challenges
5 Lessons learnt
4
1
2
3
6
26. 26
How can you improve compliance training
in your workplace?
28. 28
A small plug…
Join me and a colleague for DemoFest, 5pm to 7pm
Qualcomm’s Patent Wall Experience – Jon Brasted and Anurag Jain
− Demo and explanation of our Patent Wall Experience application, powered by Qualcomm’s Vuforia mobile vision platform and Unity3D.
Image credit: http://www.elearningguild.com/assets/images/MLC15/logos/mlearning-demofest-
Over 31,000 employees
~65% have engineering backgrounds
181 worldwide locations
Headquartered in San Diego, CA
65% of employees located in USA
35% of employees located internationally
Developing and licensing apps to make work life easier
Supporting other teams with mobile initiatives, like compliance training
Making mobile content available wherever and whenever our employees need it
I’m sure that last thing you think when you hear the words ‘compliance training’ is “fun”, but here’s a funny and quite apt Dilbert cartoon…
Non-compliance is very expensive
$500 vs 2000
A recent study by the Brandon Hall Group showed that 49% of organizations surveyed considered compliance training to be either a priority or critical to their business
How do you best use your learner’s time?
53% of decision makers listed having limited time for training *
Time restrictions for training compliance
In-person and online require a fixed block of time
The old training paradigms may not be as well accepted as before
Why only offer in-person or desktop courses?
Learners are used to bite-sized, ‘on-the-go’ training
Wouldn’t we all like to complete a long training course over a number of days / weeks?
The old training paradigms may not be as well accepted as before
Why only offer in-person or desktop courses?
Learners are used to bite-sized, ‘on-the-go’ training
How do you best use your budget to deliver your desired training outcomes?
Budgets are shrinking or staying flat
Vendor-provided solutions often incur ongoing license costs
Some compliance training programs might have six figure renewal fees
I’m sure we can all relate to these people… I know that I can…
I’m sure we can all relate to this lady…
Accessible on mobile any time, anywhere
2 hour course content split into 12 easy-to-digest chapters
Course content delivered through videos and quizzes created by Qualcomm Legal representatives
Use it as an opportunity to teach Qualcomm culture and values
Easy for Qualcomm to update the content
Automatically synchronizes user progress across multiple devices
Utilizes Experience API (xAPI) for detailed compliance tracking
Records completed progress in Qualcomm’s LMS
Uses Rustici Software’s TinCanJS1 and Rustici SCORM Engine2
Utilizes verbs from ADL's xAPI Vocabulary3 and W3C Activity Vocabulary4
We use verbs like:
initiated
launched
read
played, paused, stopped
satisfied
completed
Uses xAPI Extensions to store detailed tracking data
Video duration
Android only apps
We realize that not many people can make something in-house so here’s some tips…
Availability on mobile any time, anywhere
Make it easy for your users to access the training
Easily digestible material split into small chunks (video: 4 – 12 mins max)
Auto-resume content (video, audio, application page/position)
Allow users to start, pause and resume the training
Automatically synchronize user progress across all devices
Don’t force users to complete a long training on one single device
Bite-sized chunks
Utilize Experience API (xAPI) for detailed compliance tracking
Use well defined verb lists
ADL's xAPI Vocabulary
W3C Activity Vocabulary
CMI5 when it is available later this year
Store detailed tracking data with xAPI Extensions
Allow users to start, pause and resume the training
San Diego colleagues – lots use the Coaster train – lots of time to do some work
Automatically synchronize user progress across all devices
Don’t force users to complete a long training on one single device
Bite-sized chunks
Utilize Experience API (xAPI) for detailed compliance tracking
Use well defined verb lists
ADL's xAPI Vocabulary
W3C Activity Vocabulary
CMI5 when it is available later this year
Store detailed tracking data with xAPI Extensions
Get buy-in from your HR, Legal and compliance teams
Make them part of the decision process
Encourage them to take ownership / part-credit, if possible
Show the ability for clear auditing
Experience API
Analytics
Test and then re-test the technical connections between the training application and your LMS
We initially designed the application to send tracking data straight to the LRS
The messages are small, but critical – one lost message could contain the all important “completed training” signal, for example
Sometimes the tracking messages got “lost” in transit
Perhaps user went offline or out of signal as the training was completed
We did not have a way to recover from this at first so we developed a custom data synchronization solution
Custom tracking messages from web app are received and confirmed by the server
Server translates received tracking messages into xAPI statements and submits them to the LRS
When LRS server confirms the message was successfully received, the server marks the statement as successfully sent
The xAPI statements to the LRS can be retransmitted by the server at any time