Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Now You’re Speaking My Language! Communicating Benefits of xAPI
Similar to Now You’re Speaking My Language! Communicating Benefits of xAPI (20)
Recently uploaded
Recently uploaded (20)
Now You’re Speaking My Language! Communicating Benefits of xAPI
- 1. Now You’re Speaking My Language! 2019 Spring xAPI Party Jill Mohler
- 2. My journey with xAPI and the lessons I’ve learned when communicating with others. Photo by Vlad Bagacian on Unsplash
- 3. Education Multiple departments CIO CHRO My World Learning Technologies IT Works with different depts. Business Oversees different depts.
- 4. Education Multiple departments eLearning Development Learning Management Systems SCORM, AICC SCORM Cloud xAPI My World Learning Technologies IT Works with different depts. Oversees different depts.
- 5. Aha! Moment WBTs - (SCORM packages currently in SCORM Cloud WBT 1 – On server, not LMS. WBT 2 – On server, not LMS. Receives data from WBT 1 PDFs – Links on Intranet
- 6. Lesson #1 Who will benefit the most using xAPI? Who are your potential stakeholders?
- 7. Education Multiple departments CIO My World Learning Technologies IT Works with different depts. Business Oversees different depts. Stakeholders CHRO
- 8. Aha! Moment WBTs - (SCORM packages currently in SCORM Cloud WBT 1 – On server, not LMS. WBT 2 – On server, not LMS. Receives data from WBT 1 PDFs – Links on Intranet
- 9. Education Multiple departments CIO My World Learning Technologies IT Works with different depts. Business Oversees different depts. Stakeholders CHRO
- 10. Lesson #2 Talk less about the HOW (technical details) and more about the WHY (opportunities). “xAPI is a specification for learning technology that makes it possible to collect data about the wide range of experiences a person has (online and offline)… captures data in a consistent format.” www.xapi.com
- 11. Where to start? 1. Find out L&D pain points. What questions around learning and performance are they having a hard time answering? 2. What learning data strategy do they already have in place?
- 12. 1 2 3 4 5 Cost and Reach How much did the learning program cost us? Efficiency Effectiveness Outcomes Measuring Efficiency, Effectiveness, and Outcomes (Behavior Change) (Knowledge Gain) (Motivation and Reaction) What changes in job performance resulted from the learning process? Did learners acquire the intended knowledge, skills, and confidence? Were the learners motivated to learn and did they like the learning process? EasiestHardest Did the learning program have a measurable impact on targeted outcomes? Did the learning program provide a positive return on investment?
- 13. Questions that came out of meeting 1. Are learners getting stuck in a web-based course because of lack of knowledge or bad interface design? 2. What are learners doing after formal training is over? What learning material are they looking at? And from where? 3. Are the learning programs helping reduce time to productivity for new hires? 4. Are the vendor-based courses effective? Are we getting our money’s worth?
- 14. New Leadership Onboarding Program (Potential Pilot Project) 1. What topics are new leaders gravitating towards or need improvement in? 2. Did this program help reduce new leader turnover? 3. What are new leaders’ team engagement scores and patient satisfaction scores compared to others?
- 15. Take Away 1. Find your potential stakeholders. Who will benefit the most from xAPI data. 2. Talk more about the opportunities of using xAPI and less about the technical know how. (IT can help with that) 3. Get your stakeholders to start thinking about a learning data strategy if they are not doing so already. 4. Personally learn more about learning analytics if you are not comfortable with it.
- 16. Investigating Performance Design and Outcomes with xAPI Janet Laane Effron and Sean Putman The Data Driven Leader A Powerful Approach to Delivering Measurable Business Impact through People Analytics Jenny Dearborn and David Swanson Key Performance Indicator (KPI) Examples https://kpidashboards.com/kpi/
- 17. Questions?
Editor's Notes
- This is an oversimplified graph of different areas within a typical organization. Each area can have their own priorities and their own department language. The grey circle represents the different roles that need to be able to communicate to multiple departments. For example, the CIO needs to be able to speak to the business teams as well as to the IT teams in a way that everyone understands. As the Learning Technology Architect, I need to be able to speak to both the education teams and the IT teams in a way that everyone understands.
- To track training, we internally built a learning platform that interfaces with SCORM Cloud. My role required experience with eLearning development, LMS integration, SCORM and AICC. I first learned about xAPI and an LRS through Rustici Software since they owned SCORM Cloud. At first, I was not sure how xAPI and an LRS compared to SCORM and an LMS. Would xAPI replace SCORM? Would an LRS replace an LMS? I had to wrap my head around how xAPI statements are sent.
- While using the free LRS that came with our subscription to SCORM Cloud, I was able to view the statements already coming in from the SCORM packaged web-based training. I developed a wbt that sent custom xAPI statements to the same LRS, but the wbt was hosted on an internal server. I developed another wbt that received xAPI statements from the LRS and was hosted on a different internal server. I created pdf links on the intranet that also sent xAPI statements to the same LRS. My aha moment came when I realized that it was possible to send data in a consistent format from different learning activities in different locations, not just the LMS. It was possible to measure a learner’s progress, over time, by capturing data from different moments of need, not just during formal training.
- I told IT about the ability in sending xAPI statements to an LRS. Even though they understood the technical needs to implement such an endeavor, they were not the ones who would benefit the most from using xAPI. I needed to talk to the teams who would benefit the most.
- The education teams would benefit the most from xAPI. They were the teams I needed to talk to.
- I explained my aha moment again with the education teams on how you can send xAPI statements to an LRS from different learning activities and how you were not restricted to an LMS. I still was not getting buy in.
- I realized that though I was talking to the right people this time, I was speaking too technical. My potential stakeholders did not have to work with the IT department as closely as my role did.
- I needed to talk less about how the xAPI specification technically works and more about the why, or the opportunities in using the xAPI specification.
- I needed to find the pain points of the education teams. What questions around learning and performance are they having a hard time answering? Also, what learning data strategy do they already have in place?
- After talking to an education manager about Kirkpatrick’s levels of learning evaluation, we came to the realization that they were mostly measuring learning only up to level 2, knowledge gain. I explained that there was an opportunity to measure learning and performance at the higher levels by capturing more consistent data from more than just the LMS. I was very careful not to go into how it worked in too much technical detail, but more about the possibilities of being able to answer questions that have currently been hard to answer.
- For a potential pilot project, I sat down with a couple of the consultants and talked about the new leadership onboarding program they were getting ready to roll out. I was able to get them to start asking questions that they would like to answer if there was the potential to gather enough data to do so. We came up with different ways of capturing data on a new leader’s progress over the course of the year using xAPI.