Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Strategies for Integrating eLearning Content with Your LMS
1. Time Warner Cable Confidential
Strategies for Integrating
e-Learning Content with Your LMS
Presented by: William Paco
2. Time Warner Cable Confidential
Does Your Organization Use an LMS?
• Figure 1| Does Your Organization Use an LMS?
2
82%
90%
0% 20% 40% 60% 80% 100%
2009
2010
Yes
No
Source: ASTD Learning Circuits, 2010
3. Time Warner Cable Confidential
Challenges
0% 5% 10% 15% 20% 25% 30% 35% 40%
Other
Vendor Selection
Vendor Management
System Performance
System Administration
Standards Compliance
Management Buy-in
IT Buy-in
Integration with Legacy Systems
Employee Buy-in
Customization Requirements
Content Integration
3
• Figure 2| What are the Biggest Challenges in Implementing Your LMS (Select
All)
Source: ASTD Learning Circuits, 2010
4. Time Warner Cable Confidential
The Content Integration Challenge
According to a Bersin & Associates survey:
• “content integration” a critical problem
• Factors contributing to the content integration challenge :
– Multiple content sources: 10 – 30 different sources
– Multiple LMS’s: 35% companies have more than one LMS
– Integration costs: $150,000-$300,000 | 2-3 months to complete
Source: Bersin & Associates, 2004
4
5. Time Warner Cable Confidential
Learning
Objectives
Outcome
In this session you will learn:
• the basics of LMS/e-Learning standards
• questions to ask about your LMS to create
e-Learning standards
• tips for working with e-Learning developers
• tips to evaluate various rapid e-Learning
development tools for LMS integration
Establish Standards at YOUR company to:
• Reduce Integration Time
• Reduce Integration Costs
• Enhance developer and learner experience
5
6. Time Warner Cable Confidential
Introducing: The Time Warner Cable LMS
• Launched to all TWC Employees in late 2007 (45,000 total employees)
• Company learning strategy
Shift from 100% ILT 70% ILT and 30% eLearning
• In 2008…
– Integrated over 200 eLearning courses
– Worked with more than 10 different vendors / development tools
– Tracked 157,200 hours of eLearning training
• Today: Approximately 500 eLearning courses, 250,000 – 300,000
annual hours of training
6
8. Time Warner Cable Confidential
the basics of LMS/e-Learning standards
9. Time Warner Cable Confidential
Why Standards?
9
LMS
Company Standards
e-Learning
Course
Industry Standards
10. Time Warner Cable Confidential
e-Learning Industry Standards
10
AICC
• Aviation Industry CBT Committee
• Standards body and standard
• Formed in 1988
• 2 Web-Based Standards
• HAC-P (More Common)
• JavaScript
SCORM
• Shareable Content Object Reference
Model
• Advanced Distributed Learning
(government sponsored)
• Formed in 1997
• 2 Current Standards
• SCORM 1.2 (86%)*
• SCORM 2004 (48%)*
Sources: ADLNET.ORG, AICC.ORG
* Source: Brandon Hall, 2009
11. Time Warner Cable Confidential
Comparing AICC and SCORM
11
Consideration AICC SCORM
Packaging /
Deployment
X
Course
Development
X
Client Technical
Requirements
X
Cross-Site
Scripting
X
Sequencing /
Reusability
X
International X
12. Time Warner Cable Confidential
Data Tracking Elements
12
Common (BOTH) Advanced (SCORM)
Completion Status Interaction
Score Objectives
Bookmark Progress
Session Time
Exit
13. Time Warner Cable Confidential
Company Standards: e-Learning / LMS
13
LMS
Standards
Tracking
Standards
Development
Standards
Publication
Standards
Desktop
Standards
14. Time Warner Cable Confidential
Example: TWC LMS Standard
14
What is the Learning Management System used for at TWC?
The TWC Learning Management System will be solely used to track training courses and
training evaluations. To be considered a training course, the learning activity must meet
the following criteria:
Course Description - …
Learning Objectives - …
Program Consistency - …
Auditable - …
Course Interaction (for eLearning) - …
15. Time Warner Cable Confidential
questions to ask about your LMS to
create e-Learning standards
17. Time Warner Cable Confidential
Standards: Questions about your LMS/Vendor
17
LMS
Standards
Tracking
Standards
Development
Standards
Publication
Standards
Desktop
Standards
18. Time Warner Cable Confidential
TWC Standards – LMS Standards
18
LMS
Standards
Tracking
Standards
Development
Standards
Publication
Standards
Desktop
Standards
• Who is my LMS vendor?
• Is the LMS in-house or
outsourced?
• Who is able to administer
the LMS? Load e-Learning?
19. Time Warner Cable Confidential
LMS
Standards
Tracking
Standards
Development
Standards
Publication
Standards
Desktop
Standards
TWC Standards – Tracking Standards
19
• What e-learning industry
standard(s) does the LMS
support?
• What data elements is the
system able to track?
• What are the reporting
capabilities for e-learning
courses?
20. Time Warner Cable Confidential
LMS
Standards
Tracking
Standards
Development
Standards
Publication
Standards
Desktop
Standards
TWC Standards – Development Standards
20
• Does the LMS vendor have
an established relationship
with certain eLearning
vendors?
• What special requirements
or instructions should an
e-learning developer be
aware of?
21. Time Warner Cable Confidential
LMS
Standards
Tracking
Standards
Development
Standards
Publication
Standards
Desktop
Standards
TWC Standards – Publication Standards
21
• What support do I get from my
LMS vendor for e-Learning
integration?
• How do I upload content onto
the LMS?
• How do I handle content
updates on the LMS?
22. Time Warner Cable Confidential
LMS
Standards
Tracking
Standards
Development
Standards
Publication
Standards
Desktop
Standards
TWC Standards – Learner Standards
22
• What end-user technologies
are required to run
e-Learning from the LMS?
23. Time Warner Cable Confidential
TWC Standards – LMS Standards
23
LMS
LMS
Standards
Tracking
Standards
Development
Standards
Publication
Standards
Desktop
Standards
24. Time Warner Cable Confidential
tips for working with
e-Learning developers
25. Time Warner Cable Confidential
1. Establish e-learning integration standards
25
• LMS Delivery
• SCORM or AICC (AICC Preferred)
• Course Evaluation Link
• Session Time Tracking
• LMS Tracking
• Attempt Tracking
• Score Tracking
• Bookmark Tracking
LMS
Standards
Tracking
Standards
Development
Standards
Publication
Standards
Desktop
Standards
• Single Course Exit
• Course Interaction
• External Links / Resources
• Learner Desktop Standards
26. Time Warner Cable Confidential
2. Establish an e-learning publishing
process
26
Project Kickoff QA Production
ContentOwner
Learning
Technology
Both
Submit Project
Request
Schedule Kickoff
Meeting
Agreement
Submit Course
Package
Load Course to
QA LMS
QA Testing
Submit Project
Request
Schedule Kickoff
Meeting
Agreement
27. Time Warner Cable Confidential
3. Ask questions before / during
developer engagement
27
Questions before…
• Can you meet our development standards?
• Have you worked with our LMS / LMS vendor in the past?
• What tool are you using to develop the training?
• What technology will our learners need to run the e-learning?
Questions during Publishing / QA…
• What does a learner need to do to complete the course?
• Who do we work with from the developer for integration issues?
• What are the correct responses / test scenarios to use during QA?
28. Time Warner Cable Confidential
4. Test e-Learning Integration AHEAD
28
• Use sample / generic course from developer
• Resolve integration issues BEFORE final course development
29. Time Warner Cable Confidential
5. Provide developers access to your LMS
29
• Internal Developers – Access to view / upload courses
• External Developers – Access to external portal?
30. Time Warner Cable Confidential
tips to evaluate various rapid e-Learning
development tools for LMS integration
34. Time Warner Cable Confidential
2. Select which tools your company will support
34
• Use Free Demos
• Partnership with e-Learning developers
35. Time Warner Cable Confidential
3. Document processes for specific tools
35
• Established standard
settings for common rapid
development tools
• All courses follow standard
publication process
38. Time Warner Cable Confidential
Learning
Objectives
Outcome
In this session you will learn:
• the basics of LMS/e-Learning standards
• questions to ask about your LMS to create
e-Learning standards
• tips for working with e-Learning developers
• tips to evaluate various rapid e-Learning
development tools for LMS integration
Establish Standards at YOUR company to:
• Reduce Integration Time
• Reduce Integration Costs
• Enhance developer and learner experience
38
40. Questions to ask about your LMS to create
e-Learning Standards
• Who is my LMS vendor?
• Is the LMS in-house or outsourced?
• Who is able to administer the LMS? Load e-Learning?
• What e-learning industry standard(s) does the LMS support?
• What data elements is the system able to track?
• What are the reporting capabilities for e-learning courses?
• Does the LMS vendor have an established relationship with certain eLearning
vendors?
• What special requirements or instructions should an e-learning developer be
aware of?
• What support do I get from my LMS vendor for e-Learning integration?
• How do I upload content onto the LMS?
• How do I handle content updates on the LMS?
• What end-user technologies are required to run e-Learning from the LMS?
40
41. Tips for working with e-Learning developers
• Tip 1: establish e-Learning integration standards
• Tip 2: establish an e-learning publishing process
• Tip 3: ask questions before / during developer engagement
Questions before…
• Can you meet our development standards?
• Have you worked with our LMS / LMS vendor in the past?
• What tool are you using to develop the training?
• What technology will our learners need to run the e-learning?
Questions during Publishing / QA…
• What does a learner need to do to complete the course?
• Who do we work with from the developer for integration issues?
• What are the correct responses / test scenarios to use during QA?
• Tip 4: test e-Learning Integration AHEAD
• Tip 5: provide developers access to your LMS
41
42. Tips to evaluate various rapid e-Learning development
tools for LMS integration
• Tip 1: free demos are your friend!
• Tip 2: identify which tools your company will support
• Tip 3: document processes for specific tools
• Tip 4: create a development template (where possible)
42
Editor's Notes
Introduction
Demographic Check?
How many trainers do we have?
Training Coordinators?
How many of you are training developers?
How many of you are training managers?
Vendor Selection
Vendor Management
System Performance
System Administration
Standards compliance
Management buy-in
IT buy-in
Integration with Legacy Systems
Employee buy-in
Customization requirements
Content integration
According to a recent Bersin & Associates survey
81% cited “better content integration” as a critical problem they
felt should be solved. From multiple content sources to multiple LMS’s
to high integration costs, many factors contribute to the challenge of
content integration:
• Multiple sources of content—Most large organizations have 10 to
30 different sources of e-learning content, each with its own custom
software interface, presenting unique integration and upgrade
challenges. Bersin & Associates estimates that large enterprises (those
with 10,000 or more employees) have an average of 16 suppliers of
e-learning content and many have 30 or more.
• Multiple LMS’s—According to our latest survey of LMS buyers, 34%
of large organizations have more than one LMS. It is not uncommon
for larger enterprises to have 15 or more systems holding training
information. The more systems a company has, the more complex and
costly is the problem of integration.
Formidable content integration costs—It is not unusual for a content integration project with an off -the-shelf library of courses to cost $150,000-$300,000 and take two to three months to complete (not to mention updates that can each take an additional month). Some projects take up to five months to deploy and others simply never get off the ground because the technology challenges make them too costly to complete and/or the vendors involved don’t make them a priority. The cost of content integration can sometimes equal the cost of the library itself.”
What would it take to make an e-Learning course talk to an LMS (and vice versa) without standards?
Industry establish standards to simplify the integration of e-Learning content with Learning Management Systems
We at TWC have also established our own standards and recommend that other companies establish internal standards for the integration of content.
AICC
The original standard
Formed in 1988 by aviation manufacturers such as Boeing, Airbus, and McDonnell-Douglas to standardize the delivery of CBT as multimedia was becoming popular
First Web-
Predates networked eLearning as we know it today
Learning Management Systems (term coined in 2001)
What differences between SCORM 1.2 and SCORM 2004?
BOTTOM LINE – TWC Uses Both Standards
QUESTION, WHAT DO YOU WANT TO BE ABLE TO TRACK
Completion Status - Completion Status / Lesson Status
Score
Bookmark – Lesson Location
Session Time – Session Time
cmi.completion_status & cmi.lesson_status (cmi.core.lesson_status) – These data model elements are the most fundamental and important. They indicate when a user has finished a course and if he passed or failed. This fundamental information is essential to most LMS’s.
cmi.score.scaled (cmi.score.raw) – Indicates the score that the learner earned on any assessment within a SCO. Reporting a min and max score in conjunction with a raw score is also good form.
cmi.session_time (cmi.core.session_time) – Reports the amount of time that the learner spent in the SCO.
cmi.location (cmi.core.lesson_location) – Provides a free text field for the SCO to record a bookmark. If the SCO is bigger than just a couple HTML pages, it should consider implementing a bookmarking feature to let the learner resume a paused attempt.
cmi.exit (cmi.core.exit) – This value indicates how the learner is exiting the SCO. Setting cmi.exit to “suspend” will ensure that the current attempt is preserved and the run-time data is not reset the next time the SCO is launched. Setting cmi.exit to “” will indicate that the LMS should begin a new attempt with a new set of run-time data on the next launch of the SCO.
Industry norm expects all of the 1st tier data models elements to be used correctly in a SCO. Once that functionality has been enabled, the next most common data model elements, or 2nd tier, include:
interactions – Use the interactions data model elements to report the results of each question response. An interaction doesn’t have to be a traditional test answer. For instance, a SCO could document the learner’s choices as he progresses through a simulation. If possible, use all of the interactions elements to provide the most comprehensive picture of the learner’s responses. At a minimum, use “id”, “type”, “result” and “description” to allow LMS’s to provide basic reporting.
objectives – In large SCOs, consider reporting on the learner’s mastery of specific learning objectives using the objectives data model elements. Objectives allow for more granular reporting of the learner’s progress through and mastery of the training material.
cmi.progress_measure – Use the progress_measure element in SCORM 2004 to report the user’s progress towards completion of a SCO. The progress_measure is like a “percent complete” measure that would enable the LMS to provide a progress bar of overall completion of a course.
What other questions would you ask?
Training / L&D
Who is allowed to develop training for the LMS?
What do you want to track?
What is your internal quality assurance process?
Plan ahead for integration projects
Area
Rapid
Custom
Source
Off-the-Shelf Development Tool
Custom Developed Learning Platform / Shell
Ease of LMS Integration*
Easy with standards
Varies by developer skill level