This presentation by Learning Ninja's Sean Putman highlights the need to consider a data strategy before developing xAPI enabled learning content. Sean shares his experience with defining what needs to be tracked keeping value and end metrics in mind.
4. Know Your Data
What makes the data come into being?
How hard is it to get the data I
want/need?
What’s my Data Supply Chain?
5. Data Supply Chain
Activity Providers
Systems architecture
Data management, ownership, and
accessibility
Potential Data Integration concerns
What’s “good enough”?
7. Content Strategy
Content
What activities can provide measurable data?
Analysis
What data can we (and should we) act
on?
Technical
What data can we get from our systems?
24. What Do You Want to Know?
Participation
Performance
25. Participation Related
• How are people using resources available?
• How much time are they spending?
• What elements/resources are proving useful?
• What aspects of participation affect results?
• What aspects of participation affect completions?
26. Performance Related
• Are we teaching the right things?
• How does course performance correspond
to job performance?
• Did X have the desired effect on Y?
WE are going to talk about data in the intitial design process. And the use of data to assess the effectiveness of the learning intervention and provide for future design improvements.
Pp 101 -105
Needs analysis
Gap analysis
Strategic Road Map
Phased by Ease/Feasibility/Need – Road Blocks / Anticipated Costs
Road Map Scoring - Criteria Definition (for example: Ease, Importance, Impact/Benefit, Cost, Strategic Fit) - Scoring and Prioritization of Road Map Items
We are looking for confirmation that the learner go what they needed to know. And we can ask the question
We need to figure out what change means to us. If we were just looking to see how many people accessed something numbers are enough. When it comes to really seeing what behavior change our interventaion has made we need to figure out how we measure the change. So we need to figure out
WE are looking at Collecting more than just completions and test scores, but if we are collecting completions and test scores, what does it actually mean. If I score a 90% on a quiz how does that affect my job performance? What path did I take to get to the quiz, does that affect my score. Why did I miss the last 10%? Was there a job role that scored better than others? Why?
Data strategy
L&D Owners
L&D Customers
Data Owners
Data Customers