Mapping the landscape
and driving the evolution
of learning technology
Mark Aberdour
Chief Technology
Officer
What the market feels like…
The range of solutions is
immense… making
supplier choices more
exciting, but also more
complicated and risker
than ever before.
Fosway Group
We get the sense that
neither learning leaders, nor
learning tech providers, quite
know how to make sense of
the market.
Redthread Research
Bloggers
Influencers
Thought leaders
Vendors
Who
do we
trust?
Where should I get my info?
If only we could make sense of it all!
Towards Maturity
Redthread Research
Brandon Hall Group
Learning & Performance
Institute
Elearning Guild
Fosway Group
LinkedIn
Open University
OFCOM
Open University
OFCOM
Good Practice
AI Now Institute
Educause
Corporate Learning Analytics Summit
Society for Learning Analytics Research
Journal of Learning Analytics
ARtillry Intelligence
So what do the researchers say?...
Deep dive: the learning technology ecosystem
A growing blend of tools and techniques
Introducing the learning technology ecosystem
Commoditization in the market
means tech providers can be
switched in and out of the tech
ecosystem.
Redthread Research
New players are carving out their
presence in corporate learning
ecosystems.
Fosway Group
Towards Maturity
How does the ecosystem stick together?
Mobile app
On the job learning
Simulations
Watching videos
Playing games
Social learning
ILT
E-learning
Learner
Browsing the web
Desktop learning
Laptop
Virtual classroom
A market of connected products…
The range of solutions is
immense… making
supplier choices more
exciting, but also more
complicated and risker
than ever before.
Fosway Group
Commoditization in the
market means tech providers
can be switched in and out
of the tech ecosystem.
Redthread Research
How can I scan the market to decide what should
go in my ecosystem?
Technology radar
Quadrants show different types
of products, whatever
categories work for you!
Rings indicate stage of
adoption:
o Adopt
o Trial
o Assess
o Hold
Brightwave technology radar group
Working group takes snapshot of the scene
and assesses key products.
We then populate our own company radar,
advising which products should be:
• Kept on the ‘watch list’,
• Trialed internally
• Trialed with ‘early adopter’ clients
• Offered in our solutions
• Learning delivery
• Content creation
• Intelligent systems
• Measurement and engagement
The Brightwave Radar
Implementing new products
How often do learning technologies
providers have a positive impact?
Source: Fosway Group, Digital Learning Realities
Research 2017
7%
27%
34%
22%
10%
Always
Frequently
Occasionally
Rarely
Never
Agile and user-centered approaches to
implementation
User needs
analysis
Pilot launch
Analyse
feedback
Resolve
before next
release
Release to
discrete
audiences
Measure
and engage
Measuring the impact of learning
Brandon Hall
Learner engagement
• Monthly reviews of usage
• Community and social engagement
• Learning programme usage
• Individual and group usage
Success benchmarking
• Usage goals
• Community engagement
• Wider system measures
• Track throughout the year
User feedback
• Face to face with stakeholder
• One-to-one user interviews
• Support tickets
• Surveys
Plenty of data to measure…
Source: City University, https://blogs.city.ac.uk
Measuring behaviour change
Wherever there is change, there is the need
to learn. Wherever there is learning, there is
the need to engage.
Brightwave have brought together specialist
capabilities from the worlds of marketing and
communications to help our clients engage
their audiences to drive behaviour change.
Whenever we engage, there is an opportunity
to measure.
Analytics to share successes
Highlighting best practice
Evidencing success
Amplifying engagement
Locating champions
Building on success with further content and
programmes
Mark Aberdour
Chief Technology
Officer
Speak to our consulting team!
Nick Eastham
Learning Technologies
Consultant
Amanda Rubython
Learning Technologies
Consultant
Elly Davies
Learning Experience
Consultant
Olivia Lory-Kay
Senior Consultant
Seffy Smith
Learning Consultant
Caroline Freeman
Director of Design
Thank you
Stand N20

Mapping the landscape of learning technology

  • 1.
    Mapping the landscape anddriving the evolution of learning technology
  • 2.
  • 3.
    What the marketfeels like… The range of solutions is immense… making supplier choices more exciting, but also more complicated and risker than ever before. Fosway Group We get the sense that neither learning leaders, nor learning tech providers, quite know how to make sense of the market. Redthread Research
  • 4.
  • 5.
    If only wecould make sense of it all! Towards Maturity Redthread Research Brandon Hall Group Learning & Performance Institute Elearning Guild Fosway Group LinkedIn Open University OFCOM Open University OFCOM Good Practice AI Now Institute Educause Corporate Learning Analytics Summit Society for Learning Analytics Research Journal of Learning Analytics ARtillry Intelligence
  • 6.
    So what dothe researchers say?...
  • 7.
    Deep dive: thelearning technology ecosystem
  • 8.
    A growing blendof tools and techniques
  • 9.
    Introducing the learningtechnology ecosystem Commoditization in the market means tech providers can be switched in and out of the tech ecosystem. Redthread Research New players are carving out their presence in corporate learning ecosystems. Fosway Group Towards Maturity
  • 10.
    How does theecosystem stick together? Mobile app On the job learning Simulations Watching videos Playing games Social learning ILT E-learning Learner Browsing the web Desktop learning Laptop Virtual classroom
  • 12.
    A market ofconnected products… The range of solutions is immense… making supplier choices more exciting, but also more complicated and risker than ever before. Fosway Group Commoditization in the market means tech providers can be switched in and out of the tech ecosystem. Redthread Research
  • 13.
    How can Iscan the market to decide what should go in my ecosystem?
  • 14.
    Technology radar Quadrants showdifferent types of products, whatever categories work for you! Rings indicate stage of adoption: o Adopt o Trial o Assess o Hold
  • 15.
    Brightwave technology radargroup Working group takes snapshot of the scene and assesses key products. We then populate our own company radar, advising which products should be: • Kept on the ‘watch list’, • Trialed internally • Trialed with ‘early adopter’ clients • Offered in our solutions
  • 16.
    • Learning delivery •Content creation • Intelligent systems • Measurement and engagement The Brightwave Radar
  • 19.
  • 20.
    How often dolearning technologies providers have a positive impact? Source: Fosway Group, Digital Learning Realities Research 2017 7% 27% 34% 22% 10% Always Frequently Occasionally Rarely Never
  • 21.
    Agile and user-centeredapproaches to implementation User needs analysis Pilot launch Analyse feedback Resolve before next release Release to discrete audiences Measure and engage
  • 22.
    Measuring the impactof learning Brandon Hall
  • 23.
    Learner engagement • Monthlyreviews of usage • Community and social engagement • Learning programme usage • Individual and group usage Success benchmarking • Usage goals • Community engagement • Wider system measures • Track throughout the year User feedback • Face to face with stakeholder • One-to-one user interviews • Support tickets • Surveys Plenty of data to measure…
  • 24.
    Source: City University,https://blogs.city.ac.uk
  • 25.
    Measuring behaviour change Whereverthere is change, there is the need to learn. Wherever there is learning, there is the need to engage. Brightwave have brought together specialist capabilities from the worlds of marketing and communications to help our clients engage their audiences to drive behaviour change. Whenever we engage, there is an opportunity to measure.
  • 26.
    Analytics to sharesuccesses Highlighting best practice Evidencing success Amplifying engagement Locating champions Building on success with further content and programmes
  • 27.
    Mark Aberdour Chief Technology Officer Speakto our consulting team! Nick Eastham Learning Technologies Consultant Amanda Rubython Learning Technologies Consultant Elly Davies Learning Experience Consultant Olivia Lory-Kay Senior Consultant Seffy Smith Learning Consultant Caroline Freeman Director of Design
  • 28.

Editor's Notes

  • #2 Hello and welcome Making sense of the ever changing learning technology landscape How to make sense of the market How to track interesting products in the market Some tips for implementing new products
  • #3 Who am I?
  • #4 The learning technologies market continued expansion merger and acquisition activity more niche, specialist vendors than ever before Niche solutions solving specific challenges and integrating with existing technologies average L&D team now uses over 20 different technologies to support their learning delivery!
  • #5 So many new products How do we understand the market Who do we listen to Lots of opinion How much of it is based on EVIDENCE?
  • #6 Key research reports from the last 12 months Common thread through multiple research studies Many analysts coming to the same conclusions Research from thousands of organisations What’s happening on the ground
  • #7 We picked out 12 key themes For example: - LMS isn’t dead, but it’s changing - xAPI still has no compelling business case - Lots of talk about measurement, social and mobile, but less action on the ground Immersive and AI are ripe for experimenting, but tread carefully Sign up for the digital download…
  • #8 One area of particular interest Relates to the growing product market Especially WRT niche, specialist vendors STACK or ECOSYSTEM
  • #9 Social learning AI Mobile ILT Immersive Video Microlearning
  • #10 Niche solutions solving specific challenges. Integrate really well with existing technologies Swap in and out of the stack with relative ease – commoditization. Performance support, continuous improvement, knowledge management, workplace support and curated content. They want to complement your LMS, not replace it. LMS usage has actually risen over the past 2 years If you're in the market for an LMS, look for something modular and integration-friendly.
  • #11 API just a standard way of sharing data between systems Also used for authenticating between systems (e.g. login to a site using your Facebook login) Explosion of new products on the market use APIs to connect with each other Many people are hung up on xAPI: HOWEVER multiple research studies show it is not gaining traction and that LRS usage is decreasing ‘Understanding xAPI’ found to be one of the top challenges.
  • #12 APIs are mainstream, API companies even advertising on billboards! APIs are enabling the explosion of new services and products without having to code apps from scratch E.g. when you use Uber you use Twilio (for all the SMS messaging), Braintree (for payment services) and Google Maps (for drivers) Barriers to entry are lowered. E.g. Lift uses the same API services! Anyone can do a startup based on APIs
  • #13 Which brings us back to… So how do you manage that risk?
  • #14 So we’ve look at the crazy market We know an average org has 20+ learning technology products And we’ve seen how products are tied together into ecosystems So how to you track which products to use?
  • #15 The Radar is all about tracking interesting products. Products are organised onto the Radar using two elements: Quadrants represent different categories of products or tools, whatever categories work for you. Rings indicate what stage in an adoption lifecycle the advisory board thinks they should be in: adopt, trial, assess or hold. https://www.thoughtworks.com/radar
  • #16 Brightwave staff can all add interesting products into a shared spreadsheet. Radar group takes a snapshot of the spreadsheet and assesses the products. We then populate our own company radar, advising which products should be: Kept on the ‘watch list’, Trialed internally Trialed with ‘early adopter’ clients Offered in our solutions
  • #17 Learning delivery: LMS, virtual classrooms, social learning, video sharing, content curation, immersive learning. Content creation: Products used in the creation of digital learning: immersive, games, interactive media, elearning, animations, scenarios, infographics. Intelligent systems: Products using AI to deliver learning including chatbots, adaptive learning, recommendation engines, voice recognition tools. Measurement and engagement: Business intelligence, learning analytics, online assessment, competency management, performance management, engagement
  • #18 Simple web based tool Print or save as a PDF
  • #19 We think this is interesting and we’d like to share it It’s products of interest to our business But we think you’ll find it useful… Come to stand and sign up for it, plus consulting team could help set similar framework up for you!
  • #20 So we ‘ve looked at: How to make sense of the market How to track interesting products in the market Now we’re going to look at some tips for implementing new products
  • #21 Only one third doing what we want to be. BW NPS shows we are working in that top third! Bear in mind this covers internal teams and external vendors
  • #22 All sorts of things can be done to ease the implementation. This is how WE keep out of that two thirds of vendors who disappoint their customers. User needs analysis: What do users REALLY want? Pilot: Avoid big bang rollouts, find issues early Analyse: Collate user feedback, analyse usage data Resolve: Amend before release. Step it up: Launch to discrete audiences in turn Measure and engage: track engagement, respond to results, run campaigns, organise into 2-weekly sprints. Going to take a closer look at ’measure and engage’
  • #23 Impact measurement is a long-standing problem in the L&D sector. All the research was unanimous in that hardly anyone is measuring the impact of learning on performance and business results (Towards Maturity, Fosway, Brandon Hall, GoodPractice)
  • #24 All those APIs! Everything is already in place: measure across the ecosystem and push data into a centralised system. We have the means to measure like never before, but knowing what to look at and making it happen are different problems. Before implementing learning analytics, decide exactly WHAT you are going to measure, and what subsequent changes you can realistically make. Some people using learning analytics tools, other using BI tools. A split is emerging.
  • #25 Higher Ed is way ahead of corporate learning wrt learning analytics Many institutions using of predictive analytics to identify at-risk students, and then intervening as appropriate The KEY is that they KNOW what they want to measure. The key success criteria in their case is PASSING a course, so they look for at-risk students. What do we want to measure in workplace learning?
  • #26 So what DO we need to measure in the workplace… Compliance, culture, leadership, innovation
  • #28 Brightwave is not just digital content and tessello LMS, our team of consultants are technology agnostic and the best in the industry! Select the right learning technology products Supercharge your existing learning systems Engage your learners more effectively
  • #29 Come and see our Learning Solution of the Year!