Jim Box
Sr. Manager, Learning and Development
October 27, 2016
How Digitization is Disrupting Education
and What Cisco is Doing About it
Disrupt or Be Disrupted
1. Virtual/Augmented Reality
2. Artificial Intelligence/Machine Learning
3. Natural Language Processing
4. Analytics/Big Data
Are these topics part of your
everyday conversations?
Learning@Cisco
A Little About Us
Job Role
• JRA/JTA
• Exam Blueprint
and sets Domains
Certification-Based
Industry Standard
Segregate Exam
and Course
Development
ANSI and DOD
Talent Enablement
Fill the Talent Gap
3 x 5
P & L
Resell through LP
Channel
For Profit Business
Instructor-Led Training
Journey Of Talent Development
2008 2009 2010 2011 2012 2013 2014 2015 2016 2017
Industry
Transforming
TRAINING EDUCATION SERVICES KNOWLEDGE SERVICES
Physical and
Online
Classrooms
Virtual
Classrooms and
Communities
Personalized
Just-in-Time
Learning
• New platforms
• Dynamic content creation
• Co-created services
• Market-ready blended solutions
• Customized educational
solutions
Digital Disruption
MACHINE LEARNING
MOOC
RENEWABLE ENERGY
CITIZEN ACTIVISM
NATURAL LANGUAGE PROCESSING
INTERACTIVE HEALTHCARE
VIDEO SURVEILLANCE REMOTE MONITORING
ARTIFICIAL INTELLIGENCE
The World is
Changing
Quickly
GLOBALIZATION
Requires Innovation and Doing Business Differently
What Do these Companies Have in Common?
“Over the coming decade NO industry will
escape profound digital disruption to the
very nature of what it makes and serves.”
Digital Disruption is Everywhere
Mark Raskino
Gartner
Major Industry Digital Disruption
Point-of-Sale
Print
Advertising
CarHotel
Bookstore Taxi Music
Digital Disruption of Industry Example
Our
Moment?
The Digital Lesson …
.
Don’t be afraid to cannibalize your own
business in the name of progress.
This is seen time and again in the digital
revolution.
By the time Kodak had both feet fully in
the digital game, it had been outclassed
by more nimble competitors with better
products.
Education Disrupted
Workforce Trends
A Learner’s World Has Changed
Homework
Library
Classroom Lecture
A generation ago…
Learner
TelePresence
session
National
newspaper
feed
Chemist
broadcast
session
Virtual
lab
IM
scientist
Classroom
lectureExpert
blog
Class
lecture
VOD
Video
phone call
RSS
Open
courseware
Government
research
organization
Game
Newsletter
Expert
Website
with TA
Chemistry club
Twitter
Primate
community
Fauna
community
International newspaper
feed
GPS
to meeting
International library
virtual collection
Museum click-to-talk
iTunes U
podcast
Museum
virtual tour
Museum
National museum
virtual collection
Periodicals
Second Life museum
tour
Botany
community
vBlog
Telephone
Radio & TV
Chemistry
community
Learning Today
Cisco Confidential 16
SHORTER ATTENTION SPANS …
The average attention span in 2000 12 seconds
The average attention span in 2015 8.25 seconds
The average attention span of a goldfish 9 seconds
% of people who can really multitask effectively 2%
… MORE DIGITAL DISTRACTIONS
Average consumption of information per day (outside work)
34 gigabytes/12
hrs
Average length watched of a single internet video 2.7 minutes
# of times the average person checks their smartphone daily 150
Frequency the average worker switches tasks per day every 3 minutes
# of times the average worker glances attheir email inbox 30/per hour
Number of browser tabs the average user keeps open 10-14
Source: National Center for Biotechnology Information
“Digital learning, the most important innovation since the
printing press, offers surprising advantages even for
students with access to the best educational resources.”
L. Rafael Reif
President, Massachusetts Institute of Technology
Education is being Digitally Remastered Too
 Technology is disrupting education, expanding the
education ecosystem beyond traditional lecture halls
and classrooms to accommodate learners'
preferences for time, place, style and previous
levels of attainment.
 90% of U.S. children are online by third grade.
 70% of primary and secondary schools in the UK
now use tablet computers.
 39% of middle schoolers use smart phones for
homework, 31% use tablets for homework.
 Students using iPad outperformed the non-iPad
students in every literacy measure they were tested
on.
Sources: Verizon Foundation, MARC 2011 Survey Grades 3-12, and Gartner Research
iPad in Education Results, Apple, October 2014
http://www.bbc.com/news/education-30216408, Dec 2014
Learning is everywhere… and just-in-time!
Source: Reimagining L&D Capabilities to Drive Continuous Learning, Bersin
by Deloitte, March 2015
“With the Continuous
Learning Model,
there is a new focus
on the development
of the learner in a
holistic sense - not
just formal learning.”
The Digital Learners
Transformation
“In the next five years, the world of education is
going through one of the most massive changes
it has seen in the last three thousand years. It’s a
perfect storm.”
Nolan Bushnell, Founder Brainrush
“Serious Games And The Future Of Education”
Forbes, September 2013
We’ve been doing the same thing for 100 years
How is digitalization disrupting education?
Unbundled
Flexibility Removing barriers of access
Untethering learning opportunity from
physical location or time
Learner can review, repeat or skip content
as needed
Unbundling Creating libraries of topics that frees up
content for specific, moment-of-need learning
Topics can also be “re-bundled” for deeper
learning needs.
Learning Analytics
Instructor/Mentor
Data Collection, Visualization,
Feedback loop
Adaptive & Personalized
Track performance toward outcomes
Respond with Proactive Remediation
Monitor progress
Are you planning for
Digital Disruption?
5 Generations in the Workforce
Attention span of a goldfish
Can you see your
Kodak moment coming?
Are You Willing to Disrupt yourself
Don’t always take the easy way
What L@C is doing?
Tools End-to-End
Processes
Templates
Training/Support
New
Skills/Talent
Mindset
New Delivery Formats
• NEW online learning Platform
• NEW ePub “Digital Student Kit”
2012 2013 2015 2016Item Item
Reinvent Learning
• Learning through Labs
• JIT Learning
• Multimodal Learning
Dashboard &
Learning Analytics
Measurable learning outcomes
Learner analytics
The “Big Bang”
• Transition to XML/Single-
source authoring
THEN NOW
Word & PPT
ILT courses w/ printed
SG, LG, CAG
Digital Learning
Library
• Comprehensive Library
• Video Instruction
• Practice Exams
PBF to PBM
• Process Change
• Agile maintainence
model
Budget Run-the-BusinessPortfolio
Build Plan
2014
Intelligent Content Creation Process
Content Repository DTDs
Learning
Partners
Other
Sources
Mobile
Student
Kit
Instructor Kit
OutputXlator
Book Map
Topic
Map
Topic
Topic
Map
Topic
Book Map
Topic
Map
Topic
Topic
Map
Topic
Topic
Topic
Topic
Topic
Topic
Topic
Topic
TopicTopic
Topic
Topic
Topic
Topic
eKit
ELT
Rules
Develop
Design
Process
Learning@Cisco
Tools End-to-End
Processes
Templates
Training/Support
New
Skills/Talent
Mindset
Backend DB
• DB performace issues
• Went to No-SQL DB
• Not Relational DB more
JSON
2017Item Item
XML Template 2
• More Structured
• ID built in to mandate dev path
• Required many many templates
changes
Build in the tool
Desing in XML tool
Develop in XML tool
Publish in XML tool
Stop using Word and PPT
2013 Future
XML Template v1
Everything spelled out
Instructional Design Rules
Re-Use
• Evolved our re-use plan
• Structured Authoring
• Re-use w SA did not work
for our content needs
• Build once use many times
XML Template 4
• Remove all the embedded
instructions
• Lego Brick approach – Base
template with snap on modules
• Documented Guidelines
Operationalize ScaleInnovate
2014 2015 2016
Tagging
Build for Knowledge Servcies
Just in time learning
Concurrent FCS
Multiple Outputs
85% Shared Content
Single Development Effort
Single-Source  Multiple Outputs  One FCS
ILT
85%SHARED
CONTENT
PPT
PDF
EPUB
CL
L
LABS
LABS
VIDEOS
ASSESSMENTS
HTML5
ELT
PPT
PDF
LAB
S
>_
EPUB
Q&
A
VIDEOS
EAIs
HTML
The Business side
Tools End-to-End
Processes
Templates
Training/Support
New
Skills/Talent
Mindset
TTM 8 Months
• 85% Re-Use
2017Item Item
Single Source Dev
• Same XML Source builds ELT and
ILT outputs
• ILT First provided 85% of ELT
Content
Rapid Re-Fresh
Only update the changes
Keep content current
TTM 12 Months
2 teams
2 projects
2013 Future
Separate
Development
ILT and ELT developed in
parallel, but seperately
42:1 Dev Ratio
• 95% Re-use
• Multipule Product single
development effort
E-First
• Build ELT first then leverage
the assets needed for ILT
• More efficient and higher
quality products
Operationalize ScaleInnovate
2014 2015 2016
Development Ratios / Cost - Summary
ILT, Level 1 eLearning (Basic), Level 2 eLearning (Interactive), Level 3 eLearning (Advanced)
Rapid
Development,
Simple Projects
Average
Typical
Project
Average
Cost per-
finished hour
Advanced,
Complex,
More Media
Learning@Cisco
Single Sourced
Development
(ILT, ELT, etc.)
Instructor-Led
Training (ILT) 22:1 43:1 $5,934 82:1 8 Months
Single Source
(1,400h Dev /
32.5h output)
41.8:1
Level 1 eLearning
(Basic) – Content
Pages and
Assessment
49:1 79:1 $10,054 125:1
Level 2 eLearning
(Interactive) – Level
1, plus 25%+
interactive exercises
127:1 184:1 $18,583 267:1
Level 2.5
$10,442
Level 3 eLearning
(Advanced) –
Simulations, Games,
Award Winning type
217:1 490:1 $50,371 716:1
Digital Education is Here
Are you Ready?
What do you think Tomorrows Learner looks like?
Formal Learning Informal Learning
Explicit Knowledge Tacit Knowledge
Universal
Knowledge
(Theory / Standards)
(Routinized Work)
Experiential
Knowledge
(Practice)
(Highly Variable Work)
Expert
Routine
Work
(Process)
Technical
Work
(Complex
Process)
Trade / Craft
Work
(Situational
Variability)
Knowledge
Work
(Reason,
Synthesis,
Highly Variable)
Intermediate
Novice
Differing Learning and Knowledge Needs
GEN 2020 MILLENNIALS GEN X BOOMERS TRADITIONALISTS
Learning Preferences
Change is inevitable
“It is not the strongest of the
species that survives, nor the
most intelligent that survives.
It is the one that is most
adaptable to Change”
Charles Darwin
What’s Wrong with this Picture?
 Are you prepared to meet the needs of the
Continuous Learner?
 Is your Learning Formative and Summative?
 Can you accommodate Micro Credentialing?
 What is your Digital Delivery Strategy?
 Are your product development tools,
systems and infrastructure ready to support
a digital education world?
What’s Trending…
Personalized: Flexible, Unbundled, Relevant, Knowledge Service
Artificial Intelligence: Robots, Bots, Machine Learning, Natural Language Processing
Virtual Reality: Immersive Experience, Improve Retention
Life Long Learner: Continuous Learning, Validation, Micro Credentials, Micro Course
Digital Analytics: TinCanApi, All Interactions, Multi-faceted, Adaptive Learning
“If you don’t like change, you’re going to like
irrelevance even less”
General Eric Shinseki
34th Chief of Staff, Army
Jim Box
Sr. Manager Learning and Development
Cisco
Responsible for Learning@Cisco’s Content Development team
which provides research, engineering, design, development, and
manufacturing of Cisco’s customer-facing education and
certification products. With the goal of growing global talent in the
networking industry, Jim and his team are chartered with creating
best-in-class career certification course and assessment products
for use by Cisco’s customers, partners and employees. Jim also
focuses on the impacts of technology and digitalization on Adult
education pedagogy and learner performance. Most recently Jim
has been overseeing Cisco’s transformation to digital delivery and
XML-based, single-source development with the goal of enabling
performance support and knowledge services for Cisco
customers.

The Future of Learning

  • 1.
    Jim Box Sr. Manager,Learning and Development October 27, 2016 How Digitization is Disrupting Education and What Cisco is Doing About it Disrupt or Be Disrupted
  • 2.
    1. Virtual/Augmented Reality 2.Artificial Intelligence/Machine Learning 3. Natural Language Processing 4. Analytics/Big Data Are these topics part of your everyday conversations?
  • 3.
  • 4.
    A Little AboutUs Job Role • JRA/JTA • Exam Blueprint and sets Domains Certification-Based Industry Standard Segregate Exam and Course Development ANSI and DOD Talent Enablement Fill the Talent Gap 3 x 5 P & L Resell through LP Channel For Profit Business
  • 5.
  • 6.
    Journey Of TalentDevelopment 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 Industry Transforming TRAINING EDUCATION SERVICES KNOWLEDGE SERVICES Physical and Online Classrooms Virtual Classrooms and Communities Personalized Just-in-Time Learning • New platforms • Dynamic content creation • Co-created services • Market-ready blended solutions • Customized educational solutions
  • 7.
  • 8.
    MACHINE LEARNING MOOC RENEWABLE ENERGY CITIZENACTIVISM NATURAL LANGUAGE PROCESSING INTERACTIVE HEALTHCARE VIDEO SURVEILLANCE REMOTE MONITORING ARTIFICIAL INTELLIGENCE The World is Changing Quickly GLOBALIZATION Requires Innovation and Doing Business Differently
  • 9.
    What Do theseCompanies Have in Common?
  • 10.
    “Over the comingdecade NO industry will escape profound digital disruption to the very nature of what it makes and serves.” Digital Disruption is Everywhere Mark Raskino Gartner
  • 11.
    Major Industry DigitalDisruption Point-of-Sale Print Advertising CarHotel Bookstore Taxi Music
  • 12.
    Digital Disruption ofIndustry Example
  • 13.
    Our Moment? The Digital Lesson… . Don’t be afraid to cannibalize your own business in the name of progress. This is seen time and again in the digital revolution. By the time Kodak had both feet fully in the digital game, it had been outclassed by more nimble competitors with better products.
  • 14.
  • 15.
  • 16.
    A Learner’s WorldHas Changed Homework Library Classroom Lecture A generation ago… Learner TelePresence session National newspaper feed Chemist broadcast session Virtual lab IM scientist Classroom lectureExpert blog Class lecture VOD Video phone call RSS Open courseware Government research organization Game Newsletter Expert Website with TA Chemistry club Twitter Primate community Fauna community International newspaper feed GPS to meeting International library virtual collection Museum click-to-talk iTunes U podcast Museum virtual tour Museum National museum virtual collection Periodicals Second Life museum tour Botany community vBlog Telephone Radio & TV Chemistry community Learning Today Cisco Confidential 16
  • 17.
    SHORTER ATTENTION SPANS… The average attention span in 2000 12 seconds The average attention span in 2015 8.25 seconds The average attention span of a goldfish 9 seconds % of people who can really multitask effectively 2% … MORE DIGITAL DISTRACTIONS Average consumption of information per day (outside work) 34 gigabytes/12 hrs Average length watched of a single internet video 2.7 minutes # of times the average person checks their smartphone daily 150 Frequency the average worker switches tasks per day every 3 minutes # of times the average worker glances attheir email inbox 30/per hour Number of browser tabs the average user keeps open 10-14 Source: National Center for Biotechnology Information
  • 18.
    “Digital learning, themost important innovation since the printing press, offers surprising advantages even for students with access to the best educational resources.” L. Rafael Reif President, Massachusetts Institute of Technology
  • 19.
    Education is beingDigitally Remastered Too  Technology is disrupting education, expanding the education ecosystem beyond traditional lecture halls and classrooms to accommodate learners' preferences for time, place, style and previous levels of attainment.  90% of U.S. children are online by third grade.  70% of primary and secondary schools in the UK now use tablet computers.  39% of middle schoolers use smart phones for homework, 31% use tablets for homework.  Students using iPad outperformed the non-iPad students in every literacy measure they were tested on. Sources: Verizon Foundation, MARC 2011 Survey Grades 3-12, and Gartner Research iPad in Education Results, Apple, October 2014 http://www.bbc.com/news/education-30216408, Dec 2014
  • 20.
    Learning is everywhere…and just-in-time! Source: Reimagining L&D Capabilities to Drive Continuous Learning, Bersin by Deloitte, March 2015 “With the Continuous Learning Model, there is a new focus on the development of the learner in a holistic sense - not just formal learning.”
  • 21.
  • 22.
    “In the nextfive years, the world of education is going through one of the most massive changes it has seen in the last three thousand years. It’s a perfect storm.” Nolan Bushnell, Founder Brainrush “Serious Games And The Future Of Education” Forbes, September 2013
  • 23.
    We’ve been doingthe same thing for 100 years
  • 24.
    How is digitalizationdisrupting education? Unbundled
  • 25.
    Flexibility Removing barriersof access Untethering learning opportunity from physical location or time Learner can review, repeat or skip content as needed
  • 26.
    Unbundling Creating librariesof topics that frees up content for specific, moment-of-need learning Topics can also be “re-bundled” for deeper learning needs.
  • 27.
    Learning Analytics Instructor/Mentor Data Collection,Visualization, Feedback loop Adaptive & Personalized Track performance toward outcomes Respond with Proactive Remediation Monitor progress
  • 28.
    Are you planningfor Digital Disruption? 5 Generations in the Workforce Attention span of a goldfish Can you see your Kodak moment coming? Are You Willing to Disrupt yourself Don’t always take the easy way
  • 29.
  • 30.
    Tools End-to-End Processes Templates Training/Support New Skills/Talent Mindset New DeliveryFormats • NEW online learning Platform • NEW ePub “Digital Student Kit” 2012 2013 2015 2016Item Item Reinvent Learning • Learning through Labs • JIT Learning • Multimodal Learning Dashboard & Learning Analytics Measurable learning outcomes Learner analytics The “Big Bang” • Transition to XML/Single- source authoring THEN NOW Word & PPT ILT courses w/ printed SG, LG, CAG Digital Learning Library • Comprehensive Library • Video Instruction • Practice Exams PBF to PBM • Process Change • Agile maintainence model Budget Run-the-BusinessPortfolio Build Plan 2014
  • 31.
    Intelligent Content CreationProcess Content Repository DTDs Learning Partners Other Sources Mobile Student Kit Instructor Kit OutputXlator Book Map Topic Map Topic Topic Map Topic Book Map Topic Map Topic Topic Map Topic Topic Topic Topic Topic Topic Topic Topic TopicTopic Topic Topic Topic Topic eKit ELT Rules Develop Design Process Learning@Cisco
  • 32.
    Tools End-to-End Processes Templates Training/Support New Skills/Talent Mindset Backend DB •DB performace issues • Went to No-SQL DB • Not Relational DB more JSON 2017Item Item XML Template 2 • More Structured • ID built in to mandate dev path • Required many many templates changes Build in the tool Desing in XML tool Develop in XML tool Publish in XML tool Stop using Word and PPT 2013 Future XML Template v1 Everything spelled out Instructional Design Rules Re-Use • Evolved our re-use plan • Structured Authoring • Re-use w SA did not work for our content needs • Build once use many times XML Template 4 • Remove all the embedded instructions • Lego Brick approach – Base template with snap on modules • Documented Guidelines Operationalize ScaleInnovate 2014 2015 2016 Tagging Build for Knowledge Servcies Just in time learning
  • 33.
    Concurrent FCS Multiple Outputs 85%Shared Content Single Development Effort Single-Source  Multiple Outputs  One FCS ILT 85%SHARED CONTENT PPT PDF EPUB CL L LABS LABS VIDEOS ASSESSMENTS HTML5 ELT PPT PDF LAB S >_ EPUB Q& A VIDEOS EAIs HTML
  • 34.
  • 35.
    Tools End-to-End Processes Templates Training/Support New Skills/Talent Mindset TTM 8Months • 85% Re-Use 2017Item Item Single Source Dev • Same XML Source builds ELT and ILT outputs • ILT First provided 85% of ELT Content Rapid Re-Fresh Only update the changes Keep content current TTM 12 Months 2 teams 2 projects 2013 Future Separate Development ILT and ELT developed in parallel, but seperately 42:1 Dev Ratio • 95% Re-use • Multipule Product single development effort E-First • Build ELT first then leverage the assets needed for ILT • More efficient and higher quality products Operationalize ScaleInnovate 2014 2015 2016
  • 36.
    Development Ratios /Cost - Summary ILT, Level 1 eLearning (Basic), Level 2 eLearning (Interactive), Level 3 eLearning (Advanced) Rapid Development, Simple Projects Average Typical Project Average Cost per- finished hour Advanced, Complex, More Media Learning@Cisco Single Sourced Development (ILT, ELT, etc.) Instructor-Led Training (ILT) 22:1 43:1 $5,934 82:1 8 Months Single Source (1,400h Dev / 32.5h output) 41.8:1 Level 1 eLearning (Basic) – Content Pages and Assessment 49:1 79:1 $10,054 125:1 Level 2 eLearning (Interactive) – Level 1, plus 25%+ interactive exercises 127:1 184:1 $18,583 267:1 Level 2.5 $10,442 Level 3 eLearning (Advanced) – Simulations, Games, Award Winning type 217:1 490:1 $50,371 716:1
  • 37.
    Digital Education isHere Are you Ready?
  • 38.
    What do youthink Tomorrows Learner looks like?
  • 39.
    Formal Learning InformalLearning Explicit Knowledge Tacit Knowledge Universal Knowledge (Theory / Standards) (Routinized Work) Experiential Knowledge (Practice) (Highly Variable Work) Expert Routine Work (Process) Technical Work (Complex Process) Trade / Craft Work (Situational Variability) Knowledge Work (Reason, Synthesis, Highly Variable) Intermediate Novice Differing Learning and Knowledge Needs GEN 2020 MILLENNIALS GEN X BOOMERS TRADITIONALISTS Learning Preferences
  • 40.
    Change is inevitable “Itis not the strongest of the species that survives, nor the most intelligent that survives. It is the one that is most adaptable to Change” Charles Darwin
  • 41.
    What’s Wrong withthis Picture?  Are you prepared to meet the needs of the Continuous Learner?  Is your Learning Formative and Summative?  Can you accommodate Micro Credentialing?  What is your Digital Delivery Strategy?  Are your product development tools, systems and infrastructure ready to support a digital education world?
  • 42.
    What’s Trending… Personalized: Flexible,Unbundled, Relevant, Knowledge Service Artificial Intelligence: Robots, Bots, Machine Learning, Natural Language Processing Virtual Reality: Immersive Experience, Improve Retention Life Long Learner: Continuous Learning, Validation, Micro Credentials, Micro Course Digital Analytics: TinCanApi, All Interactions, Multi-faceted, Adaptive Learning
  • 43.
    “If you don’tlike change, you’re going to like irrelevance even less” General Eric Shinseki 34th Chief of Staff, Army
  • 45.
    Jim Box Sr. ManagerLearning and Development Cisco Responsible for Learning@Cisco’s Content Development team which provides research, engineering, design, development, and manufacturing of Cisco’s customer-facing education and certification products. With the goal of growing global talent in the networking industry, Jim and his team are chartered with creating best-in-class career certification course and assessment products for use by Cisco’s customers, partners and employees. Jim also focuses on the impacts of technology and digitalization on Adult education pedagogy and learner performance. Most recently Jim has been overseeing Cisco’s transformation to digital delivery and XML-based, single-source development with the goal of enabling performance support and knowledge services for Cisco customers.