1. Jim Spohrer (IBM)
San Jose, CA & San Francisco, CA USA
Wednesday October 25, 2017
http://www.slideshare.net/spohrer/berkeley-innovation-forum-20171025-v1
10/25/2017 1
IBM’s Service Journey
12. Questions
• What is the timeline for solving AI and IA?
• Who are the leaders driving AI progress?
• What will the biggest benefits from AI be?
• What are the biggest risks associated with AI, and
are they real?
• What other technologies may have a bigger
impact than AI?
• What are the implications for stakeholders?
• How should we prepare to get the benefits and
avoid the risks?
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 12
13. Every 20 years, compute costs are down
by 1000x
• Cost of Digital Workers
– Moore’s Law can be thought of as
lowering costs by a factor of a…
• Thousand times lower
in 20 years
• Million times lower
in 40 years
• Billion times lower
in 60 years
• Smarter Tools (Terascale)
– Terascale (2017) = $3K
– Terascale (2020) = ~$1K
• Narrow Worker (Petascale)
– Recognition (Fast)
– Petascale (2040) = ~$1K
• Broad Worker (Exascale)
– Reasoning (Slow)
– Exascale (2060) = ~$1K
1310/25/2017 (c) IBM 2017, Cognitive Opentech Group
2080204020001960
$1K
$1M
$1B
$1T
206020201980
+/- 10 years
$1
Person Average
Annual Salary
(Living Income)
Super Computer
Cost
Mainframe Cost
Smartphone Cost
T
P
E
T P E
AI Progress on Open Leaderboards
Benchmark Roadmap to solve AI/IA
14. GPD/Employee
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 14
(Source)
Lower compute costs translate into increasing productivity and GDP/employees for nations
Increasing productivity and GDP/employees should translate into wealthier citizens
AI Progress on Open Leaderboards
Benchmark Roadmap to solve AI/IA
15. Leaderboards Framework
AI Progress on Open Leaderboards - Benchmark Roadmap
Perceive World Develop Cognition Build Relationships Fill Roles
Pattern
recognition
Video
understanding
Memory Reasoning Social
interactions
Fluent
conversation
Assistant &
Collaborator
Coach &
Mediator
Speech Actions Declarative Deduction Scripts Speech Acts Tasks Institutions
Chime Thumos SQuAD SAT ROC Story ConvAI
Images Context Episodic Induction Plans Intentions Summarizatio
n
Values
ImageNet VQA DSTC RALI General-AI
Translation Narration Dynamic Abductive Goals Cultures Debate Negotiation
WMT DeepVideo Alexa Prize ICCMA AT
Learning from Labeled Training Data and Searching (Optimization)
Learning by Watching and Reading (Education)
Learning by Doing and being Responsible (Exploration)
2015 2018 2021 2024 2027 2030 2033 2036
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 15
Which experts would be really surprised if it takes less time… and which experts really surprised if it takes longer?
Approx.
Year
Human
Level ->
16. Icons of AI
Progress
• 1956: Dartmouth Conference
organized by:
– John McCarthy (Dartmouth, later
Stanford)
– Marvin Minsky (MIT)
– and two senior scientists:
• Claude Shannon (Bell Labs)
• Nathan Rochester (IBM)
• 1997: Deep Blue (IBM) - Chess
• 2011: Watson Jeopardy! (IBM)
• 2016: AlphaGo (Google DeepMinds)
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 16
18. AI Leaders
• Who is winning?
– Regions China vs USA vs EU vs ROW
– Companies Microsoft vs Google vs IBM
• Leaderboards
– SQuAD – Question Answering
– EFF Measuring AI Progress
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 18
19. AI to IA Timeline: Hard unsolved AI
problems
• 2012-2017 AI Pattern Recognition and
Learning from Massive Labeled Data
– Speech, image, translation, driverless, games
– Chatbots as digital assistants
• 2018 Video Understanding
• 2021 Episodic Memory
• 2022 Learning from Watching
• 2024 Commonsense Reasoning
• 2026 Learning from Reading
• 2028 Learning from Doing
• 2030 Fluent Conversation
• 2031-2039 Cognitive Collaborator and
Mediator; Intelligence Augmentation (IA)
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 19
20. AI Benefits
• Access to expertise
– “Insanely great” labor productivity for trusted
service providers
– Digital workers for healthcare, education, finance,
etc.
• Better choices
– ”Insanely great” collaborations with others on
what matters most
– AI for IA = Augmented Intelligence and higher
value co-creation interactions
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 20
21. AI Risks
• Job Loss
– Shorter term
bigger risk
= de-skilling
• Super-intelligence
– Shorter term
bigger risk
= bad actors
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 21
22. Other Technologies: Bigger impact?
Yes.
• Augmented Reality (AR)/
Virtual Reality (VR)
– Game worlds
grow-up
• Blockchain/
Security Systems
– Trust and security
immutable
• Advanced Materials/
Energy Systems
– Manufacturing as cheap,
local recycling service
(utility fog, artificial leaf, etc.)
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 22
23. Stakeholders
• Individuals
• Families
• Businesses and
other Organizations
• Industry Groups
• Regional
Governments:
– Cities
– States
– Nations
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 23
24. Be Prepared
• Understand open AI code + data +
models + stacks + communities
– Leaderboards
– Ethical conduct
• Learn 3 R’s of IBM’s Cognitive
Opentech Group (COG)
– Read arXiv
– Redo with Github
– Report with Jupyter notebooks on
DSX and/or leaderboards
• Improve your team’s skills of rapidly
rebuilding from scratch
– Build your open code eminence
– Understand open innovation
– Communities + Leaderboards
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 24
1972 used
Punch cards
2016 used
IBM Watson
Open APIs to win…
25. Cupertino Teens
• IBM Watson on Bluemix
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 25
AI for NLP
entity identification
26. Courses
• 2015
– “How to build a cognitive system for Q&A task.”
– 9 months to 40% question answering accuracy
– 1-2 years for 90% accuracy, which questions to reject
• 2025
– “How to use a cognitive system to be a better professional X.”
– Tools to build a student level Q&A from textbook in 1 week
• 2035
– “How to use your cognitive mediator to build a startup.”
– Tools to build faculty level Q&A for textbook in one day
– Cognitive mediator knows a person better than they know themselves
• 2055
– “How to manage your workforce of digital workers.”
– Most people have 100 digital workers.
10/25/2017 26
Take free online cognitive classes today at cognitiveclass.ai
27. Headlines
• 2017 Popular
– “AI vs People”
– “X-Y team up to invest big in AI”
• 2025 Commonplace
– “People using AI to become better at their
professions, serving others.”
– “Teenagers using AI to solve challenges,
and improve their communities.”
• 2085 Resilience
– “Teams competing to rapidly rebuild
socio-economic-technical systems (wise
service systems) from scratch”
– “U.N. Pluto-base makes major discovery
about nature of universe. U.F.P.
established.”
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 27
IEEE 2017
28. IBM-MIT $240M over 10 year AI
mission
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 28
41. 10/25/2017 41
1955 1975 1995 2015 2035 2055
Can better service help us be wiser?
Cognitive Mediator (2035): Tool, Assistant, Collaborator, Coach
42. Courses
2015
– “How to build a cognitive system for Q&A task.”
– 9 months to 40% question answering accuracy
– 1-2 years for 90% accuracy, which questions to reject
2025
– “How to use a cognitive system to be a better professional X.”
– Tools to build a student level Q&A from textbook in 1 week
2035
– “How to use your cognitive mediator to build a startup.”
– Tools to build faculty level Q&A for textbook in one day
– Cognitive mediator knows a person better than they know themselves
2055
– “How to manage your workforce of digital workers.”
– Most people have 100 digital workers.
10/25/2017 42
49. “The best way to predict the future is to inspire the
next generation of students to build it better”
Digital Natives Transportation Water Manufacturing
Energy Construction ICT Retail
Finance Healthcare Education Government
52. TED Arai Todai Robot
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 52
… when will
your smartphone
be smart enough to
pass a university
entrance exam?
53. “AI will change the world?
Who will change AI?”
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 53
54. “These amazing technologies must be
able to help people like myself…”
10/25/2017 (c) IBM 2017, Cognitive Opentech Group 54
62. You say you want a
revolution?
October 8, 2017
https://www.slideshare.net/spohrer/revolution-20171008-v23
10/25/2017 (c) IBM 2017, Cognitive Opentech Group
62
63. By 2035, T-Shaped Makers with great
Building Blocks and Cognitive Mediators
10/25/2017 63
Empathy & Teamwork
sector
region/culture
discipline
Depth
Breadth
STEM
Liberal Arts
80. What types of digital cognitive systems?
• Cognitive Build: Outthink Challenge (250K people)
• Imagine a digital cognitive system to help you do something
important in your personal or professional lives
• Team to design it and advocate for it, and then everyone
votes
• Winners: reduce waste and human suffering, screen for
health issues and safety threats, learn life skills and make
better choices, find what you are looking for, move around
more effectively, provide emotional support, provide IT
support, learn about important public policy goals and make
better choices
• Types: Tool, Assistant, Collaborator, Coach, Mediator
10/25/2017 Understanding Cognitive Systems 80
105. Tomorrow: Servitization
• Start with any traditional product that is sold to customers
• Make the product part of a smart/wise service system
– Instrument it (sensors) – Internet of Things/Everything
– Set-up an intelligent operation center to monitor all products’
performance across their life-cycles
– Use big data analytics to determine how to improve product
performance, efficiency, maintenance, etc.
– Offer customer the “product-performance-as-a-service” with
financing/Internet of Service
– Customer benefits from cost-savings, predictability
– Provider benefits margin-improvements, predictability
• Every product becomes a platform technology (a vehicle for
service innovation) for innovative university startups
106. Vision: MMaaRRSS
• Modular Manufacturing as a Regional
Recirculation Service System
– “I am the stuff that will be made into product X for
customer Y.”
– Stuff = Material, Energy, and Information Flows
– Minimize transport costs (for products and waste)
• The Vision: Circular Economy (~4 minutes)
112. Some paths to becoming 64x smarter:
Improving learning and performance
• 2x from Learning sciences (methods)
– Better models of concepts
– Better models of learners
• 2x from Learning technology (tools)
– Guided learning paths
– Elimination of “thrashing”
• 2x from Quantity effect (overlaps)
– More you know, faster you go
– Advanced organizers
• 2x from Lifelong learning (time)
– Longer lives and longer careers
– Keeps “learning-mode” activated
• 2x from Early learning (time)
– Start earlier: Challenged-based approach
– STEM-2D in K-12 (SSME+DAPP Design of Smart Service Systems)
• 2x from Cognitive systems (performance support)
– Technology & Infrastructure Interactions
– Organizations & Others Interactions
113. Next Generation:
Future-Ready T-Shaped Adaptive Innovators
Many disciplines
Many sectors
Many regions/cultures
(understanding & communications)
Deepinonesector
Deepinoneregion/culture
Deepinonediscipline
121. Assisting individuals and organizations
to close their service innovation skills gap
and co-create wiser service systems
empowering employees, customers, citizens
with cognitive mediators
in the collaborative service economy
125. “The best way to predict the future is to inspire the
next generation of students to build it better”
Digital Natives Transportation Water Manufacturing
Energy Construction ICT Retail
Finance Healthcare Education Government
128. Today’s Talk: Cyber-Social-Learning-
Systems• What is the impact of Artificial Intelligence (AI) on CSLS?
– Augmented Intelligence (IA) via digital cognitive systems
– White House OSTP Response(s)
• Other topics to think about:
– What are more of the implications of digital cognitive systems?
• Tool > Assistant > Collaborator > Coach > Mediator
• Transformation > Experience > Data > Software > Hardware
– What does social intelligence require? Episodic Memory?
– What is the impact of augmented reality on CSLS?
– What are possible connections to service systems science
(SSME+DAPP)?
– What type of adaptive innovator with growth mindset needed
(T-shapes)?
10/25/2017 Understanding Cognitive Systems 128
130. White House OSTP Response(s)
• AI for public good
• Social & economic implications
• Education to harness AI
• Research questions and gaps
• Data sets and model sets
• Multidisciplinary research
• Role of incentives and prizes
• Safety and control protocols
• Legal and governance issues
10/25/2017 Understanding Cognitive Systems 130
133. Understanding
Cognitive Systems
Jim Spohrer (IBM), August 25, 2016
CSIG (Cognitive Systems Institute Group) Speaker
Series
http://www.slideshare.net/spohrer/understanding_20
160825_v3
10/25/2017 Understanding Cognitive Systems
133
134. Today’s Talk: Understanding Cognitive
Systems• What is a cognitive system (entity)?
– biological
– technological
– types of digital cognitive systems
• How to…
– build them?
– understand them?
– work with them?
• Steps toward a next generation cognitive
curriculum…
10/25/2017 Understanding Cognitive Systems 134
135. But first…. Cognitive Science, a young
field
• Society
– cognitivesciencesociety.org
• People
– Founders: Roger Schank, Donald Norman,
Allan Collins
– Others: David Rumelhart, Herbert Simon,
Allen Newell
– Today: Patrick Langley, Wayne Gray,
Kenneth Forbus, Ashok Goel, Paul Maglio,
etc.
• Systems Conference
– cogsys.org
– (JCS wishes this was part of HICSS)
10/25/2017 Understanding Cognitive Systems 135
136. Advances in Cognitive Systems -
cogsys.org
10/25/2017 Understanding Cognitive Systems 136
138. Today’s Talk: Understanding Cognitive
Systems• What is a cognitive system (entity)?
– biological
– technological
– types of digital cognitive systems
• How to…
– build them?
– understand them?
– work with them?
• Steps toward a next generation cognitive
curriculum…
10/25/2017 Understanding Cognitive Systems 138
139. What is a cognitive system (entity)?
10/25/2017 Understanding Cognitive Systems 139
140. What is a digital cognitive system
(entity)?
10/25/2017 Understanding Cognitive Systems 140
141. What types of digital cognitive
systems?
• Cognitive Build: Outthink Challenge (250K people)
– Imagine a digital cognitive system to help you do
something important in your personal or professional
lives
– Team to design it and advocate for it, and then
everyone votes
– Winners: reduce waste and human suffering, screen
for health issues and safety threats, learn life skills and
make better choices, find what you are looking for,
move around more effectively, provide emotional
support, provide IT support, learn about important
public policy goals and make better choices
• Types: Tool, Assistant, Collaborator, Coach, Mediator
10/25/2017 Understanding Cognitive Systems 141
150. Backup slides
• Service systems - http://service-
science.info/archives/3368
10/25/2017 Understanding Cognitive Systems 150
151. What is service science?
• IBM initiated effort to establish a
multidisciplinary field to study
service systems … with a focus on
people-centered, IT-enabled service
innovations for business and society
– based on service-dominant logic
– service = value co-creation
– IT-enabled service architectures
– service systems (socio-technical
systems for win-win value co-creation)
• IBM helped establish
– computer science (1945-present)
– service science (2005-present)
10/25/2017 Understanding Cognitive Systems 151
Service systems are dynamic configurations of
resources (people, technology, organizations,
and information) interconnected by
value propositions, internally and externally.
Examples:
- macro: cities, states, nations
- meso: hospitals, universities, businesses
- micro: households, families, individuals
Reference:
Spohrer J, Maglio P, Bailey J, Gruhl D (2007)
Steps toward a science of service systems.
IEEE Computer Society. 40(3):71-77(January).
152. What is service science?
• Now over 500 universities globally teach a more
multidisciplinary approach to service innovation,
including:
– Service management and marketing
– Service engineering and operations
– Service design and arts
– Service public policy and economics
– Service computing and informatics
• SSME + DAPP =
Service Science Management Engineering +
Design Arts Public Policy
– People, technology, organizations, information
interconnected by value propositions.
10/25/2017 Understanding Cognitive Systems 152
Reference:
IfM & IBM (2008). Succeeding through service
innovation: A service perspective for education,
research, business and government.
University of Cambridge Institute for Manufacturing,
Cambridge, UK. 2008.
153. How to get involved?
• Weekly speaker series
– Service innovation
– Service education & research
– Smart service/cognitive systems
• Discovery summits & book series
• Opportunities
– Institutional memberships
– Leadership & ambassadors
– Volunteer opportunities
– Awards & sponsored
conferences
10/25/2017 Understanding Cognitive Systems 153
ISSIP.org is a non-profit society
International Society of Service Innovation Professionals
Membership:
Over 1000 professionals and students from 40+ countries,
50+ companies and 50+ universities.
154. How to get involved?
• Journals (INFORMS,
etc.)
• Conferences (HICSS,
etc.)
• Courses (MIT, etc.)
• Funding (NSF, etc.)
• Society (ISSIP, etc.)
10/25/2017 Understanding Cognitive Systems 154
155. What are the hot topics?
• Smart Service Systems: Intelligence Augmentation
– AI + AR UX (Artificial Intelligence + Augmented Reality User
Experience)
– Smartphones (mobile, social, secure, etc.)
• Collaborative Economy: Servitization
– From assets to co-creation (e.g., Uber, AirBnB, etc.)
– From product to capability/outcome-as-a-service
– Manufacturing as a local recycling service
• Digital Transformation: Trust and Identity
– Blockchain: Don Tapscott’s TED Talk & book
– Big Data: Service Analytics & HAT (Hub of All Things)
10/25/2017 Understanding Cognitive Systems 155
157. Some paths to becoming 64x smarter:
Improving learning and performance
• 2x from Learning sciences (methods)
– Better models of concepts
– Better models of learners
• 2x from Learning technology (tools)
– Guided learning paths
– Elimination of “thrashing”
• 2x from Quantity effect (overlaps)
– More you know, faster you go
– Advanced organizers
• 2x from Lifelong learning (time)
– Longer lives and longer careers
– Keeps “learning-mode” activated
• 2x from Early learning (time)
– Start earlier: Challenged-based approach
– STEM-2D in K-12 (SSME+DAPP Design of Smart Service Systems)
• 2x from Cognitive systems (performance support)
– Technology & Infrastructure Interactions
– Organizations & Others Interactions
158. Next Generation:
Future-Ready T-Shaped Adaptive Innovators
Many disciplines
Many sectors
Many regions/cultures
(understanding & communications)
Deepinonesector
Deepinoneregion/culture
Deepinonediscipline