The document outlines key discussions from a forum on AI/ML and its impact on patent markets, covering new AI-driven business models and the intersection of AI with intellectual property. Panelists discussed opportunities and challenges in technology, business, and legal domains, emphasizing the importance of humans in decision-making alongside machine learning. The document highlights the need for effective measurement and rewards in AI-driven initiatives.

1. PATENT MARKET DATA
ACTIONABLE ANALYTICS
CIP Forum: AI/ML Breakout
September 24, 2018
(C) 2018 Richardson Oliver Insights LLC 1

2. PATENT MARKET DATA
ACTIONABLE ANALYTICS
AI/ML/BD Breakout Sessions
1: AI Driven Business Models
Topic:
New AI-driven business models across
different industries. Panelists will discuss new
opportunities and challenges from a technical,
business, and legal perspective
2: AI and Intellectual Property
Topic:
Discussion of the different roles that AI/ML
plays, including as a method of invention.
Panelists
Florian Kolb
Markus Larsson
Jule Sigall
Panelists
Mark Beloborodov
Yann Ménière
Marcus Malek
Julian Nolan
(C) 2018 Richardson Oliver Insights LLC 2

3. PATENT MARKET DATA
ACTIONABLE ANALYTICS
Panelist and Moderator Intros
Florian Kolb
Markus Larsson
Erik Oliver
Jule Sigall
(C) 2018 Richardson Oliver Insights LLC 3

4. PATENT MARKET DATA
ACTIONABLE ANALYTICS
Machine Learning (in 10
minutes or less)
Erik Oliver
September 24, 2018
CIP Forum
(C) 2018 Richardson Oliver Insights LLC 4

5. PATENT MARKET DATA
ACTIONABLE ANALYTICS (C) 2018 Richardson Oliver Insights LLC 5

6. PATENT MARKET DATA
ACTIONABLE ANALYTICS (C) 2018 Richardson Oliver Insights LLC 6

7. PATENT MARKET DATA
ACTIONABLE ANALYTICS
Machine Learning (ML) vs. Artificial Intelligence (AI)
°Machine learning is a type of AI
(C) 2018 Richardson Oliver Insights LLC 7

8. PATENT MARKET DATA
ACTIONABLE ANALYTICS
Academic Definition
°Machine learning studies computer algorithms for learning to do
stuff… So in general, machine learning is about learning to do
better in the future based on what was experienced in the past
(Rob Schapire, Princeton)
(C) 2018 Richardson Oliver Insights LLC 8

9. PATENT MARKET DATA
ACTIONABLE ANALYTICS
Big Data — Two Meanings
°1: Data sets so big and large that traditional software
does not handle them well
°2: Refers to the use of analytics to extract value from data
(e.g. for AI/ML)
(C) 2018 Richardson Oliver Insights LLC 9

10. PATENT MARKET DATA
ACTIONABLE ANALYTICS
ML Uses Models…
All Models
Wrong
Some Models
Useful
Fewer
Models
Good
Source: Abe Gong
(C) 2018 Richardson Oliver Insights LLC 10

11. PATENT MARKET DATA
ACTIONABLE ANALYTICS
Example: Black Box Justice
Source: http://thepenngazette.com/black-box-justice/
Situation: Release kid from low crime
neighborhood vs. release kid from high crime
neighborhood
Machine Learning Answer: Release kid from low
crime neighborhood
Issue: ML is not the final answer
(C) 2018 Richardson Oliver Insights LLC 11

12. PATENT MARKET DATA
ACTIONABLE ANALYTICS
ML alone is not the answer
People
ProcessesTechnology
Technology often gets 95-99%
of the attention… but we need
humans to make decisions
(C) 2018 Richardson Oliver Insights LLC 12

13. PATENT MARKET DATA
ACTIONABLE ANALYTICS
Are You Measuring What Matters?
°“What gets measured gets done”
°Attributed to Peter Drucker, Tom Peters, Edwards Deming, Lord Kelvin, and others.
(C) 2018 Richardson Oliver Insights LLC 13

14. PATENT MARKET DATA
ACTIONABLE ANALYTICS
What are you rewarding?
°“What gets measured gets done.
°What gets measured and fed back gets done well.
°What gets rewarded gets repeated.”
°Attributed to John Jones
(C) 2018 Richardson Oliver Insights LLC 14

15. PATENT MARKET DATA
ACTIONABLE ANALYTICS
Presentations
Florian Kolb
Markus Larsson
Jule Sigall
(C) 2018 Richardson Oliver Insights LLC 15

16. PATENT MARKET DATA
ACTIONABLE ANALYTICS
CIP Forum: AI/ML Breakout
September 24, 2018
(C) 2018 Richardson Oliver Insights LLC 16

17. PATENT MARKET DATA
ACTIONABLE ANALYTICS
AI/ML/BD Breakout Sessions
1: AI Driven Business Models
Topic:
New AI-driven business models across
different industries. Panelists will discuss new
opportunities and challenges from a technical,
business, and legal perspective
2: AI and Intellectual Property
Topic:
Discussion of the different roles that AI/ML
plays, including as a method of invention.
Panelists
Florian Kolb
Markus Larsson
Jule Sigall
Panelists
Mark Beloborodov
Yann Ménière
Marcus Malek
Julian Nolan
(C) 2018 Richardson Oliver Insights LLC 17

18. PATENT MARKET DATA
ACTIONABLE ANALYTICS
Panelist and Moderator Intros
Mark Beloborodov
Marcus Malek
Yann Ménière
Julian Nolan
Erik Oliver
(C) 2018 Richardson Oliver Insights LLC 18

19. PATENT MARKET DATA
ACTIONABLE ANALYTICS
Presentations
Mark Beloborodov
Marcus Malek
Yann Ménière
Julian Nolan
(C) 2018 Richardson Oliver Insights LLC 19