A framework for measuring transformational innovation prs

© 2016 The MITRE Corporation. All rights reserved.Approved For Public Release; Distribution Unlimited. 16-1000
Michal Cenkl
cenkl@mitre.org
Director of Innovation and Technology
The MITRE Corporation
A Framework for Measuring
Transformational Innovation
MITRE Innovation App for iOS www.linkedin.com/in/cenkl twitter.com/cenkl www.mitre.org

| 2 |
© 2016 The MITRE Corporation. All rights reserved. Approved For Public Release; Distribution Unlimited. 16-1000
The MITRE Corporation – A Long and Distinguished History

| 3 |
MITRE Operates 7 Federally Funded Research
and Development Centers (FFRDCs)
National
Security
Engineering
Center
Center for
Enterprise
Modernization
Judiciary
Engineering and
Modernization
Center
CMS
Alliance to
Modernize
Healthcare
National
Cybersecurity
FFRDC
Center for
Advanced
Aviation System
Development
MITRE is an independent, not-for-profit organization
chartered to work in the public interest. Our vision is
to create a stronger nation and a better world by
contributing to breakthroughs in safety and security.
Homeland
Security Systems
Engineering and
Development
Institute
1958
1990
1998
2010
2009
2014
2012

| 4 |
Government “Programming” Challenges
Billions Later, Plan to Remake the
Coast Guard Fleet Stumbles

| 5 |
Government Programming
Production &
Deployment
System
Development &
Demonstration
Technology
Development
Concept
Refine
System Acquisition Milestones
CBA
Pre-Concept Refinement
Technology Readiness Levels
TRL 8
System
Qual
TRL 7
Prototype
in Ops
Environment
TRL 6
Prototype
in Rep
Environment
TRL 5
Breadboard
in Rep
Environment
TRL 4
Breadboard
in
Lab
TRL 3
Proof
of
Concept
TRL 2
Concept
Formulation
TRL 1
Basic
Principles
Observed
TRL 9
Mission
Proven
MRL 3
Mfg
Proof of
Concept
Developed
MRL 4
Manufacturing
Processes
In Lab
Environment
MRL 5
Components
In Production
Relevant
Environment
MRL 6
System or
Subsystem
In Production
Relevant
Environment
MRL 7
System or
Subsystem
In Production
Representative
Environment
MRL 8
Pilot Line
Demonstrated
Ready for
LRIP
MRL 9
LRIP
Demonstrated
Ready for
FRP
MRL 10
FRP
Demonstrated
Lean Production
Practices in
place
MRL 2
Mfg
Concepts
Identified
MRL 1
Basic Mfg
Implications
Identified
Manufacturing Readiness Levels

| 6 |
Transition Commitment Levels (TCL)
Stage TCL Description TCL Commitment Artifacts
Operational
Impact scaled out 9
 Additional (beyond TCL 8 target) sponsor/stakeholder or domain(s) identified
 Measured capability benefit achieved across additional domain(s)
Mission impact realized 8  Measured capability benefit achieved by single sponsor/stakeholder
Sponsor/stakeholder commitment to acquisition 7
 Sponsor/stakeholder capability acquisition plan
 Benefit measures established
Operational Pilot
Sponsor/stakeholder execution of operational pilot 6
 Operational pilot execution (direct funded)
 Results analysis
Sponsor/stakeholder commitment to pilot 5
 Sponsor/stakeholder commitment to direct funded operational pilot
("operational" data and environment)
 Environment setup
 Success measures and criteria defined
External
Sponsor/stakeholder
Commitment
Sponsor/stakeholder commitment and active
support 4
 Access to sponsor/stakeholder information, users, environment
 Sponsor/stakeholder direct funding
Sponsor/stakeholder interaction & awareness 3  Periodic, planned sponsor/stakeholder engagement
Internal Discovery
and MITRE
Commitment
MITRE portfolio commitment 2
 Sponsor/stakeholder engagement strategy
 Initial transition plan
 Accountable portfolio champion
 Refined business case and baseline
MITRE internal program/R&D commitment 1
 Problem definition
 (Potential) sponsor/stakeholder interest/"market”
 (Potential) business case and baseline
 MITRE investment (R&D, other indirect, e.g., MIP, SIPD, EI, license)
Internal Discovery
and MITRE
Commitment
External Sponsor/
Stakeholder
Commitment
Operational Pilot Operational

| 7 |
TCL/TRL Framework
TCL
1 2 3 4 5 6 7 8 9
Basic
Science
Concept
Proof of
Concept
Lab
Demo
Demo
Env
Prototype
Ops
Env
Sys
Qual
Mission
Proven
Operational
9
Scale
Impact
8
Operation
Benefit
7
Plan to
Acquire
1 4 11 8 27 8 8 10
Operational
Pilot
6
Pilot
Execution
2 10 13 6 7 5 4
5
Pilot
Commit
2 10 13 6 7 5 4
Sponsor
Commitment
4
Sponsor
Commits
2 10 13 6 7 5 4
3
Sponsor
Interest
6 42 116 113 31 55 16 4
Discovery
2
Internal
Commit
3 37 45 26 8 6 5 2
1 Feasibility
27 73 45 41 5 11 1
Over Hyped
No Market
Launch
Start Up
TransitionCommitmentLeevl(TCL)
Technology Readiness Level (TRL)
Guardrail Key
Medium
Risk
Higher
Risk
Very
High
Risk
Lower
Risk

| 8 |
Return value to the
nation by transferring
innovations to
industry and
government
Goal #3
MITRE Strategic Guidance
Office of Corporate Technology
Vision:
To create
a stronger nation
and a better world by
contributing to
breakthroughs
in safety and security
Deliver
transformational
capabilities that drive
mission success and
advance global
leadership
Goal #1
Shape MITRE’s
workforce, reputation
and work program
through leadership
in research and
innovation
Goal #2
MITRE Innovation Program (IR&D)

| 9 |
TCL for MITRE IR&D
50+ 111-50 2-10
Guardrail Key
Medium
Risk
Higher
Risk
Very
High
Risk
Portfolio Key
Operational
9 Scale Impact
8
Operation
Benefit
7 Plan to Acquire
Operational
Pilot
6 Pilot Execution
5 Pilot Commit
Partner
Commitment
4
Sponsor
Commits
3
Sponsor
Interest
Discovery
2
Internal
Commit
1 Feasibility
TransitionCommitmentLevel(TCL)
950
MIP projects
2010-2014
Over Hyped
No Market
Launch
Start Up

| 10 |
TCl/TRL Framework In Action
TCL
1 2 3 4 5 6 7 8 9
Basic
Science
Concept
Proof of
Concept
Lab
Demo
Demo
Env
Prototype
Ops
Env
Sys
Qual
Mission
Proven
Operational
9
Scale
Impact
8
Operation
Benefit
7
Plan to
Acquire
1 4 11 8 27 8 8 10
Operational
Pilot
6
Pilot
Execution
2 10 13 6 7 5 4
5
Pilot
Commit
2 10 13 6 7 5 4
Sponsor
Commitment
4
Sponsor
Commits
2 10 13 6 7 5 4
3
Sponsor
Interest
6 42 116 113 31 55 16 4
Discovery
2
Internal
Commit
3 37 45 26 8 6 5 2
1 Feasibility
27 73 45 41 5 11 1
Over Hyped
No Market
Launch
Start Up
1
TransitionCommitmentLeevl(TCL)
6
5
3
2
7
8
3
1
6
5
2
7
8
Guardrail Key
Medium
Risk
Higher
Risk
Very
High
Risk
Lower
Risk
Imaging Project A
Bi-Statics Radar A
Bi-Static Radar B
Identity Based IP (IBIP)
Imaging Project B
Low-Cost Surface
Awareness (LCSA)
National Patient Safety
Partnership
Modernization Project
1
2
3
4
5
6
7
8

| 11 |
© 2016 The MITRE Corporation. All rights reserved.
Approach
Public Private
Partnership to
collect, analyze,
and share patient
safety data
(7.2TB,
1.1M patients,
8.1M encounters,
60M orders) for
comprehensive
and predictive
picture of
adverse patient
safety events
National Patient Safety Partnership (NPSP)
Partnerships
MITRE trusted third
party role enables
partnerships to:
• Share clinical
data
• Team with
Clinicians team to
reveal previously
unknown
vulnerabilities
• Reveals trends &
differences
Aggregated
partner data
Medical errors 3rd
leading cause of
deaths in U.S.
U.S. Hospitals / Year
Problem
Military Casualties/10 Yr
Killed
98k/6.6K
Injured
181k/50k
FY15 TCL Measurement: Initial 3  Current 4  Target 6
*Brilli, R. L., et al. (2007). Implementation of a medical emergency team in a large pediatric teaching hospital prevents
respiratory and cardiopulmonary arrests outside the intensive care unit, Pediatric Critical Care Medicine, 8, 236-246
• 1.5M adverse drug
events cost $3.5B/yr
• Mortality of
unrecognized critical
deterioration event
(CDE) as high as
67%*
Outcome
Advanced
analytics across
multiple EHRs.
Predictive
analytics to help
identify patient
deterioration
Goals:
• Reduce Clinical
resource &
medication waste
• Reduce 50%
CDEs, ICU stay,
risks, cost

| 12 |
Low Cost Surface Awareness
FY15 TCL Measurement: Initial 3  Current 5  Target 6
Partnerships
Field experiments at
Teterboro airport via
MOU with NY/NJ Port
Authority
FAA interested in low
cost surveillance
Exploring
commercialization and
international
partnerships via
MAPS/Singapore and
others
Problem
Airport surface surveillance
options are cost prohibitive
for many small to medium
airports. A reliable, low-cost
solution would improve
safety at these airports.
Approach
Low cost infra-red
sensing technology
coupled with intelligent
analysis and display
software
Expected Outcome
A commercially viable
low-cost surveillance
capability that could
be fielded for less
than $2M (vs. $25-28M
for current systems)
At least 44 US
domestic airports are
potential customers
along with multiple
international locations

| 13 |
Transition Commitment Level Advancement Timeline
0
5
10
15
20
25
30
"1-2" "2-3" "3-4" "4-5" "5-6" "6-7" "7-8" "8-9"
TCL Advancement TIme (Months)
Average Max Min
TCL Advancement Average
Std
Deviation Max Min
"1-2" 7 2 12 6
"2-3" 7 2 12 6
"3-4" 10 3 12 6
"4-5" 7 3 12 4
"5-6" 13 7 24 3
"6-7" 3 2 5 1
"7-8" 9 4 14 3
"8-9"
How long should it take to advance through TCL levels?

| 14 |
Transformational Solutions – 10x Accelerator

| 15 |
MITRE & Sponsor Perception of Transformational Solutions
External Internal
MITRE Sponsors
recognize MITRE
as delivering
transformational
solution
in past 5 years
Majority
of (54)
MITRE Directors believe
MITRE Innovation Program
produced
transformational
solution
in past 5 years
By transformation we mean a breakthrough in capability (technology, system,
strategy and/or process) resulting in a measurably significant improvement in
the efficiency or effectiveness of mission outcomes or the ability to enable new
missions.

| 16 |
@MITREcorpMITRE +MITREMITREcorp MITREcorp
www.mitre.org
MITRE Innovation App for iOS
Thank You

| 17 |
Image Source: The MITRE Corporation

| 18 |
Image Source: The MITRE Corporation

| 19 |

| 20 |
UAL1448
Somebody just took off…
UAL1448
Image Source: Google Maps
Audio Source: National Transportation Safety Board
2998

| 21 |
UAL1448
I need to know what
runway you’re on. I can’t
see anything from the
tower.
2998

| 22 |
I need to know what runway
you’re on. I can’t see
anything from the tower.
UAL1448
2998, Runway 5R, fly
runway heading, cleared
for takeoff.
2998

| 23 |
Ma’am, I’m trying to advise
you we are on an active
runway.
I need to know what runway
you’re on. I can’t see
anything from the tower.
UAL1448
2998, Runway 5R, fly
runway heading, cleared
for takeoff.
2998

| 24 |
$$$$$$$$$
$$$$$$$$$
$$$$$$$

| 25 |

| 26 |
• Preliminary tests in simulations and in field (TCL 2)
• Cost benefit analysis suggests a 7.5X-10X benefit (TCL 3)
• Discussing system with FAA and other stakeholders (TCL 4)
Sensors alert controllers
in tower when “block” is
occupied
Controllers can tag occupied blocks
and tagging persists
Magnetic sensors (railways) are installed
to define operationally-relevant blocks
(TCL1)
Low Cost Surface Awareness System

| 27 |
Bi/Multistatic Surveillance
Persistent, high-quality
moving target indication
(MTI) data are in high
demand; however,
proliferation has been
challenging due to costs
associated with sensor
development and
procurement, and the
operation and maintenance
of the platform
Problem
• Leverage bi/multistatic radar
architectures to provide high-
quality MTI cost-effectively
• Developed and deployed
prototype sensors and
algorithms
Approach
Novel processing
approaches result in cost-
effective, persistent, high
quality MTI
 High probability of
detection
 Low probability of false
alarm
 Precise geo-location
Results

A framework for measuring transformational innovation prs

Recommended

Recommended

More Related Content

Similar to A framework for measuring transformational innovation prs

Similar to A framework for measuring transformational innovation prs (20)

Recently uploaded

Recently uploaded (20)

A framework for measuring transformational innovation prs