SlideShare a Scribd company logo
JACK PHILLIPS ROI
Phillips ROI Methodology
Reaction/Satisfaction
ROI
Impact
Implementation
Learning
Did the learning
investment payoff?
Did the learning impact
business results?
Did the learners deploy
the learning on the job?
Did the learners learn
from the content?
Did the learners like
the program?
Source – www.Lynda.com
JACK PHILLIPS ROI
Jack Phillips ROI Working
1. Collecting
Pre-Program
Data
5. Tabulating
Program Costs
7. Identifying
Intangible
Benefits
4. Converting
Data to
Monetary
Value
2. Collecting
Post-Program
Data
3. Isolating the
Effects of the
Program
6. Calculating
the Return on
Investment
Calculating the Return on Investment
ROI
Net Program Benefits
Program Costs
=
JACK PHILLIPS ROI
Five Levels of the Phillips ROI Framework
What are the participant’s reactions to the program,
and what do they plan to do with the material?
What skills, knowledge, or attitudes have changed, and by how much?
Was there a behavior change, and did the
participants apply what they learned on the job?
Did the on-the-job application produce measurable results?
Did the monetary value of the results exceed the cost for the program?
Reaction,
Satisfaction &
Planned Action
Learning
Job Application &
Implementation
Business
Impact
Return on
Investment (ROI)
JACK PHILLIPS ROI
Enter your sub headline here
Reaction- Learner satisfaction
ROI - Return
on training
investment
Behavior- Learner's behavior
change post-training
Results- Measurable
impact on performance
Learning- Knowledge transferred to learners

More Related Content

Similar to multicolor12-jack-phillips-roi-static-4x3.pptx

Moving from evaluation to learning peter york
Moving from evaluation to learning peter yorkMoving from evaluation to learning peter york
Moving from evaluation to learning peter york
Michele Garvey
 
G.training evaluation by jyoti k
G.training evaluation by jyoti kG.training evaluation by jyoti k
G.training evaluation by jyoti k
jyoti karvande
 
KM SHOWCASE 2019 - Lessons from the IFC - Kemal Cakici
KM SHOWCASE 2019 - Lessons from the IFC - Kemal CakiciKM SHOWCASE 2019 - Lessons from the IFC - Kemal Cakici
KM SHOWCASE 2019 - Lessons from the IFC - Kemal Cakici
KM Institute
 
24/7 Dad® 3rd Edition Overview
24/7 Dad® 3rd Edition Overview24/7 Dad® 3rd Edition Overview
24/7 Dad® 3rd Edition Overview
mjsteward
 
Adapting and implementing evidence-based interventions
Adapting and implementing evidence-based interventionsAdapting and implementing evidence-based interventions
Adapting and implementing evidence-based interventions
Grace Lee
 
AIESEC Indonesia |1314| iGCDP Summer Structures
AIESEC Indonesia |1314| iGCDP Summer StructuresAIESEC Indonesia |1314| iGCDP Summer Structures
AIESEC Indonesia |1314| iGCDP Summer StructuresChristina Kelman
 
Leverage lms synapsyselearnz2015
Leverage lms synapsyselearnz2015Leverage lms synapsyselearnz2015
Leverage lms synapsyselearnz2015
Phil Garing
 
2009 Roi Trainer 1 Rev1
2009 Roi Trainer 1 Rev12009 Roi Trainer 1 Rev1
2009 Roi Trainer 1 Rev1ROI TRAINER
 
Measuring the Effectiveness of Training - Myth or Reality?
Measuring the Effectiveness of Training - Myth or Reality?Measuring the Effectiveness of Training - Myth or Reality?
Measuring the Effectiveness of Training - Myth or Reality?
Accord
 
Training evaluation models
Training evaluation modelsTraining evaluation models
Training evaluation models
Megha Anilkumar
 
Measures that Matter: Capture and Communicate the Value of Learning Programs
Measures that Matter: Capture and Communicate the Value of Learning ProgramsMeasures that Matter: Capture and Communicate the Value of Learning Programs
Measures that Matter: Capture and Communicate the Value of Learning Programs
Noelle Akins
 
Putting Program Evaluation to Work for You
Putting Program Evaluation to Work for YouPutting Program Evaluation to Work for You
Putting Program Evaluation to Work for You
John Kmiec, Ph.D., Certified ROI Professional
 
View from the Learner's Perspective: ROI and the Triple Bottom Line of Learning
View from the Learner's Perspective: ROI and the Triple Bottom Line of LearningView from the Learner's Perspective: ROI and the Triple Bottom Line of Learning
View from the Learner's Perspective: ROI and the Triple Bottom Line of Learning
Aggregage
 
The Four Moments of Truth
The Four Moments of TruthThe Four Moments of Truth
The Four Moments of Truth
Training Industry Conference & Expo
 
Training Evaluation
Training EvaluationTraining Evaluation
Training Evaluation
Preeti Bhaskar
 
Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11
Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11
Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11Barbara O'Neill
 
ROI of Training Programs
ROI of Training ProgramsROI of Training Programs
ROI of Training Programs
Miguel Ángel Fernández Delgado
 
Beyond Smiley Sheets: Measuring the ROI of Learning and Development
Beyond Smiley Sheets: Measuring the ROI of Learning and DevelopmentBeyond Smiley Sheets: Measuring the ROI of Learning and Development
Beyond Smiley Sheets: Measuring the ROI of Learning and Development
Kip Michael Kelly
 
How to Measure the Impact of Soft Skills Training | Webinar 10.21.15
How to Measure the Impact of Soft Skills Training | Webinar 10.21.15How to Measure the Impact of Soft Skills Training | Webinar 10.21.15
How to Measure the Impact of Soft Skills Training | Webinar 10.21.15
BizLibrary
 
Evaluating Digital Literacy programs
Evaluating Digital Literacy programsEvaluating Digital Literacy programs
Evaluating Digital Literacy programs
TechSoup for Libraries
 

Similar to multicolor12-jack-phillips-roi-static-4x3.pptx (20)

Moving from evaluation to learning peter york
Moving from evaluation to learning peter yorkMoving from evaluation to learning peter york
Moving from evaluation to learning peter york
 
G.training evaluation by jyoti k
G.training evaluation by jyoti kG.training evaluation by jyoti k
G.training evaluation by jyoti k
 
KM SHOWCASE 2019 - Lessons from the IFC - Kemal Cakici
KM SHOWCASE 2019 - Lessons from the IFC - Kemal CakiciKM SHOWCASE 2019 - Lessons from the IFC - Kemal Cakici
KM SHOWCASE 2019 - Lessons from the IFC - Kemal Cakici
 
24/7 Dad® 3rd Edition Overview
24/7 Dad® 3rd Edition Overview24/7 Dad® 3rd Edition Overview
24/7 Dad® 3rd Edition Overview
 
Adapting and implementing evidence-based interventions
Adapting and implementing evidence-based interventionsAdapting and implementing evidence-based interventions
Adapting and implementing evidence-based interventions
 
AIESEC Indonesia |1314| iGCDP Summer Structures
AIESEC Indonesia |1314| iGCDP Summer StructuresAIESEC Indonesia |1314| iGCDP Summer Structures
AIESEC Indonesia |1314| iGCDP Summer Structures
 
Leverage lms synapsyselearnz2015
Leverage lms synapsyselearnz2015Leverage lms synapsyselearnz2015
Leverage lms synapsyselearnz2015
 
2009 Roi Trainer 1 Rev1
2009 Roi Trainer 1 Rev12009 Roi Trainer 1 Rev1
2009 Roi Trainer 1 Rev1
 
Measuring the Effectiveness of Training - Myth or Reality?
Measuring the Effectiveness of Training - Myth or Reality?Measuring the Effectiveness of Training - Myth or Reality?
Measuring the Effectiveness of Training - Myth or Reality?
 
Training evaluation models
Training evaluation modelsTraining evaluation models
Training evaluation models
 
Measures that Matter: Capture and Communicate the Value of Learning Programs
Measures that Matter: Capture and Communicate the Value of Learning ProgramsMeasures that Matter: Capture and Communicate the Value of Learning Programs
Measures that Matter: Capture and Communicate the Value of Learning Programs
 
Putting Program Evaluation to Work for You
Putting Program Evaluation to Work for YouPutting Program Evaluation to Work for You
Putting Program Evaluation to Work for You
 
View from the Learner's Perspective: ROI and the Triple Bottom Line of Learning
View from the Learner's Perspective: ROI and the Triple Bottom Line of LearningView from the Learner's Perspective: ROI and the Triple Bottom Line of Learning
View from the Learner's Perspective: ROI and the Triple Bottom Line of Learning
 
The Four Moments of Truth
The Four Moments of TruthThe Four Moments of Truth
The Four Moments of Truth
 
Training Evaluation
Training EvaluationTraining Evaluation
Training Evaluation
 
Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11
Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11
Citi grant teacher training-fin ed evaluation-assessment tools-o'neill-06-11
 
ROI of Training Programs
ROI of Training ProgramsROI of Training Programs
ROI of Training Programs
 
Beyond Smiley Sheets: Measuring the ROI of Learning and Development
Beyond Smiley Sheets: Measuring the ROI of Learning and DevelopmentBeyond Smiley Sheets: Measuring the ROI of Learning and Development
Beyond Smiley Sheets: Measuring the ROI of Learning and Development
 
How to Measure the Impact of Soft Skills Training | Webinar 10.21.15
How to Measure the Impact of Soft Skills Training | Webinar 10.21.15How to Measure the Impact of Soft Skills Training | Webinar 10.21.15
How to Measure the Impact of Soft Skills Training | Webinar 10.21.15
 
Evaluating Digital Literacy programs
Evaluating Digital Literacy programsEvaluating Digital Literacy programs
Evaluating Digital Literacy programs
 

Recently uploaded

The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
RTTS
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
g2nightmarescribd
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 

Recently uploaded (20)

The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 

multicolor12-jack-phillips-roi-static-4x3.pptx

  • 1. JACK PHILLIPS ROI Phillips ROI Methodology Reaction/Satisfaction ROI Impact Implementation Learning Did the learning investment payoff? Did the learning impact business results? Did the learners deploy the learning on the job? Did the learners learn from the content? Did the learners like the program? Source – www.Lynda.com
  • 2. JACK PHILLIPS ROI Jack Phillips ROI Working 1. Collecting Pre-Program Data 5. Tabulating Program Costs 7. Identifying Intangible Benefits 4. Converting Data to Monetary Value 2. Collecting Post-Program Data 3. Isolating the Effects of the Program 6. Calculating the Return on Investment Calculating the Return on Investment ROI Net Program Benefits Program Costs =
  • 3. JACK PHILLIPS ROI Five Levels of the Phillips ROI Framework What are the participant’s reactions to the program, and what do they plan to do with the material? What skills, knowledge, or attitudes have changed, and by how much? Was there a behavior change, and did the participants apply what they learned on the job? Did the on-the-job application produce measurable results? Did the monetary value of the results exceed the cost for the program? Reaction, Satisfaction & Planned Action Learning Job Application & Implementation Business Impact Return on Investment (ROI)
  • 4. JACK PHILLIPS ROI Enter your sub headline here Reaction- Learner satisfaction ROI - Return on training investment Behavior- Learner's behavior change post-training Results- Measurable impact on performance Learning- Knowledge transferred to learners