Oxford Major Programmes Ltd.
“Benefits for Whom?”
14/06/16
Benedict Pinches
‘Benefits’ Definition from the
Office of Government
Commerce:
The measurement of an outcome,
or part of an outcome
An end benefit is a direct
contribution to a strategic
objective
Describes an advantage accruing
from the outcome
Answers the question of what a
project delivers: why is this
required?
outcome
output
output
output
outcome
output
Benefit
Axelos, Managing Successful Programmes
Hard and Soft
Quantitative Qualitative
Financial Non-Financial
Cash flow
User fees
Customer
Satisfaction
Safety
Dignity
Well-being
Tax revenue
Competitiveness
Sellable data
Brand equity
Pride
Legacy
Direct
Indirect
P Chapman et al, Authoritative Literature Review into the Benefits of Health ICT Investments
What Do We Measure?
Benefit Categories
economic social environmental learning
How Can We Measure?
Evaluation Method Description Use
Transaction costs Uses segmentation methods to calculate use
and benefits to different user groups
Quick and easy way to estimate potential
cost savings from the introduction of
eGovernment
Net present value A straightforward method that examines
monetary values and measures tangible
benefits
Relatively straightforward; use when cash
flows are private and benefits tangible
Cost benefit analysis A flexible method that measures tangible and
intangible benefits and assesses these against
net total cost
Good consideration of all benefits, but can
be expensive and time consuming
Cost effectiveness analysis Focuses on achieving specific goals in relation
to marginal costs
Good for considering incremental benefits
against specific goals
Portfolio analysis A complex method that quantifies aggregate
risks relative to expected returns for a
portfolio of initiatives
Good for consideration of risk, just use a
consistent approach across a portfolio
Value assessment A complex method that captures and measures
benefits unaccounted for in traditional ‘Return
on Investment’ (RoI) calculations
Used by several governments to consider
performance against all policy goals
P Foley & X Alfonso, eGovernment and the Transformation Agenda
‘Literature Review into the
Benefits of Health ICT
Investments’ (DoH)
1,242 articles for Health ICT
1,810 articles for Government ICT investments
5,576 articles for Major Programmes
196 articles for Health ICT
167 articles for Government ICT investments
1,064 articles for Major Programmes
128 articles for Health ICT
126 articles for Government ICT investments
147 articles for Major Programmes
82 articles for Health ICT
57 articles for Government ICT investments
65 articles for Major Programmes
P Chapman et al, Authoritative Literature Review into the Benefits of Health ICT Investments
Academic Findings
Lack of construct
clarity
Insufficient empirical
depth
Normative models
Case studies
Lower rated journals
No reference class
P Chapman et al, Authoritative Literature Review into the Benefits of Health ICT Investments
Future Trends fault line
P Chapman et al, Authoritative Literature Review into the Benefits of Health ICT Investments
Robert McNamara:
“McNamara Fallacy”
“The first step is to measure
whatever can be easily measured.
This is OK as far as it goes. The
second step is to disregard that which
can't be easily measured or to give it
an arbitrary quantitative value. This
is artificial and misleading. The third
step is to presume that what can't be
measured easily really isn't
important. This is blindness. The
fourth step is to say that what can't
be easily measured really doesn't
exist. This is suicide.”
D Yankelovich, Corporate Priorities: A continuing study of the new demands on business
Classic Benefits Process?
Benefits Management: How to increase the business value of your IT project, by John Ward
Stakeholder issues
A Stakeholder is any
group or individual who
can affect, or is affected
by, the achievement of
a project’s purpose
Stakeholder practice
Accuracy of
stakeholder
analysis
Time
Usual approach
(At best)
Monthly reviews
Accuracy of
stakeholder
analysis
Time
Preferred approach
Why ‘Revolution’?
Dilbert on Project Failure, by Scott Adams
The Importance of
Vision
“Leaders are Dealers in Hope”
Benedict Pinches
Founder and Director
Oxford Major Programmes
Phone: +44 (0) 7956 677 483
Email: ben.pinches@oxmp.co
Twitter: @oxmp
Web: www.oxmp.co
Facebook: http://on.fb.me/PzavIu
This presentation was delivered
at an APM event
To find out more about
upcoming events please visit our
website www.apm.org.uk/events

"Benefits management: a core theme in management research and education?" conference, Ben Pinches, 14 June 2016, Sheffield

  • 1.
    Oxford Major ProgrammesLtd. “Benefits for Whom?” 14/06/16 Benedict Pinches
  • 2.
    ‘Benefits’ Definition fromthe Office of Government Commerce: The measurement of an outcome, or part of an outcome An end benefit is a direct contribution to a strategic objective Describes an advantage accruing from the outcome Answers the question of what a project delivers: why is this required? outcome output output output outcome output Benefit Axelos, Managing Successful Programmes
  • 3.
    Hard and Soft QuantitativeQualitative Financial Non-Financial Cash flow User fees Customer Satisfaction Safety Dignity Well-being Tax revenue Competitiveness Sellable data Brand equity Pride Legacy Direct Indirect P Chapman et al, Authoritative Literature Review into the Benefits of Health ICT Investments
  • 4.
    What Do WeMeasure? Benefit Categories economic social environmental learning
  • 5.
    How Can WeMeasure? Evaluation Method Description Use Transaction costs Uses segmentation methods to calculate use and benefits to different user groups Quick and easy way to estimate potential cost savings from the introduction of eGovernment Net present value A straightforward method that examines monetary values and measures tangible benefits Relatively straightforward; use when cash flows are private and benefits tangible Cost benefit analysis A flexible method that measures tangible and intangible benefits and assesses these against net total cost Good consideration of all benefits, but can be expensive and time consuming Cost effectiveness analysis Focuses on achieving specific goals in relation to marginal costs Good for considering incremental benefits against specific goals Portfolio analysis A complex method that quantifies aggregate risks relative to expected returns for a portfolio of initiatives Good for consideration of risk, just use a consistent approach across a portfolio Value assessment A complex method that captures and measures benefits unaccounted for in traditional ‘Return on Investment’ (RoI) calculations Used by several governments to consider performance against all policy goals P Foley & X Alfonso, eGovernment and the Transformation Agenda
  • 6.
    ‘Literature Review intothe Benefits of Health ICT Investments’ (DoH) 1,242 articles for Health ICT 1,810 articles for Government ICT investments 5,576 articles for Major Programmes 196 articles for Health ICT 167 articles for Government ICT investments 1,064 articles for Major Programmes 128 articles for Health ICT 126 articles for Government ICT investments 147 articles for Major Programmes 82 articles for Health ICT 57 articles for Government ICT investments 65 articles for Major Programmes P Chapman et al, Authoritative Literature Review into the Benefits of Health ICT Investments
  • 7.
    Academic Findings Lack ofconstruct clarity Insufficient empirical depth Normative models Case studies Lower rated journals No reference class P Chapman et al, Authoritative Literature Review into the Benefits of Health ICT Investments
  • 8.
    Future Trends faultline P Chapman et al, Authoritative Literature Review into the Benefits of Health ICT Investments
  • 9.
    Robert McNamara: “McNamara Fallacy” “Thefirst step is to measure whatever can be easily measured. This is OK as far as it goes. The second step is to disregard that which can't be easily measured or to give it an arbitrary quantitative value. This is artificial and misleading. The third step is to presume that what can't be measured easily really isn't important. This is blindness. The fourth step is to say that what can't be easily measured really doesn't exist. This is suicide.” D Yankelovich, Corporate Priorities: A continuing study of the new demands on business
  • 10.
    Classic Benefits Process? BenefitsManagement: How to increase the business value of your IT project, by John Ward
  • 11.
    Stakeholder issues A Stakeholderis any group or individual who can affect, or is affected by, the achievement of a project’s purpose
  • 12.
    Stakeholder practice Accuracy of stakeholder analysis Time Usualapproach (At best) Monthly reviews Accuracy of stakeholder analysis Time Preferred approach
  • 13.
    Why ‘Revolution’? Dilbert onProject Failure, by Scott Adams
  • 14.
  • 15.
    Benedict Pinches Founder andDirector Oxford Major Programmes Phone: +44 (0) 7956 677 483 Email: ben.pinches@oxmp.co Twitter: @oxmp Web: www.oxmp.co Facebook: http://on.fb.me/PzavIu
  • 16.
    This presentation wasdelivered at an APM event To find out more about upcoming events please visit our website www.apm.org.uk/events