1. Accounting for Mission:
Government Accountancy and
Outcome Evaluation
Eva Witesman, Ph.D.
Assistant Professor of Public Management
Brigham Young University
eva_witesman@byu.edu
Prepared for the 2014 Fall Symposium presented by the Northern Utah Association of Government Accountants
4. Although GAO does serve as the lead auditor of the
U.S. government’s consolidated financial statements, financial
audits
are only about 15 percent of GAO’s current workload.
Most of the agency’s work involves program evaluations,
policy analyses, and legal opinions and decisions on a broad
range
of government programs and activities both at home and abroad.
“
5. The scope of GAO’s work today includes virtually everything
the federal government is doing or thinking about doing
anywhere in the world.
GAO reports go beyond the question of whether federal funds
are being spent appropriately to ask whether federal programs
and policies
are meeting their objectives and the needs of society.
GAO looks at the results that departments and agencies are
getting
with the taxpayer dollars they receive.
“
6. Program Evaluation
Outcome Evaluation
Needs Assessment
Process Evaluation
Performance Measurement
Social Accounting
Double Bottom Line Accounting
Triple Bottom Line Accounting
Evidence-based Practice
Implementation Assessment
Impact AssessmentPerformance Auditing
Policy Analysis
Cost-benefit Analysis
Prospective Evaluation Synthesis
Outcome Monitoring
7. THE PARADIGM SHIFT
Old paradigm New paradigm
ETHICS Focuses on intentional fraud and abuse
Includes spending taxpayer money on
ineffective programs
TRANSPARENCY Make financial statements available
Examine and report on difficult-to-
measure outcomes
NEUTRALITY Avoid political debates and policy issues
Provide unbiased analysis to enhance
debates and policy considerations
SCOPE OF ANALYSIS Short-term financial information Long-term outcomes and impacts
ACCOUNTABILITY Following established rules Achieving mission and objectives
STEWARDSHIP Public money Public lives
8. The concept of holding government accountable
suggests an expanded role
for government accountancy.
It suggests the need to account for mission.
15. ACCOUNTING FOR MISSION
INPUTS ACTIVITIES
SHORT-TERM
OUTCOMES
INTERMEDIATE
OUTCOMES
LONG-TERM
OUTCOMES
OTHER INFLUENTIAL FACTORS
16. A MISSION ORIENTATION
• Identify the mission and activities of the organization.
• Promote organizational accountability for mission and outcomes.
• Orient yourself to outcome and activity data that already exists.
• Leverage opportunities to gather better data.
• Apply your existing knowledge and skills to organize data better.
• Implement ways to monitor data better.
• Analyze data using a variety of techniques and methods.
• Make performance and outcome data transparent.
17. PROMISING MODELS AND APPROACHES
• Determine whether an entitlement program (or any program or policy
with an eligibility cutoff) is effective using regression discontinuity
analysis.
• Examine whether a new practice or policy is effective using interrupted
time series analysis.
• Consider the efficiency and comparative value of similar or competing
programs using cost-benefit analysis.
21. It is not only what we do,
but also what we do not
do,
for which we are
accountable.
“
”― Molière
Editor's Notes
This image of the US capitol was taken from kogodnow.com and is assumed to be original content protected under a Creative Commons Attribution-NoDerivs 3.0 License. For more information about what that means, please visit creativecommons.org. The image has not been modified.
Walker, D. M. (2004). GAO Answers the Question: What’s in a Name?. Roll Call, 19.
Walker, D. M. (2004). GAO Answers the Question: What’s in a Name?. Roll Call, 19.
Program Evaluation
Performance Measurement
Policy Analysis
Evidence-based Practice
Outcome Evaluation
Impact Assessment
Implementation Assessment
Process Evaluation
Cost-benefit Analysis
Double Bottom Line Accounting
Triple Bottom Line Accounting
Social Accounting
Performance Monitoring
Outcome Monitoring
Prospective Evaluation Synthesis
Needs Assessment
Mission and activities may seem disconnected if you don’t have a good, purposeful plan. Activities can seem entirely removed from the grander purpose of the organization or even role/position.
Mission and activities may seem disconnected if you don’t have a good, purposeful plan. Activities can seem entirely removed from the grander purpose of the organization or even role/position.
The type of purposeful plan we are about to create is called a “logic model.” In a logic model, we refer to the overall mission or objective of an activity or set of activities as “long-term outcomes.”
The first part of a purposeful plan that is essential for linking activities to outcomes is identifying the inputs needed to actually carry out those activities successfully. Inputs identify the resources needed to carry out the key activities of an organization. An activity that is improperly resourced will be less effective at carrying out its activities and ultimately less likely to achieve the long-term outcomes.
The next step to creating a purposeful plan is to identify what the immediate results, or short-term outcomes, of activities are expected to be. It is almost never the case that doing an activity automatically results in achieving the aspirational mission of a position or agency. Instead, there is usually a logical chain of events that occurs over some period of time to achieve the mission. Each of these links should be an “if-then” statement.
Short-term outcomes are the immediate observable results of carrying out an activity. For example, the immediate result of mopping the floor should be clean floors. For attending a meeting, should either be some decision or level of understanding that has been reached.
There may be various intermediate steps between the immediate results of an activity (short term outcomes) and achievement of the mission (long-term outcomes). All of these intermediate steps are called intermediate outcomes. Intermediate outcomes should be if-thens eventually linking the short-term outcomes to the long-term outcomes.
Note: most logic models also include “outputs” which are measures of activities. However, we should be employing measures of all elements of the logic model, and this approach maintains the if-then continuity from element to element.
There may be various intermediate steps between the immediate results of an activity (short term outcomes) and achievement of the mission (long-term outcomes). All of these intermediate steps are called intermediate outcomes. Intermediate outcomes should be if-thens eventually linking the short-term outcomes to the long-term outcomes.
Note: most logic models also include “outputs” which are measures of activities. However, we should be employing measures of all elements of the logic model, and this approach maintains the if-then continuity from element to element.
Source: Mbiti & Lucas (2013) test the impact of secondary school quality on student achievement in Kenya, using the cut-off on the primary exit exam required to get into better secondary schools.
Located from: http://blogs.worldbank.org/impactevaluations/trade/regression-discontinuity-porn
Ma Z, Kuller LH, Fisher MA, Ostroff SM. Use of Interrupted Time-Series Method to Evaluate the Impact of Cigarette Excise Tax Increases in Pennsylvania, 2000–2009. Prev Chronic Dis 2013;10:120268. DOI: http://dx.doi.org/10.5888/pcd10.120268