Evaluation in Foundations: Measuring Performance and Progress July 25, 2006

WHAT IS EVALUATION? The systematic investigation of the merit or worth of a program. Impact Assessment Operations Research Outcome Evaluation Continuous Improvement Implementation Evaluation Organizational Learning Summative Evaluation Knowledge Management Formative Evaluation Process Evaluation Quality Improvement Program Evaluation Organizational Effectiveness Strategy Review Monitoring Portfolio Assessment

The systematic investigation of the merit or

worth of a program.

Impact Assessment Operations Research

Outcome Evaluation Continuous Improvement

Implementation Evaluation Organizational Learning

Summative Evaluation Knowledge Management

Formative Evaluation Process Evaluation

Quality Improvement Program Evaluation

Organizational Effectiveness Strategy Review

Monitoring Portfolio Assessment

WHAT ARE FOUNDATIONS? IRS Tax Exempt Charities—501(c)3 5% Payout No Lobbying No Self-Dealing 60,000 in US $33 Billion in 2005 Community, Corporate, Family, Private Diverse giving interests, Health, Education Foundation Center

IRS Tax Exempt Charities—501(c)3

5% Payout

No Lobbying

No Self-Dealing

60,000 in US

$33 Billion in 2005

Community, Corporate, Family, Private

Diverse giving interests, Health, Education

Foundation Center

MEASURING OUTCOMES Goal: Raise the national graduation rate to 80% by 2020. Only 32% of American high school students will graduate with skills they need to succeed in college or work.

Goal: Raise the national graduation rate to 80% by 2020.

WHY EVALUATE? 70’s, rise of evaluation research 90’s Government Performance and Results Act 90’s West Coast Venture Capital = Venture Philanthropy Social Entrepreneurs ’ 98 Grantmakers for Effective Organizations Enron, WorldCom, Tyco Future?

70’s, rise of evaluation research

90’s Government Performance and Results Act

90’s West Coast

Venture Capital = Venture Philanthropy

Social Entrepreneurs

’ 98 Grantmakers for Effective Organizations

Enron, WorldCom, Tyco

Future?

WHY EVALUATE?

WHY EVALUATE? TWO THEORIES Scientific Management Taylor Rationality, Decision-Making, Utility functions Institutional Theory Meyer and Rowan Environment, Social and Cultural demands, Legitimacy

TWO THEORIES

Scientific Management

Taylor

Rationality, Decision-Making, Utility functions

Institutional Theory

Meyer and Rowan

Environment, Social and Cultural demands, Legitimacy

TOOLS AND TEMPLATES Dashboards and Scorecards Portfolio Reviews

Dashboards and Scorecards

Portfolio Reviews

REPORTS High School Grants Evaluation 2002-2004 AIR and SRI BusinessWeek “ We are unafraid.” www.gatesfoundation.org

High School Grants Evaluation

2002-2004

AIR and SRI

BusinessWeek

“ We are unafraid.”

www.gatesfoundation.org

RESOURCES Grantmakers for Effective Organizations AEA W.K. Kellogg Foundation Foundation Strategy Group Blueprint R&D Philanthropy NW

Grantmakers for Effective Organizations

AEA

W.K. Kellogg Foundation

Foundation Strategy Group

Blueprint R&D

Philanthropy NW