SlideShare a Scribd company logo
1 of 9
1
Looking Forward to the Future
of Federal Evaluation Efforts:
Addressing Identified Challenges
April 28, 2015
Eastern Evaluation Research Society
“Let’s Get Real: Evaluation Challenges and Solutions”
38th Annual EERS Conference in Galloway, NJ
Nicholas Hart
U.S. Office of Management and Budget (OMB)
Challenges in Federal Evaluation
• Encouraging production and use (supply/demand)
– Building and maintaining support from agency leaders
– Providing evaluations in a timely manner for decisions
– Facilitating access to data the government already collects
(and ensuring quality)
• Identifying appropriate level of flexibility for initiatives
given mixed capacity across Federal agencies
• Engaging stakeholders within agencies, Congress, and
the public
• Linking existing efforts, especially performance
measurement mandates with evaluation efforts
2
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
Administration Proposals for FY 2016
1. Funding
– New fund requests
– New set-aside requests
– Contract flexibility
2. Rapid Evaluation
– Behavioral Insights
– Improving Data Access
3. Use
– Program Scaling
– “Tiered Evidence” for Grants
3
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
Funding Proposals
• Sample of new evaluation funding requests:
– Double funding for early education and childhood evaluation
– Triples funding for Ed’s First in the World Fund (+$200m)
– Create American Technical Training Fund to evaluate job-
training models (+$200m)
– New Child Support Research Fund (+$1b/10 years)
– First time proposals for energy assistance evaluation and
innovation funding (+$200m)
– Early intervention demonstration projects for the Social
Security Disability Insurance program (+$400m)
– MCC economic development approaches (+$350m)
– PEPFAR Impact Fund for AIDS data collection and program
evaluation (+$300m)
4
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
Funding Proposals
• Set-aside authority:
– Funding set-aside requests for select Education, HHS,
and Labor programs
• Funding Flexibility
– Increase funding flexibility for evaluation and survey
contracts.
– Would apply to HHS (ASPE, ACF), DOL (eval, BLS), DOJ
(NIJ, BJS), Commerce (Census), and HUD (OPDR).
5
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
Rapid Evaluation Proposals
• Behavioral Insights
– Team focused on assessing behaviorally-informed
interventions using low-cost RCTs
• Access to Administrative Data
– Expanding access
– Invest in infrastructure
– Plan for future improvements
6
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
Evaluation Use
• Program Scaling
– DOL re-employment services
– HUD’s Jobs-Plus program
– Apprenticeships
• “Tiered Evidence” approaches
– ED’s Investing in Innovation Fund (i3)
– USAID’s Global Development Lab
– Social Innovation Fund (SIF)
– ED’s Leveraging What Works grants
7
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
What’s not included
• Framework for integration of evaluation
activities with performance measurement or
strategic planning efforts
• Evaluation directives or mandates
• Baseline capacity survey or analysis
• Uniform approaches
• Explicit methodological preferences
• PRA modifications
8
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart
Thank you.
Nicholas Hart
nhart@omb.eop.gov
www.whitehouse.gov/omb
9
Looking Forward to the Future of Federal Evaluation Efforts:
Addressing Identified Challenges
Hart

More Related Content

What's hot

Measure for Measure: The role of metrics in assessing research performance - ...
Measure for Measure: The role of metrics in assessing research performance - ...Measure for Measure: The role of metrics in assessing research performance - ...
Measure for Measure: The role of metrics in assessing research performance - ...
Michael Habib
 
ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...
ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...
ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...
Greg Raschke
 

What's hot (20)

Measuring Progress: Indicators, Data Sources and Assessment | Laszlo Pinter, ...
Measuring Progress: Indicators, Data Sources and Assessment | Laszlo Pinter, ...Measuring Progress: Indicators, Data Sources and Assessment | Laszlo Pinter, ...
Measuring Progress: Indicators, Data Sources and Assessment | Laszlo Pinter, ...
 
Small grants, big opportunities: Using the small grants mechanism to build l...
Small grants, big opportunities: Using the small grants mechanism  to build l...Small grants, big opportunities: Using the small grants mechanism  to build l...
Small grants, big opportunities: Using the small grants mechanism to build l...
 
The dog who caught the car: There’s more PEPFAR data than ever before, now what?
The dog who caught the car: There’s more PEPFAR data than ever before, now what?The dog who caught the car: There’s more PEPFAR data than ever before, now what?
The dog who caught the car: There’s more PEPFAR data than ever before, now what?
 
Roth "Tools to support systematic review research"
Roth "Tools to support systematic review research"Roth "Tools to support systematic review research"
Roth "Tools to support systematic review research"
 
Improving Health Information Systems in Uganda: The HIS Stages of Continuous ...
Improving Health Information Systems in Uganda: The HIS Stages of Continuous ...Improving Health Information Systems in Uganda: The HIS Stages of Continuous ...
Improving Health Information Systems in Uganda: The HIS Stages of Continuous ...
 
Molly Irwin - Evidence informed policy making - 27 June 2017
Molly Irwin - Evidence informed policy making - 27 June 2017Molly Irwin - Evidence informed policy making - 27 June 2017
Molly Irwin - Evidence informed policy making - 27 June 2017
 
LASYR Slides IEEE event 07 APR 2021
LASYR Slides IEEE event 07 APR 2021LASYR Slides IEEE event 07 APR 2021
LASYR Slides IEEE event 07 APR 2021
 
RDC Xinjie Cui - Data Interoperability_II
RDC Xinjie Cui - Data Interoperability_IIRDC Xinjie Cui - Data Interoperability_II
RDC Xinjie Cui - Data Interoperability_II
 
Integrated Approaches for SDGs planning
Integrated Approaches for SDGs planning Integrated Approaches for SDGs planning
Integrated Approaches for SDGs planning
 
Report by PEMPAL performance budgeting working group - Naida Carsimamovic - W...
Report by PEMPAL performance budgeting working group - Naida Carsimamovic - W...Report by PEMPAL performance budgeting working group - Naida Carsimamovic - W...
Report by PEMPAL performance budgeting working group - Naida Carsimamovic - W...
 
Measure for Measure: The role of metrics in assessing research performance - ...
Measure for Measure: The role of metrics in assessing research performance - ...Measure for Measure: The role of metrics in assessing research performance - ...
Measure for Measure: The role of metrics in assessing research performance - ...
 
NIH 101: Tips and Tools for New & Early-Stage Researchers
NIH 101: Tips and Tools for New & Early-Stage ResearchersNIH 101: Tips and Tools for New & Early-Stage Researchers
NIH 101: Tips and Tools for New & Early-Stage Researchers
 
2_resume_2016.11
2_resume_2016.112_resume_2016.11
2_resume_2016.11
 
ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...
ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...
ARL Collections Presentation: Moneyball, the Extra 2%, and What Baseball Mana...
 
Jisc learninganalytics dec2016
Jisc learninganalytics dec2016Jisc learninganalytics dec2016
Jisc learninganalytics dec2016
 
Enabling smaller independent publishers to participate in Open Access agreeme...
Enabling smaller independent publishers to participate in Open Access agreeme...Enabling smaller independent publishers to participate in Open Access agreeme...
Enabling smaller independent publishers to participate in Open Access agreeme...
 
Ask an NIH Program Officer: Tips and Tools for New & Early-Stage Researchers
Ask an NIH Program Officer: Tips and Tools for New & Early-Stage ResearchersAsk an NIH Program Officer: Tips and Tools for New & Early-Stage Researchers
Ask an NIH Program Officer: Tips and Tools for New & Early-Stage Researchers
 
Falk-Krzesinski, "Administrator (Institutional Use of the Data): Data-informe...
Falk-Krzesinski, "Administrator (Institutional Use of the Data): Data-informe...Falk-Krzesinski, "Administrator (Institutional Use of the Data): Data-informe...
Falk-Krzesinski, "Administrator (Institutional Use of the Data): Data-informe...
 
Monitoring Scale-up of Health Practices and Interventions
Monitoring Scale-up of Health Practices and InterventionsMonitoring Scale-up of Health Practices and Interventions
Monitoring Scale-up of Health Practices and Interventions
 
Jisc learning analytics MASHEIN Jan 2017
Jisc learning analytics MASHEIN Jan 2017Jisc learning analytics MASHEIN Jan 2017
Jisc learning analytics MASHEIN Jan 2017
 

Viewers also liked

Viewers also liked (10)

Hart and Newcomer -- Change, Continuity and Lessons Unlearned: A Tale of Two ...
Hart and Newcomer -- Change, Continuity and Lessons Unlearned: A Tale of Two ...Hart and Newcomer -- Change, Continuity and Lessons Unlearned: A Tale of Two ...
Hart and Newcomer -- Change, Continuity and Lessons Unlearned: A Tale of Two ...
 
Determinants of Evaluation Supply at the US EPA: A Case Study of the RCRA Ha...
Determinants of Evaluation Supply at the US EPA:  A Case Study of the RCRA Ha...Determinants of Evaluation Supply at the US EPA:  A Case Study of the RCRA Ha...
Determinants of Evaluation Supply at the US EPA: A Case Study of the RCRA Ha...
 
Hart & Newcomer 2015 -- Change and Continuity: Lessons Learned from the Bush ...
Hart & Newcomer 2015 -- Change and Continuity: Lessons Learned from the Bush ...Hart & Newcomer 2015 -- Change and Continuity: Lessons Learned from the Bush ...
Hart & Newcomer 2015 -- Change and Continuity: Lessons Learned from the Bush ...
 
Sejarah android
Sejarah androidSejarah android
Sejarah android
 
Sijil Tinggi Muamalat 2 - Prinsip Asas Perniagaan: Tn. Hj. Yahya
Sijil Tinggi Muamalat 2 - Prinsip Asas Perniagaan: Tn. Hj. YahyaSijil Tinggi Muamalat 2 - Prinsip Asas Perniagaan: Tn. Hj. Yahya
Sijil Tinggi Muamalat 2 - Prinsip Asas Perniagaan: Tn. Hj. Yahya
 
Using Evidence and Evaluation in Federal Budget Decisions
Using Evidence and Evaluation in Federal Budget DecisionsUsing Evidence and Evaluation in Federal Budget Decisions
Using Evidence and Evaluation in Federal Budget Decisions
 
No a la discriminación
No a la discriminaciónNo a la discriminación
No a la discriminación
 
Insights from Program Evaluation for Retrospective Reviews of regulations
Insights from Program Evaluation for Retrospective Reviews of regulationsInsights from Program Evaluation for Retrospective Reviews of regulations
Insights from Program Evaluation for Retrospective Reviews of regulations
 
Hart 2014 -- Overseeing the Enforcers (Delivered on Nov. 6, 2014)
Hart 2014  -- Overseeing the Enforcers (Delivered on Nov. 6, 2014)Hart 2014  -- Overseeing the Enforcers (Delivered on Nov. 6, 2014)
Hart 2014 -- Overseeing the Enforcers (Delivered on Nov. 6, 2014)
 
Envisioning Solutions to Problem Scenarios in Evaluation (AEA 2014)
Envisioning Solutions to Problem Scenarios in Evaluation (AEA 2014)Envisioning Solutions to Problem Scenarios in Evaluation (AEA 2014)
Envisioning Solutions to Problem Scenarios in Evaluation (AEA 2014)
 

Similar to Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges

Aea presentation final 18_oct2013
Aea presentation final 18_oct2013Aea presentation final 18_oct2013
Aea presentation final 18_oct2013
soder145
 
Stewart_CapstonePresentation_2015 Dec
Stewart_CapstonePresentation_2015 DecStewart_CapstonePresentation_2015 Dec
Stewart_CapstonePresentation_2015 Dec
Haley J. Stewart
 
Diagnosing State Enrollment Systems: Just What the Doctor Ordered!
Diagnosing State Enrollment Systems: Just What the Doctor Ordered!Diagnosing State Enrollment Systems: Just What the Doctor Ordered!
Diagnosing State Enrollment Systems: Just What the Doctor Ordered!
NASHP HealthPolicy
 
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Derek Warnick
 
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
D. Warnick Consulting
 
Iwasiw ppts ch08_3_e
Iwasiw ppts ch08_3_eIwasiw ppts ch08_3_e
Iwasiw ppts ch08_3_e
stanbridge
 

Similar to Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges (20)

Aea presentation final 18_oct2013
Aea presentation final 18_oct2013Aea presentation final 18_oct2013
Aea presentation final 18_oct2013
 
Winning SBIR Grants & NSF I-Corps Program Update
Winning SBIR Grants & NSF I-Corps Program UpdateWinning SBIR Grants & NSF I-Corps Program Update
Winning SBIR Grants & NSF I-Corps Program Update
 
PPX January 2016 LE
PPX January 2016 LEPPX January 2016 LE
PPX January 2016 LE
 
Fostering research for policy and practitioners lessons and opportunities
Fostering research for policy and practitioners lessons and opportunitiesFostering research for policy and practitioners lessons and opportunities
Fostering research for policy and practitioners lessons and opportunities
 
Stewart_CapstonePresentation_2015 Dec
Stewart_CapstonePresentation_2015 DecStewart_CapstonePresentation_2015 Dec
Stewart_CapstonePresentation_2015 Dec
 
Strengthen Dissemination, Implementation and Improvement Science
Strengthen Dissemination, Implementation and Improvement ScienceStrengthen Dissemination, Implementation and Improvement Science
Strengthen Dissemination, Implementation and Improvement Science
 
Hm 418 harris ch09 ppt
Hm 418 harris ch09 pptHm 418 harris ch09 ppt
Hm 418 harris ch09 ppt
 
Diagnosing State Enrollment Systems: Just What the Doctor Ordered!
Diagnosing State Enrollment Systems: Just What the Doctor Ordered!Diagnosing State Enrollment Systems: Just What the Doctor Ordered!
Diagnosing State Enrollment Systems: Just What the Doctor Ordered!
 
CHHS Open DataFest - 3.14.16 - Day One Morning Sessions
CHHS Open DataFest - 3.14.16 - Day One Morning SessionsCHHS Open DataFest - 3.14.16 - Day One Morning Sessions
CHHS Open DataFest - 3.14.16 - Day One Morning Sessions
 
Ron Haskins Evidence based policymaking uk
Ron Haskins Evidence based policymaking ukRon Haskins Evidence based policymaking uk
Ron Haskins Evidence based policymaking uk
 
Building the Ship as it Sails: Challenges and Strategies to Assess and Enhanc...
Building the Ship as it Sails: Challenges and Strategies to Assess and Enhanc...Building the Ship as it Sails: Challenges and Strategies to Assess and Enhanc...
Building the Ship as it Sails: Challenges and Strategies to Assess and Enhanc...
 
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
 
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
Sneak Peek at the 2014 Benchmarking Survey (Guerrero & Dzenko)
 
Developing Better Environmental Evidence in the U.S.: Determinants of Evaluat...
Developing Better Environmental Evidence in the U.S.: Determinants of Evaluat...Developing Better Environmental Evidence in the U.S.: Determinants of Evaluat...
Developing Better Environmental Evidence in the U.S.: Determinants of Evaluat...
 
McCann-Woods Resume-Skills Based
McCann-Woods Resume-Skills BasedMcCann-Woods Resume-Skills Based
McCann-Woods Resume-Skills Based
 
Iwasiw ppts ch08_3_e
Iwasiw ppts ch08_3_eIwasiw ppts ch08_3_e
Iwasiw ppts ch08_3_e
 
Evaluation Amidst Paperwork Reduction Act Reviews: Overcoming Challenges fro...
Evaluation Amidst Paperwork Reduction Act Reviews:  Overcoming Challenges fro...Evaluation Amidst Paperwork Reduction Act Reviews:  Overcoming Challenges fro...
Evaluation Amidst Paperwork Reduction Act Reviews: Overcoming Challenges fro...
 
Big Data Opportunities in Census Bureau Research
Big Data Opportunities in Census Bureau ResearchBig Data Opportunities in Census Bureau Research
Big Data Opportunities in Census Bureau Research
 
US University Research Funding, Peer Reviews, and Metrics
US University Research Funding, Peer Reviews, and MetricsUS University Research Funding, Peer Reviews, and Metrics
US University Research Funding, Peer Reviews, and Metrics
 
swot STRENGHT WEAKNESSES THREATS OPPURTUNITIES
swot STRENGHT WEAKNESSES THREATS OPPURTUNITIESswot STRENGHT WEAKNESSES THREATS OPPURTUNITIES
swot STRENGHT WEAKNESSES THREATS OPPURTUNITIES
 

More from Nick Hart, Ph.D.

More from Nick Hart, Ph.D. (7)

The Role of Federal Evaluation Activities in the “Evidence-Based” Policy and ...
The Role of Federal Evaluation Activities in the “Evidence-Based” Policy and ...The Role of Federal Evaluation Activities in the “Evidence-Based” Policy and ...
The Role of Federal Evaluation Activities in the “Evidence-Based” Policy and ...
 
Transparency for the Modern Evidence Ecosystem
Transparency for the Modern Evidence EcosystemTransparency for the Modern Evidence Ecosystem
Transparency for the Modern Evidence Ecosystem
 
2018 Policy Contours for Using Linked Administrative Data in Evidence-Based ...
2018 Policy Contours for Using Linked Administrative Data in Evidence-Based ...2018 Policy Contours for Using Linked Administrative Data in Evidence-Based ...
2018 Policy Contours for Using Linked Administrative Data in Evidence-Based ...
 
Improving Environmental Evidence in the US
Improving Environmental Evidence in the USImproving Environmental Evidence in the US
Improving Environmental Evidence in the US
 
Performance Partnership Case Presentation: Evaluation @EPA
Performance Partnership Case Presentation: Evaluation @EPAPerformance Partnership Case Presentation: Evaluation @EPA
Performance Partnership Case Presentation: Evaluation @EPA
 
Articulating Program Impacts with Case Studies & Success Stories
Articulating Program Impacts with Case Studies & Success StoriesArticulating Program Impacts with Case Studies & Success Stories
Articulating Program Impacts with Case Studies & Success Stories
 
Performance Measurement and Evaluation in the Obama Administration
Performance Measurement and Evaluation in the Obama AdministrationPerformance Measurement and Evaluation in the Obama Administration
Performance Measurement and Evaluation in the Obama Administration
 

Recently uploaded

Top profile Call Girls In Morena [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Morena [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Morena [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Morena [ 7014168258 ] Call Me For Genuine Models We...
gajnagarg
 
Cara Gugurkan Pembuahan Secara Alami Dan Cepat ABORSI KANDUNGAN 087776558899
Cara Gugurkan Pembuahan Secara Alami Dan Cepat ABORSI KANDUNGAN 087776558899Cara Gugurkan Pembuahan Secara Alami Dan Cepat ABORSI KANDUNGAN 087776558899
Cara Gugurkan Pembuahan Secara Alami Dan Cepat ABORSI KANDUNGAN 087776558899
Cara Menggugurkan Kandungan 087776558899
 
Nagerbazar @ Independent Call Girls Kolkata - 450+ Call Girl Cash Payment 800...
Nagerbazar @ Independent Call Girls Kolkata - 450+ Call Girl Cash Payment 800...Nagerbazar @ Independent Call Girls Kolkata - 450+ Call Girl Cash Payment 800...
Nagerbazar @ Independent Call Girls Kolkata - 450+ Call Girl Cash Payment 800...
HyderabadDolls
 

Recently uploaded (20)

The NAP process & South-South peer learning
The NAP process & South-South peer learningThe NAP process & South-South peer learning
The NAP process & South-South peer learning
 
2024 UN Civil Society Conference in Support of the Summit of the Future.
2024 UN Civil Society Conference in Support of the Summit of the Future.2024 UN Civil Society Conference in Support of the Summit of the Future.
2024 UN Civil Society Conference in Support of the Summit of the Future.
 
Tuvalu Coastal Adaptation Project (TCAP)
Tuvalu Coastal Adaptation Project (TCAP)Tuvalu Coastal Adaptation Project (TCAP)
Tuvalu Coastal Adaptation Project (TCAP)
 
Adajan < Russian Call Girls Ahmedabad | Starting ₹,5K To @25k with A/C 800573...
Adajan < Russian Call Girls Ahmedabad | Starting ₹,5K To @25k with A/C 800573...Adajan < Russian Call Girls Ahmedabad | Starting ₹,5K To @25k with A/C 800573...
Adajan < Russian Call Girls Ahmedabad | Starting ₹,5K To @25k with A/C 800573...
 
Coastal Protection Measures in Hulhumale'
Coastal Protection Measures in Hulhumale'Coastal Protection Measures in Hulhumale'
Coastal Protection Measures in Hulhumale'
 
The Outlook for the Budget and the Economy
The Outlook for the Budget and the EconomyThe Outlook for the Budget and the Economy
The Outlook for the Budget and the Economy
 
YHRGeorgetown Spring 2024 America should Take Her Share
YHRGeorgetown Spring 2024 America should Take Her ShareYHRGeorgetown Spring 2024 America should Take Her Share
YHRGeorgetown Spring 2024 America should Take Her Share
 
Call Girls Radhanpur - 8250092165 Our call girls are sure to provide you with...
Call Girls Radhanpur - 8250092165 Our call girls are sure to provide you with...Call Girls Radhanpur - 8250092165 Our call girls are sure to provide you with...
Call Girls Radhanpur - 8250092165 Our call girls are sure to provide you with...
 
Top profile Call Girls In Morena [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Morena [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Morena [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Morena [ 7014168258 ] Call Me For Genuine Models We...
 
Just Call VIP Call Girls In Bangalore Kr Puram ☎️ 6378878445 Independent Fem...
Just Call VIP Call Girls In  Bangalore Kr Puram ☎️ 6378878445 Independent Fem...Just Call VIP Call Girls In  Bangalore Kr Puram ☎️ 6378878445 Independent Fem...
Just Call VIP Call Girls In Bangalore Kr Puram ☎️ 6378878445 Independent Fem...
 
Delivery in 20 Mins Call Girls Malappuram { 9332606886 } VVIP NISHA Call Girl...
Delivery in 20 Mins Call Girls Malappuram { 9332606886 } VVIP NISHA Call Girl...Delivery in 20 Mins Call Girls Malappuram { 9332606886 } VVIP NISHA Call Girl...
Delivery in 20 Mins Call Girls Malappuram { 9332606886 } VVIP NISHA Call Girl...
 
Women Call Girls in gaya 8250092165 Call Girls Advance Cash On Delivery Service
Women Call Girls in gaya  8250092165 Call Girls Advance Cash On Delivery ServiceWomen Call Girls in gaya  8250092165 Call Girls Advance Cash On Delivery Service
Women Call Girls in gaya 8250092165 Call Girls Advance Cash On Delivery Service
 
PPT Item # 7&8 6900 Broadway P&Z Case # 438
PPT Item # 7&8 6900 Broadway P&Z Case # 438PPT Item # 7&8 6900 Broadway P&Z Case # 438
PPT Item # 7&8 6900 Broadway P&Z Case # 438
 
Financing strategies for adaptation. Presentation for CANCC
Financing strategies for adaptation. Presentation for CANCCFinancing strategies for adaptation. Presentation for CANCC
Financing strategies for adaptation. Presentation for CANCC
 
Vasai Call Girls In 07506202331, Nalasopara Call Girls In Mumbai
Vasai Call Girls In 07506202331, Nalasopara Call Girls In MumbaiVasai Call Girls In 07506202331, Nalasopara Call Girls In Mumbai
Vasai Call Girls In 07506202331, Nalasopara Call Girls In Mumbai
 
Cara Gugurkan Pembuahan Secara Alami Dan Cepat ABORSI KANDUNGAN 087776558899
Cara Gugurkan Pembuahan Secara Alami Dan Cepat ABORSI KANDUNGAN 087776558899Cara Gugurkan Pembuahan Secara Alami Dan Cepat ABORSI KANDUNGAN 087776558899
Cara Gugurkan Pembuahan Secara Alami Dan Cepat ABORSI KANDUNGAN 087776558899
 
Call Girl In Prayagraj Call Girls Service 👉 6378878445 👉 Just📲 Call Ruhi Call...
Call Girl In Prayagraj Call Girls Service 👉 6378878445 👉 Just📲 Call Ruhi Call...Call Girl In Prayagraj Call Girls Service 👉 6378878445 👉 Just📲 Call Ruhi Call...
Call Girl In Prayagraj Call Girls Service 👉 6378878445 👉 Just📲 Call Ruhi Call...
 
Premium Prayagraj ❤️🍑 6378878445 👄🫦Independent Escort Service
Premium  Prayagraj ❤️🍑 6378878445 👄🫦Independent Escort ServicePremium  Prayagraj ❤️🍑 6378878445 👄🫦Independent Escort Service
Premium Prayagraj ❤️🍑 6378878445 👄🫦Independent Escort Service
 
Nagerbazar @ Independent Call Girls Kolkata - 450+ Call Girl Cash Payment 800...
Nagerbazar @ Independent Call Girls Kolkata - 450+ Call Girl Cash Payment 800...Nagerbazar @ Independent Call Girls Kolkata - 450+ Call Girl Cash Payment 800...
Nagerbazar @ Independent Call Girls Kolkata - 450+ Call Girl Cash Payment 800...
 
Cheap Call Girls In Hyderabad Phone No 📞 9352988975 📞 Elite Escort Service Av...
Cheap Call Girls In Hyderabad Phone No 📞 9352988975 📞 Elite Escort Service Av...Cheap Call Girls In Hyderabad Phone No 📞 9352988975 📞 Elite Escort Service Av...
Cheap Call Girls In Hyderabad Phone No 📞 9352988975 📞 Elite Escort Service Av...
 

Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges

  • 1. 1 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges April 28, 2015 Eastern Evaluation Research Society “Let’s Get Real: Evaluation Challenges and Solutions” 38th Annual EERS Conference in Galloway, NJ Nicholas Hart U.S. Office of Management and Budget (OMB)
  • 2. Challenges in Federal Evaluation • Encouraging production and use (supply/demand) – Building and maintaining support from agency leaders – Providing evaluations in a timely manner for decisions – Facilitating access to data the government already collects (and ensuring quality) • Identifying appropriate level of flexibility for initiatives given mixed capacity across Federal agencies • Engaging stakeholders within agencies, Congress, and the public • Linking existing efforts, especially performance measurement mandates with evaluation efforts 2 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart
  • 3. Administration Proposals for FY 2016 1. Funding – New fund requests – New set-aside requests – Contract flexibility 2. Rapid Evaluation – Behavioral Insights – Improving Data Access 3. Use – Program Scaling – “Tiered Evidence” for Grants 3 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart
  • 4. Funding Proposals • Sample of new evaluation funding requests: – Double funding for early education and childhood evaluation – Triples funding for Ed’s First in the World Fund (+$200m) – Create American Technical Training Fund to evaluate job- training models (+$200m) – New Child Support Research Fund (+$1b/10 years) – First time proposals for energy assistance evaluation and innovation funding (+$200m) – Early intervention demonstration projects for the Social Security Disability Insurance program (+$400m) – MCC economic development approaches (+$350m) – PEPFAR Impact Fund for AIDS data collection and program evaluation (+$300m) 4 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart
  • 5. Funding Proposals • Set-aside authority: – Funding set-aside requests for select Education, HHS, and Labor programs • Funding Flexibility – Increase funding flexibility for evaluation and survey contracts. – Would apply to HHS (ASPE, ACF), DOL (eval, BLS), DOJ (NIJ, BJS), Commerce (Census), and HUD (OPDR). 5 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart
  • 6. Rapid Evaluation Proposals • Behavioral Insights – Team focused on assessing behaviorally-informed interventions using low-cost RCTs • Access to Administrative Data – Expanding access – Invest in infrastructure – Plan for future improvements 6 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart
  • 7. Evaluation Use • Program Scaling – DOL re-employment services – HUD’s Jobs-Plus program – Apprenticeships • “Tiered Evidence” approaches – ED’s Investing in Innovation Fund (i3) – USAID’s Global Development Lab – Social Innovation Fund (SIF) – ED’s Leveraging What Works grants 7 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart
  • 8. What’s not included • Framework for integration of evaluation activities with performance measurement or strategic planning efforts • Evaluation directives or mandates • Baseline capacity survey or analysis • Uniform approaches • Explicit methodological preferences • PRA modifications 8 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart
  • 9. Thank you. Nicholas Hart nhart@omb.eop.gov www.whitehouse.gov/omb 9 Looking Forward to the Future of Federal Evaluation Efforts: Addressing Identified Challenges Hart

Editor's Notes

  1. Challenges in Federal evaluation are many. This Administration has prioritized efforts to both produce and use evaluation, although there have been struggles in identifying the best path forward Specific challenges to highlight with proposals – resources, data availability, timeliness, use A number of other challenges without explicit proposals – link to GPRA, stakeholder engagement, PRA/timelineness
  2. Latest administration proposals fall in to three buckets where Administration asking for congressional approval: FUNDING Improving the supply of evaluation by funding more targeted, policy-relevant evaluations. These are cases where policymakers are asking for more information, a good indicator of potential use Set-aside requests help with formative and impact evaluation Flexibilities for certain agencies to address barriers to funding multi-year evaluations TIMELINENESS Related to use, approaches to helping expedite certain responses when possible to reduce uncertainty for decisionmakers USE Scale based on some evidence and incorporate in grant structures.
  3. Because the President’s budget request proposed lifting the BCA caps, room for many more investments in evaluation than recent years. Will just highlight a few: ACF spends 1/5 of 1 percent of its budget on evaluation (88M) and a lot of new requests are housed there. Early ed CSE LIHEAP SSA demonstration authority / DI Building off previous requests and new funding provided in 2015… Worth noting that not all of the requests are housed in social service agencies – some in State, USAID and USDA. At the end of the day, unclear how many of these will ultimately get enacted.
  4. Set-asides CSBG & SSBG up to 1 pct Labor increase from 0.5 pct to 1 pct Written as up to 1 pct to allow for flexibility for agency heads. Flexibility High quality evaluations are complicated and may span many years Study designs might be altered Recruitment might take longer than anticipated incremental funding of multiple-year non-severable contracts Would allow increased funding
  5. ADMIN DATA Expanding access – is about providing researchers access to what already exists. i.e NDNH, Medicare data and some tax data for statistical agencies Focus on improving government statistics and evaluations Infrastructure investments – data matching and sharing is currently a challenge – propose to encourage census too help facilitate linking and sharing of data Future – supports a commission similar to Ryan-Murray which focuses on expanding access to data, removing legislative barriers, while improving quality and protecting privacy