• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
CES Toronto 2013 Engaging Practitioners in Evaluation using the Risk Based Compliance Framework
 

CES Toronto 2013 Engaging Practitioners in Evaluation using the Risk Based Compliance Framework

on

  • 318 views

This is a paper presentated to CES Toronto 2013. It describes a case study of how a management process is being used to embed effective design of regulatory compliance approaches into practise, and ...

This is a paper presentated to CES Toronto 2013. It describes a case study of how a management process is being used to embed effective design of regulatory compliance approaches into practise, and how it makes space for monitoring and evaluation. It highlights the importance of team formation in bringing expertise toegether from across the regulatory system (standard setting, monitoring and behaviour change). It also highlights some of the lessons from the initial application of the framework

Statistics

Views

Total Views
318
Views on SlideShare
318
Embed Views
0

Actions

Likes
0
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    CES Toronto 2013 Engaging Practitioners in Evaluation using the Risk Based Compliance Framework CES Toronto 2013 Engaging Practitioners in Evaluation using the Risk Based Compliance Framework Presentation Transcript

    • Risk Based Compliance Framework as anApproach to Engage Practitioners inEvaluationCanadian Evaluation Society Conference 2013Mark WhiteOntario Ministry of the Environment
    • Purpose• Describe the Risk Based Compliance Framework• A case study in the use of a management process toengage practitioners in evaluation• Highlight our learning relevant to the themes ofengagement across boundaries and embeddingevaluation in the organization• It has to be needed... now!• Familiarity breeds... engagement• It helps to be good enough, not perfect• Adapt to the environment• Providing a trigger for evaluation2 Ministry of the Environment
    • 3Risk Based Compliance Framework: OverviewContext•A healthy environment for a strong Ontario•Compliance approach = a combination oftools to monitor compliance and to influencebehaviourAim•To develop compliance approaches thatensure efficient and effective delivery ofregulatory objectivesKey Features•Integrates expertise across organizationalboundaries•Systematically considers influencesBenefits•Focus on evidence based decisions•Focus on communicating the benefits wedeliver3 Ministry of the Environment
    • Risk based Compliance Framework: Steps4
    • The Risk based Compliance Framework and Evaluation5 Ministry of the Environment
    • Performance Monitoring6 Ministry of the Environment• Performance Monitoringunderpinned by logic model A conceptual framework formingthe basis for a managementscorecard Intuitive way of linking activitiesto regulatory objectives Tailored for each complianceapproach• Challenges Outcome measures Limited evidence base Cost effectiveness
    • Engaging Practitioners in Evaluation7 Ministry of the Environment
    • Theme 1: It has to be needed… now!8 Ministry of the Environment
    • Theme 2: Familiarity breeds… Engagement•Relationship between evaluativeprocess and context is importantfor engagement Familiarity with concepts Familiarity with tasks Fit with process•Engagement on easier tasksprovides basis for more complexevaluative tasks9 Ministry of the Environment
    • Theme 3: Good enough, not perfect10** Haynes, L. et al. (2012). Test, Learn, Adapt: Developing Public Policywith Randomised Controlled Trials, Cabinet Office. Behavioural Insights• Working together to improvethe framework Improves the product Improves engagement• Pilot project Test on a ‘Real’ problem Engages project team Engages management• Awareness raising as anopportunity to learn andadapt
    • Theme 4: Adapt to the Environment11 Ministry of the EnvironmentDarwin’s finches**Wikimedia Commons (PublicDomain)• Adapting the framework tomeet the needs of thespecific circumstances Subject matter Tailoring the framework to context Importance of understandinginterdependencies betweencompliance tools Limitations in evidence base Users Integration of different subjectmatter expertise Decision required Most effective & efficientcombination of approaches acrosscompliance program
    • Theme 5: Providing a ‘Trigger’ for Evaluation12 Ministry of the Environment• ‘Trigger’ points forevaluation are important Using a managementprocess to ensure evaluationis considered in a timelyfashion Consideration of what is goodpractice Development of Monitoring andEvaluation Plan prior toapproval
    • Conclusion Evaluation across Boundaries– Functional & Professional Engaging Practitioners in Evaluation– Management process:o Driven by need to promote effectivenesso Approach tailored to the circumstances– Evaluation:o Design Effectivenesso Implementation Effectivenesso Outcome Effectiveness13 Ministry of the EnvironmentQuestions?mark.white@ontario.ca