The document discusses the development of an M&E (monitoring and evaluation) framework for evaluating transboundary collaboration in marine spatial planning. It provides an overview of the framework, which is based on a literature review and project interviews/observations. The framework focuses on cross-border MSP collaboration and provides guidance on evaluating such processes. It introduces a theory-based evaluation approach using a logic model to understand how MSP plans and policies produce change through activities, actions, outputs and outcomes. The document is being updated based on additional analysis and comments are requested by the end of August to further improve the framework.

1. M&E framework
Szczecin edition
June 22, 2016

2. M&E framework
• Based on
– Literature review
– Interviews and observations during the project
• Focus on transboundary and cross-border
collaboration in MSP
• The framework
– To be used when countries or stakeholders evaluate
the processes
– Presents an approach and suggestions on how to not
an evaluation method

3. Updated version available
• Updated based on analysis of interviews and
observations

4. Updated version available
Different practices across borders
Know planning systems of neighbours
Existing cross-border collaboration and networks
Common approaches to MSP
Common standards for data and mapping
International policies
Talk to each other, ask questions (communication)
Stated national priorities help collaboration
Address TB issues in national processes
MSP has different status in different countries
Similar understanding of topics
Countries in different timing

5. Updated version available
• Updated based on analysis of interviews and
observations
• Still work under construction
• For comments at workspace
– Folder: Monitoring Evaluation/FOR COMMENTS
– Please send comments by end of August
– Upload into folder WITH A DIFFERENT FILE NAME

6. Purpose of the final product
• Explain rationale for evaluating
– The point of evaluation and monitoring is to know that
are we meeting the objectives we aim to achieve
• And to check what other harm we may cause (side-effects)
– Preparing for evaluation from the beginning helps to
plan your process
• Goal → Objective → Indicator → Management measure
(Douvere and Ehler 2011)
• SMART (specific, measurable, achievable, realistic and
timely)
• Provide guidance on evaluating transboundary
collaboration in MSP
• Theory-based evaluation

7. Theory-based evaluation
• Theory-based evaluation approach is a mainstream
approach in policy evaluation
– Broad discussion, e.g. intervention theory, program theory,
intervention logic, logical framework
– e.g. inherent in preparation of European Maritime and
Fisheries Fund
• What ”theory” are we talking about here?
– An understanding of how a spatial plan, policy or
intervention will produce change (theory of change)
– ”Through which activities, actions and outputs my plan will
reach the set objectives?”
– Contextual issues
• What are the risks stemming from the broader context?
• Side-effects

8. Theory-based evaluation
• An approach, not a specific method
– Several examples of methods that can be used
• Open standards for conservation planning
– BaltSpace – a good example
• Start from defining objectives

9. Intervention
Inputs Activities Outputs
Impact
Initial
outcomes
Intermediate
outcomes
Impacts
Assumptions:
How do the outputs result in outcomes? What has to
happen? What contextual factors influence?
Risks:
Risks that the link is weak or non-existing
Side-effects:
What are the intervention’s effects in a broader context?

10. Hansen, Morten Balle, and Evert Vedung 2010.
Theory-Based Stakeholder Evaluation. American
Journal of Evaluation 31(3):295-313.

11. Process in BalticSCOPE
• Adjust the principle into evaluation of
transboundary collaboration in MSP
• Continue analysing the material
• Work together with the planners – group works
• Today a group work on outcomes and how do
we know, if we are achieving them