EX: World Bank Global and Regional Partnership Program began in mid-1990s – now supporting over 175 partnership programs and spending $3.5 billion annually EX: Climate Works Foundation – organized 10 funders and actors across sectors/geographies as part of a billion dollar networked campaign to fight climate change EX: Grant makers like Packard, Ford, Casey, MacArthur and other Foundations supporting networks as a key part of their portfolio and strategy
Monitoring and Evaluating Networks March 5, 2011
Specific indicator can be developed for each metric
Different categories of metrics may be more or less important depending on context
Example Network Metrics and Survey/Stakeholder Interview Questions Network Vibrancy Alignment Is there a match between member’s goals/priorities and that of the network? Diversity How diverse is the network? Is the current level of diversity appropriate for the network’s goals? Network Connectivity Participation How active are members? What is the value of participating in the network? Communication How well do the various network parts communicate with each other? How often do network members communicate Network Effects Influence How influential is the network? Value added Is the network fully realizing the advantages of working together?
Identifying Output and Outcome (Effects) Indicators
What are the network and its members achieving?
What are the indicators that can be used to track progress towards outputs and outcomes?
Output and outcome indicators should be tied to outputs and outcomes identified in the ToC/ToA
Identifying Vibrancy and Connectivity Indicators
How well is the “network” itself functioning?
What value added does using a network approach bring?
Network and members should monitor at least some components within the vibrancy and connectivity categories
Vibrancy and Connectivity indicators can help test original assumptions about network approach
Tools can be used in combination to support data gathering for specific metrics of interest
Identify the indicators and then select the appropriate tool to help gather data
Example Vibrancy Tools Tool Purpose Strength Comparative Constituency Feedback Surveys Gather stakeholder perceptions that can then be compared across similar networks Allows for benchmarking and can foster learning across networks. Opportunity to incorporate stakeholder perceptions. Network Effectiveness Diagnostic Tool Short tool to identify the strengths and weaknesses and to explore possible actions to develop or strengthen the network Relatively simple activity requiring limited time and resources. Responses could be compared across stakeholder groups. Partnership Score Card Identifies where partnerships are excelling, where they are breaking down and why. Assesses partnerships by analyzing the tangible and intangible exchanges between the parties.. Provides detail on specific partnerships of interest. Performance targets can be set and measured/assessed at regular intervals
Example Connectivity Tools Tool Purpose Strength Social Network Analysis Examines the links, relationships and behaviors between actors Analyzes behavior patterns and group structure - Can be used to asses changes in network structure over time Good for understanding the relationships between actors within the network and overall network structure Value Network Analysis Maps activities and sets of relationships identifying both tangible and intangible transactions and roles within the network Examines what specifically is being “exchanged” within the network . Identifies both tangible and intangible value. Monitoring at the edges Monitor levels of networking that do not directly involve the secretariat Relatively simple activity requiring limited time and resources
Example Effects Tools Tool Purpose Strength Strategic Leverage Index Examines how groups come together to achieve their own and broader collective goals - Creates a conversation around values Works to measure stakeholders inter-dependencies Creates a picture of network “health” across stakeholder groups and levels Impact Pathway Evaluation Impact pathway (or ToC) developed at the start of the initiative -Monitoring of indicators aligned withthe ToC used to guide the initiative and revise/refine the ToC in real time - Evaluation seeks to establish plausible links between the initiative’s ToC and subsequent developmental changes Links external punctuated evaluation to continuous internal M&E - Makes explicit, tests and refines an initiative’s ToC Contribution Assessment Understand how and where members are interacting with the network and what their priorities are Relatively simple participatory activity requiring limited time and resources