Sanjeev Khagram of iScale will share findings from report "Next Generation Network Evaluation" and lead a conversation on network metrics.

1. Monitoring and Evaluating Networks March 5, 2011

9. Standardized, Complicated and Complex Initiatives

30. Example Network Metrics and Survey/Stakeholder Interview Questions Network Vibrancy Alignment Is there a match between member’s goals/priorities and that of the network? Diversity How diverse is the network? Is the current level of diversity appropriate for the network’s goals? Network Connectivity Participation How active are members? What is the value of participating in the network? Communication How well do the various network parts communicate with each other? How often do network members communicate Network Effects Influence How influential is the network? Value added Is the network fully realizing the advantages of working together?

34. Example Vibrancy Tools Tool Purpose Strength Comparative Constituency Feedback Surveys Gather stakeholder perceptions that can then be compared across similar networks Allows for benchmarking and can foster learning across networks. Opportunity to incorporate stakeholder perceptions. Network Effectiveness Diagnostic Tool Short tool to identify the strengths and weaknesses and to explore possible actions to develop or strengthen the network Relatively simple activity requiring limited time and resources. Responses could be compared across stakeholder groups. Partnership Score Card Identifies where partnerships are excelling, where they are breaking down and why. Assesses partnerships by analyzing the tangible and intangible exchanges between the parties.. Provides detail on specific partnerships of interest. Performance targets can be set and measured/assessed at regular intervals

35. Example Connectivity Tools Tool Purpose Strength Social Network Analysis Examines the links, relationships and behaviors between actors Analyzes behavior patterns and group structure - Can be used to asses changes in network structure over time Good for understanding the relationships between actors within the network and overall network structure Value Network Analysis Maps activities and sets of relationships identifying both tangible and intangible transactions and roles within the network Examines what specifically is being “exchanged” within the network . Identifies both tangible and intangible value. Monitoring at the edges Monitor levels of networking that do not directly involve the secretariat Relatively simple activity requiring limited time and resources

36. Example Social Network Analysis Map

37. Example Effects Tools Tool Purpose Strength Strategic Leverage Index Examines how groups come together to achieve their own and broader collective goals - Creates a conversation around values Works to measure stakeholders inter-dependencies Creates a picture of network “health” across stakeholder groups and levels Impact Pathway Evaluation Impact pathway (or ToC) developed at the start of the initiative -Monitoring of indicators aligned withthe ToC used to guide the initiative and revise/refine the ToC in real time - Evaluation seeks to establish plausible links between the initiative’s ToC and subsequent developmental changes Links external punctuated evaluation to continuous internal M&E - Makes explicit, tests and refines an initiative’s ToC Contribution Assessment Understand how and where members are interacting with the network and what their priorities are Relatively simple participatory activity requiring limited time and resources