SlideShare a Scribd company logo
1 of 10
Download to read offline
Communication evaluation:
Challenges and complexities
27 May 2016
Dr Glenn O’Neil
oneil@owlre.com
www.owlre.com
2
Complexity
Challenges
3
Audiences
evaluation
4
Evaluation
5
Output Impact
Media relations
Advocacy
Internal comms
Online comms
Outreach
Community relations
Stakeholder relations
Multimedia
Social media
Logbook
Visit stats.
Intranet
stats.
Clippings
Viewing
stats.
Web
metrics
Event
stats.
Insights
page
Meeting
attendance
Outcome
Contribution
analysis
Focus
group
Staff
survey
Audience
interviews
Tracking
mechanism
Visitor
survey
Case
study
Insights
analysis
Panel
study
Meta-studies
Randomised
control trials
Longitudinal
studies
Ethnographic
studies
Process
tracing
6
Output ImpactOutcome
Level of
your
influence
7
Funding
People Context
Field
External influences
Evaluation policies
& institution
Communication
goals & ambitions
Organisational
setting
Internal influences
Use
Methodology
Implementation
Findings
Diverse
Pragmatic
Adaptive
Participatory
8
Use
Methodology
Implementation
Findings
2. Conceptualisation
• Communication goals and
ambitions defined?
• Matched to design and
methods?
• Organisational model used?
• Expectations of staff?
1. Pre-conditions
• Evaluation integrated in
communication function?
• Evaluation incorporated in
job and project descriptions?
• Support of evaluation
policies and institution?
• Availability of budget?
3. Approach
• Staff participation?
• Adapt to context?
• Diverse methods?
• Flexibility to change?
• Confidence of staff?
4. Finding value
• Access to evaluation
findings?
• Contribute to staff
knowledge?
• Support more efficient
communications?
• Input into future goals and
ambitions?
Evaluation
of value &
used
However beautiful the strategy, you
should occasionally look at the results
Winston Churchill
10
Thank you!
oneil@owlre.com
glennoneil
www.owlre.com
@glenn_oneil
www.intelligentmeasurement.net
Contacts:

More Related Content

What's hot

Elements Of A Survey
Elements Of A SurveyElements Of A Survey
Elements Of A Survey
Robert Davis
 
Eapp Evaluation
Eapp EvaluationEapp Evaluation
Eapp Evaluation
PGAEAPP
 
Coursera Data Science 2015
Coursera Data Science 2015Coursera Data Science 2015
Coursera Data Science 2015
Frank Hasbani
 
Causes of mode effect on survey management 2011
Causes of mode effect on survey management 2011Causes of mode effect on survey management 2011
Causes of mode effect on survey management 2011
natcenslides
 

What's hot (19)

Basic steps to program evaluation
Basic steps to program evaluationBasic steps to program evaluation
Basic steps to program evaluation
 
Seminar Data-Driven Decision Making @ School of Business and Economics & Inst...
Seminar Data-Driven Decision Making @ School of Business and Economics & Inst...Seminar Data-Driven Decision Making @ School of Business and Economics & Inst...
Seminar Data-Driven Decision Making @ School of Business and Economics & Inst...
 
Pedagogical and Technological Interventions in Peer Review (Shivers-McNair) #...
Pedagogical and Technological Interventions in Peer Review (Shivers-McNair) #...Pedagogical and Technological Interventions in Peer Review (Shivers-McNair) #...
Pedagogical and Technological Interventions in Peer Review (Shivers-McNair) #...
 
Itana gimenesevalplan
Itana gimenesevalplanItana gimenesevalplan
Itana gimenesevalplan
 
Push-to-web survey response
Push-to-web survey responsePush-to-web survey response
Push-to-web survey response
 
Design Process
Design ProcessDesign Process
Design Process
 
Online assessment and data analytics - Peter Tan - Institute of Technical Edu...
Online assessment and data analytics - Peter Tan - Institute of Technical Edu...Online assessment and data analytics - Peter Tan - Institute of Technical Edu...
Online assessment and data analytics - Peter Tan - Institute of Technical Edu...
 
Utilization Focused Evaluation
Utilization Focused EvaluationUtilization Focused Evaluation
Utilization Focused Evaluation
 
Program evaluation instead of assessment AABIG
Program evaluation instead of assessment AABIGProgram evaluation instead of assessment AABIG
Program evaluation instead of assessment AABIG
 
Elements Of A Survey
Elements Of A SurveyElements Of A Survey
Elements Of A Survey
 
Using Web 2.0 Technologies to Facilitate Learning
Using Web 2.0 Technologies to Facilitate LearningUsing Web 2.0 Technologies to Facilitate Learning
Using Web 2.0 Technologies to Facilitate Learning
 
Eapp Evaluation
Eapp EvaluationEapp Evaluation
Eapp Evaluation
 
Using Web 2.0 Technologies to Facilitate Learning
Using Web 2.0 Technologies to Facilitate LearningUsing Web 2.0 Technologies to Facilitate Learning
Using Web 2.0 Technologies to Facilitate Learning
 
AEJMC 2008
AEJMC 2008AEJMC 2008
AEJMC 2008
 
Using Web 2.0 to Facilitate Learning
Using Web 2.0 to Facilitate LearningUsing Web 2.0 to Facilitate Learning
Using Web 2.0 to Facilitate Learning
 
Developing an evaluation strategy to gain insights into the ROER4D multi-nati...
Developing an evaluation strategy to gain insights into the ROER4D multi-nati...Developing an evaluation strategy to gain insights into the ROER4D multi-nati...
Developing an evaluation strategy to gain insights into the ROER4D multi-nati...
 
The Development and Usability Evaluation of a Standards-Based Grading Tool fo...
The Development and Usability Evaluation of a Standards-Based Grading Tool fo...The Development and Usability Evaluation of a Standards-Based Grading Tool fo...
The Development and Usability Evaluation of a Standards-Based Grading Tool fo...
 
Coursera Data Science 2015
Coursera Data Science 2015Coursera Data Science 2015
Coursera Data Science 2015
 
Causes of mode effect on survey management 2011
Causes of mode effect on survey management 2011Causes of mode effect on survey management 2011
Causes of mode effect on survey management 2011
 

Viewers also liked

Viewers also liked (15)

Use of evaluation findings; types and influences
Use of evaluation findings; types and influences Use of evaluation findings; types and influences
Use of evaluation findings; types and influences
 
Evaluating Communication Programmes, Products and Campaigns: Training workshop
Evaluating Communication Programmes, Products and Campaigns: Training workshopEvaluating Communication Programmes, Products and Campaigns: Training workshop
Evaluating Communication Programmes, Products and Campaigns: Training workshop
 
Surveys for communicators
Surveys for communicatorsSurveys for communicators
Surveys for communicators
 
Crowdsourcing for #internalcomms. Creating shared insight through curious met...
Crowdsourcing for #internalcomms. Creating shared insight through curious met...Crowdsourcing for #internalcomms. Creating shared insight through curious met...
Crowdsourcing for #internalcomms. Creating shared insight through curious met...
 
Insights into global advocacy: Oxfam's GROW campaign
Insights into global advocacy: Oxfam's GROW campaign Insights into global advocacy: Oxfam's GROW campaign
Insights into global advocacy: Oxfam's GROW campaign
 
Evaluation of communication activities of international and non-governmental ...
Evaluation of communication activities of international and non-governmental ...Evaluation of communication activities of international and non-governmental ...
Evaluation of communication activities of international and non-governmental ...
 
The revolution will be televised internally: enterprise video for internal co...
The revolution will be televised internally: enterprise video for internal co...The revolution will be televised internally: enterprise video for internal co...
The revolution will be televised internally: enterprise video for internal co...
 
The Shorter COMMS Plan - Basic
The Shorter COMMS Plan - BasicThe Shorter COMMS Plan - Basic
The Shorter COMMS Plan - Basic
 
The End of the Story - Transmedia Storytelling for Corporate Communication
The End of the Story - Transmedia Storytelling for Corporate CommunicationThe End of the Story - Transmedia Storytelling for Corporate Communication
The End of the Story - Transmedia Storytelling for Corporate Communication
 
March to Standards: #SMMStandards Progress and Roadmap
March to Standards: #SMMStandards Progress and RoadmapMarch to Standards: #SMMStandards Progress and Roadmap
March to Standards: #SMMStandards Progress and Roadmap
 
Kevin Ruck, PR Academy, Measurement. #makinganimpact15
Kevin Ruck, PR Academy, Measurement. #makinganimpact15Kevin Ruck, PR Academy, Measurement. #makinganimpact15
Kevin Ruck, PR Academy, Measurement. #makinganimpact15
 
Has Off-Grid Electrification Come of Age?
Has Off-Grid Electrification Come of Age? Has Off-Grid Electrification Come of Age?
Has Off-Grid Electrification Come of Age?
 
Evaluation for PR and Event Management Agencies
Evaluation for PR and Event Management AgenciesEvaluation for PR and Event Management Agencies
Evaluation for PR and Event Management Agencies
 
Evaluation for Results-Oriented Management (or, What Can Development Stakeho...
Evaluation for Results-Oriented Management  (or, What Can Development Stakeho...Evaluation for Results-Oriented Management  (or, What Can Development Stakeho...
Evaluation for Results-Oriented Management (or, What Can Development Stakeho...
 
Evaluating Public Relations Campaigns
Evaluating Public Relations CampaignsEvaluating Public Relations Campaigns
Evaluating Public Relations Campaigns
 

Similar to Communication evaluation: Challenges and complexities

Community engagement - what constitutes success
Community engagement - what constitutes successCommunity engagement - what constitutes success
Community engagement - what constitutes success
contentli
 
Rsi 26 5-solooooooo
Rsi 26 5-soloooooooRsi 26 5-solooooooo
Rsi 26 5-solooooooo
Dilshad Shah
 
AnyanwuCarrington_DataAndAccountability
AnyanwuCarrington_DataAndAccountabilityAnyanwuCarrington_DataAndAccountability
AnyanwuCarrington_DataAndAccountability
Ijeoma Anyanwu
 
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
Institute of Development Studies
 
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
Institute of Development Studies
 

Similar to Communication evaluation: Challenges and complexities (20)

Pathways In Innovation Overview
Pathways In Innovation OverviewPathways In Innovation Overview
Pathways In Innovation Overview
 
Class 6 research quality in qualitative methods 3 2-17
Class 6 research quality in qualitative methods 3 2-17Class 6 research quality in qualitative methods 3 2-17
Class 6 research quality in qualitative methods 3 2-17
 
Neighbors Helping Neighbors
Neighbors Helping NeighborsNeighbors Helping Neighbors
Neighbors Helping Neighbors
 
Community engagement - what constitutes success
Community engagement - what constitutes successCommunity engagement - what constitutes success
Community engagement - what constitutes success
 
Beyond MOOCS – A Catalyst for Change
Beyond MOOCS – A Catalyst for ChangeBeyond MOOCS – A Catalyst for Change
Beyond MOOCS – A Catalyst for Change
 
Rsi 26 5-solooooooo
Rsi 26 5-soloooooooRsi 26 5-solooooooo
Rsi 26 5-solooooooo
 
A Survey of Best Practices for Writing and Editing CME Needs Assessments
A Survey of Best Practices for Writing and Editing CME Needs AssessmentsA Survey of Best Practices for Writing and Editing CME Needs Assessments
A Survey of Best Practices for Writing and Editing CME Needs Assessments
 
Qualitative Methods Course: Moving from Afterthought to Forethought
Qualitative Methods Course: Moving from Afterthought to ForethoughtQualitative Methods Course: Moving from Afterthought to Forethought
Qualitative Methods Course: Moving from Afterthought to Forethought
 
Evaluability Assessments and Choice of Evaluation Methods
Evaluability Assessments and Choice of Evaluation MethodsEvaluability Assessments and Choice of Evaluation Methods
Evaluability Assessments and Choice of Evaluation Methods
 
Qualitative Methods Course: Moving from Afterthought to Forethought
Qualitative Methods Course: Moving from Afterthought to ForethoughtQualitative Methods Course: Moving from Afterthought to Forethought
Qualitative Methods Course: Moving from Afterthought to Forethought
 
Evaluating Problem Gambling KTE
Evaluating Problem Gambling KTEEvaluating Problem Gambling KTE
Evaluating Problem Gambling KTE
 
AnyanwuCarrington_DataAndAccountability
AnyanwuCarrington_DataAndAccountabilityAnyanwuCarrington_DataAndAccountability
AnyanwuCarrington_DataAndAccountability
 
Week 6: Evaluation & Controlled Communication
Week 6: Evaluation & Controlled CommunicationWeek 6: Evaluation & Controlled Communication
Week 6: Evaluation & Controlled Communication
 
Master Program Organization Studies Tilburg University
Master Program Organization Studies Tilburg UniversityMaster Program Organization Studies Tilburg University
Master Program Organization Studies Tilburg University
 
CAQDAS 2014 From graph paper to digital research our Framework journey
CAQDAS 2014 From graph paper to digital research our Framework journeyCAQDAS 2014 From graph paper to digital research our Framework journey
CAQDAS 2014 From graph paper to digital research our Framework journey
 
Niloa webinar on survey final
Niloa webinar on survey finalNiloa webinar on survey final
Niloa webinar on survey final
 
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
 
Lena Etuk Why Measure Social Impact?
Lena Etuk Why Measure Social Impact? Lena Etuk Why Measure Social Impact?
Lena Etuk Why Measure Social Impact?
 
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
IDS Impact, Innovation and Learning Workshop March 2013: Day 2, Keynote 2 Pat...
 
Presenting the business case for an evaluator specific national mentoring pro...
Presenting the business case for an evaluator specific national mentoring pro...Presenting the business case for an evaluator specific national mentoring pro...
Presenting the business case for an evaluator specific national mentoring pro...
 

More from Glenn O'Neil

More from Glenn O'Neil (11)

Case study on evaluating a smoking cessation campaign
Case study on evaluating a smoking cessation campaign Case study on evaluating a smoking cessation campaign
Case study on evaluating a smoking cessation campaign
 
Evaluating Advocacy: Challenges, Methodologies and Solutions
Evaluating Advocacy:  Challenges, Methodologies and SolutionsEvaluating Advocacy:  Challenges, Methodologies and Solutions
Evaluating Advocacy: Challenges, Methodologies and Solutions
 
Humanitarian advocacy
Humanitarian advocacyHumanitarian advocacy
Humanitarian advocacy
 
Evaluation inforgraphics
Evaluation inforgraphicsEvaluation inforgraphics
Evaluation inforgraphics
 
Evaluating conferences and events: new approaches and initiatives
Evaluating conferences and events: new approaches and initiativesEvaluating conferences and events: new approaches and initiatives
Evaluating conferences and events: new approaches and initiatives
 
Pres sawi goneil_2012
Pres sawi goneil_2012Pres sawi goneil_2012
Pres sawi goneil_2012
 
Conference evaluation at a glance
Conference evaluation at a glanceConference evaluation at a glance
Conference evaluation at a glance
 
Suivi et évaluation - projet de communauté
Suivi et évaluation -  projet de communautéSuivi et évaluation -  projet de communauté
Suivi et évaluation - projet de communauté
 
Lift10 Geneva - Survey results
Lift10 Geneva - Survey resultsLift10 Geneva - Survey results
Lift10 Geneva - Survey results
 
Lift09 Asia Feedback Survey Results
Lift09 Asia Feedback Survey ResultsLift09 Asia Feedback Survey Results
Lift09 Asia Feedback Survey Results
 
Measuring Communications
Measuring CommunicationsMeasuring Communications
Measuring Communications
 

Recently uploaded

Recently uploaded (20)

Coastal Protection Measures in Hulhumale'
Coastal Protection Measures in Hulhumale'Coastal Protection Measures in Hulhumale'
Coastal Protection Measures in Hulhumale'
 
The U.S. Budget and Economic Outlook (Presentation)
The U.S. Budget and Economic Outlook (Presentation)The U.S. Budget and Economic Outlook (Presentation)
The U.S. Budget and Economic Outlook (Presentation)
 
Sustainability by Design: Assessment Tool for Just Energy Transition Plans
Sustainability by Design: Assessment Tool for Just Energy Transition PlansSustainability by Design: Assessment Tool for Just Energy Transition Plans
Sustainability by Design: Assessment Tool for Just Energy Transition Plans
 
The NAP process & South-South peer learning
The NAP process & South-South peer learningThe NAP process & South-South peer learning
The NAP process & South-South peer learning
 
A Press for the Planet: Journalism in the face of the Environmental Crisis
A Press for the Planet: Journalism in the face of the Environmental CrisisA Press for the Planet: Journalism in the face of the Environmental Crisis
A Press for the Planet: Journalism in the face of the Environmental Crisis
 
VIP Model Call Girls Lohegaon ( Pune ) Call ON 8005736733 Starting From 5K to...
VIP Model Call Girls Lohegaon ( Pune ) Call ON 8005736733 Starting From 5K to...VIP Model Call Girls Lohegaon ( Pune ) Call ON 8005736733 Starting From 5K to...
VIP Model Call Girls Lohegaon ( Pune ) Call ON 8005736733 Starting From 5K to...
 
best call girls in Pune - 450+ Call Girl Cash Payment 8005736733 Neha Thakur
best call girls in Pune - 450+ Call Girl Cash Payment 8005736733 Neha Thakurbest call girls in Pune - 450+ Call Girl Cash Payment 8005736733 Neha Thakur
best call girls in Pune - 450+ Call Girl Cash Payment 8005736733 Neha Thakur
 
1935 CONSTITUTION REPORT IN RIPH FINALLS
1935 CONSTITUTION REPORT IN RIPH FINALLS1935 CONSTITUTION REPORT IN RIPH FINALLS
1935 CONSTITUTION REPORT IN RIPH FINALLS
 
Government e Marketplace GeM Presentation
Government e Marketplace GeM PresentationGovernment e Marketplace GeM Presentation
Government e Marketplace GeM Presentation
 
Booking open Available Pune Call Girls Shukrawar Peth 6297143586 Call Hot In...
Booking open Available Pune Call Girls Shukrawar Peth  6297143586 Call Hot In...Booking open Available Pune Call Girls Shukrawar Peth  6297143586 Call Hot In...
Booking open Available Pune Call Girls Shukrawar Peth 6297143586 Call Hot In...
 
Tuvalu Coastal Adaptation Project (TCAP)
Tuvalu Coastal Adaptation Project (TCAP)Tuvalu Coastal Adaptation Project (TCAP)
Tuvalu Coastal Adaptation Project (TCAP)
 
Antisemitism Awareness Act: pénaliser la critique de l'Etat d'Israël
Antisemitism Awareness Act: pénaliser la critique de l'Etat d'IsraëlAntisemitism Awareness Act: pénaliser la critique de l'Etat d'Israël
Antisemitism Awareness Act: pénaliser la critique de l'Etat d'Israël
 
2024: The FAR, Federal Acquisition Regulations - Part 29
2024: The FAR, Federal Acquisition Regulations - Part 292024: The FAR, Federal Acquisition Regulations - Part 29
2024: The FAR, Federal Acquisition Regulations - Part 29
 
Financing strategies for adaptation. Presentation for CANCC
Financing strategies for adaptation. Presentation for CANCCFinancing strategies for adaptation. Presentation for CANCC
Financing strategies for adaptation. Presentation for CANCC
 
Chakan ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For S...
Chakan ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For S...Chakan ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For S...
Chakan ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For S...
 
Regional Snapshot Atlanta Aging Trends 2024
Regional Snapshot Atlanta Aging Trends 2024Regional Snapshot Atlanta Aging Trends 2024
Regional Snapshot Atlanta Aging Trends 2024
 
Expressive clarity oral presentation.pptx
Expressive clarity oral presentation.pptxExpressive clarity oral presentation.pptx
Expressive clarity oral presentation.pptx
 
Junnar ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For S...
Junnar ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For S...Junnar ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For S...
Junnar ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For S...
 
TEST BANK For Essentials of Negotiation, 7th Edition by Roy Lewicki, Bruce Ba...
TEST BANK For Essentials of Negotiation, 7th Edition by Roy Lewicki, Bruce Ba...TEST BANK For Essentials of Negotiation, 7th Edition by Roy Lewicki, Bruce Ba...
TEST BANK For Essentials of Negotiation, 7th Edition by Roy Lewicki, Bruce Ba...
 
Just Call Vip call girls Wardha Escorts ☎️8617370543 Starting From 5K to 25K ...
Just Call Vip call girls Wardha Escorts ☎️8617370543 Starting From 5K to 25K ...Just Call Vip call girls Wardha Escorts ☎️8617370543 Starting From 5K to 25K ...
Just Call Vip call girls Wardha Escorts ☎️8617370543 Starting From 5K to 25K ...
 

Communication evaluation: Challenges and complexities