St. Lucia Jazz • Was this event a success or failure? • Who in the country would be more likely to say it was a success? • Who would be most unhappy with this event?Festival of Highs and Lows
Learning ObjectivesAt the end of this session you should be able to:• Articulate the nature and importance of evaluation to the events management function• Describe what event evaluation should focus on• Explain the purpose of event evaluation, including the needs and expectations of stakeholders• Describe the cyclical, holistic nature of event evaluation using the three critical Ss of events• Assess the different forms of evaluation models and methods• Formulate and prepare an event evaluation report
What view of event evaluation should be taken for this event?
REASONS FOR ALL EVENT EVALUATION Allows for more informed decisions towards greater efficiency and more positive results to be made To measure success or failure INTERNALLY-DRIVEN REASONS EXTERNALLY-DRIVEN REASONS To determine whether goals and To determine level of awarenessobjectives have been met of sponsors’ products/services To engender accountability To satisfy accountability requirements To identify and address problemsand challenges To determine level of media interest and coverage To determine whether eventmanagement functions have To determine event’s level ofachieved expected outcomes impact on tourist arrivals To understand who attends the To determine event’s level ofevent to determine who else can impact on business and otherbe targeted related industries To determine worth of the event To determine whether eventto its workers and volunteers satisfies the expectations of community stakeholders To determine whether and howthe event can remain viable and To determine worth of the eventbecome sustainable to its patrons
Event Evaluation Data Descriptive Numerical Numerical and Descriptive
Evaluation Considerations• Does the event organization/event host have, or have access to the requisite resources to conduct an event evaluation exercise?• Have event evaluations been conducted on the event in the past? And if so, how often and what kind of evaluation?• What use was made of the evaluation report?• What is the nature of the environment in which the event operates?• Can it facilitate the execution of an event evaluation?• Does the event have access to a wide range of information it can use to conduct the evaluation exercise?
• Quantitative – primarily concerned with counting complex data sets such as attendance levels, information sources and event activities.• Challenges and limitations of using quantitative approaches exclusively: Low response rates to surveys Inconsistencies arising out of varied interpretations of terminology used in surveys leading to over- calculation and possible misrepresentation of data
• This video highlights some of the negative aspects of the Edinburgh International Festival.• What types of approaches might be used to evaluate these? Worries over complacency about festival
••• Challenges and limitations of using qualitative approaches exclusively: Cannot reach the numbers of quantitative approaches
Event Types & Evaluation Tools Image Maker • Content Analysis Tourism Product • Visitor Exit SurveyEconomic Development • Economic Impact Assessment Catalyst Transformer of Socio- • Social Impact Scale Analysis cultural LandscapeSustainable Development • Environmental Impact Analysis Model
Consider Live Earth Live Earth Concerts Backfire• What type of event was it?• Which of the evaluation tools would provide the measures provided in the news report?• Was the event a failure?
• Missed opportunities to correct detected problems• Minimal focus on evaluation at the planning phases, which is vital to understanding many decisions taken at the implementation stage• Key elements of the evaluations may not be deployed effectively, if at all
Conducting Event Evaluation (1) • Determine the purpose of the event evaluation exercise, including whether the evaluation isStep 1 necessary. • Identify what should be the focus of evaluation.Step 2 • Select the most suitable approach for conductingStep 3 the evaluation exercise. • Select model(s) for evaluation as a framework for data collection based on suitability, practicality andStep 4 relevance.
• Complete steps 1 – 4 for the Ecounters13 event being held here at Porvoo Campus• Display the steps in the form of a poster
Conducting Event Evaluation (2) • Develop appropriate instruments and data collection strategies based on the methodsStep 5 selected. • Collect and analyse data and findings.Step 6Step 7 • Prepare and disseminate event evaluation report. • Formulate and implement decisions for improvement based on findings of event evaluationStep 8 report.