UPDATE
PROJECT

FINAL EVALUATION REPORT

Unveiling European Union citizenship rights through Powerful messages,
Developed ...
UPDATE PROJECT 2012-2013
Unveiling European Union citizenship rights through Powerful messages,
Developed in Attractive Te...
OUTLINE
1 | EXECUTIVE SUMMARY ...............................................................................................
1

EXECUTIVE SUMMARY

The executive summary aims to summarize the most important objectives and results mentioned
in the w...
50.000 people through the website
Although all performance indicators were met, the number of website visitors was below t...
2

INTRODUCTION

The UPDATE project is an European project in which four European partners cooperate. The reason
the partn...
3

SHORT DISCRIPTION OF THE PROJECT PROPOSAL

„Media tablets are poised for strong growth with worldwide end user sales pr...
4

CONTENTS AND IMPLEMENTATION OF THE EVALUATION

4.1 | Design of evaluation
The evaluation of the UPDATE project consist ...
To inform the target
audience about the
project and awareness
message

Number of distributed
information cards

Knowledge ...
5

RESULTS OF QUANTITATIVE EVALUATION

5.1 | General quantitative goals
According Event Number 3 of the plan of action the...
The online
applications in
AppStore

The UPDATE
website

USED MATERIAL UPDATE
30000
25000
20000
15000

used

10000

indica...
5.3 | Number of trained volunteers
Event Number 4
On March 15, 2013 the meeting “Training for trainers” was held. Each par...
LOCAL ACTIONS IN BELGIUM (information form of the coordinator of the volunteers)
Action

Date

Location

1

31.05-2013
02....
LOCAL ACTIONS IN THE NETHERLAND (information form of the coordinator of the
volunteers)
Action

Date

Location

1
2
3
4
to...
6

RESULTS OF THE QUIZ ABOUT EUROPEAN CITIZEN RIGHTS

6.1 | THE INTERACTIVE QUIZ
Inventory on the knowledge of the youngst...
knowlegde EU rights volunteers
100%

5

5

5

5

4

4

4

4

80%
60%

important
after training

40%
20%

3

2

3

before t...
awareness campaign EU rights
1%
campaign useful
99%

99% of all the volunteers consider
the awareness campaign on the
Euro...
Knowledge about the EU rights from the participants before the action, according the volunteers.
Knowledge about the EU ri...
Conclusions over the volunteers
A total number of 105 volunteers have been educated by the 4
partners to facilitate succes...
6.3 | THE KNOWLEDGE OF THE CITIZENS ABOUT THEIR EUROPEAN RIGHTS
Statistical report on the data collected from 2.845 quiz c...
Participants by gender
56% of the Total
participants were male
(1.558) and 44% were
female (1.242).

2.845 participants: f...
6.4 | STATISTICAL REPORT ON THE DATA COLLECTED FROM 2.845 QUIZ CARDS
The quiz card holds 8 questions on the European right...
CORRECT ANSWERS BY QUESTION AND BY COUNTRY
Question 1 - The term "freedom of movement" in the European Union affects:
Answ...
Question 3 - I am Spanish and I live in Bulgaria. As for the elections to the European parliament,
which of the following ...
Question 5 - If a citizen of the European Union has a problem in a third country in which his
country has no consular serv...
Question 7 - The right to petition the European Parliament:
Answer 1: belongs to all nations of the earth
Answer 2: belong...
Conclusions quiz results
Conclusion

Bulgaria with 77% correct answers had the best score. The
Netherlands with 66% scored...
Quiz results by gender
The avarage score on correct answers by gender show no dramatic differences. Both genders
scored wi...
questions
1
2
3
4
5
6
7
8
average

12-17 yrs
83%
90%
40%
68%
77%
55%
78%
84%
72%

18-20 yrs
61%
74%
37%
67%
69%
33%
83%
87...
7

RESULTS OF VISIBILITY AND DISSEMINATION

Event Number 7: Media relations
The project partners will list medias both on ...
Participants by media
A calculation is made for the number of individuals that
encountered an appearance or broadcast abou...
7.4 | The visibility of the project and the activities by the networks
The partners of UPDATE are part of big (inter)natio...
8

PROCESS EVALUATION

8.1 | Event Number 8: Evaluation
The project envisages the implementation of an integrated evaluati...
8.2 | Proces evaluation of the Project management
The description of the task for process management is as follows:
The pr...
The Training for trainers meeting in Amsterdam was also successful. The partners were already well
experienced in training...
9

CONCLUSIONS AND RECOMMENDATIONS

General conclusions
The project UPDATE was finalised successful. The quantitative
indi...
6) Also 77% of the youngsters is aware of the need of a valid ID card or passport while travelling
to another European Uni...
ANNEXES
UPDATE PROJECT
ANNEXES

A. Update Material Counting (EVA1)
B. Form to filled after the action by volunteers (EVA2)...
Annex A: Update Material Counting (EVA1)

EVA 1. Form to be filled before and after the action
Date :

Country:

Place:

T...
Annex B: Form to filled after the action by volunteers (EVA2)

EVA2. Form to be filled after the action
by the VOLUNTEERS
...
3

The knowledge about EU
right from the visitors
before the action (your
assumption)
4 The knowledge about EU
right from ...
Annex C: Form to be filled after the action by coordinator (EVA3)

EVA3. Form to be filled after the action
by coordinator...
Annex D: Process evaluation (EVA 4)

EVA4. Process evaluation update
to be filled in by the country project manager
Name o...
How would you rate the locale action organization &
visuals?
The preparation
The material used (the tools)
The visibility
...
Annex E: Evaluation of the volunteers
EVALUATIONS OF THE VOLTUNEERS

Number of volunteers
Average age
Range of age
Student...
Annex F: Quiz questions

quiz to be filled during the action
Form to be filled for each group or person met
Date :

Countr...
2. VOTE FOR AND STAND AS A CANDIDATE IN EUROPEAN PARLIAMENT AND MUNICIPAL
ELECTIONS
2.1 I am Spanish and I live in Bulgari...
4. PETITION THE EUROPEAN PARLIAMENT AND COMPLAIN TO THE EUROPEAN OMBUDSMAN.
4.1 - The right to petition the European Parli...
Annex G: Quiz results Bulgaria 2008-2012-2013
Question 1 - The term "freedom of movement" in the European Union affects:
A...
Question 3 - I am Spanish and I live in Bulgaria. As for the elections to the European parliament,
which of the following ...
Question 5 - If a citizen of the European Union has a problem in a third country in which his
country has no consular serv...
Question 7 - The right to petition the European Parliament:
Answer 1:
Answer 2:
Answer 3:
Answer 4:

belongs to all nation...
Annex H: Examples of statements in the media

Newspaper: Local action in Franeker,
The Netherlands, 30.07.2013

Newspaper:...
Local action
Hungaria

Final Evaluation Report UPDATE

54
Annex I: Results Process Evaluation (EVA4)
EVA 4 Process evaluation Update
Project Management
Information about the projec...
Project
Title
Commissioned by
Author and external evaluator
Translator
Date

UPDATE
Final Evaluation Report UPDATE
Project...
Upcoming SlideShare
Loading in...5
×

Final evaluation report update

311

Published on

Unveiling European Union citizenship rights through Powerful messages, Developed in Attractive Technological Environment (2012-2013)

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
311
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Final evaluation report update"

  1. 1. UPDATE PROJECT FINAL EVALUATION REPORT Unveiling European Union citizenship rights through Powerful messages, Developed in Attractive Technological Environment (2012 - 2013) Final Evaluation Report UPDATE
  2. 2. UPDATE PROJECT 2012-2013 Unveiling European Union citizenship rights through Powerful messages, Developed in Attractive Technological Environment Project Manager UPDATE Open Youth Mr. Daniel Vankov j.k. Darvenitsa, 6 Kanarche Str. entr. B app. 7 1756 Sofia, Bulgaria chairman@open-youth.org External Evaluator Vriestyle Projects LL.M Jetty de Vries Workum The Netherlands jetty@vriestyle.com 2
  3. 3. OUTLINE 1 | EXECUTIVE SUMMARY ............................................................................................................... 4 2 | INTRODUCTION ......................................................................................................................... 6 3 | SHORT DISCRIPTION OF THE PROJECT ..................................................................................... 7 4 | CONTENTS AND IMPLEMENTATION OF THE EVALUATION ..................................................... 4.1 |Design of evaluation ......................................................................................................... 4.2 | Indicators and instruments of Evaluation ........................................................................ 8 8 8 5 | RESULTS OF QUANTITATIVE EVALUATION.............................................................................. 5.1 | General quantitative goals ............................................................................................. 5.2 | Realised products ........................................................................................................... 5.3 | Number of trained volunteers ....................................................................................... 5.4 | Number of local actions, material and (in)direct participants ....................................... 5.5 | Conclusion quantitative results ..................................................................................... 10 10 10 12 12 14 6 | RESULTS OF QUIZ ABOUT EUROPEAN CITIZEN RIGHTS ......................................................... 6.1 | The interactive quiz ....................................................................................................... 6.2 | The Knowledge of volunteers about European Rights .................................................. 6.3 | The knowledge of the citizens about their European rights ......................................... 6.4 | Statistical report on the data collected from 2845 quiz cards ...................................... 15 15 15 20 22 7 | RESULTS OF VISIBILITY AND DISSEMINATION ........................................................................ 7.1 | The visibility of the project and the activities in the media .......................................... 7.2 | The visibility of the project and the activities by the general public ............................ 7.3 | The online visibility ....................................................................................................... 7.4 | The visibility of the project and the activities by the networks .................................... 30 30 31 31 32 8 | PROCESS EVALUATION ............................................................................................................ 8.1 | Event Number 8: Evaluation ........................................................................................... 8.2 | Proces evaluation of the Project management ............................................................. 8.3 | Proces evaluation of the project team meetings ........................................................... 8.4 | Proces evaluation of the development of the used material ......................................... 8.5 | Proces evaluation of the organising of the local actions ................................................ 33 33 34 34 35 35 9 | CONCLUSIONS AND RECOMMENDATIONS ............................................................................. 36 Annexes ........................................................................................................................................... A. Update Material Counting (EVA1) B. Form to filled after the action by volunteers (EVA2) C. Form to be filled after the action by coordinator of the volunteer (EVA3) D. Process evaluation (EVA 4) E. Evaluation of the volunteers F. Quiz questions G. Quiz results Bulgaria 2008-2012-2013 H. Examples of statements in the media I. Results Process Evaluation (EVA4) 38 Final Evaluation Report UPDATE 3
  4. 4. 1 EXECUTIVE SUMMARY The executive summary aims to summarize the most important objectives and results mentioned in the work plan of the project and assessed by evaluating the project. It is aimed to clarify the Evaluation Report in order to have a clear picture of the results reached or may be not reached during the project. The project "Unveiling European Union citizenship rights through Powerful messages, developed in Attractive Technological Environment” (UPDATE) was successful. The project partners were from Bulgaria, Hungary, Belgium and the Netherlands. The goal was to develop an original comic book, explaining to the young people their basic European citizens’ rights in an interesting and understandable way and to reach the tech-savvy youth wherever they are, combining the message with this risk-free traffic participation one. The objectives, mentioned in the work plan were: Development and production of information and communication material Accomplished! After development of the visual concept, the information cards, the interactive quiz, the comic book, the online comic application, the local stands, the shirts and pens have been produced. Development of website Accomplished! In the languages English, Bulgarian, Hungarian, French and Dutch. 80 trained local volunteers Accomplished! There were 105 trained volunteers in total. 16 successful local actions Accomplished! All actions were performed successfully. For UPDATE there have been 23 actions in total. Publications to be distributed during the project The products, developed during the project were distributed. These products were: information cards (24.320), interactive quiz, quiz cards (2.845), comic books (2.552) and pens (1.275). 2.400 direct participants quiz cards Accomplished! In total, there were 2.845 (young) direct participants (face-to-face approach): During 23 local events, the quiz cards were completed by these young participants. 24.000 indirect participants Accomplished! 24.320 informative cards have been distributed during the campaign. 50.000 people reached through media Accomplished! Good press contacts were maintained during the campaigns, which resulted in: 93 Internet articles, 18 press articles in newspapers, 15 radio announcements, 8 TV reportages on national and local television and 7 information agency reports  Estimated audience = about 1.720.332 people. Final Evaluation Report UPDATE 4
  5. 5. 50.000 people through the website Although all performance indicators were met, the number of website visitors was below the expectations. 1.900 people visited the website of which 531 people completed the quiz queries and downloaded the comic book. From the total number of downloaded online applications, 406 were done for Android while Apple store does not provide download information for free apps. But the UPDATE application received a review of 4+. This shortcoming is offset by targeted efforts in the online social media (e.g. Facebook). The online campaign triggered 14.537 people to interact with the provided content. 740.246 were reached indirectly. Still the main purpose of these tools, i.e. to bring sustainability of the project results after its completion, is to be explored in the future. To inform the target audience about the awareness message: EU rights The target group of youngsters < 30 years old was approached using the quiz cards and information cards, holding the message about their EU rights. On a scale of 1 to 5 the volunteers evaluate their knowledge of EU rights at 3 before training and at 4 after training. Results quiz cards: 2.845 quiz cards x 8 questions= 22.760 questions. 66% of these questions were answered correctly. Bulgarian participants with a score of 77% achieved the best result. This best scores may have been the result of earlier awareness campaigns of Open Youth in 2008 and 2012. UPDATE action in Bulgaria Final Evaluation Report UPDATE 5
  6. 6. 2 INTRODUCTION The UPDATE project is an European project in which four European partners cooperate. The reason the partners were chosen as such is their long lasting fruitful cooperation with the project leader and for variety of experience, they bring. All organizations are experienced in working with young people but their experience defers. TOP-25 (BE) is a big organization with a long history, huge volunteer base and a strong professional team. OY (BG) is an organization, developed by young enthusiasts, and it is mainly based on volunteer efforts. RYD (NL) is representing a developed country with strong corporate spirit. HAHA (HU) is a university student association. Open Youth Bulgaria Project Manager TOP 25 Belgium Project Partner HAHA Hungary Project Partner Responsible Young Drivers The Netherlands Project Partner Timetable of the project is form 01.08.2012 to 31.01.2014 In this period the listed numbered events have been completed. Event Number 1: Project Management Event Number 2: Preparation meeting Brussel Event Number 3: Development and production of information and communication materials Event Number 4: Training for trainers Event Number 5: Pilot action Event Number 6: Local actions Event Number 7: Media relations Event Number 8: Evaluation Event Number 9: Dissemination Event Number 10: Evaluation Meeting This evaluation report will address all events. The event numbers 3-4-5-6 will be addressed in the chapters 5 and 6 (QUANTITAVE RESULTS). The event numbers 7-9 will be addressed in Chapter 7 (RESULTS OF VISIBILITY AND DISSEMINATION). The event numbers 1, 2 and 10, including the whole project, will be part of the Process Evaluation. This report is the result of event number 8. Chapter 4 (CONTENTS AND IMPLEMENTATION OF THE EVALUATION) describes the build up of the evaluation. Final Evaluation Report UPDATE 6
  7. 7. 3 SHORT DISCRIPTION OF THE PROJECT PROPOSAL „Media tablets are poised for strong growth with worldwide end user sales projected to total 54.8 million units in 2011, up 181 percent from 2010, and surpass 208 million units in 2014.” (Gartner) According to some analysts the total number of sold smart phones worldwide is expected to surpass 875 million in 2014 from “only” 267 million in 2010. The number of downloads is expected to almost double in 2011, reaching 18.1 billion from 9.5 in 2010, according to IHS Screen Digest. The expected figure for 2014 is 33 billion. This is a very powerful base for reaching tech savvy young people wherever they are. But it is still underused due to lack of information and experience. The project consortium believes that there are synergies that can be explored by cross-fertilizing regular channels with those innovative ones for promoting European citizenship rights to young Europeans. UPDATE aims to develop a genuine comics book, explaining to the young people in an interesting and understandable way their basic EU rights and how they can appeal to the European Ombudsman, and to adapt it to the world of mobile devices using AppStore platform as a pilot as it holds 75% of that market. The comics book will be promoted offline, through regular people-to-people public awareness raising activities, and online through a shared Internet marketing campaign. The developed comics book will be disseminated in at least 16 local actions in four different EU Member States. During the project we will train 80 volunteers, involve 2 400 direct participants and reach more than 24 000 indirectly. The project is based mainly on the developed capacity in the field of awareness raising campaigns and developing high-tech applications, built by the HEROES project (an EAHC co-funded initiative cross-fertilizing road safety, alcohol, drugs and AIDS prevention messages) and “European citizenship… not only words but concrete rights” campaign (a DG JLS funded communication campaign in Bulgaria). Final Evaluation Report UPDATE 7
  8. 8. 4 CONTENTS AND IMPLEMENTATION OF THE EVALUATION 4.1 | Design of evaluation The evaluation of the UPDATE project consist of the following: - Internal process evaluation (chapter 8) - Internal evaluation on the knowledge and views of the volunteers, implementing the actions on site (chapter 6) - External evaluation on the knowledge by the youngsters of the European rights for young people itself (Chapter 6) - Visibility of the project in the media (chapter 7) The process evaluation data is collected from the Process Evaluation Form (EVA4), which is completed during the final meeting in Sofia by each partners coordinator. Also the external evaluator has observed the state of affairs during the whole project and has drawn her conclusions. The internal evaluations amongst the volunteer team is done using forms, completed by the volunteers (EVA2) and the action coordinators EVA3), before and after each local action. The external evaluation on the knowledge of the youngsters under the age of 30 of the European human rights is done, based on the results of the interactive quiz. These results are entered by each country in a system, analysed by the external evaluator and summarized in this report. The external evaluation on the visibility of the project Update in the media is based on the actual media attention for this project. Each partner has collected their media coverage. 4.2 | Indicators and instruments of evaluation As a part of the work plan the evaluation indicators were assessed and the evaluation instruments were designed to measure them. The table shows the indicators and the related evaluation instruments to assess, whether the targets of the project have been reached. specific objective Process Indicator Outcome Indicator Target Evaluation Instrument To train local volunteers Number of volunteers active during the field activities Volunteers can disperse and share the knowledge of the European human rights under the youngsters 80 EVA4 To create successful local awareness actions Number of local activities implemented Number of different activities organized 16 EVA1, EVA3 To reach participants on the local actions Number of people met during the field implementations Handover the knowledge of the European rights to the youngsters 2.400 Quiz cards Final Evaluation Report UPDATE 8
  9. 9. To inform the target audience about the project and awareness message Number of distributed information cards Knowledge of the awareness message among the target audience 24.000 Counting To inform the general public about the project and field activities Number of collected press articles, radio and TV interviews. Internet audience. Publications in local and national media, 50 000 people reached through media and 50.000 online 50.000 Media Coverage 50.000 & Internet Website During and after the project an external evaluator evaluates the project Evaluation report To analyse the process of the European project UPDATE Final Evaluation Report UPDATE EVA4 Final Evaluation Meeting 9
  10. 10. 5 RESULTS OF QUANTITATIVE EVALUATION 5.1 | General quantitative goals According Event Number 3 of the plan of action the needed material for the project is developed between 01.10.2012 and 31.03.2013. This contains the information and communication materials to be used during the local actions. - development of website; production of visual concept; production of 2.400 comic book; production of 40 project t-shirts; production of 24.000 information cards; production of 2.400 quiz cards; production of interactive quiz; production of AppStore comics application; production of 2.400 pens; production of stands for the local actions. 5.2 | Realised products During the Start Up meeting in Brussels (24-26.09.2012) the process of developing and producing of the needed materials is discussed and the tasks handed out. Development of the website, the visual concept, the interactive quiz and the AppStore comics applications have been started up by the project manager and c ompleted by the participating countries. The concept was to have a Young man called Eugene come alive in the comics and have him return in the visuals. Each partner wrote a story for the comic book and developed its local material. An online application was created for iPhone, iPad and Android platforms and is downloadable through AppStore and PlayStore. Everything was developed in time before the start of the pilot actions. During the pilot actions the material was tested and put straight for using it in the four countries. Production of the comic book and the information and quiz cards Final Evaluation Report UPDATE 10
  11. 11. The online applications in AppStore The UPDATE website USED MATERIAL UPDATE 30000 25000 20000 15000 used 10000 indicator 5000 Material update Comic book Info cards Quiz cards Pens Project indicator 2.400 24.000 2.400 2.400 Used material 2.552 24.320 2.845 1.275 0 comic books info card quiz card Pens This table shows the amount of material used in all 23 local actions. Of all produced material, more is deployed than calculated during the UPDATE project. 2.552 comic books, 2.845 quiz cards, 23.320 information cards and 1.275 pens were disseminated. Paragraph 5.4 will give more information on the dissemination of the material per action. Final Evaluation Report UPDATE 11
  12. 12. 5.3 | Number of trained volunteers Event Number 4 On March 15, 2013 the meeting “Training for trainers” was held. Each partner had sent a delegate who can educate its own team of volunteers in a later stage to benefit the performance during the local actions. Chapter 7 gives the process evaluation of this meeting. This addresses the quantitative evaluation of the number of educated local volunteers. According to the project, the target indicator was “educating and training of 80 volunteers” this is 20 volunteers for each partner. All partners together have 105 volunteers, educated and deployed during the local actions. The table below shows that Bulgaria educated 36 volunteers, Hungary - 25, Belgium 24 and The Netherlands - 20. The average age of all the volunteers was 21 years, the youngest was 15 years old and the oldest was 30 years old. 75% of all the volunteers were students. The total group of volunteers nicely met the target group of the UPDATE project: youngsters < 30 years! 20 25 24 BE BU 36 HU 105 TRAINED VOLLUNTEERS • range of age 15 - 30 • average age 21 • 76% are students • 23% are (un)employed NL We also asked the volunteers about their knowledge on the European human rights before and after the actions. This qualitative data will be addressed in Chapter 6. 5.4 | Number of local actions, material and (in)direct participants Event Number 5 A pilot action will be organized by each partner in order to test the developed method and products. Each action has to attract at least 150 people to complete the interactive quiz. Event Number 6 Taking into account the result from the pilot action and implementing changes where necessary, each partner will have to implement three more actions, using the developed in Event 5 approach. Expected results 16 successful local actions, 80 trained youth volunteers, 2.400 direct participants on the interactive quiz; 24.000 indirect participants, informed by the project materials Between 01.03.2013 and 31.10.2013 the partners have organised and implemented the local actions. The table below outlines the quantitative data on the actions: - Number of actions - Dates and locations of the actions - Number of trained volunteers - Number of direct participants on the interactive quiz - Number of indirect participants Final Evaluation Report UPDATE 12
  13. 13. LOCAL ACTIONS IN BELGIUM (information form of the coordinator of the volunteers) Action Date Location 1 31.05-2013 02.06.2013 28.06.2013 30.06.2013 26.07.2013 28.07.2013 19.10.2013 Francorchamps 2 3 4 total Number of trained volunteers 6 Number of direct participants on the interactive quiz 141 Number of indirect participants 1.000 Brussel 6 136 1.000 Marche-enFamenne Brussel 6 87 1.000 6 24 236 600 1.000 4000 LOCAL ACTIONS IN BULGARIA (information form of the coordinator of the volunteers) Action Date Location 1 22.04.2013 23.04.2013 07.05.2013 08.05.2013 09.05.2013 18.05.2013 10.08.2013 17.09.2013 18.09.2013 19.09.2013 20.09.2013 Blagoevgrad 2 3 4 5 6 7 8 Number of trained volunteers 6 Number of direct particpants on the interactive quiz 206 Number of indirect participants 1.050 Vratsa 4 107 954 Belogradchik Sofia Pernik Smolyan Stara Zagora Pleven 5 5 5 4 7 0 85 176 26 102 25 207 912 1.100 730 988 960 986 36 934 7.680 total LOCAL ACTIONS IN HUNGARY (information form of the coordinator of the volunteers) Action Date Location Number of trained volunteers 1 17.07.2013 20.07.2013 10.08.2013 11.08.2013 18.08.2013 01.10.2013 02.10.2013 03.10.2013 04.10.2013 12.10.2013 14.10.2013 18.10.2013 Debrecen 2 3 4 5 6 7 total 8 Number of direct particpants on the interactive quiz 394 Number of indirect participants 4.000 Debrecen 5 94 1.230 Debrecen 3 109 1.300 Debrecen Hajdúszoboszló Debrecen Balmazújváros 2 2 2 3 25 26 21 26 41 711 550 575 490 495 8.640 Final Evaluation Report UPDATE 13
  14. 14. LOCAL ACTIONS IN THE NETHERLAND (information form of the coordinator of the volunteers) Action Date Location 1 2 3 4 total 20.07.2013 30.07.2013 18.09.2013 19.10.2013 De Veenhoop Franeker Franeker Drachten Number of trained volunteers 4 6 5 5 20 Number of direct particpants on the interactive quiz 163 219 167 51 600 Number of indirect participants 1.000 1.000 1.000 1.000 4.000 TOTAL OF LOCAL ACTIONS: PARTICIPANTS AND MATERIAL BE Actions Volunteers Participants male Participants female Participants total <30* Indirect participants Comic books Info cards Quiz cards Pens BU HU NL TOTAL 4 (6 days) 24 336 257 600 4.000 560 4.000 600 180 8 (12 days) 36 458 472 934 7.680 1.030 7.680 934 622 7 (14 days) 25 436 247 711 8.640 442 8.640 711 157 4 20 328 266 600 4.000 520 4.000 600 316 23 105 1.558 1.242 2.845 24.320 2.552 24.320 2.845 1.275 PROJECT INDICATOR 16 80 1.200 1.200 2.400 24.000 2.400 24.000 2.400 2.400 * According to the collected quiz cards.The sum differs from the reported distribution by gender, because 45 people did not report gender (7 for BE, 4 for BG, 28 for HU and 6 for NL). 5.5 | Conclusions of quantitative results The above mentioned paragraphs show that the quantitative scorecard indicators have been met extensively. In total 23 local actions were accomplished (score card indicator was 16) in which 105 trained volunteers were deployed (score card indicator was 80). The target was that the partners should directly address in total 2.400 youngsters < 30 years using the quiz cards. Effectively the partners have addressed 2.845 youngsters. The final result is that the UPDATE project directly addressed 14% more youngsters on the European rights than originally targeted. 24.320 youngsters were reached by using and distributing the same number of information cards. Final Evaluation Report UPDATE 14
  15. 15. 6 RESULTS OF THE QUIZ ABOUT EUROPEAN CITIZEN RIGHTS 6.1 | THE INTERACTIVE QUIZ Inventory on the knowledge of the youngsters is done by using an interactive quiz. For this purpose a quiz card was developed containing 8 queries. The quiz card was completed by youngsters < 30 years. Apart from these quiz cards, the queries could also be answered online. The results of the answered quiz cards were entered in the system by the four partners. The results are used to draw the conclusions on the level of knowledge the youngsters have on their European rights which are presented in this chapter. 2.845 quiz results were used. Topics of the interactive quiz 1. Move and reside freely within the EU 2. Vote for and stand as a candidate in European Parliament and municipal elections 3. Be protected by the diplomatic and consular authorities of any other EU country 4. Petition the European Parliament and complain to the European Ombudsman. The volunteers were trained before the local actions. The training did not only focus on the communication skills towards the youngsters but also on the target group knowledge of the European rights, giving the volunteers the ability to educate the message. As a surplus value of the project a conclusion can be made that 105 volunteers have more knowledge on the European rights now. In the project, after the training and any local action, the volunteers were interviewed on their experience and knowledge. The results are presented in paragraph 6.2. Paragraph 6.3 presents the results on the interactive quiz about the knowledge of youngsters on their own European rights. 6.2 |THE KNOWLEGDE OF VOLUNTEERS ABOUT EUROPEAN RIGHTS The results below are based on the interview results of the 105 volunteers. The age group of the volunteers is between 15 and 30 years old with an average of 21 years. A number of questions were asked (see Annex B EVA2 form “to be filled in after the action”) This paragraph presents the results of this questionnaire. Annex E presents the full results. Knowlegde volunteers about European Rights before and after the training 1. What’s your knowledge about the EU rights before the training? 2. What’s your knowledge about the EU rights after the training? 3. Do you find the knowledge about EU rights important? Final Evaluation Report UPDATE 15
  16. 16. knowlegde EU rights volunteers 100% 5 5 5 5 4 4 4 4 80% 60% important after training 40% 20% 3 2 3 before training 3 0% BE BU HU NL Some reasons why EU rights are important according to the volunteers: Everyone in our country need to know their rights; Every person must have know about EU rights; Because we are country member of the EU; Because it is important; It is our right!!; Because we are real Europeans; Yes, it can help when we are abroad; Because it is important for Young people; It could be useful in life; For the education of Young people; I will need it in the future; Citizenship obligation. Needed European Rights for now and in the future? 1. Have you ever needed EU rights? 2. Do you think you will ever need the EU rights? 3. Do you find this awareness campaign about EU rights useful?  yes  no  yes  no  yes  no Will you need EU rights in the future? needed before 4% 23% 77% Final Evaluation Report UPDATE yes no yes 96% no 16
  17. 17. awareness campaign EU rights 1% campaign useful 99% 99% of all the volunteers consider the awareness campaign on the European rights to be useful! campaign not useful What was, to your sense, the most interesting part for the participant (as the volunteer)? - get new information - to do the quiz - get the comic book - other..... interesting part for the participant 1% 33% 35% information quiz 31% comic book other 89% of the volunteers were satisfied with the actions of the awareness campaign. 11% of the volunteers recommend to improve the approach to the visitors. campaing Final Evaluation Report UPDATE 17
  18. 18. Knowledge about the EU rights from the participants before the action, according the volunteers. Knowledge about the EU rights from the participants after the action, according the volunteers. knowlegde participants before & after the action 4 3,5 3 To the opinion of the volunteers, the knowledge on the European rights the youngsters has increased after the actions. On a scale from 1 to 5, the general knowledge prior to the awareness action was 2.4 and 3.7 after it. 2,5 2 1,5 1 0,5 0 before after Which part of the project was for the volunteer personally the most interesting? Most interest part of the project for the volunteers team volunteers 29% contact visitors training EU rights To the opinion of the volunteers, working as a team was considered to be the most interesting part. 25% 16% learning EU rights 15% tools project 15% Final Evaluation Report UPDATE 18
  19. 19. Conclusions over the volunteers A total number of 105 volunteers have been educated by the 4 partners to facilitate successful realisation of the actions. The age of the volunteers was between 15 and 30 years with an Conclusion average age of 21. On a scale from 1 to 5 the general knowledge on the European rights of the volunteers during the project increased by 1 point. All volunteers consider the knowledge on the European rights important for the purpose of travelling, education or simply for the feeling of being part of the European community. No less than 77% of the volunteers have never needed their European rights. The remaining 23% did mostly while travelling or studying in other countries. 95% of the volunteers expects to make use of the European rights in the future. 99% of the volunteers find this awareness campaign useful. We also questioned the volunteers about the combination/relation of the various implemented campaign materials. This resulted in the opinion that the interconnection and relation of the 3 products (quiz card, comic book en information card) was considered to be very good and have resulted in a successful and complete awareness campaign. No less than 89% of the volunteers judged both the campaign and the actions as very useful and satisfactory. To the opinion of the volunteers the knowledge of the participants clearly increased, too. This knowledge increased with more than 1 point on a scale of 0 to 5. Finally we also asked the volunteers what they thought to be the most interesting aspects of the project for themselves. Almost one third (29%) enjoyed most the team work, while 25% judged the contact with the participants as most interesting. The training (16%), the knowledge on the European rights (15%) as well as the used campaign material (15%) was considered to be less interesting for the volunteers. Final Evaluation Report UPDATE 19
  20. 20. 6.3 | THE KNOWLEDGE OF THE CITIZENS ABOUT THEIR EUROPEAN RIGHTS Statistical report on the data collected from 2.845 quiz cards, completed by youngsters < 30 years. Topics of the interactive quiz (the complete quiz can be seen in Annex F) 1. Move and reside freely within the EU 2. Vote for and stand as a candidate in European Parliament and municipal elections 3. Be protected by the diplomatic and consular authorities of any EU country 4. Petition the European Parliament and complain to the European Ombudsman. Number and profile of participants on the interactive quiz The knowledge of the youngsters on the European rights is investigated by using an interactive quiz. Completing the quiz is done both offline during actions and online. The results presented below are based on the outcome of the 2.845 completed quiz cards. All information from the quiz is processed on the basis of the participating country. This paragraph presents an overview of the processed information. Participants by country participants by country 21% BELGIUM 21% BULGARIA 25% Bulgaria Belgium Hungary The Netherlands Total Final Evaluation Report UPDATE HUNGARY 33% NETHERLANDS The biggest number of reached youngsters was accomplished by Bulgaria (33% of all youngsters). Belgium, Hungary and the Netherlands reached about the same number of youngsters. All participating countries have met the performance indicator. 934 participants 600 participants 711 participants 600 participants 2.845 participants 20
  21. 21. Participants by gender 56% of the Total participants were male (1.558) and 44% were female (1.242). 2.845 participants: female of male 44% female 56% male Participants per country by gender Gender BE BU Female 257 472 Male 336 458 Unknown 7 4 600 934 HU 247 436 28 711 NL 266 328 6 600 TOTAL 1.242 1.558 45 2.845 Participants by age age of the 2845 participants The age groups of the queried participants by country 350 300 250 BEL 200 BUL 150 HUN 100 NL 50 0 unknown 12-17 18-20 21-24 25-30 Conclusions on the profile of the participants 1) 1.558 of the 2.845 quiz card were completed by male participants and 1.242 by female participants. For 45 participants the gender was not specified. In Bulgaria the number of queried female and male participants was almost equal. In Hungary 189 more male than female participants were queried (total 711). In Belgium and the Netherlands also more male than female participants were queried, but the difference was marginal. 2) The age Group 21-24 years was the most represented one in all 4 countries, also the age Group 18-20 years has a good representation. A remarkable representation of the age group 12-17 years can be seen in Bulgaria in comparison with the other countries. Final Evaluation Report UPDATE 21
  22. 22. 6.4 | STATISTICAL REPORT ON THE DATA COLLECTED FROM 2.845 QUIZ CARDS The quiz card holds 8 questions on the European rights. The full outline of the quiz queries can be found in Annex E. In the context of the project 2.845 quiz cards were completed. Each quiz card has 8 questions, which puts the total number of questions at 22.760. From these 66% were answered correctly. Averaged over all questions 34% correct 66% The individual correct scores per country are: Bulgaria 77% Netherland 66% Belgium 62% Hungary 54% wrong Average 66% The table below presents the percentage of correct answers by question number and country. Bulgaria had a reasonable high score in all questions, bringing their correct score to 77%! All countries scored very well on questions 7 and 8. The questions 3 and 6 turned out to be the most difficult ones for all countries. Hungary showed the lowest total score which one can see in most of the individual scores (red bar). good answers in % quiz results by country 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% BE BU HU NL 1 2 3 4 5 6 7 8 the questions Final Evaluation Report UPDATE 22
  23. 23. CORRECT ANSWERS BY QUESTION AND BY COUNTRY Question 1 - The term "freedom of movement" in the European Union affects: Answer 1: all together capital, goods, services and people Answer 2: only capital Answer 3: only services Answer 4: only goods Explanation: The so-called "four freedoms" are freedom of movement, of goods, of services, of capital and people. Question 1: correct answers 100% 80% 60% 40% 89% 79% 62% 20% 31% 0% BE BU HU NL Question 2 - Which of the following is valid for a Bulgarian citizen who wants to go on vacation in Germany? Answer 1: "He should apply for a visa at the German consulate." Answer 2: "He must ask permission from the municipality he lives in." Answer 3: "He must have a valid passport or identity card to be able to cross the border." Answer 4: "He must prove he has sufficient funds." Explanation: To cross the border, he must present his passport or ID card. Question 2: correct answers 100% 92% 80% 60% 86% 77% 52% 40% 20% 0% BE BU Final Evaluation Report UPDATE HU NL 23
  24. 24. Question 3 - I am Spanish and I live in Bulgaria. As for the elections to the European parliament, which of the following statements is true? Answer 1: "Unfortunately, I cannot stand for elections for members of the European parliament in Bulgaria." Answer 2: "I can stand for European parliament elections in Bulgaria if I have permission from the Spanish Embassy." Answer 3: "I can run for the next European parliament elections in Bulgaria after 10 years." Answer 4: "I can run for the next European parliament elections in Bulgaria." Explanation: Every citizen of the Union has the right to vote and to stand as a candidate at elections to the European Parliament in the Member State, in which he or she resides, under the same conditions as nationals of that State. Question 3: correct answers 60% 50% 49% 40% 30% 50% 38% 20% 10% 7% 0% BE BU HU NL (Article 39 of the Charter of Fundamental Rights of the European Union - Right to vote and to stand as a candidate at elections to the European Parliament). (http://www.europarl.europa.eu/charter/default_en.htm) Question 4 - Which of the following statements of Bulgarian citizens living in a village in Germany is true? Answer 1: "I have no right to vote in local elections." Answer 2: "I have no right to stand in local elections." Answer 3: "I have the right to vote and stand in local elections, but not to be elected as mayor." Answer 4: "I have the right to vote and stand in local elections and even to be elected as mayor." Question 4: correct answers 100% 80% 60% 72% 81% 66% 54% 40% 20% 0% BE BU Final Evaluation Report UPDATE HU NL Explanation: Every citizen of the Union has the right to vote and to stand as a candidate at municipal elections in the Member State in which he or she resides under the same conditions as nationals of that State. (Article 40 of the Charter of Fundamental Rights of the European Union - Right to vote and to stand as a candidate at municipal elections). 24
  25. 25. Question 5 - If a citizen of the European Union has a problem in a third country in which his country has no consular service, he is entitled to: Answer 1: go to a consular office where his native language is spoken Answer 2: cry Answer 3: contact the embassy or consulate of any European Union country Answer 4: go to a consular office of a country which is close to his own one Explanation: Every citizen of the Union shall, in 100% the territory of a third country in which the Member State of which 80% 86% 84% he or she is a national is not 77% 60% represented, be entitled to protection by the diplomatic or 40% consular authorities of any 40% 20% Member State, on the same conditions as the nationals of that 0% Member State. BE BU HU NL (Article 46 of the Charter of Fundamental Rights of the European Union - Diplomatic and consular protection). (Http://www.europarl.europa.eu/charter/default_en.htm) Question 5: correct answers Question 6 - Acquisition of citizenship of a Member State of the European Union depends on the: Answer 1: Member State in question Answer 2: person himself Answer 3: European institutions Answer 4: Member State and European institutions Explanation: The answer of the question whether a person can acquire citizenship of a Member State depends entirely on the national legislation of that Member State. Question 6: correct answers 70% 60% 50% 40% 30% 20% 10% 0% 65% 36% 5% BE 8% BU Final Evaluation Report UPDATE HU NL 25
  26. 26. Question 7 - The right to petition the European Parliament: Answer 1: belongs to all nations of the earth Answer 2: belongs to every citizen and every resident in a Member State of the European Union Answer 3: belongs to the large companies Answer 4: belongs to God Question 7: correct answers 88% 86% 84% 82% 80% 78% 76% 74% 87% Explanation: Any citizen of the European Union and any person residing in a Member State has the right to petition the European Parliament. 83% 79% BE 79% BU HU NL Question 8 - In the event of maladministration by the European Union institutions I have the right to: Answer 1: appeal to the U.S. Supreme Court Answer 2: turn to the Belgian Embassy Answer 3: stop paying my taxes Answer 4: complain to the European Ombudsman Question 8: correct answers 95% 93% 90% 90% 85% 85% 80% 83% Explanation: In case of maladministration by European Union institutions (with the exception of the Court of Justice), citizens and residents of the European Union are entitled to complain to the European Ombudsman. 75% BE BU Final Evaluation Report UPDATE HU NL 26
  27. 27. Conclusions quiz results Conclusion Bulgaria with 77% correct answers had the best score. The Netherlands with 66% scored second, followed by Belgium with 62% and Hungary with 54%. Some questions showed differences by country. I.e. The Netherlands had a very low score on question 3 (only 7%) and also for question 6 we see big differences for individual countries. An explanation for this could not be found. In an earlier stage, Open Youth carried out extensive awareness campaigns on the European rights in Bulgaria. This was done in 2008 and in 2012. The results of these two campaigns were compared with the results of UPDATE in 2013. The major increase of correct answers compared with the results of the earlier campaigns is remarkable. Annex G presents the differences between the various campaigns by year. Final Evaluation Report UPDATE 27
  28. 28. Quiz results by gender The avarage score on correct answers by gender show no dramatic differences. Both genders scored with an avarage of 66%. This concludes that the level of knowledge on European rights is the same for both females and males. quiz results: female versus male Correct answers in % 100% 80% 60% female 40% male 20% 0% 1 2 3 4 5 6 7 8 questions Quiz results by age By registering the age of the participants, a comparison can be made with the number of correct answers within the age group. The relatively high score of the age group 12-17 years is remarcable. With a correct score of 72% this group scored far better than all others. The remaining 3 groups had almost the same score. Age group "18-20 years" has an average correct score of 64%, age group "21-24 years" - 66% and age group "25-30 years" - 64%. Correct answers in % Quiz results by age 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 12-17 yrs 18-20 yrs 21-24 yrs 25-30 yrs 1 2 3 4 5 6 7 8 the questions Final Evaluation Report UPDATE 28
  29. 29. questions 1 2 3 4 5 6 7 8 average 12-17 yrs 83% 90% 40% 68% 77% 55% 78% 84% 72% 18-20 yrs 61% 74% 37% 67% 69% 33% 83% 87% 64% 21-24 yrs 67% 77% 38% 70% 75% 26% 84% 90% 66% 25-30 yrs 68% 77% 34% 67% 72% 24% 83% 88% 64% Conclusions results of the quiz 1) 2.845 quiz cards, all together with 22.760 queries, were completed. 66% of the answers were correct. Conclusion 2) Bulgaria had the highest score with 77% followed by the Netherlands with 66%, Belgium with 62% and Hungary with 54%, meaning that the youngsters European rights knowledge level is reasonably high in the participating countries. 3) The question “Vote for and stand as candidate in European Parliament and municipal elections” (no. 3) resulted in a low score of correct answers of 33%. 4) Also the question “protection by the diplomatic and consular authorities of any other EU country” (no. 6) seemed to be difficult. Only 33% gave a correct answer. 5) The two questions on the European Ombudsman (no. 7 and 8) scored the best with respectively 82% end 87% correct answers. 6) Not much difference was encountered in the overall result between male and female participants. Both had an average score of 66% 7) Remarkable in a positive way were the quiz results of the age group 12-17 years. This group scored with 72% correct answers. The other age categories scored almost equal: 64% for the age groups 18-20 years and 25-30 years and 66% for the age group 21-24 years. 8) Open Youth organised awareness campaigns in Bulgaria on this subject before and this presumably explains the higher scores compared with the other 3 countries. This proves that the knowledge of youngsters is increased by these campaigns. Final Evaluation Report UPDATE 29
  30. 30. 7 RESULTS OF VISIBILITY AND DISSEMINATION Event Number 7: Media relations The project partners will list medias both on national as on local level in chosen cities for local actions. Those will be contacted on regular basis to allow them to follow the development of the project and its results. Expected results: Publications in local and national media, 50.000 people reached through media Event Number 9: Dissemination The project result will be disseminated by the project partners throughout their various networks, covering the whole European Union (e.g. the European Youth Forum for Road Safety, the INSIDE network, the “Youth for Europe” online community of more than 3.000 active entities from all over Europe). Each partner will also have a dedicated budget for developing a local Internet marketing campaign, disseminating information about the comics for mobile devices. Expected results: The project results are disseminated EU wide. 7.1 | The visibility of the project and the activities in the media Press releases had been sent by the 4 partners to national and regional press during all actions. The table below presents the number of media contact of each partner. The second table presents the actual appearances in the media. With the experience that the partners have with the media, they knew how to find the way inside the media organisations and how to make the project visible for the public. Annex H presents a number of examples of published media content. Number of media contacts Local level National level 575 188 0 0 0 0 26 29 Bulgaria Belgium* Hungary** The Netherlands * During one action Belgium received a vist of their Minister of Road Safety and Agriculture, Mr. Carlo di Antonio. **Hungary did the final closing event of the project on December 16th, 2013 and gave a short presentation about the results for the regional and local NGOs. A final article will be published in the February edition of their University Journal. Bulgaria Belgium Hungary The Netherlands TV 7 0 0 1 Final Evaluation Report UPDATE Radio 14 0 0 1 Number and type of publiciations Newspaper News agencies 8 7 0 0 0 0 10 0 Internet 77 0 0 16 30
  31. 31. Participants by media A calculation is made for the number of individuals that encountered an appearance or broadcast about the UPDATE project. In our context these are named indirect participants. Bulgaria made a detailed calculation on the indirect outreach of people through media coverage. Only in Bulgaria this resulted in an indirect reach of 1.478.332 people. This calculation is based on reported audience by the diffent media and does not account for any possible overlap. The Netherlands also made a calculation of the media based on the total number of inhabitants as well as the various reaches per individual utterance. This resulted in a reach through the media of 242.000 indirect participants. In Bulgaria 1.478.332 indirect participants by media! In The Netherlands 242.000 indirect participants by media! 7.2 | The visibility of the project and the activities by the general public The project went extremely well for the visibility under a big group of spectators. The big booth used during the actions already draws public attention. Also the distribution of the information cards about the European rights contributed to good visibility and spreading out information to the public. The voluntear teams are trained to address big groups of public at big events in which many youngsters participate. After completing the quiz card each participant received a comic book to take home. The after effect of distributing the information card and the comic book unfortunately is hard to measure, but must be a multiple of the total distributed materials (24.320 information cards and 2.552 comic books). 7.3 | The online visibility Although all performance indicators were met, the number of website visitors was below the expectations. 1.900 people visited the website of which 531 people completed the quiz queries and downloaded the comic book. From the total number of downloaded online applications, 406 were done for Android. The Apple store does not provide download information for free apps, but the UPDATE application received a user review of 4+. In the period between March 12 and May 5, Bulgaria launched an internet marketing campaign using 2 facebook pages: Open Youth and Youth for Europe. By using this campaign, 14.537 people were reached directly (i.e. interacted with the provided content) and 740.246 people were reached indirectly (i.e. saw the content). Final Evaluation Report UPDATE 31
  32. 32. 7.4 | The visibility of the project and the activities by the networks The partners of UPDATE are part of big (inter)national networks and participate in multiple international projects. Project UPDATE was disseminated at the following conferences: Name Location & date Number of participants ‘Traffic Police’ Media Seminar Hisar (Bulgaria), 14 of june 2013 100 participants Name Location Date Number of participants ‘Speed Management’ Training Courses Sofia, Veliko Tarnovo, Varna, Burgas, Plovdiv (Bulgaria) 26-30.08.2013 109 participants Name Location & date Number of participants ‘Employability of Young People’ Conference at EESC, CCMI, Brussels (Belgium) 22 of November 2013 150 participants Name Location & date Number of participants Number of media relations European Youth Forum for Road Safety (EYFRS) Crotone (Italy) 26, 27, 28 of November 2013 100 participants a day 50 local journalists, 5 local TV stations, 1 national TV station Name Location & date Reason Number of participants Bulgarian Forum for Road Safety Sofia (Bulgaria) / 04th of December 2013 UPDATE press-conference 114 participants Conclusion visibility The ultimate goal was to reach 100.000 people, from which 50.000 through direct media and 50.000 through online media. The UPDATE project reached in total: Medium and products 2.552 comic books Quiz Cards Information Cards Online web and app Media Networks partners Final Evaluation Report UPDATE Reach 2.552 direct participants 2.845 direct participants 24.320 indirect participants 743.083 indirect participants 1.720.322 indirect participants Unkown 32
  33. 33. 8 PROCESS EVALUATION 8.1 | Event Number 8: Evaluation The project envisages the implementation of an integrated evaluation system foreseeing an INTERNAL EVALUATION (progress evaluation) + AN EXTERNAL EVALUATION (final evaluation) whose objectives are: - to analyze the level of implementation of the working programme at each stage; - to verify the achievements that could affect the implementation of each subsequent activity; - to collect information about the effectiveness of the work in each partner’s context. Expected results Evaluation report for the project achievements; project manual, describing the project process; statistical report on the data, collected from 2 400 quiz cards, giving information on the concrete knowledge of the ordinary citizens about their European rights. Another evaluation will be done on the experience of the involved volunteers. The evaluation will be subcontracted to an experienced external evaluator who will also participate at the preparation and evaluation meetings. The chapters 4 and 5 outlined the external evaluation. This chapter will deal with the internal evaluation, the process evaluation of the project UPDATE. On a periodic basis all partners were asked to complete an evaluation form to collect the needed data for the process evaluation. All answered questions are assembled in evaluation form EVA4 (Annex D). Finally the process of the project UPDATE was discussed and evaluated during the Final Meeting in Sofia (BG) between all partners. Annex I presents the results of the process evaluation. This chapter presents the conclusions of these 2 evaluations. The process evaluation is presented in 4 paragraphs: 1) Project management 2) Meetings of the project team 3) Development of the used material 4) Organisatiion of the local actions On the evaluation form the partners could give their judgement about a subject on a scale of 0 to 5 (Very bad 0-1-2-3-4-5 Excellent) about a subject. This judgement is used in the process evaluation. Final Evaluation Report UPDATE 33
  34. 34. 8.2 | Proces evaluation of the Project management The description of the task for process management is as follows: The project will be coordinated and managed internationally by Open Youth in its capacity as leading partner. The project coordinator plays a strategic role in meeting the objectives that have been set and in achieving results which can be useful and transferable at a European level. 1. The coordinator will be in charge of managing the relationships with EACEA . 2. The other project partners will be actively involved in this work package. Each will appoint a person, who will be responsible. Expected results Sound project management process allowing all activities to be implemented as foreseen and the aims to be achieved; activities and financial reports. Open Youth performed its job very well and reached an avarage score of 4.7 on this item. The information about the project itself, as well as the involvement of the partners, the task balancing between the partners and the goals of achievement have been expierenced as positive and clear. Also the information about how to organise local actions and the method of reporting the results was clear. A strong advantage for this was that the partners are well known with the awareness campaigns for youngsters and also cooperate together within other projects. The effect of this is a flexible running process and a efficient performing of tasks by each partner. 8.3 | Proces evaluation of the project team meetings Within the project 3 team meetings were held. Preparation Meeting in Brussel 24-26.09.2012 Training for the trainers in Amsterdam 15.03.2013 Final Meeting in Sofia 03-04.12.2013 Thanks to the project management these meetings were organised within the established time table and the proposed results were met. In the preparation meeting, the project partners will discuss and develop the project strategy in details, including information materials, project logic, defining the locations for the local actions, recruitment of local youth volunteers. After the training for the trainers meeting each partner will have a well prepared trainer who will be responsible for training a team of volunteers for the implementation of each local actions in the different partner's settings. At the end of the project the participants will meet to discuss the project achievements. They will do analysis of project development, discussion of project results, evaluation of project communication activities, instructions for final report (activities and financial), discussion of future project development. A press conference will be organized to inform the media about the project results. The Preparation meeting in Brussels reached a score of 4.35 where the Train the trainers meeting reached a score of 4.7. This means that the information about the development of the needed material was accomplished very well both at project and partner level. Each partner wrote its own EU story and all these were united in the comic book. Final Evaluation Report UPDATE 34
  35. 35. The Training for trainers meeting in Amsterdam was also successful. The partners were already well experienced in training volunteers in a way that actions could get performed well. For this reason the Training for the trainers meeting had been run efficiently and fast. The Final meeting in Sofia also went well. During this meeting the partners shared and evaluated their experiences within the local actions. On the second day of the Final meeting Open Youth organised a press conference. The results of this press conference is presented in chapter 7. 8.4 | Process evaluation of the development of the used material Development of the material to be used by the project was done well and all was realised well before the start of the first pilot actions. On local level all partners have developed their material and produced it with the branding of the project. The material used by the project received a high avarage score of 4.3 from which the comic book unanimous scored 5. Also the booth used by the actions had a very high avarage score of 4.75 and the avarage score of 4.0 for the “Appstore application comic book” is remarkable, too. In general all the project material was received very positive by the partners. 8.5 | Proces evaluation of the organising of the local actions Organising a pilot action and 3 local actions are described in Event Numbers 5 and 6 Event Number 5: A pilot action will be organized by each partner in order to test the developed method and products. Each of them will be for three days - an orientation one, a training for at least 5 local youth volunteers, enabling them to successfully implement the next day action, and the local action itself, implemented by the volunteers, supported by the trainer and the country project manager. Each action has to attract at least 150 people to complete the interactive quiz. Event Number 6: Taking into account the result from the pilot action and implementing changes where necessary, each partner will have to implement three more actions, using the developed in Event 5 approach. All partners of project UPDATE are well experienced in organising awareness campaigns and actions for youngsters. They can make use of many contacts and networks to choose, organise and realise local actions by trained volunteers. The quantitative data is presented in chapter 5 and, effectively, is higher than the pre-defined performance indicators. This part of the project was run without any problems by all partners who gave an avarage score of 4.5 for this process. Final Evaluation Report UPDATE 35
  36. 36. 9 CONCLUSIONS AND RECOMMENDATIONS General conclusions The project UPDATE was finalised successful. The quantitative indicators were widely met. Development of information and Conclusion communication materials was done in accordance with the agreements and the plan of action. For the local actions all materials like the web site, the comic book, the information cards, the quiz cards, the booth, the T-shirts and pens were prepared and ready to use on time. Also the online versions of the comic book were developed on time and in accordance with the plan of action. The project trained 105 volunteers for realising the 23 local actions. During these local actions 2.845 quiz cards were completed and 24.320 information cards distributed. The specially developed comic book and the connected online applications addressed the young target group very well. The great experience of the participating partners concluded in a successful realisation of the project UPDATE, within the given time frame and meeting the predefined targets. Specific conclusions about European Rights The aim of the UPDATE project was to explain the fundamental European rights to the youngsters. This explanation was realised by using a specially developed comic book offline with a real book and online using special apps. In this way the maximum possible number of youngsters was reached. Since many awareness actions for road safety target the aimed group of youngsters < 30 years, a combination with these awareness campaigns was often made by the project UPDATE. Both the volunteers and the participants were questioned about their knowledge on European rights. The most interesting conclusions on the knowledge on European rights of the volunteers is as follows: 1) 77% of the volunteers have never used their EU rights, but 96% think that they will need them in the future; 2) On a scale of 0 to 5 they evaluate their knowledge of EU rights at 3 before training and at 4 after it; 3) On a scale of 1 to 5 they evaluate the knowledge of the young project participants about their European rights at 2.4 before the respective campaign and at 3.7 after it; 4) 89% of the volunteers were satisfied with the actions of the awareness campaign. From the completed quiz cards by the 2.845 young participants the following conclusions can be drawn: 1) The total proportion of given correct answer is 66%; 2) There is no gender difference, the proportions of correct answers given by boys and girls was 66%; 3) Most correct answers are given by the youngest participants, aged 12 to 17 years: 72%; 4) The Bulgarian participants had the greatest knowledge on the European rights: They scored 77% correct answers, with the Dutch scoring 66%, the Belgiums scoring 62% and the Hungarians scoring 54%. 5) The score about the freedom of movement in the European Union (question 1) was very high, although Hungary had a relatively low score of 31% correct answers on this topic. Final Evaluation Report UPDATE 36
  37. 37. 6) Also 77% of the youngsters is aware of the need of a valid ID card or passport while travelling to another European Union country for i.e. holidays (question 2) 7) The question “Vote and stand as candidate in the European Parliament” is more complex. 33% correct answers were given to this question (no. 3). 8) 68% of the youngsters are aware that they have the right to vote at local elections and also that they can stand for mayor in the place where they live, independently their nationality (question no. 4) 9) Question 5 “Protection by the diplomatic and consular authorities” was more complex, this query had an average score of 33% correct answers. 10) The question about the European Parliament had a correct score of 82% (question 7). 11) The youngsters showed to be well informed about the European Ombudsman. This question received a score of 88% correct answers (question 8). Recommendations 1) The project UPDATE was very successful which was caused by both the big experience and great networks of the partners within the project. The partners are also experienced in training and working with volunteers inside a project, organising awareness campaigns and with communicating with and informing youngsters. 2) Cooperation between the partners was very good (this scored high in the process evaluation). Having worked together before in various projects eased helping and approaching each other. 3) The general knowledge about the European rights of the young participants is relatively high. The average score was 66% correct answers. 4) Open Youth already conducted 2 awareness campaigns in Bulgaria in 2008 and 2012 and from the results one can clearly see that the knowledge of the European rights strongly increased. Bulgaria finished in the total results as the country with the best results. 5) A conclusion can be drawn that an awareness campaign, such as the one realised by project UPDATE, is useful and successful and that the knowledge on the European rights increased for the target group. Final Evaluation Report UPDATE 37
  38. 38. ANNEXES UPDATE PROJECT ANNEXES A. Update Material Counting (EVA1) B. Form to filled after the action by volunteers (EVA2) C. Form to be filled after the action by coordinator of the volunteer (EVA3) D. Process evaluation (EVA 4) E. Evaluation of the volunteers F. Quiz questions G. Quiz results Bulgaria 2008-2012-2013 H. Examples of statements in the media I. Results Process Evaluation (EVA4) Final Evaluation Report UPDATE 38
  39. 39. Annex A: Update Material Counting (EVA1) EVA 1. Form to be filled before and after the action Date : Country: Place: Time : Material UPDATE Comic books Quiz cards Information cards pens Number before the action (a) Number after the action (b) Number distributed (c) (c) = (a) – (b) On average 150 people per action to complete the interactive quiz Final Evaluation Report UPDATE 39
  40. 40. Annex B: Form to filled after the action by volunteers (EVA2) EVA2. Form to be filled after the action by the VOLUNTEERS Date : Country: Name of the Volunteer Age of the volunteer Identity Your Coordinator on the action Your number off action 1 2 3 Place:  student  employed Time :  unemployed  first  second  third  fourth  fifth Your knowledge about EU rights before the training Negative 0___1___2___3___4___5 Positive Your knowledge about EU rights after the training Negative 0___1___2___3___4___5 Positive 4 Do you find the knowledge about the EU right important? If yes, why? 5 If no, why not? 6 Have you ever needed the EU rights? Do you think you ever need the EU rights? Do you find this awareness campaign about EU rights useful? How many participants / visitors did you talk to during the action today? (on the average) 7 8 9 Negative 0___1___2___3___4___5 Positive  yes  no  yes  no  yes  no  less than 20  between 20 & 50  between 50 & 100  more than 100 10 What was at you sense the  Get new information most interesting part for  Do the quiz the visitors you talked to?  Get the comic book  Others: ....................................... Final Evaluation Report UPDATE 40
  41. 41. 3 The knowledge about EU right from the visitors before the action (your assumption) 4 The knowledge about EU right from the visitors after the action (your assumption) 13 I recommend to change the activities in part 14 Negative 0___1___2___3___4___5 Positive Negative 0___1___2___3___4___5 Positive  yes  no If YES, what changes do you  the given information have in mind:  the tools  the approach of the visitors  others: .................................. 15 Which part of the project  the contacts with visitors/youngsters was for you personally most  learning about EU rights of interest?  the team of volunteers  the training  the tools  others: .................................. Final Evaluation Report UPDATE 41
  42. 42. Annex C: Form to be filled after the action by coordinator (EVA3) EVA3. Form to be filled after the action by coordinator off the volunteers Date : Country: Place: Time : profile youngsters: peer-to-peer Total Male Total female Total yougsters < 30 material update Total comics Total information cards Total quiz cards Total pens knowledge about EU rights Youngsters General knowledge: Negative 0___1___2___3___4___5 Positive Final Evaluation Report UPDATE volunteers General knowledge: Negative 0___1___2___3___4___5 Positive 42
  43. 43. Annex D: Process evaluation (EVA 4) EVA4. Process evaluation update to be filled in by the country project manager Name of the evaluator Name of the organisation Date Project Management Information about the project Clear objectives Achievable objectives Information about local actions Information about the reports Partners actively involved by the project Very bad Very bad Very bad Very bad Very bad Very bad 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 Excellent Excellent Excellent Excellent Excellent Excellent Start Up Meeting Brussel (24-26.09.2013) Clear project strategy Information about develop material Information about develop comic book/story Information about local actions Information about recruitment local volunteers Very bad Very bad Very bad Very bad Very bad 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 Excellent Excellent Excellent Excellent Excellent Training for the trainers Amsterdam (15.03.2013) Instructions about the training local volunteers Instructions about communicating young people Instructions about working with the interactive quizzes Instructions about the administration of the quizcard Instructions about dissemination of the project material Instructions about the collection of data Very bad Very bad Very bad Very bad Very bad Very bad 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 Excellent Excellent Excellent Excellent Excellent Excellent Very bad Very bad Very bad Very bad Very bad Very bad Very bad Very bad 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 Excellent Excellent Excellent Excellent Excellent Excellent Excellent Excellent How would you rate the material (useful) Website Comic book Informations cards Interactive quizcards Appstore comics applications Pens Projects shirts Local stands Final Evaluation Report UPDATE 43
  44. 44. How would you rate the locale action organization & visuals? The preparation The material used (the tools) The visibility The welcoming of the visitors The involvement of the NGO The location Very bad Very bad Very bad Very bad Very bad Very bad 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 0___1___2___3___4___5 Excellent Excellent Excellent Excellent Excellent Excellent Pilot & local actions Number of trained volunteers Number of successful actions Number of participants on the interactive quiz Other questions Your knowledge about EU rights before the project Negative 0___1___2___3___4___5 Positive Your knowledge about EU rights after the project Negative 0___1___2___3___4___5 Positive Do you find this awareness campaign about European rights is useful? I recommend to change the activities in the project If yes, what changes do you have in mind?  yes  no Media: were there publications in the local media about Update? If yes, wil you mail this to Daniel of Jetty Final Evaluation Report UPDATE  yes  no 44
  45. 45. Annex E: Evaluation of the volunteers EVALUATIONS OF THE VOLTUNEERS Number of volunteers Average age Range of age Student (Un)employed Knowledge volunteer before training* Knowledge volunteer after training* Knowledge important according the volunteer* Ever needed EU rights? Need EU rights in the future? Campaign EU rights useful? Interest part for the visitor according to the volunteer** Knowledge visitor befor the action* Knowledge visitor after the action* Change activities awareness campaign Most interest part of the project for the volunteer** BE 24 22 21 - 29 66% 34% 2.5 NL 20 21 17-24 85% 15% 2.7 ALL 105 21 15 - 30 76% 23% 2.5 4 4 3.9 4 4.4 yes no contact visitor learning EU rights team volunteers training tools HU 25 22,5 17 - 27 68% 32% 2.4 4.1 yes no yes no yes no new info quiz comic book other BU 36 20 15 - 30 86% 14% 2.4 4.3 4.8 4.8 4.6 20% 80% 100% 0% 100% 0% 31% 28% 39% 2% 2.4 3.6 8% 92% 30% 16% 29% 19% 6% 3% 97% 97% 3% 97% 3% 40% 27% 31% 2% 2.5 3.8 14% 86% 22% 16% 25% 13% 24% 8% 92% 100% 0% 100% 0% 27% 38% 35% 0% 2.3 3.7 12% 88% 18% 11% 22% 25% 24% 15% 85% 100% 0% 100% 0% 32% 31% 37% 0% 2.5 3.7 10% 90% 31% 17% 40% 7% 5% 11,5% 99% 1% 99% 1% 33% 31% 35% 1% 2.4 3.7 11% 89% 25% 15% 29% 16% 15% * negative 0__1__2__3___4__5 positive ** multiple answers possible Final Evaluation Report UPDATE 45
  46. 46. Annex F: Quiz questions quiz to be filled during the action Form to be filled for each group or person met Date : Country: Place: Time : PROFILE YOUNG EU CITYZEN Sex Male: ......... Female: .......... Total : ........ Age  12-17  Unknown  18-20  Various  20-24  25-30 INTERACTIVE QUIZ 1. MOVE AND RESIDE FREELY WITHIN THE EU 1.1 The term 'freedom of movement' in the European Union affects:  A: altogether capital, goods, services and people  B: only capital  C: only services  D: only goods Explanation: The so-called "four freedoms" are freedom of movement of goods, services, capital and people. 1.2 - Which of the following is valid for a Bulgarian citizen who wants to go on vacation in Germany?  A: "He should apply for a visa at the German consulate."  B: "He must ask permission from the municipality he lives in."  C: "He must have a valid passport or identity card to be able to cross the border."  D: "He must prove He has sufficient funds." Explanation: For the need of border crossing, he must present his passport or ID card. Final Evaluation Report UPDATE 46
  47. 47. 2. VOTE FOR AND STAND AS A CANDIDATE IN EUROPEAN PARLIAMENT AND MUNICIPAL ELECTIONS 2.1 I am Spanish and I live in Bulgaria. As for the elections to the European parliament, which of the following statements is true?  A: "Unfortunately, I cannot stand for elections for members of the European parliament in Bulgaria."  B: "I can stand for European parliament elections in Bulgaria if I have permission from the Spanish Embassy."  C: "I can run for the next European parliament elections in Bulgaria after 10 years."  D: "I can run for the next European parliament elections in Bulgaria." Explanation: Every citizen of the Union has the right to vote and to stand as a candidate at elections to the European Parliament in the Member State, in which he or she resides, under the same conditions as nationals of that State. Article 39 of the Charter of Fundamental Rights of the European Union 2.2 Which of the following statements of Bulgarian citizens living in a village in Germany is true?  A: "I have no right to vote in local elections."  B: "I have no right to stand in local elections."  C: "I have the right to vote and stand in local elections, but not to be elected as mayor."  D: "I have the right to vote and stand in local elections and even to be elected as mayor." Explanation: Every citizen of the Union has the right to vote and to stand as a candidate at municipal elections in the Member State in which he or she resides under the same conditions as nationals of that State. Article 40 of the Charter of Fundamental Rights of the European Union 3. BE PROTECTED BY THE DIPLOMATIC AND CONSULAR AUTHORITIES OF ANY OTHER EU COUNTRY 3.1 If a citizen of the European Union has a problem in a third country in which his country has no consular service, he is entitled to:  A: go to a consular office of a country which is close to his own one  B: cry  C: contact the embassy or consulate of any European Union country  D: go to a consular office where his native language is spoken Explanation: Every citizen of the Union shall, in the territory of a third country in which the Member State of which he or she is a national is not represented, be entitled to protection by the diplomatic or consular authorities of any Member State, on the same conditions as the nationals of that Member State. Article 46 of the Charter of Fundamental Rights of the European Union 3.2 Acquisition of citizenship of a Member State of the European Union depends on the:  A: Member State in question  B: person himself  C: European institutions  D: Member State and European institutions Explanation: The answer of the question whether a person can acquire citizenship of a Member State depends entirely on the national legislation of that Member State. Final Evaluation Report UPDATE 47
  48. 48. 4. PETITION THE EUROPEAN PARLIAMENT AND COMPLAIN TO THE EUROPEAN OMBUDSMAN. 4.1 - The right to petition the European Parliament:  A: belongs to all nations of the earth  B: belongs to every citizen and every resident in a Member State of the European Union  C: belongs to the large companies  D: belongs to God Explanation: Any citizen of the European Union and any person residing in a Member State has the right to petition the European Parliament. 4.2 - In the event of maladministration by the European Union institutions I have the right to:     A: B: C: D: appeal to the U.S. Supreme Court turn to the Belgian Embassy stop paying my taxes complain to the European Ombudsman Explanation: In case of maladministration by the and European Union institutions (with the exception of the Court of Justice), citizens and residents of the European Union are entitled to complain to the European Ombudsman. Final Evaluation Report UPDATE 48
  49. 49. Annex G: Quiz results Bulgaria 2008-2012-2013 Question 1 - The term "freedom of movement" in the European Union affects: Answer 1: Answer 2: Answer 3: Answer 4: 100 90 80 70 60 50 40 30 20 10 0 altogether capital, goods, services and people only capital only services only goods 96 85 Explanation: The so-called "four freedoms" are freedom of movement of goods, services, capital and people. 89 7 Answer 1 1 4 3 Answer 2 2008 1 5 Answer 3 2012 4 2 3 Answer 4 2013 Question 2 - Which of the following is valid for a Bulgarian citizen who wants to go on vacation in Germany? Answer 1: "He should apply for a visa at the German consulate." Answer 2: "He must ask permission from the municipality he lives in." Answer 3: "He must have a valid passport or identity card to be able to cross the border." Answer 4: "He must prove He has sufficient funds." Explanation: For the need of border crossing, he must present his passport or ID card. 94 92 100 69 80 60 40 17 20 7 2 1 7 2 3 2 4 0 Answer 1 Answer 2 2008 Final Evaluation Report UPDATE Answer 3 2012 Answer 4 2013 49
  50. 50. Question 3 - I am Spanish and I live in Bulgaria. As for the elections to the European parliament, which of the following statements is true? Answer 1: "Unfortunately, I cannot stand for elections for members of the European parliament in Bulgaria." Answer 2: "I can stand for European parliament elections in Bulgaria if I have permission from the Spanish Embassy." Answer 3: "I can run for the next European parliament elections in Bulgaria after 10 years." Answer 4: "I can run for the next European parliament elections in Bulgaria." Explanation: Every citizen of the Union has the right 46 50 to vote and to stand as a 45 39 candidate at elections to 40 the European Parliament 35 27 in the Member State, in 30 24 23 20 25 which he or she resides, 19 18 17 20 under the same 11 15 conditions as nationals of 7 10 that State. 5 (Article 39 of the Charter 0 of Fundamental Rights of Answer 1 Answer 2 Answer 3 Answer 4 the European Union 2008 2012 2013 Right to vote and to stand as a candidate at elections to the European Parliament). (http://www.europarl.europa.eu/charter/default_en.htm) 49 Question 4 - Which of the following statements of Bulgarian citizens living in a village in Germany is true? Answer 1: Answer 2: Answer 3: Answer 4: "I have no right to vote in local elections." "I have no right to stand in local elections." "I have the right to vote and stand in local elections, but not to be elected as mayor." "I have the right to vote and stand in local elections and even to be elected as mayor." 66 70 60 47 50 40 30 20 38 27 19 13 24 16 16 16 9 9 10 0 Answer 1 Answer 2 2008 Answer 3 2012 2013 Answer 4 Explanation: Every citizen of the Union has the right to vote and to stand as a candidate at municipal elections in the Member State in which he or she resides under the same conditions as nationals of that State. (Article 40 of the Charter of Fundamental Rights of the European Union Right to vote and to stand as a candidate at municipal elections). Final Evaluation Report UPDATE 50
  51. 51. Question 5 - If a citizen of the European Union has a problem in a third country in which his country has no consular service, he is entitled to: Answer 1: cry Answer 2: go to a consular office where his native language is spoken Answer 3: go to a consular office of a country which is close to his own one Answer 4: contact the embassy or consulate of any European Union country Explanation: Every citizen of the Union shall, in the 89 100 84 territory of a third country 73 80 in which the Member State of which he or she is 60 a national is not 40 represented, be entitled 14 9 to protection by the 7 6 20 4 1 5 3 5 diplomatic or consular 0 authorities of any Answer 1 Answer 2 Answer 3 Answer 4 Member State, on the same conditions as the 2008 2012 2013 nationals of that Member State. (Article 46 of the Charter of Fundamental Rights of the European Union - Diplomatic and consular protection). (Http://www.europarl.europa.eu/charter/default_en.htm) Question 6 - Acquisition of citizenship of a Member State of the European Union depends on the: Answer 1: Answer 2: Answer 3: Answer 4: Member State in question person himself European institutions Member State and European institutions 65 70 52 60 50 41 40 40 40 24 30 20 9 4 10 10 6 4 Explanation: The answer of the question whether a person can acquire citizenship of a Member State depends entirely on the national legislation of that Member State. 5 0 Answer 1 Answer 2 2008 Final Evaluation Report UPDATE Answer 3 2012 Answer 4 2013 51
  52. 52. Question 7 - The right to petition the European Parliament: Answer 1: Answer 2: Answer 3: Answer 4: belongs to all nations of the earth belongs to every citizen and every resident in a Member State of the European Union belongs to the large companies belongs to God 89 100 Explanation: Any citizen of the European Union and any person residing in a Member State has the right to petition the European Parliament. 83 72 80 60 40 16 9 20 7 4 5 6 3 2 4 0 Answer 1 Answer 2 2008 Answer 3 2012 Answer 4 2013 Question 8 - In the event of maladministration by the European Union institutions I have the right to: Answer 1: Answer 2: Answer 3: Answer 4: appeal to the U.S. Supreme Court turn to the Belgian Embassy stop paying my taxes complain to the European Ombudsman 89 90 85 75 80 70 60 50 40 30 17 20 10 3 4 5 4 7 5 2 4 Explanation: In case of maladministration by the an European Union institutions (with the exception of the Court of Justice), citizens and residents of the European Union are entitled to complain to the European Ombudsman. 0 Answer 1 Answer 2 2008 Final Evaluation Report UPDATE Answer 3 2012 Answer 4 2013 52
  53. 53. Annex H: Examples of statements in the media Newspaper: Local action in Franeker, The Netherlands, 30.07.2013 Newspaper: Local action Pleven Bulgaria, 20.09.2013 Website Local action Blagoevgrad Bulgaria 22-23.04.2013 Website Local action Vratsa Bulgaria 07-08.05.2013 Final Evaluation Report UPDATE 53
  54. 54. Local action Hungaria Final Evaluation Report UPDATE 54
  55. 55. Annex I: Results Process Evaluation (EVA4) EVA 4 Process evaluation Update Project Management Information about the project Clear objectives Achievable objectives Info about local actions Info about the reports Partners actively involved by the project BE 5 5 5 4 5 5 BU 5 5 5 5 5 5 HU 5 5 4 4 4 5 NL 5 5 4 4 4 5 average 5 5 4,5 4,25 4,5 5 Start Up Meeting Brussel Clear project strategy Info about develop material Info about develop comic book story Info abtou local actions Info about recruitment local volunteers 5 5 5 4 4 5 5 5 5 5 4 3 3 4 4 4 5 4 4 4 4,5 4,5 4,25 4,25 4,25 Training for the trainers Amsterdam Instructions about the training local volunteers Instructions about communicating young people Instructions about working with the interactive quiz Instructions about the administration of the quizcards Instructions about dissemination of the quizcard Instructions about the collection of data 4 5 5 5 5 5 5 5 5 5 5 5 5 5 4 5 4 5 4 4 5 5 4 4 4,5 4,75 4,75 5 4,5 4,75 How would you rate the material (useful) Website Comic book Information card Interactive quiz card AppStore comics applications Pens Project shirt Local stands 4 5 4 4 5 4 4 5 4 5 5 5 4 4 3 5 5 5 4 5 4 5 3 4 3 5 4 4 3 5 5 5 4 5 4,25 4,5 4 4,5 3,75 4,75 How would you rate the actions organisation & visuals The preparation The material used (the tools) The visibility The welcoming of the visitors The involvement of the NGO The location 4 4 4 5 5 5 5 5 5 5 5 4 4 5 5 4 4 4 4 5 4 5 5 4 4,25 4,75 4,5 4,75 4,75 4,25 4 5 yes no 5 5 yes no 3 4 yes no 1 5 yes no 3,25 4,75 100% yes 100% no Other questions Your knowledge about EU rights before the project Your knowledge about EU rights after the project Do you find this awareness campaign useful I recommend to change the activities in the project Final Evaluation Report UPDATE 55
  56. 56. Project Title Commissioned by Author and external evaluator Translator Date UPDATE Final Evaluation Report UPDATE Project Manager Update, Mr. Daniel Vankov LL.M Jetty de Vries, Workum, The Netherlands jetty@vriestyle.com Mr. Eric Mehlbaum 07.01.2014

×