The document summarizes Catalonia's efforts to evaluate its 20-year cluster policy. It outlines precedents from 2008-2014 that involved case studies and internal benchmarking. In 2015-2016, a cluster evaluation project in Catalonia was launched. It developed questionnaires to assess performance of clusters in the Catalonia Clusters Program and ACCIÓ's work with clusters, and to compare cluster vs. non-cluster firm performance. The questionnaires examine topics like structure, projects, visibility, strategic changes, and value of clustering. Challenges discussed include capturing intangible human benefits and measuring broader macro-level impacts beyond traditional GDP indicators.

1. Cluster evaluation in Catalonia
Marta Marsé Vidri, Acció
TCI Cluster Evaluation Workshop, Barcelona, 19-20 May 2016

2. Cluster evaluation in
Catalonia
TCI Evaluation Group Meeting
Barcelona, 19th may 2016
Marta Marsé Vidri
Cluster Analysis Manager
Acció

3. More than 20 years of Cluster Policy in Catalonia

4. Main objectives to start the cluster evaluation project in 2015
We’ve had a cluster policy for 20 years. Mature.
The international context is developing evaluation tools
Initiatives and articles on the subject are emerging.
TCI Network evaluation group
Evaluate the performance of the clusters that are currently in
“Programa Catalonia Clusters”.
Evaluate the work we do with clusters in ACCIÓ
Compare cluster companyies to non cluster Companies

5. 2012:
Internal workgroup
2014:
International
Benchmarking
(Scandinavian
with Emily
Wise)
2015 - 2016:
Cluster
evaluation
project in
Catalonia
Cluster evaluation in Catalonia: precedents and attempts
2008:
Anoia’s knitwear case
study. Internal

6.  Gathered data and experiences
 Includes 3 clusters case of those
older than 10 year
 Peer Review with 3 International
experts through TCI Network call
 Editing in process
 International benchmarking
 Questionnaire created with qualitative and
quantitative indicators at:
 Cluster Level (29 questions)
 Firm Level (14 questions)
 Focus grup with Cluster Managers
 Tool implementation in 2016
Balance (sheet) of the last
ten years in cluster policy
2005-2014
Creation of an annual
evaluation tool
1
Cluster Policy Evaluation project in Catalonia 2015-2016. Summary
2
What have we done to capture the value of cluster policy

7. What happened in Catalonia with
the cluster work from 2005 to
2014?
14 inputs list in the Balance
document

8. Cluster Policy Anual Evaluation tool: objectives
 Assess the performance of clústers belonging to Catalonia Clusters
Program
 Assess the work with clústers developped from Accio and Update
productes and programs
 Assess clusters impact on companie’s strategy and competitiveness
 Compare cluster firm’s preformance to non cluster firm’s performance
through a control group
Developped in an internal workshop

9. Cluster Policy Anual Evaluation tool : 2 questionnaires
Cluster
Managers
questionnaire
29 questions
Firms
questionnaire:
17questions
1 2

10. Cluster Policy Anual Evaluation tool :
Questionnaire’s structure
Descriptive data
Structure and funding
Projects and activities
Visibility
(...)
Impact, perception and results data
Strategic change
Satisfaction
New business opportunities
New companyies or agents
Value of clustering on firm relations and competitiveness (...)

11. Online Anual Evaluation tool for Cluster Managers
Example of
quantitative
qüestions in
the platform

12. Online Anual Evaluation tool for firms
Example of
qualitative
qüestions in
the platform

13. CM level: Already launched. Expected
report on the 1st week of june
Firm level: will be launched on june 2016
Results expected on setembre 2016
We don’t have results yet

14. Focusing to challenges:
How to capture the benefit of clustering? And what to capture?
Benefits of great trust and
collaboration
Process of change: How this
happened Final
outcome.
The effect

15. Challenges encountered. New inputs for evaluation
1. The human element: difficulties to evaluate
it. Will never be possible to quantify all its
effects but it is relevant to accept its
existance
2. The macro impact approach: New
perspectives of competitiveness

16. Challenges: 1. The Human Element

17. Challenges: 1. The Human Element

18. The Human element
Possibilities to capture it?
Engagements
Linkages
Interaction
Collaboration
Trust
Cooperation
Bridge-Building
Building relationships
Challenges: 1. The Human Element
Qualitative qüestions + Not linking one specific cause to a consequence

19. Interview with
strategic reflection
Networking events
Strategic
immersion
Strategic
change of
a company
Launching
of a new
product of
a company
Export
collaboration
between two
companies
Project
between
two
companies
Increase in
the
company
profits
Study
presentation
A cluster, a system
Not everything can be quantified with numbers: The intangibles.
Challenges: 1. The Human Element

20. Clusters are ecosystems that allow larger
velocity in tacit knowledge flow
Networking with
all the value
chain
Strategic,
competitiveness
trends
dissemination
Larger results
dissemination
Collaborative
projects
Big possibilities
to find partners
Companies are not self suficient, their exit is affected by environment
structures around them: systemic approach
Challenges: 1. The Human Element

21. Challenges: 2. The Macro Impact approach
Indicators about cluster impact at other levels?
Source: own
1.Wider impact
2. Beyond GDP indicator: social + ecological aspects
Well-being: New paradigm

22. GDP
Social
Environmental
Beyond GDP
Well-
Being
Possibilities to measure the cluster impact on new dimensions of competitiveness
Towards a Well-being evaluation
Source: Own elaboration
Challenges: 2. The Macro Impact approach

23. Challenges: 2. The Macro Impact approach
Possibilities to measure the cluster impact on new dimensions of competitiveness
Source: Christian Ketels: “Competitiveness and Clusters: Implications for a New European Growth Strategy”, Working paper, 89 UE, february 2015
What is the role of clusters in the new orientation of growth and competitiveness?

24. Challenges: 2. The Macro Impact approach
Possibilities to measure the cluster impact on new dimensions of competitiveness
Source: Christian Ketels: “Competitiveness and Clusters: Implications for a New European Growth Strategy”, Working paper, 89 UE, february 2015
Need to offer new products and services that meet these emerging needs

25. Which is the impact of the use of clusters and the practices of cluster-
based economic development on the transition for the New Growth
path?
In which ways the “beyond GDP objectives” are being integrated into
the corrent practice of cluster-based economic development efforts?
Which would be the key factors) (Systemic changes, collaborative efforts
by private-public groups, etc.)
Use of cluster-based economic development tools as instrument to
achieve “beyond-GDP objectives”.
Possibilities to measure the cluster impact on new dimensions of competitiveness
Challenges: 2. The Macro Impact approach

26. Thanks for your attention!
Marta Marsé Vidri
mmarse@gencat.cat