This document discusses measuring innovative public procurement (IPP). It outlines user interests in IPP data and indicators, previous efforts to measure IPP in Spain, and a proposed methodology for an IPP scoreboard. The methodology would collect input data on IPP funding and personnel from ministries and output data on resulting firms, products, jobs and publications. Next steps are to create a template to collect this data and validate the indicators.

1. Expert Workshop on the Measurement of
Public Procurement of Innovation
“What are the user interests behind
requests for data and indicators on PPI?
Can these requirements be clearly
identified and delivered? ”
Laura Hernández Garvayo – Metrics Department
February 4th, 2013
OECD, Paris
‹Nº›

2. TABLE OF CONTENTS
1. USER INTERESTS FOR DATA AND INDICATORS
2. PREVIOUS EXPERIENCE IN MEASURING INNOVATIVE PUBLIC PROCUREMENT:
THE E2I 2010 ACTION PLAN
2.1 TEMPLATE FOR PROCUREMENT OF GOODS AND SERVICES DATA
3. PROPOSED METHODOLOGY FOR AN INNOVATIVE PUBLIC PROCUREMENT SCOREBOARD
4. NEXT STEPS
‹Nº›

3. ICONO is FECYT's Observatory of R&I Indicators
• provides objective data about R&I indicators and their
evolution
• analyses science, technology and innovation policies and
strategies.
• publishes reports regarding R&I
For whom?
Public administration R&D
Research agents S&T
Private industry
Media and Press
Society
The aim of ICONO is to be a reference from the point of view of
the measurement of science and innovation
The observatory is on the scene of any relevant activity related to
science, technology and innovation indicators:
1) national and international forums: European Commission, OECD, RICYT
2) agreements with institutions: INE, Cotec, SCImago, IVIE-ÁBACO
3) workshops, events and conferences
‹Nº›

4. 1. User interests for data and indicators
WHY
• “In God we trust, all others must bring data”
Edwards Deming
WHAT
• Public Understanding of Science Survey, Fecyt 2012
HOW
• Budget, Programmes and Staff
• Job creation, firms, products and services
‹Nº›

5. Over 80% of Spanish think public investment in science and innovation should
Public Understanding of Science Survey, Fecyt 2012
Near 60% of the population think firms do not invest enough in science and
increase.
innovation
Yes
81,6% 21,5%
No
59,4%
82,8% NC
1,0%
82,3% Doesn t know
18,1%
80,9%
Q13. Should public administration invest in science and innovation? Q.15. Do firms invest enough in Science and innovaton?
‹Nº›
5

6. 2. Previous experience in measuring IPP: the e2i 2010
Action Plan
• Monitoring the National Innovation Strategy (e2i): FECYT developed a data collection
methodology targeted for all ministerial actions within the scope of the 2010 Action
Plan.
• In order to meet the established objectives, FECYT carried out the following actions:
1. Identification of public authorities responsible of the innovation Strategy Action Plan 2010.
2. Drafting two templates for data collection:
o calls for tenders
o procurement of goods and services.
The actions of the e2i 2010 Action Plan collected using the template for procurement of
goods and services can be understood as a first approach to an Innovative Public
Procurement Scoreboard.
‹Nº›

7. 2.1 Template for procurement of goods and services data
Performance Indicators Impact Indicators
Number of beneficiary
Jobs
Approved Executed Total of companies Companies
Axis Action Name Number of Number of
budget budget beneficiary Total of Number of
Chapter tenders allocations beneficiary Other
(total) (total) entities beneficiary R&D&i companies
SME activities
companies involved
Policies for Technology and Innovation Strategy for Defence 6 135.378,38 137.961,24 237 71 347 170 40 676 2.387 210
innovation in
Defence Technology and Innovation Strategy for Defence 6 54.477,76 52.571,38 3.109 162 154 64 53 125 13
Incorporation of innovation in internationalisation support
policy – Support to the internationalisation of innovative
6 1.117,00 860,50 79 30 30 30 30
companies. Support Plan for Business Projects involving
International Innovation Dissemination.
Incorporation of innovation in internationalisation support
policy – Support to the internationalisation of innovative
6 407,00 313,00 12 11 11 11 11
companies. Support Plan for Business Projects involving
Design Internationalisation
Measures for the Incorporation of innovation in internationalisation support
international policy – Internationalisation plan for the Biotechnology 6 116,00 90,00 1 1 19 18 18
development of sector.
global innovative Incorporation of internationalisation support policy –
companies international support policy for innovative companies. 6 137,00 106,00 1 1 1
Internationalisation Plan for the Nanotechnology sector
Incorporation of innovation in internationalisation support
policy – Support to the internationalisation of innovative
6 244,00 188,00 1 1 21 20 20
companies. Internationalisation Plan for Technological
Centres
Incorporation of innovation in internationalisation support
policy – Support to the internationalisation of innovative 6 103,00 80,00 1 1 25 24 24
companies. Internationalisation Plan for the Design sector
continues
‹Nº›

8. 2.1 Template for procurement of goods and services data
Performance Indicators Impact Indicators
Number of beneficiary
Jobs Companies
Axis Action Name Approved Executed Total of companies
Number of Number of
budget budget beneficiary Total of Number of
Chapter tenders allocations
(total) (total) entities beneficiary beneficiary R&D&i Other companies
SME activities
companies involved
Web page of Spanish cultures 6 4.776,60 4.776,60 1 1 11 26 11
Development of Database digitalisation of the Ministry of Culture 6 138,00 3 1 1 1 5 1
i-Government Strategic Plan for the Modernisation of the Justice Sector 6 573.216,01 573.216,01 20 20 20 900 20
Innovation projects for State Security Forces 6 4.500,00 4.500,00
6 2.820,00 1.095,00
Development of Meteorological Support Services for Air Navigation 2 2.980,00 2.948,00
28 6 6 6 6
the Green
Economy Regionalised Climate Scenarios 6 63,80 63,80 1 1 1 1 2 1
Policy for Rural Affairs Innovation
rd
Development of MetOp European satellite programme 3 mission (MTG) 7 1.226,00 1.226,00
the Science 2 165,00 92,00
Industry Air Quality Plan 6 3 3 3 3
6 1.794,00 1.410,00
Local Innovation
State Fund for Employment and Sustainability 7 916.739,77 916.739,77 7.650 7.644 4.962 4.962 62.779 4.962
Support Plan
Health Information System of the National Health System 6 3.000,00 3.000,00 30
Development of Clinical information interoperability 6 2.000,00 1.677,50 15
Health and Social
Care Economy INGESA Actions 6 639,00 639,00 26 15 15 15 6 12
National Health System Organ Donation and Transplant 6 220,48 220,48
TOTAL 1.706.258,8 1.703.774,28 11.156 7.969 665 5.345 5.158 1.714 65.249 5.227
SCOPE
15 Ministries and their managerial departments
133 programs and actions
15 responsible delegates Data collection by collaboration
‹Nº›

9. 3. Proposed Innovative Public Procurement Scoreboard
• An innovative public procurement scoreboard: input and output indicators (ongoing)
-this data is being collected from State Procurement Platform
• Indicators and sources for the scoreboard
INPUT OUTPUT
1.Total and percentage of Public Administrations 1. Total number of firms dedicated to IPP
Expenditure on IPP:
1.1. National (and regional) level 2. Number of products/services resulting from IPP.
1.2. Ministries and their managerial departments
3. Turnover due to IPP of companies with IPP contracts.
2. Programmes financing IPP:
2.1. Number of programmes 4. Number of new created positions linked to IPP.
2.2. Amount financed by each programme
5. Number of patents linked to IPP.
3. Total number of IPP dedicated Personnel:
3.1. Public sector 6. Number of scientific publications linked to IPP
3.2. Private sector
Source: State Procurement Platform and Template (
‹Nº›

10. 4. Nexts Steps
• Drafting a template for public authorities bidders responsible of Innovative
Public Procurement contracts. It implies identification of:
o ministries and their managerial departments,
o programs and actions
o responsible delegates
• Defining procedure for validation of main indicators (state procurement
platform)
‹Nº›

11. On the web: www.icono.fecyt.es
Follow Fecyt on Facebook and Twitter: Follow Icono on Twitter
www.facebook.com/fecyt.ciencia @ICONO_FECYT
@FECYT_Ciencia
ICONO, Spanish Research and Innovation Observatory:icono@fecyt.es
Email:
Laura Hernández Garvayo: laura.hernandez@fecyt.es
Thank you!
‹Nº›