This document summarizes the process and outcomes of the 5th Wave of applications to join the European Network of Living Labs (ENoLL). It describes the evaluation process involving 6 teams that reviewed 77 eligible proposals. The teams used a scoring system to evaluate applications based on 20 criteria. As a result, 62 Living Labs were selected to join ENoLL, including 48 from EU countries and 14 non-EU members. The document provides details on the application process, evaluation methodology, results, and next steps for new ENoLL members.

1. 5th
Wave
Launch
Ceremony
The
5th
Wave
Process
and
Outcomes
Jesse
Marsh
5wave
Coordinator
Budapest,
16
May,
2011
The
5th
Wave
Process
and
Outcomes
1

2. ENoLL
Waves:
Terms
of
Reference
• Openness
– Opportunity
for
all
potenBal
Living
Labs
• Transparency
– Clear
rules,
criteria
and
processes
• Fairness
– ObjecBvity,
avoiding
conflict
of
interest
20/05/11
2
Budapest,
16
May,
2011
The
5th
Wave
Process
and
Outcomes
2
2

3. ENoLL
Waves
1-­‐4
250
200
150
100
Non-­‐EU
EU
50
0
2006
2007
2008
2009
20/05/11
3
Budapest,
16
May,
2011
The
5th
Wave
Process
and
Outcomes
3
3

4. New
for
the
5°
Wave
• ENoLL
as
an
legal
enBty
• AdministraBon
fee
for
new
members
• Pre-­‐registraBon
• Info
on
themaBc
domains
• Public
status
of
successful
applicaBon
forms
20/05/11
4
Budapest,
16
May,
2011
The
5th
Wave
Process
and
Outcomes
4
4

5. 5wave
applicaBons
• 122
pre-­‐registraBons
• 80
proposals
submiXed
• 77
eligible
proposals
20/05/11
5
Budapest,
16
May,
2011
The
5th
Wave
Process
and
Outcomes
5
5

6. EvaluaBon
teams
• 6
evaluaBon
teams
of
3
members
each
– All
ENoLL
members
– Team
members
from
different
countries
– Team
leaders
with
previous
experience
• 12-­‐13
proposals
per
team
– 3
readers
minimum
for
each
proposal
– None
from
same
country
• X-­‐Team
cross-­‐evaluaBons
– 1
common
and
1
specific
from
each
team
20/05/11
6
Budapest,
16
May,
2011
The
5th
Wave
Process
and
Outcomes
6
6

7. EvaluaBon
scoring
• Scores
of
0-­‐5
for
each
of
the
20
criteria
• Aggregated
averages
for
each
of
the
5
groups
– OrganisaBon,
openness,
resources,
users
and
reality,
value
• Total
score
of
aggregate
values
• Scores
averaged
for
each
team
• Thresholds
for
both
group
and
total
scores
20/05/11
7
Budapest,
16
May,
2011
The
5th
Wave
Process
and
Outcomes
7
7

8. EvaluaBon
phases
1. Individual
evaluators
read
and
score
2. Teams
reach
consensus
and
submit
3. All
results
compiled,
thresholds
adjusted
4. Team
results
compared
with
each
other
and
X-­‐Team
scores
5. Teams
revise
scoring
for
overall
coherence
6. Final
results
compiled,
consensus
reached
7. Results
sent
to
ENoLL
Council
for
approval
20/05/11
8
Budapest,
16
May,
2011
The
5th
Wave
Process
and
Outcomes
8
8

9. Typical
weaknesses
• Where
are
the
users?
Weak
involvement
in
co-­‐design,
lack
of
methodology
• Project,
not
innovaBon
ecosystem
• Excessive
technology
push
/
insufficient
ICT
• Weak,
closed,
or
limited
partnerships,
lack
of
commitment
and/or
resources
• Future
plans,
liXle
experience
• Lack
of
focus,
limited
value
and
impact
20/05/11
9
Budapest,
16
May,
2011
The
5th
Wave
Process
and
Outcomes
9
9

10. Results
• 62
Living
Labs
selected
• 48
EU
members,
from
12
countries
• 14
Non-­‐EU
members
(23%),
from
6
countries
20/05/11
10
Budapest,
16
May,
2011
The
5th
Wave
Process
and
Outcomes
10
10

11. Country
distribuBon
20/05/11
11
Budapest,
16
May,
2011
The
5th
Wave
Process
and
Outcomes
11
11

12. ThemaBc
domains
New
topics
Security
Industrial
&
logisBcs
Sustainable
Mobility
Regional
&
rural
Tourism
&
Culture
Media,
Content,
Web
2.0
e-­‐Gov
&
e-­‐ParBcipaBon
Social
InnovaBon
&
Inclusion
Smart
CiBes,
FI,
IoT
Wellbeing
&
Health
Energy
&
Climate
Change
0
5
10
15
20
25
Requests to join ENoLL thematic domain networks from 70% of applications
20/05/11
12
Budapest,
16
May,
2011
The
5th
Wave
Process
and
Outcomes
12
12

13. ENoLL
today
20/05/11
13
Budapest,
16
May,
2011
The
5th
Wave
Process
and
Outcomes
13
13

14. Welcome
to
ENoLL!
• Compile
and
send
your
info
leaflet
• Register
with
the
ENoLL
site
• Choose
your
membership
profile
• Express
your
interest
in
a
Working
Group
• Join
one
or
more
ThemaBc
Domain
Networks
and...
• Stay
around
for
the
group
photo!
20/05/11
14
Budapest,
16
May,
2011
The
5th
Wave
Process
and
Outcomes
14
14

15. Thank
you
for
your
aXenBon
• Jesse
Marsh,
5°
wave
coordinator
• Álvaro
Oliveira
and
Mikael
Börjeson,
Task
Force
core
group
• Pieter
Balloon
and
Anna
Kivilehto,
secretarial
support
• The
ENoLL
evaluaBon
team
...and
our
thanks
all
proposers
and
the
Corvinno
team
info@enoll.org
20/05/11
15
Budapest,
16
May,
2011
The
5th
Wave
Process
and
Outcomes
15
15