Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Evaluation Sustainability


Published on

Evaluation Sustainability presentation at the 2nd annual LLiSA conference

  • Be the first to comment

  • Be the first to like this

Evaluation Sustainability

  1. 1. 1
  2. 2. 2
  3. 3. Evaluation, Sustainability, Quality Management in Relation to the Context and SituationLessons learned from: ▶ Active and Healthy Ageing in EU ▶ Lessons learned in Japan, Taiwan and China ▶ Laurea LivingLabs – Unit of Excellence: FAO/UN initiative ▶ European Network of LivingLabs – criteria & PPPP initiative3/1/2011 Laurea University of Applied Sciences 3
  4. 4. EUROPEAN COMMISSIONDIRECTORATE GENERAL FOR RESEARCH & INNOVATIONDirectorate C - Research and InnovationUnit C.1 – Innovation Policy Platform Breaking Down Barriers Between Key Players at Regional Level Laurea LivingLabs Network with the Helsinki - Uusimaa region as an open innovation ecosystem based on human centric RDI European Innovation Partnerships – meeting societal challenges and reinforcing competitiveness Simulation Seminar for ERAC regarding the pilot "Active and Healthy Ageing” Ways of identifying and tackling obstacles to Innovation Tuija Hirvikoski, PhD Director| Laurea University of Applied Sciences| Internationalisation of RDI | ENoLL council member and co-ordinator of the thematic domains | Sendai- Finland Wellbeing Centre steering group member | | | | || | 22nd of February, 2011 Berlaymont building, room Schuman, 200 rue de la Loi, Brussels
  5. 5. New Collaborative Innovation Paradigm, Why?• due to the multi-layered, • apart from new multidisciplinary, multi- technologies and sector, multi-stakeholder products, we also need complexities new production and• we need to improve the effectiveness and impact of consumptions that will policies, programmes and renew local and global projects services, markets and industries and we want to effect human behaviour3/1/2011 Laurea University of Applied Sciences 5
  6. 6. New Collaborative Innovation Paradigm How? LivingLabs = enlarged Triple Helix model & open Research, Development and Innovation (RDI) infrastructures and methodologies Learning and Co-Innovating for Development local, regional and cross- boarder collaboration addressing the grand challenges Hirvikoski (2009)3/1/2011 Laurea University of Applied Sciences 6
  7. 7. Lessons learned from EU Active and Healthy ageingwanted because of• system level thinking, • fragmentation of the market /non-existing holistic and systemic market solutions • overlapping RDI• capacity to orchestrate • need to boost the and scale the transformation of the innovation up from the professionals‟, clients‟ and local level to the citizens‟ behaviour national/system level • to boost societal innovation3/1/2011 Laurea University of Applied Sciences 7
  8. 8. Lessons Learned in Japan,China and Taiwan• Sendai-Finland • Cultivating Talent and Wellbeing Centre Transformation of the • from push marketing Innovation Ecosystem towards open RDI across of Taiwan Finnish &Japanese • high tech stakeholders • people driven (Biking• Active Ageing in and social media in a Shanghai Hakka community) • systemic, holistic • integrating tradition and solution across 16 high tech (Dharma Finnish companies and Drum) Chinese authorities3/1/2011 Laurea University of Applied Sciences 8
  9. 9. Kanter (1988) Innovation is most likely inorganizations that (a) have integrative structures, (b) emphasize diversity, (c) have multiple structural linkages inside and outside the organization, (d) have intersecting territories, (e) have collective pride and faith in people‟s talent, and (f) emphasize collaboration and teamwork.
  10. 10. Type of, radicalism of and maturity of innovation, e.g. TH2009
  11. 11. Laurea with multiple Centre ofExcellence awardsin the Helsinki Metropolitan Area Cultivating Smart Living Talents in Higher Education International Forum on Smart Living Summer School Initiatives in Asia Tuija Hirvikoski, PhD, Laurea University of Applied Sciences European Network of Living Labs, co-coordinator of the thematic domain January 14, 2011 Taipei, Taiwan
  12. 12. Smart Living/Cities Challenges and Solutions in the rapidly changing world1. What is needed for smart living in smart cities?2. What kind of an innovation process are we taking about?3. Abilities and skills needed? (Professionals and students)4. Challenges for higher education (and other stakeholders....)5. The future in the world without bordersJanuary 14, 2011, Taipei , Taiwan International Forum on Smart Living Summer School Initiatives in Asia Tuija Hirvikoski 12
  13. 13. About the Smart City Solutions based on Industrial University collaboration See the Helsinki Smart City Showcase and Laurea University of Applied Sciences 13
  14. 14. The current status and the future trend on smart living educationENoLL, European Network of LivingLabs▶▶▶▶ Learning by Developing (LbD) model with the best employment rate.FINHEEC: “the model can set an example for the whole Finland”▶ The Finnish Higher Education Evaluation Council University of Applied Sciences International Advisory Board▶ _Research_Fellows/index.jspand compared to what was learned from the colleagues in ITRI (i236), III,and The Talent Cultivation Program for Smart Living Industry• INSIGHT Suan-Lien Elderly Centre (Prof. Lin and Prof. Kang) – Care home LL• Touch Centre (Prof. Jeng and Prof. Yang) Showroom & future learning environment LL• Eco-City (Prof. Lin) Biking and social media supporting economical, social and cultural development in rural areaJanuary 14, 2011, Taipei , Taiwan International Forum on Smart Living Summer School Initiatives in Asia Tuija Hirvikoski 14
  15. 15. Harvesting Results |Virtual Elderly Care Services | A Guardian Angel for the Extended Home Environment | DiYSE | CaringTV | Clinic Art & Encounter Art | Active Aging |Express to Connect (E2C) | Polar heart rate monitoring devises | Helsinki Metropolitan Entrepreneurship Academy | Radiology and Laboratory Service System | Senior Trainer | Konkkaronkka | Sendai-Finland Wellbeing Centre | Nordic Walking in Japan | 250 new companies in social service and healthcare sector
  16. 16. Laurea’s Operating Environment• the Greater Helsinki Metropolitan Area produces approximately 50% of Finland‟s gross domestic product• Uusimaa region consists of urban and rural areas • The social and health care sector is strongly influenced by demographic changes and struggling with the challenge of ensuring equal services for rural and urban areas with limited budgetary conditions. The ageing population, long distances and the possible lack of qualified work force are common challenges in particularly in the archipelago• In its operating environment, Laurea is specializing in service innovations and focusing on regional development of the metropolitan area Helsinki Smart City Showcase 163/1/2011 Laurea University of Applied Sciences
  17. 17. Laurea’s LivingLabs Network and the partners in the Uusimaa Region Medical and Care Strategic Intent 2015: Simulation Centre In 2015 Laurea will be an internationally Hospital Area User Driven Innovation acknowledged Hyri and TechVilla Centre university of applied sciences specializing in future expertise and regional development in the Service Innovation and Design Lab metropolitan area. Care Innovation and Design Hub The focus of the LivingLabs is on welfare, Otaniemi Uusimaa Regional knowledge intensive business services, security Marketing Council and social responsibility. The basis for Laurea’sCulminatum HUS, THL R&D&I is a holistic view of well-being which Active Life Village CKIR /Aalto provides sustainable direction for businesses and Forum Virium for the development of entire service systems 3/1/2011 Laurea University of Applied Sciences 17
  18. 18. Learning by Developing (LbD) with an open RDI Ecosystem = Laurea LivingLabsInstitutional Strategic Business Execution Design Personal enviroment environment environment professional development enviroment environment meanings orchestration table Political Enablers Utilizer Developer guidelines New Technologies, products, services, User New production and consumption spin-offs, User behavior transformation renewal of markets, industries and societies
  19. 19. LbD = student-centric research and development work integrated into learning• LbD is a system of learning and human development that mobilizes and harnesses human creative talent en masse. It is a learning system that integrates education with research, development and innovation operations (RDI); consequently, it fuels our collective creativity. In addition, it provides each student the tools to develop and utilize his or her creative talents fully in order to generate a livelihood for him or herself and to foster productivity for society as a whole• arking_evaluation_audit/centre_of_excellence_evaluation_2009.jspLa January 14, 2011, Taipei , Taiwan International Forum on Smart Living Summer School Initiatives in Asia Tuija Hirvikoski 19
  20. 20. Learning by Developing – a Unique Way to Study• The working life oriented learning method Learning by Developing is a pedagogical innovation developed by Laurea.• The LbD -projects are conducted in partnership with the world of industry and commerce, which means that authentic workplace issues are selected as subjects of studying.• For students LbD is a new way to get the competence needed in working life: they grow from learners into experts with excellent employment opportunities within their specific fields.3/1/2011 Laurea University of Applied Sciences 20
  21. 21. Feedback on Laurea Centre of Excellence (FINHEEC)• The students„ participation in R&D has been raised to a new level, so that they are now the main activating forces in the process• supported by Laureas management and it is purposefully developed throughout the organisation• a vision-based management model - incentivising for staff - communities of experts based on the interests of the parties involved• a regional operator and partner in the metropolitan area - in continuous interaction with the environment• many of the articles and conference presentations have involved students• Laurea has determined the core competences included in all of its degree programmes, taken into account the context of each degree in curriculum development, and improved competence evaluation procedures3/1/2011 21
  22. 22. Feedback on Centre of Excellence• Laurea has defined its core competence in relation to the operating environments competence needs in terms of areas of focus, from which it has also derived the core competences for each degree programme• The Learning by Developing core process strives to bring together employers and the workplace, employment-related research and development, and learning. Student-centric R&D is the connecting link between Laureas three main tasks, when the students projects are aimed at developing employment in the local region.• In feedback, students especially mentioned the possibility of doing the right tasks in projects, and the appropriateness of their studies. Another strength that was mentioned was the improvement of team work and interaction skills, although imbalances in the degree of participation appear to be a challenge for teachers to tackle in the active student community and the commitment- demanding study model.• One of the particular strengths of R&D activities at Laurea University of Applied Sciences is the role of students as central actors and takers of responsibility. 3/1/2011 22
  23. 23. Feedback on Centre of Excellence• Despite the strong emphasis on R&D, theory and practice are well balanced in the education. Student-centric R&D is particularly well suited to universities of applied sciences, and Laurea can set an example for the whole of Finland.• The generally high level of results indicates that student-centric R&D is a good choice for pedagogy• Laurea produces the highest number of ECTS credits from R&D. In addition, the students participation in publication, project preparation and even project management activities proves that they are central actors in Laureas R&D operations.• Other strengths are Laureas open interaction with its operating environment, its agility in responding to the needs of the environment, and the apparent functionality of its management model. 3/1/2011 23
  24. 24. Shared leadership based on interaction Leaders and professors provide Crewmembers (staff and students) • an empowering vision and • participate into the interactive meaningful storylines leaderships e.g. by forecasting, • support and trust those with ideas proposing, carrying the and an entrepreneurial anxiety and responsibilities capabilities to make the ideas to • are curious about opportunities and work in reality search for solutions • create platforms and trust based • empower their peers and leaders opportunities for collaboration and co-creation True transformations evolve organically: new innovations emerge, newsystems of technology and infrastructure are put in place, and new patterns of living and working gradually take shape and begin to remake the economic January 14, 2011, International Forum on Smart Living Summer Taipei , Taiwan School Initiatives in Asia landscape. Tuija Hirvikoski 24
  25. 25. New Collaborative Innovation Paradigm, How? Cross-boarder collaborationIn the world without boarders, the diversity of cultures, technologies and business models nurtures innovation and learning New opportunities emerge whilst ideas, knowledge and innovation travel from country to country
  26. 26. New Collaborative Innovation Paradigm. How? European Network of Living Labs (ENoLL) was founded in 2006 under the auspices of the Finnish EU- presidency• contributes to the creation of a dynamic, multi-layered and multidimensional, future European innovation ecosystem• supports co-creative, human-centric and user-driven research, Hirvikoski (2009) development and innovation in order to better cater for people‟s needs All current 212 Living Labs listed on Laurea University of Applied Sciences 26
  27. 27. Average growth of turnover in Danish firms, 2005-2007(Source: Fora & Statistics Denmark, 2010)
  28. 28. New Collaborative Innovation Paradigm How? The long term vision on Public- Europe as a dynamic, multi-layered and Private-People Partnerships (PPPP) multi-dimensional European Innovation for user-driven open innovation includes: Ecosystem• Living Labs as Open Access Platforms for Smart Cities and Regions• Alliances with Local Authorities to integrate Living Lab Innovation and Sustainability Policies• Cross-border and Cross-Thematic Cooperation addressing the grand challenges of our time• Large-scale User Behaviour Transformation through Social and Societal Innovation 3/1/2011 Laurea University of Applied Sciences 28
  29. 29. European UnionLiving Lab Partnerships City- and Regional Governments Social Networks Citizens GroupsInternational OrganizationsFAO, UN, World Bank, OECDInternational Partnershipswith Living Labs in other Regions Universities Research Institutions SMEs ICT Industries
  30. 30. The ENoLL 5th Wave of Membership Jesse Marsh 5wave Coordinator3/1/2011 Laurea University of Applied Sciences 30
  31. 31. ENoLL: a Legal Entity A non-profit association established under Belgian law – AISBL General Assembly of Effective Members Elected Council of max 21 Members President, Vice-Presidents, Treasurers, Secretary elected by the Council Thematic Domain Networks, Working Groups, etc. open to participation by all members 29.02.2011 LLiSA 01-03-2011 31Ghent, 14 December 2010 The ENoLL 5th Wave of Membership 31
  32. 32. Membership in ENoLL Adherent members ▶ Living Labs having passed an Wave evaluation Effective members ▶ Adherent members having paid a membership fee Associate members ▶ Non-LLs (eg University, public authority, etc.) paying the membership fee An administration services fee may be introduced as of 2011 29.02.2011 LLiSA 01-03-2011 32Ghent, 14 December 2010 The ENoLL 5th Wave of Membership 32
  33. 33. Pre-registration Send an email to stating ▶ Organisation name ▶ Web address ▶ Applicant country ▶ Contact person details You will receive a unique registration number and the official Membership Application Form 29.02.2011 LLiSA 01-03-2011 33Ghent, 14 December 2010 The ENoLL 5th Wave of Membership 33
  34. 34. Evaluation process Evaluation teams constituted from ENoLL members and LLs 3 members per team from different countries Proposals divided by team excluding represented countries Team Leaders collaborate to ensure common criteria X-Team cross-evaluates to ensure coherence 29.02.2011 LLiSA 01-03-2011 34Ghent, 14 December 2010 The ENoLL 5th Wave of Membership 34
  35. 35. Submission Max 8 pages, max 1 Mb pdf, no annexes Send to Deadline: 15 March 2011, 24:00 hours CET Submission constitutes: ▶ Expression of interest to join ENoLL AISBL ▶ Permission to ENoLL to hold data for evaluation purposes ▶ Permission to ENoLL to make information public unless otherwise notified by 15 March 2011 29.02.2011 LLiSA 01-03-2011 35Ghent, 14 December 2010 The ENoLL 5th Wave of Membership 35
  36. 36. Application Form Basic facts Membership motivation Description and characteristics Organisation Openness Resources Users and Reality Value Direction and Plans for the Future 01-03-2011 29.02.2011 LLiSA 36Ghent, 14 December 2010 The ENoLL 5th Wave of Membership 36
  37. 37. Evaluation Criteria Proposals are then evaluated against 20 criteria grouped into 5 categories ▶ Organisation ▶ Openness ▶ Resources ▶ Users & Reality ▶ Value No targets, no quotas: proposals evaluated strictly on merit 29.02.2011 LLiSA 01-03-2011 37Ghent, 14 December 2010 The ENoLL 5th Wave of Membership 37
  38. 38. Enoll- Evaluation Criteria• Evidence of co-created values from research, development and innovation• Values/Services offered/provided to LL actors• Measures to involve users• Reality of usage contexts, where the LL runs its operations• User-centricity within the entire service process
  39. 39. Enoll- Evaluation CriteriaFull product lifecycle support - capability & maturityLL covers several entities within value-chain(s)Quality of user-driven innovation methods and toolsAvailability of required technology and/or testbeds Evidence of expertise gained from the LivingLab operations Commitment to open processesIPR principles supporting capability and openness
  40. 40. Enoll- Evaluation Criteria• Openness towards new partners & investors• Business-citizens-government partnership –strength & maturity• Organization of LL governance, management & operations• Business model for LL sustainability• Interest and capacity to be active in EU Innovation system• International networking experience and capability• Channels (web etc) supporting public visibility and interaction• People/Positions dedicated to LL management& operations
  41. 41. Selection and announcement Evaluation results submitted to ENoLL Council for validation and final decisions Candidates informed of evaluation results at least 30 days prior to official announcement Launch event scheduled 16 May in Budapest under the auspices of the Hungarian Presidency 29.02.2011 LLiSA 01-03-2011 41Ghent, 14 December 2010 The ENoLL 5th Wave of Membership 41
  42. 42. Summary Pre-register via email to obtain the registration number and Application Form Submit the completed application by 15 March 2011 Complex yet transparent and accountable evaluation process taking over one month Official launch of successful new members at Hungarian Presidency event in Budapest 01-03-2011 29.02.2011 LLiSA 42Ghent, 14 December 2010 The ENoLL 5th Wave of Membership 42
  43. 43. For further information ENoLL Portal at ▶ In-depth description of ENoLL: organisation, working groups, membership, etc. ▶ Info and FAQ section on 5° Wave call ▶ For ENoLL members, access to dissemination kit to promote the 5° wave ▶ For everyone, subscription to the ENoLL newsletter for the latest updates 29.02.2011 LLiSA 01-03-2011 43Ghent, 14 December 2010 The ENoLL 5th Wave of Membership 43
  44. 44. Thank you for your attention Jesse Marsh, 5° wave coordinator Álvaro Oliveira and Mikael Börjeson, Task Force core group Pieter Balloon and Anna Kivilehto, secretarial support The ENoLL evaluation team 29.02.2011 LLiSA 01-03-2011 44Ghent, 14 December 2010 The ENoLL 5th Wave of Membership 44
  45. 45. PROPOSED PRINCIPAL PROCESSfor the evaluators - Reviewers download all (~18) applications assigned to his/hers team from web (see above) - Review team first checks the eligibility criteria for each application. - Each reviewer reads and grades their applications (each appl graded by three reviewers). - It is recommended to use the review result template (principals from Jesse) in 4WB sheet "Grade" - The team compiles results from all three reviewers and fill in the result in sheet "Appl" - The entire workbook with filled in EligCriteria and Grades (5 Cat/appl) is sent to me by 23 Feb. - Please "channel" remarks/questions to me via your team leader.
  46. 46. Apollon - Homecare and Independent Living Experiences of SMEs▶ Evaluates the different services in another country – forces to re-think the initial business case▶ Provides a “lessons learned” in transferring or setting-up cross border Homecare and Independent products – better value proposition and better product fit▶ provides opportunity to discuss the Health care eco-system in another country to identity different needs and to explore new business opportunities▶ provides insights into the requirements and operational issues related to transferring products to other markets outside the base marketInnovating, Televic
  47. 47. Connecting the Dots of Excellence across European and Asian Aging Societies Elderly Welfare Promotion Group, National Taiwan University INSIGHT Suan-Lien Living Lab Innovations of Long-Term Care Services for the Elderly in Chuncheon, Hallym University, Korea
  48. 48. Connecting the Dots of Excellence across European and Asian Aging Societies Comparative research City/region level Northern East Asian civic analysis European societal model scaling up the results welfare model to the system level => new products, services and solutions to be scaled up from the micro level to the system level and to the global market What is the role of the citizens, users, and people ? How does the public, private, people partnership evolve? LivingLabs/Testbeds role?
  49. 49. Pre-Commercial Procurement Good Practice Procure R&D in steps (solutions, prototypes, test series) to reduce the risk and give SMEs a chance Risk-benefit sharing with Suppliers Competing development with multiple Suppliers Sharing R&D costs with other Procurers
  50. 50. PPPP for Active and Healthy Aging – evaluation of inputs, process, results, impacts Action Through a Policy Mix Improving Co-ordination of Key Players Europe as a dynamic, multi-layered and multi-dimensional Innovation Ecosystem: impacts3/1/2011 Laurea University of Applied Sciences 50
  51. 51. Lessons Learned - Action Through a Policy Mix- enabling health and social care policy, educational policy, industrial and innovation policy (management by vision, evaluation and incentives) integration of education and RDI to foster motivated professionals integration of bottom-up (demand and human driven, self-organising) and top-down (scalable, transferable solutions) approaches parallel incremental development and systemic paradigm sift of active and healthy aging (care systems, health behaviour, societal innovation etc.) enhancing innovation in pre-commercial public purchasing processes & sustainable urban innovations through multidisciplinary R&D cooperation (as The Innovative City® Program) simultaneous innovative procurement and support for growth companies => business expansion, generates new job opportunities3/1/2011 Laurea University of Applied Sciences 51
  52. 52. Lessons Learned - Improving the Coordination ofKey Players by PPPP• enabling structures and platforms (LivingLabs) to address the multi-stakeholder, multi-layer, multi-disciplinary, multi- sector complexities => effectiveness and impact of policies• proactive platform activators => trust, coherent value bases, good collaboration among stakeholders => strategic agility• empower the elderly, citizens, care professionals and students => innovative solutions & diffusion of innovation• connect the dots of excellence across European and Asian aging societies
  53. 53. Scaling up the PPPP model: Europe as a dynamic,multi-layered and multi-dimensional InnovationEcosystem - Consequences - involves creative and motivated professionals and citizens to the development of Active and Healthy Ageing solutions and the transformation of behaviour - creates innovative solutions from the micro to the most macro level of the Active and Healthy Ageing systems - decreases innovation obstacles - boosts Europe as a lead market of Active and Healthy Aging - boosts new spin-offs and supports growth companies - gives companies an opportunity to grow in the emerging Asian (global) markets - generates meaningful new jobs3/1/2011 Laurea University of Applied Sciences 53
  54. 54. Thank you Image TuijaJanuary 14, 2011, Taipei , Taiwan International Forum on Smart Living Summer School Initiatives in Asia Tuija Hirvikoski 54