Gabriel Rissola: "Measuring the impact of eInclusion actors"


Published on

Telecentre-Europe Summit 2011 - Plenary session 3: "Impact assessment: European digital inclusion"

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Gabriel Rissola: "Measuring the impact of eInclusion actors"

    1. 1. Measuring the impact of eInclusion actors on Digital Literacy, Skills and Inclusion goals of the DAE Gabriel Rissola, JRC-IPTS Information Society Unit Joint Research Centre (JRC) Institute for Prospective Technological Studies The European Commission’s Research-Based Policy Support Organization
    2. 2. <ul><li>Background: </li></ul><ul><li>DAE Pillar 6 implementation needs the contribution of eInclusion intermediaries </li></ul><ul><li>eInclusion actors need evidence of their socio-economic impact </li></ul><ul><li>There is a lack of systematic IA practice in the field </li></ul><ul><li>Stakeholders are aware, motivated and engagement starts </li></ul><ul><li>A number of related studies were recently sponsored by DG INFSO </li></ul>Pre-proposal (April 2011)
    3. 3. <ul><li>Aims: </li></ul><ul><li>Know better who those intermediaries are, their missions/profiles, beneficiary groups and specific eInclusion role (digital inclusion and/or ICT-enhanced socio-economic inclusion) </li></ul><ul><li>Build an appropriate measurement framework (indicators and IA methods) that allows to systematically collect end-users longitudinal micro-data through grassroots orgs. and aggregate it at EC level as to produce valid evidence for policy making </li></ul>Pre-proposal (April 2011)
    4. 4. <ul><li>Purpose: </li></ul><ul><li>Together with stakeholders (e.g. Telecentre Europe) </li></ul><ul><li>develop a practical Impact Assessment framework </li></ul><ul><li>develop the necessary Guidelines and Tools </li></ul><ul><li>deploy the necessary infrastructure , skills and organisational arrangements to measure the impact of eInclusion actors on Digital Literacy, skills and inclusion, at EU level </li></ul>Pre-proposal (April 2011)
    5. 5. Impact Assessment <ul><li>This project is aimed to provide the EC with a powerful IA tool that assesses the socio-economic changes that can be attributed to eInclusion intermediaries interventions </li></ul><ul><li>>> It look for the changes in outcome that are directly attributable to an intervention, so requires comparison between what actually happened and what would have happened in the absence of the intervention ( Counterfactual analysis ) </li></ul><ul><li>>> It pursues questions like: “How would outcomes such as participants’ employment status have changed if the intervention had not been undertaken?” </li></ul>
    6. 6. Building blocks +  Telecentre role in community Explanations and theories Economic Participation Social Capital & Inclusion Theories Indicators Available data In-depth cases analysis (one by main typology) Common std. methodology Selection of Indicators Methodology Development Validation & refining Guidelines and tools Deployment Methods used by stakeholders to measure impact Inventory and typologies of stakeholders
    7. 7. Preparatory work (4Q/2011) <ul><li>1. Intermediaries </li></ul><ul><ul><li>Exploratory Study on explanations and theories of how Telecentres and other community based eInclusion actors operate and have an impact on digital and social inclusion policy goals </li></ul></ul><ul><ul><ul><li>Outcomes expected for March 2012 </li></ul></ul></ul><ul><ul><li>Exploratory Study on methods used to measure the ICT-mediated social impact of Grassroots organisations </li></ul></ul><ul><ul><ul><li>Outcomes expected for February 2012 </li></ul></ul></ul><ul><ul><li>Inventory survey (census of Telecentre-Europe community) </li></ul></ul><ul><ul><ul><li>Joint voluntary effort by TE, Univ of Washington and IPTS </li></ul></ul></ul><ul><ul><ul><li>Online survey to be announced in TE Summit (Oct’11) </li></ul></ul></ul>
    8. 8. Preparatory work (4Q/2011) <ul><li>2. eInclusion: theory and explanations review </li></ul><ul><ul><li>Focus on two main axes: </li></ul></ul><ul><ul><li>Economic Participation </li></ul></ul><ul><ul><ul><li>ICT4EMPL: Literature Review on Employability, Inclusion and ICT </li></ul></ul></ul><ul><ul><ul><li>* O utcomes expected for April 2012 </li></ul></ul></ul><ul><ul><li>Social Capital </li></ul></ul><ul><ul><ul><li>Theory & indicators review on Social Capital/Inclusion and ICT </li></ul></ul></ul><ul><ul><ul><li>* New study to be launched soon </li></ul></ul></ul><ul><ul><ul><li>* O utcomes expected for May 2012 </li></ul></ul></ul>
    9. 9. Step 1: AA 2012-2013 <ul><li>EU eInclusion ecosystem: intermediaries map </li></ul><ul><ul><li>Scope: representative sample </li></ul></ul><ul><ul><li>Inventory survey (v2?) can be the data gathering tool (extended outside TE to other umbrella orgs/networks, e.g. Global libraries) </li></ul></ul><ul><li>Consultation process with Stakeholders on the objectives of the IA exercise </li></ul><ul><li>Indicators & available </li></ul><ul><ul><li>Digital Competences indicators (INFSO/C.4) </li></ul></ul><ul><ul><li>Economic participation: </li></ul></ul><ul><ul><ul><li>P olicy and indicators review </li></ul></ul></ul><ul><ul><ul><li>EUROSTAT and other EU-wide available statistics </li></ul></ul></ul><ul><ul><li>Social Capital/Inclusion: policy review and selection of Indicators </li></ul></ul><ul><ul><ul><li>P olicy and indicators review </li></ul></ul></ul><ul><ul><ul><li>EUROSTAT and other EU-wide available statistics </li></ul></ul></ul>
    10. 10. Step 1: AA 2012-2013 <ul><li>4. Three in-depth IA case studies </li></ul><ul><li>5. Development of standard IA method </li></ul><ul><ul><li>The results of data aggregation and elaboration needs to be politically relevant </li></ul></ul><ul><ul><li>The standard method selected/developed needs to be easily implementable by grassroot organisations, as well as scientifically solid/sound </li></ul></ul><ul><ul><li>Gathered data must be comparable to available statistics for selected Indicators (to guarantee feasibility of Counterfactual analysis) </li></ul></ul><ul><ul><ul><li>This limits the analysis by target groups to available socio-demographic variables (e.g. low educated and unemployed citizens aged 16-24) </li></ul></ul></ul><ul><ul><ul><li>More granular analysis by target groups (e.g. YAR living in marginal areas) requires triangulation with other methods and local data sources </li></ul></ul></ul>
    11. 11. Step 1: AA 2012-2013 <ul><li>6. Methodology validation and refining </li></ul><ul><ul><li>Methodology Framework validation with experts and practitioners </li></ul></ul><ul><ul><li>Testing in 3 different real settings (e.g. a telecentre network, a library network and a social service provider using ICT) </li></ul></ul><ul><ul><li>Refining of methodology </li></ul></ul>
    12. 12. Further Steps <ul><li>Step 2: IA Guidelines and tools > In or out of AA? </li></ul><ul><ul><li>Protocols for data collection and elaboration </li></ul></ul><ul><ul><li>Software tool(s) development </li></ul></ul><ul><ul><li>Guidelines for practitioners </li></ul></ul><ul><ul><li>Training for practitioners </li></ul></ul><ul><ul><li>Data quality assurance </li></ul></ul><ul><li>Step 3: Deployment through the CIP programme </li></ul><ul><ul><li>Pilot test the implementation tools in 3 networks </li></ul></ul><ul><ul><li>Carry-out IA data collection and analysis at 100 (?) centres across Europe in a gradual implementation process. </li></ul></ul><ul><ul><li>3) Integrate the analysis results of (1) into an aggregated European level analysis. </li></ul></ul><ul><ul><li>4) Set up the basis for a sustainable action to assure a longitudinal analysis of social and digital intermediaries contribution to the DAE goals in Europe </li></ul></ul>
    13. 13. Thank you [email_address]