Prototype 2.5 Evaluation: Interview Outline This a broad outline of the types of questions that will be asked during the structured interviews. It is not intended to be exhaustive, as the actual questions asked will depend on how the interviews flow, so this section is intended to act as a basic checklist and to give an idea of the types of questions we will ask. Introduction and warm-‐up Duration: 3 minutes User login required: NO Necessary: YES • WeGov approach: Connecting politics with citizens on social networking sites (SNS) • Toolbox design: Landing page with widgets and search page with more details Information and dissemination behaviour on SNS Duration: 5 minutes User login required: NO Necessary: NICE-‐TO-‐HAVE • Before you started engaging with SNS, what were the trusted means of communication and information, via which you reached out to your citizen base? • What were the features you liked most about these more traditional means and what were the features you felt were lacking in functionality? Elaborate. • How highly would you rate (on a scale of 1-‐5) the following as a matter of priority for you in communication with your citizen-‐base: o Transparency o Trust o Provenance o Targeted networking – relevance o Impact
WeGov toolbox in general Duration: 5-‐10 minutes User login required: YES Necessary: YES • How do you find the current suite of functionalities being offered by the WeGov tool set, in addressing the above priorities? • What single feature or set of features do you trust most in the current iteration, with regard to the quality of information being retrieved by the WeGov tool set? o Is there any benefit for your everyday life? o Yes: What are the benefits and why are they beneficial? What is the benefit used for? Can WeGov replace some processes that happen manually so far? Do you save time whit the WeGov toolbox? o No: Why? What other functionality would you want to see addressed by WeGov instead? What is your concern about the toolbox? • Can you imagine for whom the toolbox may beneficial? • What single feature or set of features do you find lacking in the current iteration, with regard to the quality of information being retrieved by the WeGov tool set?
Focus on the WeGov toolbox landing page Duration: 3 minutes User login required: YES Necessary: YES • Is the landing page with widgets and functionality clear? • Is it timesaving or time consuming? • What is useful – what not? -‐> What needs to be improved? Focus on the WeGov toolbox search page Duration: 3 minutes User login required: YES Necessary: YES • Are the analysis results useful / trustful? -‐> Is the analysis transparent? • Would you use results within your everyday workflow? • How do the WeGov results relate to your presswork results? (= Monitoring all media – SNS & traditional press -‐ for the topics of the policy) Focus on WeGov toolbox analysis components Duration: 3 minutes User login required: YES Necessary: YES • Is there any use for long-‐term analysis? -‐> What topics? • Is it useful to combine analysis components? • How can the tools support you on Twitter and Facebook? -‐> Best practice… • Which social networks should be included and why? Use cases and best practise Duration: 3 minutes User login required: YES Necessary: YES • Have you tried to find users? • Have you tried the local search?
• Have you tried to find topics within your constituency? Technical future Duration: 5 minutes User login required: BETTER Necessary: NICE-‐TO-‐HAVE • What role do you see social networks playing in future policy making (with specific examples from your everyday work life)? • How does the current WeGov iteration of the toolkit match this vision? What would you suggest needs adding/amendment? • How in your view are social networks challenging the ways in which policy information is being analysed and made sense of by those with access to decision making? In other words, how do you feel (if at all) technical innovations in networked communications, allow for a more trusted / transparent communication between citizens and policy makers? • With the increase in complexity and at times anonymity of social networks today, can policy makers trust the feedback they receive enough to base important policy decisions upon?