The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
9.11.11 final tools for learning data gathering
1. Jim Dine, 1962, MoMa Tools for Learning Module 2 Data Gathering Paula Nottingham 9/11/11
2. Jim Dine, 1973,MoMa Inquiry Tools Observations Surveys Interviews Focus Groups
3. Observations Observations can be a rich source of information of a behavioural nature - observation grids can be devised in order to examine the number of times that behaviour occurs or to record specific responses or interventions. http://www.ehow.co.uk/
4. Observations The observation method involves the researcher in watching, recording and analysing events of interest. the events may be recorded, either at the time or later by the researcher the observations may be structured in terms of a predetermined framework or may be relatively open. The observer may also be a participant in the events being studied… this participant observation can be recorded in your journal.
5. Observations Data is often both qualitative (how and why) and quantitative (how much and when). You can prepare a ‘coding framework’ or grid that ensures data is collected within agreed boundaries of subjectivity-objectivity. You can practice developing your analytical skills by observing meetings (or similar events) in the workplace (Bell, 2005), or audiovisual documentaries of events. Interactions with interviewees are noted in the analysis – describe how you carried out the observation. This would include gaining insight into any inherent conflicts from the duality of the insider-researcher perspective.
6. Analysing Observations The data is gathered and displayed as descriptions, quotes, diagrams to show relationships, quantitative charts/displays to show quantitative data, audio, audio-visual, and photographic evidence, etc. Your observations record what has happened sensitively and appropriately to issues of ethics, permission and confidentiality. You need to report an understanding of the context for the event or meeting that was observed in order to draw conclusions from the data.
7. Surveys news.bbc.co.uk The main advantage of the survey approach is the ability to gather data from wide range of representative respondents. The national census and large-scale MORI polls are good examples of the survey approach at its most effective.
8. Surveys Surveys are usually associated with the idea of asking groups of people questions about who they are or what they ‘think’. The subjects being investigated by the researcher can in fact be about a range of issues, events and activities. Surveys can be both quantitative (counting up the responses and giving percentages of the responses) and qualitative (leaving space for participants to make comments). A survey entirely based on one questionnaire might be limited in terms of the depth of inquiry that can be undertaken, but it could make up for this in terms of the breadth or range of results achieved. To achieve generalisable results, the researcher can survey a representative sample of the population of interest. Selection of sufficient numbers of people to target in the population of interest can be developed using a sampling frame that helps ensure that there are sufficient numbers i n categories or variables of specific interest.
9.
10. Analysing the data The framework for data analysis of replies determined in advance. Coding your questionnaire: There are five steps involved in the coding process (Survey Monkey can export this data): 1. Develop the coding frame for both pre-coded (closed) and open questions. 2. Create a codebook and coding instructions. 3. Code the questionnaires. 4. Transfer the values to a computer (as in an Excel spreadsheet). 5. Check and clean the data (you can make simple graphs with the data). Interpretation involves identifying significant results, trends, patterns, similarities and differences and offering an explanation for them. This can be expressed in the form of numbers or words in your findings…
11. (Image courtesy of beewebhead on Flickr obtained from MIT open access website) Interviews
12. Interview- what is it? It is a qualitative method where you collect what people say (from your sample) in order to use it as evidence. Its advantage is that you “can follow up on ideas, probe responses and investigate motives and feelings” (Bell, 2005, p.157). You can ask the why questions… It is an occasion to gather information ‘for the record’, with a specific agenda set out by the researcher, it is not just a conversation (Denscombe,2007). When it is processed, the evidence from the interview will provide data for your research.
13. Sampling – choosing who to interview There are a number of different ways to design a sampling frame and this will depend on your approach and access. Match your methods to your research problem and work-based learning project. Purposive - choosing people who can answer the questions using defined criteria like expertise or their being in certain roles within the workplace (qualitative) Representative - selection of the sample population (quantitative and mixed - i.e. the interviews might follow a survey) more ‘scientific’ - using a version of probability or non-probability sampling
14.
15.
16.
17.
18.
19. Doing the interview Be punctual and have all handouts ready (Consent form, questionnaires, etc.). Arrange the surroundings, i.e. the seating and recording devices, so that the participant is comfortable. It is important that the participant is supported in the process and that you also engage with them in a professional manner BUT that you come away from the interview with the evidence that you need for your inquiry
20.
21.
22. Analysing interviews The analysis of data collected from interviews can be complex. It has been collected within a certain context or a variety of different ones and must be analysed with that in mind. Care must be taken that comments are not lifted or quoted outside the context or out of sequence. Quotes can be selected because they typify the data (common responses) or there might be some statements that are significant though only said once (significant). Data can also be put into categories that you choose or those that the participants have indicated as common practice.
23. Analysing interviews The qualitative researcher can categorise (code) data that has emerged into themes, and the data may include the researchers own ideas, impressions and interpretations that are observed. The data is organised so that comparisons, contrasts and evaluations can be made with the aim of finding the meaning of the evidence presented. Content analysis can also looks at how often words and phrases are used to explain meaning by a systematic review of the data that could be subjected to statistical significance testing, e.g. categorising the positive and negative statements in a transcript of the interview or related documents (like government policy papers).
24. Focus Groups Your choice of setting, public or private, depends on the situation.
25. Focus Groups Focus groups are similar to group interviews but they have a different dynamics because of the interaction between the participants. “ Focus groups are more likely to include members who either have similar characteristics or experience… or are known to have a professional concern about and knowledge of the issues involved.” (Bell, 2005, p. 162).
26. Focus Groups Focus groups can also be hard to manage so the role of the moderator or facilitator (yourself) is an important one to make sure to provide the ‘trigger’ topic or questions and to channel the discussion to elicit the data needed for the research (Denscombe, 2007, p. 179). With focus groups you may want to have everyone identify themselves first so that you can identify their voice - these are more difficult to transcribe.
27. Focus Groups - the setting Researcher Gatekeeper Recording devices Actual seating arrangement for a recent focus group in which Paula took part.
28.
29. Troubleshooting Cancelled appointments - situations change in the workplace - so you must plan for changes and contingencies (Plan A, Plan B). Getting people to send you documents if they do not have them to hand. Working with children and parents’ permission Working with people you know at work Getting the details for additional participants for the research project - non-probability snowballing or signposting… With focus groups you may want to have everyone identify themselves first so that you can identify their voice - these are more difficult to transcribe.
