Observation Research Method  Group Project  Leslie Lopez Penelope Pereboom Sam Sirichoke
Definition Observation is studying and gathering information on an activity: what happens, what your object of study does or how it behaves.  Observation is visual: can be seen firsthand or recorded for later viewing.
Types of Observational Research  Observation  without  intervention  Naturalistic Observation:  Researchers unobtrusively observe behaviors in their natural setting by: Desensitization - the researcher gradually moves closer to the participantion Habituation  - the researcher appears in the setting numerous times until his or her presence no longer appears to effect the participants' behavior.
Types of Observational Research Observation  with  Intervention Participant observation:  researcher is active participant in one of two ways: undisguised participant studies disguised participant studies
Types of Observational Research Observation  with  Intervention Structured observation:  researcher intervenes in order to cause an event to occur or to set up a situation so that events can be more easily recorded than they would be without intervention
Types of Observational Research Observation  with  Intervention Field experiments:  controlled studies that occur in a natural setting which can provide a greater external validity than is obtained in laboratory experiments.
Types of Qualitative Observational Research  Ethnography   Narrative Inquiry  Short Term Observation  Ethnomethodology  Grounded Theory  Phenomenology   Kinesics
Types of Data Collected Qualitative - Narrative records Quantitative - Checklist ( check off behavior that is assigned a number)
Techniques for Data Collection  Sampling Techniques: Time Sampling Event Sampling Situation Sampling
Interpreting  the Data  Descriptive requires no inference making on the part of the researcher. You write down what you see. Inferential Requires researcher to make inferences about what is observed and the underlying emotion Evaluative requires researcher to make an inference and a judgment about the behavior
Pros and Cons Cons Most observational studies are correlation studies Observational studies have two primary sources of "confounds" Influence of the observer on behavior Biased observation Time consuming  Pros Suitable for sensitive social issues which people might not feel comfortable answer questions about Great way to start the research
Why it is useful for  Educational Technology  Adds depth of knowledge about individual and group interactions rather than just looking out the outcomes.   Focuses on the  PROCESS OUTCOME.   This is critical for  educational  rather than the technology. Used in Instructional Design, in small group evaluation, and field trial evaluation to find some errors in a prototype or invention.
Observation Method Example #1 A school-based project in five kindergartens:  the case of teacher development and school development Yuen Ling Li School of Early Childhood Education, Hong Kong Institute of Education
Background Basis: Kindergarten teachers were not putting child-initiated learning theory into practice. Needs of the children not the major consideration of their classroom practice.
The Project 60 Teachers engaged in collaborative investigation of school curriculum and pedagogical innovations. Goal:  to determine merits of peer coaching, mentoring, and collaborative teamwork.
Methodology Classroom observations  Semi-structured interviews  Teaching records videotaped teaching episodes feedback
Triangulation Application and combination of several research methodologies in the study of the same phenomenon.  Benefit:  reduces chance of biases. Use a variety of collected data, observers theories, methodologies or any combination of varieties
Triangulation Example Variety of Data: 60 teachers, different settings, time Variety of Methodology Observations Semi-structured Interviews
What was observed Classrooms were observed before the project commenced and again after the teachers participated in a collaborative project with their peers
What was observed? Teachers were asked to participate in a project where they were to collaboratively produce teaching videos Formed teams and selected themes (art, music, math, etc.) Taped classroom teaching for a month and chose best episodes to share
How and where? Teachers were taped As they participated in sharing sessions where they observed each other’s teaching videos and gave each other feedback In their classroom twice during the data collection period of 2 years In evaluation meetings  During interviews
Excerpt from ECLC Website Learning and Teaching Observation Facilities The ECLC is equipped with video-taking facilities for non-intrusive observation and analysis of children's activities. These facilities allow staff to improve children's learning, and demonstrate learning and teaching approaches to visitors, parents and student teachers.  Support the Professional Development of Early Childhood Teachers The ECLC provides field experience opportunities for pre-service and in-service student teachers that support their professional development through class observations, attachments, supervised teaching practice and internships.
Observation Method Example #2 Ethnomethodology/ Conversation Analysis   Mazur, J. M. (2004). Conversation analysis for educational technologists: Theoretical and methodological issues for researching the structures, processes, and meaning of on-line talk. In D. Jonassen (Ed.), Handbook of Research for Educational Communications & Technologies (pp. 1138-1178). Mahwah, NJ: Lawrence Erlbaum.
Ethnomethodology  …the empirical study of methods that individuals use to give sense to and to accomplish their daily actions: communicating, making decisions, and reasoning
Discourse Analysis  "A discourse analysis moves beyond this ordinary sense of language use and includes additional elements of interest -who uses the language, how, why, and when." 1074
Written Discourse "Written discourse is multimodal (semiotic landscape). Chat rooms, threaded discussions and instant messaging have created a new hybrid language or written speech with evolving semiotics." 1075
Elements to consider in  Discourse Analysis  Context Gender Ethnicity Culture
Elements to consider in  Discourse Analysis Social Discourse Analysis : discourse encompassed by social institutions, roles and practices. Critical Discourse Analysis : explicit articulation of the political or social posture of the analyst as he/she engages in the process of understanding talk or text.  "the critical discourse analyst argues for moral-social dimension in research and works to make public findings regarding how discourse can oppress, silence, dominate, or prejudice." 1077
Elements to consider in  Discourse Analysis Select a sequence of a transcript - arbitrarily or purposefully Characterize the sequence Consider Rights, Obligations, and Expectations Constituted in the Talk (inferences or assumptions)
Ethical Considerations Public On-Line Forum - maintain ethical posture Public forums (no passwords) do not require informed consent
Case Study of  Conversation Analysis  Obtain required permissions to observe or participate in on-line forum Compile record of on-line chat Prepare the transcript Read the transcript Define sample specimen Analyze specimen with CA elements Conceptualize the CA Theoretically
Observation Method Example #3 Production in a Fifth Grade Classroom Composing Across Multiple Media:  A Case Study of Digital Video
The Purpose Quantitative case study of two students' composing processes as they developed a documentary video about the Dominican Republic - How did the students use digital video production in connection with other media as part of their overall composing process? What various resources did they draw from digital video and the other media? How were these resources interwoven?
The Observer Researcher posed as a co-instructor Visited the two-hour class once or twice a week over 7 months  Spoke to the students and instructor occasionally Encouraged the students sometimes
The Data Gathered qualitative data in several forms including descriptive and analytic field notes Wrote down conversations between students and described their on going processes Gathered copies of students' notes and  screen shots while they are planning, searching for info, and editing video.
Activity
Bibliography  Brown, L., Observational Field Research, retrieved April 3, 2008 from  http://www. socialresearchmethods . net/tutorial/Brown/lauratp . htm http://www2.uiah.fi/projekti/metodi/162.ht Colorado State University Writing Guides: Conducting Observational Research  http://writing.colostate.edu/guides/research/observe/ Hong Kong Institute of Education  http://www.ied.edu.hk/ Hong Kong Institute of Education Early Childhood Learning Center  http://www. ied . edu . hk/sece/eclc/e/centre . htm Mazur, J. M. (2004). Conversation analysis for educational technologists: Theoretical and  methodological issues for researching the structures, processes, and meaning of on-line talk. In D. Jonassen (Ed.), Handbook of Research for Educational Communications & Technologies (pp. 1138-1178). Mahwah, NJ: Lawrence Erlbaum. li, Yuen Ling (2004). A school-based project in five kindergartens: the case of teacher development and school development. International Journal of Early Years Education, 12 (2), 143-155. Retrieved April 1, 2008, from  http://www.informaworld.com/10.1080/0966976042000225534 Ranker, Jason (2008).Composing across multiple media: a case study of digital video production in a fifth grade classroom.  Written Communication. 25 , 196-234

Research

  • 1.
    Observation Research Method Group Project Leslie Lopez Penelope Pereboom Sam Sirichoke
  • 2.
    Definition Observation isstudying and gathering information on an activity: what happens, what your object of study does or how it behaves. Observation is visual: can be seen firsthand or recorded for later viewing.
  • 3.
    Types of ObservationalResearch Observation without intervention Naturalistic Observation: Researchers unobtrusively observe behaviors in their natural setting by: Desensitization - the researcher gradually moves closer to the participantion Habituation - the researcher appears in the setting numerous times until his or her presence no longer appears to effect the participants' behavior.
  • 4.
    Types of ObservationalResearch Observation with Intervention Participant observation: researcher is active participant in one of two ways: undisguised participant studies disguised participant studies
  • 5.
    Types of ObservationalResearch Observation with Intervention Structured observation: researcher intervenes in order to cause an event to occur or to set up a situation so that events can be more easily recorded than they would be without intervention
  • 6.
    Types of ObservationalResearch Observation with Intervention Field experiments: controlled studies that occur in a natural setting which can provide a greater external validity than is obtained in laboratory experiments.
  • 7.
    Types of QualitativeObservational Research Ethnography Narrative Inquiry Short Term Observation Ethnomethodology Grounded Theory Phenomenology Kinesics
  • 8.
    Types of DataCollected Qualitative - Narrative records Quantitative - Checklist ( check off behavior that is assigned a number)
  • 9.
    Techniques for DataCollection Sampling Techniques: Time Sampling Event Sampling Situation Sampling
  • 10.
    Interpreting theData Descriptive requires no inference making on the part of the researcher. You write down what you see. Inferential Requires researcher to make inferences about what is observed and the underlying emotion Evaluative requires researcher to make an inference and a judgment about the behavior
  • 11.
    Pros and ConsCons Most observational studies are correlation studies Observational studies have two primary sources of "confounds" Influence of the observer on behavior Biased observation Time consuming Pros Suitable for sensitive social issues which people might not feel comfortable answer questions about Great way to start the research
  • 12.
    Why it isuseful for Educational Technology Adds depth of knowledge about individual and group interactions rather than just looking out the outcomes.  Focuses on the PROCESS OUTCOME.   This is critical for educational rather than the technology. Used in Instructional Design, in small group evaluation, and field trial evaluation to find some errors in a prototype or invention.
  • 13.
    Observation Method Example#1 A school-based project in five kindergartens: the case of teacher development and school development Yuen Ling Li School of Early Childhood Education, Hong Kong Institute of Education
  • 14.
    Background Basis: Kindergartenteachers were not putting child-initiated learning theory into practice. Needs of the children not the major consideration of their classroom practice.
  • 15.
    The Project 60Teachers engaged in collaborative investigation of school curriculum and pedagogical innovations. Goal: to determine merits of peer coaching, mentoring, and collaborative teamwork.
  • 16.
    Methodology Classroom observations Semi-structured interviews Teaching records videotaped teaching episodes feedback
  • 17.
    Triangulation Application andcombination of several research methodologies in the study of the same phenomenon. Benefit: reduces chance of biases. Use a variety of collected data, observers theories, methodologies or any combination of varieties
  • 18.
    Triangulation Example Varietyof Data: 60 teachers, different settings, time Variety of Methodology Observations Semi-structured Interviews
  • 19.
    What was observedClassrooms were observed before the project commenced and again after the teachers participated in a collaborative project with their peers
  • 20.
    What was observed?Teachers were asked to participate in a project where they were to collaboratively produce teaching videos Formed teams and selected themes (art, music, math, etc.) Taped classroom teaching for a month and chose best episodes to share
  • 21.
    How and where?Teachers were taped As they participated in sharing sessions where they observed each other’s teaching videos and gave each other feedback In their classroom twice during the data collection period of 2 years In evaluation meetings During interviews
  • 22.
    Excerpt from ECLCWebsite Learning and Teaching Observation Facilities The ECLC is equipped with video-taking facilities for non-intrusive observation and analysis of children's activities. These facilities allow staff to improve children's learning, and demonstrate learning and teaching approaches to visitors, parents and student teachers. Support the Professional Development of Early Childhood Teachers The ECLC provides field experience opportunities for pre-service and in-service student teachers that support their professional development through class observations, attachments, supervised teaching practice and internships.
  • 23.
    Observation Method Example#2 Ethnomethodology/ Conversation Analysis Mazur, J. M. (2004). Conversation analysis for educational technologists: Theoretical and methodological issues for researching the structures, processes, and meaning of on-line talk. In D. Jonassen (Ed.), Handbook of Research for Educational Communications & Technologies (pp. 1138-1178). Mahwah, NJ: Lawrence Erlbaum.
  • 24.
    Ethnomethodology …theempirical study of methods that individuals use to give sense to and to accomplish their daily actions: communicating, making decisions, and reasoning
  • 25.
    Discourse Analysis "A discourse analysis moves beyond this ordinary sense of language use and includes additional elements of interest -who uses the language, how, why, and when." 1074
  • 26.
    Written Discourse "Writtendiscourse is multimodal (semiotic landscape). Chat rooms, threaded discussions and instant messaging have created a new hybrid language or written speech with evolving semiotics." 1075
  • 27.
    Elements to considerin Discourse Analysis Context Gender Ethnicity Culture
  • 28.
    Elements to considerin Discourse Analysis Social Discourse Analysis : discourse encompassed by social institutions, roles and practices. Critical Discourse Analysis : explicit articulation of the political or social posture of the analyst as he/she engages in the process of understanding talk or text.  "the critical discourse analyst argues for moral-social dimension in research and works to make public findings regarding how discourse can oppress, silence, dominate, or prejudice." 1077
  • 29.
    Elements to considerin Discourse Analysis Select a sequence of a transcript - arbitrarily or purposefully Characterize the sequence Consider Rights, Obligations, and Expectations Constituted in the Talk (inferences or assumptions)
  • 30.
    Ethical Considerations PublicOn-Line Forum - maintain ethical posture Public forums (no passwords) do not require informed consent
  • 31.
    Case Study of Conversation Analysis Obtain required permissions to observe or participate in on-line forum Compile record of on-line chat Prepare the transcript Read the transcript Define sample specimen Analyze specimen with CA elements Conceptualize the CA Theoretically
  • 32.
    Observation Method Example#3 Production in a Fifth Grade Classroom Composing Across Multiple Media: A Case Study of Digital Video
  • 33.
    The Purpose Quantitativecase study of two students' composing processes as they developed a documentary video about the Dominican Republic - How did the students use digital video production in connection with other media as part of their overall composing process? What various resources did they draw from digital video and the other media? How were these resources interwoven?
  • 34.
    The Observer Researcherposed as a co-instructor Visited the two-hour class once or twice a week over 7 months Spoke to the students and instructor occasionally Encouraged the students sometimes
  • 35.
    The Data Gatheredqualitative data in several forms including descriptive and analytic field notes Wrote down conversations between students and described their on going processes Gathered copies of students' notes and  screen shots while they are planning, searching for info, and editing video.
  • 36.
  • 37.
    Bibliography Brown,L., Observational Field Research, retrieved April 3, 2008 from http://www. socialresearchmethods . net/tutorial/Brown/lauratp . htm http://www2.uiah.fi/projekti/metodi/162.ht Colorado State University Writing Guides: Conducting Observational Research http://writing.colostate.edu/guides/research/observe/ Hong Kong Institute of Education http://www.ied.edu.hk/ Hong Kong Institute of Education Early Childhood Learning Center http://www. ied . edu . hk/sece/eclc/e/centre . htm Mazur, J. M. (2004). Conversation analysis for educational technologists: Theoretical and methodological issues for researching the structures, processes, and meaning of on-line talk. In D. Jonassen (Ed.), Handbook of Research for Educational Communications & Technologies (pp. 1138-1178). Mahwah, NJ: Lawrence Erlbaum. li, Yuen Ling (2004). A school-based project in five kindergartens: the case of teacher development and school development. International Journal of Early Years Education, 12 (2), 143-155. Retrieved April 1, 2008, from http://www.informaworld.com/10.1080/0966976042000225534 Ranker, Jason (2008).Composing across multiple media: a case study of digital video production in a fifth grade classroom. Written Communication. 25 , 196-234