Younce action researchproject


Published on

1 Like
  • Be the first to comment

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Younce action researchproject

  1. 1. Improving Student Response Quality Utilizing “Thinking Maps®” -Action Research Final Report- Ann Younce University of Colorado at Denver IT 6720 – Research in Information and Learning Technologies May 2, 2010
  2. 2. Thinking Maps® 2 Abstract This introductory experience into action research focuses on the utilization of “Thinking Maps®” (specialized visual organizational tools for content learning, designed by Thinking Maps, Inc.) to increase student response quality and depth of understanding of complex content. A fifth grade teacher (the researcher) working in a suburban district southeast of Denver, Colorado, was motivated to find out about the effectiveness of “Thinking Maps®” (or TMs) strategies in her science class, and whether the maps could produce a significant change in the quality and depth of responses from her students, many of whom were reluctant to provide more than surface answers and who generally resisted higher level thought. The researcher had never before used the TMs tools, but was inspired by a team member’s inclusion in a school-wide pilot of the “Thinking Map®” program, and observed its use in the neighboring classroom earlier in the year. The researcher believed that these purposeful thinking tools offered the right blend of graphic organizer and critical thinking strategies to increase student engagement and achieve additional scaffolding for differentiated student learning. The guiding question evolved into determining to what extent “Thinking Maps®” (or TMs) are effective tools and strategies to significantly produce a change in the quality and depth of written responses, as well as to build scaffolding techniques, deepen understanding, and increase engagement. The research process included implementing the use of a variety of TMs into the instruction of a new “Human Body” science unit. As the action research progressed over the course of the four-week study, the researcher taught students to use a variety of TMs, applied related key word and questioning strategies, recorded field notes, observed student behaviors and attitudes, collected data in the form of questionnaires and assessments, and monitored changes in the quality of student written responses and the level of engagement with new information. She also pursued peer contributions in the form of discussions and interviews. Throughout the implementation, she began to recognize improved note taking and study patterns among her students, and determined that TMs indeed added a new layer of metacognition for students that led to an increase in performance on science assessments. As a result of this action research, the researcher plans to fully incorporate TMs into her instructional methodology, and to participate in a school-wide “Thinking Map®” cohort next school year to continue with a new phase of action research.
  3. 3. Thinking Maps® 3 Introduction In my current role as a fifth grade teacher in a Denver-area elementary school, I serve an impacted suburban community, represented by the following school profile data: 580 student enrollment (100 of which are in the fifth grade; 24 of which are in my class), with 34% on free-reduced lunch, an 82% stability rate, a 95% attendance rate, and diversity demographics including Native American (0.9%), Asian American (8.7%), African American (16.5%), Hispanic American (17%) and Caucasian (56.9%) populations. The school setting and culture is one of high expectations for best practice and professional learning with a strong base of data-driven practices among faculty and staff. The school utilizes embedded Professional Learning Communities to build capacity while continually seeking and expanding learning experiences. The school’s organizational purpose and motto clearly states: “Learning…Whatever It Takes” and it is an effective philosophy for student achievement as well as professional growth. This foundational message both supports the implementation of research-based solutions and encourages action research among colleagues. Research Statement and Guiding Question As a largely unexplored topic, I planned to focus my action research in the general area of effective instructional strategies that impact all content. I aimed to take a closer look at the use of graphic organizers as metacognitive tools for deepening understanding and promoting higher level thinking. A large number of my students were consistently providing written responses that lacked substance and failed to reach higher levels of thinking. I had many questions about what the appropriate solutions could be and I saw this action research as an opportunity to investigate and attempt a workable remedy. The overall research goal was to try to increase literacy and science achievement (as demonstrated by increased comprehension and improved written response, predominantly with large amounts of new science information) by using “Thinking Maps®” (or TMs) in an effort to close current achievement gaps. This topic involved both an increase of skills for students - the need for independent/automatic skill use to communicate/show their thinking and the ability to apply strategies in cross-curricular ways, as well as their ability to internalize a new learning strategy process -incorporating specific, visual representations and patterns for thinking, utilizing a common language (Hyerle, 1996). My main goal was to incorporate new TMs strategies during a large instructional science unit, utilizing the process of journaling, interviews, disaggregated pre- and post-assessment data, anchor work samples, and similar artifacts. The projected affect of such research was three-fold: specifically, my students could gain improved ability to acquire and retain large amounts of information, making it both meaningful and relevant to them through cross-curricular strategies. The teachers (initially me and my grade level team)
  4. 4. Thinking Maps® 4 could also gain in our ability to differentiate instruction for those who need a more structured approach to internalizing information and communicating higher level thought. Ultimately, my colleagues and the entire school community could benefit from shared information and increased student, instructional and programmatic successes. This was a beneficial challenge because my personal interest in brain-compatible instruction and metacognition served as another impetus for this research. Finally, the research was both timely and relevant due to the fact that sections of my school have been in various stages of the implementation of a new “Thinking Maps®” pilot program and have established a cross-grade level cohort for vertical alignment. As a desired outcome, I hoped for increased understanding and achievement for students, utilizing quick, readily-available scaffolding frames at an independent level in order to successfully accomplish three goals: (1) read/acquire to filter information, consistently identify main idea and provide supporting details, (2) organize to construct meaningful information, secure logical patterns and make emotional connections, and (3) write to demonstrate increased comprehension by showing quality responses, high level thinking and internalized deep understanding. The guiding question for my research continued to evolve and finally emerged with several facets: To what extent are “Thinking Maps®” effective tools and strategies: (1) to significantly produce a change in the quality and depth of written responses, and (2) to build scaffolding techniques, deepen understanding, and increase engagement? Review of Literature It was important for me to select parameters to guide my search for relevant literature as I began the ongoing process of researching “Thinking Maps®” (or TMs). As my topic became more and more narrowed, it naturally diverged into several themes: graphic organizers, engagement, high-order thinking, effective cross-disciplinary instructional strategies, depth/complexity of understanding, and metacognition. I quickly made use of the various online databases such as Google Scholar, and Education Full Text (Wilson’s Web), available from the university’s Auraria Library, to access electronic resources. In addition, I created general Internet searches of familiar professional sites I regularly use, such as ASCD and McRel, in addition to the “Thinking Maps®” website itself, as well as made use of professional texts from my own personal library. A quick search through each of their bibliographies allowed me to identify additional data sources that these other references had used. As I began to search for relevant literature to collect and review, I compiled a list of keyword search terms and tried multiple variations, such as: “thinking maps,” “graphic organizers + deep understanding,” “common visual language,” “non-linguistic representation,” and similar combinations involving maps or organizers used to solidify learning and increase comprehension. At first, it seemed like a treasure hunt as I searched through articles about “Thinking Maps®” (or TMs) and found references to
  5. 5. Thinking Maps® 5 additional articles, studies and names of researchers. In particular, the “Thinking Maps®” website had devoted entire sections to the research conducted in support of their product, including links to the Thinking Foundation and Designs for Thinking websites. These sites contained various research formats including journal articles, case studies, and news articles, and I found excerpts and glimpses of classroom teacher research projects explained throughout the article texts. In order to produce relevant search results of the literature, I instituted various descriptors to serve as lenses or filters through which to pass my reference sources through. These filter criteria included: recently published references, results from actual studies, implementation information, elementary/middle school-preferred ranges, and a science-based focus (for example, brain research in education). These filters helped me to stay organized, categorize my research into subtopic themes, and evaluate potential references. The chart below provides a general overview of the types of collected literature which includes a variety of source formats such as professional journals, professional texts, and relevant websites. (For a complete listing of all literature sources, see References). Figure 1: Sample Literature Collected Texts/Authors Periodicals Websites Other Hyerle New Hampshire Journal of Ed course website Medina Journal of Educational Psych. site cohort Marzano Teaching, Thinking & Creativity Costa Educational Leadership Robinson & Lai The Reading Teacher Jensen Metacognitive Learning Tomlinson I began to collect large amounts of information before I realized that most of it was related to the same researcher (Dr. David Hyerle, the founder of “Thinking Maps®”) and was limited to a specific time frame (late 1980’s and through the 1990s). I quickly became frustrated not being able to find many current (within the last few years) studies or publications that related to my topic. Although I utilized several database searches, I still came up with the same listings, from 10 to 15 years ago. Even though the brain research of the last decade shows links between understanding, non-linguistic representation and achievement (Marzano, Pickering & Pollack, 2001), I was unable to find any more recent studies and immediately wondered why, second-guessing my choice of research. These gaps of somewhat outdated literature, as well as some additional identified problems (such as many articles that applied to ELA or special education needs only) left me disappointed with the small scope of the research and I had to consider some sources to not be as valid and reliable as others. I have since assumed that some of the gaps (especially in Hyerle’s case) may have been due to renewed longitudinal studies since the earlier years of
  6. 6. Thinking Maps® 6 research. Therefore, as far as the scope is concerned, certain literature may not be included because there seems to be very little (as far as research studies) conducted past 2001. Amid the articles and studies that I did happen to find, there were varying degrees of cohesiveness in the findings, and just as many areas of conflict. From the significant researchers, relevant ideas emerged and my beliefs were further derived and substantiated. As for a few key studies or articles of significance to my research, there were some similarities that related directly to my own questions, beginning with the foremost expert in the field, Dr. David Hyerle. Hyerle suggests that after being reinforced over several years (a main difference from my own study) students are able to “transfer multiple maps into each content area, becoming spontaneous in their ability to choose and use maps for whatever content information and concepts they are learning” (Hyerle & Williams, 2009). Although my students had only about four weeks of “intensive” map training, they too could choose from multiple maps. (Although the breakdown here for my students was that they were not always used correctly for the corresponding skill). Like Hyerle’s recent study, some of my students were also able to identify the correct thinking process and select the appropriate map and use the obvious cognition pattern. In a path that diverges from Hyerle’s study, I found that my students would all start with the common language and graphic, yet how they completed the information varied greatly among students. I also found design strategies among the literature that were appealing to me and similar those I chose for my study. Stull and Mayer’s (2007) study, although far more complex than my own, had students in one portion generate their own graphic organizers after being frontloaded in how to generate various types of visual tools, such as hierarchical, lists, flowcharts and matrices. Both their study and my own had the instructor first modeling types of graphic organizers. In contrast however, I found conflicting analyses and conclusions in the Stull and Mayer (2007) piece, where they found that there was little to no evidence that students constructing their own graphic organizers achieved any more than students who received author-provided organizers. Although my students all received the same “blank” organizer, they differed on their responses within. There were many discrepancies in the results of studies and the conclusions of articles as to whether or not the visual patterns (and I interpreted “Thinking Maps®” here) resulted in extraneous processing or generative processing, and the evidence for deeper learning was contradictory. I question here whether this effects “Thinking Maps®” (or TMs) and do all the various types of graphic organizers interfere with a student’s cognitive process as they’re selecting and using the maps – do they use too many versions of graphic organizers and waste time/cognitive processes independently deciphering which is the best tool to use? In addition I found very little from which to model the design of my own research among the articles and studies. Many of the earlier studies had hundreds of participants across multiple schools or districts, whereas I am limited to my own class of 24 students; although I did find a few useable
  7. 7. Thinking Maps® 7 similarities in some of the shared vignettes from classroom to classroom that were mentioned in some of the articles and research studies (Leary, 1999; Hyerle, Curtis & Alpert, 2004). TMs are advanced graphic tools used to secure brain pathways for learning, and metacognitive tools used to increase awareness of cognitive cues and help to deepen student understanding. One other aspect that concerned me (and confused me) was in the contradiction of some of the evidence in some studies (Merkley & Jeffries, 2000/2001; Stull & Mayer, 2007; and Ritchhart, Turner & Hadar, 2009) that showed that general graphic organizers (not mentioning TMs specifically) may or may not increase student comprehension or deepen learning. Following recent brain research, it was stated that vision dominates all other senses in the brain, and the more elaboration, the better the coding and hence better storing and retrieval (Medina, 2008), which seems to make an argument in favor of visual tools like graphic organizers. Although Medina also states that it is through pictures - not through written or spoken words – that the brain makes the most lasting connections, that leads me to wonder why the TMs program doesn’t make mention of incorporating sketches and pictures in place of some words within the various map structures? In summary of the literature, although there definitely were more articles than any recent studies that pertained to my research topic, I feel as though I semi-exhausted my search across the related fields of cognitive science, effective instructional practice, and brain research, and it did allow me to form a more complete research picture, especially as I began to see a saturation of the same researchers mentioned again and again. Some further thoughts or questions that were prompted by my literature review would have to include whether or not my choice of study still represents a valid instructional practice? The methodology and research presented by the TMs website itself seems relevant and robust, yet I am still not clear as to why there is not more current research out there? Perhaps I have stumbled upon a gap in the literature as it seems as though there should be more studies that explore variations of the TMs strategies or, at the very least, further challenge the relevance of this type of tool as it compares with other brain research. Relevant Background Knowledge TMs were designed to integrate content learning with thinking process instruction across disciplines and be utilized as a “common visual language” for learning (Hyerle & Yeager, 2007). Learners are expected to identify 8 fundamental thinking skills and link them to dynamic visual representations to create specific pathways for “thinking about their thinking”. Maps are designed to be used in combination to increase depth and complexity, and as a developmental process, complexity in use increases overtime (Hyerle, Curtis & Alpert, 2004). “Frames of reference” surround each map to provide connections to sources, reflection and ownership. The maps are consistent, integrative, and flexible for various types of
  8. 8. Thinking Maps® 8 implementation. Each map corresponds with a specific thinking process designed to activate and build schema: Figure 2: “Thinking Maps®” and 8 Corresponding Cognitive Skills “Thinking Maps®” Cognitive Skill “circle map” defines in context; presents point of view “bubble map” describes sensory, emotional, logical qualities “double bubble map” compares & contrasts qualities “tree map” shows relationships between main idea & supporting detail “flow map” relates events as a sequence “multi-flow map” indicates cause & effect; helps predict outcomes “brace map” deconstructs physical structures & part-to-whole relationships “bridge map” transfers or forms analogies (See Appendix D for actual map designs) Expository text structure is often difficult to digest for intended meaning, complex concepts, specialized vocabulary and inferred relationships such as cause & effect, compare/contrast, sequences or cycles (McCormick, 1995). TMs enable learners to assess prior knowledge, respond to complex inquiry and, working independently or collaboratively, draw out essential knowledge, identify critical information with supporting details, and make inferences and find connections to the text. TMs have been purposefully organized to align with current brain research to enable movement from concrete to abstract thinking with greater depth and to directly apply thinking to complex tasks. Meaningful context links to emotional and metacognitive “frames of reference” and ownership, addressing essential questions, prior knowledge, primary sources, point of view and other influences. Over the last decade, brain research shows that 80% of all information that comes into the brain is visual (Jensen, 1998) and the visual patterns of TMs help learners create concrete images from abstract thought. The brain is a natural pattern detector and teachers need to provide students with experiences that enable them to perceive patterns and make connections (Caine & Caine, 1991). It has been shown that “explicitly engaging students in the creation of nonlinguistic representations stimulates and increases activity in the brain” (Gerlic & Jausovec, 1999) and unlike earlier forms of concept maps (Novak & Gowin, 1984) and other types of random or ready-made graphic organizers that do not fully suffice, TMs encourage learners to become independent thinkers due to the ownership and connections made in their completion. In further support, the dual-coding theory (Paivio, 1986) states that simultaneous use of pictures and words enhance the brain’s ability to organize information for subsequent retrieval and use. Research proves that the more learners use both linguistic and nonlinguistic representations the better their thinking and recall (Marzano, Pickering & Pollack, 2001). TMs align nicely and integrate into practice with many
  9. 9. Thinking Maps® 9 of Marzano’s 9 strategies most likely to increase achievement, among them: identifying similarities & differences, summarization & note-taking, cooperative learning, cues, questions and advanced organizers. Class time spent using TMs increases engagement with specialized thinking skills, and it is suggested that students should spend 60-80% of class time engaged in “process, discussion, group work, self-assessment, journal writing, feedback, mapping” (Tomlinson & Kalbfleisch, 1998) with such differentiation evident in the strategic components of TMs. Methodology/Research Design: The purpose of the study was to determine the effectiveness of “Thinking Maps®” (or TMs) strategies for use in science instruction, and whether the maps could produce a significant change in the quality and depth of responses from students, many of whom were reluctant to provide more than surface answers and who generally resisted higher level thought. The guiding research question was: To what extent are “Thinking Maps®” effective tools and strategies: (1) to significantly produce a change in the quality and depth of written responses, and (2) to build scaffolding techniques, deepen understanding, and increase engagement? In order to best serve my research into TMs, one small way in which I employed aspects of problem-based methodology in using both qualitative and quantitative research methodology and design traditions, was in exploring some limited use of the “Theory of Action” techniques (Robinson & Lai, 2006) in exploration of constraints, actions and consequences which will be addressed later in this study. I began by asking questions about the assumptions and beliefs I held about my classroom and my concepts of student response quality. Students need a certain type of response to demonstrate understanding and I believe I had been a good judge of the depth of their understanding, asking them to “write/draw it in another way” or to “tell me more” to elicit the best possible response. From here I needed to further investigate what I do in my practice and why I do it when assessing student response quality. The main type of data analysis I employed however, most resembles that of Wolcott’s Three Stages of Analysis (Wolcott, 1994), where different aspects of analysis based on qualitative data collection inform each other to incorporate (1) descriptive data from original notes, questionnaires and pre-/post- test experiences, (2) analyses based on how the descriptive data initially relates to the research question in an exploratory manner, looking for patterns and themes, identifying key factors and relationships, and (3) my interpretations to make sense of findings and the conclusions based on the extent to which they pose meaningful, relevant and compelling answers to the research question. Quantitative data collection appeared in the formulation of results tables to quantify through tallies the number of occurrences of specific written response types, frequency of TMs used, or data points for behaviors.
  10. 10. Thinking Maps® 10 Site Selection I selected my own fifth grade classroom as the site for this study, as I believed this would help me achieve the maximum impact and benefit, thus making the experience as meaningful and personally relevant as possible. The classroom is one of four adjacent fifth grade classes, with 24 students (11 boys and 13 girls) with a demographic composition that closely reflects that of the entire school population (see Abstract). The science lessons take place predominantly in the afternoon block, being the last 45-minute class of the day. The students are situated in table groups of 4 to 5 students per group, and a typical day consists of a quick preview of new material (or a review of the previous day’s lessons), followed by either a group exploration activity or experiment to “kick-off” the inquiry. Time is then usually spent in direct instruction through interactive SmartBoard lessons, class discussion, group reading or data mining, collaborative or independent work production, and finally reflection. Occasionally, due to schedule changes or anticipated interruptions of the instructional time, I would switch (or add) science instruction time into the morning block, with each day usually starting out with a pre-reading activity or TMs preparatory work as part of a morning menu. Role My role was generally that of “facilitator”, where I would introduce content, model and suggest strategies, employ questioning techniques, elicit responses and reflection, and monitor collaboration. My goal for consistency was to develop an instructional routine to closely follow in order to keep the experience familiar and consistent for the students, and to keep an order for me to follow in terms of making observational notations and focusing specifically on student response quality and incidents of engagement. The classroom climate needed to be one where thinking is valued, visible and actively modeled (Ritchhart, Turner & Hadar, 2009). Just prior to the beginning of the first data collection cycle, we held an initial class meeting to discuss the action research project they would be a vital part of – using TMs to improve content learning and assess response quality. I answered any questions or address any concerns they had (and the only “fear” that needed to be alleviated was that they wouldn’t be graded on their questionnaire responses – only on the regular unit quizzes and tests). In describing my relationship with the students, I tried to maintain a positive report and communication style, rigorous expectations, a casual teaching style that incorporated flexible pace as needed and interjecting humor to engage. I utilized a school-wide positive reinforcement behavior management system (“Mountain of Trust” – earning their way “up the mountain” using silent and visual cues employed without a break in instructional momentum) with predictable rewards and consequences. My students were comfortable with me and that climate allowed them to take risks this group endeavor when asked, and at times, independently.
  11. 11. Thinking Maps® 11 Purposeful Sampling Strategies When it came to the selection of individual respondents, I made the decision to sample all 24 of the students in my class. As an intermediate grade level teacher, it was inconceivable to run any sort of “control group” and “variable group” when I’m ethically bound to provide consistent instruction for all. Instead, I would make general comparisons of my class as TM beginners, to other classes with more or less TM training. Although my grouping was a relatively small data set, it was one that was manageable by me. For my interview subjects, I first selected one of my grade level colleagues who was participating in the tandem TMs pilot cohort on site, as well as an instructional coach/trainer who was overseeing the cohort. Additional questions and probes were asked of other team members who were not part of the pilot. The selection of activities to observe included taking anecdotal field notes on random student behaviors, attitudes, engagement, and expressions. I rotated around the classroom listening-in on table collaborations and cooperative learning routines. Other activities included observing TM use during class and for assessments. I was looking for confident and appropriate use of TMs as well as an improvement in overall response quality. As for the selection of documents to analyze, I looked at the use of thinking strategies, TM completion and response quality on student work products such as class and individual TMs, science notebooks, test questions and research questionnaires, and my own field notes. I created a mix of closed questions with a range of pre-determined responses, and open-ended opportunities that were non- threatening and would allow for rich and detailed responses (Ritchhart, Turner & Hadar, 2009). Data Collection Strategies In order to remain consistent with the traditions of the selected research designs, data collection tools were designed purposefully to elicit clear pictures of student thought processes to more accurately determine content knowledge and assess response quality. I established a balance of different artifacts to collect (Robinson & Lai, 2006) which included observations of students recorded in field notes, questionnaires for students to explain use of strategies or to rate difficulty, examination of student work product (actual TMs), and interviews with colleagues. Data was obtained by observation techniques, note taking, disaggregating student responses on questionnaires, pre-tests and post-tests, and comparisons of student TMs to anchor maps. I was intrigued by the notion that students learn more deeply when they construction their own organizers, or “learn by doing” than when the organizers are provided for them, or “learn by viewing” (Stull & Mayer, 2007). I knew I had to model the initial use of each type of TM while balancing the need to allow for learner-generated variance. I established a collection cycle and kept it consistent for each subtopic within the unit: pre-test, map introduction and use (“circle map”, followed by “tree map” or “bubble map” or “brace map” as needed, and culminating with a “flow map”) and finally
  12. 12. Thinking Maps® 12 post-test. I would rotate around from group to group, observing students over-the-shoulder, have students verbally explain their strategy to me, or observe from a clear vantage point during an assessment. Interviews of colleagues were conducted largely in an unstructured conversational style and I designed questions so as not to be leading in any way. The collection of actual data was planned for as I recorded observations, thoughts and process notes in a spiral notebook. Throughout the lessons and assessments I would collect data in an informal way (sticky notes or clipboard), tally according to criteria (for example, the number of times students looked up vaguely, trying to remember; or the number of times they looked around the room looking for visual cues), or anecdotal notations be formally transcribed after class. Assurances of Confidentiality In order to ensure confidentiality throughout the process, assurances were made and designed into the research methodology. Verbal consent of colleagues was achieved, and informed consent of the students was implied as I spoke with them at length about the process and their role in it. Parental consent was not necessary as this was part of the daily routines of class and no identifying elements would present a conflict. I concentrated on the student group as a whole, with no individual identifying comments in field notes (other than pre-determined codes to safeguard identity) and I took care not to mention any identifying factors of specific individuals in class conversations, interviews with colleagues, or in the writing of this document. Data Analysis Strategies I endeavored to employ techniques to be consistent with traditional qualitative and quantitative methods, although my approach was not a particularly linear process but one that was flexible among the complexities of the teaching and learning day. I looked for obvious shifts in the classroom as far as behavior, engagement, strategy use, and quality of response, and I also looked to evaluate changes in student conceptions of thinking. The literature provided me with guidance in the form of 3 components for successful and creative data analysis: (1) patience - reminding myself that it was my first time with action research, as well as a first for my students, (2) mistakes – maintaining a willingness to take risks and an acceptance that mistakes would be made, and (3) playfulness – remembering to have fun with the process and with my students as we investigated TMs together (Hubbard & Power, 2003). In each of the data collection tools I attempted to examine frequency of specific question responses, and tally instances of successful use, or marginal attempts at use, or non-use of various TMs. Some of the participant coding makes reference to both gender as well as ethnicity data (and this particular use of demographics is something that my district and school consistently utilize in order to focus on equity issues, as well as serving as a reminder to always be cognizant of potential equity constraints in
  13. 13. Thinking Maps® 13 instructional practices). The coding indicated: B (boy), G (girl), 4/3 (ethnicity code for “hispanic/black”), and 5 (ethnicity code for “white”) as there are no other ethnicity groups represented in this participant pool. I also made an attempt to code emotions (such as “easy, fun, hard, or confusing”) in my field notes and look for emergence of new types of responses. There also came the realization that, after many years of experimenting with tracking student responses and behavior, it may be difficult to analyze the “subtle nuances of change” and find different ways to code than what had been intuitive thus far as simple anecdotal records (Hubbard & Power, 2003). Other techniques of verification included transcription after the fact into usable data, looking for recurring patterns to identify, as well as the use triangulation to observe from several different angles, such as student interviews and observations and pre-tests/post-tests, to see if they all independently produce the same conclusions (Robinson & Lai, 2006). The additional use of colleague data will help to round out the questionnaires, observations and test data to confirm stronger triangulation within data collection. Presentation of Findings: Results, Implications and Significance When looking at the data through the lens of “Theory of Action” (Robinson & Lai, 2006) making sense of the constraints meant identifying the factors that led to my use of TMs: the program was being piloted at my school with a pilot cohort on site, and one of my fifth-grade team members was actively using TMs in our classes. In my class there was varying ability to read/write independently and a wide variance in the depth of learning and quality of written responses for some individuals, so there were many diverse learning styles and needs within the same group. TM authors recommend at least an 8-week introduction period followed by a year-long process to work with TMs until they start to become intuitive for learners. My own 3-4 week study pales in comparison and the limited exposure to TMs (except in flexible grade-level groupings for math and reading where they may have been exposed to more TM training with the pilot teacher, or from other grade level team teachers attempting to emulate without the training) may have produced inequities with TM instruction repetition for some and being new for others. In addition to absences which are unavoidable, the majority of instruction occurred at the end of the day which may have produced a loss of attention span, frequent interruptions (PA announcements, students leaving school for appointments) and the like. One other possible constraint was determining whether it was the presentation of new material (“human body”) or new map use (or both) that made the difference in results. In an attempt to satisfy these constraints on the problem, various actions through instruction were used to narrow to a range of solutions (Robinson & Lai, 2006). I worked to keep students focused (using SmartBoard strategies designed to engage) and created predictable routines for each lesson. I implemented alternate activity to increase attention span (integrated movement, varied the use of text, video,
  14. 14. Thinking Maps® 14 SmartBoard, discussion, cooperative groupings for pair-shares and jigsaw activities). I also tried to transition the students in their use of TMs by starting out with the pre-printed blank TMs at first and gradually released them to use their own self-drawn maps. TMs by their design were meant to allow for differentiation and the needs of those learners with varying abilities were met in the flexible nature of the maps. I attempted to prevent lesson interruption by occasionally rearranging the day so that the science TMs lesson could be earlier to avoid afternoon disruption. I also maintained constant communication with other TM teachers to aim for consistency in instruction, modeling and the rate of exposure to TMs. The subsequent consequences of instructional actions produced a more focused and engaged climate with an apparent increase in student interest (but again, was that the TMs or subject matter – or both?) and both intended and unintended consequences emerged (Robinson & Lai, 2006). Intended consequences were positive reactions to the TMs demo and students were more motivated to get their own written, more productive in written responses, and the collaborative groups seemed to increase the sense of community while working with new maps and sharing connections. I made sure to encourage different types of color-coding on the maps and for this, student connections to references and schema were more effective in the depth to which they could transfer their learning during class. Other expected results included the findings that TMs were most effective when used in combination for students to fully develop their conclusions (Hyerle & Yeager, 2007). The most precise and detailed responses came when students used two or more maps to explain their thinking. Also intended was my increased ability to use TMs to assess students’ development of concepts and misconceptions (Novak & Gowan, 1984). It was far easier to spot patterns and connections in thinking as well as the glaring gaps from misconceptions or map misuse. It was anticipated that students would achieve the ability to organize their ideas independently, assess the quality and quantity of their own written responses, and possess increased awareness of own thinking and an increased motivation to learn. In conversations with students, it was made clear that they thought these strategies helped them as they read through text, watched videos and participated in class discussions. 20% of the class even alluded to the fact that the use of TMs helped them more than the traditional study guides when preparing for the test. There were, however, unintended consequences that I did not anticipate. Although I knew that those students who generally do well would continue to do well (and the data supported this), I assumed that all of those who did not generally do well would make some growth. Instead, I found that only a small group began to improve and for some, there was no improvement. For some inexplicable reason, there was also a reversal in performance about midway through, and students started to use TMs less and less effectively. I relied on the assumption that the maps would begin to make a permanent change in the written response quality of most students, and during direct instruction or independent class time, it did. However, on assessment it appears that perhaps the “novelty” wore off because TMs were utilized less and
  15. 15. Thinking Maps® 15 less across the board. My only thought is that in the constraint of available time and length of data collection could not be altered, therefore it could still be too early to tell if any significant growth is possible without continuing the TM instruction and monitoring again toward the end of the school year. The overall presentation of the data is organized both by type of data tool and chronological stage of data collection. By examining the data closely I was able to comment and reflect on different aspects which appear either below the data sets or further on in the discussion section. As with all the data presented, absences occurred on a daily basis so there are few data sets showing results for all the respondents at any one time. For “Questionnaire #1”, I thought it was important to establish a baseline of prior knowledge about the specific content to be studied (the human body) and of various thinking strategies and tools previously used prior to the introduction of any TMs in my science class. Figure 3: Student Questionnaire #1: Prior Knowledge Q-A: How much do you know about the human body before we start our unit? Participant code/Response “ a lot” “some” “a little” “nothing” B 4/3 0 2 0 0 B 5 1 2 2 0 G 4/3 0 0 6 0 G 5 0 4 0 1 Q-B: What strategies and tools do you use most to help you learn information?* Participant code/Response “ study guide” “books” “notes” “TMs” B 4/3 0 0 2 1 B 5 1 2 1 0 G 4/3 0 1 3 2 G 5 1 1 1 1 **Other: There were other responses noted such as: mnemonics, cheers/chants, flash cards, games, videos, online support, group study, memorization… (See Appendix A for actual questionnaire) Most of the respondents (about 88%) had “some” or “a little” prior knowledge about the human body content which I think would make for an easier transition into using TMs to organize knowledge and remember terms, facts and processes. There were 4 students (18%) who already used TMs to varying degrees as a learning strategy or tool in other classes, and the majority (59%) used some traditional form of study strategy. A smaller percentage (22%) used additional strategies that they delineated, but the data shows that all students were comfortable using strategies of some kind. I anticipated that even though the number of participants previously familiar with TMs was small, that this number would grow with the instruction in each sub-unit of instruction, or body system. As for looking at ethnicity data… there are few if any implications here that show variance in ethnic groups and I wasn’t sure going forward if any significant patterns would be revealed. (One of the initial constraints I noticed was the issue of participant absences and it made for a varying number of responses every time I collected data. Because the absences were attributed to different individuals each time, I wasn’t sure how address the validity of data collection,
  16. 16. Thinking Maps® 16 other than to continue to be consistent for all who were present. If I were to try to “make-up” the data when a student returned, it might skew the overall data because it was collected in different settings, and if I were to ignore the absent individuals, then the total number of participants would change with each collection tool. I chose to try a little of each remedy, although I’m not sure that I can disaggregate the effect from the overall data). Throughout each sub-unit, pretests were given to assess prior knowledge. At no time (especially in the later pre-tests) did students independently utilize TMs to share their thinking. I assumed that they would gradually start to appear, but not once in a pre-test situation was a TM used by a student. During instruction, TMs were utilized by all students to their fullest capacity, since I began modeling with the whole class emulating and then I would wander as they worked looking for completeness. When it came time to assess independent use, the next form of data collection was the post-tests following each sub-unit where it was anticipated that TMs would appear in student responses. Both the “pre-test” and “post-test” asked an identical question: whether the student could describe the process for that specific body system (such as the process of digestion, the process of breathing, the process of blood circulation, the process of the brain sending a message, etc.). Most pre-tests were answered in the same manner (short written responses to the question, or “I don’t know”) but after content instruction and TMs modeling of the “flow map”, the post tests began to show some TMs use to varying degrees of success: Figure 4: Post-Test Results Body System Successful TM Use Marginal TM Use Non-TM Use Participant Code 1 1 0 B 4/3 4 5 0 B 5 4 3 0 G 4/3 Digestive 1 5 0 G 5 Body System Successful TM Use Marginal TM Use Non-TM Use Participant Code 0 2 0 B 4/3 2 5 1 B 5 2 6 0 G 4/3 Respiratory 2 0 3 G 5 Body System Successful TM Use Marginal TM Use Non-TM Use Participant Code 0 3 0 B 4/3 1 3 3 B 5 4 2 2 G 4/3 Circulatory 1 3 0 G 5 Body System Successful TM Use Marginal TM Use Non-TM Use Participant Code 0 2 3 B 4/3 0 1 4 B 5 0 4 1 G 4/3 Nervous 1 2 2 G 5
  17. 17. Thinking Maps® 17 The initial pre-test responses were for the most part the same - minimal answers with little terminology or content knowledge, and no use of TMs – even after the students had started to receive instruction in their use. Targeted TMs were introduced (such as the “flow map” for sequence of events/processes) and utilized throughout instruction and, when the same question was posed on the post- test, my expectation was that the students would use flow maps on the assessment to explain the specific body function process. The data shows TMs usage with varying degrees of success over time – the digestive system was the first sub-unit introduced, with the nervous system being one of the last in the 4- week time frame. Some participants successfully used the correct TMs with the correct terminology at each body system stage. Others attempted to use the flow map, but did not provide the correct information in each stage of the process. Still others made no attempt at using TMs whatsoever, reverting back to short written responses, or various other diagrams/graphic organizers such as Venn Diagrams, cycles and labeled models. Subsequent body systems (skeletal and muscular) did not make use of the same type of flow map for processes, and a different set of TMs were utilized. Data was not collected in the same manner for these final systems. After all of the TM instruction and modeling was introduced, about midway through the data collection, a questionnaire was given to students to see if they could identify the specific thinking processes and match it to the corresponding map: Figure 5: Student Questionnaire #2: Identify Intended Thinking Strategy Q- Match each TM to its intended thinking strategy (that is, why do we use it)? Participant code/ Number Correct of 6 0 1 2 3 4 5 6 B 4/3 0 0 1 0 0 0 1 B 5 0 2 1 2 2 0 1 G 4/3 0 0 2 1 3 0 0 G 5 0 0 1 3 2 0 0 (See Appendix D for actual questionnaire) Most of the students ranged from 2 to 4 correct matches with only about 41% passing acceptably. It was still only midway through an admittedly short research period, so there was hope that with more practice an increasing number of students would be more successful in the future. Yet another area within the data where unintended results occurred unwittingly was with the human body “final test”. It was designed by one of the other grade level team members and administered to the entire grade level – including my participants (and ultimately was not always consistent in language with my earlier post-tests). Students were asked on 3 occasions to describe body function “processes” – all 3 which could have been suited for TMs responses if the student was aware of the cues (the test used similar language like “describe how __ works”, “describe how ___ occurs”, and in one very consistent instance with a pre-test and class work, “compare and contrast ____”; in addition to a bonus section where students were asked to “describe” additional facts not previously required). Even though the questions
  18. 18. Thinking Maps® 18 were worded in a slightly different way, it was still my hope that my students would see the key word, make the connections and utilize the appropriate TMs: Figure 5: Final Test Questions (that included key word descriptions of specific processes) Arteries & Veins (success/marginal) Breathing (success/marginal) Muscle Pairs (success/marginal) “Extra credit facts” (success/marginal) (no TM attempt) Participant Code 0/1 0/1 0/0 0/0 1 B 4/3 1/1 0/2 0/0 0/0 5 B 5 1/2 0/0 0/0 0/0 3 G 4/3 2/0 0/0 0/0 0/0 4 G 5 Students seemed to fully utilize TMs much more during class and independently than they did on the final assessment. Perhaps it was due to the fact that I purposely did not mention TMs as a specific option for test responses? I wanted to see rather if they would transfer the use of TMs independently without my prompting. The number of students who were successful with their maps on these questions (only about 16%) was disappointing, but even more alarming was the number of students who chose not to use a TM at all (about 54%) on test responses, even within the “low pressure” extra credit section. The “muscle pairs” question also rated no attempts at TM usage for some unknown reason even though we distinctly used TMs in class to discuss the relationship. At the end of all the TM instruction and modeling, and after the final assessment near the end of the data collection, a third questionnaire was given to students to see if they could make connections with the key words and phrases associated with each thinking process and then draw the corresponding map: Figure 6: Student Questionnaire #3: Connect with key words and draw TM Q- Match each TM to its intended thinking strategy (that is, why do we use it)? Participant code/ Number Correct of 6 0 1 2 3 4 5 6 B 4/3 0 1 0 0 0 1 0 B 5 0 0 2 1 3 0 1 G 4/3 0 1 0 2 0 0 2 G 5 0 1 1 2 0 0 1 (See Appendix E for actual questionnaire) Most of the students ranged once again from 2 to 4 correct responses and similarly to the second questionnaire, only about 42% passed within acceptable margins. Although a few had moved over into the 4, 5, or 6 correct columns, even more had moved in the opposite direction, showing more incorrect responses overall. I was curious how this result might have related to the frequency of use of each type of map over the course of the data collection. I tallied the frequency of each map as it was used throughout the sub-units, then I determined the percentage of students that correctly connected key words with drawing to see if there were any correlations:
  19. 19. Thinking Maps® 19 Figure 7: Frequency of TM use v. success rate on questionnaire #3 Type of map Frequency of use across sub-units % correct responses “circle map” 7 70% “tree map” 3 39% “double bubble map” 1 48% “flow map” 5 57% “cause & effect map” 1 39% “brace map” 1 30% * Not all TM types were used during this data collection period The “circle map” was most widely used and showed in the number of correct responses. The “flow map” and “tree map” were the next most used maps, yet the number of correct responses doesn’t seem to correlate. Maybe it had to do with amount of exposure time – or perhaps my sample is too small? The remainder of data was collected in the form of observation notes on student engagement, depth of knowledge and colleague interview responses (see Appendices F & G). General observations included that, after four weeks of TM introduction, some students (about 25%) began to speak about content in a more confident manner and often referred back to a TM when making a point and attempting to clarify their thoughts. More students (about 30%) were able to discuss concepts with great detail using TMs with little prompting from me. I observed a limited increase in written response depth and quality (about 20%), but a much larger increase in class engagement (about 60%). The data collected from colleague input was more revealing however. All (100%) of my colleagues found the use of TMs, especially the common language they created, to be extremely helpful. Vertical conversations including teachers and administration revealed that students were largely on task and participated more when able to offer the different perspectives that the TMs encourage. The use of TMs also enabled the students in their classrooms to be more independent and concise, and several expressed their amazement at what their students could do with the maps. Most (about 80%) agreed that more teacher professional training was necessary moving forward. Emerging Themes/Results: As a result of all the data, I was surprised to see that the strongest data (and participation in TMs usage) came at the very beginning and declined on every data collection that followed. Perhaps most curious for me is that the data appears to show a decrease in consistent and independent TM use; instead of getting stronger with TMs use, it appears that the students were becoming less and less consistent with the proper TMs, and not independently choosing those graphic organizers, but reverting back to other more general forms (or poorly constructed written responses). Not at all what I had expected! In addition, there appears to be some difficulty for some participants to remember which TMs belongs with which thinking/ process skill and I’m concerned that this might present a “double load” and be just as hard as learning the
  20. 20. Thinking Maps® 20 content material itself, presenting further areas of confusion. As an initial response to my research questions, the first use of TMs produced more depth of responses and more engagement in the TMs process. As each sub unit progressed, the participants utilized TMs in their notes, class discussions and post tests, but with decreasing degrees of accuracy. There seemed to be a small number of students who increased their understanding, response levels and engagement, but they weren’t the ones who needed to in terms of skill progression. I am still trying to sort out the reasons why this may have occurred. Some other constraints I hadn’t thought to explore emerged as learning style constraints that TMs seemed to produce – TMs being predominantly visual and systematic organizers (with some tactile qualities of writing or drawing, and auditory qualities when paired with “verbal rehearsal” of their contents). I realize after looking at the data that I should have allowed students the opportunity to “think aloud” and verbalize the process in a way that they could have explained it better and it would have produced different results for some students. In wanting to remain consistent in how I modeled the use of TMs and the expectations for assessment responses, I overlooked meeting the needs of other learning styles. Another potential barrier to clear and consistent data could have been that this participant group may have had varying degrees of previous “response instruction” (modeled by different team teachers in flexible groupings for reading and math, in addition to a different graphic organizer system used in a school-wide writing program), as well as a different amount of previous exposure to TMs use, and these instances may have offered some confusion when confronted with the TMs approach. My overall findings appear to parallel those I read in a sample study (Burden & Silver, 2006) where teachers were convinced that students were capable of achieving more than what they were demonstrating and intended to raise expectations and realize an increased number of students becoming more active learners with TMs. Although the results did not quite meet their assumptions, and the researchers noted that the TMs needed extensive further piloting, they came to the conclusion that students were just starting to shows signs that the TM tools helped guide thinking and problem-solving and that there were many different uses still ahead for multiple maps implementation. I too agree that there are early signs of habit-forming and that TMs are beneficial, having connections to several related clusters of Costa’s “Habits of Mind” (Hyerle, 2008) such as “attending to tasks that require patience & analytical, detailed thinking”. Over time, students should develop fluency with each map and become more able to transfer skills from multiple maps into each content area, having “the flexibility to choose and use maps for a variety of purposes” (Hyerle & Williams, 2009). Discussion and Suggestions for Further Research From the perspective of my action research, I have learned that TMs are really powerful tools when modeled and used in appropriate ways. Consistent use (and especially their use across disciplines) provides the ability to make connections to one’s learning in more depth. They offer a way to express
  21. 21. Thinking Maps® 21 thoughts and personalize learning by utilizing the map features (frames of reference and color coding) to differentiate one’s learning and offer structure to note-taking and the absorption of new content. Some realizations that I had as a result of this action research were that I’ve barely scratched the surface with my implementation of TMs, and although I learned about these TM strategies “second-hand” from a team member who was part of the actual pilot group, I realize that there are more deliberate skills and strategies that I need to learn in order to have the maximum effect of my students. As I made observations of my students, I noticed some emerging trends in that many students still required a constant “nudging” to encourage them to utilize the TMs to their fullest potential and the most difficult instructional glitch was getting some of the students to transition to independence in their use of TMs. As I sought answers to my research questions I’ve come to appreciate and need to reinforce the notion that only through extended exposure over time and consistent practice will TM use become intuitive for the students (and teachers)! Upon reflection of my research technique I found the use of field notes in this way to be more powerful than other types of anecdotal record keeping that I’ve attempted in the past. I’ve gained increased reflection and metacognition of my own instructional practices and an increased use of strategies on my part since TMs have slowly become more intuitive with use. As for the future, I will continue to utilize TMs in my classroom across all subject disciplines. I will also begin the use of portfolios to monitor learners as they assimilate new knowledge and develop incremental skill using TMs making note as patterns emerge. This research has warranted continued exploration of my practice and to actively invite explicit thinking, integrate more TMs into the curriculum, and monitor the effects of TMs on scores. The way to increase long-term memory (and improve student achievement) is to incorporate new information gradually and repeat it at regular intervals to “mind the gap” while attracting and holding attention (Medina, 2008) and this increased exposure to TM usage should solidify these metacognitive strategies for students to take with them for future years. I have since participated in a school-wide training of TMs and reviewed a culminating report of the first pilot group’s findings. I will be part of a summer training conducted by the first pilot group to review “lessons learned” and share in how to implement TMs successfully in the classroom. I have also recently been invited to participate in the second round of the TMs pilot program in the fall, so I will be starting again with action research on TMs and refocusing my efforts with a new class. Perhaps I will also take a look at keeping students motivated once they have been trained in TMs use in an effort to prevent the decline of use over time that I found in this current study. I look forward to learning more about Thinking Maps® in the future, increasing my instructional skill and continually informing my practice.
  22. 22. Thinking Maps® 22 References Burden, B., & Silver, J. (2006). Thinking maps in action. Teaching, Thinking & Creativity Retrieved from Caine, R.N., & Caine, G. (1991). Making connections, teaching and the human brain. Wheaton, MD: ASCD. Dual-coding theory. (n.d.) In Wikipedia. Retrieved from coding_theory Gerlic, I., & Jausovec, N. (1999). Multimedia: Differences in cognitive processes observed with EEG. Educational Technology Research and Development, 47(3), 5-14. Hubbard, R.S., & Power, B.M. (2003). The art of classroom inquiry: A handbook for teacher-researchers. Portsmouth, NH: Heinemann. Hyerle, D. (1996). Thinking maps: seeing is understanding. Educational Leadership, 53(4). Hyerle, D., Curtis, S., & Alper, L. (2004). Student successes with thinking maps: School-based research, results and models for achievement using visual tools. Thousand Oaks, CA: Corwin Press. Hyerle, D. & Yeager, C. (2007). Thinking maps: A language for learning. Cary, NC: Thinking Maps, Inc. Hyerle, D. (2008). Thinking maps: Visual tools for activating habits of mind. In A.L. Costa and B. Kallick (eds.), Learning and leading with habits of mind: 16 Essential characteristics for success (149- 176). Alexandria, VA: ASCD Hyerle, D., & Williams, K. (2009). Bifocal assessment in the cognitive age: thinking maps for assessing content learning and cognitive processes. New Hampshire Journal of Education, 12, 32-38. Jensen, E. (1998). Brain-based learning: The new paradigm of teaching. Thousand Oaks, CA: Sage. Leary, S. F. (1999). The effect of thinking maps instruction on the achievement of fourth-grade students. Retrieved from dissertation.pdf Marzano, R.J., Pickering, D.J., & Pollock, J.E. (2001). Classroom instruction that works: Research-based strategies for increasing student achievement. Alexandria, VA: Prentice Hall. McCormick, S. (1995). Instructing students who have literacy problems. Englewood Cliffs, NJ: Prentice Hall. Medina, J. (2008). Brain rules. Retrieved from IT 6710 Merkley, D. M., & Jeffries, D. (Dec. 2000/Jan. 2001). Guidelines for implementing a graphic organizer. The Reading Teacher, 54 (4), 350-357. Novak, J.D., & Gowin, D.B. (1984). Learning to learn. New York, NY: Cambridge University Press.
  23. 23. Thinking Maps® 23 Paivio, A. (1990). Mental representations: A dual coding approach. Available from 20%2B%20dual%20coding%20theory&lr&pg=PP1#v=onepage&q=Paivio%20+%20dual%20cod ing%20theory&f=false Ritchhart, R., Turner, T., & Hadar, L. (2009). Uncovering students' thinking about thinking using concept maps. Metacognition and Learning, 4 (2), 145-159. Robinson, V. & Lai, M.K. (2006). Practitioner research for educators: A guide to improving classrooms and schools. Thousand Oaks, CA: Corwin Press. Stull, A.T., & Mayer, R. (2007). Learning by doing versus learning by viewing: Three experimental comparisons of learner-generated versus author-provided graphic organizers. Journal of Educational Psychology, 99 (4), 808-820. Tomlinson, C.A., & Kalbfleisch, M.L. (1998). Teach me, teach my brain: A call for differentiated classrooms. Educational Leadership, 56 (3), 52-55.
  24. 24. Thinking Maps® 24 Appendix A: (Data collection questionnaire sample 1) Questionnaire #1 Directions:  Please carefully read each question and respond thoughtfully. Remember to write neatly and make your thoughts clear. 1. How much do you know about “the human body” before we start our unit? (Circle one) a lot some a little nothing 2. What strategies or tools do you use the most to help you learn and remember new information? _____________________________________________________________________________________ _____________________________________________________________________________________ 3. How do you think you usually do on tests? (Circle one) very well pretty good just OK not very well 4. What do you think of the quality of your test responses? (Select the most appropriate answer)  My work is usually thorough and I’m proud of my success  I usually recognize my mistakes and I can fix them  I’m usually not sure where I went wrong and need further clarification  My responses are not usually sufficient  Other: ________________________________________________________________________ ************************************************************** The questions above were about your learning strategies for science. Please answer the following questions about learning in all subject areas: Should students be taught “thinking skills”? (Circle one) Y N Why or why not? _____________________________________________________________________________________ _____________________________________________________________________________________ List all of the thinking skills/tools/strategies that you use to help you learn in school: ____________________________ ____________________________ ____________________________ ____________________________ ____________________________ ____________________________
  25. 25. Thinking Maps® 25 Appendix B: (Data collection pre-test sample) Pretest #1: Digestion Directions:  Please carefully read each question and respond thoughtfully. Remember to write neatly and make your thoughts clear. 1. Using words or pictures, describe how human digestion works: 2. How do you know? _____________________________________________________________________________________ _____________________________________________________________________________________ _____________________________________________________________________________________ 3. Where will you be able to find out more about digestion? _____________________________________________________________________________________ _____________________________________________________________________________________ _____________________________________________________________________________________
  26. 26. Thinking Maps® 26 Appendix C: (Data collection post-test sample) Post-test #3: Circulation Directions:  Please carefully read each question and respond thoughtfully. Remember to write neatly and make your thoughts clear. 1. Using words and/or pictures, describe the process of human circulation: 2. How do you know? _____________________________________________________________________________________ _____________________________________________________________________________________ _____________________________________________________________________________________
  27. 27. Thinking Maps® Appendix D: (Data collection questionnaire sample 2) Questionnaire #2 Directions:  Look at each of the “thinking maps” on the left side of the page.  Carefully draw a line to match each to its intended thinking strategy on the right side of the page. Restated: Match each “thinking map” to the reason we use it… 27 comparing & contrasting sequencing & ordering identifying part-to-whole relationships brainstorming or defining in context analyzing cause & effect classifying & grouping
  28. 28. Thinking Maps® Appendix E: (Data collection questionnaire sample 3) Questionnaire #3 Directions:  Carefully read each description below that contains the “code words & phrases” that help us know which type of “thinking map” works best for what we study.  Decide which “thinking map” is being described and draw it into the frame of reference. Restated: Draw the “thinking map” that best describes the phrases below it… define brainstorm describe in context list identify generate ideas… …as many as you can …tell everything you know …use your prior knowledge explore the meaning of… classify categorize organize group sort give sufficient details for… types of… describe parts & functions of… list & elaborate on… compare/contrast similarities/differences alike/unlike distinguish between… show what ___ has in common… describe shared components of… sequence order events describe phases/cycles/process recount/retell summarize procedures tell/show how… identify steps/stages first/then/next… put in order how to get from ___ to ___ cause/effect discuss consequences of… why did/does… what would happen if… predict the outcome of… describe changes discuss strategy/outcome what is the impact of… what would be the result if… part-to-whole describe/show structure what are the parts/components take apart __/ put together __ __ is made up of… describe the subparts/subcomponents how does __ fit in a larger context 28
  29. 29. Thinking Maps® 29 Appendix F: Field notes excerpts Entry (3/9/10): Started on the third sub-unit today “Circulatory System” … introduced circle map to be completed as part of the “morning menu”… First elicited “what you already know” and marked the pre- established color-coding on the board: brain = pencil; For the first time, a G5 asked at the beginning of ‘morning menu’, “Can we add in our own notes with other colors if we once we finish our brainstorming?” This is the first time that anyone has made the connection to use additional colors for additional sources on their own, without my prompting. Maybe they’re starting to get it?? We then added to the board the remainder of the color-coding chart and left it there permanently for the duration of all the human body units: Brain = pencil; text = 2nd color; class discussions & teacher lesson = 3rd color; video = 4th color; Assigned corresponding text readings and note-taking to the menu… Will introduce tree map this afternoon for 3 types of blood cells *** Entry (3/17/10): I walked around the room during group work activity (students were establishing a flow chart for “Nervous System” – How does the brain send/respond to a message?)… observed individuals displaying – and/or + behaviors with respect to the DB map skill… General Observations: (B 3/4) participants (B 5) participants (G 3/4) participants (G 5) participants -quickly scribbling a double bubble; no care taken to align related bubbles +using tree map for facts to put into DB map +completed DB map before rest of group with lots of detail -starts a Venn Diagram when asked to compare/contrast +explaining how to use a double bubble to elbow partner +comparing DB map to the difference paragraph ‘bug box’ in writing +2 working together “divide and conquer”- one uses red for compare, other uses blue for contrast -needs explanation from elbow partner; does not remember how to use DB -uses bubble map instead of DB map -off task and talking; no signs of map being started Note: this week’s lessons are becoming “extra”- feeling like “one more thing’ in an already tight schedule; have to embed brace map as a “quick check” activity (direct instruction) to make time instead prior to quiz…. *** Entry (3/23/10): Group Observation tally Behaviors during “Skeletal/Muscular” assessment: (B 3/4) participants (B 5) participants (G 3/4) participants (G 5) participants Staring at page or looking up in thought lll I I II Using FM instead of MFM to show contractions II IIII III II Color-coding maps on test I I II I Asks what map to use I I Note: 6 absences today!! Need to determine how that will affect overall data…. Make-up exams!!
  30. 30. Thinking Maps® 30 Appendix G: Interview question format The following questions were asked of my colleagues (grade-level team members, pilot participants, other teachers trying to emulate the pilot instruction on their own) in an effort to find common experiences and to help me make comparisons between my class and other classes at similar levels of implementation: Domain Interview Questions Quantitative 1. Which TM do you most frequently use? Why? 2. How often do you use each of the TMs? 3. How many of each type of map have the students completed? 4. Have you measured growth? Probe Further: How long does the introduction/modeling take for each? Qualitative 1. What instructional strategies do you use to teach TMs? 2. Describe the experience of using TMs in your classroom 3. How have you extended the use of TMs? Probe Further: Which TMs seem easiest for your students? Most difficult? Reflective: Outcome of Lesson 1. How does the TM relate to the lesson being taught? 2. How do you monitor engagement? 3. How do you incorporate TMs in to assessment? Probe Further: How do you differentiate using TMs? Professional Impact and Practice 1. Describe your pacing for TM implementation? 2. What success have you observed? 3. What areas for improvement have you observed? Probe Further: How does the use of TMs support our school or grade-level agreements? (adapted from the literature- Leary, 1999; used that study’s questionnaire format as the model )
  31. 31. Thinking Maps® 31 Appendix H: Research Timeline Task Date/Time Frame People involved Scope the research problem Begin Feb 1 (due Feb. 7) Self Create timeline, or “plan of action” Begin Feb 1 (due Feb. 14) Self Conduct the initial literature review Begin Feb 1 (due Apr. 4) Self Design the study; plan data collection Begin Feb 7 (due Feb. 21) Self; team Create data collection tools Begin Feb 7 (due Feb. 21) Self Arrange to conduct research with respondents and involved educators Begin Feb 7 (due Feb. 21) Self; team; students Create permission forms and obtain permission to conduct research at designated site Begin Feb 7 (due Feb. 21) Self; team; parents Collect data (activity part 1) Begin Feb 22 (due Feb. 28) Self; team; students Collect data (activity part 2) Begin Feb 22 (due Mar. 7) Self; team; students Continue data collection Begin Feb 22 (due Mar 26) Self; team; students Analyze data Begin Mar. 8 (due Mar. 28) Self; team Make inferences and determine findings Begin Mar. 8 (due Apr. 11) Self Literature review (activity due) Begin Feb. 1 (due Apr. 4) Self Finalize literature review Begin Feb. 1 (due Apr. 25) Self Write final report draft Begin Feb 7 (due Apr. 11) Self Peer edit Begin Apr. 12 (due Apr. 18) Self; IT 6720 cohort; team Review findings with key person Begin Apr. 12 (due Apr. 18) Self; team Revise final report Begin Apr. 19 (due Apr. 25) Self Submit final report ** Due Apr. 25 ** Self Prepare presentation Begin Apr. 25 (due May 2) Self Presentation: review of study and findings ** Due May 2 ** Self