• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Make clickers work for you:  Faciltiation and question writing
 

Make clickers work for you: Faciltiation and question writing

on

  • 1,212 views

Clickers can make teaching more effective and fun, but how does a teacher best use clickers in the class? In this interactive workshop, we’ll explore research-based ideas for questioning to achieve ...

Clickers can make teaching more effective and fun, but how does a teacher best use clickers in the class? In this interactive workshop, we’ll explore research-based ideas for questioning to achieve student engagement and deep learning. We will focus on the use of “peer instruction” in which students discuss challenging questions. We’ll compare example questions, practice writing questions, discuss common challenges, and share tips on getting students to productively reason through them. No software needed.

Statistics

Views

Total Views
1,212
Views on SlideShare
546
Embed Views
666

Actions

Likes
0
Downloads
12
Comments
0

3 Embeds 666

http://blog.sciencegeekgirl.com 645
http://feeds.feedburner.com 20
http://www.google.com 1

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • HAVE PEOPLE SIT BY DISCIPLINE
  • How do you feel about asking students questions in class?How many times have you given a lecture and found that students hadn’t followed you?Can you rely on students to ask questions if they don’t understand something?Can you rely on students to know if they don’t understand something?So, what are the benefits of questioning?Why do you think people don’t question more?
  • During each section, ask people for examples of questions that they wrote that fall into this category. Give clicker booklet for responding.Point out the handout where each one is detailed more.
  • We aren’t just trying to sell you on peer instruction because it seems like a good idea. There is lots of research on this. We’ll show a little later, but realize that lots of evidence points towards this being a more effective mode of instruction than lecture only.
  • Is this a problem? Unreasonable to expect adoption of any method wholesale without modification.Some modifications might increase effectiveness. But some components essential to student learning might be eliminated. Some dropped elements argued to be key to effectiveness by developers. Can’t assume faculty using PI is using as intended. Methods are related to or inspired by PI, but no longer recognizeable as PI, and so not been tested for effectiveness.
  • Shop for ideas
  • During each section, ask people for examples of questions that they wrote that fall into this category. Give clicker booklet for responding.Point out the handout where each one is detailed more.
  • Shop for ideas
  • Shop for ideas
  • Shop for ideas
  • Questions threaten studentsI get no volunteers to answerStudents don’t talk to each otherAnswers take me off trackTakes too much time
  • What comes first? Learning goals.
  • Instructor circulates, may need to show that you’re serious
  • Undergraduate biology majors Intro genetics.16 times. Isomorphic question, different “cover story” but same idea or topic. Q1 and Q2 randomly assigned. Reviewed by two independent reviewers.

Make clickers work for you:  Faciltiation and question writing Make clickers work for you: Faciltiation and question writing Presentation Transcript

  • Make Clickers Work for You FACILITATION TIPS AND TECHNIQUES Dr. Stephanie V. Chasteen Dr. Steven Pollock Physics Department & Science Education Initiative Univ. of Colorado at Boulder http://colorado.edu/seiWeb and blog: http://sciencegeekgirl.comEmail: stephanie.chasteen@colorado.edu
  • Who are you? Show of handsA. Natural sciencesB. Social sciencesC. HumanitiesD. ArtsE. LanguagesF. Other
  • Have you used response systems (clickers) in your teaching? Take a clicker & turn it on If the green light flashes, your vote has been countedA. Not at all, and I haven’t seen them usedB. Not at all, but I’ve observed their use somewhatC. I’ve used them a littleD. I’ve used them a lotE. I could be (should be?) giving this workshop
  • How familiar are you with “Peer Instruction” Colored cardsA. Fairly familiar, and I like itB. Fairly familiar, but I’m not sure that I like itC. I’ve heard of it but only have a vague idea what it isD. Not familiar at allE. Not sure
  • Introducing Me 5Science Education Initiative http://colorado.edu/SEI Applying scientific principles to improve science education – What are students learning, and which instructional approaches improve learning?Physics Education Research Group http://PER.colorado.edu One of largest PER groups in nation, studying technology, attitudes, classroom practice, & institutional change. Blogger http://blog.sciencegeekgirl.com
  • Agenda1. Thinking about questioning2. About clickers and peer instruction3. Writing great clicker questions4. Overcoming common challenges5. Action plan
  • Why question? 71. Why do we question our students?2. When might you use questioning in your classes?3. For what purposes might clickers be an appropriate questioning tool?Discuss in groups of 2-3 for 5minutes.(May make notes in yourhandout) whiteboard
  • What is special about clicker questions? 8 Similar goals as other types of questioning techniques Multiple choice Anonymous (to peers) Every student has a voice – the loud ones and the shy ones Clickers are a tool Forced wait time You can withhold the answer until everyone has had time to think (choose when to show the histogram)
  • When can we ask questions? 9 BEFORESetting up instruction DURING E.g.: Developing knowledge Motivate Assess prior knowledge Application … (handout!) Elicit misconception … AFTER Relate to big picture Assessing Demonstrate success learning … Credit: Rosie Piller and Ian Beatty.
  • Gallery Walk With a partner, look at the “example questions” trios on the wall. What do you think an instructor would be trying to accomplish with such questions? Jot down any ideas on the sheet 5 minutes Aihofanz2010 on Wikimedia
  • Agenda1. Thinking about questioning2. About clickers and peer instruction3. Writing great clicker questions4. Overcoming common challenges5. Action plan
  • Clickers are a tool for questioning 12 But not a magic bullet!Don’t equate the pedagogy with the technology. So what IS the pedagogy?
  • Why use peer instruction? 13
  • An outline of Peer Instruction. 14
  • Anatomy of Peer Instruction 15 Ask Question…Lecture… (Maybe vote)Class Discussion Peer Discussion Vote * See also: Peer Instruction, A User’s Manual. E. Mazur.
  • Burning questions? 16 Ask Question…Lecture… (Maybe vote)Class Discussion Peer Discussion Vote * See also: Peer Instruction, A User’s Manual. E. Mazur.
  • U. Colorado clicker resources… 17Videos of effective use of clickers 2-5 mins long http://STEMvideos.colorado.eduClicker resource page http://STEMclickers.colorado.edu • Instructor’s Guide • Question banks • Workshops • Literature / Articles
  • Peer instruction helps students learn 19Research shows that: Students can better answer a similar question after talking to their peers Peer discussion + instructor explanation of question works better than either one alone Students like peer instruction Peer instruction classes outperform traditional lectures on a common test See http://STEMclickers.colorado.edu for various references
  • Example question: Physics 20Which superpower would yourather have? The ability to… A. Change the mass of things B. Change the charge of things C. Change the magnetization of things D. Change the boiling point of things 20 Question: Ian Beatty, UNC Greensboro Image: Thibault fr on Wikimedia
  • Example question: LiteratureIf Homer wrote the Iliad today, Stanley Fish and Harold Bloom would argue, respectively, whether the work should be categorized as:A. Existential vs. RomanticB. Postmodern vs ClassicalC. Modern vs RomanticD. Postcolonial vs ModernE. Preliterate vs Postliterate The Technology Enhanced Learning and Research center at Ohio StateOrigin unknown
  • Example question: MathYour sister in law calls to say that she’s having twins. Which of the following is the most likely? (Assume she’s having fraternal, not identical, twins)A. Twin boysB. Twin girlsC. One girl and one boyD. All are equally likely 22Derek Bruff, Vanderbilt
  • Example question: History or EthicsIf you were a judge, how would you assess the “responsibility” of the U.S. Government, for what happened in the world between 1933 and 1945?A. Not responsibleB. Minimally responsibleC. ResponsibleD. Very responsible Origin unknown 23
  • Let’s try it I think the toughest thing about using clickers and peer instruction in class is / will be:A. Writing good questionsB. Getting students to really think about the questionsC. Getting students to share their reasoning with the whole classD. The same students always respond in whole class discussionE. It takes too long / I have a lot of content to cover
  • Honestly, I think that I’m most likely to modify this technique of Peer Instruction to suit me and my students. I know that there are at least ___ parts of the technique that I’ll be changing:A. NoneB. OneC. Two-threeD. Four or more
  • Is there a problem with modifications?I won’t tell you how to teach. You’re smart & you care about instruction. But realize that modifications may change the effectiveness of the technique.Be strategic about modifications. Know the research.
  • Some research on modifications  63.5% of faculty (in physics) say they are familiar with Peer Instruction  30% report that they use Peer Instruction  50% of those use Peer Instruction in the way described by developers  Often dropped are:  Student discussion Is this a problem? Use of conceptual questions  Probably.  Whole-class votingDancy & Henderson, Pedagogical practices and instructional change of faculty, Am. J. Phys., 78(10), Oct2010.Web survey of 722 physics faculty at various institutions, initial sample of 2000.
  • Exercise #1: Core Philosophies 28 In groups: What are the underlying principles that make this work? Ask Question…Lecture… (Maybe vote)Class Discussion Peer Discussion Vote * See also: Peer Instruction, A User’s Manual. E. Mazur.
  • Some core philosophies of mineClicker questions are an integral part of my lecture Students learn by … teaching each other … articulating their ideas It’s important for me to …. hear student ideas … know what my students understand I value and respect student ideasI want students to … know that I value student ideas … feel safe sharing their ideas
  • Agenda1. Thinking about questioning2. About clickers and peer instruction3. Writing great clicker questions4. Overcoming common challenges5. Action plan
  • Question-writing tips Move away from simple quizzes Use questions that prompt discussion Use questions that emphasize reasoning or process Use clear wording Use tempting distracters Use questions for a variety of instructional goals Use questions at a mixture of cognitive depth Ask challenging questions – don’t just test memorized facts See handout
  • Some instructional goals for clickers 32 BEFORESetting up instruction DURING E.g.: Developing knowledge Motivate Assess prior knowledge Application … (handout!) Elicit misconception … AFTER Relate to big picture Assessing Demonstrate success learning … Credit: Rosie Piller and Ian Beatty.
  • Effective multiple-choice questions have believable “distracters.”1)Talking with other instructors that have taught the course in the past.2)Talking with your students one-on- one before class, after class, during office hours.3)Using student responses to open- ended questions D. Duncan, Univ. of Colorado 33
  • Exercise #2: Try writing a question Choose one of the question goals (slide #3 on page 2 in handouts) Write a draft question that aims to achieve this goal. 5 minutes
  • An example question What causes the seasons?A. The change in the earth’s distance from the sun during the year Bad question.B. The tilt of the earths axis Students canC. Changes in the sun’s brightness answer by memorizing aD. Changes in clouds word (“tilt”)E. None of the above Can we make a better question on the SAME topic? Yes…
  • Better seasons exampleWhat would happen to the seasons if the earth’sorbit around the sun was made a perfect circle (but nothing else changed) ?A. There would be no seasonsB. The seasons would remain pretty much as they are todayC. Winter to spring would differ much less than nowD. Winter to spring would differ much more than now Much better question. Requires reasoning!
  • Use questions at a variety of cognitive depth 37 Do the questions you use intellectually challenge your students or simply assess their factual knowledge? Higher order ---------------- Lower order handout
  • Exercise #3: Rate and swap Use the Bloom’s Taxonomy worksheet to rate the Bloom’s level of your question Swap your question with a neighbor. Do you agree on the Bloom’s level of your question? Use the verbs on the detailed Bloom’s handout to “Bloomify up” the level of your question. 5 minutes
  • What was the Bloom’s level of your question?A. RememberingB. UnderstandingC. ApplyingD. AnalyzingE. Evaluating
  • Share out What did you learn in this process? What worked well, what was challenging? How might you go about writing questions in your class?
  • Agenda1. Thinking about questioning2. About clickers and peer instruction3. Writing great clicker questions4. Overcoming common challenges5. Action plan
  • Exercise #4 Challenges in the Classroom 42 You ask students a question, and ask them to discuss. You then ask them to share their answers and reasoning in a whole-class discussion What could possibly go wrong?  5 mins With a partner, brainstorm some challenges and write them on the board (in the appropriate area). What are some possible solutions that are in line with your core philosophies?
  • 1. Asking Question. Philosophies? Challenges? 43 Philosophies •Questions are integral to lecture •Students can learn by considering a question Best practices •Ask several times during lecture •Ask challenging, meaningful questions •Don’t post until ready & give time to read 43 Handout/worksheet / whiteboard
  • 2. Peer Discussion. Philosophies? Challenges? 44 Philosophies: • Students learn through discussion • Students need to know that you value their ideas & that it’s safe to share Solutions: •Make it clear why you’re doing this • Circulate and ask questions / model •Use questions they want to discuss •Allow enough time (2-5 mins) •Focus on reasoning in wrap-up
  • Talking brings convergence 45 Eric Mazur - Harvard U.Before discussion After discussion Why do you think this happens? A B C A B (A) Students are getting answers from the ‘smart’ kids C (B) They’re learning from their discussions (C) They just needed more time to think about it Mazur, 1997
  • The hypothesis: If students learn from peer discussion, they should show better performance on a similar question. Ask a second, similar question without any instructor input: Q2 Undergrad introductory genetics course. 16 Q1/Q2 pairs.Research by MichelleSmith, Bill Wood, WendyAdams, CarlWieman, JennyKnight, Nancy Guild, TinTin Su, MCDB. Smith et al., Science. 2009, 323(5910):122.
  • Are they learning from peers? 100 100 1) Students answer 90 8080 Q1 individually. 70 6060 Percent Q Percent 50 Q Q 4040 Students talk to 2) 30 neighbors and 2020 answer Q1 again 10 (Q1AD = Q1“After 00 Q1 Q1 Q1AD Q1a Q2 Q2 Discussion”). Individual After Individual Discussion 3) Students answer Q2 individually . Q2 tests same concept as Q1. n= 350 studentsThen explain answers to Q1 and Q2 Smith et al., Science. 2009, 323(5910):122.
  • Can students answer difficult questions correctly after discussion? 100100 Q1 90 90 Very few students Q1after discussion 80 80 knew correct Q2 answer to Q1, but 70 70 Percent correct 60 60 after Percent 50 50 discussion, many 40 40 more answer 30 30 correctly: students 20 20 are constructing 10 10 their own 0 0 knowledge Easy Easy Medium Medium Hard Difficult (5 questions) (7 questions) (4 questions)Smith et al., Science. 2009, 323(5910):122.
  • Student buy-in is key!
  • 3. Wrap-Up Discussion. Challenges? 50 Philosophies: •Student ideas are important •Students need to feel safeSolutions:•Establish culture of respect•Consider whether to show the histogram immediately• Ask multiple students to defend their answers• Emphasize reasoning: Why are wrong answers wrongand why right answer is right
  • Giving the answer stops student thinking! 51
  • Other things we haven’t talked about? 52 Other challenges / solutions / philosophies?
  • Action Plan 53 Take a few minutes to write down your action plan to implement ideas you heard about in the workshop
  • U. Colorado clicker resources… 54Videos of effective use of clickers http://STEMvideos.colorado.edu2-5 mins longClicker resource page http://STEMclickers.colorado.edu • Instructor’s Guide • Question banks PLUS past workshops And all workshop materials •Literature / Articles I can help you with your institution’s workshops too
  • Thanks! Resource Page: http://STEMclickers.colorado.edu Web and blog: http://sciencegeekgirl.com Email: stephanie.chasteen@colorado.edu Many materials in this workshop (particularly the questioning cycle and the participant exercises) were adapted from Rosie Piller, Making Students Think: The Art of Questioning. Short papers published in: Computer Training & Support Conference, 1995; ISPI International Conferences, 1991 and 1996; ASTD National Conference on Technical & Skills Training, 1990. Related workshop description at http://www.educationexperts.net/nstworkshop.html. Other materials (particularly sample clicker questions and goals of clicker questions) adapted from Ian Beatty’s Technology Enhanced Formative Assessment (TEFA) program. http://ianbeatty.com/crs