This document discusses using clickers or classroom response systems to increase active engagement in large sociology courses. It provides evidence that clickers can improve learning outcomes when used consistently with good questioning techniques. Examples of effective questioning techniques include peer instruction, polling, and adding metacognition. The document encourages starting small with clickers and providing support and incentives to demonstrate their value for both instructors and students.
Clickers 201 - Effective questions in any discipline - March 2012Jeff Loats
Slides from the workshop given by Jeff Loats and Christy Cummings on March 30th, 2012. Please contact either one of us to get a copy of the handout (which includes a thorough list of scholarly references).
Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...Blackboard APAC
The higher education classroom is rapidly expanding beyond the limitations posed by brick and mortar buildings into the wide world of cyberspace. Constant accessibility to online information has created unrealistic expectations for academics to respond on demand to student questions. Course related enquiries have significantly increased due to the emergence of e-Learning and mobile devices. Academics are under increasing pressure to juggle large teaching loads whist maintaining a productive research output. This has led to an increased uptake of peer-assisted learning activities whereby students teach each other. Many questions from students could be answered by their peers. It is widely recognised that students learn more efficiently from their peers because it encourages independent, inquiry-based learning. An anonymous asynchronous online discussion board was introduced into the Blackboard platform for second year Science undergraduates as the primary source of student-student and student-academic communication. The authors will present a case study highlighting user statistics, student survey data and what they have learned from the experience.
Delivered at Innovate and Educate: Teaching and Learning Conference by Blackboard. 24 -27 August 2015 in Adelaide, Australia.
Clickers 201 - Effective questions in any discipline - March 2012Jeff Loats
Slides from the workshop given by Jeff Loats and Christy Cummings on March 30th, 2012. Please contact either one of us to get a copy of the handout (which includes a thorough list of scholarly references).
Enhancing Engagement and Promoting Peer-Assisted Learning through the Impleme...Blackboard APAC
The higher education classroom is rapidly expanding beyond the limitations posed by brick and mortar buildings into the wide world of cyberspace. Constant accessibility to online information has created unrealistic expectations for academics to respond on demand to student questions. Course related enquiries have significantly increased due to the emergence of e-Learning and mobile devices. Academics are under increasing pressure to juggle large teaching loads whist maintaining a productive research output. This has led to an increased uptake of peer-assisted learning activities whereby students teach each other. Many questions from students could be answered by their peers. It is widely recognised that students learn more efficiently from their peers because it encourages independent, inquiry-based learning. An anonymous asynchronous online discussion board was introduced into the Blackboard platform for second year Science undergraduates as the primary source of student-student and student-academic communication. The authors will present a case study highlighting user statistics, student survey data and what they have learned from the experience.
Delivered at Innovate and Educate: Teaching and Learning Conference by Blackboard. 24 -27 August 2015 in Adelaide, Australia.
Mobile, Instant, and Electronic Feedback to Increase Participation and Learni...Spencer Jardine
This presentation talks about soliciting information from students in order to understand better how to teach them during a library workshop. It includes some ideas from the research on clickers or audience response systems. Now, with cloud computing, students can be polled with text messaging and Polleverywhere.
Peerwise - Paul Denny - Edinburgh 2011 (part 2)EdUniSciEng
Part 2 of Paul Denny's presentation at the LTKB workshop, Edinburgh 2011. PeerWise is a web-based repository of MCQs built by students. Students are given the responsibility of creating and moderating the resource. By leveraging the creativity and energy of a class, a large, diverse and rich resource can result.
EPSS for Faculty Development (In-Progress Project)Saul Carliner
In this project, a team comprised of members from university and a Cegep are developing an alternate approach to professional development: an electronic performance support system (EpSS) that provides teaching support online and consists of (a) generalized and discipline-specific research-based guidance for their most significant challenges as identified by a needs assessment; (b) teaching cases that illustrate practical applications in the classroom and (c) other approaches to engage faculty with this system. This session, by the research team describes the system and summarizes the first topics covered.
A half day session for the BC Special Education Association at Crosscurrants - three pillars of collaboration: class reviews, non-categorical support model, performance-based reading assessment.
Description of a study comparing the effect of inverting the classroom & adding in-class activities to a Majors' General Biology Course. To be presented at EB2016, Monday 4/4.
This powerpoint summarizes the results of a Collaborative Action Research Project that I and several classmates coordinated as a part of our MAT Program. In order to become an effective teacher, researching skills should be developed and used (whether consciously or unconsciously). This assignment helped us work out our researching and statistics skills.
From FTEP, March 15th. Stephanie Chasteen, Science Teaching Fellow, Physics
Steven Pollock, President’s Teaching Scholar and Professor of Physics
Questioning is a central part of student assessment and quizzing, but it can also be a powerful learning tool. How does a teacher use questioning effectively? What is the right number of questions to ask? How do we avoid just giving students the answer? How do we avoid embarrassing our students, or confusing the class, if they give me the wrong answer? In this interactive workshop, we’ll explore research-based tips and ideas for questioning in a way that allow us to achieve the full benefit of questioning –student engagement and deep learning. We will focus on the use of “peer instruction” – the practice of requiring students to discuss their answers to challenging questions with one another. Peer instruction is facilitated by the use of “clickers”, but many benefits of the technique can be achieved even without the technology. We’ll discuss common challenges, share tips on getting students to productively argue and reason through the questions, and ways to encourage all students to speak up in response to questions.
Mobile, Instant, and Electronic Feedback to Increase Participation and Learni...Spencer Jardine
This presentation talks about soliciting information from students in order to understand better how to teach them during a library workshop. It includes some ideas from the research on clickers or audience response systems. Now, with cloud computing, students can be polled with text messaging and Polleverywhere.
Peerwise - Paul Denny - Edinburgh 2011 (part 2)EdUniSciEng
Part 2 of Paul Denny's presentation at the LTKB workshop, Edinburgh 2011. PeerWise is a web-based repository of MCQs built by students. Students are given the responsibility of creating and moderating the resource. By leveraging the creativity and energy of a class, a large, diverse and rich resource can result.
EPSS for Faculty Development (In-Progress Project)Saul Carliner
In this project, a team comprised of members from university and a Cegep are developing an alternate approach to professional development: an electronic performance support system (EpSS) that provides teaching support online and consists of (a) generalized and discipline-specific research-based guidance for their most significant challenges as identified by a needs assessment; (b) teaching cases that illustrate practical applications in the classroom and (c) other approaches to engage faculty with this system. This session, by the research team describes the system and summarizes the first topics covered.
A half day session for the BC Special Education Association at Crosscurrants - three pillars of collaboration: class reviews, non-categorical support model, performance-based reading assessment.
Description of a study comparing the effect of inverting the classroom & adding in-class activities to a Majors' General Biology Course. To be presented at EB2016, Monday 4/4.
This powerpoint summarizes the results of a Collaborative Action Research Project that I and several classmates coordinated as a part of our MAT Program. In order to become an effective teacher, researching skills should be developed and used (whether consciously or unconsciously). This assignment helped us work out our researching and statistics skills.
From FTEP, March 15th. Stephanie Chasteen, Science Teaching Fellow, Physics
Steven Pollock, President’s Teaching Scholar and Professor of Physics
Questioning is a central part of student assessment and quizzing, but it can also be a powerful learning tool. How does a teacher use questioning effectively? What is the right number of questions to ask? How do we avoid just giving students the answer? How do we avoid embarrassing our students, or confusing the class, if they give me the wrong answer? In this interactive workshop, we’ll explore research-based tips and ideas for questioning in a way that allow us to achieve the full benefit of questioning –student engagement and deep learning. We will focus on the use of “peer instruction” – the practice of requiring students to discuss their answers to challenging questions with one another. Peer instruction is facilitated by the use of “clickers”, but many benefits of the technique can be achieved even without the technology. We’ll discuss common challenges, share tips on getting students to productively argue and reason through the questions, and ways to encourage all students to speak up in response to questions.
CU Berkeley Workshop #2: Making it work, Effective Facilitation of Clicker Q...Stephanie Chasteen
So now you’ve got some great questions to use with clickers, but that’s no magic bullet. What might go wrong, and how do we avoid common pitfalls? How do we avoid just giving students the answer, or what if students are reluctant to discuss the questions? In this interactive workshop, we’ll explore research-based tips and ideas for questioning in a way that allow us to achieve the full benefit of clickers and peer instruction. We’ll discuss common challenges, share tips on getting students to productively argue and reason through the questions, and ways to encourage all students to speak up in response to questions. Time-depending, participants will also get a chance to practice aspects of teaching through questioning.
Make clickers work for you: Faciltiation and question writingStephanie Chasteen
Clickers can make teaching more effective and fun, but how does a teacher best use clickers in the class? In this interactive workshop, we’ll explore research-based ideas for questioning to achieve student engagement and deep learning. We will focus on the use of “peer instruction” in which students discuss challenging questions. We’ll compare example questions, practice writing questions, discuss common challenges, and share tips on getting students to productively reason through them. No software needed.
A discussion of Scholarly Teaching, with a focus on three areas:
- Active engagement during class time
- Effective preparation (students & instructors)
- Feedback loops and iterative learning
Phystec Conference: The Gentle Art of Questioning. Writing Great Clicker Qu...Stephanie Chasteen
How does a teacher use questioning effectively? This workshop will focus on writing those questions that engage students, spark their curiosity, help recap material, give you insight into their thinking, or help them learn critical ideas in physics. We will focus on "peer instruction" -- a research-tested method of requiring students to discuss challenging questions with one another. We will investigate the surprising power of multiple-choice questions to achieve critical thinking skills. Finally, we will look at writing questions that align with our goals for students, discuss the elements of effective questions, and practice writing questions and work on improving them.
This is a workshop that I presented for the Faculty Teaching Excellence Program of CU-Boulder in Feb 2012.
---
This workshop will focus on writing those questions for use with peer instruction that engage students, spark their curiosity, help recap material, give you insight into their thinking, or help them learn critical ideas in your discipline. We will investigate the surprising power of multiple-choice questions to achieve critical thinking skills. We will practice writing questions that align with our goals for students, discuss the elements of effective questions, and look at various examples to get ideas for our own courses.
CU Berkeley Workshop #1: Writing Great Clicker QuestionsStephanie Chasteen
How does a teacher use questioning effectively? This workshop will focus on writing those questions that engage students, spark their curiosity, help recap material, give you insight into their thinking, or help them learn critical ideas in your discipline. We will focus on the use of clickers with "peer instruction" -- a research-tested method of requiring students to discuss challenging questions with one another. We will discuss how clickers can help facilitate this teaching strategy, investigate the surprising power of multiple-choice questions to achieve critical thinking skills, plus spend time discussing the elements of effective questions and practicing writing and improving questions for our classes.
JiTT - Blended Learning Across the Academy - Teaching Prof. Tech - Oct 2015Jeff Loats
A four-person panel discusses the implementation of Just-in-Time Teaching in 18 courses across 5 disciplines. Participation rates and correlations with other outcomes are discussed.
Scholarly Teaching - Aims CC Keynote - Sept 2016Jeff Loats
Much like doctors should be knowledgeable about the most up-to-date methods of treating patients. Teachers should know the empirical evidence on the best teaching methods. They need to be social scientists!
JiTT - Tilting Classes Across the Academy - COLTT 2016Jeff Loats
Myself and two colleagues present on the basics of Just-in-Time Teaching as well as the preliminary results of our research on the effectiveness of JiTT in different disciplines and for different types of students (as measured by the BIg Five personality traits).
TLTS 2015 - JiTT - A Strategy For Success - Oct 2015Jeff Loats
Slides from a 40-minutes panel presentation discussing the effectiveness of Just-in-Time Teaching across many disciplines, levels of courses and course-types.
Presenters:
Arlene Sgoutas
Jeff Loats
Randi Smith
Courtney Rocheleau
90 minute presentation on Just-in-Time Teaching, including motivation for change, evidence for effectiveness, the best tools to use, writing good questions and getting student buy-in.
COLTT 2015 - Just-in-Time Teaching - Part 2 - Making It Shine - Aug 2015Jeff Loats
A second session, focusing on how to make the technique really work in the classroom. Topics: JiTT recap, participant questions, what tool to use, getting student buy-in and writing good questions.
This presentation focuses less on what JiTT is and the evidence for its effectiveness..
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptxEduSkills OECD
Andreas Schleicher presents at the OECD webinar ‘Digital devices in schools: detrimental distraction or secret to success?’ on 27 May 2024. The presentation was based on findings from PISA 2022 results and the webinar helped launch the PISA in Focus ‘Managing screen time: How to protect and equip students against distraction’ https://www.oecd-ilibrary.org/education/managing-screen-time_7c225af4-en and the OECD Education Policy Perspective ‘Students, digital devices and success’ can be found here - https://oe.cd/il/5yV
Ethnobotany and Ethnopharmacology:
Ethnobotany in herbal drug evaluation,
Impact of Ethnobotany in traditional medicine,
New development in herbals,
Bio-prospecting tools for drug discovery,
Role of Ethnopharmacology in drug evaluation,
Reverse Pharmacology.
How to Create Map Views in the Odoo 17 ERPCeline George
The map views are useful for providing a geographical representation of data. They allow users to visualize and analyze the data in a more intuitive manner.
Synthetic Fiber Construction in lab .pptxPavel ( NSTU)
Synthetic fiber production is a fascinating and complex field that blends chemistry, engineering, and environmental science. By understanding these aspects, students can gain a comprehensive view of synthetic fiber production, its impact on society and the environment, and the potential for future innovations. Synthetic fibers play a crucial role in modern society, impacting various aspects of daily life, industry, and the environment. ynthetic fibers are integral to modern life, offering a range of benefits from cost-effectiveness and versatility to innovative applications and performance characteristics. While they pose environmental challenges, ongoing research and development aim to create more sustainable and eco-friendly alternatives. Understanding the importance of synthetic fibers helps in appreciating their role in the economy, industry, and daily life, while also emphasizing the need for sustainable practices and innovation.
The French Revolution, which began in 1789, was a period of radical social and political upheaval in France. It marked the decline of absolute monarchies, the rise of secular and democratic republics, and the eventual rise of Napoleon Bonaparte. This revolutionary period is crucial in understanding the transition from feudalism to modernity in Europe.
For more information, visit-www.vavaclasses.com
4. 4
Are you currently using clickers or another
classroom response system in your courses?
A) I have never used them.
B) I have used them before, but don’t currently.
C) I use them currently in at least one class.
8. 8
MAZUR’S PERSONAL REVOLUTION
(added) Pre-class reading, enforced
(removed) Most sample problems
(removed) Derivations
(modified) Lecture broken up into small bites
(added) Depth over coverage
(added) Concept Tests with Peer Instruction
9. 9
PEER INSTRUCTION
• Multiple choice questions
– Conceptual
– Hard
1. Students answer Individually
2. Discussion with peers
3. Students answer post-discussion
4. Class-wide discussion
10. 10
Students have developed a robot dog
and a robot cat, both of which can
run at 8 mph and walk at 4 mph.
A the end of the term, there is a race!
The robot cat must run for half of its
racing time, then walk.
The robot dog must run for half the
racing distance, then walk.
Which one wins the race?
A) Robot cat B) Robot dog C) They tie
18. 18
Do you feel you were treated fairly at all
levels of review when you had your most
recent professional review (renewal, tenure,
promotion, etc.)?
A) Yes
B) No
First: Women only Second: Men only
19. 19
How large of an effect does bias have in the
social sciences? [Measurement was of faculty
responsiveness to prospective student emails.]
A) Women/minorities do worse by ~11%)
B) Women/minorities do worse by ~3%
C) No difference across gender/ethnicities
D) Caucasian males do worse by ~3%
E) Caucasian males do worse by ~11%
20. 20
POLL-TEACH-POLL
• Poll but don’t show results
• Teach
• Poll again to explore shifts in attitudes
• Peer sharing for added metacognition
• Insightful results for instructor
21. 21
Which best describes your feelings about female
circumcision/female genital mutilation?
A) I am writing letters to the WHO to protest.
B) To each their own… we shouldn’t interfere
with another culture.
C) What is the big deal… males around the world
are circumcised.
D) I don’t know anything about it.
22. 22
THOUGHT QUESTIONS
• Choose a relevant open-ended question.
• Small group discussion
• Presentation & defense by a single group
• Class votes: Agree/Disagree/Don’t know
• Majority disagrees? Next group presents!
• Repeat until majority agrees
Created by Teresa Foley & Pei-San Tai
from the CU Integrative Physiology Department
23. 23
Endocrinology:
What would you predict would happen to the
ovulatory frequency if one ovary were removed?
Immunology:
Given that all blood cell types derive from the
pluripotent hemopoietic stem cell, why are there
so many different types of cells in the immune
system?
25. 25
ADDING METACOGNITION
“… and I can explain why”
“… but I don’t know why”
• Good for two-choice questions
• Adds to formative assessment value
26. 26
THE EVIDENCE STANDARD
• Quick/easy attendance in large class sizes.
• Provides anonymity (Banks, 2006).
• Every student participates (Banks, 2006).
• Encourages active learning (Martyn, 2007).
27. 27
THE EVIDENCE STANDARD
• Improved concentration (Hinde & Hunt, 2006)
• Improved learning and retention (Moreau, 2010).
• Improved exam scores (Poirier & Feldman, 2007)
• Efficient use of class time (Anderson, et al. 2011).
29. 29
BEST PRACTICES
• Start small – 5 min of each hour of class
• Sell it – Be explicit about why
• Be consistent – Nearly every class
• Engage students – Wait for explanation
• Demonstrate value – Focus on wrong answers
• Follow up – Assessments must change
• Credit – 2%-15% for participation… mostly.
30. 30
GET SUPPORTED!
• Try it… but be smart!
• Resources:
– Center for Faculty Development
– Metro’s TLT Conference (Oct. 26th)
– Teacher Scholar Forum (Feb. 22nd)
– Me (visit, email, chat, etc.)
– Colleagues!
31. 31
YOUR SUMMARY
For yourself… or to share?
What part of how or why to use clickers is the
fuzziest for you after this talk?
What is the biggest reason you might not give
clickers a try in one course next term?
Contact me: Jeff.Loats@gmail.com
Presentation: www.slideshare.net/jeffloats
Editor's Notes
“Learning technologies should be designed to increase, and not to reduce, the amount of personal contact between students and faculty on intellectual issues.”(Study Group on the Conditions of Excellencein American Higher Education, 1984)“The challenge is not simply to incorporate learning technologies into current institutional approaches, but rather to change our fundamental views about effective teaching and learning and to use technology to do so.” (Higher Education in an Era of Digital Competition, Donald E. Hanna)
Asking
About ~20 years ago, physics teachers began treating education as a research topic!Their findings were pretty grim"But the students do fine on my exams!“It appeared that students had been engaging in “surface learning” allowing them to solve problems algorithmically without actually understanding the concepts.
Was this just at Harvard (silly question)!Data from H.S., 2-year, 4-year, universities, etc.0.23 Hake gain on the FCI means that of the newtonian physics they could have learned in physics class, they learned 23% of it.Conclusion: Traditional physics lectures are all similarly (in)effective in improving conceptual understanding.
Enter Physics Education Research:An effort to find empirically tested ways to improve the situation.
Students had fragile knowledge from engaging in surface learningObviously this isn't what he thought he was teaching.Very “learner centered” moveClass time is now almost entirely focused on tackling tough conceptual questionsLater shifted to JiTT instead of reading quizzes
Carefully chosen questionsIdeally: 30-70% correct on first try)In 95% of cases, students “migrate” towards correct answer, often dramatically.Explanation and discussion by instructor follows the second “vote”, as necessary.In my class, participation is required (5% of final grade) but correctness is not required.
Asking
Is this just about new energy being put into an old class?(This is a difficult confounding factor in assessing new teaching techniques.)
Is this just about new energy being put into an old class?
Can occasionally serve as a reading quiz or as a lecture diagnostic.Students rate these questions as much less valuable compared to harder, deeper questions.If these are “high-stakes,” technical difficulties become even more problematic.
Not asking
Polls or surveys provide a way for students to express their opinion on topics, when they otherwise might remain quiet. Polls or surveys can be used as a comparison with statistics in the text.Students enjoy voting on controversial topics. The classroom can quickly become more animated after viewing the results.
Not asking
AskingActual results:Social science faculty responded 2.5% more to white men (71% vs. 68.5%)Natural, physical sciences and math responded 5.9% more (69.8% vs. 63.9%)
Polling first (without showing the results), then teaching, then polling again allows tracking of changes in student attitudes or opinions. Can enhance critical thinking (analyzing, evaluating).Increases metacognition (partner/peer share).Provides quick checks on knowledge and understanding of material.
Not asking
Start by choosing a learning goal to assess.Develop an open-ended application/prediction question for the goal.Present the question, organize groups of 3-4 students and allow 5-7 minutes for discussion.One group presents their answer and rationale.Class votes on rationale: Agree/Disagree/Don’t know.If the majority of the class disagrees, another group gets to offer their answer and rationale.Repeat 5 & 6 until the majority agrees.
Hee-mo-poe-ee-dic
Reference for repeated testing beating out repeated studying is: Roediger & Karpicke, 2006
Hinde & Hunt: We survey 219 first-year business studies students tackling introductory economics, and find that the technology enhances learning in lectures because, among other things, it improves concentration, provides instantaneous and more effective student feedback, and allows students to make comparisons on how well they fare relative to their peers. Moreau, 2010: Overall, the experimental group scored higher on the posttest than the control group, and weak students in the experimental group made more improvement as measured by the posttest than similar ability students in the control groupPoirier & Feldman, 2007: There are reports of modest increases in exam grades when instructors use clickers to test concepts and probe opinions in large sections of introductory psychology .Anderson, et al. 2011: Compression (dropping topics that are well understood) based on group, or individual-level performance caused no decrease in learning compared to no compression.
Hinde & Hunt: We survey 219 first-year business studies students tackling introductory economics, and find that the technology enhances learning in lectures because, among other things, it improves concentration, provides instantaneous and more effective student feedback, and allows students to make comparisons on how well they fare relative to their peers. Moreau, 2010: Overall, the experimental group scored higher on the posttest than the control group, and weak students in the experimental group made more improvement as measured by the posttest than similar ability students in the control groupPoirier & Feldman, 2007: There are reports of modest increases in exam grades when instructors use clickers to test concepts and probe opinions in large sections of introductory psychology .Anderson, et al. 2011: Compression (dropping topics that are well understood) based on group, or individual-level performance caused no decrease in learning compared to no compression.
The 10% rule or 5 min/hour.Clicker questions should be worth credit (2% - 15%)Give 2-3 “free days” to reduce complaints/excusesGrading based on correctness:Distorts student discussion and learning strategies.Limits question types.Leads to technology/human issues: “I meant to hit, C!”Grade based on participation (mostly?)Immediate feedback without penalty seems key to learning.Allows for “bad” questions that are still great for learning.Occasional “must be correct” questions can motivate.