This document discusses the use of classroom response systems, also known as clickers, to promote active engagement in university courses. It provides an overview of techniques like peer instruction and thought questions that can be used with clickers. The evidence suggests that clickers help students learn and perform better on assessments by encouraging participation and concentration. While clickers are effective, the presenter emphasizes that pedagogical techniques are more important than the technology itself, and instructors should start small and focus on conceptual understanding over factual recall.
Clickers 201 - Effective questions in any discipline - March 2012Jeff Loats
Slides from the workshop given by Jeff Loats and Christy Cummings on March 30th, 2012. Please contact either one of us to get a copy of the handout (which includes a thorough list of scholarly references).
Accounting 1 students used the one minute paper at the end of each tutorial over one semester. there was a significant improvement in final results compared to the same cohort in the previous years. Students recognised that the revision component of the one minute paper assisted their learning but did not recognise the benefits in the reflection process implicit in writing the one-minute paper. Students may need assistance with reflection.
Clickers 201 - Effective questions in any discipline - March 2012Jeff Loats
Slides from the workshop given by Jeff Loats and Christy Cummings on March 30th, 2012. Please contact either one of us to get a copy of the handout (which includes a thorough list of scholarly references).
Accounting 1 students used the one minute paper at the end of each tutorial over one semester. there was a significant improvement in final results compared to the same cohort in the previous years. Students recognised that the revision component of the one minute paper assisted their learning but did not recognise the benefits in the reflection process implicit in writing the one-minute paper. Students may need assistance with reflection.
How to fit an elephant into a cool box: Programme Assessment re-visitedTansy Jessop
TESTA has shown the value of looking beyond modules to the big picture of assessment and feedback in higher education. This presentation looked at TESTA's three big ideas: (1) Modules as the wrong metaphor for student learning; (2) Matching assessment and feedback to educational paradigms which enable learning; (3) Beyond content as curriculum.
Learn about SBAC's definition for formative assessment and tech tools that can be used to gather student data, give feedback, and capture student thinking.
Description of a study comparing the effect of inverting the classroom & adding in-class activities to a Majors' General Biology Course. To be presented at EB2016, Monday 4/4.
Mobile, Instant, and Electronic Feedback to Increase Participation and Learni...Spencer Jardine
This presentation talks about soliciting information from students in order to understand better how to teach them during a library workshop. It includes some ideas from the research on clickers or audience response systems. Now, with cloud computing, students can be polled with text messaging and Polleverywhere.
How to fit an elephant into a cool box: Programme Assessment re-visitedTansy Jessop
TESTA has shown the value of looking beyond modules to the big picture of assessment and feedback in higher education. This presentation looked at TESTA's three big ideas: (1) Modules as the wrong metaphor for student learning; (2) Matching assessment and feedback to educational paradigms which enable learning; (3) Beyond content as curriculum.
Learn about SBAC's definition for formative assessment and tech tools that can be used to gather student data, give feedback, and capture student thinking.
Description of a study comparing the effect of inverting the classroom & adding in-class activities to a Majors' General Biology Course. To be presented at EB2016, Monday 4/4.
Mobile, Instant, and Electronic Feedback to Increase Participation and Learni...Spencer Jardine
This presentation talks about soliciting information from students in order to understand better how to teach them during a library workshop. It includes some ideas from the research on clickers or audience response systems. Now, with cloud computing, students can be polled with text messaging and Polleverywhere.
An economic analysis of student's perceptions of a web-based response system utilized as a classroom tool. Includes effects on student outcomes from the tool as well as student survey data.
Making proofs click: Classroom response systems in transition-to-proof coursesRobert Talbert
[Presentation given at the AMS/MAA Joint Meetings, Boston, MA on 1/4/2012.]
Transition-to-proof courses, designed to prepare students from calculus and other lower-level courses for the methodology
of upper-level mathematics, are often dicult for students in several ways. Students who are used to purely algorithmic
approaches to mathematics experience culture shock at the more open-ended and uncertain mathematical world that such
courses introduce. The elements of communication and writing often play a much larger role in these courses than in
earlier ones. And generally, these courses signal a major change in the way students conceive of the study of mathematics,
which can make further study of mathematics stressfully forbidding.
Technology can help students make this transition. In particular, classroom response systems, or "clickers", open
up the classroom to a range of pedagogical approaches that can help students learn mathematical abstraction and
good mathematical writing practice. In this talk, we discuss some instances of clicker-enabled pedagogy in the author's
Communicating in Mathematics class, including peer instruction, and peer review of writing samples.
Classroom response systems in mathematics: Learning math better through votingRobert Talbert
Have you ever wondered if there's a simple way to get students more engaged in a math class? Do you feel that students would benefit from an enhanced focus on conceptual learning in math? If so, there's a simple solution: Let students vote. This session describes different ways to incorporate student voting into mathematics classes, particularly through the use of classroom response systems or "clickers". Of particular interest is peer instruction, a teaching technique that combines the best elements of the flipped classroom, direct instruction, and collaborative learning with a twist of voting to make it all work.
(These are slides from a session given at Math in Action 2012 on the campus of Grand Valley State University, Allendale, MI on February 25, 2012.)
Better Learning Through Voting: Using classroom response systems to improve s...Robert Talbert
Slides from the first portion of a workshop on classroom response systems (clickers) given to faculty at Ferris State University, 23 August 2013. Facilitated by Robert Talbert, PhD., Department of Mathematics, Grand Valley State University.
Faculty Development Seminar Series - This presentation will describe the core content that should appear in the Curriculum Vitae (CV) of residents, graduate students, and faculty members involved in contemporary academic medicine. A Recommended format will be presented, along with the rationale for using this standard format. Consideration will be given to the many potential uses of a well-polished CV, and how one's CV may evolve over the course of a long career. Suggestions will be given about how and why to keep your CV up-to-date.
BYOD (Bring Your Own Device) in the Classroom: Two Tech Tools for Fostering ...maritezita
Maritez Apigo's presentation at the Strengthening Student Success Conference on October 5, 2016 at Hyatt Regency Orange County
Tired of telling your students to put away their phones? Instead, instruct your students to take them out! The presenter will showcase two user-friendly educational technology tools for engaging students in interactive polls and administering formative assessments of student learning outcomes on their mobile devices: Poll Everywhere and Socrative. These student response systems allow instructors to identify students in need of targeted intervention strategies and to apply data-driven instruction. Through the techniques modeled and examples shared, the presenter will demonstrate the benefits of integrating technology in the classroom to advance equity and student success. This session will also provide tips and helpful resources for getting started and troubleshooting with these technologies. Bring your smartphone, iPad, tablet, or laptop to fully participate in this interactive session.
http://maritez.populr.me/sssc16
To click or not to click? Managing Classroom Response System in a large classCIT, NUS
By Victor Tan. Department of Mathematics, NUS.
http://www.youtube.com/watch?v=vLjUralh7ZA&p=83FA1CD871F4A4E5
There are many clear advantages of using Classroom Response System (CRS) in class. When it is used effectively, CRS will promote active learning, and students will be more engaged during the lecture. However, it takes huge courage for a lecturer or module coordinator to take the first step to implement CRS in their classroom teaching. Other than having to manage the system while delivering the lecture at the same time, there are many logistical issues involved, such as the issuing and collecting the clickers. In this talk, I will share with the audience my experience of using and managing CRS in a math module of more than 400 students.
JiTT - Blended Learning Across the Academy - Teaching Prof. Tech - Oct 2015Jeff Loats
A four-person panel discusses the implementation of Just-in-Time Teaching in 18 courses across 5 disciplines. Participation rates and correlations with other outcomes are discussed.
From FTEP, March 15th. Stephanie Chasteen, Science Teaching Fellow, Physics
Steven Pollock, President’s Teaching Scholar and Professor of Physics
Questioning is a central part of student assessment and quizzing, but it can also be a powerful learning tool. How does a teacher use questioning effectively? What is the right number of questions to ask? How do we avoid just giving students the answer? How do we avoid embarrassing our students, or confusing the class, if they give me the wrong answer? In this interactive workshop, we’ll explore research-based tips and ideas for questioning in a way that allow us to achieve the full benefit of questioning –student engagement and deep learning. We will focus on the use of “peer instruction” – the practice of requiring students to discuss their answers to challenging questions with one another. Peer instruction is facilitated by the use of “clickers”, but many benefits of the technique can be achieved even without the technology. We’ll discuss common challenges, share tips on getting students to productively argue and reason through the questions, and ways to encourage all students to speak up in response to questions.
Questioning is a central part of student assessment and quizzing, but it can also be a powerful learning tool. In this interactive workshop, we’ll explore research-based tips and ideas for achieving the full benefit of questioning. Effective use of common questioning tools -- clickers and discussion boards -- will be discussed as a means to achieve student engagement and deep learning.
A discussion of Scholarly Teaching, with a focus on three areas:
- Active engagement during class time
- Effective preparation (students & instructors)
- Feedback loops and iterative learning
Make clickers work for you: Faciltiation and question writingStephanie Chasteen
Clickers can make teaching more effective and fun, but how does a teacher best use clickers in the class? In this interactive workshop, we’ll explore research-based ideas for questioning to achieve student engagement and deep learning. We will focus on the use of “peer instruction” in which students discuss challenging questions. We’ll compare example questions, practice writing questions, discuss common challenges, and share tips on getting students to productively reason through them. No software needed.
CU Berkeley Workshop #2: Making it work, Effective Facilitation of Clicker Q...Stephanie Chasteen
So now you’ve got some great questions to use with clickers, but that’s no magic bullet. What might go wrong, and how do we avoid common pitfalls? How do we avoid just giving students the answer, or what if students are reluctant to discuss the questions? In this interactive workshop, we’ll explore research-based tips and ideas for questioning in a way that allow us to achieve the full benefit of clickers and peer instruction. We’ll discuss common challenges, share tips on getting students to productively argue and reason through the questions, and ways to encourage all students to speak up in response to questions. Time-depending, participants will also get a chance to practice aspects of teaching through questioning.
Scholarly Teaching - Aims CC Keynote - Sept 2016Jeff Loats
Much like doctors should be knowledgeable about the most up-to-date methods of treating patients. Teachers should know the empirical evidence on the best teaching methods. They need to be social scientists!
JiTT - Tilting Classes Across the Academy - COLTT 2016Jeff Loats
Myself and two colleagues present on the basics of Just-in-Time Teaching as well as the preliminary results of our research on the effectiveness of JiTT in different disciplines and for different types of students (as measured by the BIg Five personality traits).
TLTS 2015 - JiTT - A Strategy For Success - Oct 2015Jeff Loats
Slides from a 40-minutes panel presentation discussing the effectiveness of Just-in-Time Teaching across many disciplines, levels of courses and course-types.
Presenters:
Arlene Sgoutas
Jeff Loats
Randi Smith
Courtney Rocheleau
90 minute presentation on Just-in-Time Teaching, including motivation for change, evidence for effectiveness, the best tools to use, writing good questions and getting student buy-in.
COLTT 2015 - Just-in-Time Teaching - Part 2 - Making It Shine - Aug 2015Jeff Loats
A second session, focusing on how to make the technique really work in the classroom. Topics: JiTT recap, participant questions, what tool to use, getting student buy-in and writing good questions.
This presentation focuses less on what JiTT is and the evidence for its effectiveness..
How to Create Map Views in the Odoo 17 ERPCeline George
The map views are useful for providing a geographical representation of data. They allow users to visualize and analyze the data in a more intuitive manner.
The Art Pastor's Guide to Sabbath | Steve ThomasonSteve Thomason
What is the purpose of the Sabbath Law in the Torah. It is interesting to compare how the context of the law shifts from Exodus to Deuteronomy. Who gets to rest, and why?
We all have good and bad thoughts from time to time and situation to situation. We are bombarded daily with spiraling thoughts(both negative and positive) creating all-consuming feel , making us difficult to manage with associated suffering. Good thoughts are like our Mob Signal (Positive thought) amidst noise(negative thought) in the atmosphere. Negative thoughts like noise outweigh positive thoughts. These thoughts often create unwanted confusion, trouble, stress and frustration in our mind as well as chaos in our physical world. Negative thoughts are also known as “distorted thinking”.
2. THE TECHNOLOGY CHALLENGE
2
“The challenge is not simply to incorporate
learning technologies into current institutional
approaches, but rather to change our
fundamental views about effective teaching and
learning and to use technology to do so.”
(Higher Education in an Era of Digital Competition, Donald E. Hanna)
3. GUIDING PRINCIPLES
3
Technology is not an educational panacea
Seek tools that offer new approaches
As always, let evidence guide our attention
4. OVERVIEW
4
1. Motivation for change
2. Peer Instruction
3. Technology options
4. Question types
5. Practice writing questions
6. Evidence for effectiveness
7. Summaries
5. 5
In (roughly) what area do you teach?
A) Humanities
B) Natural sciences & mathematics
C) Professions & applied sciences
D) Social sciences
E) Teacher education
6. 6
Are you currently using clickers or another
classroom response system in your courses?
A) I have never used them.
B) I have used them before, but don’t currently.
C) I use them currently in at least one class.
10. FEEDBACK THAT WORKS
10
“Improvement of performance is actually a
function of two perceptual processes.The
individual’s perception of the standards of
performance, and her/his perception of his/her
own performance.”
The Feedback Fallacy – Steve Falkenberg (via Linda Nilson)
12. MAZUR’S PERSONAL REVOLUTION
12
(added) Pre-class reading, enforced
(removed) Most sample problems
(removed) Derivations
(modified) Lecture broken up into small bites
(added) Depth over coverage
(added) ConceptTests with Peer Instruction
13. PEER INSTRUCTION
13
Multiple choice questions
–Conceptual
–Hard
1. Students answer Individually
2. Discussion with peers
3. Students answer post-discussion
4. Class-wide discussion
14. Students have developed a robot dog
and a robot cat, both of which can
run at 8 mph and walk at 4 mph.
A the end of the term, there is a race!
The robot cat must run for half of its
racing time, then walk.
The robot dog must run for half the
racing distance, then walk.
Which one wins the race?
A) Robot cat B) Robot dog C) They tie
14
23. Do you feel you were treated fairly at all
levels of review when you had your most
recent professional review (renewal, tenure,
promotion, etc.)?
A) Yes
B) No
First:Women only Second: Men only
23
24. How large of an effect does bias have in the social
sciences? [Measurement was of faculty
responsiveness to prospective student emails.]
A) Women/minorities do worse by ~11%)
B) Women/minorities do worse by ~3%
C) No difference across gender/ethnicities
D) Caucasian males do worse by ~3%
E) Caucasian males do worse by ~11%
24
25. POLL-TEACH-POLL
25
1. Poll but don’t show results
2. Teach
3. Poll again (explore shifts in attitude)
Peer sharing for added metacognition
Insightful results for instructor
26. Which best describes your feelings about female
circumcision/female genital mutilation?
A) I am writing letters to theWHO to protest.
B) To each their own… we shouldn’t interfere
with another culture.
C) What is the big deal… males around the world
are circumcised.
D) I don’t know anything about it.
26
27. THOUGHT QUESTIONS
27
• Choose a relevant open-ended question.
• Small group discussion
• Presentation & defense by a single group
• Class votes: Agree/Disagree/Don’t know
• If threshold isn’t met… next group presents!
Repeat until majority agrees
Created byTeresa Foley & Pei-SanTai
from the CU Integrative Physiology Department
28. Endocrinology:
What would you predict would happen to the
ovulatory frequency if one ovary were removed?
Immunology:
Given that all blood cell types derive from the
pluripotent hemopoietic stem cell, why are there
so many different types of cells in the immune
system?
28
32. WRITE A QUESTION AND SHARE...
32
Imagine an introductory course and a topic early
in that course.
Write a question, then share
Peer Instruction
Factual recall (add metacognition?)
Polling/survey
Poll-Teach-Poll
Thought Questions
Teach-Test-Retest
33. THE EVIDENCE STANDARD
33
Quick/easy attendance in large class sizes.
Provides anonymity (Banks, 2006).
Every student participates (Banks, 2006).
Encourages active learning (Martyn, 2007).
34. THE EVIDENCE STANDARD
34
Improved concentration (Hinde & Hunt, 2006)
Improved learning and retention
(Moreau, 2010).
Improved exam scores (Poirier & Feldman, 2007)
Efficient use of class time
(Anderson, et al. 2011).
35. STUDENT FEEDBACK ON CLICKERS
315 students in 7 classes over 4 terms (roughly ±6%)
Rated on 5 point scale (strongly disagree to agree)
The use of iClickers, and activities
that used them have…
Agreed or
Strongly Agreed
…helped me to stay more engaged
in class than I would otherwise be.
93%
…helped me to learn the material
better than I otherwise would
83%
…been worth the cost to buy them 78%
36. WHAT MIGHT STOPYOU?
36
In terms of the technique:
Time, coverage, not doing your part, pushback…
In terms of the technology:
Learning curve, tech. failures, perfectionism…
In any reform of your teaching:
Reinventing, no support, too much at once…
37. BEST PRACTICES
37
Start small – 5 min of each hour of class
Sell it – Be explicit about why
Be consistent – Nearly every class
Engage students –Wait for explanation
Demonstrate value – Focus on wrong answers
Follow up – Assessments must change
Credit – 2%-15% for participation… mostly.
38. MY SUMMARY
38
Classroom response systems can be integrated
into most teaching styles and disciplines to good
effect.
From an evidence-based perspective, classroom
response systems addresses often-neglected
areas.
As with all reforms, be prepared to find that
students know less than we might hope.
39. YOUR SUMMARY
39
For yourself… or to share?
What part of using a classroom response system
is the fuzziest for you after this?
What is the biggest reason you thing trying a
classroom response system might work well?
Contact Jeff: Jeff.Loats@gmail.com
Today’s slides: www.slideshare.net/JeffLoats
Editor's Notes
“Learning technologies should be designed to increase, and not to reduce, the amount of personal contact between students and faculty on intellectual issues.”Study Group on the Conditions of Excellence in American Higher Education, 1984
“Learning technologies should be designed to increase, and not to reduce, the amount of personal contact between students and faculty on intellectual issues.”(Study Group on the Conditions of Excellencein American Higher Education, 1984)
Asking
Asking
About ~20 years ago, physics teachers began treating education as a research topic!Their findings were pretty grim"But the students do fine on my exams!“It appeared that students had been engaging in “surface learning” allowing them to solve problems algorithmically without actually understanding the concepts.
Was this just at Harvard (silly question)!Data from H.S., 2-year, 4-year, universities, etc.0.23 Hake gain on the FCI means that of the newtonian physics they could have learned in physics class, they learned 23% of it.Conclusion: Traditional physics lectures are all similarly (in)effective in improving conceptual understanding.
Enter Physics Education Research:An effort to find empirically tested ways to improve the situation.
Students had fragile knowledge from engaging in surface learningObviously this isn't what he thought he was teaching.Very “learner centered” moveClass time is now almost entirely focused on tackling tough conceptual questionsLater shifted to JiTT instead of reading quizzes
Carefully chosen questionsIdeally: 30-70% correct on first try)In 95% of cases, students “migrate” towards correct answer, often dramatically.Explanation and discussion by instructor follows the second “vote”, as necessary.In my class, participation is required (5% of final grade) but correctness is not required.
Is this just about new energy being put into an old class?(This is a difficult confounding factor in assessing new teaching techniques.)
Is this just about new energy being put into an old class?
Can occasionally serve as a reading quiz or as a lecture diagnostic.Students rate these questions as much less valuable compared to harder, deeper questions.If these are “high-stakes,” technical difficulties become even more problematic.
Polls or surveys provide a way for students to express their opinion on topics, when they otherwise might remain quiet. Polls or surveys can be used as a comparison with statistics in the text.Students enjoy voting on controversial topics. The classroom can quickly become more animated after viewing the results.
Actual results:Social science faculty responded 2.5% more to white men (71% vs. 68.5%)Natural, physical sciences and math responded 5.9% more (69.8% vs. 63.9%)
Polling first (without showing the results), then teaching, then polling again allows tracking of changes in student attitudes or opinions. Can enhance critical thinking (analyzing, evaluating).Increases metacognition (partner/peer share).Provides quick checks on knowledge and understanding of material.
Start by choosing a learning goal to assess.Develop an open-ended application/prediction question for the goal.Present the question, organize groups of 3-4 students and allow 5-7 minutes for discussion.One group presents their answer and rationale.Class votes on rationale: Agree/Disagree/Don’t know.If the majority of the class disagrees, another group gets to offer their answer and rationale.Repeat 5 & 6 until the majority agrees.
Reference for repeated testing beating out repeated studying is: Roediger & Karpicke, 2006
Major caveat: Using classroom response system does not automatically bring these benefits. The method matters much more than the means.Hinde & Hunt: We survey 219 first-year business studies students tackling introductory economics, and find that the technology enhances learning in lectures because, among other things, it improves concentration, provides instantaneous and more effective student feedback, and allows students to make comparisons on how well they fare relative to their peers. Moreau, 2010: Overall, the experimental group scored higher on the posttest than the control group, and weak students in the experimental group made more improvement as measured by the posttest than similar ability students in the control groupPoirier & Feldman, 2007: There are reports of modest increases in exam grades when instructors use clickers to test concepts and probe opinions in large sections of introductory psychology .Anderson, et al. 2011: Compression (dropping topics that are well understood) based on group, or individual-level performance caused no decrease in learning compared to no compression.
Hinde & Hunt: We survey 219 first-year business studies students tackling introductory economics, and find that the technology enhances learning in lectures because, among other things, it improves concentration, provides instantaneous and more effective student feedback, and allows students to make comparisons on how well they fare relative to their peers. Moreau, 2010: Overall, the experimental group scored higher on the posttest than the control group, and weak students in the experimental group made more improvement as measured by the posttest than similar ability students in the control groupPoirier & Feldman, 2007: There are reports of modest increases in exam grades when instructors use clickers to test concepts and probe opinions in large sections of introductory psychology .Anderson, et al. 2011: Compression (dropping topics that are well understood) based on group, or individual-level performance caused no decrease in learning compared to no compression.
The 10% rule or 5 min/hour.Clicker questions should be worth credit (2% - 15%)Give 2-3 “free days” to reduce complaints/excusesGrading based on correctness:Distorts student discussion and learning strategies.Limits question types.Leads to technology/human issues: “I meant to hit, C!”Grade based on participation (mostly?)Immediate feedback without penalty seems key to learning.Allows for “bad” questions that are still great for learning.Occasional “must be correct” questions can motivate.