Real Time Evaluation
Tips, Tools, and Tricks of the Trade
Yuqi Wang
@Yuqi_2w6
Evaluation 2015, Chicago, IL
American Evaluation Association
Wednesday, November 11, 2015
@Innonet_eval
Survey!
http://bit.ly/1G0XJNx
Agenda
1
2
3
What is RTE?
H-form
Survey
Timeline4
4
What is Real Time Evaluation (RTE)?
Collecting and analyzing data in real time, along
with audience participation and feedback.
Why use RTE?
• Enhances participation in data collection and
analysis
• Provides timely evaluation feedback
• Cultivates shared group understanding
Concepts and definitions1
Survey2
https://www.flickr.com/photos/ter-burg/9152553231/
How RTE surveys work2
Screenshot from Michael Quinn Patton’s Developmental Evaluation eStudy
How RTE surveys work2
How RTE surveys work2
Lessons Learned
Pay attention to details and organization
Decide how to quantify your responses
http://bit.ly/1RMtACI
H-form3
Why do
you
disagree?
Strongly
Disagree
Strongly
Agree
Why do
you
agree?
“We respond to the moves of the
opposition in a timely way.”
My organization
How RTE H-forms work3
Strongly
Disagree
Strongly
Agree
Why do
you
disagree?
Why do
you
agree?
STATEMENT
How RTE H-forms work3
Strongly
Disagree
Strongly
Agree
Why do
you
disagree?
Why do
you
agree?
“We respond to the moves of the
opposition in a timely way.”
My organization
Strongly
Disagree
Strongly
Agree
How RTE H-forms work3
Strongly
Disagree
Strongly
Agree
Why do
you
disagree?
Why do
you
agree?
“We respond to the moves of the
opposition in a timely way.”
My organization
Strongly
Disagree
Strongly
Agree
Lessons Learned
Prep for the H-form in advance
http://bit.ly/1RMtACI
How RTE Timelines Work4
How RTE Timelines Work4
How RTE Timelines Work4
Lessons Learned
Timelines for future events do not work
Begin a timeline before a project starts
Think about the purpose of a timeline
Events are best organized by color
http://bit.ly/1RMtACI
What we covered
1
2
3
What is RTE?
H-form
Survey
Timeline4
Thank you!
Yuqi Wang
ywang@innonet.org
@Yuqi_2w6
Real Time Evaluation
Tips, Tools, and Tricks of the Trade
@Innonet_eval

Real Time Evaluation: Tips, Tools, and Tricks of the Trade

Editor's Notes

  • #16 We used blue tape to create a line for past and present, and a dotted line for future. Participants wrote milestones on post-it notes, and successes and challenges for milestones on larger post-it notes. My colleagues Smriti, Katherine and Kat will have a Friday session on creating timelines.