Text2Review Insights and Results


Published on

Results and Insights from 3 Texting Pilots Designed to Promote Better Study Habits

Published in: Education, Technology
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Text2Review Insights and Results

  1. 1. Text2ReviewResults and Insights from 3 Texting Pilots Designed to Promote Better Study Habits <br />Andrew Martin<br />Stanford University ‘13<br />@amartinsu13<br />#calmingtech<br />
  2. 2. What’s the Problem?<br />Students attend class, take notes, but then LEAVE class without reviewing what they just learned.<br />They don’t look back on their notes until a week later when they need to do homework<br />OR worse yet, months later when they cram for exams.<br />This leads to high levels of stress when students cram for exams, rather than slowly learning and internalizing over a quarter.<br />
  3. 3. What’s our BIG Abstract Goal?<br />To get students to study more EFFECTIVELY, thereby reducing the inherent stress when cramming under an imminent time deadline<br />Yes, a LOFTY goal, but if you break this large goal into many small target behaviors that matter, it is possible.<br />The key? Hot trigger each behavior at the correct time, and reinforce each one until they become habits.<br />These texting pilots are testing the FIRST, smallest target behavior to reach this goal.<br />
  4. 4. What are our Assumptions?<br />From BJ Fogg’s Behavior Design principles:<br />Humans are LAZY, sloppy thinkers<br />Humans are creatures of HABIT<br />Don’t assume that people have the willpower to do anything<br />When designing solutions, start with the most motivated people<br />
  5. 5. Smallest Behavior That Matters / Study Design<br />The FIRST step in studying more effectively is actively reviewing a lecture right after it occurs.<br />So, I will gather participants and ask them what time they have lecture for each day of the study.<br />Key: I texted (hot trigger) each user immediately following their lecture (at the right time), asking them to:<br />“Text me anything you just learned in lecture in 5 words or less!”<br />
  6. 6. Trial 1: 14 Friends/2 Days<br />28 texts sent to users, 28 texts received<br />“eigenvectors are key to diagonalization”<br />“geographic barriers cause allopatric speciation”<br />100% Response Rate!<br />Feedback: “I did enjoy answering. To answer, I would review the entire lecture. More than anything else, it at least helped me determine areas I would have difficulty summarizing or did not understand that well.”<br />
  7. 7. Trial 2: 6 Friends/Everyone in Econ 50/1 Day<br />Added incentive: Promised users to send all the summaries at the end of the day. Users appreciated seeing other summaries. <br />6 texts sent to users, 6 texts received<br />“perfect substitutes have flat ICC”<br />“calculating indirect utility from demand”<br />100% Response Rate!<br />
  8. 8. Trial 3: 17 Anonymous Users5 Days<br />Iteration: Will I see similar results when users aren’t my friends?<br />Sent emails, with bit.ly links to sign ups, to several dorm chat lists.<br />64 people clicked bit.ly link, 17 sign ups<br />27% conversion rate on sign ups with anonymous users<br />17 Users: 3 Freshman, 12 Sophomores, 1 Junior, 1 Senior. All Stanford.<br />
  9. 9. Trial 3: Results<br />82 texts sent to users, 57 texts received; 70% Response Rate over 5 Days!<br />“Photography is about creating relationships”<br />“Allocate regulation resources more economically”<br />
  10. 10. Trial 3 Feedback<br />60%response rate on text survey<br />9 of 10 enjoyed the process of reviewing and texting in 5 words or less<br />10 of 10 said they reviewed their lecture through their notes or in their head to formulate answer (the TARGET BEHAVIOR)<br />
  11. 11. Text2Review Overall Results<br />So after 3 trials, it seems as if we have successfully designed for our target behavior.<br />The vast majority of users said that in order to answer the text, they took 2-3 minutes to review the lecture that just happened.<br />
  12. 12. Insights / Keys to Success<br />Key 1: A well-timed hot trigger. Sending a hot trigger (text) is not enough, users need to be able to act on it right away. <br />Key 2: Focused on a target behavior that people are already motivated to do (study more efficiently!)<br />
  13. 13. Surprises<br />I’m surprised that in my first two trials, I had a 100% response rate, 34 texts sent and received! <br />Why did this happen?<br />I made it easy for users to respond (<2 minutes required, trigger at right time)<br />
  14. 14. What Next?<br />Next, we need to figure out the next small behavior that matters that will move our subjects closer to the goal of studying more efficiently.<br />Building on our idea, we can try texting users after every lecture, not just 1 lecture/day <br />
  15. 15. Contact Info<br />Questions? Comments? Contact Me (Really!)<br />Andrew Martin, Stanford ‘13<br />T: @amartinsu13<br />#calmingtech<br />E: amartin6@stanford.edu<br />