Weco 20100820


Published on

This presentation is a topic about what I learned from the summer school at Tsinghua University : human computation.

Published in: Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Weco 20100820

  1. 1. Agent-based Game Design for Human Computation<br />Speaker: Azrael Cheng<br /> Advisor: Hsing Mei <br />Web Computing Laboratory<br />Computer Science and Information Engineering Department<br />Fu Jen Catholic University<br />August 17, 2010<br />
  2. 2. Outline<br />Introduction to Human Computation<br />What is Human Computation?<br />Human Computation<br />CAPTCHA and reCAPTCHA<br />CAPTCHA<br />reCAPTCHA<br />Game with a Purpose<br />Motivation<br />Image Search<br />Audio and Vedio Labels<br />Improvement of Text Search<br />Conclusion<br />2<br />
  3. 3. Introduction to Human Computation<br />3<br />
  4. 4. Human vs. Computer<br />The main idea: If we treat human brain as processors in a distributed system, each can perform a small part of a massive computation.<br />4<br />
  5. 5. What is Human Computation?<br />Human-based computation is a computer science technique in which a computational process performs its function by outsourcing certain steps to humans. <br />This approach leverages differences in abilities and alternative costs between humans and computer agents to achieve symbiotic human-computer interaction.<br />5<br />
  6. 6. What is Human Computation?<br />6<br />Question<br />Answer<br />
  7. 7. Human Computation<br />In 2005, the term “human computation” was first shown in Luis Von Ahn's Ph.D. thesis.<br />Success stories <br />CAPTCHA and reCAPTCHA<br />GWAPs<br />7<br />
  8. 8. CAPTCHA and reCAPTCHA<br />8<br />
  9. 9. CAPTCHA<br />The term "CAPTCHA" was coined in 2000 by Luis von Ahn, Manuel Blum, Nicholas J. Hopper, and John Langford.<br />Using high levels of warping on the text to avoid cracking by OCR.<br />9<br />
  10. 10. CAPTCHA<br />10<br />
  11. 11. CAPTCHA<br />Roughly 200 million CAPTCHAs are typed every day.<br />10s of human time per CAPTCHA<br />11<br />Can we use this human effort for good?<br />
  12. 12. reCAPTCHA<br />To use the CAPTCHA to help digitize the text of books.<br />On September 16, 2009, Google acquired reCAPTCHA.<br />12<br />
  13. 13. Digitizing Books<br />13<br />Scan<br />
  14. 14. Digitizing Books<br />14<br />Word that OCR can’t read<br />
  15. 15. reCAPTCHA<br />Where do the words come from?<br /> Years 1851-1980 completed in 2009.<br /> The 110 other years done by the end of 2010.<br /> Books from Google Books<br />15<br />
  16. 16. Games with A Purpose<br />16<br />
  17. 17. Motivation<br />Each year, people around the world spend billions of hours playing computer games.<br />What if people playing computer games could, without consciously doing so, simultaneously solve large-scale problems?<br />What if people produce useful information while playing games?<br />17<br />
  18. 18. GWAP Games<br />Image Search<br />ESP Game<br />Squigl<br />Matchin<br />FlipIt<br />Audio and Video Labels<br />Tag a Tune<br />PopVideo<br />Improvement in Text Search<br />Verbosity<br />18<br />
  19. 19. Desiderata<br />How to label all images on the web fast and cheap?<br /> Using human cleverly: ESP Game<br />19<br />
  20. 20. Image Search<br />Image search on the web uses the filenames and html texts.<br />Labeling Images with words is still an open problem.<br />20<br />
  21. 21. The ESP Game …..<br />The player and his/her partner see the same image.<br />Each of the player must guess what words his/her partner is typing.<br />21<br />
  22. 22. The ESP Game …..<br />22<br />
  23. 23. Google Image Labeler<br />23<br />
  24. 24. Audio ESP: Tag a Tune .…<br />The player and a partner hear a tune and must describe it.<br />Based on the descriptions, the player has to figure out if both the player an his/her partner listening to the same tune!<br />There are several other bonus rounds which are self descriptive. Enjoy!<br />24<br />
  25. 25. Audio ESP: Tag a Tune .…<br />25<br />
  26. 26. Video ESP: PopVideo .…<br />The player and his/her partner see the same video clip.<br />Each of them enters words describing what he/she sees and hears. <br />26<br />
  27. 27. Video ESP: PopVideo .…<br />27<br />
  28. 28. Verbosity …<br />The player and his/her partner alternaste between being Describer and Guesser.<br />As Describe, the player must help his/her partner guess the secret word by giving clues.<br />As Guesser, he must type the secret word that his/her partner is describing<br />28<br />
  29. 29. Verbosity …<br />29<br />
  30. 30. Conclusion<br />A new domain about the combination of humain brain and computers.<br />Solve the problem of shortage of computer.<br />The lunch box they ordered was unsavory. <br />30<br />
  31. 31. Reference<br />[1] Wiki, Human Computation, http://en.wikipedia.org/wiki/Human-based_computation<br />[2] Luis von Ahn, , http://video.google.com/videoplay?docid=-8246463980976635143# , Google Tech talk, July 26, 2006.<br />[3] Luis’ Website, http://www.cs.cmu.edu/~biglou/<br />[4] Wiki, reCAPTCHA, http://zh.wikipedia.org/zh-tw/ReCAPTCHA<br />[5] Wiki, CAPTCHA, http://zh.wikipedia.org/zh-tw/CAPTCHA<br />[6] UIUI, Luis von Ahn: 人腦運算 , http://uiui.mmdays.com/2008/07/07/human-computation/<br />[7] 阿榮遊樂場, Human Computation, http://jkuangpan.blogspot.com/2008/07/human-computation.html<br />[8] Wiki, Luis Von Ahn, http://en.wikipedia.org/wiki/Luis_von_Ahn<br />[9] Luis von Ahn, Ben Maurer, Colin McMillen, David Abraham and Manuel Blum.reCAPTCHA: Human-Based Character Recognition via Web Security Measures.Science, September 12, 2008. pp 1465-1468.<br />31<br />
  32. 32. Reference<br />[10] Luis von Ahn and Laura Dabbish. General Techniques for Designing Games with a Purpose. Communications of the ACM, August 2008. pp 58-67.<br />[11] Luis von Ahn. Games With A Purpose. IEEE Computer Magazine, June 2006. pp 96-98.<br />[12] Luis von Ahn. http://www.gwap.com/gwap/<br />[13] Mr./Ms. Days (MMDays) – 網路, 資訊, 觀察, 生活, 玩遊戲,做研究, http://mmdays.com/2007/02/05/game-research/<br />[14] The Next New Thing , http://www.ait.org.tw/infousa/zhtw/E-JOURNAL/EJ_Next/ahn.html, SMITHSONIAN, October 2007.<br />32<br />
  33. 33. 33<br />Thanks for your listening<br />Q & A<br />