Sexy Slideshare

7,153 views

Published on

1 Comment
1 Like
Statistics
Notes
No Downloads
Views
Total views
7,153
On SlideShare
0
From Embeds
0
Number of Embeds
62
Actions
Shares
0
Downloads
0
Comments
1
Likes
1
Embeds 0
No embeds

No notes for slide

Sexy Slideshare

  1. 1. LABELING IMAGES CARNEGIE MELLON UNIVERSITY LUIS VON AHN
  2. 2. 9 BILLION MAN-HOURS OF SOLITAIRE WERE PLAYED IN 2003 EMPIRE STATE BUILDING PANAMA CANAL 7 MILLION MAN-HOURS (6.8 HOURS OF SOLITAIRE) 20 MILLION MAN-HOURS (LESS THAN A DAY OF SOLITAIRE)
  3. 3. LABELING IMAGES WITH WORDS STILL A COMPLETELY OPEN PROBLEM FACE MAN SUPER SEXY
  4. 4. IMAGE SEARCH ON THE WEB USES FILENAMES AND HTML TEXT
  5. 5. ACCESSIBILITY LESS THAN 10% OF THE WEB IS ACCESSIBLE TO THE VISUALLY IMPAIRED REASON: MOST IMAGES DON’T HAVE A CAPTION
  6. 6. DESIDERATA A METHOD THAT CAN LABEL ALL IMAGES ON THE WEB FAST AND CHEAP
  7. 7. HUMAN LABELING THE ESP GAME COULD LABEL ALL IMAGES ON THE WEB IN 30 DAYS! THE ESP GAME CLEVER
  8. 8. TWO-PLAYER ONLINE GAME PARTNERS DON’T KNOW EACH OTHER AND CAN’T COMMUNICATE OBJECT OF THE GAME: TYPE THE SAME WORD THE ONLY THING IN COMMON IS AN IMAGE THE ESP GAME
  9. 9. PLAYER 1 PLAYER 2 THE ESP GAME GUESSING: CAR GUESSING: BOY GUESSING: CAR SUCCESS! YOU AGREE ON CAR SUCCESS! YOU AGREE ON CAR GUESSING: KID GUESSING: HAT
  10. 10. © 2004 Carnegie Mellon University, all rights reserved. Patent Pending.
  11. 11. MANY PEOPLE PLAY OVER 20 HOURS A WEEK 3.2 MILLION LABELS WITH 22,000 PLAYERS THE ESP GAME IS FUN
  12. 12. LABELING THE ENTIRE WEB INDIVIDUAL GAMES IN YAHOO! AND MSN AVERAGE OVER 10,000 PLAYERS AT A TIME 5000 PEOPLE PLAYING SIMULTANEOUSLY CAN LABEL ALL IMAGES ON GOOGLE IN 30 DAYS !
  13. 13. A FEW MILLION LABELS CAN IMPROVE IMAGE SEARCH CAN BE USED TO IMPROVE COMPUTER VISION
  14. 14. WHAT ABOUT CHEATING? IF A PAIR PLAYS TOO FAST, WE DON’T RECORD THE WORDS THEY AGREE ON
  15. 15. WHAT ABOUT CHEATING? WE GIVE PLAYERS TEST IMAGES FOR WHICH WE KNOW ALL THE COMMON LABELS: WE ONLY STORE A PLAYER’S GUESSES IF THEY SUCCESSFULLY LABEL THE TEST IMAGES
  16. 16. SEARCH RESULTS
  17. 17. SAMPLE LABELS SADDAM MR. WILSON MAN FACE MOUSTACHE BUSH PRESIDENT DUMB YUCK YUCK COMING SOON: MEET YOUR SOUL MATE THROUGH THE GAME!
  18. 18. THE ESP GAME GIVES ITS PLAYERS A WEIRD AND BEAUTIFUL SENSE OF ANONYMOUS INTIMACY. ON THE ONE HAND, YOU HAVE NO IDEA WHO YOUR PARTNER IS. THE ESP GAME GIVES ITS PLAYERS A WEIRD AND BEAUTIFUL SENSE OF ANONYMOUS INTIMACY. ON THE ONE HAND, YOU HAVE NO IDEA WHO YOUR PARTNER IS. ON THE OTHER HAND, THE TWO OF YOU ARE BRINGING YOUR MINDS TOGETHER IN A WAY THAT LOVERS WOULD ENVY. ” THE ESP GAME GIVES ITS PLAYERS A WEIRD AND BEAUTIFUL SENSE OF ANONYMOUS INTIMACY. “
  19. 19. MAKES ME THINK “ ” IT’S FUN TRYNG TO GUESS WHAT OTHERS THINK. YOU HAVE TO STEP OUTSIDE OF YOURSELF TO MATCH “ ” IT’S FAST-PACED “ ” HELPS ME LEARN ENGLISH “ ”
  20. 20. BLOGS IN OTHER CROWNING ACHEIVEMENTS, I HAVEN'T PLAYED IN AT LEAST A WEEK (PROBABLY LONGER), AND I AM STILL ON THE TOP TEN LIST OF PLAYERS ON THE ESP GAME. NUMBER EIGHT IF I REMEMBER CORRECTLY. “ GOD, MY LIFE IS SAD. ”
  21. 21. THERE ARE MANY FASCINATING THINGS ABOUT THE ESP GAME: HOW IT USES A GAME STRUCTURE TO BUILD AN INDEX OF IMAGES ON THE WEB WHAT WORDS BECOME TABOO FROM FREQUENT USE HOW INTERESTING SOME OF THE IMAGES PULLED RANDOMLY FROM THE WEB ARE “ BUT BY FAR THE MOST INTRIGUING ASPECT OF THE GAME IS HOW OFTEN YOUR RANDOM, UNKNOWN PARTNER IS A COMPLETE IDIOT. ”
  22. 22. REUSING HUMAN CYCLES
  23. 24. WWW. ESPGAME.ORG
  24. 25. MORE SPECIAL THANKS UDI MANBER MONI NAOR LENORE RAMM CHUCK ROSENBERG RONI ROSENFELD DAVID STORK LATANYA SWEENEY SHINGO UCHIHASHI MANUELA VELOSO SPECIAL THANKS TO ADITYA AKELLA JOSH BENALOH GUY BLELLOCH LENORE BLUM MANUEL BLUM ANDREW BORTZ SHUCHI CHAWLA LAURA DABBISH BILL GATES NICK HOPPER SCOTT HUDSON TAKEO KANADE STEVEN KATZ JOHN LANGFORD JITENDRA MALIK SPEAKER’S ENTERTAINMENT PROVIDED BY HOMESTARRUNNER.COM WARDROBE PROVIDED BY THE GAP THIS WORK HAS BEEN AND WILL BE PARTIALLY SUPPORTED BY MANUEL BLUM THE ALADDIN CENTER MICROSOFT RESEARCH
  25. 27. SEARCH FOR FUNNY
  26. 28. THE CHOLESTEROL POLICE

×