SlideShare a Scribd company logo
1 of 73
CAPTCHA,
THE ESP GAME,
AND OTHER STUFF
LUIS VON AHN
CARNEGIE MELLON UNIVERSITY
CAPTCHA
A PROGRAM THAT CAN TELL WHETHER
ITS USER IS A HUMAN OR A COMPUTER
CAPTCHA
A. MOST HUMANS CAN PASS
B. CURRENT COMPUTER
PROGRAMS CANNOT PASS
A PROGRAM THAT CAN GENERATE
AND GRADE TESTS THAT:
EXAMPLE
PICKS RANDOM
STRING OF LETTERS
oamg
RENDERS IT INTO A
DISTORTED IMAGE
…AND GENERATES A TEST:
TYPE THE CHARACTERS THAT
APPEAR IN THE IMAGE
P STANDS FOR PUBLIC
ALL CODE AND DATA USED BY A CAPTCHA
SHOULD BE PUBLICLY AVAILABLE
COMPLETELY AUTOMATED
PUBLIC TURING TEST TO TELL
COMPUTERS AND HUMANS APART
UTILIZING THE POWER OF
HUMAN CYCLES
CAPTCHA
THE ESP GAME
APPLICATIONS
EXAMPLES
DIRTY HACKS
OTHER STUFF
APPLICATIONS OF CAPTCHAS
(FROM WWW.SLASHDOT.ORG)
QUICKVOTE
Which is the best Computer Science
Grad School in the US?
CMU
MIT
vote
Berkeley
StanfordCornell
Princeton
FREE E-MAIL SERVICES
DATA COLLECTION
WORMS AND SPAM
PREVENTING DICTIONARY ATTACKS
(PINKAS AND SANDER ‘02)
APPLICATIONS
FREE E-MAIL SERVICES
DATA COLLECTION
WORMS AND SPAM
PREVENTING DICTIONARY ATTACKS
(PINKAS AND SANDER ‘02)
APPLICATIONS
FREE E-MAIL SERVICES
DATA COLLECTION
WORMS AND SPAM
PREVENTING DICTIONARY ATTACKS
(PINKAS AND SANDER ‘02)
APPLICATIONS
FREE E-MAIL SERVICES
DATA COLLECTION
WORMS AND SPAM
PREVENTING DICTIONARY ATTACKS
(PINKAS AND SANDER ‘02)
APPLICATIONS
EXAMPLES OF CAPTCHAS
PIX
WHAT ARE THESE PICTURES OF?
PIX
WHAT ARE THESE PICTURES OF?
THE IMAGES NEED TO BE
RANDOMLY DISTORTED
PIX
WHAT ARE THESE PICTURES OF?
THE IMAGES NEED TO BE
RANDOMLY DISTORTED
PIX
WHAT ARE THESE PICTURES OF?
THE IMAGES NEED TO BE
RANDOMLY DISTORTED
WHAT ARE THESE PICTURES OF?
BONGO
VISUAL ANALOGY
PROBLEMS
(BONGARD 1951)
SOUND-BASED CAPTCHA
HUMANS ARE BETTER THAN COMPUTERS
AT UNDERSTANDING SPOKEN LANGUAGE
CREATE A CAPTCHA BASED ON
LANGUAGE UNDERSTANDING
OPEN PROBLEM
DIRTY HACKS
CAPTCHA SWEAT SHOPS
SPAM COMPANIES HIRE HUMANS TO
SOLVE CAPTCHAS ALL DAY LONG
$2.50 PER HOUR FOR EACH HUMAN
720 CAPTCHAS PER HOUR PER HUMAN
1/3 CENT PER ACCOUNT
Free Nude Photos
> NEXT
Type the word in the box if you want to
see the next picture
Free Nude Photos
UTILIZING THE POWER OF
HUMAN CYCLES
CAPTCHA
THE ESP GAME
APPLICATIONS
EXAMPLES
DIRTY HACKS
OTHER STUFF
LABELING IMAGES WITH WORDS
MARTHA STEWART
FLOWERS
SUPER EVIL
STILL AN OPEN PROBLEM
IMAGE SEARCH ON THE WEB
USES FILENAMES
AND HTML TEXT
ACCESSIBILITY
LESS THAN 10% OF THE WEB IS
ACCESSIBLE TO THE VISUALLY IMPAIRED
REASON: MOST IMAGES DON’T HAVE
PROPER CAPTIONS
DESIDERATA
A METHOD THAT CAN LABEL
ALL IMAGES ON THE WEB
FAST AND CHEAP
USING HUMANS
THE ESP GAME COULD LABEL ALL
IMAGES ON THE WEB IN 30 DAYS!
THE ESP GAME
CLEVERLY
TWO-PLAYER ONLINE GAME
PARTNERS DON’T KNOW EACH OTHER
AND CAN’T COMMUNICATE
OBJECT OF THE GAME:
TYPE THE SAME WORD
THE ONLY THING IN COMMON IS
AN IMAGE
THE ESP GAME
PLAYER 1 PLAYER 2
GUESSING: CAR GUESSING: BOY
GUESSING: CAR
SUCCESS!
YOU AGREE ON CAR
SUCCESS!
YOU AGREE ON CAR
GUESSING: KID
GUESSING: HAT
THE ESP GAME
© 2004 Carnegie Mellon University, all rights reserved. Patent Pending.
4.1 MILLION LABELS WITH 23,000 PLAYERS
THE ESP GAME IS FUN
THERE ARE MANY PEOPLE THAT PLAY
OVER 20 HOURS A WEEK
LABELING THE ENTIRE WEB
INDIVIDUAL GAMES IN YAHOO! AND MSN
AVERAGE OVER 5,000 PLAYERS AT A TIME
5000 PEOPLE PLAYING SIMULTANEOUSLY CAN
LABEL ALL IMAGES ON GOOGLE IN 30 DAYS!
A FEW MILLION LABELS
CAN IMPROVE IMAGE SEARCH
CAN BE USED TO IMPROVE
COMPUTER VISION
SINGLE PLAYER GAME
A SINGLE PERSON CAN PLAY WITH PRE-
RECORDED ACTIONS AS THEIR PARTNER
WHEN 2 PEOPLE PLAY, WE
RECORD EVERY ACTION
WITH TIMING INFORMATION
WE EMULATE PARTNER
BY PLAYING PRE-
RECORDED MOVES(0:12) CAR
(0:15) HAT
(0:21) KID
(0:08) BOY
(0:23) CAR
NOTICE THAT THIS
DOESN’T STOP THE
LABELING PROCESS!
WHAT ABOUT CHEATING?
IF A PAIR PLAYS TOO FAST, WE DON’T
RECORD THE WORDS THEY AGREE ON
WE GIVE PLAYERS TEST IMAGES FOR WHICH
WE KNOW ALL THE COMMON LABELS:
WE ONLY STORE A PLAYER’S GUESSES
IF THEY SUCCESSFULLY LABEL THE
TEST IMAGES
WHAT ABOUT CHEATING?
SEARCH RESULTS
SAMPLE LABELS
BEACH
CHAIRS
SEA
PEOPLE
MAN
WOMAN
PLANT
OCEAN
TALKING
WATER
PORCH
SADDAM
MR. WILSON
MAN
FACE
MOUSTACHE
SAMPLE LABELS
BUSH
PRESIDENT
DUMB
YUCKYUCK
COMING SOON:
MEET YOUR SOUL MATE
THROUGH THE GAME!
WHY DO PEOPLE LIKE
THE ESP GAME?
THE ESP GAME GIVES ITS PLAYERS A
WEIRD AND BEAUTIFUL SENSE OF
ANONYMOUS INTIMACY. ON THE ONE HAND,
YOU HAVE NO IDEA WHO YOUR PARTNER
IS. ON THE OTHER HAND, THE TWO OF YOU
ARE BRINGING YOUR MINDS TOGETHER IN
A WAY THAT LOVERS WOULD ENVY.
”
THE ESP GAME GIVES ITS PLAYERS A
WEIRD AND BEAUTIFUL SENSE OF
ANONYMOUS INTIMACY. ON THE ONE HAND,
YOU HAVE NO IDEA WHO YOUR PARTNER
IS.
THE ESP GAME GIVES ITS PLAYERS A
WEIRD AND BEAUTIFUL SENSE OF
ANONYMOUS INTIMACY.
“
STRANGELY ADDICTIVE
“ ”
IT’S SO MUCH FUN TRYNG TO GUESS
WHAT OTHERS THINK. YOU HAVE TO
STEP OUTSIDE OF YOURSELF TO
MATCH
“
”
IT’S FAST-PACED“ ”
HELPS ME LEARN ENGLISH“ ”
BLOGS
IN OTHER CROWNING ACHEIVEMENTS,
I HAVEN'T PLAYED IN AT LEAST A WEEK
(PROBABLY LONGER), AND I AM STILL ON THE
TOP TEN LIST OF PLAYERS ON THE ESP GAME.
NUMBER EIGHT IF I REMEMBER CORRECTLY.
“
GOD, MY LIFE IS SAD.
”
THERE ARE MANY FASCINATING THINGS
ABOUT THE ESP GAME:
HOW IT USES A GAME STRUCTURE TO
BUILD AN INDEX OF IMAGES ON THE WEB
WHAT WORDS BECOME TABOO FROM
FREQUENT USE
HOW INTERESTING SOME OF THE IMAGES
PULLED RANDOMLY FROM THE WEB ARE
“
BUT BY FAR THE MOST INTRIGUING ASPECT
OF THE GAME IS HOW OFTEN YOUR RANDOM,
UNKNOWN PARTNER IS A COMPLETE IDIOT.
”
OTHER GAMES
LOCATING OBJECTS IN IMAGES
THE ESP GAME TELLS US IF AN IMAGE
CONTAINS A SPECIFIC OBJECT, BUT DOESN’T
SAY WHERE IN THE IMAGE THE OBJECT IS
SUCH INFORMATION WOULD BE EXTREMELY
USEFUL FOR COMPUTER VISION RESEARCH
PAINTBALL GAME
PLAYERS SHOOT AT OBJECTS ON THE IMAGE
SHOOT THE:
CAR
WE GIVE POINTS AND CHECK ACCURACY
BY GIVING PLAYERS IMAGES FOR WHICH
WE ALREADY KNOW WHERE THE OBJECT IS
X% OF IMAGES (100-X)% OF IMAGES
PAINTBALL GAME
DON’T
KNOW
BALL
REVEALING IMAGES
REVEALERGUESSER
CAR
PARTNER’S
GUESS
GUESS
BRUSH BRUSHCAR CAR
MEDIUM-TERM GOAL
USE THE ESP GAME, ALONG WITH THE PAINT-
BALL GAME AND THE REVEALING GAME TO
CREATE THE MOST ACCURATE COMPUTER
VISION ALGORITHMS TO RECOGNIZE A WIDE
VARIETY OF OBJECT CATEGORIES
X OR NOT
CAN BE USED TO CLASSIFY ALL IMAGES ON
THE WEB AS HAVING PROPERTY X OR NOT
WE GIVE PEOPLE
40% OF IMAGES WITH PROPERTY X
40% OF IMAGES WITHOUT PROPERTY X
20% OF UNKNOWN IMAGES
IF PEOPLE LIKE IMAGES WITH PROPERTY X,
WE CAN OFFER AN INCENTIVE: THE MORE
ACCURATE A PLAYER IS, THE MORE IMAGES
WITH PROPERTY X THEY GET
$$$
THE POWER OF HUMAN CYCLES
OPEN
PROBLEM
CAPTCHA
GAME
OUR WORK ON CAPTCHA HAS
APPEARED IN OVER 100
NEWSPAPERS AROUND THE WORLD
THE ESP GAME HAS
APPEARED IN OVER 50
NEWSPAPERS AROUND THE
WORLD
Name That Image
Computers excel at sifting information, but they have trouble distinguishing a picture
of a tree from one of a turtle.
So researchers at Carnegie Mellon University knew they needed human volunteers
to successfully label millions of unmarked images on the Web. Luis von Ahn, a
graduate student in computer science, had the inspired idea of turning the laborious
process into a two-player contest called the ESP Game (espgame.org).
Each time you play, you are randomly paired with another anonymous player. You
can't communicate with your partner, although you both see the same image. The
goal is to guess the descriptive word your partner is typing for the image. Once you
both type the same word, you see a new image.
Since October the game has attracted 15,000 registered players, and they have
created more than 1.5 million labels (a label is a single descriptive word; most
photos require multiple labels). The site draws from a database of 200,000 Web
images; another 200,000 are to be added soon. Mr. von Ahn said that properly
labeling Web images would allow for more efficient image searching, improve the
screen readers used by the visually impaired and help users block inappropriate
images.
WWW.CAPTCHA.NET
WWW.ESPGAME.ORG
SLIDE DESIGN
LUIS VON AHN
CAPTCHA CREW
LUIS VON AHN
MANUEL BLUM
NICHOLAS HOPPER
JOHN LANGFORD
THE ESP GAME CREW
LUIS VON AHN
LAURA DABBISH
SPEAKER’S ENTERTAINMENT
PROVIDED BY
HOMESTARRUNNER.COM
SPECIAL THANKS TO
ADITYA AKELLA
JOSH BENALOH
LENORE BLUM
MANUEL BLUM
ANDREW BORTZ
SHUCHI CHAWLA
LAURA DABBISH
BILL GATES
BRIGHTEN GODFREY
NICK HOPPER
SCOTT HUDSON
TAKEO KANADE
STEVEN KATZ
JOHN LANGFORD
JITENDRA MALIK
WARDROBE PROVIDED BY
THE GAP
HAIRSTYLES
ARNAUD SOME-FRENCH-LAST-NAME
THIS WORK HAS BEEN
AND WILL BE PARTIALLY
SUPPORTED BY
MANUEL BLUM
THE ALADDIN CENTER
MICROSOFT RESEARCH
MY MOM
YOUR TAX DOLLARS
MORE SPECIAL THANKS
UDI MANBER
MONI NAOR
LENORE RAMM
CHUCK ROSENBERG
RONI ROSENFELD
DAVID STORK
LATANYA SWEENEY
SHINGO UCHIHASHI
MANUELA VELOSO

More Related Content

Similar to Captcha security for google

Game Studies Download 2009 - Top 10 Research Findings
Game Studies Download 2009 - Top 10 Research FindingsGame Studies Download 2009 - Top 10 Research Findings
Game Studies Download 2009 - Top 10 Research FindingsJane McGonigal
 
4. proposal finished
4. proposal finished4. proposal finished
4. proposal finishedLouisbiddles7
 
Help! My Library is Turning Into a Arcade
Help! My Library is Turning Into a ArcadeHelp! My Library is Turning Into a Arcade
Help! My Library is Turning Into a ArcadeBeth Gallaway
 
Gaming Update October '11
Gaming Update October '11Gaming Update October '11
Gaming Update October '11Advance A/S
 
Core Collections: Videogames for Libraries
Core Collections: Videogames for LibrariesCore Collections: Videogames for Libraries
Core Collections: Videogames for LibrariesBeth Gallaway
 
Combining Art, Creativity and Industrial Simulations: Game-Based Tools for Le...
Combining Art, Creativity and Industrial Simulations: Game-Based Tools for Le...Combining Art, Creativity and Industrial Simulations: Game-Based Tools for Le...
Combining Art, Creativity and Industrial Simulations: Game-Based Tools for Le...Karl Kapp
 
Games at the CTAM Summit 2007
Games at the CTAM Summit 2007Games at the CTAM Summit 2007
Games at the CTAM Summit 2007Jane McGonigal
 
Online gaming culture 2
Online gaming culture 2Online gaming culture 2
Online gaming culture 2Anton367594
 
Pitch for tv show
Pitch for tv showPitch for tv show
Pitch for tv showliampage99
 
FableVision eGaming & Learning
FableVision eGaming & LearningFableVision eGaming & Learning
FableVision eGaming & Learningfablevision
 
last go us media campaign
last go us media campaignlast go us media campaign
last go us media campaigngaynordobson
 
AR Library Association
AR Library AssociationAR Library Association
AR Library AssociationBeth Gallaway
 
Dc 3 – the escapist
Dc 3 – the escapistDc 3 – the escapist
Dc 3 – the escapistDexter Rullez
 
Video Games and Swearing
Video Games and SwearingVideo Games and Swearing
Video Games and Swearingourmobilecheats
 

Similar to Captcha security for google (20)

Game Studies Download 2009 - Top 10 Research Findings
Game Studies Download 2009 - Top 10 Research FindingsGame Studies Download 2009 - Top 10 Research Findings
Game Studies Download 2009 - Top 10 Research Findings
 
Weco 20100820
Weco 20100820Weco 20100820
Weco 20100820
 
4. proposal finished
4. proposal finished4. proposal finished
4. proposal finished
 
Help! My Library is Turning Into a Arcade
Help! My Library is Turning Into a ArcadeHelp! My Library is Turning Into a Arcade
Help! My Library is Turning Into a Arcade
 
Gaming Update October '11
Gaming Update October '11Gaming Update October '11
Gaming Update October '11
 
Research FMP Year 2
Research FMP Year 2Research FMP Year 2
Research FMP Year 2
 
Core Collections: Videogames for Libraries
Core Collections: Videogames for LibrariesCore Collections: Videogames for Libraries
Core Collections: Videogames for Libraries
 
Combining Art, Creativity and Industrial Simulations: Game-Based Tools for Le...
Combining Art, Creativity and Industrial Simulations: Game-Based Tools for Le...Combining Art, Creativity and Industrial Simulations: Game-Based Tools for Le...
Combining Art, Creativity and Industrial Simulations: Game-Based Tools for Le...
 
Media campaign
Media campaignMedia campaign
Media campaign
 
5. Proposal For Game
5. Proposal For Game5. Proposal For Game
5. Proposal For Game
 
Games at the CTAM Summit 2007
Games at the CTAM Summit 2007Games at the CTAM Summit 2007
Games at the CTAM Summit 2007
 
Online gaming culture 2
Online gaming culture 2Online gaming culture 2
Online gaming culture 2
 
Metro Oct 2007
Metro  Oct 2007Metro  Oct 2007
Metro Oct 2007
 
Pitch for tv show
Pitch for tv showPitch for tv show
Pitch for tv show
 
Get Your Game On!
Get Your Game On!Get Your Game On!
Get Your Game On!
 
FableVision eGaming & Learning
FableVision eGaming & LearningFableVision eGaming & Learning
FableVision eGaming & Learning
 
last go us media campaign
last go us media campaignlast go us media campaign
last go us media campaign
 
AR Library Association
AR Library AssociationAR Library Association
AR Library Association
 
Dc 3 – the escapist
Dc 3 – the escapistDc 3 – the escapist
Dc 3 – the escapist
 
Video Games and Swearing
Video Games and SwearingVideo Games and Swearing
Video Games and Swearing
 

Recently uploaded

Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?XfilesPro
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAndikSusilo4
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 

Recently uploaded (20)

Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & Application
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 

Captcha security for google

  • 1. CAPTCHA, THE ESP GAME, AND OTHER STUFF LUIS VON AHN CARNEGIE MELLON UNIVERSITY
  • 2.
  • 3. CAPTCHA A PROGRAM THAT CAN TELL WHETHER ITS USER IS A HUMAN OR A COMPUTER
  • 4. CAPTCHA A. MOST HUMANS CAN PASS B. CURRENT COMPUTER PROGRAMS CANNOT PASS A PROGRAM THAT CAN GENERATE AND GRADE TESTS THAT:
  • 5. EXAMPLE PICKS RANDOM STRING OF LETTERS oamg RENDERS IT INTO A DISTORTED IMAGE
  • 6. …AND GENERATES A TEST: TYPE THE CHARACTERS THAT APPEAR IN THE IMAGE
  • 7. P STANDS FOR PUBLIC ALL CODE AND DATA USED BY A CAPTCHA SHOULD BE PUBLICLY AVAILABLE
  • 8. COMPLETELY AUTOMATED PUBLIC TURING TEST TO TELL COMPUTERS AND HUMANS APART
  • 9. UTILIZING THE POWER OF HUMAN CYCLES CAPTCHA THE ESP GAME APPLICATIONS EXAMPLES DIRTY HACKS OTHER STUFF
  • 11. (FROM WWW.SLASHDOT.ORG) QUICKVOTE Which is the best Computer Science Grad School in the US? CMU MIT vote Berkeley StanfordCornell Princeton
  • 12. FREE E-MAIL SERVICES DATA COLLECTION WORMS AND SPAM PREVENTING DICTIONARY ATTACKS (PINKAS AND SANDER ‘02) APPLICATIONS
  • 13. FREE E-MAIL SERVICES DATA COLLECTION WORMS AND SPAM PREVENTING DICTIONARY ATTACKS (PINKAS AND SANDER ‘02) APPLICATIONS
  • 14. FREE E-MAIL SERVICES DATA COLLECTION WORMS AND SPAM PREVENTING DICTIONARY ATTACKS (PINKAS AND SANDER ‘02) APPLICATIONS
  • 15. FREE E-MAIL SERVICES DATA COLLECTION WORMS AND SPAM PREVENTING DICTIONARY ATTACKS (PINKAS AND SANDER ‘02) APPLICATIONS
  • 17. PIX WHAT ARE THESE PICTURES OF?
  • 18. PIX WHAT ARE THESE PICTURES OF? THE IMAGES NEED TO BE RANDOMLY DISTORTED
  • 19. PIX WHAT ARE THESE PICTURES OF? THE IMAGES NEED TO BE RANDOMLY DISTORTED
  • 20. PIX WHAT ARE THESE PICTURES OF? THE IMAGES NEED TO BE RANDOMLY DISTORTED
  • 21. WHAT ARE THESE PICTURES OF?
  • 23.
  • 24. SOUND-BASED CAPTCHA HUMANS ARE BETTER THAN COMPUTERS AT UNDERSTANDING SPOKEN LANGUAGE
  • 25. CREATE A CAPTCHA BASED ON LANGUAGE UNDERSTANDING OPEN PROBLEM
  • 27. CAPTCHA SWEAT SHOPS SPAM COMPANIES HIRE HUMANS TO SOLVE CAPTCHAS ALL DAY LONG $2.50 PER HOUR FOR EACH HUMAN 720 CAPTCHAS PER HOUR PER HUMAN 1/3 CENT PER ACCOUNT
  • 29. Type the word in the box if you want to see the next picture Free Nude Photos
  • 30. UTILIZING THE POWER OF HUMAN CYCLES CAPTCHA THE ESP GAME APPLICATIONS EXAMPLES DIRTY HACKS OTHER STUFF
  • 31. LABELING IMAGES WITH WORDS MARTHA STEWART FLOWERS SUPER EVIL STILL AN OPEN PROBLEM
  • 32. IMAGE SEARCH ON THE WEB USES FILENAMES AND HTML TEXT
  • 33. ACCESSIBILITY LESS THAN 10% OF THE WEB IS ACCESSIBLE TO THE VISUALLY IMPAIRED REASON: MOST IMAGES DON’T HAVE PROPER CAPTIONS
  • 34. DESIDERATA A METHOD THAT CAN LABEL ALL IMAGES ON THE WEB FAST AND CHEAP
  • 35. USING HUMANS THE ESP GAME COULD LABEL ALL IMAGES ON THE WEB IN 30 DAYS! THE ESP GAME CLEVERLY
  • 36. TWO-PLAYER ONLINE GAME PARTNERS DON’T KNOW EACH OTHER AND CAN’T COMMUNICATE OBJECT OF THE GAME: TYPE THE SAME WORD THE ONLY THING IN COMMON IS AN IMAGE THE ESP GAME
  • 37. PLAYER 1 PLAYER 2 GUESSING: CAR GUESSING: BOY GUESSING: CAR SUCCESS! YOU AGREE ON CAR SUCCESS! YOU AGREE ON CAR GUESSING: KID GUESSING: HAT THE ESP GAME
  • 38. © 2004 Carnegie Mellon University, all rights reserved. Patent Pending.
  • 39. 4.1 MILLION LABELS WITH 23,000 PLAYERS THE ESP GAME IS FUN THERE ARE MANY PEOPLE THAT PLAY OVER 20 HOURS A WEEK
  • 40. LABELING THE ENTIRE WEB INDIVIDUAL GAMES IN YAHOO! AND MSN AVERAGE OVER 5,000 PLAYERS AT A TIME 5000 PEOPLE PLAYING SIMULTANEOUSLY CAN LABEL ALL IMAGES ON GOOGLE IN 30 DAYS!
  • 41. A FEW MILLION LABELS CAN IMPROVE IMAGE SEARCH CAN BE USED TO IMPROVE COMPUTER VISION
  • 42. SINGLE PLAYER GAME A SINGLE PERSON CAN PLAY WITH PRE- RECORDED ACTIONS AS THEIR PARTNER WHEN 2 PEOPLE PLAY, WE RECORD EVERY ACTION WITH TIMING INFORMATION WE EMULATE PARTNER BY PLAYING PRE- RECORDED MOVES(0:12) CAR (0:15) HAT (0:21) KID (0:08) BOY (0:23) CAR NOTICE THAT THIS DOESN’T STOP THE LABELING PROCESS!
  • 43. WHAT ABOUT CHEATING? IF A PAIR PLAYS TOO FAST, WE DON’T RECORD THE WORDS THEY AGREE ON
  • 44. WE GIVE PLAYERS TEST IMAGES FOR WHICH WE KNOW ALL THE COMMON LABELS: WE ONLY STORE A PLAYER’S GUESSES IF THEY SUCCESSFULLY LABEL THE TEST IMAGES WHAT ABOUT CHEATING?
  • 48. WHY DO PEOPLE LIKE THE ESP GAME?
  • 49. THE ESP GAME GIVES ITS PLAYERS A WEIRD AND BEAUTIFUL SENSE OF ANONYMOUS INTIMACY. ON THE ONE HAND, YOU HAVE NO IDEA WHO YOUR PARTNER IS. ON THE OTHER HAND, THE TWO OF YOU ARE BRINGING YOUR MINDS TOGETHER IN A WAY THAT LOVERS WOULD ENVY. ” THE ESP GAME GIVES ITS PLAYERS A WEIRD AND BEAUTIFUL SENSE OF ANONYMOUS INTIMACY. ON THE ONE HAND, YOU HAVE NO IDEA WHO YOUR PARTNER IS. THE ESP GAME GIVES ITS PLAYERS A WEIRD AND BEAUTIFUL SENSE OF ANONYMOUS INTIMACY. “
  • 50. STRANGELY ADDICTIVE “ ” IT’S SO MUCH FUN TRYNG TO GUESS WHAT OTHERS THINK. YOU HAVE TO STEP OUTSIDE OF YOURSELF TO MATCH “ ” IT’S FAST-PACED“ ” HELPS ME LEARN ENGLISH“ ”
  • 51. BLOGS IN OTHER CROWNING ACHEIVEMENTS, I HAVEN'T PLAYED IN AT LEAST A WEEK (PROBABLY LONGER), AND I AM STILL ON THE TOP TEN LIST OF PLAYERS ON THE ESP GAME. NUMBER EIGHT IF I REMEMBER CORRECTLY. “ GOD, MY LIFE IS SAD. ”
  • 52. THERE ARE MANY FASCINATING THINGS ABOUT THE ESP GAME: HOW IT USES A GAME STRUCTURE TO BUILD AN INDEX OF IMAGES ON THE WEB WHAT WORDS BECOME TABOO FROM FREQUENT USE HOW INTERESTING SOME OF THE IMAGES PULLED RANDOMLY FROM THE WEB ARE “ BUT BY FAR THE MOST INTRIGUING ASPECT OF THE GAME IS HOW OFTEN YOUR RANDOM, UNKNOWN PARTNER IS A COMPLETE IDIOT. ”
  • 54. LOCATING OBJECTS IN IMAGES THE ESP GAME TELLS US IF AN IMAGE CONTAINS A SPECIFIC OBJECT, BUT DOESN’T SAY WHERE IN THE IMAGE THE OBJECT IS SUCH INFORMATION WOULD BE EXTREMELY USEFUL FOR COMPUTER VISION RESEARCH
  • 55. PAINTBALL GAME PLAYERS SHOOT AT OBJECTS ON THE IMAGE SHOOT THE: CAR WE GIVE POINTS AND CHECK ACCURACY BY GIVING PLAYERS IMAGES FOR WHICH WE ALREADY KNOW WHERE THE OBJECT IS
  • 56. X% OF IMAGES (100-X)% OF IMAGES PAINTBALL GAME DON’T KNOW
  • 57. BALL
  • 59.
  • 60. MEDIUM-TERM GOAL USE THE ESP GAME, ALONG WITH THE PAINT- BALL GAME AND THE REVEALING GAME TO CREATE THE MOST ACCURATE COMPUTER VISION ALGORITHMS TO RECOGNIZE A WIDE VARIETY OF OBJECT CATEGORIES
  • 61.
  • 62. X OR NOT CAN BE USED TO CLASSIFY ALL IMAGES ON THE WEB AS HAVING PROPERTY X OR NOT WE GIVE PEOPLE 40% OF IMAGES WITH PROPERTY X 40% OF IMAGES WITHOUT PROPERTY X 20% OF UNKNOWN IMAGES IF PEOPLE LIKE IMAGES WITH PROPERTY X, WE CAN OFFER AN INCENTIVE: THE MORE ACCURATE A PLAYER IS, THE MORE IMAGES WITH PROPERTY X THEY GET $$$
  • 63. THE POWER OF HUMAN CYCLES OPEN PROBLEM CAPTCHA GAME
  • 64.
  • 65. OUR WORK ON CAPTCHA HAS APPEARED IN OVER 100 NEWSPAPERS AROUND THE WORLD
  • 66.
  • 67. THE ESP GAME HAS APPEARED IN OVER 50 NEWSPAPERS AROUND THE WORLD
  • 68.
  • 69. Name That Image Computers excel at sifting information, but they have trouble distinguishing a picture of a tree from one of a turtle. So researchers at Carnegie Mellon University knew they needed human volunteers to successfully label millions of unmarked images on the Web. Luis von Ahn, a graduate student in computer science, had the inspired idea of turning the laborious process into a two-player contest called the ESP Game (espgame.org). Each time you play, you are randomly paired with another anonymous player. You can't communicate with your partner, although you both see the same image. The goal is to guess the descriptive word your partner is typing for the image. Once you both type the same word, you see a new image. Since October the game has attracted 15,000 registered players, and they have created more than 1.5 million labels (a label is a single descriptive word; most photos require multiple labels). The site draws from a database of 200,000 Web images; another 200,000 are to be added soon. Mr. von Ahn said that properly labeling Web images would allow for more efficient image searching, improve the screen readers used by the visually impaired and help users block inappropriate images.
  • 70.
  • 73. SLIDE DESIGN LUIS VON AHN CAPTCHA CREW LUIS VON AHN MANUEL BLUM NICHOLAS HOPPER JOHN LANGFORD THE ESP GAME CREW LUIS VON AHN LAURA DABBISH SPEAKER’S ENTERTAINMENT PROVIDED BY HOMESTARRUNNER.COM SPECIAL THANKS TO ADITYA AKELLA JOSH BENALOH LENORE BLUM MANUEL BLUM ANDREW BORTZ SHUCHI CHAWLA LAURA DABBISH BILL GATES BRIGHTEN GODFREY NICK HOPPER SCOTT HUDSON TAKEO KANADE STEVEN KATZ JOHN LANGFORD JITENDRA MALIK WARDROBE PROVIDED BY THE GAP HAIRSTYLES ARNAUD SOME-FRENCH-LAST-NAME THIS WORK HAS BEEN AND WILL BE PARTIALLY SUPPORTED BY MANUEL BLUM THE ALADDIN CENTER MICROSOFT RESEARCH MY MOM YOUR TAX DOLLARS MORE SPECIAL THANKS UDI MANBER MONI NAOR LENORE RAMM CHUCK ROSENBERG RONI ROSENFELD DAVID STORK LATANYA SWEENEY SHINGO UCHIHASHI MANUELA VELOSO