SlideShare a Scribd company logo
amazon
                                               web services



Crowdsourcing for
    improving
 Business Process



October, 2012 - Optimized for 1280x960   -   ยฉ Amazon Web Services
_ Presented by
John Hoskins, hoskins @ amazon.com
Mechanical Turk, Amazon




       [         Before we start
                                     ]
                           2
How does it
High     Crowdsourcing           work             Examples
Level

                                                         Questions



Detail           What is MTurk?         How is it used




         [   Our plan for today                          ]

                             3
[                    ]
What is Crowdsourcing?




          4
[   Crowd Labor Trends   ]
            5
1. Crowdsourcing



       6
[   Crowdsourcing:
    Key Advantages   ]

          7
[   1. Elastic Capacity   ]

             8
On and Off           Fast Growth




Variable peaks       Predictable peaks


   [  Staffing Usage Patterns      ]

                 9
On and Off        WASTE     Fast Growth



              Missed
Variable peaks Opportunity Predictable peaks


    [  Staffing Usage Patterns            ]

                       10
On and Off               Fast Growth




Variable peaks           Predictable peaks


   [         Usage Patterns:
             Crowdsourcing             ]

                    11
[   2. On Demand Availability   ]

                12
[                                    ]
    3. Pay as you go, for what you use




                    13
$                             $

    Lower costs               Capital efficiency




Improve productivity        Focus on your business



[       Business Benefits
        of Crowdsourcing                   ]

                       14
2. What is MTurk?



        15
Marketplace for Work
_ Access to global workforce, on demand
_ Quality controls and workflow โ€œbuilding blocksโ€
_ Pay as you go, only when satisfied with results
_ Programmatic Access (API)



   [      What is Mechanical Turk?                  ]

                              16
_ 500,000 Workers
_ 190+ Countries




       [      Global Workforce
                                 ]
                     17          (as of Apr 19th, 2012)
3. How it works



       18
[   How it works   ]
         19
Highest
Performing


                 Average
MASTERS
                           Unknown




  [          Mturk Workforce   ]
                     20
Highest
  Performing




                   Average
MASTERS                      Unknown
               Your Custom
                Workforce




    [      Custom Workforce      ]
                        21
Speed


      Price

                 Accuracy




[   Balances & Levers
                            ]

                  22
4. How is it used?



        23
Data Management                       Analysis/Research
_ Verification                        _ Sentiment
_ Entry & Collection                  _ Relevance
_ De-dupe                             _ Online Research
_ Algorithm Training




Content Management                    Annotation
_ Moderation (Photos, Content)        _ Tagging
_ Transcription                       _ Classification
_ Localization/Translation



          [       Common Use Cases                       ]
                                 24
How can we assess relevance of
tweets in real-time?
How can we research and categorize
merchants in our database?

How can we verify accuracy of low
confidence OCR scans?

How do we build a dictionary to
categorize ads on the internet?


[    Examples     ]
          25
Categorization


Web Research


Transcription


Categorization and DeDupe



[    Examples     ]
           26
amazon
                               web services



http://www.mturk.com
   John Hoskins, Mechanical Turk
      hoskins@amazon.com




                 27

More Related Content

Similar to Amazon mechanical turk intro to bpo's v3

ASUG 2010 - Efficient Usage Monitoring in a 160.000 User SAP Portal (by Frank...
ASUG 2010 - Efficient Usage Monitoring in a 160.000 User SAP Portal (by Frank...ASUG 2010 - Efficient Usage Monitoring in a 160.000 User SAP Portal (by Frank...
ASUG 2010 - Efficient Usage Monitoring in a 160.000 User SAP Portal (by Frank...
Sweetlets
ย 
Jz 101 b
Jz 101 bJz 101 b
Jz 101 b
Amazon Web Services
ย 
Aws 101 cloud computing seminar (reference model included)
Aws 101 cloud computing seminar (reference model included)Aws 101 cloud computing seminar (reference model included)
Aws 101 cloud computing seminar (reference model included)Martin Yan
ย 
Mechanical Turk: Increase Image Sales (April 2013 Webinar)
Mechanical Turk: Increase Image Sales (April 2013 Webinar)Mechanical Turk: Increase Image Sales (April 2013 Webinar)
Mechanical Turk: Increase Image Sales (April 2013 Webinar)
Daniel Gray
ย 
Finding the true value of cloud computing
Finding the true value of cloud computingFinding the true value of cloud computing
Finding the true value of cloud computingDavid Linthicum
ย 
SAP Product Lifecycle Management: Implementation Tip, Tricks and Lessons
SAP Product Lifecycle Management:  Implementation Tip, Tricks and LessonsSAP Product Lifecycle Management:  Implementation Tip, Tricks and Lessons
SAP Product Lifecycle Management: Implementation Tip, Tricks and Lessons
Eric Stajda
ย 
How varian medical_customized_sap_screens_in_hours
How varian medical_customized_sap_screens_in_hoursHow varian medical_customized_sap_screens_in_hours
How varian medical_customized_sap_screens_in_hours
Peter Spielvogel
ย 
Amazon Web Services - Media Use Cases
Amazon Web Services  - Media Use CasesAmazon Web Services  - Media Use Cases
Amazon Web Services - Media Use CasesSantanu Dutt
ย 
Mechanical turk increase image sales webinar 040213
Mechanical turk increase image sales webinar 040213Mechanical turk increase image sales webinar 040213
Mechanical turk increase image sales webinar 040213
QuicoGray
ย 
1513 Driving Sap Value With It Bus Partnership
1513 Driving Sap Value With It Bus Partnership1513 Driving Sap Value With It Bus Partnership
1513 Driving Sap Value With It Bus Partnership
Suzanne Passante
ย 
Daybreak Pitch Deck.pdf
Daybreak Pitch Deck.pdfDaybreak Pitch Deck.pdf
Daybreak Pitch Deck.pdf
vikramsingh663539
ย 
Business process management center of excellence 2010
Business process management center of excellence 2010Business process management center of excellence 2010
Business process management center of excellence 2010
Robert Levy
ย 
Webhomes - What We Do
Webhomes - What We DoWebhomes - What We Do
Webhomes - What We Do
Peter Ashworth
ย 
Leverage CRM & Enterprise Apps with Genesys
Leverage CRM & Enterprise Apps with GenesysLeverage CRM & Enterprise Apps with Genesys
Leverage CRM & Enterprise Apps with GenesysTom Leddy
ย 
Addwiser Presentation Pdf
Addwiser Presentation PdfAddwiser Presentation Pdf
Addwiser Presentation PdfPrince George
ย 
Addwiser Presentation
Addwiser PresentationAddwiser Presentation
Addwiser Presentationsmita.philip
ย 
Addwiser Presentation Pdf
Addwiser Presentation PdfAddwiser Presentation Pdf
Addwiser Presentation PdfMonika Singh
ย 
Webhomes what we do v1.3
Webhomes   what we do v1.3Webhomes   what we do v1.3
Webhomes what we do v1.3
Peter Ashworth
ย 

Similar to Amazon mechanical turk intro to bpo's v3 (20)

ASUG 2010 - Efficient Usage Monitoring in a 160.000 User SAP Portal (by Frank...
ASUG 2010 - Efficient Usage Monitoring in a 160.000 User SAP Portal (by Frank...ASUG 2010 - Efficient Usage Monitoring in a 160.000 User SAP Portal (by Frank...
ASUG 2010 - Efficient Usage Monitoring in a 160.000 User SAP Portal (by Frank...
ย 
Jz 101 b
Jz 101 bJz 101 b
Jz 101 b
ย 
Aws 101 cloud computing seminar (reference model included)
Aws 101 cloud computing seminar (reference model included)Aws 101 cloud computing seminar (reference model included)
Aws 101 cloud computing seminar (reference model included)
ย 
Mechanical Turk: Increase Image Sales (April 2013 Webinar)
Mechanical Turk: Increase Image Sales (April 2013 Webinar)Mechanical Turk: Increase Image Sales (April 2013 Webinar)
Mechanical Turk: Increase Image Sales (April 2013 Webinar)
ย 
Finding the true value of cloud computing
Finding the true value of cloud computingFinding the true value of cloud computing
Finding the true value of cloud computing
ย 
SAP Product Lifecycle Management: Implementation Tip, Tricks and Lessons
SAP Product Lifecycle Management:  Implementation Tip, Tricks and LessonsSAP Product Lifecycle Management:  Implementation Tip, Tricks and Lessons
SAP Product Lifecycle Management: Implementation Tip, Tricks and Lessons
ย 
How varian medical_customized_sap_screens_in_hours
How varian medical_customized_sap_screens_in_hoursHow varian medical_customized_sap_screens_in_hours
How varian medical_customized_sap_screens_in_hours
ย 
Amazon Web Services - Media Use Cases
Amazon Web Services  - Media Use CasesAmazon Web Services  - Media Use Cases
Amazon Web Services - Media Use Cases
ย 
Mechanical turk increase image sales webinar 040213
Mechanical turk increase image sales webinar 040213Mechanical turk increase image sales webinar 040213
Mechanical turk increase image sales webinar 040213
ย 
1513 Driving Sap Value With It Bus Partnership
1513 Driving Sap Value With It Bus Partnership1513 Driving Sap Value With It Bus Partnership
1513 Driving Sap Value With It Bus Partnership
ย 
Daybreak Pitch Deck.pdf
Daybreak Pitch Deck.pdfDaybreak Pitch Deck.pdf
Daybreak Pitch Deck.pdf
ย 
Business process management center of excellence 2010
Business process management center of excellence 2010Business process management center of excellence 2010
Business process management center of excellence 2010
ย 
Webhomes - What We Do
Webhomes - What We DoWebhomes - What We Do
Webhomes - What We Do
ย 
LMC
LMCLMC
LMC
ย 
Leverage CRM & Enterprise Apps with Genesys
Leverage CRM & Enterprise Apps with GenesysLeverage CRM & Enterprise Apps with Genesys
Leverage CRM & Enterprise Apps with Genesys
ย 
Addwiser Presentation Pdf
Addwiser Presentation PdfAddwiser Presentation Pdf
Addwiser Presentation Pdf
ย 
Addwiser Presentation
Addwiser PresentationAddwiser Presentation
Addwiser Presentation
ย 
Addwiser Presentation
Addwiser Presentation Addwiser Presentation
Addwiser Presentation
ย 
Addwiser Presentation Pdf
Addwiser Presentation PdfAddwiser Presentation Pdf
Addwiser Presentation Pdf
ย 
Webhomes what we do v1.3
Webhomes   what we do v1.3Webhomes   what we do v1.3
Webhomes what we do v1.3
ย 

Recently uploaded

April 2024 Nostalgia Products Newsletter
April 2024 Nostalgia Products NewsletterApril 2024 Nostalgia Products Newsletter
April 2024 Nostalgia Products Newsletter
NathanBaughman3
ย 
3.0 Project 2_ Developing My Brand Identity Kit.pptx
3.0 Project 2_ Developing My Brand Identity Kit.pptx3.0 Project 2_ Developing My Brand Identity Kit.pptx
3.0 Project 2_ Developing My Brand Identity Kit.pptx
tanyjahb
ย 
The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...
Adam Smith
ย 
Search Disrupted Googleโ€™s Leaked Documents Rock the SEO World.pdf
Search Disrupted Googleโ€™s Leaked Documents Rock the SEO World.pdfSearch Disrupted Googleโ€™s Leaked Documents Rock the SEO World.pdf
Search Disrupted Googleโ€™s Leaked Documents Rock the SEO World.pdf
Arihant Webtech Pvt. Ltd
ย 
The-McKinsey-7S-Framework. strategic management
The-McKinsey-7S-Framework. strategic managementThe-McKinsey-7S-Framework. strategic management
The-McKinsey-7S-Framework. strategic management
Bojamma2
ย 
Sustainability: Balancing the Environment, Equity & Economy
Sustainability: Balancing the Environment, Equity & EconomySustainability: Balancing the Environment, Equity & Economy
Sustainability: Balancing the Environment, Equity & Economy
Operational Excellence Consulting
ย 
ModelingMarketingStrategiesMKS.CollumbiaUniversitypdf
ModelingMarketingStrategiesMKS.CollumbiaUniversitypdfModelingMarketingStrategiesMKS.CollumbiaUniversitypdf
ModelingMarketingStrategiesMKS.CollumbiaUniversitypdf
fisherameliaisabella
ย 
What are the main advantages of using HR recruiter services.pdf
What are the main advantages of using HR recruiter services.pdfWhat are the main advantages of using HR recruiter services.pdf
What are the main advantages of using HR recruiter services.pdf
HumanResourceDimensi1
ย 
Brand Analysis for an artist named Struan
Brand Analysis for an artist named StruanBrand Analysis for an artist named Struan
Brand Analysis for an artist named Struan
sarahvanessa51503
ย 
amptalk_RecruitingDeck_english_2024.06.05
amptalk_RecruitingDeck_english_2024.06.05amptalk_RecruitingDeck_english_2024.06.05
amptalk_RecruitingDeck_english_2024.06.05
marketing317746
ย 
Skye Residences | Extended Stay Residences Near Toronto Airport
Skye Residences | Extended Stay Residences Near Toronto AirportSkye Residences | Extended Stay Residences Near Toronto Airport
Skye Residences | Extended Stay Residences Near Toronto Airport
marketingjdass
ย 
Digital Transformation and IT Strategy Toolkit and Templates
Digital Transformation and IT Strategy Toolkit and TemplatesDigital Transformation and IT Strategy Toolkit and Templates
Digital Transformation and IT Strategy Toolkit and Templates
Aurelien Domont, MBA
ย 
Cree_Rey_BrandIdentityKit.PDF_PersonalBd
Cree_Rey_BrandIdentityKit.PDF_PersonalBdCree_Rey_BrandIdentityKit.PDF_PersonalBd
Cree_Rey_BrandIdentityKit.PDF_PersonalBd
creerey
ย 
Introduction to Amazon company 111111111111
Introduction to Amazon company 111111111111Introduction to Amazon company 111111111111
Introduction to Amazon company 111111111111
zoyaansari11365
ย 
RMD24 | Debunking the non-endemic revenue myth Marvin Vacquier Droop | First ...
RMD24 | Debunking the non-endemic revenue myth Marvin Vacquier Droop | First ...RMD24 | Debunking the non-endemic revenue myth Marvin Vacquier Droop | First ...
RMD24 | Debunking the non-endemic revenue myth Marvin Vacquier Droop | First ...
BBPMedia1
ย 
ikea_woodgreen_petscharity_dog-alogue_digital.pdf
ikea_woodgreen_petscharity_dog-alogue_digital.pdfikea_woodgreen_petscharity_dog-alogue_digital.pdf
ikea_woodgreen_petscharity_dog-alogue_digital.pdf
agatadrynko
ย 
FINAL PRESENTATION.pptx12143241324134134
FINAL PRESENTATION.pptx12143241324134134FINAL PRESENTATION.pptx12143241324134134
FINAL PRESENTATION.pptx12143241324134134
LR1709MUSIC
ย 
20240425_ TJ Communications Credentials_compressed.pdf
20240425_ TJ Communications Credentials_compressed.pdf20240425_ TJ Communications Credentials_compressed.pdf
20240425_ TJ Communications Credentials_compressed.pdf
tjcomstrang
ย 
BeMetals Presentation_May_22_2024 .pdf
BeMetals Presentation_May_22_2024   .pdfBeMetals Presentation_May_22_2024   .pdf
BeMetals Presentation_May_22_2024 .pdf
DerekIwanaka1
ย 
Attending a job Interview for B1 and B2 Englsih learners
Attending a job Interview for B1 and B2 Englsih learnersAttending a job Interview for B1 and B2 Englsih learners
Attending a job Interview for B1 and B2 Englsih learners
Erika906060
ย 

Recently uploaded (20)

April 2024 Nostalgia Products Newsletter
April 2024 Nostalgia Products NewsletterApril 2024 Nostalgia Products Newsletter
April 2024 Nostalgia Products Newsletter
ย 
3.0 Project 2_ Developing My Brand Identity Kit.pptx
3.0 Project 2_ Developing My Brand Identity Kit.pptx3.0 Project 2_ Developing My Brand Identity Kit.pptx
3.0 Project 2_ Developing My Brand Identity Kit.pptx
ย 
The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...
ย 
Search Disrupted Googleโ€™s Leaked Documents Rock the SEO World.pdf
Search Disrupted Googleโ€™s Leaked Documents Rock the SEO World.pdfSearch Disrupted Googleโ€™s Leaked Documents Rock the SEO World.pdf
Search Disrupted Googleโ€™s Leaked Documents Rock the SEO World.pdf
ย 
The-McKinsey-7S-Framework. strategic management
The-McKinsey-7S-Framework. strategic managementThe-McKinsey-7S-Framework. strategic management
The-McKinsey-7S-Framework. strategic management
ย 
Sustainability: Balancing the Environment, Equity & Economy
Sustainability: Balancing the Environment, Equity & EconomySustainability: Balancing the Environment, Equity & Economy
Sustainability: Balancing the Environment, Equity & Economy
ย 
ModelingMarketingStrategiesMKS.CollumbiaUniversitypdf
ModelingMarketingStrategiesMKS.CollumbiaUniversitypdfModelingMarketingStrategiesMKS.CollumbiaUniversitypdf
ModelingMarketingStrategiesMKS.CollumbiaUniversitypdf
ย 
What are the main advantages of using HR recruiter services.pdf
What are the main advantages of using HR recruiter services.pdfWhat are the main advantages of using HR recruiter services.pdf
What are the main advantages of using HR recruiter services.pdf
ย 
Brand Analysis for an artist named Struan
Brand Analysis for an artist named StruanBrand Analysis for an artist named Struan
Brand Analysis for an artist named Struan
ย 
amptalk_RecruitingDeck_english_2024.06.05
amptalk_RecruitingDeck_english_2024.06.05amptalk_RecruitingDeck_english_2024.06.05
amptalk_RecruitingDeck_english_2024.06.05
ย 
Skye Residences | Extended Stay Residences Near Toronto Airport
Skye Residences | Extended Stay Residences Near Toronto AirportSkye Residences | Extended Stay Residences Near Toronto Airport
Skye Residences | Extended Stay Residences Near Toronto Airport
ย 
Digital Transformation and IT Strategy Toolkit and Templates
Digital Transformation and IT Strategy Toolkit and TemplatesDigital Transformation and IT Strategy Toolkit and Templates
Digital Transformation and IT Strategy Toolkit and Templates
ย 
Cree_Rey_BrandIdentityKit.PDF_PersonalBd
Cree_Rey_BrandIdentityKit.PDF_PersonalBdCree_Rey_BrandIdentityKit.PDF_PersonalBd
Cree_Rey_BrandIdentityKit.PDF_PersonalBd
ย 
Introduction to Amazon company 111111111111
Introduction to Amazon company 111111111111Introduction to Amazon company 111111111111
Introduction to Amazon company 111111111111
ย 
RMD24 | Debunking the non-endemic revenue myth Marvin Vacquier Droop | First ...
RMD24 | Debunking the non-endemic revenue myth Marvin Vacquier Droop | First ...RMD24 | Debunking the non-endemic revenue myth Marvin Vacquier Droop | First ...
RMD24 | Debunking the non-endemic revenue myth Marvin Vacquier Droop | First ...
ย 
ikea_woodgreen_petscharity_dog-alogue_digital.pdf
ikea_woodgreen_petscharity_dog-alogue_digital.pdfikea_woodgreen_petscharity_dog-alogue_digital.pdf
ikea_woodgreen_petscharity_dog-alogue_digital.pdf
ย 
FINAL PRESENTATION.pptx12143241324134134
FINAL PRESENTATION.pptx12143241324134134FINAL PRESENTATION.pptx12143241324134134
FINAL PRESENTATION.pptx12143241324134134
ย 
20240425_ TJ Communications Credentials_compressed.pdf
20240425_ TJ Communications Credentials_compressed.pdf20240425_ TJ Communications Credentials_compressed.pdf
20240425_ TJ Communications Credentials_compressed.pdf
ย 
BeMetals Presentation_May_22_2024 .pdf
BeMetals Presentation_May_22_2024   .pdfBeMetals Presentation_May_22_2024   .pdf
BeMetals Presentation_May_22_2024 .pdf
ย 
Attending a job Interview for B1 and B2 Englsih learners
Attending a job Interview for B1 and B2 Englsih learnersAttending a job Interview for B1 and B2 Englsih learners
Attending a job Interview for B1 and B2 Englsih learners
ย 

Amazon mechanical turk intro to bpo's v3

  • 1. amazon web services Crowdsourcing for improving Business Process October, 2012 - Optimized for 1280x960 - ยฉ Amazon Web Services
  • 2. _ Presented by John Hoskins, hoskins @ amazon.com Mechanical Turk, Amazon [ Before we start ] 2
  • 3. How does it High Crowdsourcing work Examples Level Questions Detail What is MTurk? How is it used [ Our plan for today ] 3
  • 4. [ ] What is Crowdsourcing? 4
  • 5. [ Crowd Labor Trends ] 5
  • 7. [ Crowdsourcing: Key Advantages ] 7
  • 8. [ 1. Elastic Capacity ] 8
  • 9. On and Off Fast Growth Variable peaks Predictable peaks [ Staffing Usage Patterns ] 9
  • 10. On and Off WASTE Fast Growth Missed Variable peaks Opportunity Predictable peaks [ Staffing Usage Patterns ] 10
  • 11. On and Off Fast Growth Variable peaks Predictable peaks [ Usage Patterns: Crowdsourcing ] 11
  • 12. [ 2. On Demand Availability ] 12
  • 13. [ ] 3. Pay as you go, for what you use 13
  • 14. $ $ Lower costs Capital efficiency Improve productivity Focus on your business [ Business Benefits of Crowdsourcing ] 14
  • 15. 2. What is MTurk? 15
  • 16. Marketplace for Work _ Access to global workforce, on demand _ Quality controls and workflow โ€œbuilding blocksโ€ _ Pay as you go, only when satisfied with results _ Programmatic Access (API) [ What is Mechanical Turk? ] 16
  • 17. _ 500,000 Workers _ 190+ Countries [ Global Workforce ] 17 (as of Apr 19th, 2012)
  • 18. 3. How it works 18
  • 19. [ How it works ] 19
  • 20. Highest Performing Average MASTERS Unknown [ Mturk Workforce ] 20
  • 21. Highest Performing Average MASTERS Unknown Your Custom Workforce [ Custom Workforce ] 21
  • 22. Speed Price Accuracy [ Balances & Levers ] 22
  • 23. 4. How is it used? 23
  • 24. Data Management Analysis/Research _ Verification _ Sentiment _ Entry & Collection _ Relevance _ De-dupe _ Online Research _ Algorithm Training Content Management Annotation _ Moderation (Photos, Content) _ Tagging _ Transcription _ Classification _ Localization/Translation [ Common Use Cases ] 24
  • 25. How can we assess relevance of tweets in real-time? How can we research and categorize merchants in our database? How can we verify accuracy of low confidence OCR scans? How do we build a dictionary to categorize ads on the internet? [ Examples ] 25
  • 27. amazon web services http://www.mturk.com John Hoskins, Mechanical Turk hoskins@amazon.com 27