CrowdSearch is a system that uses human workers on Amazon Mechanical Turk to validate image search results in real-time on mobile phones. It has three main components: 1) an image search engine that extracts features from query images and searches a database, 2) a crowdsearch algorithm that optimizes delay and cost by predicting validation times and results, and 3) a system implementation that coordinates the image search engine and human validators. The system was able to improve search precision using human validation while meeting user-specified deadlines in experimental evaluations.

1. CrowdSearch: Exploiting Crowds for Accurate Real-time Image Search on Mobile PhonesTienShengWenDepartment of Electronic EngineeringChung-Yuan Christian University, TaiwanTingxin Yan, Vikas Kumar, Deepak GanesanDepartment of Computer ScienceUniversity of Massachusetts, Amherst, MA 01003{yan, vikas, dganesan}@cs.umass.edu

2. OutlineIntroduction

3. System Architecture

4. Crowdsearch for Search

5. CrowdsearchAlgorithm

6. Image Search Engine

7. System Implementation

8. Experimental Evaluation

9. Conclusions Introduction Image search system for mobile phones

10. Real-time validation

11. Beyond Image Search

12. System Performance

13. Payment System ArchitectureCrowdSearchis implemented on Apple iPhone and Linux servers.Requires three pieces of information prior to initiating search: (a) A image query(b) A query deadline(c) A payment mechanism for human validators

14. Crowdsearchfor SearchAmazon Mechanical Turk (AMT)