Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Renat Gilmanov "Visual search results validation or where is my ninja turtles?"

15 views

Published on

BigData & Data Engineering

Published in: Engineering
  • Be the first to comment

  • Be the first to like this

Renat Gilmanov "Visual search results validation or where is my ninja turtles?"

  1. 1. Visual search results validation or where is my ninja turtles bucket? NOV 3, 2018
  2. 2. 2CONFIDENTIAL ATLAS project
  3. 3. Search products A simple interface to a very complex problem
  4. 4. ATLAS timeline
  5. 5. Why can’t Elasticsearch solve the problem?
  6. 6. ATLAS toolbox Adaptive strategies Computer visionIntelligence
  7. 7. Automated synonym detection teaser Picture is photo Drama is show Love is hate
  8. 8. Search products A simple interface to a very complex system
  9. 9. Search products
  10. 10. 11CONFIDENTIAL A quick test
  11. 11. Test 1: select a dark t-shirt
  12. 12. Test 1: select a cheap t-shirt
  13. 13. Sometimes less is more Unsatisfied customer Time Choices We have to respect human nature
  14. 14. Another example t-shirt T-Shirt Soft Cotton Are you kidding me?
  15. 15. 18CONFIDENTIAL The problem
  16. 16. A proper way to start Let’s search for “mutant ninja turtles”
  17. 17. Expected Experienced
  18. 18. Full text search has flaws Full text searching is likely to retrieve many documents that are not relevant to the intended search question. The retrieval of irrelevant documents is often caused by the inherent ambiguity of natural language. Product description and specifications might affect relevancy badly.
  19. 19. 25CONFIDENTIAL Any solution?
  20. 20. Basic idea Top queries Product images from Google/Amazon/etc Phase1: Training AI and Computer vision
  21. 21. Basic idea Top queries AI and Computer vision Product images from Google or/and Amazon Phase1: Training Trained models
  22. 22. Basic idea Top queries AI and Computer vision Product images from Google or/and Amazon Products Trained models OK NOT OK Phase2: TestingPhase1: Training
  23. 23. Basically, it is an artificial eye
  24. 24. Technology we use
  25. 25. 32CONFIDENTIAL Results
  26. 26. 36CONFIDENTIAL Self-learning?
  27. 27. Self-learning problem: cultural perspective
  28. 28. Where is my rectangle?!? Computer vision is not that accurate
  29. 29. TV – 72%
  30. 30. Evil test (TBD) Nice dress! Nice dress! TBD TBD
  31. 31. 42CONFIDENTIAL Additional validation
  32. 32. Non uniform products in the feed Vision NOT OK NOT OK
  33. 33. Identify product shape • No manual operations are allowed • All products should be uniform Small area Big area
  34. 34. Example #1 I’m so tired…
  35. 35. Product shape 01 TBD
  36. 36. Product shape 02 TBD
  37. 37. Uniform products improve the experience OK! OK!
  38. 38. Good model – Good results
  39. 39. 52CONFIDENTIAL The solution at scale
  40. 40. Splitting axe model training Trained model … additional 1000 000 examples
  41. 41. Multiple data sources Trained models Amazon Google Wikipedia Verified training sets
  42. 42. Complete solution • Fast • Extremely fast comparing to a manual testing • Knows everything • Validates visual results • Adapts and learns on the fly • Works 24/7 Trained models “splitting axe” model
  43. 43. 56CONFIDENTIAL Question & Answers

×