Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Big Dating at eHarmony


Published on

Thod Nguyen's presentation on "Big Dating at eHarmony" at MongoDB World 2014

  • Be the first to comment

  • Be the first to like this

Big Dating at eHarmony

  1. 1. Thod Nguyen Chief Technology Officer Big Dating at eHarmony
  2. 2. social impact
  3. 3. big dating at scale 3B+ potential matches daily ~ 25+ TB of data 60M+ multi-attribute queries daily looking across 250+ attributes 212M+ photos ~ 15+ TB of data 4B+ relationship questionnaires ~ 25+ TB of data
  4. 4. the big win for product Decreased the processing time to match by 95%, from 2+ weeks to 12 hours on 3B+ potential matches/day 30% increase in 2-way communications 50% increase in paid subs 60% increase in unique visitors
  5. 5. today Compatibility Matching System The Old The New Why MongoDB What’s Next
  6. 6. compatibility matching system® Compatibility Matching System® Match Distribution 3 Compatibility Matching 1 Affinity Matching 2
  7. 7. Compatibility Matching System® Affinity Matching Match Distribution 2 3 compatibility matching system (cont’d) Compatibility Matching 1
  8. 8. traditional search
  9. 9. eharmony matching
  10. 10. compatibility models
  11. 11. compatibility matching process
  12. 12. legacy compatibility match processor (CMP)
  13. 13. legacy compatibility match processor V.2 (CMP)
  14. 14. challenges with existing v2. design
  15. 15. challenges with existing v2. design (contd.)
  16. 16. challenges with existing v2. design (contd.)
  17. 17. challenges with existing v2. design (contd.)
  18. 18. challenges with existing v2. design (contd.)
  19. 19. new data store requirements
  20. 20. why Mongodb?
  21. 21. tradeoffs No schema = larger footprint Aggregation queries are different Initial configuration can be long, manual process
  22. 22. lessons learned Turn on the Firehose Unleash the Chaos Monkey Engage MongoDB, Inc. early – dev to production Try to isolate your queries to a shard Run in shadow mode
  23. 23. what’s next New matching use cases: Globalization and Localization of eH site Careers by eHarmony Internet of Things “Compatible” New use cases within eHarmony: Real-time geo location based matching service Careers
  24. 24. technology stack
  25. 25. We’re Hiring