Your SlideShare is downloading. ×
The Where and When of NoSQL Platforms
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

The Where and When of NoSQL Platforms

1,312

Published on

Logicworks presents Just Say No to SQL as part of the Digital Media Series, moderated by Mashable's own Christina Warren.

Logicworks presents Just Say No to SQL as part of the Digital Media Series, moderated by Mashable's own Christina Warren.

Published in: Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,312
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
9
Comments
0
Likes
1
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • Mirror modeShort timeoutsLog errors DB2 is still database of record
  • Transcript

    • 1. PRESENTS
    • 2. Moderator
      Christina Warren,
      Panelists
      Harry Heymann, Head of Server Engineering at
      Michael Bryzek, CTO & Founder at
      Frank Weigel, Director of Products at
      Matt Pfeil, VP of Customer Solutions and Co-Founder at
      Dave Connors, VP of Operations at  
      Dwight Merriman, CEO at 10Gen at
    • 3. The Old World
      Pros
      Transactional integrity
      Sequential nature
      Cons
      • Expensive
      • 4. Scale up typically not out
    • The New World
       
    • 5. Why ??
      Huge volume of content
      Distributed Infrastructure
      Relaxed and agile
      Throw the RD rules out the window
      Speed of development
      No DBA needed
      Elastic scaling (out not up)
      Major cost savings
    • 6. Platforms
    • 7. Companies
    • 8. Michael Bryzek CTO & Founder
    • 9. GILT GROUPEis an innovative e-commerce company offering highly coveted products and experiences at insider prices.
    • 10. One of the Most Innovating Companies
      “Gilt Groupe, the online shopping phenomenon”
      --Alexandra Kotur, Vogue
      “The t-shirt arrived the very next day in a clean box with nicely folded black tissue paper and a friendly note from the founders thanking me for my purchase. They're thanking me? No, Gilt Groupe, thank you.”
      --Damien Nunes, GQ (on his first purchase)
      “The French invented the online sample sale for designer merchandise, spawning numerous American competitors, but none boasts the pedigree of Gilt Groupe.”
      --Fortune, (from their story “Dotcom Divas”)
      “People with a taste for high-end fashion items have turned Gilt into a guiltless addiction.”
      --Roy Furchgott, The New York Times
    • 11. 10,000 foot view
    • 12. The Shopping Cart
    • 13. Harry Heymann
      Head of Server Engineering
    • 14.
    • 15. mongodb: some numbers
      • 8 clusters
      • 16. some sharded, some not
      • 17. some master/slave, some replica sets
      • 18. ~40 machines (68GB, m2.4xl on EC2)
      • 19. 2.3 billion records
      • 20. ~15k QPS
    • Why MongoDB?
      Biggest reason (by far): auto sharding:
      • Started on a single SQL database.  Eventually split to two nodes: 1 for check-ins (our biggest dataset), 1 for everything else.
      • 21. It was clear that check-ins would grow beyond what a single machine could handle.
      • 22. Major efficiency gains by outsourcing the development of the sharding layer to consultants at 10gen.
    • Dave Connors, VP of Operations
    • 23. Constant Contact
      • Customers are Small Businesses
      • 24. Email, Event, Survey & now Social Media
      • 25. Over 450k paying customers
      • 26. Business model
      • 27. Many customers pay as little as $15 a month
      • 28. ~2 million database transactions per minute
      • 29. Business problem
      • 30. Social Media  up to 100 times more data
      • 31. Challenge with our business model
    • Implementation
      Cultural Challenges: NoSQL
      Traditional Roles
    • 38. Managing Risk: Phased Rollout
      • Switchable modes
      • 39. Mirroring
      • 40. Dial-able traffic
    • Conclusion
      Business Value Comparison
    • 41. Technologists
    • 42. Dwight Merriman
      CEO
    • 43. Past:RDBMS
      one size fits all
    • 44. other segments
      e.g. search
      RDBMS
      BI / Data warehousing
    • 45. RDBMS
      other segments
      e.g. search
      RDBMS
      BI / Data warehousing
      aster, greenplum, neteeza, teradata, vertica, hadoop
      NoSQL
    • 46.
      • very complex transactional semantics
      • 47. legacy projects
      • 48. projects requiring SQL
      RDBMS
      other segments
      e.g. search
      RDBMS
      BI / Data warehousing
      aster, greenplum, neteeza, teradata, vertica, hadoop
      NoSQL
      • a few gigantic queries
      • 49. visual client tools important -> a need for SQL
      • 50. scales horizontally (better ones)
      • 51. agile
      • 52. programmer friendly data modle
      • 53. horizontall scalable
      • 54. works for operational data (lots of small reads and writes)
    • Frank Weigel, Director of Products
    • 55. Couchbase Server Architecture
      11211
      11210
      memcapable 1.0
      memcapable 2.0
      moxi
      Memcached Managed Cache
      protocol listener/sender
      REST management API/Web UI
      vBucket state and replication manager
      Rebalance orchestrator
      Node health monitor
      Heartbeat
      Process monitor
      Global singleton supervisor
      Configuration manager
      Data Manager
      Cluster Manager
      engine interface
      Couchbase Storage Engine
      http
      on each node
      one per cluster
      Erlang/OTP
      HTTP
      distributed erlang
      erlang port mapper
      21100 – 21199
      4369
      8091
    • 56. MySQL
      : Migrating to Couchbase
      Example of online migration of existing application.
      First migrated large or slow performing tables and frequently updated fields from MySQL to Couchbase
      Web Server
      Web Server
      Apache + PHP
      Apache + PHP
      Client-side Moxi
      Client-side Moxi
      memcached
      protocol listener/sender
      memcached
      protocol listener/sender
      memcached
      protocol listener/sender
      TAP
      TAP
      TAP
      engine interface
      engine interface
      engine interface
      Couchbase Storage Engine
      Couchbase Storage Engine
      Couchbase Storage Engine
      30
    • 57. Matt Pfeil, VP of Customer Solutions
    • 58. Architecture
    • 59. Better technology
      Multi-master, multi-DC
      Linearly scalable
      Larger-than-memory datasets
      Best-in-class performance (not just writes!)
      Fully durable
      Integrated caching
      Tuneable consistency
    • 60. A performance retrospective
    • 61. Credit: Nathan Hurst, 2010
    • 62. QUESTIONS FROM THE AUDIENCE
    • 63. THANK YOU FOR JOINING US!
      We look forward to seeing you at our upcoming events

    ×