MongoDB at MercadoLibre
Upcoming SlideShare
Loading in...5
×
 

MongoDB at MercadoLibre

on

  • 1,464 views

Presentation for MongoDB Buenos Aires 2012

Presentation for MongoDB Buenos Aires 2012

Statistics

Views

Total Views
1,464
Views on SlideShare
1,453
Embed Views
11

Actions

Likes
3
Downloads
10
Comments
0

4 Embeds 11

http://www.linkedin.com 5
https://www.linkedin.com 3
http://www.docshut.com 2
https://twitter.com 1

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n

MongoDB at MercadoLibre MongoDB at MercadoLibre Presentation Transcript

  • MongoDB At MercadoLibreWh at h ave we le a rned
  • OverviewAbout MeLiWhy MongoDB?Use casesLessons LearnedWrapping Up
  • MeLi - Platform
  • MeLi - Facts!20M requests / minute 50K requests / sec (peaks) 4 Gb bandwidth / sec
  • MeLi - Facts!20M requests / minute 50K requests / sec (peaks) 4 Gb bandwidth / secOur farm +1000 physical server +6000 virtual instances
  • MeLi - InsideLot of fun here playing with new stuff :P
  • MeLi - InsideLot of fun here playing with new stuff :POur NoSQL stack Redis Memcached Hadoop
  • MeLi - InsideLot of fun here playing with new stuff :POur NoSQL stack Redis Memcached Hadoop .... and of course
  • Why MongoDB?Horizontal ScalingHigh AvailabilityPerformanceFlexible Data!
  • Why MongoDB?Horizontal ScalingHigh AvailabilityPerformanceFlexible Data!
  • Why MongoDB?(... and more) JavaScript(‘ing) Polyglot Open Source Awesome Community Support
  • Support :-)
  • Use Cases DB Documents Social +700M Orders +23MFeedback +3M Emails +61M Items +200MLogging +332M
  • Use Case: SocialStore Meli’s users social dataLOT of data (friends, likes, ...)> 500 Gb> 700 M documents12 shards servers : 4 replica setEach replica set = 3 servers80Gb per instance
  • Use Case: Social Sp ec @T ial ioB thk or stStore Meli’s users social data rac o hoLOT of data (friends, likes, ...)> 500 Gb> 700 M documents12 shards servers : 4 replica setEach replica set = 3 servers80Gb per instance
  • Use Case: Items1 Item!
  • Use Case: Items1 Item!
  • Use Case: Items1 Item!
  • Use Case: Items 1 Item!N x N x N ... > 100k rows
  • Use Case: Items1 Item!
  • Use Case: Logging Capped Collections!Info logs RabbitMQ messages Track certain use casesErrors logs Something bad happen... Recuperable errors with retry handler
  • Lessons LearnedStorage File System NSF: Bad choice, Poor results Ext4: Far much better Mount Options Reducing Disk IO by mounting partitions with noatime and nodiratime Track disk performance iostat -xm 2 (%util column < 100%)
  • Lessons LearnedVM’s Shard instances 4 cores >= 16 Gb ram Config server low cpu consumption 1Gb ram / 1Gb storage Mongos runs along with the webserver (client) 1 mongos x webserver
  • Lessons LearnedMonitoring Disk usage (with zenoss) Ping health check curl --connect-timeout 3 --write-out %{http_code} --silent --output /dev/null http://localhost:28017/_status
  • Lessons LearnedMonitoring MMS - It’s free!
  • Lessons LearnedPlan your actions! Shard key Upgrades Cfg Servers + bad decisions = Lot of rework ...
  • Lessons LearnedPlan your actions! Shard key Upgrades Cfg Servers + bad decisions = Lot of rework ... Study Think Plan Hands On!
  • Wrapping Up!Meli loves MongoDB!
  • The End Questions? {  name     : "Pablo Molnar",   title    : "Software Engineer", work    : "MercadoLibre", location : "Buenos Aires", twitter  : "@pablomolnar" }