dharshanrAt MongoDirector (www.mongodirector.com) we automate the entire process of deploying and managing Mongo replica sets and shards. Provisioned IOPS are used for optimal performance. We also use LVM snapshots for backup so that your backups take the same amount of time irrespective of the size of data.2 months ago
Are you sure you want to
nachainThe suggestions given here were really helpful and thanks a lot for that. We are currently moving our EBS volumes to RAID 10 structure, and I have a question related to that.
If we use mdadm *only*, it looks like there is no way to increase the size of storage after the initial set-up.
If I use LVM on top of mdadm, then we can extend the storage online by adding one or more RAID 10 devices to LVM. However adding LVM means one more piece and more complexity. It would be great if we could just do it using mdadm, but I can't seem to find a solution. Any tips here would be great. Thanks.1 year ago
Amazon EC2 Instance Types 32-bit = Don’t Use Typical MongoD ConfigD/ Arbiter Big MongoD 32-bit = Don’t Use High CPU not necessary
OS Turn off atime Raise file descriptor limits cat >> /etc/security/limits.conf << EOF * hard nofile 65536 * soft nofile 65536 EOF DO NOT use large VM pages Use ext4, xfs Use RAID RAID10 on MongoD RAID1 on ConfigbDB Warning! Known problems with Ubuntu 10.04 & EBS https://bugs.launchpad.net/ubuntu/+source/linux-ec2/+bug/614853 https://bugzilla.kernel.org/show_bug.cgi?id=16991
Mongodb components on ec2
MongoD on EC2 MongoD 64-Bit EC2 Instance LVM or MDADM RAID 10 EBS Volumes
MongoS on EC2 Language Specific Driver Your App 32- or 64-Bit EC2 Instance (Typically your app server) MongoS
Arbiter on EC2 64-Bit EC2 Instance (Micro Instance is Fine) Arbiter Local Instance Storage
ConfigDB on EC2 64-Bit EC2 Instance (Micro Instance is Fine) ConfigDB LVM or MDADM RAID 1 EBS Volumes
Deployment Scenarios
3-Node Replica Set Your App Large Large Large MongoD (Primary) MongoD (Secondary) MongoD (Secondary) RAID 10 RAID 10 RAID 10
2-Nodes + Arbiter Your App Large Large Micro MongoD (Primary) MongoD (Secondary) Arbiter RAID 10 RAID 10
3-Node Replica Set Your App US West US East Large Large Large MongoD (Primary) MongoD (Secondary) MongoD (Secondary) Priority = 0 RAID 10 RAID 10 RAID 10
Operational Considerations Automating Deployment Puppet Chef Amazon CloudFormation
Backup / Restore EBS Snapshots Also for rapid replica provisioning LVM Snapshots Use secondaries for zero downtime backups http://www.mongodb.org/pages/viewpage.action?pageId=19562846
Security Groups
All nodes listen on all interfaces unless –bind_ip is specified
Specify alternate port with –port
Don’t mix names & IP’s. Names preferred
Use security groups as access control lists
(e.g. allow 27017 from app servers, but not everybody)
Final thoughts EC2 is a great platform for Mongo Lots of production use Try it out! Test a big cluster for cheap! We’re here to help!
Questions? I am Jared Rosoff (jsr@10gen.com) @forjared Try it out! http://www.mongodb.org/downloads http://www.mongodb.org/display/DOCS/Amazon+EC2
If we use mdadm *only*, it looks like there is no way to increase the size of storage after the initial set-up.
If I use LVM on top of mdadm, then we can extend the storage online by adding one or more RAID 10 devices to LVM.
However adding LVM means one more piece and more complexity. It would be great if we could just do it using mdadm, but I can't seem to find a solution. Any tips here would be great. Thanks. 1 year ago