reddit is a subsidiary of Conde Nast. They are a multi-billion doallar media conglomorate that owns TV, newspapers, and some of the biggest brand names in publishing, such as Vogue, GQ, etc
They also have a lot of webistes (other than reddit). currently doing an EC2 proof of concept with Vogue UK and wired.com is also using EC2 for some of their site functionality. But reddit is by far the biggest user of EC2 in Conde Nast.
community where people come together share and discuss interesting things on the internet such as links to other stuff or their own content.
Been AWS user since almost the begining
When we started, we had a custom logo almost every day.
Unfortunately, allowing the designer SVN access was untenable. So we signed up for S3, and everything was great!
Now have over 20 million items in a single s3 bucket.
This is a graph of actual costs vs. what we could have spent on EC2. you can see the spike every time we had to get a new cabinet full of servers
So we had to make a decision
This was before Amazon offered the Virtual Private Cloud service. Ran like this for about 7 months, slowing adding new machines as necessary. This went so well we decided to move our whole site to EC2
started by migrating all the data that could be done ahead of time set up replication to keep the data up to date
multiple zones beta/staging is elastic app servers are elastic
What our datacenter would have cost vs. what we pay now 29% cheaper!
Time to market is faster because I no longer have to wait for servers or set them up. i can get capacity when i need it
As Amazon upgrades their hardware, I can move up to better stuff.
Don’t have to pay for capacity we don’t need. I can shut down servers at night, or if a product doesn’t take off
But moving to EC2 wasn’t all roses
Virtualized hardware just doesn’t get sub-millisecond response times. We had to rethink how we used memcached, making less calls for more data at a time
Due to the redundant and network based nature, sometimes the underlying drive has to remirror or the network may be momentarily unavailable. This can be avoided by having read slaves and caching It forced me to add read slaves I should have had anyway
It is a new paradigm you have to get used to. Ideally the machine can be told to boot and then be ready with no user intervention.
I can’t stress this enough.
Eric Hammond’s runurl to trigger a push of the keys to only authorized hosts.
get a whole application stack in at least 2 zones
aka. nosql. We’re mostly there, just a few more bits
A more functional style of programming is generally more reliable in exchange for eventual consistancy
We are open source, so go to code.reddit.com to see our source.
This the website of our book which we hope to start filling with lots of useful stuff soon. stay tuned. thank you.