Setting up New Relic's Infrastructure:
A bunch of things we did wrong and a few we
did right.
DAVE PETERSON & NIC BENDERS
...
David Peterson
(dave@newrelic.com)

Nic Benders
(nic@newrelic.com)
[“star” graph of code base at launch]
100,000req/sec
2Gbps
200TB
Who Does What?
Site Operations != IT
You are not Batman

Do your work during the day
Lowest hour is still 60% of peak hour!
Put your servers
on the moon
Never open the box
Domain names are cheap
10.0.0.0/31
10.0.0.0/30
10.0.0.0/29
10.0.0.0/28
10.0.0.0/27
10.0.0.0/26
10.0.0.0/25
10.0.0.0/24
10.0.0.0/23
10.0.0.0/22
10...
Hardware
System Management
189 ms

167 ms

158 ms

137 ms

Average response time

X6550

E5-2450

E5-2643

E5-2690
25% performance improvement

2x 6-Core X6550
@ 2.67 GHz

2x 8-Core E5-2690
@ 2.90 GHz
Storage

√
Databases
32-bits isn't enough
class CreateTribbles < ActiveRecord::Migration
def change
create_table :tribbles do |t|
t.boolean :hu...
32-bits isn't enough
`id` int(11) NOT NULL AUTO_INCREMENT

`id` bigint(20) unsigned NOT NULL AUTO_INCREMENT

`id` SERIAL
Your database is not a queue
Long running queries
will kill you
And now, a thanks to the people who are out
there every day fixing the mistakes that we
made:
Jonathan Owens

Sean Kane

Jonathan Thurman

Paul Showalter

Aaron Bento

Karl Matthias
Setting Up New Relic's Infrastructure
Upcoming SlideShare
Loading in...5
×

Setting Up New Relic's Infrastructure

1,321

Published on

Published in: Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,321
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
10
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Setting Up New Relic's Infrastructure

  1. 1. Setting up New Relic's Infrastructure: A bunch of things we did wrong and a few we did right. DAVE PETERSON & NIC BENDERS 2013-10-25
  2. 2. David Peterson (dave@newrelic.com) Nic Benders (nic@newrelic.com)
  3. 3. [“star” graph of code base at launch]
  4. 4. 100,000req/sec 2Gbps 200TB
  5. 5. Who Does What?
  6. 6. Site Operations != IT
  7. 7. You are not Batman Do your work during the day
  8. 8. Lowest hour is still 60% of peak hour!
  9. 9. Put your servers on the moon
  10. 10. Never open the box
  11. 11. Domain names are cheap
  12. 12. 10.0.0.0/31 10.0.0.0/30 10.0.0.0/29 10.0.0.0/28 10.0.0.0/27 10.0.0.0/26 10.0.0.0/25 10.0.0.0/24 10.0.0.0/23 10.0.0.0/22 10.0.0.0/21 10.0.0.0/20 10.0.0.0/19 10.0.0.0/18 10.0.0.0/17 10.0.0.0/16 10.0.0.0-10.0.0.1 10.0.0.0-10.0.0.3 10.0.0.0-10.0.0.7 10.0.0.0-10.0.0.15 10.0.0.0-10.0.0.31 10.0.0.0-10.0.0.63 10.0.0.0-10.0.0.127 10.0.0.0-10.0.0.255 10.0.0.0-10.0.1.255 10.0.0.0-10.0.3.255 10.0.0.0-10.0.7.255 10.0.0.0-10.0.15.255 10.0.0.0-10.0.31.255 10.0.0.0-10.0.63.255 10.0.0.0-10.0.127.255 10.0.0.0-10.0.255.255 255.255.255.254 255.255.255.252 255.255.255.248 255.255.255.240 255.255.255.224 255.255.255.192 255.255.255.128 255.255.255.0 255.255.254.0 255.255.252.0 255.255.248.0 255.255.240.0 255.255.224.0 255.255.192.0 255.255.128.0 255.255.0.0 Private IPs are FREE 2 4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384 32768 65536
  13. 13. Hardware
  14. 14. System Management
  15. 15. 189 ms 167 ms 158 ms 137 ms Average response time X6550 E5-2450 E5-2643 E5-2690
  16. 16. 25% performance improvement 2x 6-Core X6550 @ 2.67 GHz 2x 8-Core E5-2690 @ 2.90 GHz
  17. 17. Storage √
  18. 18. Databases
  19. 19. 32-bits isn't enough class CreateTribbles < ActiveRecord::Migration def change create_table :tribbles do |t| t.boolean :hungry t.string :color t.references :parent, index: true end end end
  20. 20. 32-bits isn't enough `id` int(11) NOT NULL AUTO_INCREMENT `id` bigint(20) unsigned NOT NULL AUTO_INCREMENT `id` SERIAL
  21. 21. Your database is not a queue
  22. 22. Long running queries will kill you
  23. 23. And now, a thanks to the people who are out there every day fixing the mistakes that we made:
  24. 24. Jonathan Owens Sean Kane Jonathan Thurman Paul Showalter Aaron Bento Karl Matthias
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×