This document discusses the differences between cloud, colocation, and bare metal infrastructure options. It covers key considerations for performance including CPU, memory, disk, and network latency and bandwidth. Colocation provides hardware at a specific location while maintaining internal skills, but has costs for total spend, hardware specifications, and power usage. Cloud infrastructure offers elastic workloads and support for demand spikes and unknown requirements, but bare metal is preferable for managed hardware replacement and networking needs. Overall, the best option depends on an organization's specific workload characteristics and skills.

1. Infrastructure choices
Cloud vs colo vs bare metal
Cloud Conf, Turin 2015
David Mytton, CEO, Server Density

2. David Mytton

4. Slides: @davidmytton

5. Agenda
• Cloud
• Bare metal
• Colocation
• Performance considerations

6. Performance Considerations
• CPU
• Memory
• Disk
• Network

7. Network
• Port speeds

8. Network
• Latency
• Port speeds

9. Network
• Latency
• Port speeds

10. Network
• Latency
• Port speeds
Location Ping RTT
Within USA 40-80ms
Trans-Atlantic 100ms
Trans-Pacific 150ms
Europe - Japan 300ms

11. Network
• Latency
• Services
• Port speeds

12. Network
• Latency
• Services
• Port speeds
• Uses

13. Network
• 1d, 1h, 58m
• 11.22MB/s

14. Network
• 1d, 1h, 58m

15. CPU
• Clock speed

16. CPU
• # of cores
• Clock speed

17. CPU
• # of cores
• Architecture
• Clock speed

18. CPU
• # of cores
• Architecture
• Clock speed
• Steal

19. Memory
• Exact amounts

20. Memory
• Pricing
• Exact amounts

21. Memory

22. Memory
EC2 Instance CPUs Memory (GB) Pricing
r3.large 2 15 $130/m
r3.2xlarge 8 61 $520/m
r3.8xlarge 32 244 $2083/m

23. Disk
• (Local) SSD

24. Disk
• Magnetic
• (Local) SSD

25. Disk

26. Disk
• Magnetic
• (Local) SSD
• NAS

27. Disk
• Magnetic
• (Local) SSD
• NAS
• i/o

28. Cloud
• Elastic workloads

29. Cloud
• Demand spikes
• Elastic workloads

30. Cloud
• Demand spikes
• Elastic workloads
• Unknown requirements

31. Cloud
• Demand spikes
• Elastic workloads
• Unknown requirements
• Supporting services

32. Bare metal
• Hardware replacement

33. Bare metal
• Managed / support
• Hardware replacement

34. Bare metal
• Managed / support
• Hardware replacement
• Networking

35. Colocation
• Hardware spec / price

36. Colocation
• Total cost
• Hardware spec / price

37. Colocation
• Total cost
• Hardware spec / price
• Internal skills

38. Colocation
• Total cost
• Hardware spec / price
• Internal skills
• More fun?

40. Colo experiment
• x2 8C AMD 2.8Ghz
• Dell 1U R415
• 32GB RAM
• Dual PSU, NIC
• x4 1TB SATA hot swappable

41. Colo experiment
• 51-100Mbps - £15/Mbps/m
• 10-50Mbps - £20 - £25/Mbps/m
• 100Mbps - £13/Mbps/m

42. Colo experiment
• 1000Mbps metro - £750/m
• 100Mbps metro - £300/m

43. Colo experiment
• 4.5A - £520/m
• £300-350/kWh/m
• 9A - £900/m

45. ありがとうございます
david@serverdensity.com
@davidmytton