Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Hosting Open Source Projects at the OSUOSL

2,432 views

Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Hosting Open Source Projects at the OSUOSL

  1. 1. <ul>Hosting Open Source Projects at the OSUOSL </ul><ul>Lance &quot;Ramereth&quot; Albertson Systems Administrator / Architect </ul>
  2. 2. <ul>About me </ul><ul><ul><li>OSU Open Source Lab
  3. 3. Server hosting for Open Source projects
  4. 4. Open Source development projects
  5. 5. Lead Systems Administrator
  6. 6. Gentoo Developer
  7. 7. Trumpet Jazz performer </li></ul></ul>
  8. 8. <ul>In the Beginning... </ul><ul><ul><li>University President sees &quot;www.orst.edu&quot; on a sign
  9. 9. Maintain - DNS/DHCP management
  10. 10. Seed money from OSU Network Services
  11. 11. First clients are some of the most well known Open Source projects  </li></ul></ul><ul>Picture flickr user 'tappnel' </ul>
  12. 12. <ul>Why do hosting at OSU? </ul><ul>&quot; Our commitment to the development and application of Open Source is consistent with our drive to be the land grant university of the 21st century. Through open source activities we are helping under-served populations around the world and creating new industries and new products at home. &quot; OSU president, Ed Ray </ul>
  13. 13. <ul>Timing is everything </ul><ul><ul><li>Post dot-com bust = lots of dark fiber
  14. 14. Invested $250K into laying 11mi of fiber to I-5
  15. 15. &quot;Cheap&quot; bandwidth
  16. 16. Internet2 connectivity
  17. 17. Newly renovated data center </li></ul></ul>
  18. 18. <ul>Staff </ul><ul><ul><li>8 full-time employees / ~8 undergrad students </li></ul></ul><ul><ul><ul><li>Hosting
  19. 19. Development
  20. 20. Government Outreach
  21. 21. ORVSD
  22. 22. Outreach Manager
  23. 23. MeeGo/Intel Dev 
  24. 24. Operations Manager
  25. 25. Director </li></ul></ul></ul>
  26. 26. <ul>Students </ul><ul><ul><li>Undergraduate students
  27. 27. Full root access
  28. 28. Hired at Freshmen or Sophomore year
  29. 29. Constant turnover (2-3yrs/student) </li></ul></ul>
  30. 30. <ul>Data Center Specs </ul><ul><ul><li>2770 sqft, 76 Colo racks, 11 IDF racks
  31. 31. Dual independent power feeds </li></ul></ul><ul><ul><ul><li>ea 400A / 480V
  32. 32. 3-phase
  33. 33. Dual UPS
  34. 34. Single generator </li></ul></ul></ul><ul><ul><li>55 ton cooling capacity via 3 Lieberts </li></ul></ul><ul>One of two primary UPS's </ul>
  35. 35. <ul>Networking </ul><ul><ul><li>NERO </li></ul></ul><ul><ul><ul><li>Network for Education & Research in Oregon </li></ul></ul></ul><ul><ul><li>10 Gbps to NERO
  36. 36. Cisco 6509 Core
  37. 37. 2 Gbps to upstream (10 Gbps coming soon)
  38. 38. IPv6 coming soon </li></ul></ul><ul>10Gbps uplink to NERO </ul>
  39. 39. <ul>Datacenter 1st row </ul>
  40. 40. <ul>Datacenter 2nd row </ul>
  41. 41. <ul>Datacenter </ul>
  42. 42. <ul>Hosted Machines </ul><ul><ul><li>266 servers + ~100 MeeGo servers
  43. 43. ~130 virtual machines 
  44. 44. Projects purchase/own servers  </li></ul></ul><ul><ul><ul><li>22 racks used by OSL currently
  45. 45. Project racks: Drupal, ASF, Gentoo, Linux Foundation, MeeGo </li></ul></ul></ul><ul><ul><li>What are they running? </li></ul></ul><ul><ul><ul><li>Debian/Ubuntu, CentOS, FreeBSD </li></ul></ul></ul>
  46. 46. <ul>ASF & Drupal Racks </ul>
  47. 47. <ul>Google OSPO Servers </ul>
  48. 48. <ul>Freenode </ul>
  49. 49. <ul>Xiph.org </ul>
  50. 50. <ul>Kernel.org (master.kernel.org) </ul>
  51. 51. <ul>Services Provided at the OSL </ul><ul><ul><li>Co-location hosting
  52. 52. Smart-hands support
  53. 53. Virtual machine(s)
  54. 54. Managed hosting
  55. 55. FTP Mirror space
  56. 56. Email forwarding
  57. 57. DNS hosting </li></ul></ul>
  58. 58. <ul>FTP Mirrors </ul><ul><ul><li>3 servers </li></ul></ul><ul><ul><ul><li>Corvallis, Oregon
  59. 59. Chicago, IL
  60. 60. New York, NY </li></ul></ul></ul><ul><ul><li>6 TB capacity
  61. 61. Split via DNS view
  62. 62. 700 Mbps avg total
  63. 63. TDS Telecom </li></ul></ul><ul>ftp-osl.osuosl.org </ul>
  64. 64. <ul>Virtualization </ul><ul><ul><li>Ganeti </li></ul></ul><ul><ul><ul><li>Ganeti Web Manager </li></ul></ul></ul><ul><ul><li>Linux KVM hypervisor
  65. 65. Easy to expand
  66. 66. Primary cluster </li></ul></ul><ul><ul><ul><li>5 machines / 75VMs </li></ul></ul></ul><ul><ul><li>Project clusters </li></ul></ul><ul><ul><ul><li>phpBB, OSGeo, OSM, ORVSD </li></ul></ul></ul>
  67. 67. <ul>Supercell </ul><ul><ul><li>Continuous integration testing
  68. 68. Run-time testing
  69. 69. Several platforms supported
  70. 70. On-demand virtualization
  71. 71. Powered by Ganeti+KVM
  72. 72. Hardware donation by Facebook
  73. 73. Still in beta </li></ul></ul>
  74. 74. <ul>Hosting FAQ </ul><ul><ul><li>Hosting tailored to each project
  75. 75. Target medium-large &quot;high impact&quot; projects
  76. 76. Typically outgrown their current hosting
  77. 77. Bad experiences with other hosting
  78. 78. Let the projects code instead of worrying about their site </li></ul></ul>
  79. 79. <ul>Requesting Hosting </ul><ul><ul><li>http://osuosl.org/services/hosting
  80. 80. Submit request to support@osuosl.org 
  81. 81. What we look for </li></ul></ul><ul><ul><ul><li>Widely used project
  82. 82. Healthy community
  83. 83. Needs fit within our resources </li></ul></ul></ul>
  84. 84. <ul>Hosted Projects </ul>
  85. 85. <ul>New Projects / Stories </ul><ul><ul><li>Supercell launched
  86. 86. New Projects </li></ul></ul><ul><ul><ul><li>Elgg, crosstool-NG, speed.python.net, Project Harmony, Freedroid, OpenStreetMap US, Mageia, Sahana Foundation, Meego, Open Compute </li></ul></ul></ul><ul><ul><li>Ganeti Web Manager
  87. 87. New Outreach Manager / Meego Dev
  88. 88. Bandwidth Upgrades </li></ul></ul>
  89. 89. <ul>Growth </ul><ul><ul><li>4 years ago... </li></ul></ul><ul><ul><ul><li><10 racks
  90. 90. ~60 machines / ~30 VMs
  91. 91. ~60 projects </li></ul></ul></ul><ul><ul><li>Today </li></ul></ul><ul><ul><ul><li>22 racks
  92. 92. 366 machines / ~130 VMs </li></ul></ul></ul><ul><ul><li>Same amount of people resources </li></ul></ul>
  93. 93. <ul>Tools We Use </ul><ul><ul><li>Configuration management </li></ul></ul><ul><ul><ul><li>CFEngine+git </li></ul></ul></ul><ul><ul><li>Operating systems </li></ul></ul><ul><ul><ul><li>Gentoo:  ~115 machines
  94. 94. CentOS:  ~30 machines </li></ul></ul></ul><ul><ul><li>Monitoring </li></ul></ul><ul><ul><ul><li>Nagios, Cacti, Munin </li></ul></ul></ul><ul><ul><li>Issue Tracking </li></ul></ul><ul><ul><ul><li>RT: external tracker
  95. 95. Redmine: internal tracker </li></ul></ul></ul>
  96. 96. <ul>Why Gentoo? </ul><ul><ul><li>Early History
  97. 97. Easier customization
  98. 98. Hardened
  99. 99. Seamless upgrades*
  100. 100. Team skill-set
  101. 101. Tightly integrated into our CFEngine </li></ul></ul><ul>* Gentoo upgrades introduce a different set of problems compared to binary distros </ul>
  102. 102. <ul>Funding </ul><ul><ul><li>Donations </li></ul></ul><ul><ul><ul><li>Large Corporations
  103. 103. Projects
  104. 104. Individuals </li></ul></ul></ul><ul><ul><li>Grants
  105. 105. No state funding
  106. 106. Please support us! </li></ul></ul>
  107. 107. <ul>Future </ul><ul><ul><li>Puppet migration </li></ul></ul><ul><ul><ul><li>Shared server management
  108. 108. More flexibility </li></ul></ul></ul><ul><ul><li>More virtualization
  109. 109. Server replacements
  110. 110. Ganeti Web Manager
  111. 111. Datacenter management tools
  112. 112. More hosted projects </li></ul></ul>
  113. 113. <ul>Questions? </ul><ul>Lance Albertson [email_address] @ramereth http://lancealbertson.com </ul><ul>This work is licensed under a  Creative Commons Attribution-Share Alike 3.0 United States License . </ul>

×