Hosting Open Source Projects at the OSUOSL

2,237 views

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
2,237
On SlideShare
0
From Embeds
0
Number of Embeds
339
Actions
Shares
0
Downloads
15
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • LH suggests using the www.orst.edu billboard image for one slide then move on to these other points - the visual image is stunning First hosted projects (2003) Debian, Gentoo Early hosted projects (2005-ish) Apache Software Foundation Mozilla, Drupal Kernel.org, Freenode
  • talk about who each person is for the subbullets and a little bit about their role.  changed number of FTEs and students to be accurate with what I know
  • Mentoring by me and senior students Start with little Linux experience usually Work up to 20hrs/week during school year Get awesome jobs!
  • Separate from OSU network IPv6 coming soon*
  • Mostly Dell, HP, SuperMicro, & Sun Must be rackable, include OOB, & Approval
  • Decided by staff on a case-by-case basis Be specific in what your project needs Be patient, we've very busy usually!
  • Hosting Open Source Projects at the OSUOSL

    1. 1. <ul>Hosting Open Source Projects at the OSUOSL </ul><ul>Lance &quot;Ramereth&quot; Albertson Systems Administrator / Architect </ul>
    2. 2. <ul>About me </ul><ul><ul><li>OSU Open Source Lab
    3. 3. Server hosting for Open Source projects
    4. 4. Open Source development projects
    5. 5. Lead Systems Administrator
    6. 6. Gentoo Developer
    7. 7. Trumpet Jazz performer </li></ul></ul>
    8. 8. <ul>In the Beginning... </ul><ul><ul><li>University President sees &quot;www.orst.edu&quot; on a sign
    9. 9. Maintain - DNS/DHCP management
    10. 10. Seed money from OSU Network Services
    11. 11. First clients are some of the most well known Open Source projects  </li></ul></ul><ul>Picture flickr user 'tappnel' </ul>
    12. 12. <ul>Why do hosting at OSU? </ul><ul>&quot; Our commitment to the development and application of Open Source is consistent with our drive to be the land grant university of the 21st century. Through open source activities we are helping under-served populations around the world and creating new industries and new products at home. &quot; OSU president, Ed Ray </ul>
    13. 13. <ul>Timing is everything </ul><ul><ul><li>Post dot-com bust = lots of dark fiber
    14. 14. Invested $250K into laying 11mi of fiber to I-5
    15. 15. &quot;Cheap&quot; bandwidth
    16. 16. Internet2 connectivity
    17. 17. Newly renovated data center </li></ul></ul>
    18. 18. <ul>Staff </ul><ul><ul><li>8 full-time employees / ~8 undergrad students </li></ul></ul><ul><ul><ul><li>Hosting
    19. 19. Development
    20. 20. Government Outreach
    21. 21. ORVSD
    22. 22. Outreach Manager
    23. 23. MeeGo/Intel Dev 
    24. 24. Operations Manager
    25. 25. Director </li></ul></ul></ul>
    26. 26. <ul>Students </ul><ul><ul><li>Undergraduate students
    27. 27. Full root access
    28. 28. Hired at Freshmen or Sophomore year
    29. 29. Constant turnover (2-3yrs/student) </li></ul></ul>
    30. 30. <ul>Data Center Specs </ul><ul><ul><li>2770 sqft, 76 Colo racks, 11 IDF racks
    31. 31. Dual independent power feeds </li></ul></ul><ul><ul><ul><li>ea 400A / 480V
    32. 32. 3-phase
    33. 33. Dual UPS
    34. 34. Single generator </li></ul></ul></ul><ul><ul><li>55 ton cooling capacity via 3 Lieberts </li></ul></ul><ul>One of two primary UPS's </ul>
    35. 35. <ul>Networking </ul><ul><ul><li>NERO </li></ul></ul><ul><ul><ul><li>Network for Education & Research in Oregon </li></ul></ul></ul><ul><ul><li>10 Gbps to NERO
    36. 36. Cisco 6509 Core
    37. 37. 2 Gbps to upstream (10 Gbps coming soon)
    38. 38. IPv6 coming soon </li></ul></ul><ul>10Gbps uplink to NERO </ul>
    39. 39. <ul>Datacenter 1st row </ul>
    40. 40. <ul>Datacenter 2nd row </ul>
    41. 41. <ul>Datacenter </ul>
    42. 42. <ul>Hosted Machines </ul><ul><ul><li>266 servers + ~100 MeeGo servers
    43. 43. ~130 virtual machines 
    44. 44. Projects purchase/own servers  </li></ul></ul><ul><ul><ul><li>22 racks used by OSL currently
    45. 45. Project racks: Drupal, ASF, Gentoo, Linux Foundation, MeeGo </li></ul></ul></ul><ul><ul><li>What are they running? </li></ul></ul><ul><ul><ul><li>Debian/Ubuntu, CentOS, FreeBSD </li></ul></ul></ul>
    46. 46. <ul>ASF & Drupal Racks </ul>
    47. 47. <ul>Google OSPO Servers </ul>
    48. 48. <ul>Freenode </ul>
    49. 49. <ul>Xiph.org </ul>
    50. 50. <ul>Kernel.org (master.kernel.org) </ul>
    51. 51. <ul>Services Provided at the OSL </ul><ul><ul><li>Co-location hosting
    52. 52. Smart-hands support
    53. 53. Virtual machine(s)
    54. 54. Managed hosting
    55. 55. FTP Mirror space
    56. 56. Email forwarding
    57. 57. DNS hosting </li></ul></ul>
    58. 58. <ul>FTP Mirrors </ul><ul><ul><li>3 servers </li></ul></ul><ul><ul><ul><li>Corvallis, Oregon
    59. 59. Chicago, IL
    60. 60. New York, NY </li></ul></ul></ul><ul><ul><li>6 TB capacity
    61. 61. Split via DNS view
    62. 62. 700 Mbps avg total
    63. 63. TDS Telecom </li></ul></ul><ul>ftp-osl.osuosl.org </ul>
    64. 64. <ul>Virtualization </ul><ul><ul><li>Ganeti </li></ul></ul><ul><ul><ul><li>Ganeti Web Manager </li></ul></ul></ul><ul><ul><li>Linux KVM hypervisor
    65. 65. Easy to expand
    66. 66. Primary cluster </li></ul></ul><ul><ul><ul><li>5 machines / 75VMs </li></ul></ul></ul><ul><ul><li>Project clusters </li></ul></ul><ul><ul><ul><li>phpBB, OSGeo, OSM, ORVSD </li></ul></ul></ul>
    67. 67. <ul>Supercell </ul><ul><ul><li>Continuous integration testing
    68. 68. Run-time testing
    69. 69. Several platforms supported
    70. 70. On-demand virtualization
    71. 71. Powered by Ganeti+KVM
    72. 72. Hardware donation by Facebook
    73. 73. Still in beta </li></ul></ul>
    74. 74. <ul>Hosting FAQ </ul><ul><ul><li>Hosting tailored to each project
    75. 75. Target medium-large &quot;high impact&quot; projects
    76. 76. Typically outgrown their current hosting
    77. 77. Bad experiences with other hosting
    78. 78. Let the projects code instead of worrying about their site </li></ul></ul>
    79. 79. <ul>Requesting Hosting </ul><ul><ul><li>http://osuosl.org/services/hosting
    80. 80. Submit request to support@osuosl.org 
    81. 81. What we look for </li></ul></ul><ul><ul><ul><li>Widely used project
    82. 82. Healthy community
    83. 83. Needs fit within our resources </li></ul></ul></ul>
    84. 84. <ul>Hosted Projects </ul>
    85. 85. <ul>New Projects / Stories </ul><ul><ul><li>Supercell launched
    86. 86. New Projects </li></ul></ul><ul><ul><ul><li>Elgg, crosstool-NG, speed.python.net, Project Harmony, Freedroid, OpenStreetMap US, Mageia, Sahana Foundation, Meego, Open Compute </li></ul></ul></ul><ul><ul><li>Ganeti Web Manager
    87. 87. New Outreach Manager / Meego Dev
    88. 88. Bandwidth Upgrades </li></ul></ul>
    89. 89. <ul>Growth </ul><ul><ul><li>4 years ago... </li></ul></ul><ul><ul><ul><li><10 racks
    90. 90. ~60 machines / ~30 VMs
    91. 91. ~60 projects </li></ul></ul></ul><ul><ul><li>Today </li></ul></ul><ul><ul><ul><li>22 racks
    92. 92. 366 machines / ~130 VMs </li></ul></ul></ul><ul><ul><li>Same amount of people resources </li></ul></ul>
    93. 93. <ul>Tools We Use </ul><ul><ul><li>Configuration management </li></ul></ul><ul><ul><ul><li>CFEngine+git </li></ul></ul></ul><ul><ul><li>Operating systems </li></ul></ul><ul><ul><ul><li>Gentoo:  ~115 machines
    94. 94. CentOS:  ~30 machines </li></ul></ul></ul><ul><ul><li>Monitoring </li></ul></ul><ul><ul><ul><li>Nagios, Cacti, Munin </li></ul></ul></ul><ul><ul><li>Issue Tracking </li></ul></ul><ul><ul><ul><li>RT: external tracker
    95. 95. Redmine: internal tracker </li></ul></ul></ul>
    96. 96. <ul>Why Gentoo? </ul><ul><ul><li>Early History
    97. 97. Easier customization
    98. 98. Hardened
    99. 99. Seamless upgrades*
    100. 100. Team skill-set
    101. 101. Tightly integrated into our CFEngine </li></ul></ul><ul>* Gentoo upgrades introduce a different set of problems compared to binary distros </ul>
    102. 102. <ul>Funding </ul><ul><ul><li>Donations </li></ul></ul><ul><ul><ul><li>Large Corporations
    103. 103. Projects
    104. 104. Individuals </li></ul></ul></ul><ul><ul><li>Grants
    105. 105. No state funding
    106. 106. Please support us! </li></ul></ul>
    107. 107. <ul>Future </ul><ul><ul><li>Puppet migration </li></ul></ul><ul><ul><ul><li>Shared server management
    108. 108. More flexibility </li></ul></ul></ul><ul><ul><li>More virtualization
    109. 109. Server replacements
    110. 110. Ganeti Web Manager
    111. 111. Datacenter management tools
    112. 112. More hosted projects </li></ul></ul>
    113. 113. <ul>Questions? </ul><ul>Lance Albertson [email_address] @ramereth http://lancealbertson.com </ul><ul>This work is licensed under a  Creative Commons Attribution-Share Alike 3.0 United States License . </ul>

    ×