Creating macOS Build Infrastructure in the Cloud
•
0 likes•79 views
Learn why CI is different for iOS and how to solve the unique challenges this creates. We’ll cover the pros and cons of CI-as-a-Service tools, the best way to deploy Mac hardware, different options for virtualizing macOS, and how to speed up builds. We’ll also share some benchmarking data we’ve compiled based on MacStadium’s research and lab tests.
Recommended
Recommended
More Related Content
What's hot
What's hot (18)
Similar to Creating macOS Build Infrastructure in the Cloud
Similar to Creating macOS Build Infrastructure in the Cloud (20)
Recently uploaded
Recently uploaded (20)
Creating macOS Build Infrastructure in the Cloud
- 1. ©2018 MacStadium, Inc. Apple®, Mac®, Mac mini®, Mac Pro® and macOS® are trademarks of Apple, Inc. Creating macOS Build Infrastructure in the Cloud Shawn Lankton MacStadium Webinar – August 23, 2018 1
- 2. ©2018 https://www.macstadium.com 2 Shawn Lankton Today’s presenter • Computer engineer from Georgia Tech • Startup, enterprise, and consulting experience • Leads sales and marketing at MacStadium • Work with hundreds of iOS/Mac DevOps teams
- 3. ©2018 https://www.macstadium.com 3 Developers iOS macOS Engineers Who is this talk for?
- 4. ©2018 https://www.macstadium.com Agenda • Why is macOS required? • Several options for running builds • Top challenges for iOS/Mac CI setups • Deploying Mac hardware • Virtualizing macOS • Automating the pipeline • Speeding up builds • Q&A and where to learn more 4
- 5. ©2018 https://www.macstadium.com CI CD We’ll focus on build and test 5 • Build on every commit • Test on every build • Catch errors faster • Faster time to value Continuous Integration build test
- 6. ©2018 https://www.macstadium.com How CI works for everything else 6 Microsoft Build Commit Prepare Contain Automate Provision
- 7. ©2018 https://www.macstadium.com 7 Not so simple in Apple world… Apple makes you build different.
- 8. ©2018 https://www.macstadium.com What are your options? 8 1) CI-as-a-Service FLEXIBILITY SECURITY PERFORMANCE COST Microsoft
- 9. ©2018 https://www.macstadium.com What are your options? 9 2) DIY Macs MAINTENANCE SCALABILITY AUTOMATION AVAILABILITY
- 10. ©2018 https://www.macstadium.com What are your options? 10 3) Go with the best
- 11. ©2018 https://www.macstadium.com Here are some insights from the best… 11 • CI leaders that push us forward • Tech leaders brands with big workloads • CI-as-a-Service providers at super-scale
- 12. ©2018 https://www.macstadium.com Top challenges for Mac CI setups 1. Deploying Mac Hardware 2. Virtualizing macOS 3. Automating the pipeline 4. Speeding up builds 12
- 13. ©2018 https://www.macstadium.com Problem 1: Deploying Mac Hardware 13
- 14. ©2018 https://www.macstadium.com Problem 1: Deploying Mac Hardware 14 That’s easy! Use MacStadium. We’re the best in the world at this. Here’s how we do it…
- 15. ©2018 https://www.macstadium.com We transform Apple’s consumer products… 15
- 16. ©2018 https://www.macstadium.com Into enterprise class Mac infrastructure • Racked in top-tier data centers • Upgraded with redundant power, 10G Ethernet, and all-flash SAN • Deployed with dedicated firewalls, storage, and remote hands 16
- 17. ©2018 https://www.macstadium.com We deploy dedicated private clouds 17 PRIVATE CLOUD • Root access to infrastructure • You can control firewall, hosts, hypervisor, etc. hypervisor
- 18. ©2018 https://www.macstadium.com Problem 2: Virtualizing macOS 18
- 19. ©2018 https://www.macstadium.com Problem 2: Virtualizing macOS 19 Why? Simplify maintenance Ensure reliable builds Maintain multiple configs Scale up with ease Automate everything
- 20. ©2018 https://www.macstadium.com 20 • Established • Super-scalable • Flexible, does everything • vSphere API, plugins • New, built for Mac • Really simple setup • Tuned for CI • APIs, CLI, plugins Which hypervisor should you choose? Learn more at https://www.macstadium.com/virtualization-options
- 21. ©2018 https://www.macstadium.com Problem 3: Automating the pipeline 21
- 22. ©2018 https://www.macstadium.com Problem 3: Automating everything 22 Static VMs Ephemeral VMs Create VM Build, revert Build, revert … Destroy VM (when it breaks) ! Create, build, destroy Create, build, destroy Create, build, destroy Create, build, destroy IMMUTABLE CONSISTENT
- 23. ©2018 https://www.macstadium.com Plugins and APIs • CI orchestration plugins (Jenkins, TeamCity, etc.) • Infrastructure-as-code plugins (Ansible, Terraform, Packer) • Hypervisor APIs (vSphere, Anka) • Image libraries (Anka) 23 • Write once, track and version your code to keep it up to date • Create consistent build infrastructure and process • Add redundancy so your Macs become “cattle not pets” • Run and scale continuously as demand grows
- 24. ©2018 https://www.macstadium.com Problem 4: Speeding up builds 24
- 25. ©2018 https://www.macstadium.com Problem 4: Speeding up builds 25 Refactor code ! Parallelize builds/tests Pre-loaded repos Tweak Xcode settings Use bigger build machines
- 26. ©2018 https://www.macstadium.com Xcode tweaks for faster builds • Increase the thread count • Increase the number of concurrent build tasks • Set Xcode to optimize for performance gains • Turn on build time summaries • Tweak the iOS simulator pixel size • Change the simulator rendering mode 26 Builds Tests
- 27. ©2018 https://www.macstadium.com More cores = faster builds 27 100 150 200 250 300 350 2c 4c 6c 8c 12c Build times by number of cores Customer app benchmark, build time (min) 348 min 218 min 172 min 151 min 135 min 2.6x # of cores per VM (on 12c Mac Pro with Anka) 1.6x
- 28. ©2018 https://www.macstadium.com Faster Macs go faster 28 Build times on different Macs 0 50 100 150 18c iPro 12c Pro 6c Pro 4c mini 2c mini Swift/C++ Compiler, Build time (min) 7.7x 100 min 64 min 45 min 37 min 13 min
- 29. ©2018 https://www.macstadium.com Top challenges for Mac CI setups 29 DEPLOY VIRTUALIZE AUTOMATE ACCELERATE
- 30. ©2018 https://www.macstadium.com 30 slankton@macstadium.com @macstadiummacstadium.com Want to learn more? Contact us!
- 31. ©2018 https://www.macstadium.com Keep on learning 31 Newsletter www.macstadium.com/newsletter iOS DevOps Survey We heard from a diverse group of developers at companies ranging in size from large corporations to small start-ups across several different industries. We hope that you can find information in this survey that’s relevant to your company, but if you’re left with unanswered questions, please reach out to us at hello@macstadium.com. introduction About the companies 13% 29% 11% 12% 35% 5,000+ 1-50 employees 50-100 100-500 500-5,000 Company Size 18% 48% 24% 10% 1 iOS developer 2-10 10-50 50+ Development Team Size Software & Internet App Dev Services Entertainment Technology/Hardware Banking & FinTech Other Enterprise Healthcare & Health IT Retail & Ecommerce 40% 16% 11% 9% 8% 7% 5% 4% Trends in iOS DevOps A survey of iOS developers from the 2018 Apple Worldwide Developers Conference (WWDC) & AltConf www.macstadium.com/ios-devops-survey Knowledge Base help.macstadium.com
- 32. ©2018 MacStadium, Inc. Apple®, Mac®, Mac mini®, Mac Pro® and macOS® are trademarks of Apple, Inc. Creating macOS Build Infrastructure in the Cloud Shawn Lankton MacStadium Webinar – August 23, 2018 32