Acquia presented at MassTLC event on automated testing
TestOps:The testing side of DevOpsThe testing side of DevOpsBarry JaspanSenior ArchitectAcquia
Server configuration is software• The days of manual configuration by sysadmins are over• Puppet, Chef, and similar tools turn server config intosoftware• Software needs testing• Automated• Fast• Clone of the production environment• "If it isnt tested, it doesnt work."
Unit vs. System tests• Unit tests isolate individual program modules• Injection mocks out external systems• Problem:You cant mock out the real world and get accurate results• System tests are end-to-end• Exercise real servers as the app(s) will• Problem: Reality is very messy!• Race conditions and retries• EC2 launch failure• Cosmic rays• For infrastructure, system tests are essential
• Basic server builds• Infrastructure moving parts• Backup and restore• Message queues & worker auto-scaling• Monitoring & alerting• Application interaction with the infrastructure• Force app to operate under degraded infrastructure conditions• Server reboot and relaunch• Release process for upgrades• Security compliance