Smoke Tests @ DevOps-Hamburg 06.02.2017
•
1 like•665 views
"Today it's crystal clear why we need unit tests. Even integration and acceptance tests are quite common but who is making sure that your pages are working in production environment? I'd like to show in detail how smoke tests will help achieving this goal and why you should try to burn down your production server." This is a hands-on talk about how we use excessive smoke tests in our continuous deployment to make sure a freshly rolled-out release can actually go live.
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (20)
Similar to Smoke Tests @ DevOps-Hamburg 06.02.2017
Similar to Smoke Tests @ DevOps-Hamburg 06.02.2017 (20)
Recently uploaded
Recently uploaded (20)
Smoke Tests @ DevOps-Hamburg 06.02.2017
- 1. SmokeTestsWhy you should try to burn down your production environment Comments & Feedback
- 2. Sebastian Thoß Chapter lead Backend
- 4. Disclaimer
- 5. Agenda • Types Of Tests • SmokeTests • Server Architecture • Questions & Answers
- 8. Class 2 Class 3 Mock Mock Unit Tests Class 1 Class 4
- 11. Class 3 Class 4Mock Mock Integration Tests Class 1 Class 2
- 13. Test Pyramid ACCEPTANCE TESTS INTEGRATION TESTS UNITTESTS
- 14. Acceptance Tests Class 1 Class 2 Class 3 Class 4
- 15. Test Pyramid ACCEPTANCE TESTS INTEGRATION TESTS UNITTESTS ? $$$ ¢
- 16. SmokeTests
- 17. What are SmokeTests? In computer programming and software testing, smoke testing is preliminary testing to reveal simple failures severe enough to reject a prospective software release. Source: https://en.wikipedia.org/wiki/Smoke_testing_(software)
- 18. SmokeTests should… • … be simple • … be fast • … test pages with optional parameters too • … cover at least all URLs in google index • … use a manual maintained list of URLs
- 19. How do SmokeTests work? https://www.my-application.com/foo <html><body>…</body></html> TTFB: 65ms HTTP 1.1/200 OK SmokeTest Client CI Server Application Under Test Production Server
- 20. How do SmokeTests work? https://www.my-application.com/foo <html><body>…</body></html> TTFB: 320ms HTTP 1.1/200 OK SmokeTest Client CI Server Application Under Test Production Server
- 21. What should SmokeTests validate? • Correct Server • Status Code • Time To First Byte • If Body Is Provided
- 22. SmokeTests are NOTAcceptance Tests SmokeTest Client HTTP 1.1/200 OK <html> <head> <title>Foo</title> <body> <div id="bar"><span>foobar</span></div> </body> </html>
- 23. namespace KartenmachereiTesting; use PHPUnit_Framework_TestCase; class SmokeTest extends PHPUnit_Framework_TestCase { /** * @dataProvider furyUrlProvider * * @param Url $url */ public function testFuryUrl(Url $url) { $result = $this->sendGetRequest($url); $this->assertSame(200, $result->getStatusCode()); $this->assertNotEmpty($result->getBody()); $this->assertLessThanOrEqual(100, $result->getTimeToFirstByteInMilliseconds()); } public function furyUrlProvider() { $urls = ['http://www.kartenmacherei.de', …]; $urlCollection = UrlCollection::fromStrings($urls); return $urlCollection->asDataProviderArray($urlCollection); }
- 24. How to speed up SmokeTests?
- 25. Concurrent SmokeTests SmokeTest Client CI Server Application Under Test Production Server https://www.my-application.com/baz https://www.my-application.com/bar https://www.my-application.com/foo
- 26. Concurrent SmokeTests https://www.my-application.com/baz SmokeTest Client CI Server Application Under Test Production Server https://www.my-application.com/bar https://www.my-application.com/foo TTFB: 34ms
- 27. Concurrent SmokeTests https://www.my-application.com/foobaz SmokeTest Client CI Server Application Under Test Production Server https://www.my-application.com/bar https://www.my-application.com/foo
- 28. Concurrent SmokeTests SmokeTest Client CI Server Application Under Test Production Server TTFB: 65ms https://www.my-application.com/foobaz https://www.my-application.com/bar https://www.my-application.com/foo
- 29. Concurrent SmokeTests SmokeTest Client CI Server Application Under Test Production Serverhttps://www.my-application.com/123 https://www.my-application.com/foobaz https://www.my-application.com/bar
- 30. Concurrent SmokeTests SmokeTest Client CI Server Application Under Test Production Server TTFB: 620ms https://www.my-application.com/123 https://www.my-application.com/foobaz https://www.my-application.com/bar
- 31. There is a Lib for SmokeTests DjThossi/Smoke-Testing-PHP
- 33. class SmokeTest extends PHPUnit_Framework_TestCase { use SmokeTestTrait; /** * @dataProvider myDataProvider */ public function testExample(Result $result) { $this->assertSuccess($result); $this->assertTimeToFirstByte(new TimeToFirstByte(100), $result); $this->assertBodyNotEmpty($result); $this->assertHeaderExists(Header::fromPrimitives(‘App-Server', ‘Fury’), $result); } public function myDataProvider() { $urls = ['http://www.kartenmacherei.de', …]; $options = new SmokeTestOptions( UrlCollection::fromStrings($urls), new RequestTimeout(2), new FollowRedirects(true), new Concurrency(3), new BodyLength(500) ); return $this->runSmokeTests($options); }
- 35. Webserver (Router) Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver FURY Frontend Server B K/V StoreSearch FURY Backend
- 36. Webserver (Router) Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver FURY Frontend Server B K/V StoreSearch FURY Backend active = A
- 37. Webserver (Router) Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver FURY Frontend Server B K/V StoreSearch FURY Backend active = B
- 38. Webserver (Router) Webserver FURY Frontend Server A K/V StoreSearch FURY Backend active = B
- 39. RDBMS Read Slave Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver (Router) Build Server Deploy Code active = B
- 40. RDBMS Read Slave Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver (Router) Build Server Deploy Code Collect & Export active = B
- 41. RDBMS Read Slave Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver (Router) Build Server Deploy Code Collect & Export Smoke Tests active = B
- 42. RDBMS Read Slave Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver (Router) Build Server Deploy Code Collect & Export Smoke Tests active = B
- 43. RDBMS Read Slave Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver (Router) Build Server Deploy Code Collect & Export Smoke Tests active = B
- 44. RDBMS Read Slave Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver (Router) Build Server Deploy Code Collect & Export Smoke Tests Switch to A active = Bactive = A
- 45. Conclusion • Write tests • Get 100% coverage • SmokeTest your Website • Only activate server if it didn't start smoking