SmokeTests

1. SmokeTests Why you should try to burn down your production environment

2. Sebastian Thoß Chapter Lead Backend

4. Disclaimer

5. Agenda • Project Architecture • Types Of Tests • SmokeTests • Server Architecture • Questions & Answers

6. Project  Architecture

7. "one hundred fifty-seven quinvigintillion, seven hundred eighty-six quattuorvigintillion, six hundred fifty-seven trevigintillion, seven hundred forty-seven duovigintillion, three hundred forty unvigintillion, one hundred eighty-six vigintillion, (…) nine hundred forty-five quintillion, eight hundred twenty-eight quadrillion, two hundred seventy trillion, eighty billion, …"

10. Webserver Key-Value Store Search FURY Frontend FURY Backend FURY Components

11. Webserver Key-Value Store Search FURY Frontend FURY Backend Legacy RDBMSLegacy System Session Storage Collect & Export K-V  Store

12. Webserver Key-Value Store Search FURY Frontend FURY Backend Legacy RDBMSLegacy System FURY Requests 200OK Session Storage K-V  Store

13. Webserver Key-Value Store Search FURY Frontend FURY Backend Legacy RDBMSLegacy System Requests to Legacy System 404NOTFOUND Session Storage K-V  Store

14. Webserver Key-Value Store Search FURY Frontend FURY Backend Legacy RDBMSLegacy System Requests to Legacy System 404NOTFOUND 200 OK Session Storage K-V  Store

15. More information on www.sebastianthoss.de

16. Types Of Tests

17. Test Pyramid UNITTESTS

18. Class 2 Class 3 Mock Mock Unit Tests Class 1 Class 4

20. Test Pyramid INTEGRATION TESTS UNITTESTS

21. Class 4Class 3 Integration Tests Class 1 Class 2 Mock Mock

22. Test Pyramid INTEGRATION TESTS UNITTESTS 100%CODECOVERAGE

23. Test Pyramid ACCEPTANCE TESTS INTEGRATION TESTS UNITTESTS

24. Acceptance Tests Class 1 Class 2 Class 3 Class 4

25. Test Pyramid ACCEPTANCE TESTS INTEGRATION TESTS UNITTESTS ?

26. SmokeTests

27. What are SmokeTests? In computer programming and software testing, smoke testing is preliminary testing to reveal simple failures severe enough to reject a prospective software release.  Source: https://en.wikipedia.org/wiki/Smoke_testing

28. What are SmokeTests?

29. SmokeTests should… • … be simple • … be fast • … test pages with optional parameters too • … cover at least all URLs in google index • … use a manual maintained list of URLs

30. How do SmokeTests work? https://www.my-application.com/foo <html><body>…</body></html> TTFB: 65ms HTTP 1.1/200 OK SmokeTest  Client CI Server Application   to test Production Server

31. How do SmokeTests work? https://www.my-application.com/foo <html><body>…</body></html> TTFB: 320ms HTTP 1.1/200 OK SmokeTest  Client CI Server Production Server Application   to test

32. What should SmokeTests validate? • Status code • Time to ﬁrst byte • If body is provided • Correct server

33. SmokeTests are NOT Acceptance Tests SmokeTest  Client HTTP 1.1/200 OK <html> <head> <title>Foo</title> <body> <div id="bar"><span>foobar</span></div> </body> </html>

34. namespace KartenmachereiTesting; use PHPUnit_Framework_TestCase; class SmokeTest extends PHPUnit_Framework_TestCase { /** * @dataProvider furyUrlProvider * * @param Url $url */ public function testFuryUrl(Url $url) { $result = $this->sendGetRequest($url); $this->assertSame(200, $result->getStatusCode()); $this->assertNotEmpty($result->getBody()); $this->assertLessThanOrEqual(100, $result->getTimeToFirstByteInMilliseconds()); } public function furyUrlProvider() { $urls = ['http://www.kartenmacherei.de', …]; $urlCollection = UrlCollection::fromStrings($urls); return $urlCollection->asDataProviderArray($urlCollection); }

35. How to speed up SmokeTests?

36. Concurrent SmokeTests SmokeTest  Client CI Server Application  to test Production Server https://www.my-application.com/baz https://www.my-application.com/bar https://www.my-application.com/foo

37. Concurrent SmokeTests https://www.my-application.com/baz https://www.my-application.com/bar https://www.my-application.com/foo TTFB: 34ms SmokeTest  Client CI Server Application  to test Production Server

38. Concurrent SmokeTests https://www.my-application.com/foobaz https://www.my-application.com/bar https://www.my-application.com/foo SmokeTest  Client CI Server Application  to test Production Server

39. Concurrent SmokeTests TTFB: 65ms https://www.my-application.com/foobaz https://www.my-application.com/bar https://www.my-application.com/foo SmokeTest  Client CI Server Application  to test Production Server

40. Concurrent SmokeTests https://www.my-application.com/123 https://www.my-application.com/foobaz https://www.my-application.com/bar SmokeTest  Client CI Server Application  to test Production Server

41. Concurrent SmokeTests TTFB: 620ms https://www.my-application.com/123 https://www.my-application.com/foobaz https://www.my-application.com/bar SmokeTest  Client CI Server Application  to test Production Server

42. Source: http://www.ve7kfm.com/fcc-server.jpg

43. Let’s try to burn it down!

44. There is a package for SmokeTests DjThossi/Smoke-Testing-PHP

45. DataProvider Test Application HTTP Requests HTTP Responses PHPUnit Call Result[] Result

46. class SmokeTest extends PHPUnit_Framework_TestCase { use SmokeTestTrait; /** * @dataProvider myDataProvider */ public function testExample(Result $result) { $this->assertSuccess($result); $this->assertTimeToFirstByte(new TimeToFirstByte(100), $result); $this->assertBodyNotEmpty($result); $this->assertHeaderExists(Header::fromPrimitives(‘App-Server', ‘Fury’), $result); } public function myDataProvider() { $urls = ['http://www.kartenmacherei.de', …]; $options = new SmokeTestOptions( UrlCollection::fromStrings($urls), new RequestTimeout(2), new FollowRedirects(true), new Concurrency(3), new BodyLength(500) ); return $this->runSmokeTests($options); }

52. Output

53. Features to come next • Improve ErrorResult object • Introduce assertions for Redirects • Improve quality of error message • 2nd version based on PHPUnit 6

54. Server Architecture

55. Webserver (Router) Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver FURY Frontend Server B K/V StoreSearch FURY Backend

56. Webserver (Router) Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver FURY Frontend Server B K/V StoreSearch FURY Backend active = A

57. Webserver (Router) Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver FURY Frontend Server B K/V StoreSearch FURY Backend active = B

58. Webserver (Router) Webserver FURY Frontend Server A K/V StoreSearch FURY Backend active = B

59. RDBMS   Read Slave Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver (Router) Build Server Deploy Code active = B

60. RDBMS   Read Slave Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver (Router) Build Server Deploy Code Collect & Export active = B

61. Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver (Router) Build Server Deploy Code Collect & Export Smoke Tests active = B RDBMS   Read Slave

64. Webserver FURY Frontend Server A K/V StoreSearch FURY Backend Webserver (Router) Build Server Deploy Code Collect & Export Smoke Tests Switch to A active = Bactive = A RDBMS   Read Slave

65. Conclusion • Write tests • Get 100% coverage • SmokeTest your Website • Only activate server if it didn’t start smoking

66. https://www.facebook.com/kartenmacherei/ jobs@kartenmacherei.de http://inside.kartenmacherei.de/job.html https://tech.kartenmacherei.de @techdotkam Contact & Feedback Q&A

SmokeTests

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to SmokeTests

Similar to SmokeTests (20)

More from tech.kartenmacherei

More from tech.kartenmacherei (8)

Recently uploaded

Recently uploaded (20)

SmokeTests