More Related Content
Similar to SpectoLabs Xebia TestWorks Conf October 2016
Similar to SpectoLabs Xebia TestWorks Conf October 2016 (20)
Recently uploaded
Recently uploaded (20)
SpectoLabs Xebia TestWorks Conf October 2016
- 1. Automated Testing in a World of Interdependence: Service Virtualisation for the Modern Age TestWorksConf Workshop, 7th October Benji Hooper, Daniel Bryant, John Davenport, Tom Cunliffe
- 2. About Specto Workshops • This slide deck is an excerpt from a workshop delivered as part of the test automation TestWorksConf • http://testworksconf.com/talk/automated-testing-in-a-world-of-interdependence • The Specto team run public and private workshops (contact@specto.io) • All aspects of test automation • Microservice testing and service virtualisation with Hoverfly • Incorporating FR / NFR testing into a build pipeline
- 3. Testing is kind of important.
- 4. Knight Capital, 2012 $440m loss Neiman Marcus, Black Friday 2015 IPO cancelled Stock trading disruption 12 hour outage Royal Bank of Scotland, 2012 Transactions disrupted worldwide £500m in fines and compensation
- 5. OK - very important.
- 6. In any complex distributed system… … testing an individual component in isolation is difficult…. … and test automation is sometimes impossible
- 7. Agenda • Group flip-chart sessions (30 minutes) • Introduction to service virtualization (20 minutes) • Hands-on session (50 minutes) • Wrap up
- 8. Group flip-chart session • Equal-sized groups: • 1 facilitator - Edze, Tom, Daniel, Benji and John • 1 scribe • 1 presenter • 30 minutes • 10-15 minutes: read the scenario & discuss issues • 4 presentations of 4 minutes - your main issues and solutions
- 9. The busy QA / developer’s guide to service virtualisation
- 10. credit to @mogronalol 10 Resources shopfront stockmanager productcatalogue Payments Fraud Cost
- 11. credit to @mogronalol 11
- 12. credit to @mogronalol 12 Licensing Consumer Producer Consumer Producer Third party Cost
- 13. credit to @mogronalol 13 Dependency Constraints Consumer Producer Consumer Producer
- 14. credit to @mogronalol 14 Flakey Dependencies Consumer Producer Consumer Producer
- 15. credit to @mogronalol 15 Doesn't exist Consumer ?
- 16. credit to @mogronalol 16 Non Deterministic assertThat(booking.getDate()) .isEqualTo(LocalDate.of(2013,1,8)); Consumer Booking Service Consumer Booking Service Consumer Booking Service { “date” : “2013-01-08”, … } { “date” : “2016-02-07”, … }
- 17. credit to @mogronalol 17 Fault Injection Consumer Producer Consumer Producer 4xx, 5xx, timeouts Operationally challenging to trigger faults
- 18. credit to @mogronalol 18 Service Virtualisation • Emulation of real service • Non-intrusive • Lightweight - or should be
- 19. credit to @mogronalol 19 Service Virtualisation Consumer Producer Virtual Producer
- 20. credit to @mogronalol 20 Creating Data Consumer Producer Service Virtualisation Tool
- 21. credit to @mogronalol 21 Creating Data https://github.com/tomakehurst/wiremock
- 22. credit to @mogronalol 22 Proxy Mode Consumer Producer Service Virtualisation Tool
- 23. credit to @mogronalol 23 Webserver / Facade Mode Consumer Producer Service Virtualisation Tool
- 24. credit to @mogronalol 24 Not Mocking Service Under Test Mocking Dependant Service Http Virtual Service Mocks bleed into the architectural boundary of your application
- 25. credit to @mogronalol 25 Open Source Tooling
- 26. credit to @mogronalol 26 Record and replay Consumer External Producer Service Virtualisati on Tool
- 27. credit to @mogronalol 27 JUnit Example @Rule public HoverflyRule hoverflyRule = HoverflyRule.inCaptureMode(“src/test/ resources/external.json").build(); @Test public void shouldBeAbleToRetrieveABooking() throws URISyntaxException { // Given final int bookingId = 1; // When final Booking booking = bookingServiceGateway.getBooking(bookingId); // Then assertThat(booking.getCustomer()).isEqualTo(“Andrew Morgan”); assertThat(booking.getDate()).isEqualTo(LocalDate.of(2016,3,1)); }
- 28. credit to @mogronalol 28 JUnit Example { "data": [ { "request": { "path": "/api/bookings/1", "method": "GET", "destination": "www.my-test.com", "query": null, "body": "" }, "response": { "status": 200, "body": “{”customer”:”Andrew Morgan", ”date”: ”2016-03-01”}}}”, "headers": { "Content-Type": [ "application/json" ] } } } ] }
- 29. credit to @mogronalol 29 JUnit Example @Test public void shouldBeAbleToRetrieveABooking() throws URISyntaxException { // Given final int bookingId = 1; // When final Booking booking = bookingServiceGateway.getBooking(bookingId); // Then assertThat(booking.getCustomer()).isEqualTo(“Andrew Morgan”); assertThat(booking.getDate()).isEqualTo(LocalDate.of(2016,3,1)); } @Rule public HoverflyRule hoverflyRule = HoverflyRule.buildFromClassPathResource(“external.json").build();
- 30. credit to @mogronalol 30 Advantages • Isolation • Flaky dependencies • Rate limiting • Deterministic • Licensing
- 31. credit to @mogronalol 31 Deployment and Infrastructure Consumer External Producer Virtual Service Internal Producer Internal Producer Internal Producer Virtual Service Virtual Service Virtual Service
- 32. credit to @mogronalol 32 CLI Example $ hoverctl start —proxy-port 8080 $ hoverctl import accounts-service-simulation.json $ hoverctl start —proxy-port 8081 $ hoverctl import payments-service-simulation.json $ curl http://www.account-service.com/api/v1/accounts/1 —proxy http:// localhost:8080 [{"name":"foo"}] $ curl http://www.payment-service.com/api/v1/payments/1 -proxy http:// localhost:8081 [{“amount":"£23.27"}]
- 33. Hands-on session • Exercise 1: Explore an application that needs testing and create the simulations required to test it independently • Exercise 2: Test the circuit breakers in an application using Hoverfly • Code available: • https://github.com/benjih/oreilly-docker-java-shopping • Edze, Tom, Daniel, Benji and John will be around for help if needed (and feel free to work with others!)
- 34. Let’s wrap this up…
- 35. If you create simulations of components… … then individual components can be tested in isolation.
- 36. A simulation of a component behaves like the real thing… … it misbehaves like the real thing… So you can create a realistic, repeatable test environment… … and automate all the things.
- 37. github.com/SpectoLabs/hoverfly specto.io/blog We run public and private training workshops: contact@specto.io