Simulating APIs for Effective Testing: (Micro)Service Virtualisation for the 21st Century
•
3 likes•1,762 views
Talk on simulating API's given at the London Java Community meetup.
Recommended
Recommended
More Related Content
Similar to Simulating APIs for Effective Testing: (Micro)Service Virtualisation for the 21st Century
Similar to Simulating APIs for Effective Testing: (Micro)Service Virtualisation for the 21st Century (20)
Recently uploaded
Recently uploaded (20)
Simulating APIs for Effective Testing: (Micro)Service Virtualisation for the 21st Century
- 1. @mogronalol Simulating APIs for Effective Testing: (Micro)Service Virtualisation 1 Andrew Morgan @mogronalol OpenCredo & Spectolabs
- 2. @mogronalol 2 About Me • Consultant at OpenCredo • Background mainly with Java and now Go • Spectolabs Andrew Morgan @mogronalol
- 4. @mogronalol 3 Agenda • The problems with operating and testing distributed systems and microservices
- 5. @mogronalol 3 Agenda • The problems with operating and testing distributed systems and microservices • Overview of Service Virtualisation / Api Simulation
- 6. @mogronalol 3 Agenda • The problems with operating and testing distributed systems and microservices • Overview of Service Virtualisation / Api Simulation • Improving our Tests
- 7. @mogronalol 3 Agenda • The problems with operating and testing distributed systems and microservices • Overview of Service Virtualisation / Api Simulation • Improving our Tests • Data Synchronisation
- 8. @mogronalol 3 Agenda • The problems with operating and testing distributed systems and microservices • Overview of Service Virtualisation / Api Simulation • Improving our Tests • Data Synchronisation • Summary
- 9. @mogronalol 4 Agenda • The problems with operating and testing distributed systems and microservices • Overview of Service Virtualisation / Api Simulation • Improving our Tests • Data Synchronisation • Summary
- 15. @mogronalol 9 Airline Booking Application
- 16. @mogronalol 9 Airline Booking Application • Microservice architecture
- 17. @mogronalol 9 Airline Booking Application • Microservice architecture • Integration with third party services
- 18. @mogronalol 9 Airline Booking Application • Microservice architecture • Integration with third party services • Integration with legacy internal services
- 19. @mogronalol 9 Airline Booking Application • Microservice architecture • Integration with third party services • Integration with legacy internal services • Heavy resource consumption
- 20. @mogronalol 9 Airline Booking Application • Microservice architecture • Integration with third party services • Integration with legacy internal services • Heavy resource consumption • A standard CI/CD pipeline
- 31. @mogronalol 11
- 48. @mogronalol 16 Non Deterministic Consumer Booking Service { “date” : “2013-01-08”, … }
- 49. @mogronalol 16 Non Deterministic assertThat(booking.getDate()) .isEqualTo(LocalDate.of(2013,1,8)); Consumer Booking Service { “date” : “2013-01-08”, … }
- 50. @mogronalol 16 Non Deterministic assertThat(booking.getDate()) .isEqualTo(LocalDate.of(2013,1,8)); Consumer Booking Service { “date” : “2013-01-08”, … }
- 51. @mogronalol 16 Non Deterministic assertThat(booking.getDate()) .isEqualTo(LocalDate.of(2013,1,8)); Consumer Booking Service { “date” : “2016-02-07”, … }
- 55. @mogronalol 17 Fault Injection Consumer Producer Consumer Producer 4xx, 5xx, timeouts
- 56. @mogronalol 17 Fault Injection Consumer Producer Consumer Producer 4xx, 5xx, timeouts Operationally challenging to trigger faults
- 57. @mogronalol 18 Agenda • The problems with operating and testing distributed systems and microservices • Overview of Service Virtualisation / Api Simulation • Improving our Tests • Data Synchronisation • Summary
- 59. @mogronalol 19 Service Virtualisation • Emulation of real service
- 60. @mogronalol 19 Service Virtualisation • Emulation of real service • Non-intrusive
- 61. @mogronalol 19 Service Virtualisation • Emulation of real service • Non-intrusive • Lightweight - or should be
- 64. @mogronalol 20 Service Virtualisation Consumer Producer
- 68. @mogronalol 21 Creating Data Consumer Producer
- 69. @mogronalol 21 Creating Data Consumer Producer Service Virtualisation Tool
- 73. @mogronalol 23 Proxy Mode Consumer Producer
- 74. @mogronalol 23 Proxy Mode Consumer Producer Service Virtualisation Tool
- 75. @mogronalol 24 Webserver / Facade Mode
- 76. @mogronalol 24 Webserver / Facade Mode Consumer
- 77. @mogronalol 24 Webserver / Facade Mode Consumer Producer
- 78. @mogronalol 24 Webserver / Facade Mode Consumer Producer
- 79. @mogronalol 24 Webserver / Facade Mode Consumer Producer Service Virtualisation Tool
- 80. @mogronalol 24 Webserver / Facade Mode Consumer Producer Service Virtualisation Tool
- 81. @mogronalol 25 Not Mocking Service Under Test Dependant Service Http
- 82. @mogronalol 25 Not Mocking Service Under Test Mocking Dependant Service Http
- 83. @mogronalol 25 Not Mocking Service Under Test Mocking
- 84. @mogronalol 25 Not Mocking Service Under Test Virtual Service
- 85. @mogronalol 25 Not Mocking Service Under Test Virtual Service Mocks bleed into the architectural boundary of your application
- 86. @mogronalol 26 Open Source Tooling
- 87. @mogronalol 26 Open Source Tooling
- 88. @mogronalol 26 Open Source Tooling
- 89. @mogronalol 26 Open Source Tooling
- 90. @mogronalol 27 Agenda • The problems with operating and testing distributed systems and microservices • Overview of Service Virtualisation / Api Simulation • Improving our Tests • Data Synchronisation • Summary
- 91. @mogronalol 28 Record and replay
- 92. @mogronalol 28 Record and replay Consumer
- 93. @mogronalol 28 Record and replay Consumer External Producer
- 94. @mogronalol 28 Record and replay Consumer External Producer Service Virtualisati on Tool
- 95. @mogronalol 28 Record and replay Consumer External Producer Service Virtualisati on Tool
- 97. @mogronalol 29 JUnit Example @Test public void shouldBeAbleToRetrieveABooking() throws URISyntaxException { // Given final int bookingId = 1; // When final Booking booking = bookingServiceGateway.getBooking(bookingId); // Then assertThat(booking.getCustomer()).isEqualTo(“Andrew Morgan”); assertThat(booking.getDate()).isEqualTo(LocalDate.of(2016,3,1)); }
- 98. @mogronalol 29 JUnit Example @Rule public HoverflyRule hoverflyRule = HoverflyRule.inCaptureMode(“src/test/ resources/external.json").build(); @Test public void shouldBeAbleToRetrieveABooking() throws URISyntaxException { // Given final int bookingId = 1; // When final Booking booking = bookingServiceGateway.getBooking(bookingId); // Then assertThat(booking.getCustomer()).isEqualTo(“Andrew Morgan”); assertThat(booking.getDate()).isEqualTo(LocalDate.of(2016,3,1)); }
- 99. @mogronalol 30 JUnit Example { "data": [ { "request": { "path": "/api/bookings/1", "method": "GET", "destination": "www.my-test.com", "query": null, "body": "" }, "response": { "status": 200, "body": “{”customer”:”Andrew Morgan", ”date”: ”2016-03-01”}}}”, "headers": { "Content-Type": [ "application/json" ] } } } ] }
- 100. @mogronalol 31 JUnit Example @Test public void shouldBeAbleToRetrieveABooking() throws URISyntaxException { // Given final int bookingId = 1; // When final Booking booking = bookingServiceGateway.getBooking(bookingId); // Then assertThat(booking.getCustomer()).isEqualTo(“Andrew Morgan”); assertThat(booking.getDate()).isEqualTo(LocalDate.of(2016,3,1)); } @Rule public HoverflyRule hoverflyRule = HoverflyRule.buildFromClassPathResource(“external.json").build();
- 103. @mogronalol 32 Advantages • Isolation • Flaky dependencies
- 104. @mogronalol 32 Advantages • Isolation • Flaky dependencies • Rate limiting
- 105. @mogronalol 32 Advantages • Isolation • Flaky dependencies • Rate limiting • Deterministic
- 106. @mogronalol 32 Advantages • Isolation • Flaky dependencies • Rate limiting • Deterministic • Licensing
- 107. @mogronalol 33 Deployment and Infrastructure
- 108. @mogronalol 33 Deployment and Infrastructure Consumer External Producer
- 109. @mogronalol 33 Deployment and Infrastructure Consumer External Producer Internal Producer Internal Producer Internal Producer
- 110. @mogronalol 33 Deployment and Infrastructure Consumer Virtual Service Virtual Service Virtual Service Virtual Service
- 112. @mogronalol 34 CLI Example $ hoverctl start —proxy-port 8080
- 113. @mogronalol 34 CLI Example $ hoverctl start —proxy-port 8080 $ hoverctl import accounts-service-simulation.json
- 114. @mogronalol 34 CLI Example $ hoverctl start —proxy-port 8080 $ hoverctl import accounts-service-simulation.json $ hoverctl start —proxy-port 8081
- 115. @mogronalol 34 CLI Example $ hoverctl start —proxy-port 8080 $ hoverctl import accounts-service-simulation.json $ hoverctl start —proxy-port 8081 $ hoverctl import payments-service-simulation.json
- 116. @mogronalol 34 CLI Example $ hoverctl start —proxy-port 8080 $ hoverctl import accounts-service-simulation.json $ hoverctl start —proxy-port 8081 $ hoverctl import payments-service-simulation.json $ curl http://www.account-service.com/api/v1/accounts/1 —proxy http:// localhost:8080 [{"name":"foo"}]
- 117. @mogronalol 34 CLI Example $ hoverctl start —proxy-port 8080 $ hoverctl import accounts-service-simulation.json $ hoverctl start —proxy-port 8081 $ hoverctl import payments-service-simulation.json $ curl http://www.account-service.com/api/v1/accounts/1 —proxy http:// localhost:8080 [{"name":"foo"}] $ curl http://www.payment-service.com/api/v1/payments/1 -proxy http:// localhost:8081 [{“amount":"£23.27"}]
- 118. @mogronalol 35
- 121. @mogronalol 36 Fault Injection Consumer External Producer Service Virtualisation Tool Middleware
- 125. @mogronalol 38 Advantages • Transparent • Configurable
- 126. @mogronalol 38 Advantages • Transparent • Configurable • Operationally simple
- 133. @mogronalol 40 Advantages • Documentation Driven Development
- 134. @mogronalol 40 Advantages • Documentation Driven Development • Work in Parallel
- 135. @mogronalol 41 Agenda • The problems with operating and testing distributed systems and microservices • Overview of Service Virtualisation / Api Simulation • Improving our Tests • Data Synchronisation • Summary
- 136. @mogronalol 42 Data Synchronisation Issues
- 137. @mogronalol 42 Data Synchronisation Issues Consumer Virtual Service
- 138. @mogronalol 42 Data Synchronisation Issues ConsumerConsumer Virtual Service
- 139. @mogronalol 42 Data Synchronisation Issues ConsumerConsumerConsumer Real Service
- 141. @mogronalol 43 Ownership Own Consumer Own Producer Strategy
- 142. @mogronalol 43 Ownership Own Consumer Own Producer Strategy Integration Contract Testing
- 143. @mogronalol 44 Integration Contract Testing http://martinfowler.com/bliki/IntegrationContractTest.html
- 144. @mogronalol 44 Integration Contract Testing Scheduled Build http://martinfowler.com/bliki/IntegrationContractTest.html
- 145. @mogronalol 44 Integration Contract Testing Scheduled Build Reproduce Simulations http://martinfowler.com/bliki/IntegrationContractTest.html
- 146. @mogronalol 44 Integration Contract Testing Scheduled Build Reproduce Simulations Diff http://martinfowler.com/bliki/IntegrationContractTest.html
- 147. @mogronalol 44 Integration Contract Testing Scheduled Build Reproduce Simulations Diff Integration Testing or Contract Diff http://martinfowler.com/bliki/IntegrationContractTest.html
- 148. @mogronalol 44 Integration Contract Testing Scheduled Build Reproduce Simulations Diff No diff? Integration Testing or Contract Diff http://martinfowler.com/bliki/IntegrationContractTest.html
- 149. @mogronalol 44 Integration Contract Testing Scheduled Build Reproduce Simulations Diff No diff? Diff? Integration Testing or Contract Diff http://martinfowler.com/bliki/IntegrationContractTest.html
- 150. @mogronalol 45 Ownership Own Consumer Own Producer Strategy Integration Contract Testing
- 151. @mogronalol 45 Ownership Own Consumer Own Producer Strategy Integration Contract Testing Virtual Service as First Class Citizen
- 152. @mogronalol 46 Virtual Service as First Class Citizen
- 153. @mogronalol 46 Virtual Service as First Class Citizen Run and Capture Service Tests
- 154. @mogronalol 46 Virtual Service as First Class Citizen Run and Capture Service Tests Transform to simulation
- 155. @mogronalol 46 Virtual Service as First Class Citizen Run and Capture Service Tests Transform to simulation Publish Virtual Service
- 156. @mogronalol 46 Virtual Service as First Class Citizen Run and Capture Service Tests Parse Contract Transform to simulation Publish Virtual Service
- 157. @mogronalol 46 Virtual Service as First Class Citizen Run and Capture Service Tests Parse Contract Transform to simulation Parse Documentati on Publish Virtual Service
- 158. @mogronalol 47 Ownership Own Consumer Own Producer Strategy Integration Contract Testing Virtual Service as First Class Citizen
- 159. @mogronalol 47 Ownership Own Consumer Own Producer Strategy Integration Contract Testing Consumer Driven Contract Testing Virtual Service as First Class Citizen
- 160. @mogronalol 48 Consumer Driven Contract Testing http://www.martinfowler.com/articles/consumerDrivenContracts.html
- 161. @mogronalol 48 Consumer Driven Contract Testing Consumer Defines Contract http://www.martinfowler.com/articles/consumerDrivenContracts.html
- 162. @mogronalol 48 Consumer Driven Contract Testing Consumer Defines Contract http://www.martinfowler.com/articles/consumerDrivenContracts.html Generate Producer Stubs
- 163. @mogronalol 48 Consumer Driven Contract Testing Consumer Defines Contract http://www.martinfowler.com/articles/consumerDrivenContracts.html Generate Producer Stubs Implement Consumer
- 164. @mogronalol 48 Consumer Driven Contract Testing Consumer Defines Contract http://www.martinfowler.com/articles/consumerDrivenContracts.html Generate Producer Stubs Implement Consumer
- 165. @mogronalol 48 Consumer Driven Contract Testing Consumer Defines Contract http://www.martinfowler.com/articles/consumerDrivenContracts.html Generate Producer Stubs Generate Producer Contract Tests Implement Consumer
- 166. @mogronalol 48 Consumer Driven Contract Testing Consumer Defines Contract Implement Producer http://www.martinfowler.com/articles/consumerDrivenContracts.html Generate Producer Stubs Generate Producer Contract Tests Implement Consumer
- 167. @mogronalol 48 Consumer Driven Contract Testing Consumer Defines Contract Implement Producer http://www.martinfowler.com/articles/consumerDrivenContracts.html Generate Producer Stubs Generate Producer Contract Tests Implement Consumer Run Consumer Contract Tests
- 168. @mogronalol 48 Consumer Driven Contract Testing Consumer Defines Contract Implement Producer http://www.martinfowler.com/articles/consumerDrivenContracts.html Generate Producer Stubs Generate Producer Contract Tests Implement Consumer Run Consumer Contract Tests
- 169. @mogronalol 49 Consumer Driven Contract Testing http://www.martinfowler.com/articles/consumerDrivenContracts.html
- 170. @mogronalol 49 Consumer Driven Contract Testing Change producer http://www.martinfowler.com/articles/consumerDrivenContracts.html
- 171. @mogronalol 49 Consumer Driven Contract Testing Change producer http://www.martinfowler.com/articles/consumerDrivenContracts.html Run Consumer Contract Tests
- 172. @mogronalol 49 Consumer Driven Contract Testing Change producer http://www.martinfowler.com/articles/consumerDrivenContracts.html Run Consumer Contract Tests
- 173. @mogronalol 50 Tools
- 174. @mogronalol 50 Tools
- 175. @mogronalol 50 Tools
- 176. @mogronalol 51 Testing Pyramid End to end Integration / Service Testing Unit Testing
- 177. @mogronalol 51 Testing Pyramid End to end Integration / Service Testing Unit Testing Consumer Driven Contract Testing
- 178. @mogronalol 51 Testing Pyramid End to end Integration / Service Testing Unit Testing Consumer Driven Contract Testing
- 180. @mogronalol 52 Summary • Cost reduction from simulated services
- 181. @mogronalol 52 Summary • Cost reduction from simulated services • Easy deployment of simulations
- 182. @mogronalol 52 Summary • Cost reduction from simulated services • Easy deployment of simulations • Less dependant on end to end testing
- 183. @mogronalol 52 Summary • Cost reduction from simulated services • Easy deployment of simulations • Less dependant on end to end testing • Better feedback cycle