SpringOne Platform 2017 Violeta Georgieva, Pivotal "Scalability and resilience are important key goals, characteristics for modern applications. To achieve this, applications can use non-blocking, event-driven manner that scale with a small number of threads with backpressure as a key ingredient. In Spring Framework 5, a new reactive stack is introduced, which includes Servlet/Reactive Streams bridge. Using this new capability it is possible to create reactive applications that can be deployed on Apache Tomcat or any Servlet 3.1 compatible containers. In this session you will learn how to leverage this bridge in your applications. In addition you will look behind the scene and see how this bridge is implemented supporting both HTTP and Websocket protocols. Performance comparison will be presented showing the benefits of the new approach."

1. Reactive Applications on Apache
Tomcat and Servlet 3.1 Containers
Violeta Georgieva
@violeta_g_g
1

2. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Violeta Georgieva
• Pivotal
• Tomcat committer
• RM for Tomcat7/8.0
• Spring Framework contributor
• Reactor Netty committer
2

3. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
3

4. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Use Cases
4

5. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Use Cases
5

6. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Use Cases
6
Network Latency

7. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Use Cases
7
Processing Latency

8. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Demo - Blocking
8
∞
Stock
Quotes
Trading Service
Load Generator
Browser

9. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Synchronous Processing/Blocking
9
Client App A App B

10. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Synchronous Processing/Blocking
10
Client App A App B

11. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Asynchronous Processing/Blocking
11
Client App A App BThread
Pool

12. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Asynchronous Processing/Blocking
12
Client App A App BThread
Pool

13. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Asynchronous Processing/Blocking
13
Client App A App BThread
Pool

14. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Asynchronous Processing/Non-Blocking
Read
14
Container App

15. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Asynchronous Processing/Non-Blocking
Read
15
Container App
onDataAvailable

16. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Asynchronous Processing/Non-Blocking
Read
16
Container App
onDataAvailable
read
isReady?

17. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Asynchronous Processing/Non-Blocking
Read
17
Container App
onDataAvailable
read
isReady?
read
isReady?
false

18. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Asynchronous Processing/Non-Blocking
Read
18
Container App
onDataAvailable
read
isReady?
read
isReady?
false
onDataAvailable

19. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Asynchronous Processing/Non-Blocking
Write
19
Container App

20. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Asynchronous Processing/Non-Blocking
Write
20
Container App
onWritePossible

21. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Asynchronous Processing/Non-Blocking
Write
21
Container App
onWritePossible
write
isReady?

22. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Asynchronous Processing/Non-Blocking
Write
22
Container App
onWritePossible
write
isReady?
write
isReady?
false

23. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Asynchronous Processing/Non-Blocking
Write
23
Container App
onWritePossible
write
isReady?
write
isReady?
false
onWritePossible

24. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Reactive Streams
• Publisher
• Subscriber
• Subscription
• Processor
24

25. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Reactive Streams
25
Publisher Subscriber
subscribe
onSubscribe

26. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Reactive Streams
26
Publisher Subscriber
subscribe
onSubscribe
request(2)

27. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Reactive Streams
27
Publisher Subscriber
subscribe
onSubscribe
request(2)
onNext
onNext

28. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Reactive Streams
28
Publisher Subscriber
subscribe
onSubscribe
request(2)
onNext
onNext
request(1)

29. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Reactive Streams
29
Publisher Subscriber
subscribe
onSubscribe
request(2)
onNext
onNext
request(1)
onNext

30. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Read
30
Container Read Listener Read Publisher App

31. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Read
31
Container Read Listener Read Publisher App
onSubscribe
subscribe

32. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Read
32
Container Read Listener Read Publisher App
onSubscribe
subscribe
request

33. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Read
33
Container Read Listener Read Publisher App
onSubscribe
subscribe
requestisReady?
read
onNext(data)

34. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Read
34
Container Read Listener Read Publisher App
onSubscribe
subscribe
requestisReady?
read
onNext(data)
request

35. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Read
35
Container Read Listener Read Publisher App
onSubscribe
subscribe
requestisReady?
read
onNext(data)
requestisReady?
false

36. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Read
36
Container Read Listener Read Publisher App
onSubscribe
subscribe
requestisReady?
read
onNext(data)
requestisReady?
false
onDataAvailabl
e
onDataAvailabl
e

37. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Read
37
Container Read Listener Read Publisher App
onSubscribe
subscribe
requestisReady?
read
onNext(data)
requestisReady?
false
onDataAvailabl
e
onDataAvailabl
e
onNext(data)
read

38. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Write
38
Container Write Listener Write
Subscriber
App

39. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Write
39
Container Write Listener Write
Subscriber
App
subscribe
onSubscribe

40. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Write
40
Container Write Listener Write
Subscriber
App
subscribe
onSubscribe
request

41. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Write
41
Container Write Listener Write
Subscriber
App
subscribe
onSubscribe
request
isReady?
write
onNext(data)

42. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Write
42
Container Write Listener Write
Subscriber
App
subscribe
onSubscribe
request
isReady?
write
onNext(data)
request

43. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Write
43
Container Write Listener Write
Subscriber
App
subscribe
onSubscribe
request
isReady?
write
onNext(data)
request
isReady?
false
onNext(data)

44. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Write
44
Container Write Listener Write
Subscriber
App
subscribe
onSubscribe
request
isReady?
write
onNext(data)
request
isReady?
false
onNext(data)
onWritePossible onWritePossible

45. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Servlet 3.1/Reactive Streams Bridge - Write
45
Container Write Listener Write
Subscriber
App
subscribe
onSubscribe
request
isReady?
write
onNext(data)
request
isReady?
false
onNext(data)
onWritePossible onWritePossible
write
request

46. Unless otherwise indicated, these slides are © 2013 -2017 Piv otal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Demo – Non Blocking
46
Load Generator
∞
Stock
Quotes
Trading Service
Browser

47. Thank You
http://github.com/violetagg/s1p2017-demo
47
#springone@s1p