The document discusses the visualizing of 4D data in web browsers, emphasizing the integration of various services like Docker, Kubernetes, and NGINX. It contrasts short and long-running container processes, outlining the advantages and disadvantages of each regarding scalability and operational efficiency. The content concludes with considerations on costs and performance in cloud environments, inviting further questions from the audience.

1. Killing containers to
make weather
beautiful
Jacob Tomlinson
Met Office Informatics Lab
@_jacobtomlinson

2. Who am I?

4. Visualising
4D data in a
web
browser
Confidence
in
integration

5. Visualising 4D data in a
web browser

6. Ingestion

7. Supercomputer
Binary files
PNG images
Videos
The browser

10. Service types

11. Long running daemons
Short running workers

12. Kubernetes

13. Mixing job types

14. Docker Host
nginx
SystemCapacity
Docker Host
nginxSystemCapacity
Docker Host
nginx
SystemCapacity

15. Docker Host
SystemCapacity
Docker Host
SystemCapacity
Docker Host
SystemCapacity
nginx nginx nginx

16. Docker Host
nginx
SystemCapacity
Docker Host
nginxSystemCapacity
Docker Host
nginx
SystemCapacity

17. Docker Host
nginx
SystemCapacity
Docker Host
nginxSystemCapacity
Docker Host
nginx
SystemCapacity
worker
worker
worker
worker
worker
worker
worker
worker
worker
worker
worker
worker

18. Docker Host
nginx
SystemCapacity
Docker Host
SystemCapacity
Docker Host
SystemCapacity
worker
nginx nginx
workerworker

19. Docker
nginx
System
worker
Docker
System
worker
nginx
Docker
System
worker
nginx
Docker
System
worker
worker
worker
worker
worker

20. Docker
System
worker
Docker
System
worker
Docker
System
worker
Docker
System
worker
nginx
worker
nginxnginxnginx
workerworkerworker

21. Persistence

22. EBS backed
persistent volumes

23. Docker Host
mongo
EBS Volume
Docker Host Docker Host

24. Docker Host
EBS Volume
Docker Host Docker Host
mongo mongo

25. Docker Host
EBS Volume
Docker Host Docker Host
mongo

26. Scaling by queue

27. AWS cost vs scale

28. Confidence in
integration

29. Short containers
Long containers
Daemon processes which listen to requests
Asynchronous processes doing repetitive
workloads

30. Short containers

31. ∞ jobs
1 job
n jobs

32. Pros
Conceptual simplicity
Confidence
Cons
Overhead

33. Long containers

34. Run forever
Finite runtime

35. Scaling down

36. Being confident

37. Conclusion

38. Questions
Jacob Tomlinson @_jacobtomlinson