When you’re one of the world's largest tech unicorns and you’re dealing with the health and lives of hundreds of millions of people, you don’t want to be the bottleneck. That was the data platform engineering team at Babylon Health and so began Babylon's journey with Lenses.io to introduce DataOps tools and practices to scale their business. In this presentation, understand the complexity of Babylon’s data challenges as their business exploded into new markets by the month and * the tools, processes and GitOps practices Babylon had to put in place to scale * mistakes you should avoid as you grow * how Babylon free up engineering and infrastructure resources by opening up their data platform to data consumers directly * how you can reduce the need of skills by using SQL to work with real-time streams of data * how to build real-time streaming applications in a consistent manner following GitOps principles * how using Lenses.io has been the secret to Babylon’s success

1. Scaling engineering
Healthcare with DataOps

2. Andrew Stevenson
CTO - Lenses.io
datamountaineer
StevensonA_D

3. 3
Jeremy Frenay
Data Operations
Platform Engineer
@frenayj
jeremy-frenay

4. enabling realtime
DataOps
LENSES.IO

5. Just Some Of Our Customers

6. Data, Data everywhere
But not a drop to drink….

7. How fast did you get into
PRODUCTION?
Did you even make it?

8. “85% of projects fail”Gartner 2018
Distributed Skills

9. How to get to
PRODUCTION
faster?

10. Focus on what matters
DATAOPS
Data INTENSITY

11. But wait…
Aren’t we all meant to
be tech companies
now?

12. Tech intensity
To speed tech adoption, organizations need
to be able to access the latest platforms,
tools and training, so that they don’t have to
re-create technology that already has been
commoditized
Sayta Nadella – CEO Microsoft

13. Technology is a commodity
“depth and breadth of analytics
types on
streaming data are critical”
The Forrester Wave™:
Streaming Analytics 2019

14. Our shortest commodity is manpower;
every minute we can save on managing
our technology is worth more than
anything else to my business and
allows my team to focus on
accelerating our offerings to market
Ryan Fergusson, CEO, Riskfuel

15. Data Flows
Self-service
Data Visibility
Data Governance
DataOps
with lenses.io

16. What does a data platform
look like?

17. Architects view
Kafka / Pulsar / Redis / ?

18. Don’t give users
a black box

19. The terminal is
still a black box

20. Provide Visibility

21. Provide
access to
data

22. Provide a
way to
integrate
data

23. Provide a
way to
transform
data

24. Make it simple
to deploy and
scale

25. Provide a
familiar
skillset
Lenses SQL

26. Provide
self service
everything is an API

27. Provide
governance,
security and
multi-tenancy

28. So you can
build you
application
landscape

29. Automate everything - GitOps
Repeatable, promotion of
application landscapes

30. Cloud migration?

31. Self service Pluggable authenticationAudits
Monitor Apps & Infra Data access - SQL
Data integration Data processing - SQL
DataOps with Lenses

32. technology is an ENABLER
focus on your
DATA INTESITY

33. There’s nothing more
important than your HEALTH

34. Babylon’s mission is to
put an accessible and
affordable health service
in the hands of every
person on earth

35. Babylon services
Physical Services
Virtual Services
AI Services

36. Babylon in the UK
50,000/month
55,000/month
80,000/month
Members
Appointments
Chatbot conversations

37. Revolutionizing Healthcare with AI

38. Data Sovereign
Platform
Cloud Infrastructure
Orchestration
Data Infrastructure
Data
Processor
Microservices
Tools &
Automation

39. Data Sovereign
Platform
Streams

40. Babylon Data Platform

41. The challenges
● Healthcare Industry
● Data ownership / GDPR
● Hyper growth
● Observability / Data Quality
● Kafka Operation
● Innovation VS Governance

42. ● Data Infrastructure
● Tools & Automation
● Observability & Data Quality
● Empower with Governance
● Docker & Kubernetes
● Secure Software Development Life Cycle
DataOps at Babylon

43. Lenses at Babylon
● Explore Topics
● Debug
● Experiment
● Operate
● Custom Serde
● RBAC

44. Lenses at Babylon
● Lenses Helm chart
● Deployed on AWS EKS

45. What’s next
● Data Reliability
● Data Discovery
● Self-Service Tools & Infra
● Better Observability

46. More of the Data Infrastructure on Kubernetes?
What’s next
Streams

47. Thank you
47

48. We hiring!
https://lenses.io/career
all-in-one Box, it's free!
Download our all-in-one instance of
Lenses & Kafka.
https://lenses.io/start/