This document discusses building a social network from scratch using microservices and Kubernetes. It outlines the technologies used in the DOF HUNT stack including Golang and Python for backends, Flutter for mobile, MySQL and MongoDB for databases, Elasticsearch for search, Redis for caching, NATS for messaging, and Linkerd for service mesh. It also covers monitoring and tracing with OpenCensus and Jaeger, and logging with Fluentd and Elasticsearch. Clean architecture is employed with modules separated into transport, handler, repository, and storage layers to allow easy transition between monolith and microservices.

1. Build a Social Network from scratch
with Microservices & Kubernetes
1
DOF HUNT

2. About me
Tran Xuan Viet (Viet Tran)
•Founder, CTO at 200lab
•Former Solution Architect at Sendo.
•Former CTO at Skylab
•Former Software Engineer at Foody.
viettranx@gmail.com
2

3. • Switch Monolith <=> Microservices easily
• Clean architecture at DOF Hunt
• Monitoring & Tracing
• Service Mesh with Linkerd
• Logging
Agenda
3

4. • Backend: Golang, Python
• Mobile: Flutter
• Database: MySQL (main), MongoDB
• Search Index DB: Elastic Search
• Caching: Redis
• Broker Pub/Sub: NATS
• Service Mesh: Linkerd
DOF HUNT Stack
4

5. Monolith <=> Microservices easily
with Clean Architecture
5

6. Clean Architecture at DOF Hunt
6
TRANSPORT
HANDLER
REPOSITORY
STORAGE
Module/Service
TRANSPORT
HANDLER
REPOSITORY
STORAGE
Module/Service
TRANSPORT
HANDLER
REPOSITORY
STORAGE
Module/Service
.
.
.

7. Clean Architecture at DOF Hunt (.cont)
7
REPOSITORY STORAGE
FindProductById(id)
UpdateProduct(product)
MYSQL
FindProductById(id)
UpdateProduct(product)
REDIS
FindProductById(id)
UpdateProduct(product)
UpdateProduct(product)
HANDLER

8. Clean Architecture at DOF Hunt (Cont)
8

9. Clean Architecture at DOF Hunt (Cont)
9
Inside a module

10. Microservice
10

11. Microservice
11
Microservices remove dependent
But add more complex for system

12. First at all, we need to know what makes
our system slow
12

13. Monitoring & Logging
13

14. MySQL Monitoring
14

15. Nginx Monitoring
15

16. Nginx Monitoring
16

17. DOF HUNT Tracing
OpenCensus Jaeger
17

18. Jaeger is a distributed tracing system released as open
source by Uber Technologies. Learn more
• Distributed context propagation
• Distributed transaction monitoring
• Root cause analysis
• Service dependency analysis
• Performance / latency optimization
Storage Support:
18

19. Opensensus & Jaeger Deployment
Golang +
Agent
UDP
Span Data
Service Node
Golang +
Agent
UDP
Span Data
Service Node
.
.
.
T-Channel
Kafka Broker
Collector Node
Collector
Storage
Write
UI
Query
Push
Kafka
19

20. Opensensus & Jaeger Deployment
20

21. Service Mesh with Linkerd
21

22. Logging with Fluentd & ElasticSearch
22

23. Visualize logging data
23

24. Visualize logging data
24

25. Thank you
25