The introduction about how MOMO tackle with Big Data

1. Data Platform
Hai.Nguyen1 - Head of Data Platform

2. Agenda
Data Platform in MOMO
Principle of Development
Best Practises
Q&A

3. Data Platform

8. Step 2
Implementation
& verify
Step 1
Brainstorming ideas
Data usage
scenarios

10. Achievements
● Number of queries (daily): 30,000
● Data scanned (daily): 60 TB
● Number of synced records (daily): 530 mil
● Number of generated records (daily): 200 mil
Number of transformation logics: 500

11. Principle of Development

12. Step 4
Feedbacks
Training
Step 3:
Deployment
Step 2:
Implementation
Step 1:
Design
End2End
Solution

13. Best Practises

14. Migration: Connection To Cloud

15. Data Migration v1

16. Data Migration v2 - Batch Mode

17. Data Migration v2 - Streaming Mode

18. Data Migration - Monitoring

19. Data Usage - Timezone

20. Interactive: 100
Batch: ∞ Query - interactive
Data Usage - Bigquery Quotas

21. Data Usage

22. Security - Service Account Key

23. Security - Data Masking

24. Q & A

25. Thank you