Responsibilities - Design Understating the problem Define proper data structure(s) Determine proper tools Consider the integration of selected tools

1. Data Operations
‫ها‬ ‫داده‬ ‫عملیاتی‬ ‫مدیریت‬

2. Who am I

3. Data Platforms & Positions
Data Architect
Data Engineer Data Scientist

4. Responsibilities - Design
1. Understating the problem
2. Define proper data structure(s)
3. Determine proper tools
4. Consider the integration of selected tools

6. Understating the problem
Production
Layer
Warehouse
Layer
Reporting
Layer
Ingestion
Layer

7. Production Layer
…

8. Production Layer
…

9. Production Layer

10. Production Layer
Optimize Data Access Path
Archiving
Implement New Technologies for Specific Use cases
Database Migration

11. Warehouse Layer

12. Warehouse Layer
What is the state of their current platform?
How long data should be kept?
What Their Requirements really are?
Which Technologies should be used?

13. Reporting Layer

14. Ingestion Layer

15. Ingestion Layer

17. Netflix
•110 million subscribers.
•200 countries.
•$3 billion in revenue per quarter.
•5 million new subscribers per quarter.
•1 billion hours of video each week.
•250 million hours of video on a single day in 2017.
•37% of peak internet traffic in the United States.
•Netflix plans to spend $7 billion on new content in 2018.

18. Netflix

19. Uber
• 83 countries and over 674 cities worldwide
(Source: Uber)
• 40 million rides monthly and has over 77% of
US ride-hailing Total number of rides by 2016
– 2 billion
• Uber valuation in 2017 – $69 billion
(Source: Bloomberg)
• In the US, Uber has over 160,000 active drivers
• 14% of its drivers are female (Source: Uber)
• It’s largest competitor Lyft generates a
fraction of net revenue ($700 million)
compared to Uber ($6.5 billion)

20. Uber

21. Uber

22. Persian Bank(Top Project)

23. Digikala(Data Lake Project)

24. Digikala(Data Lake Project)

25. Digikala(Data Lake Project)

26. The End…