AWS Community Day Kochi 2019 - Technical Presentation Connecting 10000 cars to the AWS Cloud by Ashwin Murali, Associate Director of DevOps at Zoomcar

1. Connecting 10000
cars to the AWS
Cloud
Ashwin @ Zoomcar | Oct-12, 2019

2. $whoami
• Old school Sys / Network Admin
• <3 Shell / UNIX
• <3 Cloud and scaling tech companies
• IoT is my new tinker toy
• Own Mail and DNS servers

4. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9
India’s first and largest app-based
self-drive car rental company.

5. Cars
E-
Scooters

6. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9
100% AWS

7. Some more data
• 40 Cities
• 3mn users on the platform
• > 4000 rides every day
• 5lac km travelled daily
• 10000 cars

8. Some more data contd…
• All cars are connected to platform
• > 500mn IoT events ingested daily
• > 1TB data lake for analysis and reporting

9. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9
This is just cars!
We have scooters too ;-)

10. How did we do this?

11. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9
WE BURNT OURSELVES, OUR
FAMILIES, OUR FRIENDS, OUR
LAPTOPS and then some!

12. THAT CHEAP Datacenter!

13. • ~ 70 % uptime
• No NOC
• Noisy neighbor problems
• Hands tied on architectural, design, infra decisions
• DevOps === Red eyed devils on the floor
• Maintain / own Systems
• Maintain / own Infra

14. Bring on the experts!

15. • Mandate to scale – Zap subscribe
• 1 month to create migration plan
• 2 days to create instances
• 3 days to migrate data
• 4 hours of downtime
• 5 Star Performance

16. Post the upgrade
• Cloudfront – Website (1.2 secs to first paint)
• Autoscaling API cluster (2sec to 150ms avg resp time)
• EKS (~30% cost advantage)
• Multi AZ RDS (No DBAs in office)
• Read Replica Slaves (Daisy chained on demand for teams)
• AWS Glue / Athena / Redshift (More data sources, more information)
• 40X average scale / 200X peak load (Yaaaaay!!!)
• Elasticache (Memcache / Redis at their performant best)
• Kafka for IoT pipelines (Beast mode on steroids for distributed data
processing)

17. Data is the new FUEL!

18. Business Intelligence
• User behavior capturing
• Quicker identification of UX drop off points
• Demand Forecasting
• Predictive Maintenance

19. Data Analytics
• Every data point we can think of captured
• Cars produce 500mn data points per day
• Customer Churn
• Fraud detection
• Driver Score

20. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9
And that’s how we connect 10000
cars to the AWS Cloud…

21. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9
Hold on! There’s more!

22. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9
How would YOU do it?

23. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9
How would you connect 1mn
devices?

24. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9
Few Key Learnings

25. Bad arch decisions bite you hard

26. Be prepared to change at the
earliest

27. Managed Services exist for a
reason

28. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9
AWS IoT

29. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9
Key Components

30. Ingestion / Persistence / Analysis

31. Key Components
• Applications
• Device Management
• Message management
• Storage
• Data Processing
• Notifications
• Analytics

32. Key Components
• Applications – AWS IoT SDK / Edge with Greengrass
• Device Management – AWS IoT Hub / Device Shadows
• Message management – AWS IoT Message Queue / AWS IoT Rules Engine
• Storage – RDS / DynamoDB
• Data Processing - Lambda
• Notifications – SQS
• Analytics – EMR / Kinesis / Redshift

33. Why AWS IoT???

34. • Rock solid / proven ecosystem
• Infinite Scale
• Insanely small Time to Market
• Programmability
• Insights
• Smooth learning curve
• Existing support systems and community

36. Note: This works when copying entire slides from other presentations as long as the source presentation is also 16:9
Thank You
me@imashwin.co
+91 9003010231