Presented by Ms Lisa Ong, Principal Lecturer & Consultant, Software Systems Practice,NUS-ISS, at NUS-ISS Learning Day 2019

1. Intelligence on the (bleeding)
Edge/Fog
Bringing AI Closer to the Customer
#ISSLearningDay
Ms. Lisa Ong, NUS-ISS
2 Aug 2019

2. Topics
• Edge Computing
• OpenFog Architecture
• AWS DeepLens
• Google Coral
#ISSLearningDay

3. Edge Computing
“Doing more things nearer to you”
#ISSLearningDay

4. What is Edge Computing?
• Running Data Processing, Analytics, Algorithms on
intelligent, distributed “device nodes”
instead of on the cloud
• Distributed = placed nearer to data source, sensor, customer
• Fog Computing: when device nodes are connected to internet
#ISSLearningDay

5. What’s wrong with the cloud?
• Cloud is too far away
• Latency
• Data privacy
• Cloud needs connectivity
infrastructure
• Cloud is expensive to scale
• More devices
• More data streams
#ISSLearningDay The Economist, 2018

6. Why Edge/Fog Computing?
#ISSLearningDay Source: Industrial IoT Consortium

7. Powered by 5G
#ISSLearningDay
GSMA Intelligence, 2014

8. Rising Business Opportunity
#ISSLearningDay
ZDNet, 2018

9. Projected US18.2bn by 2022
#ISSLearningDay
ZDNet, 2018

10. Smart Street Lighting Network
#ISSLearningDay
ST Engineering
The Straits Times, 2018

11. Self-monitoring Plant
#ISSLearningDay
OpenFog Consortium: Bonsai in the Fog

12. DIY Coffee Vending Machine
#ISSLearningDay
Hackster.io
ESP32 IoT Board

13. OpenFog Architecture
Guidelines on designing Edge/Fog systems
#ISSLearningDay

14. OpenFog Consortium
• Established 2015
• Founded by ARM, Cisco, Dell, Intel, Microsoft, Princeton
• Merged into Industrial Internet Consortium in 2019
• Includes AT&T, IBM, General Electric
#ISSLearningDay

15. Pillars of OpenFog
• Security
• Scalability
• Openness
• Autonomy
• RAS (Reliability, Availability and Serviceability)
• Agility
• Hierarchy
• Programmability
#ISSLearningDay

16. #ISSLearningDay
OpenFog Consortium

17. Hierarchy: N-Tiered Network
#ISSLearningDay
OpenFog Reference Architecture

18. Autonomy, Scalability
#ISSLearningDay
OpenFog Reference Architecture

19. Distributed Compute Capabilities
#ISSLearningDay
OpenFog Reference Architecture

20. Use Case: Airport Journey Tracking
#ISSLearningDay
OpenFog Reference Architecture

21. #ISSLearningDay
OpenFog Reference Architecture

22. AWS DeepLens
Video Camera Edge Device with deep learning capabilities
#ISSLearningDay

23. #ISSLearningDay
https://aws.amazon.com/deeplens/community-projects/

24. Workflow
#ISSLearningDay
docs.aws.amazon.com/deeplens/latest/dg/how-deeplens-works.html

25. Google Coral
Efficiently run TensorFlow AI on the Edge
#ISSLearningDay

26. Deep Learning Accelerators
#ISSLearningDay
spectrum.ieee.org/geek-life/hands-on/the-coral-dev-board-takes-googles-ai-to-the-edge
coral.withgoogle.com/

27. Benchmarking: Deep Neural Networks
#ISSLearningDay
https://medium.com/@aallan/benchmarking-edge-computing-ce3f13942245

28. Deployment Workflow
#ISSLearningDay coral.withgoogle.com/docs/edgetpu/models-intro/

29. Thank You!
lisaong@nus.edu.sg
4-Day Course: NICF - Designing Intelligent Edge Computing (SF)
#ISSLearningDay

30. Appendix: TF Graph Partitioning
#ISSLearningDay coral.withgoogle.com/docs/edgetpu/models-intro/