With the fast technological progress of sensors, processors, operating system and AI, more and more data are generated and processed. Cloud computing is usually the 1st choice for such tasks, however, cloud computing does have many limitations, like real-time processing, security, scalability etc. Cloud needs to work together with the end point to achieve the best result. in the presentation, I will introduce the concept, example and progress of edge computing, as well as the challenges we are facing to push more computing and analytics to the edge.
1. Copyright Thunder Software Technology Co., Ltd. 2008-2016 All right reserved
http://www.thundersoft.com/
the Rise and Myth of
Edge Computing
2017.7.8
7/13/2017 1
Ppengcheng Zou
CTO of Thundersoft
6. Data that Cannot Be Understood
7/13/2017 6
About 5GB data will be generated every
second by a Boeing 787, but the bandwidth …
1GB data will be generated by the autonomous car
every second and it requires real-time processing…
I
A
3526
C
50 IDC/ ABI/ Cisco forecast connected devices will be
26 / 35 / 50 Billion by 2020…
Tens of Billions of face images collected each day
8. Challenges of AI
7/13/2017 8
Massive
Data
Real-Time
Security /
Privacy
40%About 40% raw data will be
processed at the edge by 2019
IDC estimates that IoT data will
make up 95% of real-time data by
2025
More and more devices require
security but now unprotected…
45%
42%
13%
Requires security
unprotected
Does not require
security
Requires security
protected
9. Rise of Edge Computing
7/13/2017 9
Before 1980 1980-2000 2000-2020 After 2020
Mainframes Client-Server Cloud-Mobile Intelligent Edge
Centralized Distributed Centralized Distributed
Limited adoption-high
end enterprise,
government, and
education
Broader enterprise
adoption, some
consumer
Mass consumerization;
life enhancing
applications
Ubiquitous adoption; life
critical applications
Thousands of devices,
millions of users
Hundreds of millions of
devices and users
Billions of devices and
users
Hundreds of billions of
devices, billions of users
Structured data Mostly Structured
Structured and
unstructured
Increasingly unstructured
❖ By 2022, all new IP Cameras will support embedded CNNs
❖ By 2030, the majority of cameras connected to the internet
will not stream video
10. Movidius - 深度学习 vs. 传统图像处理算法
深度学习是不是只适合图片分类呢? Movidius(就是去年被Intel收购的那家深度学习芯片公司)的答案当然
是"不"。Movidius会介绍一些也同样可以全部或部分应用深度学习的领域,比如:手势识别和跟踪,SLAM等,
而其他一些图像处理算法(比如ISP,图像拼接,点云处理等)可能还暂时用不上深度学习。
11. 13.7.2017 г. 11
Imagry - 在终端上运行深度学习
Imagry是一家以色列的深度学习算法公司,他们将介绍如何在移动终端上进行深度学习计算,特
别是如何在终端上对新的学习数据进行处理。
36. Too Much to Build a Vision Product
7/13/2017 36
Operating System Camera Solution Product
• Linux, Android or RTOS?
• Low Footprint
• Quick Boot Time
• SoC Support
• Camera H/W Selection
• Driver Development
• Camera Tuning
• Camera Features
• Quality Control
• Certification Support
• H/W Customization
• Stability Test
Algorithm Dev.
• Algorithm Design
• Benchmarking
• Optimization
• Integration
38. Thundersoft Overview
7/13/2017 38
❖ Founded in 2008
❖ Smart Device OS & Platform
❖ 3000+ SW/HW Engineers
❖ IPO in 2015
❖ Worldwide Presence
Mobile
Automotive
Multi-OS and Multi-Platform Support Key Market
IoT
Security & Enterprise
39. What We Do
OS Customization
Android OS Upgrade
Carrier Certification
Customer Technical Support
Component Verification and
Driver Development
BSP&APP Maintenance
• Small RAM
• Fast Boot
• Power Saving
• System Tailoring
• Hardware Security
• Secure APPs
• Network Security
• Device Management
• Camera Tuning
Turnkey Solution
• Dual Camera
• 360 panorama
• Face recognition
• Object tracking
• Deep learning
• Sensor Fusion
• TurboX Series SoM Products
• Reference Design of Drone,
Smart Camera, AR/VR and
Robot
• Customization
• APP & UI/UE development
• Global Carrier Certification
• Automatic Test Solution
• FOTA Solution
• IVI
• Automotive HMI
• Digital Cluster
• MDM
• Mobile office
• Enterprise security
• APP development tools
Mobile
Automotive Enterprise & Security
IoT
System
Optimization
Security
Image
Processing
Computing
Vision
7/13/2017 39
41. 13.7.2017 г. 41
中科创达 (Thundersoft) - Camera交钥匙方案及开发套件
好的Camera系统涉及的因素很多,传感器,镜头,马达,驱动,ISP,内核,多媒体框架,
算法,应用等等,每个环节都涉及复杂的专业知识和经验。Thundersoft介绍如何用交钥匙方
案的方式更高效地开发Camera系统,并且展示专门用于Camera系统开发的套件。
Camera Turn-key Solution
42. Thundersoft Camera Solution
7/13/2017 42Thundersoft
HW OS Algorithm Services Products
BSP
HTTP Server
Video Algorithm
System Tuning
Face detection, recognition
EIS, Motion detection
Stability, Performance,
Power, Image Quality
Multi-Media Framework
Drivers/Camera/V4l2)
Camera
Service
Encoder
Control Engine
Connectivity
WiFi, USB2.0/3.0
Ethernet I/F(RJ45)
RTSP Server
HW Design
Camera Reference Design
8~13 Megapixel Camera
4K, H264(AVC), 265(HEVC)
Algorithm
Mobile App
Camera
Tuning
Cloud
43. Deep Learning in the Device
7/13/2017 43
Segment Your Food
Recognize Your Food
• Up to 700 diverse dishes
• Up to 80% Top-1 accuracy
• Up to 6 FPS with only model optimization
• 5x performance boost using Deep Learning Engine
• Depth camera
• Relative precise bounding contours
• Calorie counting
44. ❖ Overview
► A clip-like BLE wearable device, measure biological information such as
physical activity information, heart rate information, stress level, sleep
information
► Transfer the sensor data from device to Gateway and IOT cloud.
❖ Use Scenario
► wear on the belt, gather and process the the sensor data from the
devices
► place on the cradle, detect the pressure data by connecting a close soft
tube which placed under-the-bed
❖ Gateway Type
► Proxy on smart phone
► Dedicated smart gateway
Smart Belt
7/13/2017 44
• Cortext M4 + BLE Module
• Accelerometer + Pressure Sensors
• mbed OS 5.4
• Body Position Algorithms