1. 以電腦視覺搭配感測器
進行環境偵測
John Chang ( 張書源 )
資深軟體開發協理
微軟亞太區前瞻科技合作部
john.chang@microsoft.com

2. 理想的物聯網解决方案 :
主動了解環境狀態並做出反應
視覺
觸覺/嗅覺/味覺
聽覺
說話/動作人腦

3. 攝影機
感知器
麥克風
說話/動作物聯網装置
理想的物聯網解决方案 :
主動了解環境狀態並做出反應

4. Custom Cloud
Gateway
Custom Cloud
Gateway
Field
Gateway
Device
VPN/ExpressRoute
OPC, HTTP, CoAP,…
Custom Protocols
Client SDK
IoT Edge
AMQP
Management app
Device registry/Management
Monitoring
Send commands
Client SDK
Management app
Device registry/Management
Monitoring
Send commands
Client SDK
Cloud protocol
gateway sample
Cloud protocol
gateway sample
AMQP, MQTT, HTTPS
Applications
- Companion apps
- Dashboards
- Controllers
- …
CoAP, AllJoyn, OPC,…
Device
Device
CoAP, AllJoyn, OPC, …
Device
Device
Device
IoT
Hub
Field
Gateway

5. Custom Cloud
Gateway
Custom Cloud
Gateway
Field
Gateway
Device
VPN/ExpressRoute
OPC, HTTP, CoAP,…
Custom Protocols
Client SDK
IoT Edge
AMQP
Management app
Device registry/Management
Monitoring
Send commands
Client SDK
Management app
Device registry/Management
Monitoring
Send commands
Client SDK
Cloud protocol
gateway sample
Cloud protocol
gateway sample
AMQP, MQTT, HTTPS
Applications
- Companion apps
- Dashboards
- Controllers
- …
CoAP, AllJoyn, OPC,…
Device
Device
CoAP, AllJoyn, OPC, …
Device
Device
Device
IoT
Hub
Field
Gateway
Data + AI

6. 結合攝影鏡頭偵測環境狀態
記錄當下狀況供日後追蹤
透過電腦視覺判斷當下狀況
更容易套用複雜的情境
深度學習讓影像辨識技術更成熟
OpenCV 可在 IoT Edge g9 篩選影像
Azure 認知服務支援影像分析
可與 Azure 其他服務结合

7. Sensor
Sensor
Sensor
Sensor
Sensor Blob Queue
Azure FunctionOpenCV
Custom Vision
Rule Engine
AzureIoT
Device Bot
SMS
Text
Phone
Call
Deep Learning

8. Sensor
Sensor
Sensor
Sensor
Sensor Blob Queue
Azure FunctionOpenCV
Custom Vision
Rule Engine
AzureIoT
Device Bot
SMS
Text
Phone
Call
Deep Learning

9. Sensor
Sensor
Sensor
Sensor
Sensor Blob Queue
Azure FunctionOpenCV
Computer Vision
Rule Engine
AzureIoT
Device Bot
SMS
Text
Phone
Call
Deep Learning

10. Deep Learning
Sensor
Sensor
Sensor
Sensor
Sensor Blob Queue
OpenCV
AzureIoT
疑似空氣汙染!

11. Sensor
Sensor
Sensor
Sensor
Sensor Blob Queue
Azure FunctionOpenCV
Computer Vision
AzureIoT
空氣汙染!
Deep Learning

12. Sensor
Sensor
Sensor
Sensor
Sensor Blob Queue
Azure FunctionOpenCV
Computer Vision
Rule Engine
AzureIoT
Device Bot
SMS
Text
Phone
Call
空氣汙染!
Deep Learning

14. Azure Data Science 虛擬機器
• 有 Windows & Linux 兩種版本
• CNTK, TensorFlow, MXNet, Caffe, Caffe2,
DIGITS, H2O, Keras, Theano, and Torch are
built, installed, and configured so they are
ready to run immediately
• NVIDIA driver, CUDA, and cuDNN are also
included
• Combine with Edge
• OpenCV 3.3 supports Caffe, TensorFlow & Torch

15. Blob Storage Azure Functions
Azure 資料科學
虛擬機器

17. 幾個步驟建立自己的物件模型
上傳照片
訓練
評估
匯出模型

19. 匯出模型進行邊緣運算
匯出模型到裝置使用

20. Blob Storage
Azure Functions
Custom
Vision API

21. Demo
智慧物聯網案例 –
空氣汙染偵測

22. 謝謝
Email: john.chang@microsoft.com