Download as PDF, PPTX
Uploaded byJohn Chang
以電腦視覺搭配感測器進行環境偵測
This document discusses using computer vision and sensors for environmental detection in an ideal IoT solution. It describes capturing images with cameras to monitor current conditions and detect situations like air pollution. Deep learning and OpenCV can be used to analyze images at the edge or in the cloud using Azure services like Custom Vision and Cognitive Services. A demo is provided of a smart IoT solution that detects air pollution by training a model with images and deploying it to edge devices.
![[系列活動] 智慧城市中的時空大數據應用](https://cdn.slidesharecdn.com/ss_thumbnails/dscstbigdata1060211-170211004152-thumbnail.jpg?width=640&height=640&fit=bounds)
以電腦視覺搭配感測器進行環境偵測
- 1. 以電腦視覺搭配感測器 進行環境偵測 John Chang (張書源 ) 資深軟體開發協理 微軟亞太區前瞻科技合作部 john.chang@microsoft.com
- 2.
- 3.
- 4. Custom Cloud Gateway Custom Cloud Gateway Field Gateway Device VPN/ExpressRoute OPC,HTTP, CoAP,… Custom Protocols Client SDK IoT Edge AMQP Management app Device registry/Management Monitoring Send commands Client SDK Management app Device registry/Management Monitoring Send commands Client SDK Cloud protocol gateway sample Cloud protocol gateway sample AMQP, MQTT, HTTPS Applications - Companion apps - Dashboards - Controllers - … CoAP, AllJoyn, OPC,… Device Device CoAP, AllJoyn, OPC, … Device Device Device IoT Hub Field Gateway
- 5. Custom Cloud Gateway Custom Cloud Gateway Field Gateway Device VPN/ExpressRoute OPC,HTTP, CoAP,… Custom Protocols Client SDK IoT Edge AMQP Management app Device registry/Management Monitoring Send commands Client SDK Management app Device registry/Management Monitoring Send commands Client SDK Cloud protocol gateway sample Cloud protocol gateway sample AMQP, MQTT, HTTPS Applications - Companion apps - Dashboards - Controllers - … CoAP, AllJoyn, OPC,… Device Device CoAP, AllJoyn, OPC, … Device Device Device IoT Hub Field Gateway Data + AI
- 6. 結合攝影鏡頭偵測環境狀態 記錄當下狀況供日後追蹤 透過電腦視覺判斷當下狀況 更容易套用複雜的情境 深度學習讓影像辨識技術更成熟 OpenCV 可在 IoTEdge g9 篩選影像 Azure 認知服務支援影像分析 可與 Azure 其他服務结合
- 7. Sensor Sensor Sensor Sensor Sensor Blob Queue AzureFunctionOpenCV Custom Vision Rule Engine AzureIoT Device Bot SMS Text Phone Call Deep Learning
- 8. Sensor Sensor Sensor Sensor Sensor Blob Queue AzureFunctionOpenCV Custom Vision Rule Engine AzureIoT Device Bot SMS Text Phone Call Deep Learning
- 9. Sensor Sensor Sensor Sensor Sensor Blob Queue AzureFunctionOpenCV Computer Vision Rule Engine AzureIoT Device Bot SMS Text Phone Call Deep Learning
- 10. Deep Learning Sensor Sensor Sensor Sensor Sensor BlobQueue OpenCV AzureIoT 疑似空氣汙染!
- 11. Sensor Sensor Sensor Sensor Sensor Blob Queue AzureFunctionOpenCV Computer Vision AzureIoT 空氣汙染! Deep Learning
- 12. Sensor Sensor Sensor Sensor Sensor Blob Queue AzureFunctionOpenCV Computer Vision Rule Engine AzureIoT Device Bot SMS Text Phone Call 空氣汙染! Deep Learning
- 14. Azure Data Science虛擬機器 • 有 Windows & Linux 兩種版本 • CNTK, TensorFlow, MXNet, Caffe, Caffe2, DIGITS, H2O, Keras, Theano, and Torch are built, installed, and configured so they are ready to run immediately • NVIDIA driver, CUDA, and cuDNN are also included • Combine with Edge • OpenCV 3.3 supports Caffe, TensorFlow & Torch
- 15. Blob Storage AzureFunctions Azure 資料科學 虛擬機器
- 17.
- 19.
- 20.
- 21.
- 22.