This presentation shows why, in IoT, AI needs to be deployed at the very edge of the network to be massively scalable, what is the readiness of the HW ecosystem and provides some application examples
8. Proprietary Information 8
Sensors
Sensor
mW image fps
# frames
to snap an
image
uW
(1 image/min)
QVGA 2 30 6 6,7
VGA 230 200 1 19,2
• The numbers illustrate the potential of the technology power wise
• System wise, the sensors architecture and features only start to be
designed for IoT use
e.g.
• some microphones now support wake-up-on-noise and low
resolution/lower power mode
• some image sensors offer multiple resolutions, but no image
sensor is meant for snapping one image at the time.
Their use remains a bit of DIY
• Plenty of room for improvement
• QVGA, 30fps @ 2mW
• VGA global shutter with logarithmic
sensitivity, 200 fps @ 230mW
• IR 80x80, 10 fps @ 15mW
• 10Hz 2m radar @ 1mW
• microphone @ 300uW
…
The devil is in the detail
12. • To minimize energy consumption, we also go for hierarchical device architecture,
from always-on inaccurate low power sensor to higher power higher resolution
sensor
• e.g.
• a PIR sensor detects life heat
• the camera is turned on during the day (an IR camera during the night) and captures an
image
• the processor looks for a person in the image
• a basic microphone detects a sound
• the microphone array is turned on and captures an audio sequence
• the processor calculates the direction of the sound and defines the window of interest
• the camera is turned and captures an image
• the processor looks into the window of interest for what the algorithm as been trained for
Proprietary Information 12
In real life