How to do birdspotting using a Raspberry Pi, Azure IoT Hub, Azure Function and Cognitive services to identify contents of images.

1. Birdwatching with
Raspberry Pi, Azure IoT
Hub, Function and
Cognitive Services
By John Staveley
28/01/2021
https://uk.linkedin.com/in/johnstaveley/
@johnstaveley

2. Objective
 Take pictures of birds,
 not cats!

3. Architecture

4. Raspberry Pi Overview
 Raspberry Pi 4-b, Wifi,
Camera port
 GPIO, SPI, USB2/3,
Ethernet, HDMI etc
 MicroSD card and USB-
C power

5. Birdcam BOM
 Infrared Motion sensor
 Camera
 Case
 Scaffolding
 Cost: ~£110
 https://shop.pimoroni.
com/collections/raspb
erry-pi

6. Raspberry Pi Environment and code
 Linux, 32bit
 Vnc and Sftp
 .Net 5, Python
 Visual studio Code
 DEMO: Go through code

7. Azure Setup
 Use Free tiers!
 IoT Hub – register device, get secret
 Blob storage – setup 2 containers
 Function App – get deployment code
 Cognitive Services – get secret and endpoint

8. Azure FunctionApp for processing
Blob Triggers Azure Function
Calls Cognitive Services
Analyses image classification for key tags
Move picture and stores with analysis
Sends feedback to Raspberry Pi
 DEMO: Go through code

9. Cognitive Services
 Description: ducks on
a pond
 Tags[]: tree, outdoor,
grass, water, lake,
duck, animal, bird,
goose, pond
 Objects[]: Bird, x: 267,
y: 174, w: 165, h: 102
etc
 Dominant colours,
image type etc
 Uses confidence
intervals 0-1

10. Demo
 Take picture using Pi, look at analysis

11. Demo 1

12. Demo 2

13. Future Development
 Run Cognitive Services on a container on the Pi
 Use Adafruit BrainCraft HAT for Image recognition
 IR Cam for working at night
 Put in cat deterrent!

14. Any Questions?
@johnstaveley
Demo code: https://github.com/johnstaveley/BirdCam
Slides:
https://www.slideshare.net/johnstaveley/