Bird Game App - RHoK Trento December 2011

Trento, December 3 rd , 2011
Project Page: http://code.google.com/p/happybirds
Bird Game App
Egidio Caprino
Filippo Del Frari
Carlo Mariangeli
Ermanno Moser
Nicola Perantoni
Gloria Zen

one of the world's prime outposts for observing the spring migration of birds
issue: project (lead by World Bank) of building a channel to bring water from the Red Sea to the Dead Sea on bird migration
environmentalists accuses this would affect migration phenomenon
proof supporting this claim is needed!
over 500 million birds cross Israel's airspace, heading south to warming weather in Africa.
Every autumn, million of birds migrate toward Southern warm areas of the world.
Human activities and climate/landscape changes are affecting this natural phenomenon
Goal = to identify the routes and the species that are in danger.
Case study: Israel
/ 14
Migration Birds Assessment

Exploit crowdsourcing to collect information data on the flocks' migratory phenomenon
Collection of image data with time + GPS location of Flocks of Birds
Information about bird species + number of individuals can be automatically extracted from image.
Information about routes can be reconstructed/inferred from time+GPS discrete data.
Solution
Challenge
To build a funny + easy-to-use web game application to involve as many users as possible
Extract significant data
/ 14
Bird Game App

Data Analysis users' scores = ? = ? birds/flocks data unlabeled images / 14
Solution flowchart
Data uploading - image - GPS&timestamp - user id - (user's label) SERVER Image processing data+GPS+Time processing image processing users labeling Estimation of - migration routes - birds population statistics

How to access to new users
Marketing our application within birdwatchers' community
Position information signs in strategic birdwatching hotspots
Marketing the initiative within local environmental associations (wwf, national parks, etc.)
Extend application to users with Smartphone + GPS camera
How to involve users
To build a geographical-time map for migrating birds that is a reference for the community.
Users are allowed to look through images and data on this map ( e.g. )
Create a score system where user gets new points for each new image loaded or labeled
Send reminders ( e.g. from year to year) to users who already participated and return in the areas of interest.
/ 14
Involving users

Download application
Users can download the Bird Game APP from Android Market or Apple's App Store for free.
Register to service
with a simple registration form, user obtains a unique identifier
Upload data (images & info)
user takes a photo of a bird and uploads it on the server. Photo contains info about: - GPS position - timestamp - (eventually) user's tag or comment
Interact with Server database
User can look through data on the server. Images are geo-tagged so they can be found directly on Google Maps or OpenStreetMap. Users can add new tags/labels to data. / 14
Smartphone

User can look through the data on the server
Query example:
“ show me pictures uploaded by user_id in the area around GPS_coordinate position ”
User input example:
“ This bird sighted at this GPS_coordinate position is a swallow ”
= ? / 14 `
Not only from Android, images with GPS position can be uploaded from the website!
Smartphone

What can we infer ( automatically or semi-automatically ) from images?
/ 14
Image Analysis

Flock's Cardinality = 8 individuals
Bird shape
Flock's V-Formation
What can we infer from Long-distance images?
Bird Species = ?
/ 14
Image Analysis
How can we infer this automatically ?
( opencv.willowgarage.com image processing library )
Thres- holding Blob detection original image binary image results (birds localization)

Easy cases
Challenges
well defined silhouettes
homogeneous background
overlapping
low contrast
heterogeneous background
(swallow flock) / 14
Image Analysis

What can we infer from Short-distance images?
= ?
Info about sighted Species
where/when different species stops by
= ? 14 / 14
Image Analysis

/ 14
Estimation of species migration routes
Estimation of risk species
1 5 10 15 20 25 30
Birds Hotspots
1 5 10 15 20 25 30 1 5 10 15 20 25 30
Example of data:
storks sighting in the month of October
Mining data

/ 14
We developed a system to monitor birds migration phenomenon
We want to exploit crowdsourcing. Target users are birdwatchers.
Through this system we want to create an open map migratory birds, containing information about the presence of which bird species + in which period of the year .
We show our demo implemented on a platform Android....
Solutions available at:
http://www.rhok.org/node/20752
http://code.google.com/p/happybirds/
Conclusions

Bird Game App - RHoK Trento December 2011

by filippodelfra

Accessibility

Categories

Upload Details

Usage Rights

Statistics

Bird Game App - RHoK Trento December 2011 Presentation Transcript