Mdaf biodiv app tutorial

420 views

Published on

Tutorial for the Mobile Data Acquisition Framework (MDAF)-based biodiversity application prototype

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
420
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Mdaf biodiv app tutorial

  1. 1. THE ENVIRONMENTAL OBSERVATION WEB AND ITS SERVICE APPLICATIONS WITHIN THE FUTURE INTERNET BIODIVERSITY APPLICATION OVERVIEW Denis Havlik and Maria Egly AIT Austrian Institute of Technology GmbH. “ENVIROfying” the Future Internet
  2. 2. 1. ENVIROFI Project and FI-PPP 2. Biodiversity Scenario 3. ENVIROFI-Bio App Walkthrough 4. Future Applications 5. TODO list Contents Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 2
  3. 3. 1. We envision … • a system with dynamic understanding of the Earth’s atmospheric, marine and terrestrial spheres for the benefit of all European citizens ENVIROFI Project Vision Copyright © 2013 ENVIROFI 3
  4. 4. 1. Bringing Biodiversity into the Future Internet • Enables biodiversity surveys with advanced ontologies • Analysis, quality assurance and dissemination of biodiversity data 2. Personal Information System for Air Pollutants, allergens and meteorological conditions • Enhance human to environment interaction • Atmospheric conditions and pollution in “the palm of your hand” 3. Collaborative Usage of Marine Data Assets • Assess needs of key marine user communities • Selection of representative marine use cases for further trial: leisure and tourism, ocean energy devices, aquaculture, oil spill alert ENVIROFI Scenarios Copyright © 2013 ENVIROFI 4
  5. 5. 1. Enable users to provide objective, semi- objective and subjective observations on biodiversity often in remote areas and under unfavorable weather conditions 2. Integrate additional (possible contradictory) observations from third-party databases 3. Assess the quality and meaning of the correlated observation collections Through combination of automated methods and crowdsourcing 4. Assure the users are aware of the findings and able to use them in own activities. Biodiversity Scenario Requirenments Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 5
  6. 6. Typed Observations • a photo could be “leaf photo” or a “tree photo”; a • number could be “tree height in meters Mobile App Functionality View existing knowledge • Map view • Table view • Detailed View • Areas of Interest Receive information (events!) • Requests for more observations, • Warnings, e.g. “pollen warning” • Interests, e.g. “monumental tree in vicinity” Report observations • “New” things, e.g. “here and now I see a tree” • Obs. on existing thing, e.g. “this tree currently blossoms NFC-Tags: • User interface (usability) • Identification of things • Authentication Alert! Caching;offlinemode Means of Reporting: • Free/controlled text (name, report) • Multiple choice (text, photo, ..) • Interval (from-to; area, …) • Sensor Input (camera, microphone, position, pressure) • NFC Tag (offline user Interface) Server Backend (or proxy) Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH.
  7. 7. Background Functionality Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 7 Plausibility/Confidence checks Consensus buildingSimilar & Related Observations? Habitat Information Image Recognition Reporters Reputation Observation DB Observ. on things (independent, conflicting, incomplete) Observations on observations (identification, plausibility, annotation) Application specific views (fusion, meaning uncertainty) Sensor Networks Observation Access & Management (Observation == Event!) Mobile client App Integrate existing data Other: Users, rights Resource discovery Data Fusion Reasoning Visualization Event handling
  8. 8. FI-Ware “Generic Enablers” already fulfill several requirements common to many environmental application scenarios: 1. “Single sign on" and authorization (Identity Management GE) 2. Event handling (Complex Event Processing GE, Publish/Subscribe Context Broker GE) 3. On demand scaling (cloud hosting GEs) 4. BLOB storage and retrieval (cloud storage GE) 5. Ad-hoc applications for specific users (composition & Mashup Ges) See: http://www.fi-ppp.eu/, http://www.fi-ware.eu/ ENVIROFI and the FI-Ware Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 8
  9. 9. Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 9 Application Architecture Copyright © 2013 Maria Egly, AIT Austrian Institute of Technology GmbH.
  10. 10. ENVIROFI-BIO APP Walkthrough App version 0.52, from 28.02.2013
  11. 11. Download and documentation on: http://catalogue.envirofi.eu Note: • Developed and tested on Android 4.1; not compatible with 4.0 • Expected to work (but not tested) on android v 2.3.3 and higher App Download & Instalation Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 11
  12. 12. Login Screen Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 12 Login 1. Login using previously registered account 2. Select from list of accounts stored on phone Demo Login 1. Choose one of the “DemoUser” accounts 2. Press login Note2: data entered by DemoUser accounts will eventually be deleted
  13. 13. Popup Messages Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 13 The app uses two types of popups Help Messages Most popup messages are educational. These popups can be safely turned off by the user. Warnings In addition, the app will warn users before performing some “dangerous” operation such as deleting the data or starting a large data transfer.
  14. 14. Main Menu Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 14 List Observations Browse through Objects of Interest (trees), report new objects and observations, define new areas of interest. Settings Some user-selectable options Areas of Interest Shortcut to previously defined Areas of Interest Press „List Observations“ button!
  15. 15. Map View Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 15 Zoom buttons Single OoI (tree) Tap to show details OoI group (11 trees) Tap to zoom in Add OOI button Tap to add new tree „My position“ button Tap to re-center the map on GPS position New AoI button Tap to add new Area of Interest • double-tap to zoom-in, • stretch to zoom-out, • drag map to pan
  16. 16. Adding an Area of Interest (1) Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 16 First login & Areas of Interest On fist login, the app will show an empty map. User has to define some areas of interest before proceeding. Note: if you choose an existing account (e.g. demo 1), the app will immediately start downloading the users data in the background. Pan and zoom to define AoI position and size, then press “Save” button
  17. 17. Adding an Area of Interest (2) Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 17
  18. 18. Behind the Scene: AoI Copyright © 2013 Maria Egly, AIT Austrian Institute of Technology GmbH. 18 Environmental Georeferenced Observation App Environmental Georeferenced Observation Service Environmental Georeferenced Observation Proxy Service Client Server Area of Interest { Bounding Box Coordinates } Web MapTile Server Area of Interest { Occurrences & Observations }
  19. 19. Ready to go! Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 19 Your data and AOIs The app will now display the known objects of interests (previously reported trees) within the new Area of Interest on a map. New AoI appears in the AoI list and can be used to display the same area on a map later. Note: from now on, you can start using the application offline. The app will synchronize the list of OOIs and observations within your AoI as needed, whenever a network connection is available
  20. 20. List View and Filters Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 20 List View List view is synchronized with the Map View and presents an alternative view of the trees within currently active map area. Hint: press on a tree name to show tree details Filter View Filter view can be used to pre- select the trees corresponding to filter criteria. The filter is honoured by map and list view
  21. 21. Tree Details View Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 21 OOI versus observations Most Objects of Interest in our database are trees imported from the tree cadastres of Vienna and Florence. Users can add new OOIs (trees) as well as the observations on existing OOIs. Note: Our app currently displays each report as a separate block on tree details view, starting with initial OOI. We plan to present a fused view on all available information in the future
  22. 22. Adding Objects of Interest Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 22 Why OOI? Object of Interest is a concept closely aligned with OGCs’ “Feature of Interest” and a concept of “Thing” in Internet of Things. OOI is one of the main data element of the Environmental Georeferenced Observation Service SE, and used to represent trees in this app. Tap here, to enter the „add OOI“ mode. Pan & zoom the map to choose OOI location Press the crosshair to report a new OOI at this position
  23. 23. Adding Observations on OOIs Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 23 Why Observations? Concept of observation originates from the OGC Sensor Web Enablement. The “Observation” data element in the Environmental Georeferenced Observation Service SE and in this app corresponds to “observation collection” rather than to a single O&M observation. Note: mapping to standard O&M schema is straightforward but working with larger documents is more efficient in our applications. First open a „Tree Details“ view, e.g. by pressing on a tree icon on a map. Then Press this button
  24. 24. Supported Observed Properties Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 24 LTER connection ENVIROFI-Bio app has been designed in cooperation with the Austrian Long Term Ecological Research Network (LTER). Starting with an empty sheet The long list of observation properties foreseen in the LTER data model is grouped in logical groups and each group can be easily displayed or hidden as needed.
  25. 25. Supported Observed Properties (2) Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 25
  26. 26. Behind the Scene: Add OoI Copyright © 2013 Maria Egly, AIT Austrian Institute of Technology GmbH. 26 Environmental Georeferenced Observation App Environmental Georeferenced Observation Service Environmental Georeferenced Observation Proxy Service Client Server Object of Interest { time, geolocation, provider, properties }
  27. 27. Environmental Georeferenced Observation App Behind the Scene: Leaf Image Classification Copyright © 2013 Maria Egly, AIT Austrian Institute of Technology GmbH. 27 Environmental Georeferenced Observation Service Environmental Georeferenced Observation Proxy Service ServerClient Environmental image sample classification service MDAF Image Storage FI-Ware Object Storage GE Observation { … imagetype ‘leaf’ … }
  28. 28. Environmental georeferenced Observation App Behind the Scene: Access Broker Copyright © 2013 Maria Egly, AIT Austrian Institute of Technology GmbH. 28 Environmental Georeferenced Observation Service Environmental Georeferenced Observation Proxy Service ServerClient Access Broker Observation { … species … }
  29. 29. Events in ENVIROFI applications Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 29 Working with Events Propagation of Observations and new OOIs is faciliated by event-driven architecture of the Environmental Georeferenced Observation Service SE. This is already used to trigger external processing services. TODO • Event-driven requests of actions from users • Pushing of events to FI- Ware event processing services Event Propagate data Trigger services Request actions Alerts
  30. 30. Working with NFC tags Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 30 Offline User interfaces GUI handling of mobile apps can be frustrating, especially in bad weather conditions. Our idea is to provide an alternative method for user input using external objects such as NFC tags and 2D barcodes. OOI identification with NFC User can associate a tree with an NFC tag. This tag can be used as a shortcut to open a tree details view later.
  31. 31. Environmental Georeferenced Observation Service Environmental Georeferenced Observation Proxy Service Client Technology: Environmental Georeferenced Observation App Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 31 Server Sencha Touch Android Blackberry OS Apple IOS Windows Phone PhoneGap = Apache Cordova Presentation Layer Application Logic Visualization standardized technologies  Javascript  HTML 5  CSS Platform independent* *to a large extent; minor porting effort necessary HTTP Interfaces:  OpenStreetMap  Google Service API  FI-Ware Object Storage  FI-Ware Identity Management
  32. 32. Environmental Georeferenced Observation App Environmental Georeferenced Observation Service Technology: Environmental Georeferenced Observation Proxy Copyright © 2013 Maria Egly, AIT Austrian Institute of Technology GmbH. 32 ServerClient CouchDB/ GeoCouch CouchDB/ GeoCouch continuous replication standardized technologies  GeoJSON  HTTP  Storage/Retrieval via http RESTful Interface  Changes Notification API used for app GUI updates  Created on user‘s first login  Filtered replication to Environmental Georeferenced Observation Service
  33. 33. Technology: Environmental Georeferenced Observation Service Copyright © 2013 Maria Egly, AIT Austrian Institute of Technology GmbH. 33 Environmental Georeferenced Observation App Environmental Georeferenced Observation Proxy Service Client Server CouchDB/ GeoCouch Image StoreCouchDB/ GeoCouch Observation Store Utilities*  Data Import  WFS  SOS  XML  User Registration  GeoCouch Utilities * implementation in Perl, Java  Information provided via HTTP RESTful Interface  API implemented as JavaScript Views in CouchDB  Geospatial queries available, results encoded in (Geo)JSON  Interface extendable for any kind of data retrieval requirements  Prototype implementation of SOS available  Event interface provided for creation of observations
  34. 34. • Biodiversity: plants and animal sightings, seasonal changes, invasive species, educational • Forestry & agriculture: invasive species, spread of pests & infections • Administration: state of inventory, need for actions (e.g. „this tree is about to fall“) • Health: environment/health correlation, allergene plants (see ENVIROFI PEIS pilot), light & noise pollution • Crisis Management: augmented reality for training, improved situation awareness, coordination of volunteers and field workers. Possible Future Applications Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 34
  35. 35. • Produce and consume FI-Ware events • „Best guess“ fused view on OOI based on all available observations (instead of showing all observations). • Request QA observations from users as needed • GUI changes to simplify quality-assurance by users (“this an apple-tree, not pine-tree”) • “Find/Locate a tree” function • Deleting own OOIs and observations, deleting Areas of Interest • Publicly accessible Environmental Georeferenced Observation (Proxy) Service And more… We are looking for new projects to continue development beyond ENVIROFI TODO list Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 35
  36. 36. Coming soon … Copyright © 2013 Denis Havlik, AIT Austrian Institute of Technology GmbH. 36 Consensus Building Other users are asked to check/rate the observation A user makes an observation

×