Using Open Source Software
For Mobile Data Collection
Andy Faust, GISP
North Central Wisconsin Regional
Planning Commissio...
Agenda
• Overview of the ODK Project
• Backend Storage Options
• Install ODK Collect
• Design Custom Forms
• Data Collecti...
Open Data Kit
• Open Data Kit (ODK) is a suite of tools that allows data
collection using mobile devices and data submissi...
Open Data Kit
2
•http://www.youtube.com/watch?v=IRYzf0Xg3qw&feature=player_embedded
Opendatakit.org
• Open Data Kit (ODK) is a free and open-source set of
tools which help organizations author, field, and
m...
Aggregate
• provide blank forms to ODK Collect,
• accept finalized forms (submissions) from ODK Collect and
manage collect...
Aggregate
• ODK Aggregate can be deployed on Google's App
Engine, enabling users to quickly get running
without facing the...
Install Aggregate
• appengine.google.com
• Run web application on Google’s server
• http://code.google.com/p/opendatakit/
...
Overview of ODK System
Server
Forms
Builder
Collect
Data
Store
Mobile
Collection
XML
Forms
•App Engine
•Local Server
•Form...
https://appengine.google.com/
https://developers.google.com/appengine/docs/billing
8
9
Verify your Google App Engine Account
10
Enter Verification code
11
Sign in to your Google App Engine Account using your Gmail Account
12
13
Remember this for install
wlia9999
14
Download ODK Aggregate v1.2.0 windows-installer.exe
15
http://code.google.com/p/opendatakit/downloads/list
16
17
1 2
3 4
18
1 2
3 4
19
1 2
3
4
20
1 2
3
4
http://build.opendatakit.org/
21
Online web application to create forms. You must register for a free account to use Build...
22
Create a basic text question. To add new fields to the survey select type from bottom.
23
Add a numeric question.
24
Add a media question to take a picture
25
Add a question with select multiple
26
Add question with choose one
27
Save form and export to App Engine Enter App ID from page 13
28
Sample Form on App Engine
29
Backend Options
Google App Engine Local Server Formhub.org
PROS PROS PROS
No Hardware Required More Control Free
Low Co...
http://www.apachefriends.org/en/xampp-windows.html
30
XAMPP is a free and open source cross-platform web server solution s...
31
32
33
34
http://localhost
35
36
37
http://www.mysql.com/downloads/connector/j/5.1.html
C:xampptomcatlib
38
39
40
Type = cmd
CD C:xamppmysqlbin
41
42
43
copy the ODKAggregate.war to the webapps directory of the Apache Tomcat installation
44
45
46
Formhub uses the ODK source code to create an online application that can be used for free
47
Create formhub sign in
48
Fill in registration and wait for email confirmation
For help: https://formhub.org/getting_started/
49
Sign in and give formhub a try.
text Text input.
integer Integer (ie, whole number) input.
decimal Decimal input.
select_one [options] Multiple choice que...
start Start date and time of the survey.
end End date and time of the survey.
today Day of the survey.
deviceid IMEI (Inte...
52
Survey tab – Were database fields and questions are added to your survey.
Column Description
name name of database field (no spaces in field name)
label What is displayed on the screen
hint Hint t...
54
Choices tab – Were selection list are located
55
Settings tab – Were name and version of form are set
Choices Tab
Column Description
list_name option from the select
name value that is added to database
label what is display...
57
Sample Survey ODK_WorkshopformWLIA1.xls - survey tab
58
Sample Survey ODK_WorkshopformWLIA1.xls - choices tab
59
Sample Survey ODK_WorkshopformWLIA1.xls - settings tab
60
Samples shown using local server used for Wisconsin Hazard & Assessment & Mapping (WHAM)
61
Pie Chart Display Example
62
Map Display Example
63
Publish to Google Fusion Tables or Google Spreadsheets
64
Publish to Google stay active and live. As new data is collected it is pushed to Fusion
tables or Spreadsheets
65
Google Fusion Table
66
Google Fusion Table Map Display
67
Change Info Window – Pick what fields are displayed
<div class='googft-info-window' style='font-family: sans-serif'>
<img src="{Photo1}" style="width: 150px; vertical-align: ...
69
Custom Info window displayed
70
Change Info Window – Pick what fields are displayed
71
From Aggregate to CSV
72
From Aggregate to CSV
73
KML to Google Earth
74
KML to Google Earth
75
Data displayed in Google Earth
Workshop   using open source software for mobile data collection workshop - andrew faust
Workshop   using open source software for mobile data collection workshop - andrew faust
Workshop   using open source software for mobile data collection workshop - andrew faust
Workshop   using open source software for mobile data collection workshop - andrew faust
Workshop   using open source software for mobile data collection workshop - andrew faust
Workshop   using open source software for mobile data collection workshop - andrew faust
Upcoming SlideShare
Loading in...5
×

Workshop using open source software for mobile data collection workshop - andrew faust

1,425

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,425
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
107
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Workshop using open source software for mobile data collection workshop - andrew faust

  1. 1. Using Open Source Software For Mobile Data Collection Andy Faust, GISP North Central Wisconsin Regional Planning Commission WLIA Annual Conference Lake Geneva, Wisconsin February 13, 2013
  2. 2. Agenda • Overview of the ODK Project • Backend Storage Options • Install ODK Collect • Design Custom Forms • Data Collection • Analyze / View / Export Data • Questions / Review
  3. 3. Open Data Kit • Open Data Kit (ODK) is a suite of tools that allows data collection using mobile devices and data submission to an online server, even without an Internet connection or mobile carrier service at the time of data collection. • Created by developers at the University of Washington's Computer Science and Engineering department , Members of Change, and Google. Open Data Kit is an open-source project available to all. 1
  4. 4. Open Data Kit 2 •http://www.youtube.com/watch?v=IRYzf0Xg3qw&feature=player_embedded
  5. 5. Opendatakit.org • Open Data Kit (ODK) is a free and open-source set of tools which help organizations author, field, and manage mobile data collection solutions. ODK provides an out-of-the-box solution for users to: 1. Build a data collection form or survey online web application (XLSForm is recommended for larger forms); 2. Collect the data on a mobile device to send it to a server. The application on the device; 3. Aggregate the collected data on a server and extract it useful formats 3
  6. 6. Aggregate • provide blank forms to ODK Collect, • accept finalized forms (submissions) from ODK Collect and manage collected data, • visualize the collected data using maps and simple graphs, • export data (e.g., as CSV files for spreadsheets, or as KML files for Google Earth), and • publish data to external systems (e.g., Google Spreadsheets or Google Fusion Tables). 4
  7. 7. Aggregate • ODK Aggregate can be deployed on Google's App Engine, enabling users to quickly get running without facing the complexities of setting up their own scalable web service. • ODK Aggregate can also be deployed locally on a Tomcat server (or any servlet 2.5-compatible web container) backed with a MySQL or PostgreSQL database server. 5
  8. 8. Install Aggregate • appengine.google.com • Run web application on Google’s server • http://code.google.com/p/opendatakit/ Once you are signed up you need to create an application, so just click on the button “Create an Application” and give your application a name (called “application identifier”). This name needs to be unique among all users applications, so it might take a while to find a unique one. Save your new application. After you have created your first application you need to specify your cell phone number. Google will then send you a SMS with a code that you enter into their site. This confirms that you are the owner of this Google App Engine account. 6
  9. 9. Overview of ODK System Server Forms Builder Collect Data Store Mobile Collection XML Forms •App Engine •Local Server •Form Hub •ODK Build •XLS Forms •XML •Text •Numbers •Date •Pictures •Video •Sound •Barcodes 7
  10. 10. https://appengine.google.com/ https://developers.google.com/appengine/docs/billing 8
  11. 11. 9 Verify your Google App Engine Account
  12. 12. 10 Enter Verification code
  13. 13. 11 Sign in to your Google App Engine Account using your Gmail Account
  14. 14. 12
  15. 15. 13 Remember this for install wlia9999
  16. 16. 14
  17. 17. Download ODK Aggregate v1.2.0 windows-installer.exe 15 http://code.google.com/p/opendatakit/downloads/list
  18. 18. 16
  19. 19. 17 1 2 3 4
  20. 20. 18 1 2 3 4
  21. 21. 19 1 2 3 4
  22. 22. 20 1 2 3 4
  23. 23. http://build.opendatakit.org/ 21 Online web application to create forms. You must register for a free account to use Build Can be used to create basic survey forms
  24. 24. 22 Create a basic text question. To add new fields to the survey select type from bottom.
  25. 25. 23 Add a numeric question.
  26. 26. 24 Add a media question to take a picture
  27. 27. 25 Add a question with select multiple
  28. 28. 26 Add question with choose one
  29. 29. 27 Save form and export to App Engine Enter App ID from page 13
  30. 30. 28 Sample Form on App Engine
  31. 31. 29 Backend Options Google App Engine Local Server Formhub.org PROS PROS PROS No Hardware Required More Control Free Low Cost More Secure Easy to setup Easy to setup No Hardware Required CONS CONS CONS Cost Cost Loss of Control Loss of Control Hardware Required Less Secure Less Secure Harder to setup Form Limitations
  32. 32. http://www.apachefriends.org/en/xampp-windows.html 30 XAMPP is a free and open source cross-platform web server solution stack package consisting mainly of Apache and MySQL database. XAMPP can be helpful to get your own local server up and running.
  33. 33. 31
  34. 34. 32
  35. 35. 33
  36. 36. 34
  37. 37. http://localhost 35
  38. 38. 36
  39. 39. 37
  40. 40. http://www.mysql.com/downloads/connector/j/5.1.html C:xampptomcatlib 38
  41. 41. 39
  42. 42. 40
  43. 43. Type = cmd CD C:xamppmysqlbin 41
  44. 44. 42
  45. 45. 43
  46. 46. copy the ODKAggregate.war to the webapps directory of the Apache Tomcat installation 44
  47. 47. 45
  48. 48. 46 Formhub uses the ODK source code to create an online application that can be used for free
  49. 49. 47 Create formhub sign in
  50. 50. 48 Fill in registration and wait for email confirmation
  51. 51. For help: https://formhub.org/getting_started/ 49 Sign in and give formhub a try.
  52. 52. text Text input. integer Integer (ie, whole number) input. decimal Decimal input. select_one [options] Multiple choice question; only one answer can be selected. select_multiple [options] Multiple choice question; multiple answers can be selected. note Display a note on the screen, takes no input. geopoint Collect GPS coordinates. image Take a photograph. barcode Scan a barcode, requires the barcode scanner app is installed. date Date input. datetime Accepts a date and a time input. audio Take an audio recording. video Take a video recording. calculate Perform a calculation. Question Types 50
  53. 53. start Start date and time of the survey. end End date and time of the survey. today Day of the survey. deviceid IMEI (International Mobile Equipment Identity) subscriberid IMSI (International Mobile Subscriber Identity) sim_serial SIM serial number. phone_number Phone number (if available). Metadata 51
  54. 54. 52 Survey tab – Were database fields and questions are added to your survey.
  55. 55. Column Description name name of database field (no spaces in field name) label What is displayed on the screen hint Hint that is displayed on the screen constraint constraint used to validate input….example: . > 0 and . < 120 constraint_message constraint message displayed if constaint is not met required "yes" if the input is required appearance numbers, maps, year, annotate, draw, signature, compact default enter a default value calculation displays a value calculated from another field choice_filter Used for Cascading Selects Survey Tab – Column Definitions 53
  56. 56. 54 Choices tab – Were selection list are located
  57. 57. 55 Settings tab – Were name and version of form are set
  58. 58. Choices Tab Column Description list_name option from the select name value that is added to database label what is displayed on survey screen Settings Tab Column Description form_title Form Title form_id Form ID public_key Public ID Key used for encryption submission_url Submission URL version Form Version 1.the form ID should be short (ideally < 10 characters). 2.the form ID should be unique within your organization. 3.the form ID must not contain any spaces or punctuation characters. 4.the form ID should contain only alphanumeric characters and the characters '_' and '-'. 5.the form ID should start with a letter. 6.it may be useful to add a version designation (e.g, "medinfo-01") to aid in version tracking as you revise your forms. 56 Form ID yyyymmddnn yyyy = year ie. 2013 mm = month ie. 02 nn = form iteration within the given day
  59. 59. 57 Sample Survey ODK_WorkshopformWLIA1.xls - survey tab
  60. 60. 58 Sample Survey ODK_WorkshopformWLIA1.xls - choices tab
  61. 61. 59 Sample Survey ODK_WorkshopformWLIA1.xls - settings tab
  62. 62. 60 Samples shown using local server used for Wisconsin Hazard & Assessment & Mapping (WHAM)
  63. 63. 61 Pie Chart Display Example
  64. 64. 62 Map Display Example
  65. 65. 63 Publish to Google Fusion Tables or Google Spreadsheets
  66. 66. 64 Publish to Google stay active and live. As new data is collected it is pushed to Fusion tables or Spreadsheets
  67. 67. 65 Google Fusion Table
  68. 68. 66 Google Fusion Table Map Display
  69. 69. 67 Change Info Window – Pick what fields are displayed
  70. 70. <div class='googft-info-window' style='font-family: sans-serif'> <img src="{Photo1}" style="width: 150px; vertical-align: top; margin-center: .5em" /> <h2>{Address}</h2> <b>Description:</b> {Description}<br> <b>Amount:</b> {Amount}<br> <b>Insurance:</b> {Insurance}<br> <b>Classification:</b> {Classification}<br> <b>Municipality: {mcd}<br> <b> <a href="{Photo1}" target="_blank">Photo1</a> <a href="{Photo2}" target="_blank">Photo2</a> <a href="{Photo3}" target="_blank">Photo3</a> <br> </div> 68 Change Info Window – Custom using HTML
  71. 71. 69 Custom Info window displayed
  72. 72. 70 Change Info Window – Pick what fields are displayed
  73. 73. 71 From Aggregate to CSV
  74. 74. 72 From Aggregate to CSV
  75. 75. 73 KML to Google Earth
  76. 76. 74 KML to Google Earth
  77. 77. 75 Data displayed in Google Earth
  1. ¿Le ha llamado la atención una diapositiva en particular?

    Recortar diapositivas es una manera útil de recopilar información importante para consultarla más tarde.

×