Presentation given at the FME WT in Cardiff

1. A Database for
Every Occasion

3. Types of Databases

4. . . . For Every Occasion
Relational
Sports league
NoSQL
Epic party
File-based
Camping

5. File-Based Databases
• Pack light to go camping!
• Offline access
• Minimal setup
• Make a mistake, just delete it

6. File-Based
Databases
✔ Simple
✔ Shareable and Portable
✔ Tiny
✔ Extensible

7. Relational Databases
ID Name Position
1 Harry Potter Seeker
2 Ginny Weasley Chaser
3 Draco Malfoy Seeker
ID Name Colors
1 Gryffindor Red and gold
2 Slytherin Green and silver
TeamID PlayerID
1 1
1 2
2 3
Player
Team
Team_Players

8. Relational
Databases
✔ Static schema
✔ Consistent, reliable transactions
✔ Accuracy
✔ Complex SQL querying
✔ Control security for each table

9. NoSQL Databases
{
ID: 1,
Title: "Bilbo Baggins’ Eleventy First Birthday Party",
Location: Shire,
Fireworks Display: {
Name: "Gandalf the Wizard",
Time: "half past six",
}
}
• NoSQL values
scalability over
accuracy
• No set schema
• Single storage
location
• High volume

10. NoSQL
Databases
✔ Agile schema
✔ High data volumes (big data)
✔ Fast transactions
✔ Scalable
✔ Access via APIs

11. Let’s Build an App
Wildlife surveying

12. Bald Eagle Survey
A team of wildlife surveyors needs
to assess eagle habitat.
• Mobile devices
• Track locations
• Store local condition data

13. Which database to
use?

14. OGC GeoPackage
• Free and open source
• Standards-based
• Platform-independent
• Portable
• Compact
• All the power of a fully-featured RDBMS
Supports raster and vector all in a SQLite container!
http://www.geopackage.org/

15. Step 1:
Build Database using Existing Data

16. Over to FME

17. Step 2: Collect Data
Going Mobile
Place your screenshot here
GeoPackage MapCache Android
QField for QGIS (QGIS Mobile)
Esri Collector – Storage in AGOL

18. Final Step:
Merge all Updates into Master
FME Tips:
1. Detect updates
2. fme_db_operation
3. Unique ID field

19. Over to FME

20. Story: Field Data
Collection and
Maintenance
Landscaping company
1. Collect job site summary
2. Data = Time cards, tasks
and materials.

21. Step 1: Field Data Collection

22. Step 2: Transform AGOL to Excel & File Geodatabase
Esri
Survey123

23. Step 3: Cyclical Quality Control
✅

24. Prepped Excel data loaded into Microsoft Power BI

25. Summary
• Choose the right database for the
occasion
– Pros and cons to relational,
NoSQL, and file-based databases
• Update master database using
UpdateDetector, fme_db_operation,
and a unique ID

26. Questions?
Learn more:
Tutorial: Updating Databases
NoSQL blogs + webinar
safe.com/nosql
David Eagle
Managing Consultant
FME Certified Professional & Trainer
david.eagle@1spatial.com
Twitter @david_eagle