Something’s Burning: Using FME for Data Updates & Decision Support
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Something’s Burning: Using FME for Data Updates & Decision Support

on

  • 1,621 views

 

Statistics

Views

Total Views
1,621
Views on SlideShare
1,621
Embed Views
0

Actions

Likes
0
Downloads
4
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • ISC atom layer; every piece surveyed line work ever digitized in the provinceISC FME run to create the above layers in shapefile formatMonthly email indicating that the new data is available on an FTP site for download along with some notes of interest if any major changes have occurred
  • 12h 5 or 6 h effort- under 1 hour (12 minutes if you skip the boundary layer)
  • - End of month output from isc delivered mid month.
  • One of the ways to update features in a database is by using the Feature Based Attribute fme_db_operation. The steps involved are - test the incoming features for a value which will decide between updating, deleting, inserting or ignoringadd the attribute fme_db_operation to the features and assign it a value - either UPDATE/DELETE/INSERT - set the UPDATE KEY COLUMN to some attribute which will match the input features to the database features - in this case it is the attribute “PPID". - change the WRITER MODE on the destination dataset to UPDATE The feature based attribute fme_db_operation is available on most of the database readers and writers
  • Report on land purchases to the Ministry are required.

Something’s Burning: Using FME for Data Updates & Decision Support Presentation Transcript

  • 1. Something’s Burning:
    Using FME for data updates and decision support
    Barry Otterson
    Saskatchewan Ministry of Environment
    October 18th, 2010
  • 2. Objectives
    Data updates
    > Information Services Corporation (ISC) Sask Cadastral dataset
    Decision support
    > Southern Conservation Land Policy
    > LDIS, R.A.N., Enduring Features, FWDF, Conservation Easement
  • 3. Data updates: ISC Sask Cadastral dataset
    What is this?
    Saskatchewan’s land parcel data.
    What does it do?
    The Sask Cadastral Dataset provides a current, accurate description of land parcels in the province, useful for a variety of applications.
    Why do we need it?
    Legal parcel boundaries and ownership records are a critical part of maintaining accurate information on land ownership that aid in decision making.
  • 4. Data updates: ISC Sask Cadastral dataset
    Full product(s)
    block,boundary,IR,lane,lot,monument,0_hudson_bay_reserve,o_quarter_section,o_riverlot,o_road_allowance,o_road_allowance_int,o_section,park,plan,quarter_section,railway,right_of_way,riverlot,rural_municipality,section,surface,survey_parcel,surveyed_line,township,urban_municipality,provincial_boundary
    Change records
    same as above but includes a transaction file.
  • 5. Data updates: ISC Sask Cadastral dataset
    Data Maintained on an Internal ArcSDE at ENV.
    This location happens to be within 30 metres of the original dataset hosted by ISC!
    Options for maintaining this data:
    - Full delete and replace each month
    - Manual change record transactions
    - Automated process using FME or other tools
  • 6. Data updates: ISC Sask Cadastral dataset
    Change records in a nutshell:
    - Change records include all the transactions since the last delivery of the data.
    • Significantly smaller in size than the full dataset
    • 7. Add, Delete and Modify
  • Data updates: ISC Sask Cadastral dataset
    Transaction.dbf (50,000~ records for August)
  • 8. Data updates: ISC Sask Cadastral dataset
    A change record shapefile is sent for each theme (i.e. park.shp)
  • 9. Data updates: ISC Sask Cadastral dataset
    FME workbench
    • Joins transaction.dbf to each shapefile theme and performs the operation (add (insert), modify (update), or delete (delete)) on a version within ArcSDE.
    • 10. Deletes are stored only within transaction file
    • 11. Adds and modifies are sent with the corresponding geometry.
    • 12. A Simple process that looks like it could compete for the …. http://www.fmepedia.com/index.php/Chamber_of_Workspace_Horrors
  • Data updates: ISC Sask Cadastral dataset
    ENV ArcSDE
    QA/QC
    Post
    New
    version
    Version
    fme_db_operation
    Change records
    You have been warned here it is FME
  • 13. Data updates: ISC Sask Cadastral dataset
    Room to improve
    -automate creation and posting of version
    -automate QC/QA?
    -metadata updates and statistics and ArcSDE compression
    Ultimate Goal
    -direct access to ISC’s data!
    -replication?
    -WFS?
    Questions so far?
  • 14. Decision Support: Southern Conservation Land Policy
    -The goal of the SCLP is to attain lands that contribute to the overall conservation of biodiversity in the province while meeting The Saskatchewan Farm Security Act and The Saskatchewan Farm Security Regulations.
    -Conservation NGO’s obtain lands that contribute to the SCLP.
    -The Saskatchewan Ministry of Environment is responsible to evaluate those land holdings and long term conservation plans.
  • 15. Decision Support: Southern Conservation Land Policy
    Farmland in Saskatchewan should be considered for conservation purchase or conservation easements if the following guidelines are met:
    1. Conservation Goal Alignment:
    • The acquisition is part of a long-term plan of a conservation group filed with and approved by Ministry of Environment.
    2. Stewardship:
    • outlines (among other things) how weeds will be controlled to reduce fire hazards, fence management plans and circumstances under which conservation lands are made available for agricultural uses.
    3. Lands Evaluation:
    • Land acquisition for conservation use should primarily occur where the land has a low capability for cultivation. An explanation of the need for land with higher capability should be provided.
    4. Regional Consultation:
    • The plan has been subjected to adequate regional consultation and has accommodated concerns and issues raised in those consultations.
    5. Compliancy Approval/Rejection
    • Ministry of Environment has reviewed the conservation organizations annual report to determine if the activities are consistent with their long-term plan.
  • Decision Support: Southern Conservation Land Policy
    The Full Menu
    As stated in the Southern Conservation Lands Policy (SCLP) under the heading
    “Conditions for Purchase of Conservations Lands in Southern Saskatchewan”,
    subsection (e):
    “The conservation organization files an annual report with Saskatchewan Environment detailing their land purchases, easements registered, stewardship activities and consultations”
    And as required by The Saskatchewan Farm Security Regulations, (SFSR, 2006)
    37/2006, under section 6(1) subsection (c), point (ii):
    “The conservation group files annual compliance reports with the Minister of the Environment in an approved form”
    • Conservation organizations are required to file annual reports to the government
    that detail their land holdings for the reporting year.
  • 16. Decision Support: Southern Conservation Land Policy
    Condensed soup from the policy documents
  • 17. Decision Support: Southern Conservation Land Policy
    What role does FME play?
    The Ministry processes each conservation organization’s annual land acquisitions to assess the legislative and ecological criteria of the SCLP using ESRI and FME.
  • 18. Decision Support: Southern Conservation Land Policy
    Black and white rules in the SCLP
    • 100,000 acres (as of 200606)
    -PANP is just under 1 million acres
    -Moose Mountain is just over 100,000 acres
    • 3% max total land holdings within an RM
    -Average size for 3% of an RM’s is 15,500 acres
    -640 acres in a section / 160 per quarter section
    -97~ quarters = 3~% of an RM
  • 19. Decision Support: Southern Conservation Land Policy
    Ecological evaluation
    • Agricultural Capability
    • 20. Enduring Features Representation
    • 21. Fragmentation
    • 22. Percent Native Grasslands
    • 23. Other exceptions
  • Decision Support: Southern Conservation Land Policy
    The workbench’s FME
  • 24. Questions?
    Contact:
    Barry Otterson
    Saskatchewan Ministry of Environment
    Barry.Otterson@gov.sk.ca
    306 953-2230