Something’s Burning:<br />Using FME for data updates and decision support<br />Barry  Otterson<br />Saskatchewan Ministry ...
Objectives<br />Data updates<br /> 		> Information Services Corporation (ISC) Sask Cadastral dataset<br />Decision support...
Data updates:  ISC Sask Cadastral dataset<br />What is this? <br />Saskatchewan’s land parcel data.<br />What does it do?<...
Data updates:  ISC Sask Cadastral dataset<br />Full product(s)<br />	block,boundary,IR,lane,lot,monument,0_hudson_bay_rese...
Data updates:  ISC Sask Cadastral dataset<br />Data Maintained on an Internal ArcSDE at ENV.<br />This location happens to...
Data updates:  ISC Sask Cadastral dataset<br />Change records in a nutshell:<br />- Change records include all the transac...
Add, Delete and Modify</li></li></ul><li>Data updates:  ISC Sask Cadastral dataset<br />Transaction.dbf  (50,000~ records ...
Data updates:  ISC Sask Cadastral dataset<br />A change record shapefile is sent for each theme (i.e. park.shp)<br />
Data updates:  ISC Sask Cadastral dataset<br />FME workbench<br /><ul><li>Joins transaction.dbf to each shapefile theme an...
Deletes are stored only within transaction file
Adds and modifies are sent with the corresponding geometry.
A Simple process that looks like it could compete for the …. http://www.fmepedia.com/index.php/Chamber_of_Workspace_Horror...
Data updates:  ISC Sask Cadastral dataset<br />Room to improve<br />-automate creation and posting of version<br />-automa...
Decision Support:  Southern Conservation Land Policy<br />-The goal of the SCLP is to attain lands that contribute to the ...
Decision Support:  Southern Conservation Land Policy<br />Farmland in Saskatchewan should be considered for conservation p...
Decision Support:  Southern Conservation Land Policy<br />Condensed soup from the policy documents<br />
Decision Support:  Southern Conservation Land Policy<br />What role does FME play?<br />The Ministry processes each conser...
Decision Support:  Southern Conservation Land Policy<br />Black and white rules in the SCLP<br /><ul><li>100,000 acres (as...
Decision Support:  Southern Conservation Land Policy<br />Ecological evaluation<br /><ul><li>Agricultural Capability
Enduring Features Representation
Upcoming SlideShare
Loading in …5
×

Something’s Burning: Using FME for Data Updates & Decision Support

1,598 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,598
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
6
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • ISC atom layer; every piece surveyed line work ever digitized in the provinceISC FME run to create the above layers in shapefile formatMonthly email indicating that the new data is available on an FTP site for download along with some notes of interest if any major changes have occurred
  • 12h 5 or 6 h effort- under 1 hour (12 minutes if you skip the boundary layer)
  • - End of month output from isc delivered mid month.
  • One of the ways to update features in a database is by using the Feature Based Attribute fme_db_operation. The steps involved are - test the incoming features for a value which will decide between updating, deleting, inserting or ignoringadd the attribute fme_db_operation to the features and assign it a value - either UPDATE/DELETE/INSERT - set the UPDATE KEY COLUMN to some attribute which will match the input features to the database features - in this case it is the attribute “PPID&quot;. - change the WRITER MODE on the destination dataset to UPDATE The feature based attribute fme_db_operation is available on most of the database readers and writers
  • Report on land purchases to the Ministry are required.
  • Something’s Burning: Using FME for Data Updates & Decision Support

    1. 1. Something’s Burning:<br />Using FME for data updates and decision support<br />Barry Otterson<br />Saskatchewan Ministry of Environment<br />October 18th, 2010<br />
    2. 2. Objectives<br />Data updates<br /> > Information Services Corporation (ISC) Sask Cadastral dataset<br />Decision support <br /> > Southern Conservation Land Policy<br /> > LDIS, R.A.N., Enduring Features, FWDF, Conservation Easement<br />
    3. 3. Data updates: ISC Sask Cadastral dataset<br />What is this? <br />Saskatchewan’s land parcel data.<br />What does it do?<br />The Sask Cadastral Dataset provides a current, accurate description of land parcels in the province, useful for a variety of applications.<br />Why do we need it?<br />Legal parcel boundaries and ownership records are a critical part of maintaining accurate information on land ownership that aid in decision making.<br />
    4. 4. Data updates: ISC Sask Cadastral dataset<br />Full product(s)<br /> block,boundary,IR,lane,lot,monument,0_hudson_bay_reserve,o_quarter_section,o_riverlot,o_road_allowance,o_road_allowance_int,o_section,park,plan,quarter_section,railway,right_of_way,riverlot,rural_municipality,section,surface,survey_parcel,surveyed_line,township,urban_municipality,provincial_boundary<br />Change records<br /> same as above but includes a transaction file.<br />
    5. 5. Data updates: ISC Sask Cadastral dataset<br />Data Maintained on an Internal ArcSDE at ENV.<br />This location happens to be within 30 metres of the original dataset hosted by ISC! <br />Options for maintaining this data:<br /> - Full delete and replace each month <br /> - Manual change record transactions<br /> - Automated process using FME or other tools<br />
    6. 6. Data updates: ISC Sask Cadastral dataset<br />Change records in a nutshell:<br />- Change records include all the transactions since the last delivery of the data.<br /><ul><li>Significantly smaller in size than the full dataset
    7. 7. Add, Delete and Modify</li></li></ul><li>Data updates: ISC Sask Cadastral dataset<br />Transaction.dbf (50,000~ records for August)<br />
    8. 8. Data updates: ISC Sask Cadastral dataset<br />A change record shapefile is sent for each theme (i.e. park.shp)<br />
    9. 9. Data updates: ISC Sask Cadastral dataset<br />FME workbench<br /><ul><li>Joins transaction.dbf to each shapefile theme and performs the operation (add (insert), modify (update), or delete (delete)) on a version within ArcSDE.
    10. 10. Deletes are stored only within transaction file
    11. 11. Adds and modifies are sent with the corresponding geometry.
    12. 12. A Simple process that looks like it could compete for the …. http://www.fmepedia.com/index.php/Chamber_of_Workspace_Horrors</li></li></ul><li>Data updates: ISC Sask Cadastral dataset<br />ENV ArcSDE<br />QA/QC <br />Post<br />New<br /> version<br />Version<br />fme_db_operation<br />Change records<br />You have been warned here it is FME<br />
    13. 13. Data updates: ISC Sask Cadastral dataset<br />Room to improve<br />-automate creation and posting of version<br />-automate QC/QA?<br />-metadata updates and statistics and ArcSDE compression<br />Ultimate Goal<br />-direct access to ISC’s data! <br />-replication?<br />-WFS?<br />Questions so far?<br />
    14. 14. Decision Support: Southern Conservation Land Policy<br />-The goal of the SCLP is to attain lands that contribute to the overall conservation of biodiversity in the province while meeting The Saskatchewan Farm Security Act and The Saskatchewan Farm Security Regulations. <br />-Conservation NGO’s obtain lands that contribute to the SCLP.<br />-The Saskatchewan Ministry of Environment is responsible to evaluate those land holdings and long term conservation plans.<br />
    15. 15. Decision Support: Southern Conservation Land Policy<br />Farmland in Saskatchewan should be considered for conservation purchase or conservation easements if the following guidelines are met:<br />1. Conservation Goal Alignment:<br /><ul><li>The acquisition is part of a long-term plan of a conservation group filed with and approved by Ministry of Environment. </li></ul>2. Stewardship:<br /><ul><li>outlines (among other things) how weeds will be controlled to reduce fire hazards, fence management plans and circumstances under which conservation lands are made available for agricultural uses.</li></ul>3. Lands Evaluation:<br /><ul><li>Land acquisition for conservation use should primarily occur where the land has a low capability for cultivation. An explanation of the need for land with higher capability should be provided.</li></ul>4. Regional Consultation:<br /><ul><li>The plan has been subjected to adequate regional consultation and has accommodated concerns and issues raised in those consultations.</li></ul>5. Compliancy Approval/Rejection<br /><ul><li>Ministry of Environment has reviewed the conservation organizations annual report to determine if the activities are consistent with their long-term plan. </li></li></ul><li>Decision Support: Southern Conservation Land Policy<br />The Full Menu<br />As stated in the Southern Conservation Lands Policy (SCLP) under the heading<br />“Conditions for Purchase of Conservations Lands in Southern Saskatchewan”,<br />subsection (e):<br />“The conservation organization files an annual report with Saskatchewan Environment detailing their land purchases, easements registered, stewardship activities and consultations”<br />And as required by The Saskatchewan Farm Security Regulations, (SFSR, 2006)<br />37/2006, under section 6(1) subsection (c), point (ii):<br />“The conservation group files annual compliance reports with the Minister of the Environment in an approved form”<br /><ul><li>Conservation organizations are required to file annual reports to the government</li></ul> that detail their land holdings for the reporting year.<br />
    16. 16. Decision Support: Southern Conservation Land Policy<br />Condensed soup from the policy documents<br />
    17. 17. Decision Support: Southern Conservation Land Policy<br />What role does FME play?<br />The Ministry processes each conservation organization’s annual land acquisitions to assess the legislative and ecological criteria of the SCLP using ESRI and FME.<br />
    18. 18. Decision Support: Southern Conservation Land Policy<br />Black and white rules in the SCLP<br /><ul><li>100,000 acres (as of 200606)</li></ul>-PANP is just under 1 million acres<br />-Moose Mountain is just over 100,000 acres<br /><ul><li>3% max total land holdings within an RM</li></ul>-Average size for 3% of an RM’s is 15,500 acres<br />-640 acres in a section / 160 per quarter section<br />-97~ quarters = 3~% of an RM<br />
    19. 19. Decision Support: Southern Conservation Land Policy<br />Ecological evaluation<br /><ul><li>Agricultural Capability
    20. 20. Enduring Features Representation
    21. 21. Fragmentation
    22. 22. Percent Native Grasslands
    23. 23. Other exceptions</li></li></ul><li>Decision Support: Southern Conservation Land Policy<br />The workbench’s FME<br />
    24. 24. Questions?<br />Contact:<br />Barry Otterson<br />Saskatchewan Ministry of Environment<br />Barry.Otterson@gov.sk.ca<br />306 953-2230<br />

    ×