Geospatial Metadata Workshop


Published on

Workshop given by Tony Mathys on 26 October in Aberdeen.

Published in: Education
1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Geospatial Metadata Workshop

  1. 1. Geospatial Metadata and Spatial Data Workshop
  2. 2. Workshop Programme <ul><li>PRESENTATION SESSION: </li></ul><ul><li>Background information </li></ul><ul><li>Metadata, standards and application profiles </li></ul><ul><li>UK Academic Geospatial Metadata Application Profile, Version 2 (UK AGMAP 2) and guidelines </li></ul><ul><li>Geodoc Metadata Editor tool, Go-Geo! portal and other resources </li></ul><ul><li>ShareGeo Open spatial data repository </li></ul><ul><li>Look at current and future activities </li></ul><ul><li>REFRESHMENTS (15 - 30 minutes) </li></ul><ul><li>DEMONSTRATION/HANDS-ON SESSION: </li></ul><ul><li>Geodoc Metadata Editor tool, Go-Geo! portal and ShareGeo Open spatial data repository </li></ul>
  3. 3. Background <ul><li>three decades of GIS and spatial </li></ul><ul><li>data capture technology </li></ul><ul><li>an eclectic range of academic </li></ul><ul><li>disciplines using GIS as a </li></ul><ul><li>research and teaching tool </li></ul><ul><li>considerable cost and time </li></ul><ul><li>invested in spatial data creation </li></ul><ul><li>*2006 spatial data audit at </li></ul><ul><li>4 universities: +500 dataset files, </li></ul><ul><li>100s of orphan datasets </li></ul><ul><li>Requires a spatial data management, </li></ul><ul><li>discovery and sharing solution </li></ul><ul><li>delivered through portal technology </li></ul><ul><li>and metadata . </li></ul>
  4. 4. So what is METADATA ? <ul><li>The word appears to be of Greek and Latin origin…… </li></ul>but metadata represents something completely different…… Photographic Images copyright: Jupiter Images 2006
  5. 5. Photographic Images copyright: Jupiter Images 2006 and it’s not sun and holiday
  6. 6. Represents a documented and ordered summary of information that describes something, in this case, a spatial dataset. Provides the What, Where, When and Why of a dataset, Ownership and Contact details and Access and Use conditions. Think of metadata as a recipe for making beer….. What are the ingredients? What are the brewing steps? Who sells the ingredients or W here can you buy them? Purpose of making beer? Metadata (data describing data) Photographic Images copyright: Jupiter Images 2006 An incentive to encourage metadata creation?
  7. 7. <ul><li>Where is the study area </li></ul><ul><li>represented in the data? </li></ul><ul><li>When were the data collected? </li></ul><ul><li>What is the dataset’s purpose?  </li></ul><ul><li>spatial reference system? </li></ul><ul><li>spatial accuracy? </li></ul><ul><li>type of application? </li></ul><ul><li>processes or algorithms used? </li></ul><ul><li>Who supplies the data? </li></ul><ul><li>What do these polygons represent? </li></ul><ul><li>What attribute information is </li></ul><ul><li>associated with these polygons? </li></ul>So why metadata? Can you tell me from these files…..
  8. 8. What do these SOILCLASS values mean? What does this attribute mean?
  9. 9. <ul><li>These questions can </li></ul><ul><li>be answered in one </li></ul><ul><li>metadata record </li></ul>
  10. 10. The relevance of geospatial metadata <ul><li>Useful for local data management </li></ul>Dataset Creator/ User Metadata Record Spatial dataset Directory Spatial Datasets Metadata Directory
  11. 11. <ul><li>Geoportal : an interface to run searches on the internet to locate geographical resources, and to discover, harvest and publish metadata records representing spatial data and geo services. </li></ul><ul><li>A geoportal enables users to search and discover geospatial metadata using </li></ul><ul><ul><li>geographic location (co-ordinates and place name) </li></ul></ul><ul><ul><li>free text </li></ul></ul><ul><ul><li>date </li></ul></ul><ul><ul><li>resource type </li></ul></ul>Geoportal Metadata Record Spatial Datasets and Geo-services Useful to discover spatial data and services via metadata published on a Geoportal
  12. 12. Dataset B (Contours) Dataset A (Raster Map) Dataset C (3D Model) Revealing and sharing spatial data from different sources offers potential for creating new datasets © Crown Copyright/database right 2008 © Crown Copyright/database right 2008 © Crown Copyright/database right 2008
  13. 13. and developing GIS applications
  14. 14. Other benefits: data protection Photographic Images copyright: Jupiter Images 2006
  15. 15. <ul><li>protects investments of time and cost dedicated to </li></ul><ul><li>dataset creation and development; </li></ul><ul><li>maintains an inventory of datasets to reduce time required to </li></ul><ul><li>re-assess existing datasets for new and future applications; </li></ul><ul><li>ensures integrity of existing and new datasets using metadata as a tracking mechanism to monitor changes and edits to datasets; </li></ul><ul><li>reduces and minimises the disruptive effects of staff </li></ul><ul><li>turnover; </li></ul><ul><li>eliminates or reduces the risk of redundancy in dataset collection; </li></ul><ul><li>accidental deletion of dataset files. </li></ul>
  16. 16. <ul><li>Intellectual Property Rights (IPR) </li></ul><ul><li>residual licensed data rights for derived data </li></ul><ul><li>liability fears </li></ul><ul><li>concerns over data quality (data creator and user) </li></ul><ul><li>privacy and security </li></ul><ul><li>time and cost for data delivery </li></ul><ul><li>data transformation and harmonisation (scale, positional accuracy, projections, formats) </li></ul><ul><li>legacy data </li></ul><ul><li>time and cost to anonymise data for release </li></ul><ul><li>time and cost for metadata record updates, especially descriptive level metadata </li></ul><ul><li>performance, maintenance and enhancements of portals and repositories </li></ul><ul><li>data archiving </li></ul><ul><li>data and software warehousing issues </li></ul><ul><li>long-term commitment and investment in the infrastructure </li></ul><ul><li>revisions to standards </li></ul><ul><li>confusion about standards compliance and which standard to use </li></ul>Still issues though!
  17. 17. Metadata standards <ul><li>provide precise specifications; </li></ul><ul><li>enforce and ensure consistency and interoperability; </li></ul><ul><li>define and describe metadata entities and data elements; </li></ul><ul><li>classify and group relevant metadata elements with entities; </li></ul><ul><li>assign structure and conditions (obligations, data type, domain). </li></ul>
  18. 18. Dublin Core (ISO 15836) <ul><li>Dublin Core: 15 elements to facilitate simple resource discovery in a networked environment (e.g. internet or library) </li></ul>Photographic Images copyright: Jupiter Images 2006
  19. 19. Geospatial metadata standards <ul><li>Federal Geographic Data Committee (FGDC) Content Standard for Digital Geospatial Metadata (CSDGM) introduced in mid 1990s for documenting spatial datasets. </li></ul><ul><li>ISO 19115 Metadata Standard for Geographic Information was ratified in 2003 and supersedes FGDC. </li></ul>Geospatial metadata standards are critical for supporting metadata creation and…………………………
  20. 20. Other Content Providers NGDF/GIgateway Network Geo-data Gateway Geoportal portal interoperability and search capabilities across the internet. User Local Go-Geo! database
  21. 21. Centre for Ecology and Hydrology (CEH) National Environment Research Council (NERC) National Soil Resources Institute (NSRI)
  22. 22. Geospatial Metadata Application Profiles <ul><li>ISO 19115 standard has too many elements (300+) </li></ul>
  23. 23. * An application profile is derived from a standard and represents a reduction of the number of entities and elements. * It should include the core element set of a standard to support interoperability across the wider geospatial community ( Discovery level metadata). * Should include elements for Descriptive level metadata? * It can be extended to include elements which are best suited for a working group’s specific applications. Example: The Biological Data Profile (BDP) An approved profile with additional elements to allow for documenting biological information such as taxonomy , m ethodology and analytical tools .
  24. 24. Creating application profiles from ISO 19115 ISO 19115 Metadata Standard Core Element Set Application Profiles Academia ( 43 + 33=76) Public Sector ( 43 + 62=105) Private Sector ( 43 + 12=55) 300+ elements 43 elements Health Geological Sciences Specialised APs * ANZLIC Metadata Profile * North American Application Profile (NAP), Canada and the US ** INSPIRE Directive Metadata Guidelines ** UK GEMINI 2.1 , an INSPIRE compliant geospatial metadata standard for the UK
  25. 25. Infrastructure for Spatial Information in the European Community (INSPIRE) *European Commission (EC) *European Environment Agency (EEA) *Representatives from Member States (Mapping/GIS) INSPIRE Directive Metadata Guidelines
  26. 26. INSPIRE Directive [2007 /2/ EC] <ul><li>T argets electronic spatial data and services for environmental information. </li></ul><ul><li>Aims to create a European Spatial Data Infrastructure (SDI) based on Member States’ infrastructures, to improve interoperability of spatial information. </li></ul><ul><li>These data and services to be delivered through initiatives across Europe. </li></ul><ul><li>INSPIRE Regulations 2009 No 3157 came into force on 31 December 2009 and applies to England, Northern Ireland and Wales. </li></ul><ul><li>Scotland’s Parliament enacted a complementary regulation which came into force on the same date. </li></ul><ul><li>Public authorities will be obliged to produce and keep up to date ‘metadata’ for describing datasets, dataset series and geo services. </li></ul><ul><li>Includes UK academia as it must comply with the Freedom of Information Act, 2000. </li></ul>
  27. 27. <ul><li>• Provide metadata catalogues to reveal what information is available. </li></ul><ul><li>• Provide online data discovery , view , download and transformation (interoperability) services. </li></ul><ul><li>• Licensing arrangements to allow for information sharing, access and use in accordance with state regulations. </li></ul><ul><li>• Set up e-commerce arrangements where charging is applicable. </li></ul><ul><li>• Introduce monitoring mechanisms to show that information is being made available. </li></ul><ul><li>• Introduce co-ordination mechanisms to ensure effective operation of the infrastructure. </li></ul><ul><li>Comply with the 34 data specifications in three annexes </li></ul><ul><li>(reference geographies, environmental datasets). </li></ul>INSPIRE Regulations for member states
  28. 28. INSPIRE spatial data themes and deadlines for creating metadata
  29. 30. INSPIRE Metadata Editor and Geoportal
  30. 31. * First released in 2004 to support creation of ISO 19115 and e-GMS compliant metadata - supersedes the National Geospatial Data Framework ( NGDF) * Targeting the UK public sector * 2010: UK Location Programme (UKLP) revised UK GEMINI 2.1 to meet the requirements of the EU INSPIRE Directive. UK GEMINI UK Location Programme (UKLP) is a pan-government collaborative initiative with the responsibility to develop and implement the INSPIRE Directive 2007/2/EC and the UK Location Strategy.
  31. 32. UK Location Metadata Editor and Catalogue (beta) supports UK GEMINI 2.1
  32. 33. /#/
  33. 34. <ul><li>Geo resources for UK academia </li></ul>
  34. 35. UK Academic Geospatial Metadata Application Profile, Version 2 (UK AGMAP 2) UK AGMAP 2 created to support the specific needs of the UK H&FE academic communities. Comprises elements from ISO 19115, UK GEMINI 2 and INSPIRE. Supports documentation of a dataset, dataset series or geo service for the purpose of discovery and description. Mapped to Dublin Core, FGDC, INSPIRE, UK GEMINI 2 and DDI.
  35. 36. UK AGMAP 2 profile for datasets and dataset series Contact details = 7 Drop down lists = 10 Red = Mandatory Green = Conditional 32 mandatory 91 elements
  36. 37. UK AGMAP 2 profile for Geo-services Contact details = 7 Drop down lists = 6 Red = Mandatory Green = Conditional 25 mandatory 40 elements
  37. 38. UK AGMAP 2 Guidelines Contain descriptions and examples to assist metadata creators and Go-Geo! portal users from numerous, eclectic academic disciplines.
  38. 39. Most spatial data information is stored in our heads. We need to move it from there to electronic files. Metadata Creation Photographic Images copyright: Jupiter Images 2006
  39. 40. Mind reading aliens? Solutions? Spatial data extraction device?
  40. 41. Geodoc Metadata Editor Tool
  41. 42. Geodoc design and functionality <ul><li>Java-built online tool </li></ul><ul><li>authentication required </li></ul><ul><li>text fields and drop-down lists for entering information </li></ul><ul><li>validation (red fields) </li></ul><ul><li>access to metadata guidelines </li></ul><ul><li>and Geodoc reference guide. </li></ul>
  42. 43. <ul><li>MyGo-Geo! automation </li></ul><ul><li>and customisation tool </li></ul>
  43. 44. Geodoc coordinate extent tool Map tool captures co-ordinate values for bounding box elements used to define the extent of a dataset’s study area. Extents for Nations at the click of the mouse
  44. 45. Direct links at click of button to metadata guidelines ‘Help’ pages
  45. 46. Personal and secure directory for storing, editing and exporting metadata records.
  46. 47. <ul><li>e X tensible M arkup L anguage ( XML ) is used for marking up </li></ul><ul><li>documents and data using tags that define structural elements. </li></ul><ul><li>A standard way to describe and share data on the web. </li></ul>
  47. 48. Geodoc exports UK AGMAP 2 Metadata records in user-friendly *.pdf format
  48. 49. Publication on open or private (institutional) node
  49. 50. 1,2) create and validate record; 3) submit record for review; 4,5) Metadata creator is contacted and record subsequently published on the Go-Geo! portal 1 2 3 5 A few easy steps to publication of a metadata record using Geodoc 4 Photographic Images copyright: Jupiter Images 2006
  50. 51. A simple interface designed for UK academia to run queries to discover metadata for spatial datasets. The portal enables searching by the use of various options including -free text -date -resource type -geographic location Go-Geo! Portal
  51. 52. Go-Geo! simple search Place name search using Unlock middleware gazetteer
  52. 53. Search results page and extents display
  53. 54. Metadata record published on Go-Geo!
  54. 55. Links between Go-Geo! portal elements to UK AGMAP 2 guidelines
  55. 56. Advanced search - Data Type - Location - Text - Date Range *BGS JIDI Photo Collection *COPAC
  56. 57. Access to metadata records published on institutional (private) node
  57. 58. Why publish metadata on the Go-Geo! portal? <ul><li>a repository for you to store and manage your metadata thus savings in cost and time; </li></ul><ul><li>use metadata to announce your data and applications; </li></ul><ul><li>advertise (and sell?) your spatial datasets to other interested parties in academia and in the private and public sectors; </li></ul><ul><li>metadata in the portal can be referenced and cited for project proposals; </li></ul><ul><li>could be configured as an internal resource to access and share datasets. </li></ul>
  58. 59. Web resource channels almost 3,000 resources
  59. 60. Bookmark resources (MyGo-Geo!)
  60. 61. Other geospatial metadata resources
  61. 62. Geospatial Metadata Workshops <ul><li>July 2007 </li></ul><ul><ul><li>Aberdeen University </li></ul></ul><ul><ul><li>Marine/ECO-IMAGINE </li></ul></ul><ul><ul><li>Geospatial </li></ul></ul><ul><ul><li>Technologies Course </li></ul></ul><ul><li>2008 </li></ul><ul><ul><li>Sheffield University </li></ul></ul><ul><ul><li>Southampton University </li></ul></ul><ul><ul><li>May 2010 </li></ul></ul><ul><ul><li>Plymouth University </li></ul></ul><ul><li>2003 </li></ul><ul><ul><li>Durham University </li></ul></ul><ul><ul><li>City University </li></ul></ul><ul><li>2004 </li></ul><ul><ul><li>University of Essex </li></ul></ul><ul><li>York University </li></ul><ul><ul><li>Strathclyde University </li></ul></ul><ul><li>Bradford University Oxford Brookes University </li></ul><ul><li>Coventry University </li></ul><ul><ul><li>Edinburgh University </li></ul></ul><ul><ul><li>Oxford University </li></ul></ul><ul><li>Kingston University </li></ul><ul><ul><li>Sheffield University </li></ul></ul><ul><li>2006 </li></ul><ul><ul><li>Aberdeen University </li></ul></ul><ul><ul><li>Leeds University </li></ul></ul><ul><ul><li>Cambridge University </li></ul></ul><ul><ul><li>Oxford University </li></ul></ul><ul><ul><li>Stirling University </li></ul></ul><ul><ul><li>Glasgow University </li></ul></ul><ul><ul><li>Heriot-Watt University </li></ul></ul><ul><ul><li>Strathclyde University </li></ul></ul><ul><ul><li>Kingston University </li></ul></ul><ul><ul><li>GISRUK Conference (Nottingham) </li></ul></ul><ul><ul><li>Edinburgh University </li></ul></ul><ul><li>Autumn 2010 </li></ul><ul><li>Cardiff University </li></ul><ul><li>Aberdeen University </li></ul><ul><ul><li>Lancaster University </li></ul></ul><ul><ul><li>Glasgow University </li></ul></ul><ul><ul><li>Leeds University </li></ul></ul>Civil Engineering Biological Sciences Planning Environmental Sciences Architecture Information Technology Retailing Climate Sociology Library Science Landscape Planning Archaeology Mathematics Health Ecology Geosciences Computing
  62. 63. ShareGeo Open <ul><li>Key to delivering a Spatial Data Infrastructure (SDI) for the UK </li></ul><ul><li>academic GI community. </li></ul><ul><li>A repository for deposit and extraction of spatial data. </li></ul><ul><li>Support access to and sharing of spatial data. </li></ul><ul><li>Holds national and international spatial datasets </li></ul><ul><li>(raster, vector and tabular). </li></ul><ul><li>ArcGIS plugin to create metadata to deposit with data. </li></ul>
  63. 64. Spatial dataset extraction
  64. 66. Spatial data submission: simple metadata record form to complete; extents extracted from dataset
  65. 67. Ordnance Survey (OS OpenData)
  66. 68. ShareGeo (closed) Addresses issues surrounding IPR and spatial data derived from licensed data.
  67. 69. Current and future activities
  68. 70. Rebuild Go-Geo! portal with GeoNetwork GeoNetwork: A standards based, free and open source catalogue application to manage spatially referenced resources through the web. Provides powerful metadata editing and search functions as well as an embedded interactive web map viewer.
  69. 71. Offer Go-Geo! resources for local spatial data management -UK AGMAP 2 -Guidelines -Geodoc metadata tool -Go-Geo! portal nodes -Workshops -eLearning objects Geography Archaeology Geological Sciences Biological Sciences Research
  70. 72. Go-Geo! University A Go-Geo! University B Go-Geo! University C Go-Geo! Open Spatial Data Infrastructure (SDI) for UK academia Other resources and portals Spatial Data Repository Spatial data Metadata Search Data user Metadata UK AGMAP 2 Guidelines Geodoc tadata tool Customised Go-Geo! Portal Nodes Training Geography Archaeology Geological Sciences Biological Sciences Go-Geo! Go-Go! UK AGMAP 2 Guidelines Geodoc metadata tool Customised Go-Geo! Portal Nodes Training Geography Archaeology Geological Sciences Biological Sciences Go-Geo! Go-Go! UK AGMAP 2 Guidelines Geodoc metadata tool Customised Go-Geo! Portal Nodes Training Geography Archaeology Geological Sciences Biological Sciences Go-Geo! Go-Go! UK AGMAP 2 Guidelines Geodoc metadata tool Customised Go-Geo! Portal Nodes Training Geography Archaeology Geological Sciences Biological Sciences Go-Geo! Go-Go! University D
  71. 73. Discover Locate Access Use Publish Fit for purpose? Preserve Steps to data immortality
  72. 74. <ul><li>Encourage and promote more metadata creation and publication. </li></ul><ul><li>*Cambridge, Edinburgh, Kingston, Leeds, Sheffield and Southampton have created and published more than +200 metadata records on Go-Geo! portal (global and private). </li></ul><ul><li>Engage with UK academic institutions to identify INSPIRE data. </li></ul>The way forward…..
  73. 75. Questions?