Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Oxford University Geospatial Metadata Workshop 20110415

  • Be the first to comment

  • Be the first to like this

Oxford University Geospatial Metadata Workshop 20110415

  1. 1. Geospatial Metadata and Spatial Data Workshop University of Oxford
  2. 2. Workshop Programme <ul><li>PRESENTATION SESSION: </li></ul><ul><li>Background information </li></ul><ul><li>Metadata, standards and application profiles </li></ul><ul><li>REFRESHMENTS (15 - 30 minutes) </li></ul><ul><li>UK Academic Geospatial Metadata Application Profile, Version 2.1 (UK AGMAP 2.1) and guidelines </li></ul><ul><li>Geodoc Metadata Editor tool, Go-Geo! portal and other resources </li></ul><ul><li>ShareGeo Open spatial data repository </li></ul><ul><li>Look at current and future activities </li></ul><ul><li>DEMONSTRATION/HANDS-ON SESSION: </li></ul><ul><li>Geodoc Metadata Editor tool, Go-Geo! portal and ShareGeo Open spatial data repository </li></ul>
  3. 3. Background <ul><li>three decades of GIS and spatial </li></ul><ul><li>data capture technology </li></ul><ul><li>an eclectic range of academic </li></ul><ul><li>disciplines using GIS as a </li></ul><ul><li>research and teaching tool </li></ul><ul><li>considerable cost and time </li></ul><ul><li>invested in spatial data creation </li></ul><ul><li>*2006 spatial data audit at </li></ul><ul><li>4 universities: +500 dataset files, </li></ul><ul><li>100s of orphan datasets </li></ul><ul><li>Requires a spatial data management, </li></ul><ul><li>discovery and sharing solution </li></ul><ul><li>delivered through portal technology </li></ul><ul><li>and metadata . </li></ul>
  4. 4. So what is METADATA ? <ul><li>The word appears to be of Greek and Latin origin…… </li></ul>but metadata represents something completely different…… Photographic Images copyright: Jupiter Images 2006
  5. 5. Photographic Images copyright: Jupiter Images 2006 and it’s not sun and holiday
  6. 6. Represents a documented and ordered summary of information that describes something, in this case, spatial data. Provides the What, Where, When and Why for a spatial dataset. Includes its Ownership and Contact (Who) details and Access and Use conditions. Metadata (data describing data)
  7. 7. What are the ingredients? Where were ingredients produced? Who sells the ingredients? What are the brewing steps? When does the fermentation process end? Photographic Images copyright: Jupiter Images 2006 Think of metadata as a recipe for making beer.
  8. 8. metadata
  9. 9. Think of metadata as food product labelling. What are the ingredients? What is the nutritional value? How many calories and how much fat? When is this product’s expiry date? Where was it produced? Who produced it?
  10. 10. metadata
  11. 11. <ul><li>Where is the dataset’s study area? </li></ul><ul><li>When were the data collected? </li></ul><ul><li>Why was this dataset created?  </li></ul><ul><li>type of application? </li></ul><ul><li>spatial reference system? </li></ul><ul><li>spatial accuracy? </li></ul><ul><li>processes or algorithms used? </li></ul><ul><li>Who created the dataset? </li></ul>Can you tell me from any of these files….. Now think of metadata as spatial data labelling.
  12. 12. What do these polygons represent? What attribute information is associated with these polygons?
  13. 13. What do these SOILCLASS values mean? What does this attribute mean?
  14. 14. metadata
  15. 15. The importance of geospatial metadata <ul><li>Local Data Management </li></ul>Metadata Record Spatial Dataset Directory or Repository Spatial Datasets Metadata Directory
  16. 16. <ul><li>Geoportal : an interface to run searches on the internet and local catalogues to locate geographical resources, and to discover metadata records representing spatial data and geo services. </li></ul>Geoportal Metadata Record Spatial Datasets and Geo-services Spatial Data Discovery via a Geoportal
  17. 17. A geoportal enables users to search and discover spatial data via metadata using free text , resource type , geographic location (co-ordinate and placename) and date .
  18. 18. Discovering spatial data through metadata offers the prospect of developing new applications
  19. 19. Contours Raster Map Draped 3D Model and creating new datasets © Crown Copyright/database right 2008 © Crown Copyright/database right 2008 © Crown Copyright/database right 2008
  20. 20. Other benefits: data protection Photographic Images copyright: Jupiter Images 2006
  21. 21. <ul><li>protects investments of time and cost dedicated to </li></ul><ul><li>dataset creation and development; </li></ul><ul><li>maintains an inventory of datasets to reduce time required to </li></ul><ul><li>re-assess existing datasets for new and future applications; </li></ul><ul><li>ensures integrity of existing and new datasets using metadata as a tracking mechanism to monitor changes and edits to datasets; </li></ul><ul><li>reduces and minimises the disruptive effects of staff </li></ul><ul><li>turnover; </li></ul><ul><li>eliminates or reduces the risk of redundancy in dataset collection; </li></ul><ul><li>saves against accidental deletion of dataset files. </li></ul>Metadata creation
  22. 22. <ul><li>Intellectual Property Rights (IPR) </li></ul><ul><li>residual licensed data rights for derived data </li></ul><ul><li>concerns over data quality (data creator and user) </li></ul><ul><li>liability fears </li></ul><ul><li>privacy and security </li></ul><ul><li>time and cost for data delivery </li></ul><ul><li>data transformation and harmonisation (scale, positional accuracy projections, formats) </li></ul><ul><li>legacy data </li></ul><ul><li>time and cost to anonymise data for release </li></ul><ul><li>time and cost for metadata record (descriptive level) updates </li></ul><ul><li>portal and repository performance, maintenance and enhancement costs </li></ul><ul><li>data archiving </li></ul><ul><li>data and software warehousing issues </li></ul><ul><li>long-term commitment and investment in the infrastructure </li></ul><ul><li>revisions to changes in standards </li></ul><ul><li>confusion about standards compliance and which standard to use </li></ul>Many concerns remain (metadata and data)
  23. 23. Metadata standards <ul><li>provide precise specifications; </li></ul><ul><li>enforce and ensure consistency and interoperability; </li></ul><ul><li>define and describe metadata entities and data elements; </li></ul><ul><li>classify and group relevant metadata elements with entities; </li></ul><ul><li>assign structure and conditions (obligations, data type, domain). </li></ul>
  24. 24. Dublin Core (ISO 15836) <ul><li>Dublin Core: 15 elements to facilitate simple resource discovery in a networked environment (e.g. internet or library) </li></ul>Photographic Images copyright: Jupiter Images 2006
  25. 25. Geospatial metadata standards <ul><li>Federal Geographic Data Committee (FGDC) Content Standard for Digital Geospatial Metadata (CSDGM) introduced in mid 1990s for documenting spatial datasets. </li></ul><ul><li>ISO 19115 Metadata Standard for Geographic Information was ratified in 2003 and supersedes FGDC. </li></ul>Geospatial metadata standards are critical for supporting metadata creation and…………………………
  26. 26. Other Content Providers UK Location Programme Network Geo-data Gateway Geoportal portal interoperability and search capabilities across the internet. User Local Go-Geo! database
  27. 27. Centre for Ecology and Hydrology (CEH) National Environment Research Council (NERC) National Soil Resources Institute (NSRI)
  28. 28. Geospatial Metadata Application Profiles <ul><li>ISO 19115 standard has too many elements (300+) </li></ul>
  29. 29. * An application profile is derived from a standard and represents a reduction of the number of entities and elements. * It should include the core element set of a standard to support interoperability across the wider geospatial community ( Discovery level metadata). * Perhaps include elements for Descriptive level metadata? * A profile can be extended to include elements which are best suited for a working group’s specific applications. Example: The Biological Data Profile (BDP) An approved profile with additional elements to document biological information such as taxonomy , methodology and analytical tools .
  30. 30. Creating application profiles from ISO 19115 ISO 19115 Metadata Standard ISO 19115 Core Element Set Application Profiles Academia ( 43 + 47=90) Public Sector ( 43 + 62=105) Private Sector ( 43 + 12=55) 300+ elements 43 elements Environmental Sciences Specialised APs * INSPIRE Directive Metadata Guidelines * UK GEMINI 2.1 , an INSPIRE compliant geospatial metadata standard for the UK * ANZLIC Metadata Profile * North American Application Profile (NAP), Canada and the US Archaeology Biological Sciences Geo Sciences History Health Informatics
  31. 31. Infrastructure for Spatial Information in the European Community (INSPIRE) *European Commission (EC) *European Environment Agency (EEA) *Representatives from Member States (Mapping/GIS) INSPIRE Directive Metadata Guidelines
  32. 32. INSPIRE Directive [2007 /2/ EC] <ul><li>T argets electronic spatial data and services for environmental information. </li></ul><ul><li>Aims to create a European Spatial Data Infrastructure (SDI) based on Member States’ infrastructures, to improve interoperability of spatial information. </li></ul><ul><li>These data and services to be delivered through initiatives across Europe. </li></ul><ul><li>INSPIRE Regulations 2009 No 3157 came into force on 31 December 2009 and applies to England, Northern Ireland and Wales. </li></ul><ul><li>Scotland’s Parliament enacted a complementary regulation which came into force on the same date. </li></ul><ul><li>Public authorities will be obliged to produce and keep up to date ‘metadata’ for describing datasets, dataset series and geo services. </li></ul><ul><li>Includes UK academia as it must comply with the Freedom of Information Act, 2000. </li></ul>
  33. 33. <ul><li>• Provide metadata catalogues to reveal what information is available. </li></ul><ul><li>• Provide online data discovery , view , download and transformation (interoperability) services. </li></ul><ul><li>• Licensing arrangements to allow for information sharing, access and use in accordance with state regulations. </li></ul><ul><li>• Set up e-commerce arrangements where charging is applicable. </li></ul><ul><li>• Introduce monitoring mechanisms to show that information is being made available. </li></ul><ul><li>• Introduce co-ordination mechanisms to ensure effective operation of the infrastructure. </li></ul><ul><li>Comply with the 34 spatial data specifications in three annexes </li></ul><ul><li>(reference geographies, environmental datasets). </li></ul>INSPIRE Regulations for member states
  34. 34. INSPIRE spatial data themes and deadlines for creating metadata
  35. 36. INSPIRE Metadata Editor tool and Geoportal
  36. 37. * First released in 2004 to support creation of ISO 19115 and e-GMS compliant metadata - supersedes the National Geospatial Data Framework ( NGDF) * Targeting the UK public sector * 2010: UK Location Programme (UKLP) revised UK GEMINI 2.1 to meet the requirements of the EU INSPIRE Directive. UK GEMINI UK Location Programme (UKLP) is a pan-government collaborative initiative with the responsibility to develop and implement the INSPIRE Directive 2007/2/EC and the UK Location Strategy.
  37. 38. UK Location Metadata Editor and Catalogue conform to UK GEMINI 2.1
  38. 39. /#/
  39. 40. <ul><li>Metadata and spatial data resources for </li></ul><ul><li>UK academia </li></ul>
  40. 41. UK Academic Geospatial Metadata Application Profile, Version 2.1 (UK AGMAP 2.1) UK AGMAP 2.1 created to support the specific needs of the UK H&FE communities. Comprises elements from ISO 19115, UK GEMINI 2.1 and INSPIRE. Supports documentation of a dataset, dataset series or geo service for the purpose of discovery and description. Mapped to Dublin Core, FGDC, INSPIRE, UK GEMINI 2.1 and DDI.
  41. 42. UK AGMAP 2.1 profile for datasets and dataset series Contact details = 7 Drop down lists = 9 Red : Mandatory Green : Conditional 29 mandatory 90 elements
  42. 43. UK AGMAP 2.1 profile for Geo-services Contact details: 7 Drop down lists: 6 Red : Mandatory Green : Conditional 22 mandatory 39 elements
  43. 44. UK AGMAP 2.1 Guidelines Contain descriptions and examples to assist metadata creators and Go-Geo! portal users from eclectic range of academic disciplines.
  44. 45. Most spatial data information is stored in our heads. We need to move it from there to electronic files. Metadata Creation Photographic Images copyright: Jupiter Images 2006
  45. 46. Mind reading aliens? Solutions?
  46. 47. Spatial data extraction device?
  47. 48. Geodoc Metadata Editor Tool
  48. 49. Geodoc design and functionality <ul><li>Java-built online tool </li></ul><ul><li>authentication required </li></ul><ul><li>text fields and drop-down lists for entering information </li></ul><ul><li>validation (red fields) </li></ul><ul><li>access to metadata guidelines </li></ul><ul><li>and Geodoc reference guide. </li></ul>
  49. 50. Direct links at click of button to metadata guidelines ‘Help’ pages
  50. 51. <ul><li>MyGoGeo! automation </li></ul><ul><li>and customisation tool </li></ul>
  51. 52. Geodoc coordinate extent tool Map tool captures co-ordinate values for bounding box elements used to define the extent of a dataset’s study area. Extents for Nations at the click of the mouse
  52. 53. Personal and secure directory for storing, editing and exporting metadata records.
  53. 54. <ul><li>e X tensible M arkup L anguage ( XML ) is used for marking up </li></ul><ul><li>documents and data using tags that define structural elements. </li></ul><ul><li>A standard way to describe and share data on the web. </li></ul>
  54. 55. Geodoc exports UK AGMAP 2.1 metadata records in PDF format
  55. 56. Publication on open or private (institutional) nodes
  56. 57. 1) create and validate record; 2) submit record for review; 3) metadata creator is contacted; and 4) record is published on the Go-Geo! portal. 1 2 3 A few easy steps to publication of a geospatial metadata record 4 Photographic Images copyright: Jupiter Images 2006
  57. 58. A simple interface designed for UK academia to run queries to discover metadata for spatial datasets. The portal enables searching by the use of various options including -free text -date -resource type -geographic location Go-Geo! Portal
  58. 59. Go-Geo! simple search Placename search using Unlock middleware gazetteer
  59. 60. Search results page and extents display
  60. 61. Metadata record published on Go-Geo!
  61. 62. Links between Go-Geo! portal elements to UK AGMAP 2.1 guidelines
  62. 63. Advanced search - Data Type - Location - Text - Date Range *BGS JIDI Photo Collection *COPAC
  63. 64. Access to metadata records published on institutional (private) node
  64. 65. Why publish metadata on the Go-Geo! portal? <ul><li>a repository for you to store and manage your metadata thus savings in cost and time; </li></ul><ul><li>use metadata to announce your data and applications; </li></ul><ul><li>advertise (and sell?) your spatial datasets to other interested parties in academia and in the private and public sectors; </li></ul><ul><li>metadata in the portal can be referenced and cited for project proposals; </li></ul><ul><li>could be configured as an internal resource to access and share datasets. </li></ul><ul><li>* Cambridge, Edinburgh, Kingston, Leeds, Leicester, Sheffield </li></ul><ul><li>and Southampton universities have created and published </li></ul><ul><li>+200 metadata records on Go-Geo! portal (global and private). </li></ul>
  65. 66. Geo resource channels over 3,000 resources and daily updates
  66. 67. MyGoGeo!: bookmark resources
  67. 68. Other geospatial metadata resources
  68. 69. Geospatial Metadata Workshops <ul><li>July 2007 </li></ul><ul><ul><li>Aberdeen University </li></ul></ul><ul><ul><li>Marine/ECO-IMAGINE </li></ul></ul><ul><ul><li>Geospatial </li></ul></ul><ul><ul><li>Technologies Course </li></ul></ul><ul><li>2008 </li></ul><ul><ul><li>Sheffield University </li></ul></ul><ul><ul><li>Southampton University </li></ul></ul><ul><ul><li>May 2010 </li></ul></ul><ul><ul><li>Plymouth University </li></ul></ul><ul><li>2003 </li></ul><ul><ul><li>Durham University </li></ul></ul><ul><ul><li>City University </li></ul></ul><ul><li>2004 </li></ul><ul><ul><li>University of Essex </li></ul></ul><ul><li>York University </li></ul><ul><ul><li>Strathclyde University </li></ul></ul><ul><li>Bradford University Oxford Brookes University </li></ul><ul><li>Coventry University </li></ul><ul><ul><li>Edinburgh University </li></ul></ul><ul><ul><li>Oxford University </li></ul></ul><ul><li>Kingston University </li></ul><ul><ul><li>Sheffield University </li></ul></ul><ul><li>2006 </li></ul><ul><ul><li>Aberdeen University </li></ul></ul><ul><ul><li>Leeds University </li></ul></ul><ul><ul><li>Cambridge University </li></ul></ul><ul><ul><li>Oxford University </li></ul></ul><ul><ul><li>Stirling University </li></ul></ul><ul><ul><li>Glasgow University </li></ul></ul><ul><ul><li>Heriot-Watt University </li></ul></ul><ul><ul><li>Strathclyde University </li></ul></ul><ul><ul><li>Kingston University </li></ul></ul><ul><ul><li>GISRUK Conference (Nottingham) </li></ul></ul><ul><ul><li>Edinburgh University </li></ul></ul><ul><li>Autumn 2010 </li></ul><ul><li>Cardiff University </li></ul><ul><li>Aberdeen University </li></ul><ul><ul><li>Lancaster University </li></ul></ul><ul><ul><li>Glasgow University </li></ul></ul>Civil Engineering Biological Sciences Planning Environmental Sciences Architecture Information Technology Retailing Climate Sociology Library Science Landscape Planning Archaeology Mathematics Health Ecology Geosciences Computing <ul><li>Spring 2011 </li></ul><ul><li>Oxford University </li></ul><ul><li>Northumbria University </li></ul><ul><li>Stirling University </li></ul><ul><li>Strathclyde University </li></ul><ul><ul><li>Leeds University </li></ul></ul><ul><ul><li>Cambridge University </li></ul></ul>
  69. 70. ShareGeo Open <ul><li>Key to delivering a Spatial Data Infrastructure (SDI) for the UK </li></ul><ul><li>academic GI community. </li></ul><ul><li>A repository for deposit and extraction of spatial data. </li></ul><ul><li>Supports access to and sharing of spatial data. </li></ul><ul><li>Holds national and international spatial datasets </li></ul><ul><li>(raster, vector and tabular). </li></ul><ul><li>ArcGIS plugin to create metadata to deposit with data. </li></ul>
  70. 71. Spatial dataset extraction
  71. 73. Spatial data submission: simple metadata record form to complete with extents extracted from dataset
  72. 74. Ordnance Survey (OS OpenData)
  73. 75. ShareGeo Digimap Addresses issues pertaining to spatial data derived from licensed data.
  74. 76. Current and future activities
  75. 77. Rebuild Go-Geo! portal with GeoNetwork GeoNetwork: A standards based, free and open source catalogue application to manage spatially referenced resources through the web. Provides metadata editing and search functions as well as an embedded interactive web map viewer.
  76. 78. Offer Go-Geo! resources for local spatial data management -UK AGMAP 2.1 -Guidelines -Geodoc metadata tool -Go-Geo! portal nodes -Workshops -eLearning objects Geography Archaeology Geological Sciences Biological Sciences Research
  77. 79. Go-Geo! University A Go-Geo! University B Go-Geo! University C Go-Geo! Open Spatial Data Infrastructure (SDI) for UK academia Other resources and portals Spatial Data Repository Spatial data Metadata Search Data user Metadata UK AGMAP 2 Guidelines Geodoc tadata tool Customised Go-Geo! Portal Nodes Training Geography Archaeology Geological Sciences Biological Sciences Go-Geo! Go-Go! UK AGMAP 2 Guidelines Geodoc metadata tool Customised Go-Geo! Portal Nodes Training Geography Archaeology Geological Sciences Biological Sciences Go-Geo! Go-Go! UK AGMAP 2 Guidelines Geodoc metadata tool Customised Go-Geo! Portal Nodes Training Geography Archaeology Geological Sciences Biological Sciences Go-Geo! Go-Go! UK AGMAP 2 Guidelines Geodoc metadata tool Customised Go-Geo! Portal Nodes Training Geography Archaeology Geological Sciences Biological Sciences Go-Geo! Go-Go! University D
  78. 80. Discover Locate Access Use Publish Fit for purpose? Preserve Steps to data immortality
  79. 81. Questions?
  80. 82. Using the Geodoc Metadata Editor Tool to create a valid geospatial metadata record Practical 1
  81. 83. <ul><li>Access MyGoGeo! to enter contact details. </li></ul><ul><li>Read description of CORONA satellite image dataset. </li></ul><ul><li>Access Geodoc Metadata Editor tool and open reference documents on home page. </li></ul><ul><li>Create and save a valid metadata record referencing the information provided for the CORONA satellite image dataset. </li></ul><ul><li>Export the metadata record into UK AGMAP 2.1 format using XML and PDF output. </li></ul><ul><li>Publish metadata record. </li></ul>
  82. 84. <ul><li>Using the Go-Geo portal to access a </li></ul><ul><li>ShareGeo Open spatial dataset </li></ul>Practical 2
  83. 85. <ul><li>Conduct a search using the Go-Geo! portal. </li></ul><ul><li>Open and read the metadata record. </li></ul><ul><li>Access the ShareGeo Open spatial dataset via link provided in metadata record. </li></ul>