Mobile cultural heritage guide: location-aware semantic search (EKAW2010)
Upcoming SlideShare
Loading in...5
×

Like this? Share it with your network

Share

Mobile cultural heritage guide: location-aware semantic search (EKAW2010)

  • 1,488 views
Uploaded on

In this paper we explore the use of location aware mobile devices for ...

In this paper we explore the use of location aware mobile devices for
searching and browsing a large number of general and cultural
heritage information repositories. Based on
GPS positioning we can determine a user's location and context, composed of physical
nearby locations, historic events that have taken place there, artworks
that were created at or inspired by those locations and artists that have
lived or worked there. Based on a geolocation, the user has three levels of refinement: pointing to a specific heading and selection and facets and subfacets of cultural heritage objects. In
our approach two types of knowledge are combined: general knowledge
about geolocations and points of interest and specialized knowledge about
a particular domain, i.e. cultural heritage. We use a number of
Linked Open Data sources and a
number of general sources from the cultural heritage domain (including Art and Architecture Thesaurus, Union List of Artist Names) as well as data from several Dutch cultural institutions. We show three concrete
scenarios where a tourist accesses localized information on his
iPhone about the current environment, events, artworks or persons, which are enriched by Linked Open Data sources.
We show that Linked Open Data sources in isolation are currently too limited to
provide interesting semantic information but combined with each other
and with a number of other sources a really informative location-based
service can be created.

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
1,488
On Slideshare
1,488
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
27
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • Ongoing
  • in depot Trefwoordendrinkglas, roemer, kelkglas, heiplan toren Nieuwe Kerk, steenlegging, Nieuwe Kerk, Willem Backer, Cornelis Backer, Stichting Projecten De Nieuwe Kerk AmsterdamglascollectieOp de kelk is in diamantgravering het heiplan voor de nooit voltooide toren van de Nieuwe Kerk aangebracht.Zie ookPB 22 / Nieuwe Kerk, eerste steenlegging van de toren van de
  • in depot Trefwoordendrinkglas, roemer, kelkglas, heiplan toren Nieuwe Kerk, steenlegging, Nieuwe Kerk, Willem Backer, Cornelis Backer, Stichting Projecten De Nieuwe Kerk AmsterdamglascollectieOp de kelk is in diamantgravering het heiplan voor de nooit voltooide toren van de Nieuwe Kerk aangebracht.Zie ookPB 22 / Nieuwe Kerk, eerste steenlegging van de toren van de
  • The user’s context
  • h = [0..359]

Transcript

  • 1. Mobile cultural heritage guide location-aware semantic search
    • Chris van Aart (1) , Bob Wielinga (1,2) , Willem Robert van Hage (1)
    • (1) VU University Amsterdam, the Netherlands (2) Universiteit van Amsterdam, the Netherlands
    • [email_address]
    • October 2010
  • 2. Data: http://bit.ly/ekaw2010 Simulator: http://bit.ly/i-ams iOS: http://bit.ly/lodapp
  • 3. Recovering of tourism market in Amsterdam not fast enough
  • 4.  
  • 5.  
  • 6.  
  • 7.  
  • 8.  
  • 9.  
  • 10.  
  • 11.  
  • 12.  
  • 13.  
  • 14.  
  • 15.  
  • 16. (Digital) Cultural heritage
    • Museums
    • (old)buildings (monuments)
    • Statues
    • Art-works
    • Historic events
  • 17.  
  • 18.  
  • 19.  
  • 20.  
  • 21. <title>De Prinsengracht bij de Reesluis, 1663 - 1664</title> <keywords>schilderij, stadsgezicht, stadsgezicht Amsterdam, Prinsengracht, Reesluis, scheepvaart</keywords>
  • 22. <title>Roemer EERSTE STEENLEGGING NIEUWE KERK, 1647</title> <keywords>drinkglas, roemer, kelkglas, heiplan toren Nieuwe Kerk, steenlegging, Nieuwe Kerk, Willem Backer, Cornelis Backer, Stichting Projecten De Nieuwe Kerk Amsterdam Glascollectie</keywords> <description>Op de kelk is in diamantgravering het heiplan voor de nooit voltooide toren van de Nieuwe Kerk aangebracht.<description>
  • 23. <title>Anatomische les van Prof. Frederik Ruysch, 1670</title> <keywords>schilderij, portret, groepsportret, anatomische les, ambachten en beroepen, onderwijs, Chirurgijnsgilde, Leendert Fruyt, Aert van Swieten, Frederik Ruysch, Gillis Hondekoeter, Rogier de Coen, Joris van Loon Tilanus, Jacob Brandt</keywords> <description> Frederik Ruysch (1638-1731) was de opvolger van Jan Deijman als praelector van het chirurgijnsgilde.De jonge doctor demonstreert de ligging van de lymfevaten in de lies. De nadruk ligt nu niet op de levenloze staat van de dode, zoals bij Rembrandt. Het lichaam op de snijtafel lijkt eerder toe te behoren aan iemand die slaapt. Waarschijnlijk wilde Ruysch hiermee zijn specialiteit verbeelden: dankzij zijn preparatietechnieken leek het alsof de doden nog leefden. Het schilderij is na restauratie voor het eerst sinds lange tijd weer te zien. </description>
  • 24. <title>De brand in het oude stadhuis (1652)</title> <keywords>prent, stadsgezicht, brand van het oude stadhuis op de Dam, Dam</keywords>
  • 25. http://bit.ly/eculture
  • 26. Cultural heritage data cloud http://e-culture.multimedian.nl/resources/datacloud/
  • 27. http://dbpedia.org/resource/Amsterdam
  • 28.  
  • 29. Location awareness / LBS
    • Real time locating and positioning
    • Sun/Stars, Compass, Postal code, WGS84 (GPS)…
    • communication, networks, traffic, logistics, security, search & rescue, business administration, leisure,…
  • 30. DBPedia mobile: Google maps “ Louvre app”
  • 31. Research question
    • “ How to find cultural heritage POIs at a particular location, given the constraints of a mobile device, using current Semantic Web data and technology?”
  • 32. Challenges
      • enrich location data by constructing an ``enriched local map'' of nearby Points of Interest
      • Enrich POIs with additional information, such as e.g. events, persons and artworks.
      • present the results in a manageable way on a mobile device
  • 33.  
  • 34. Approach
    • Combine:
      • general knowledge about geolocations and points of interest:
        • GeoNames, LinkedGeodata, Freebase and DBPedia
      • specialized knowledge about the cultural heritage domain
        • Art and Architecture Thesaurus,
        • Union List of Artist Names,
        • Netherlands Institute for Art History
        • Rijksmuseum Amsterdam.
  • 35.
    • The “Active” tourist:
    • What do I see?
    • Next stop?
    • Hot spots?
    • History?
    • Stories?
    • Events?
    • Persons?
    • Descriptions?
    • Maps?
  • 36. From Geolocation to Real-world Annotation Task structure
  • 37. 1
  • 38. Harvest Locations
    • Iphone GPS
      • Latitude = 52.368611
      • Longitude = 4.88944
      • (we ignore heading)
    • ==> select those geo data that are relevant to this point
      • Searching dbpedia, linkedgeodata, geonames for locations and objects within a certain distance.
      • Crawling via various relations (owl:sameAs, nearby etc) we gather a collection of RDF resources related to our location.
      • Using a Prolog spatial indexing package (space) we can compute distances and directions from our current location.
  • 39. 2
  • 40. Merging geo info
    • Non trivial:
      • Different schemas
      • Different labeling conventions
      • Different (GPS) data
        • Spui in Amsterdam has at least 5 coordinates in LOD
        • There is also an Spui in The Hague
      • Errors in human annotations
      • Resolve conflicts
        • Begijnhof isa way
        • Begijnhof isa area
        • Begijnhof isa building
  • 41. 3
  • 42.  
  • 43. 4
    • rdf:type property (a.o. restaurant, shop, building, church, place of worship, university, way, bequinage, market, marketplace)
    • linked geo data ontology ( LGDV ):
      • Facets={ location, event, artwork or people}
      • SubFacets{ painting, photograph, book, artist, musician, politician, sport, conflict,..}
  • 44.  
  • 45. In practice
  • 46. Spui square ( 52° 22′ 7″ N, 4° 53′ 22″ E )
  • 47.  
  • 48. What does LOD return?
    • Linked Geo Data
      • Spui25, Nieuwezijds Voorburgwal, Het Lieverdje, Spui, Begijnhof (kapel), …
    • DBpedia
      • Spui (Amsterdam), Universiteit van Amsterdam, Maagdenhuis (only NL), Het Lieverdje (only NL), …
    • Geonames
      • Nieuwezijds Voorburgwal, Lutherse Kerk, Het Lieverdje, Spui, Begijnhof (RK), Begijnhof, ...
  • 49. Merging geo info
    • Non trivial:
      • Different schemas
      • Different labeling conventions
      • Different (GPS) data
        • Spui in Amsterdam has at least 5 coordinates in LOD
      • Errors in human annotations
      • Resolve conflicts
        • Begijnhof isa way
        • Begijnhof isa area
        • Begijnhof isa building
  • 50. “ Spui” Square and the “Lutherse Kerk”
  • 51. User Interaction
      • Facets={ location, event, artwork or people}
      • SubFacets={ painting, photograph, book, artist, musician, politician, sport, conflict,..}
    h = [0..359]
  • 52. “ Spui” Square and the “Lutherse Kerk”
  • 53.  
  • 54. “ Maagdenhuis” Building and the “Helios Building”
  • 55. Technical details
  • 56. Inference structure
    • geolocation, represented by a point s = ⟨lat, long⟩, e.g. s = ⟨52.3638611, 4.88944⟩
    • Raw Mental map : spatially relevant objects (POIs) Space package e.g. 5 different “Spui” in DBPedia, geonames, openstreetmaps and freebase)
    • Aligned Mental Map: (GeoNames) i.e.: Spui square in Amsterdam
    • Semantic Crawling: query cultural heritage cloud “spui+amterdam” -> construction of RDF graph
    • Classify: add facets and subfacets
    • Choose heading h=[0..359]
    • Presentation
  • 57. light weight client with a heavy endpoint
  • 58.  
  • 59. Demo
  • 60. Copyright issues with content… mobile DBPedia tabulator: http://bit.ly/lodapp
  • 61. http://bit.ly/i-ams
  • 62. Evaluation
    • A lot of links in LOD, actual “knowledge” rather limited: -> A lot of comment and labels.
    • Alignment of non-stand URIs:
      • -> e.g., /Begijnhof_,Amsterdam /Spui versus /Spui_(Amsterdam)
    • Local information in local languages, e.g. English wikis are limited on Amsterdam
    RDF
  • 63. Google maps & Panoramio
  • 64. #URIs and #RDF statements for different schema’s of the location data for the Spui square Evaluation
  • 65. Discussion
    • How to combine Linked Open Data and cultural heritage data?
      • Geonames->mental map->PDF graph
      • Combination of sources achieves an added value
      • Still difficult to find information for the “active tourists”
    • How to present the results in a manageable way on a mobile device?
      • Not “one” user: Understand task, Location awareness (GPS + heading)
      • Syntactic sugar
      • Novel user interface -> augmented television
  • 66. Thank you Previews available on request: send your UUID [email_address] Checkout: http://bit.ly/lodapp http://bit.ly/i-ams http://bit.ly/ekaw2010 This work has been partially supported by: EU project NoTube (ICT-231761), Poseidon project (supported by the Dutch Ministry of Economic Affairs under the BSIK03021 program) and Agora project (funded by NWO in the CATCH programme, grant 640.004.801). Don’t forget to book a week-end in Amsterdam