Mobile cultural heritage guide  location-aware semantic search <ul><li>Chris van Aart (1) , Bob Wielinga (1,2) , Willem Ro...
Data: http://bit.ly/ekaw2010 Simulator: http://bit.ly/i-ams  iOS: http://bit.ly/lodapp
Recovering of  tourism market in  Amsterdam not fast enough
 
 
 
 
 
 
 
 
 
 
 
 
(Digital) Cultural heritage <ul><li>Museums </li></ul><ul><li>(old)buildings (monuments) </li></ul><ul><li>Statues </li></...
 
 
 
 
<title>De Prinsengracht bij de Reesluis, 1663 - 1664</title> <keywords>schilderij, stadsgezicht, stadsgezicht Amsterdam, P...
<title>Roemer EERSTE STEENLEGGING NIEUWE KERK, 1647</title> <keywords>drinkglas, roemer, kelkglas, heiplan toren Nieuwe Ke...
<title>Anatomische les van Prof. Frederik Ruysch, 1670</title> <keywords>schilderij, portret, groepsportret, anatomische l...
<title>De brand in het oude stadhuis (1652)</title> <keywords>prent, stadsgezicht, brand van het oude stadhuis op de Dam, ...
http://bit.ly/eculture
Cultural heritage data cloud http://e-culture.multimedian.nl/resources/datacloud/
http://dbpedia.org/resource/Amsterdam
 
Location awareness / LBS <ul><li>Real time locating and positioning </li></ul><ul><li>Sun/Stars, Compass, Postal code, WGS...
DBPedia mobile:  Google maps “ Louvre app”
Research question  <ul><li>“ How to find cultural heritage POIs at a particular location, given the constraints of a mobil...
Challenges <ul><ul><li>enrich location data  by constructing an ``enriched local map'' of nearby Points of Interest </li><...
 
Approach <ul><li>Combine:  </li></ul><ul><ul><li>general knowledge  about geolocations and points of interest: </li></ul><...
<ul><li>The “Active” tourist: </li></ul><ul><li>What do I see? </li></ul><ul><li>Next stop? </li></ul><ul><li>Hot spots? <...
From Geolocation to  Real-world Annotation Task structure
1
Harvest Locations <ul><li>Iphone GPS </li></ul><ul><ul><li>Latitude = 52.368611 </li></ul></ul><ul><ul><li>Longitude = 4.8...
2
Merging geo info <ul><li>Non trivial: </li></ul><ul><ul><li>Different schemas </li></ul></ul><ul><ul><li>Different labelin...
3
 
4 <ul><li>rdf:type property  (a.o. restaurant, shop, building, church, place of worship, university, way, bequinage, marke...
 
In practice
Spui square  ( 52° 22′ 7″ N, 4° 53′ 22″ E )
 
What does LOD return? <ul><li>Linked Geo Data </li></ul><ul><ul><li>Spui25, Nieuwezijds Voorburgwal, Het Lieverdje, Spui, ...
Merging geo info <ul><li>Non trivial: </li></ul><ul><ul><li>Different schemas </li></ul></ul><ul><ul><li>Different labelin...
“ Spui” Square and the “Lutherse Kerk”
User Interaction <ul><ul><li>Facets={ location, event, artwork or people} </li></ul></ul><ul><ul><li>SubFacets={ painting,...
“ Spui” Square and the “Lutherse Kerk”
 
“ Maagdenhuis” Building and  the “Helios Building”
Technical details
Inference structure <ul><li>geolocation, represented by a point s = ⟨lat, long⟩,  e.g. s = ⟨52.3638611, 4.88944⟩ </li></ul...
light weight client with a  heavy endpoint
 
Demo
Copyright issues with content… mobile DBPedia tabulator: http://bit.ly/lodapp
http://bit.ly/i-ams
Evaluation <ul><li>A lot of links in LOD, actual “knowledge” rather limited:  -> A lot of comment and labels. </li></ul><u...
Google maps & Panoramio
#URIs and #RDF statements for different schema’s of the location data for the Spui square Evaluation
Discussion <ul><li>How to combine Linked Open Data and cultural heritage data? </li></ul><ul><ul><li>Geonames->mental map-...
Thank you Previews available on request: send your UUID [email_address] Checkout: http://bit.ly/lodapp http://bit.ly/i-ams...
Upcoming SlideShare
Loading in …5
×

Mobile cultural heritage guide: location-aware semantic search (EKAW2010)

1,586 views

Published on

In this paper we explore the use of location aware mobile devices for
searching and browsing a large number of general and cultural
heritage information repositories. Based on
GPS positioning we can determine a user's location and context, composed of physical
nearby locations, historic events that have taken place there, artworks
that were created at or inspired by those locations and artists that have
lived or worked there. Based on a geolocation, the user has three levels of refinement: pointing to a specific heading and selection and facets and subfacets of cultural heritage objects. In
our approach two types of knowledge are combined: general knowledge
about geolocations and points of interest and specialized knowledge about
a particular domain, i.e. cultural heritage. We use a number of
Linked Open Data sources and a
number of general sources from the cultural heritage domain (including Art and Architecture Thesaurus, Union List of Artist Names) as well as data from several Dutch cultural institutions. We show three concrete
scenarios where a tourist accesses localized information on his
iPhone about the current environment, events, artworks or persons, which are enriched by Linked Open Data sources.
We show that Linked Open Data sources in isolation are currently too limited to
provide interesting semantic information but combined with each other
and with a number of other sources a really informative location-based
service can be created.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,586
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
28
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Ongoing
  • in depot Trefwoordendrinkglas, roemer, kelkglas, heiplan toren Nieuwe Kerk, steenlegging, Nieuwe Kerk, Willem Backer, Cornelis Backer, Stichting Projecten De Nieuwe Kerk AmsterdamglascollectieOp de kelk is in diamantgravering het heiplan voor de nooit voltooide toren van de Nieuwe Kerk aangebracht.Zie ookPB 22 / Nieuwe Kerk, eerste steenlegging van de toren van de
  • in depot Trefwoordendrinkglas, roemer, kelkglas, heiplan toren Nieuwe Kerk, steenlegging, Nieuwe Kerk, Willem Backer, Cornelis Backer, Stichting Projecten De Nieuwe Kerk AmsterdamglascollectieOp de kelk is in diamantgravering het heiplan voor de nooit voltooide toren van de Nieuwe Kerk aangebracht.Zie ookPB 22 / Nieuwe Kerk, eerste steenlegging van de toren van de
  • The user’s context
  • h = [0..359]
  • Mobile cultural heritage guide: location-aware semantic search (EKAW2010)

    1. 1. Mobile cultural heritage guide location-aware semantic search <ul><li>Chris van Aart (1) , Bob Wielinga (1,2) , Willem Robert van Hage (1) </li></ul><ul><li>(1) VU University Amsterdam, the Netherlands (2) Universiteit van Amsterdam, the Netherlands </li></ul><ul><li>[email_address] </li></ul><ul><li>October 2010 </li></ul>
    2. 2. Data: http://bit.ly/ekaw2010 Simulator: http://bit.ly/i-ams iOS: http://bit.ly/lodapp
    3. 3. Recovering of tourism market in Amsterdam not fast enough
    4. 16. (Digital) Cultural heritage <ul><li>Museums </li></ul><ul><li>(old)buildings (monuments) </li></ul><ul><li>Statues </li></ul><ul><li>Art-works </li></ul><ul><li>Historic events </li></ul>
    5. 21. <title>De Prinsengracht bij de Reesluis, 1663 - 1664</title> <keywords>schilderij, stadsgezicht, stadsgezicht Amsterdam, Prinsengracht, Reesluis, scheepvaart</keywords>
    6. 22. <title>Roemer EERSTE STEENLEGGING NIEUWE KERK, 1647</title> <keywords>drinkglas, roemer, kelkglas, heiplan toren Nieuwe Kerk, steenlegging, Nieuwe Kerk, Willem Backer, Cornelis Backer, Stichting Projecten De Nieuwe Kerk Amsterdam Glascollectie</keywords> <description>Op de kelk is in diamantgravering het heiplan voor de nooit voltooide toren van de Nieuwe Kerk aangebracht.<description>
    7. 23. <title>Anatomische les van Prof. Frederik Ruysch, 1670</title> <keywords>schilderij, portret, groepsportret, anatomische les, ambachten en beroepen, onderwijs, Chirurgijnsgilde, Leendert Fruyt, Aert van Swieten, Frederik Ruysch, Gillis Hondekoeter, Rogier de Coen, Joris van Loon Tilanus, Jacob Brandt</keywords> <description> Frederik Ruysch (1638-1731) was de opvolger van Jan Deijman als praelector van het chirurgijnsgilde.De jonge doctor demonstreert de ligging van de lymfevaten in de lies. De nadruk ligt nu niet op de levenloze staat van de dode, zoals bij Rembrandt. Het lichaam op de snijtafel lijkt eerder toe te behoren aan iemand die slaapt. Waarschijnlijk wilde Ruysch hiermee zijn specialiteit verbeelden: dankzij zijn preparatietechnieken leek het alsof de doden nog leefden. Het schilderij is na restauratie voor het eerst sinds lange tijd weer te zien. </description>
    8. 24. <title>De brand in het oude stadhuis (1652)</title> <keywords>prent, stadsgezicht, brand van het oude stadhuis op de Dam, Dam</keywords>
    9. 25. http://bit.ly/eculture
    10. 26. Cultural heritage data cloud http://e-culture.multimedian.nl/resources/datacloud/
    11. 27. http://dbpedia.org/resource/Amsterdam
    12. 29. Location awareness / LBS <ul><li>Real time locating and positioning </li></ul><ul><li>Sun/Stars, Compass, Postal code, WGS84 (GPS)… </li></ul><ul><li>communication, networks, traffic, logistics, security, search & rescue, business administration, leisure,… </li></ul>
    13. 30. DBPedia mobile: Google maps “ Louvre app”
    14. 31. Research question <ul><li>“ How to find cultural heritage POIs at a particular location, given the constraints of a mobile device, using current Semantic Web data and technology?” </li></ul>
    15. 32. Challenges <ul><ul><li>enrich location data by constructing an ``enriched local map'' of nearby Points of Interest </li></ul></ul><ul><ul><li>Enrich POIs with additional information, such as e.g. events, persons and artworks. </li></ul></ul><ul><ul><li>present the results in a manageable way on a mobile device </li></ul></ul>
    16. 34. Approach <ul><li>Combine: </li></ul><ul><ul><li>general knowledge about geolocations and points of interest: </li></ul></ul><ul><ul><ul><li>GeoNames, LinkedGeodata, Freebase and DBPedia </li></ul></ul></ul><ul><ul><li>specialized knowledge about the cultural heritage domain </li></ul></ul><ul><ul><ul><li>Art and Architecture Thesaurus, </li></ul></ul></ul><ul><ul><ul><li>Union List of Artist Names, </li></ul></ul></ul><ul><ul><ul><li>Netherlands Institute for Art History </li></ul></ul></ul><ul><ul><ul><li>Rijksmuseum Amsterdam. </li></ul></ul></ul>
    17. 35. <ul><li>The “Active” tourist: </li></ul><ul><li>What do I see? </li></ul><ul><li>Next stop? </li></ul><ul><li>Hot spots? </li></ul><ul><li>History? </li></ul><ul><li>Stories? </li></ul><ul><li>Events? </li></ul><ul><li>Persons? </li></ul><ul><li>Descriptions? </li></ul><ul><li>Maps? </li></ul>
    18. 36. From Geolocation to Real-world Annotation Task structure
    19. 37. 1
    20. 38. Harvest Locations <ul><li>Iphone GPS </li></ul><ul><ul><li>Latitude = 52.368611 </li></ul></ul><ul><ul><li>Longitude = 4.88944 </li></ul></ul><ul><ul><li>(we ignore heading) </li></ul></ul><ul><li>==> select those geo data that are relevant to this point </li></ul><ul><ul><li>Searching dbpedia, linkedgeodata, geonames for locations and objects within a certain distance. </li></ul></ul><ul><ul><li>Crawling via various relations (owl:sameAs, nearby etc) we gather a collection of RDF resources related to our location. </li></ul></ul><ul><ul><li>Using a Prolog spatial indexing package (space) we can compute distances and directions from our current location. </li></ul></ul>
    21. 39. 2
    22. 40. Merging geo info <ul><li>Non trivial: </li></ul><ul><ul><li>Different schemas </li></ul></ul><ul><ul><li>Different labeling conventions </li></ul></ul><ul><ul><li>Different (GPS) data </li></ul></ul><ul><ul><ul><li>Spui in Amsterdam has at least 5 coordinates in LOD </li></ul></ul></ul><ul><ul><ul><li>There is also an Spui in The Hague </li></ul></ul></ul><ul><ul><li>Errors in human annotations </li></ul></ul><ul><ul><li>Resolve conflicts </li></ul></ul><ul><ul><ul><li>Begijnhof isa way </li></ul></ul></ul><ul><ul><ul><li>Begijnhof isa area </li></ul></ul></ul><ul><ul><ul><li>Begijnhof isa building </li></ul></ul></ul>
    23. 41. 3
    24. 43. 4 <ul><li>rdf:type property (a.o. restaurant, shop, building, church, place of worship, university, way, bequinage, market, marketplace) </li></ul><ul><li>linked geo data ontology ( LGDV ): </li></ul><ul><ul><li>Facets={ location, event, artwork or people} </li></ul></ul><ul><ul><li>SubFacets{ painting, photograph, book, artist, musician, politician, sport, conflict,..} </li></ul></ul>
    25. 45. In practice
    26. 46. Spui square ( 52° 22′ 7″ N, 4° 53′ 22″ E )
    27. 48. What does LOD return? <ul><li>Linked Geo Data </li></ul><ul><ul><li>Spui25, Nieuwezijds Voorburgwal, Het Lieverdje, Spui, Begijnhof (kapel), … </li></ul></ul><ul><li>DBpedia </li></ul><ul><ul><li>Spui (Amsterdam), Universiteit van Amsterdam, Maagdenhuis (only NL), Het Lieverdje (only NL), … </li></ul></ul><ul><li>Geonames </li></ul><ul><ul><li>Nieuwezijds Voorburgwal, Lutherse Kerk, Het Lieverdje, Spui, Begijnhof (RK), Begijnhof, ... </li></ul></ul>
    28. 49. Merging geo info <ul><li>Non trivial: </li></ul><ul><ul><li>Different schemas </li></ul></ul><ul><ul><li>Different labeling conventions </li></ul></ul><ul><ul><li>Different (GPS) data </li></ul></ul><ul><ul><ul><li>Spui in Amsterdam has at least 5 coordinates in LOD </li></ul></ul></ul><ul><ul><li>Errors in human annotations </li></ul></ul><ul><ul><li>Resolve conflicts </li></ul></ul><ul><ul><ul><li>Begijnhof isa way </li></ul></ul></ul><ul><ul><ul><li>Begijnhof isa area </li></ul></ul></ul><ul><ul><ul><li>Begijnhof isa building </li></ul></ul></ul>
    29. 50. “ Spui” Square and the “Lutherse Kerk”
    30. 51. User Interaction <ul><ul><li>Facets={ location, event, artwork or people} </li></ul></ul><ul><ul><li>SubFacets={ painting, photograph, book, artist, musician, politician, sport, conflict,..} </li></ul></ul>h = [0..359]
    31. 52. “ Spui” Square and the “Lutherse Kerk”
    32. 54. “ Maagdenhuis” Building and the “Helios Building”
    33. 55. Technical details
    34. 56. Inference structure <ul><li>geolocation, represented by a point s = ⟨lat, long⟩, e.g. s = ⟨52.3638611, 4.88944⟩ </li></ul><ul><li>Raw Mental map : spatially relevant objects (POIs) Space package e.g. 5 different “Spui” in DBPedia, geonames, openstreetmaps and freebase) </li></ul><ul><li>Aligned Mental Map: (GeoNames) i.e.: Spui square in Amsterdam </li></ul><ul><li>Semantic Crawling: query cultural heritage cloud “spui+amterdam” -> construction of RDF graph </li></ul><ul><li>Classify: add facets and subfacets </li></ul><ul><li>Choose heading h=[0..359] </li></ul><ul><li>Presentation </li></ul>
    35. 57. light weight client with a heavy endpoint
    36. 59. Demo
    37. 60. Copyright issues with content… mobile DBPedia tabulator: http://bit.ly/lodapp
    38. 61. http://bit.ly/i-ams
    39. 62. Evaluation <ul><li>A lot of links in LOD, actual “knowledge” rather limited: -> A lot of comment and labels. </li></ul><ul><li>Alignment of non-stand URIs: </li></ul><ul><ul><li>-> e.g., /Begijnhof_,Amsterdam /Spui versus /Spui_(Amsterdam) </li></ul></ul><ul><li>Local information in local languages, e.g. English wikis are limited on Amsterdam </li></ul>RDF
    40. 63. Google maps & Panoramio
    41. 64. #URIs and #RDF statements for different schema’s of the location data for the Spui square Evaluation
    42. 65. Discussion <ul><li>How to combine Linked Open Data and cultural heritage data? </li></ul><ul><ul><li>Geonames->mental map->PDF graph </li></ul></ul><ul><ul><li>Combination of sources achieves an added value </li></ul></ul><ul><ul><li>Still difficult to find information for the “active tourists” </li></ul></ul><ul><li>How to present the results in a manageable way on a mobile device? </li></ul><ul><ul><li>Not “one” user: Understand task, Location awareness (GPS + heading) </li></ul></ul><ul><ul><li>Syntactic sugar </li></ul></ul><ul><ul><li>Novel user interface -> augmented television </li></ul></ul>
    43. 66. Thank you Previews available on request: send your UUID [email_address] Checkout: http://bit.ly/lodapp http://bit.ly/i-ams http://bit.ly/ekaw2010 This work has been partially supported by: EU project NoTube (ICT-231761), Poseidon project (supported by the Dutch Ministry of Economic Affairs under the BSIK03021 program) and Agora project (funded by NWO in the CATCH programme, grant 640.004.801). Don’t forget to book a week-end in Amsterdam

    ×