[esIoT'12] an attitude based reasoning strategy to enhance interaction with augmented objects

734 views
691 views

Published on

Published in: Technology, Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
734
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
1
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

[esIoT'12] an attitude based reasoning strategy to enhance interaction with augmented objects

  1. 1. Grupo de Procesado de Datos y Simulación ETSI de Telecomunicación Universidad Politécnica de Madrid An attitude-based reasoning strategyto enhance interaction with augmented objects esIoT 2012 International workshop on Extending Seamlessly to the Internet of Things Josué Iglesias, David Gómez, Ana M. Bernardos, José R. Casar josue@grpss.ssr.upm.es
  2. 2. contents  introduction and motivation  IoT browser functionalities  architecture design  attitude-based resource recommendation strategy  prototype description  discussion and future worksExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 2 / 16
  3. 3. contents  introduction and motivation  IoT browser functionalities  architecture design  attitude-based resource recommendation strategy  prototype description  discussion and future worksExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 3 / 16
  4. 4. introduction and motivationExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 4 / 16
  5. 5. introduction and motivation archie gopher veronica etc.Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 4 / 16
  6. 6. introduction and motivation web web 2.0Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 4 / 16
  7. 7. introduction and motivation semantic webExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 4 / 16
  8. 8. introduction and motivation traditional InternetExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 4 / 16
  9. 9. introduction and motivation traditional Internet Internet of Things (IoT)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 4 / 16
  10. 10. introduction and motivation traditional Internet + Internet of Things (IoT)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 4 / 16
  11. 11. introduction and motivation traditional Internet + new environment (reality) identification traditional Internet discovery information management interactivity etc. + Internet of Things (IoT)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 4 / 16
  12. 12. introduction and motivation traditional Internet + new environment (reality) Internet of Things identification location traditional Internet discovery proximity information management mobility interactivity etc. etc. + Internet of Things (IoT)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 4 / 16
  13. 13. introduction and motivation 3D-AR Augmented Reality traditional Internet + Internet of Things (IoT)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 4 / 16
  14. 14. introduction and motivation traditional Internet + new environment (reality) Internet of Things identification location traditional Internet discovery proximity information management mobility interactivity etc. etc. + ... densely populated environments Internet of Things (IoT)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 4 / 16
  15. 15. introduction and motivation traditional Internet + new environment (reality) Internet of Things identification location traditional Internet discovery proximity information management mobility interactivity etc. etc. user experience + ... o interaction densely populated environments o filtering / selection Internet of Things (IoT)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 4 / 16
  16. 16. introduction and motivation traditional Internet + new environment (reality) Internet of Things identification location traditional Internet discovery proximity information management mobility interactivity etc. etc. user experience + ... o interaction densely populated environments o filtering / selection focus  development of IoT browser based on augmented reality (AR)  context-aware representation of resources Internet of Things (IoT)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 4 / 16
  17. 17. contents   introduction and motivation  IoT browser functionalities  architecture design  attitude-based resource recommendation strategy  prototype description  discussion and future worksExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 5 / 16
  18. 18. IoT browser functionalitiesExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 6 / 16
  19. 19. IoT browser functionalities resource recognitionuser position(mobile)resource position(fixed  mobile)location estimation• WiFi RSS ( 3 m.)• beacon-based (simulated) - e.g., RFIDExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 6 / 16
  20. 20. IoT browser functionalities resource interfaces recognitionuser position 2D(mobile) WiFi locationresource position(fixed  mobile)location estimation 3D - AR• WiFi RSS beacon-based loc. ( 3 m.)• beacon-based (simulated) - e.g., RFIDExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 6 / 16
  21. 21. IoT browser functionalities resource map interfaces recognition matchinguser position 2D zones(mobile) WiFi location rectangularresource position disjoint(fixed  mobile) real (meeting rooms, bedrooms, etc.)location estimation 3D - AR• WiFi RSS beacon-based loc. user’s ( 3 m.)• beacon-based line-of-sight (simulated) walls - e.g., RFID (other obstacles)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 6 / 16
  22. 22. IoT browser functionalities user- resource map interfaces resource recognition matching interactionuser position 2D zones explicit(mobile) WiFi location rectangular icons / virtual obj.resource position disjoint touch-based(fixed  mobile) real explicit info. (meeting rooms, bedrooms, etc.)location estimation 3D - AR• WiFi RSS beacon-based loc. implicit user’s relative attitude ( 3 m.)• beacon-based line-of-sight • distance (simulated) walls • orientation - e.g., RFID (other obstacles)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 6 / 16
  23. 23. IoT browser functionalities user- resource map resource interfaces resource recognition matching filtering interactionuser position 2D zones explicit context-aware(mobile) WiFi location rectangular icons / virtual obj.resource position disjoint touch-based distance(fixed  mobile) real explicit info. “focus” (orientation) (meeting rooms, bedrooms, etc.) line-of-sightlocation estimation 3D - AR history• WiFi RSS beacon-based loc. implicit profile user’s relative attitude ( 3 m.) preferences• beacon-based line-of-sight • distance group (simulated) walls • orientation etc. - e.g., RFID (other obstacles)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 6 / 16
  24. 24. contents   introduction and motivation   IoT browser functionalities  architecture design  attitude-based resource recommendation strategy  prototype description  discussion and future worksExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 7 / 16
  25. 25. architecture design infrastructure plane device plane smart space plane location ... Spatial Location orientation Module Services Interface Spatial Selector Module Reasoner Server Representation 2D Resource Module ResourceKB MapsKB ARExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 8 / 16
  26. 26. architecture design infrastructure plane device plane smart space plane location ... Spatial Location orientation Module Services Interface Spatial Selector Module Reasoner Server Representation 2D Resource Module ResourceKB MapsKB ARExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 8 / 16
  27. 27. architecture design infrastructure plane device plane smart space plane location ... Spatial Location orientation Module Services Interface Spatial Selector Module Reasoner Server Representation 2D Resource Module ResourceKB MapsKB ARExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 8 / 16
  28. 28. architecture design infrastructure plane device plane smart space plane location ... Spatial Location orientation Module Services Interface Spatial Selector Module Reasoner Server Representation 2D Resource Module ResourceKB MapsKB ARExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 8 / 16
  29. 29. architecture design infrastructure plane device plane smart space plane location ... Spatial Location orientation Module Services Interface Spatial Selector Module Reasoner Server Representation 2D Resource Module ResourceKB MapsKB ARExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 8 / 16
  30. 30. architecture design infrastructure plane device plane smart space plane location ... Spatial Location orientation Module Services Interface Spatial Selector Module Reasoner Server Representation 2D Resource Module ResourceKB MapsKB ARExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 8 / 16
  31. 31. contents   introduction and motivation   IoT browser functionalities   architecture design  attitude-based resource recommendation strategy  prototype description  discussion and future worksExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 9 / 16
  32. 32. resource recommendation profile/preference- historic- spatial- explicit-based based prioritization prioritization based based 3rd parties prioritizationExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 10 / 16
  33. 33. resource recommendationresource prioritization based on user’s habitsuser’s history probabilistic model (dynamic) ← location ↑ time of the day profile/preference- historic- spatial- explicit-based based prioritization prioritization based based 3rd parties prioritization Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 10 / 16
  34. 34. resource recommendationresource prioritization based on user’s habitsuser’s history probabilistic model (dynamic) ← location ↑ time of the dayresources desired spatio-temporal visibility profile/preference- historic- spatial- explicit-based based prioritization prioritization based based 3rd parties prioritization Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 10 / 16
  35. 35. resource recommendationresource prioritization based on user’s habits flexible resources visibility (examples)user’s history probabilistic model (dynamic) just by user location e.g. resource ‘a’ visibility would be ← location focused on a specific space (s1), independently of the time of the day just temporal-based e.g. resource ‘b’ visibility would be ↑ time of the day focused on a specific period of time (t1), and not in any particular spaceresources desired spatio-temporal visibility spatio-temporal combination e.g. resource ‘c’ visibility would be focused on a specific space (s1) during a particular period of time (t1) profile/preference- historic- spatial- explicit-based based prioritization prioritization based based 3rd parties prioritization Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 10 / 16
  36. 36. resource recommendationresource prioritization based on user’s habits flexible resources visibility (examples)user’s history probabilistic model (dynamic) just by user location e.g. resource ‘a’ visibility would be ← location focused on a specific space (s1), independently of the time of the day just temporal-based e.g. resource ‘b’ visibility would be ↑ time of the day focused on a specific period of time (t1), and not in any particular spaceresources desired spatio-temporal visibility spatio-temporal combination e.g. resource ‘c’ visibility would be focused on a specific space (s1) during a particular period of time (t1) profile/preference- historic- spatial- explicit-based based prioritization prioritization based based 3rd parties prioritization Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 10 / 16
  37. 37. resource recommendation spatial-based prioritization user (device) – resource distance user location resources location user (device) – resource relative orientation + accelerometer + magnetometer profile/preference- historic- spatial- explicit-based based prioritization prioritization based based 3rd parties prioritizationExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 11 / 16
  38. 38. resource recommendation spatial-based prioritization user (device) – resource distance user location resources location user (device) – resource relative orientation + accelerometer + magnetometer distance approach orientation approach + ·············· − + ················· − (near) ··········· (far) (0 ) ················ (180 ) profile/preference- historic- spatial- explicit-based based prioritization prioritization based based 3rd parties prioritizationExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 11 / 16
  39. 39. resource recommendation spatial-based prioritization2D(WiFi location) user (device) – resource distance user location resources location zd user (device) – resource relative orientation yd + accelerometer + magnetometer xd distance approach orientation approach + ·············· − + ················· − (near) ··········· (far) (0 ) ················ (180 ) profile/preference- historic- spatial- explicit-based based prioritization prioritization based based 3rd parties prioritizationExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 11 / 16
  40. 40. resource recommendation spatial-based prioritization2D 3D - AR(WiFi location) (beacon-based loc.) user (device) – resource distance user location resources location yd zd user (device) – resource relative orientation yd + accelerometer zd + magnetometer xd xd distance approach orientation approach + ·············· − + ················· − (near) ··········· (far) (0 ) ················ (180 ) profile/preference- historic- spatial- explicit-based based prioritization prioritization based based 3rd parties prioritizationExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 11 / 16
  41. 41. contents   introduction and motivation   IoT browser functionalities   architecture design   attitude-based resource recommendation strategy  prototype description  discussion and future worksExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 12 / 16
  42. 42. prototype description Motorola Xoom Honeycomb Android v3.1 (Java server + mySQL DB)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 13 / 16
  43. 43. prototype description2D Motorola Xoom Honeycomb Android v3.1 (Java server + mySQL DB)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 13 / 16
  44. 44. prototype description2D Motorola Xoom WiFi-based location ON/OFF beacon-based location (simulated) Honeycomb Android v3.1 (Java server + mySQL DB)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 13 / 16
  45. 45. prototype description2D Motorola Xoom WiFi-based location ON/OFF beacon-based location (simulated) Honeycomb Android v3.1 (Java server + mySQL DB) POIs information distance POIs location 360 viewExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 13 / 16
  46. 46. prototype description2D Motorola Xoom WiFi-based location ON/OFF beacon-based location (simulated) Honeycomb Android v3.1 (Java server + mySQL DB) 2D ↔ 3D-AR POIs information distance POIs location 360 viewExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 13 / 16
  47. 47. prototype description3D-AR Motorola Xoom Honeycomb Android v3.1 (Java server + mySQL DB) icons 2D/3D form size colored/grey solid/transparent pictures labels POI name distanceExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 13 / 16
  48. 48. prototype description3D-AR Motorola Xoom Honeycomb Android v3.1 (Java server + mySQL DB) icons 2D/3D form size colored/grey solid/transparent pictures labels POI name distanceExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 13 / 16
  49. 49. contents   introduction and motivation   IoT browser functionalities   architecture design   attitude-based resource recommendation strategy   prototype description  discussion and future worksExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 14 / 16
  50. 50. discussion and future works• base framework – IoT-based browsers funcionalities prototypes – context-aware representation of resource informationExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 15 / 16
  51. 51. discussion and future works• base framework – IoT-based browsers funcionalities prototypes – context-aware representation of resource information• new paradigm in resource recommendation – real-world (spatial) magnitudes (distance, orientation, line-of-sight, etc.)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 15 / 16
  52. 52. discussion and future works• base framework – IoT-based browsers funcionalities prototypes – context-aware representation of resource information• new paradigm in resource recommendation – real-world (spatial) magnitudes (distance, orientation, line-of-sight, etc.)  beacon-based localization  RFID  pressure matsExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 15 / 16
  53. 53. discussion and future works• base framework – IoT-based browsers funcionalities prototypes – context-aware representation of resource information• new paradigm in resource recommendation – real-world (spatial) magnitudes (distance, orientation, line-of-sight, etc.)  beacon-based localization  RFID  pressure mats  priority approaches  develop static and explicit prioritizations  integrationExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 15 / 16
  54. 54. discussion and future works• base framework – IoT-based browsers funcionalities prototypes – context-aware representation of resource information• new paradigm in resource recommendation – real-world (spatial) magnitudes (distance, orientation, line-of-sight, etc.)  beacon-based localization  RFID  pressure mats  priority approaches  develop static and explicit prioritizations  integration  line-of-sight management (obstacles)Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 15 / 16
  55. 55. discussion and future works• base framework – IoT-based browsers funcionalities prototypes – context-aware representation of resource information• new paradigm in resource recommendation – real-world (spatial) magnitudes (distance, orientation, line-of-sight, etc.)  beacon-based localization  RFID  pressure mats  priority approaches  develop static and explicit prioritizations  integration  line-of-sight management (obstacles)  context-aware icons/labelsExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 15 / 16
  56. 56. discussion and future works• base framework – IoT-based browsers funcionalities prototypes – context-aware representation of resource information• new paradigm in resource recommendation – real-world (spatial) magnitudes (distance, orientation, line-of-sight, etc.)  beacon-based localization  RFID  pressure mats  priority approaches  develop static and explicit prioritizations  integration  line-of-sight management (obstacles)  context-aware icons/labels  infrastructure  mobile deviceExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 15 / 16
  57. 57. discussion and future works• base framework – IoT-based browsers funcionalities prototypes – context-aware representation of resource information• new paradigm in resource recommendation – real-world (spatial) magnitudes (distance, orientation, line-of-sight, etc.)  beacon-based localization  RFID  pressure mats  priority approaches  develop static and explicit prioritizations  integration  line-of-sight management (obstacles)  context-aware icons/labels  infrastructure  mobile device  integrationExtending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 15 / 16
  58. 58. any question?Extending Seamlessly to the Internet of Things – esIoT 2012 josue@grpss.ssr.upm.es 16 / 16

×