Wearable Technology for Museums - Giulio Caperdoni @ MWF2014


Published on

Presentation held by Giulio Caperdoni, Vidiemme COO, during MWF 2014.
The speech covers Google Glass topics, the project GoogleGlass4LIS and Museum 2.0

Published in: Technology
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Wearable Technology for Museums - Giulio Caperdoni @ MWF2014

  1. 1. MWF 2014 Wearable Technology for Museums
  2. 2. who we are? user experience and technology
  3. 3. Rokivo & Vidiemme Rokivo Inc. is an American company based in New York and Turin, specialized in user experience, or the design of the experience on different types of screens (computer, smartphone, tablet, etc..) www.rokivo.com #werok Vidiemme Consulting Srl is an Italian company based in Milan, key player in the digital context and focused on technology innovation for web, mobile and wearables www.vidiemme.it #weroll Rokivo and Vidiemme have brought to Italy one of the Google Glass Explorer Edition prototypes, the program opened so far only to US residents with the objective to develop new apps for this revolutionary device.
  4. 4. the speaker Giulio Caperdoni COO Vidiemme Consulting
  5. 5. the speaker Valerio Saffirio Founder Rokivo
  6. 6. what does it mean to develop for Google Glass?
  7. 7. two options to develop on Glass March 2013 November 2013 Mirror API GDK The Google Mirror API allows you to build webbased services, called Glassware, that interact with Google Glass, but do not run on it. The Glass Development Kit (GDK) is an add-on to the Android SDK that lets you build Glassware that runs directly on Glass. Platform independence Common infrastructure Built-in functionality Real-time User Interaction Source: https://developers.google.com/glass/develop Offline Functionality Access to Hardware
  8. 8. focus on GDK Android SDK Layouts, view and other UI widgets GPS, Sensors and other hardware Activities, services and other building block GDK add-on The GDK is an Android SDK add-on that contains APIs for Glass-specific features. By using the Android SDK and GDK, you can leverage the vast array of Android APIs and also design an optimal user experience for Glass. Voice Cards Gesture Detector Source: https://developers.google.com/glass/develop/gdk
  9. 9. why GDK is so important? because it opens up endless possibilities to leverage all the “senses” of the device because it allows to add functionalities, voice commands and gestures because it allows a better integration with external services
  10. 10. designing for Glass UI elements allow 3 pattern types: Glass has its own rules and guideline for design and use, that are fundamentally different from existing mobile and desktop platforms and that need to be taken into consideration when creating the user experience. While computers and smartphones may store a medium to large quantity of data, Glass works best with information that is simple, relevant, and current. forever last year last month now Source: https://developers.google.com/glass/design/principles • Static card - Displays text, HTML, images, and video. Static cards can invoke live cards or immersions • Live card – Show content that is important at the current time and constantly update to keep information fresh and relevant • Immersion - Customized UI experiences that take over a user's focus and display outside of the timeline experience
  11. 11. GOOGLEGLASS4LIS - museum for deaf
  12. 12. what the LIS language is? The LIS is the Italian Sign Language used by those deaf people that cannot speak or write Italian. Every community may have its own sign language; the Italian one is different from the one used in America for example and even in Italy there are different “dialects”. LIS is based on “signs”. Signs are the results of different parameters: Manual Hand movements Hands orientation Place Configuration Non manual Facial expression Oral behavior Posture Each sign is obtained combining basic units of meaning, called cheremes in Italian. Cheremes are ordered in accordance to LIS specific syntactic rules. “Mom’s car” becomes “Mom + Car + Hers” Combining cheremes in new ways it is possible to create new signs.
  13. 13. GoogleGlass4LIS GoogleGlass4LIS is the first experimental project to develop an App intended to deaf people to provide a full and accessible museum experience a project by in collaboration with sponsored by
  14. 14. the concept PLAY
  15. 15. how does it work? 1 Within the museum the deaf person wears Google Glass and looks at the statue of interest 4 2 3 Google Glass displays the avatar on its display GoogleGlass4LIS App recognizes the statue based on its position Information on the statue are linked with the corresponding translation produced by the ATLAS platform and rendered through an avatar signing the LIS
  16. 16. Statue of king Ramses II … Final User Experience
  17. 17. the ATLAS platform GoogleGlass4LIS is based on the ATLAS (Automatic Translation into Sign Languages) platform, a huge project started in 2009 funded by Regione Piemonte and the EU. The platform is able to translate any Italian text or audio to LIS. The platform creates in real time an avatar that can then be displayed on any digital device (smartphone, tablet and – of course – Google Glass). SET of VOCABULARY Input: Subtitles Audio Audio/Video Text* Intermediate Format Weather forecast Train station Museum (to be created for the project) … “Signs” for the virtual avatar *ATLAS core
  18. 18. (r)evolutions Build an App useful for many types of deafness, disabilities or educational needs: Subtitles for non-LIS speaking, Children, Foreigners , … Making the entire museum interactive with indoor positioning systems
  19. 19. press release Press Conference Egyptian Antiquities Museum - Nov 11th Torino DOWNLOAD THE FULL PRESS RELEASE HERE
  20. 20. indoor positioning systems
  21. 21. indoor location and positioning • Bringing the power of GPS and maps indoor • Tying digital information to physical places • Instead of punching a 3 digit number into a handheld tour guide, you could walk up to a painting, pull out your smartphone, and find additional info right there waiting for you • No single technology is ubiquitous • There are trade-offs to each of the technologies. WiFi is low cost and ubiquitous, but not very accurate*; high precision location usually requires higher cost and infrastructure work *High accuracy is considered to be 1 to 5 meters, medium accuracy is 6 to 10 meters, and low accuracy is over 11 meters
  22. 22. WiFi fingerprinting • The localization technique is based on measuring the intensity of the received WiFi signal and generating a “fingerprint” for every different position Accuracy • medium Availability • ubiquitous • • Glass compares its current WiFi fingerprint to Fingerprint/Location database in order to find its position The accuracy depends on the number of positions that have been previously entered into the database Glass issue • WiFi signal sampling frequency is much slower than usual in order to safeguard battery life o localization takes longer than with a smartphone
  23. 23. beacons • They are low-cost gizmos that continually beam out a Bluetooth signal, running for up to a year on a small watch battery and located at defined positions within a building Accuracy • high Availability • iOS7 – Android 4.3 • • Beacons come in different formats - including small coin cell powered devices and USB sticks - and software versions A beacon could pinpoint an item’s location in a room Glass issue • Not compatible with current Android version (4.0.4) • Temporary workaround: 1. Beacon is discovered by the smartphone paired with the Glass 2. Beacon Id is sent to Glass by the smartphone
  24. 24. contacts Rokivo Inc. talkto@rokivo.com - www.rokivo.com 244 Fifth Avenue Suite F263, New York, NY 10001 Rokivo Srl - Via Giolitti, 41 - 10123 Turin (TO) Vidiemme Consulting Srl info@vidiemme.it - www.vidiemme.it Via Natale Battaglia, 8 - 20127 Milan (MI) contacts Valerio Saffirio +39.3358485602/valerio.saffirio@rokivo.com contacts Giulio Caperdoni +39.3489154293/giulio.caperdoni@vidiemme.it