Augmented audio reality by Ronald Huizer

1,299 views

Published on

This presentation is an updated version of my earlier presentation of the new concept of augemented audio. This concept interesting for both mobile adepts as well as visually impaired.

Published in: Design, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,299
On SlideShare
0
From Embeds
0
Number of Embeds
188
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Augmented audio reality by Ronald Huizer

  1. 1. Creating an audio augmented reality By Ronald Huizer Ronald Huizer huizerronald@gmail.com CC-BY
  2. 2. Vision on Mobile internet Ronald Huizer huizerronald@gmail.com CC-BY
  3. 3.  The interface for mobile internet has evolved from small displays and small (numeric) keyboards to large touchscreen with full qwerty keyboards.  Basically, the devices have the same interface as a traditional PC; a display and a keyboard, with a mouse, a stylus or touchscreen  These devices enable you have access to the internet at all places…  …but when you are walking, biking, driving, talking or listening, these interfaces are difficult to handle, or even dangerous (f.i. 7 pounds)…  Device batteries are limited to a few hours of intensive usage; most of the power is used by displays…  That’s doesn’t sounds very mobile at all, is it?Tradidional interface on mobile internet Ronald Huizer huizerronald@gmail.com CC-BY
  4. 4. Orientation and navigation, Handsfree!Audio interface on mobile internet Ronald Huizer huizerronald@gmail.com CC-BY
  5. 5. So, how can we make applications using mobile internet,without a keyboard and display,without the use of hands and eyes?Audio interface on mobile internet Ronald Huizer huizerronald@gmail.com CC-BY
  6. 6. The new interface;a headset that creates a virtual (audio) reality The headset is a (bluetooth) headset that:  mixes the line out from your device with exterior sounds/noises;  enables you to listen to music, podcasts, text or calls  while still being able to hear and to communicate (audio) as usual This device, that is already on the market (from Plantronics) It will enable visual impaired to listen to any audio device, and still having normal use of hearingAudio interface on mobile internet Ronald Huizer huizerronald@gmail.com CC-BY
  7. 7. Optimized version of this headset has additional features: White noise modus – completely filters out all backround noises External modus – 80% external audio Internal modus – 20% external audio Mute modus - 100% external audio Voice activated; when your speaking, automatically switch to external modus * I will be in contact with several companies to discuss further development of such a product.Audio interface on mobile internet Ronald Huizer huizerronald@gmail.com CC-BY
  8. 8. Audiotwitter :Listening to your tweets and music at the same time! A twitter app using a twitter API captures tweets from your account A text-to-speech application (f.i. Siri, or Acapela) procudes spoken tweets. Hyperlinks are mentioned, but not spoken The app can also mix the spoken tweets with music from your iPhone; when tweets are spoken music is pauzed, or lowered in volume. Tweets can be pauzed Fase II developments: ◦ Audiotwitter for desktop to enable visually impaired to use twitter ◦ Speech2text interface for twitter ◦ The app recognizes the language of a tweet and selects the applicable voice/voccabulaire ◦ Multiple voices (male, female) based on gender in Easy to use with the profile of tweet author v.a.r. headsetAudio interface on mobile internet Ronald Huizer huizerronald@gmail.com CC-BY
  9. 9. Audio navigation with Google MapsWith a GPS-smartphone users can navigate and be aware of all points of interest, without having to held and to view a handset Using a speech-to-text application (f.i. Yap) that captures input from user about destination of a searched object Use Google Maps (API) to produce route instructions and information on nearby objects likes stores and difficult situations A text-to-speech application (f.i. Acapela ) will produce instructions Special maps/layers for target groups can be developped and maintained by communities.  “Safe routes” for visually impaired, of wheelchair users.  Fastes routes for bike-couriers Easy to use with the  Nices routes for tourists v.a.r. headsetAudio interface on mobile internet Ronald Huizer huizerronald@gmail.com CC-BY
  10. 10. Additional product concepts An orientation headset* with a compass functionality (similar to Android G1/iPhone 3Gs) will enhance the opportunities for mobile orientation to an even more detailled level. Based on your GPS position and viewing direction, an augmented reality application (to be developped) can reveil every information about locations, business, people etcetera. ◦ Look at a buddy and find out who he is doing (with Google latitude) ◦ Look at a star and hear what star it is (Google Stardroid) Nonverbal communicator: In addiction to speech-to-text, a movement sensor (built in headset) can interpreter nonverbal communication, like nodding “yes” or “no” .Audio interface on mobile internet Ronald Huizer huizerronald@gmail.com CC-BY
  11. 11. “Turn left” “Navigate to home” “There is a bookshop with Lonely Planet Iceland in that store on your right hand” “Skip commercial” “You’re buddy Paul “Find Paul” is 1 mile close to you, do you want directions?”Audio interface on mobile internet Ronald Huizer huizerronald@gmail.com CC-BY
  12. 12. Additional product concepts Nonverbal communicator: In addiction to speech-to-text, a movement sensor/accelerator can interpreter nonverbal communication, like nodding left, right, up or down. Commands like confirm, stop/skip, left & right, up & down, or customized commands can be given This can be used in addition to manual and speech-to-text interfaces This interface will also decrease the use of keyboard/touchscreensAudio interface on mobile internet Ronald Huizer huizerronald@gmail.com CC-BY
  13. 13. Augmented Video* Augmented AudioHeavy battery usage Lite battery usage, long enduranceBlocks/troubles normal sight Normale sight remainsLooks silly! Headsets are cool!Costs 350 euro Costs 80 euroTablet or pda requires use of Totally handsfreehandsNeed good working eyes (no Suitable for everybody, especiallyglasses when using VR glasses) visually impaired. Not for hearing impaired.* (with VR glasses, pda or tablet)Comparison
  14. 14.  Please preview and discuss my presentation; I will be happy to answer questions and give additional explanation, and get feedback from you Contact me huizerronald@gmail.comNext steps Ronald Huizer huizerronald@gmail.com CC-BY

×