Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

From audiopaper to next generation paper

280 views

Published on

Keynote talk given to Webmedia 2017, 17-20th October 2017, Gramado, Brazil.
Discusses connections between personal work adding sound to paper, and a vision for connecting future paper to the web.

Published in: Internet
  • Be the first to comment

  • Be the first to like this

From audiopaper to next generation paper

  1. 1. www.surrey.ac.uk/dwrc/ From audio paper to next generation paper Professor David Frohlich 18th October 2017
  2. 2. www.surrey.ac.uk/dwrc/ Motivation www.surrey.ac.uk/dwrc/
  3. 3. www.surrey.ac.uk/dwrc/ Trend: From print to web media e.g. domestic photography WEB MEDIA www.surrey.ac.uk/dwrc/ PRINT MEDIA
  4. 4. www.surrey.ac.uk/dwrc/ Technology: Augmented paper Electronic paper (e-books) versus Augmented paper DIGITAL PAPER-AND-DIGITAL “While the electronic paper approach aims to make existing devices as paper-like as possible, the augmented or interactive paper approach focuses on augmenting regular paper by linking it to supplemental digital information”. (Signer & Norrie 2010 Interactive paper: Past, present and future. UbiComp ‘10)
  5. 5. www.surrey.ac.uk/dwrc/ Augmented paper fights back? e.g. domestic photography WEB MEDIA www.surrey.ac.uk/dwrc/ PRINT MEDIA
  6. 6. www.surrey.ac.uk/dwrc/ Vision concept: The Audio-photobook (https://vimeo.com/album/3430190) www.surrey.ac.uk/dwrc/
  7. 7. www.surrey.ac.uk/dwrc/ Research questions for this talk 1. What is the role of augmenting paper with audio? 2. How can we combine the best of print and web media more generally? www.surrey.ac.uk/dwrc/
  8. 8. www.surrey.ac.uk/dwrc/ Plan • Audioprints (design explorations) • Interactive newsprint (design explorations) • Next generation paper (vision) • Conclusions www.surrey.ac.uk/dwrc/
  9. 9. www.surrey.ac.uk/dwrc/ Audioprints www.surrey.ac.uk/dwrc/
  10. 10. www.surrey.ac.uk/dwrc/ Audiophotography research HP Labs 1995-2005, DWRC 2014 2004 2015 www.surrey.ac.uk/dwrc/
  11. 11. www.surrey.ac.uk/dwrc/ Audiocamera prototypes 1998 2000 2002
  12. 12. www.surrey.ac.uk/dwrc/ The multilayered audiophoto
  13. 13. www.surrey.ac.uk/dwrc/ The multilayered audiophoto
  14. 14. www.surrey.ac.uk/dwrc/ HP audiophotography products HP Jornada 1998 HP Photosmart 850 camera 2000 HP Memories Disc software 2002-2005HP Compact camera line 2001-2005
  15. 15. www.surrey.ac.uk/dwrc/ Current audiophoto apps 2015
  16. 16. www.surrey.ac.uk/dwrc/ The audioprint opportunity: Playback of sound from the printed photo Audioscanner 1996 Audioprint player 1998 Audiocard/frame 1998Audiophoto album 1998
  17. 17. www.surrey.ac.uk/dwrc/ Feedback from audiophoto trials (Frohlich & Tallyn 1999, Frohlich 2004) • All participants liked both screen and paper ‘playback’ .. for different purposes. People still like tangible prints. • The audioscanner was seen as personal, intimate and accessible to older users • The audioprint player was seen as a vehicle for playback of sounds but also recording voice messages on photos • The audioprint album was seen as too heavy to carry and more suitable for special event collections and gifts. • The audio cards were prefered to audio frames especially for sending to others
  18. 18. www.surrey.ac.uk/dwrc/ The Audiophoto Desk Frohlich, Clancy, Robinson & Costanza (2004)
  19. 19. www.surrey.ac.uk/dwrc/ The Audiophoto desk Frohlich, Clancy, Robinson & Costanza (2004)
  20. 20. www.surrey.ac.uk/dwrc/ Feedback from an audiophoto desk trial (Lindley & Monk 2004) • Sound adds humour to the interaction especially when it doesn’t match the image • Mixing sounds and images on the desk made the interaction more engaging • Sound affects the conversation around photographs • Music was left playing in the background for atmosphere and mood • Ambient sounds became a talking point in their own right • Voiceover inhibits conversation • Sound adds humour to the interaction especially when it doesn’t match the image • Mixing sounds and images on the desk made the interaction more engaging • Sound affects the conversation around photographs • Music was left playing in the background for atmosphere and mood • Ambient sounds became a talking point in their own right • Voiceover inhibits conversation
  21. 21. www.surrey.ac.uk/dwrc/ Emerging audioprint products 2015 www.surrey.ac.uk/dwrc/ HP Live Photos Tap for message stickerPhoto storybook from Shutterfly Moon Pig cards
  22. 22. www.surrey.ac.uk/dwrc/ Interactive newsprint www.surrey.ac.uk/dwrc/
  23. 23. www.surrey.ac.uk/dwrc/ Interactive newsprint project 2011-2013
  24. 24. www.surrey.ac.uk/dwrc/ Interactive newsprint prototype
  25. 25. www.surrey.ac.uk/dwrc/ Interactive newsprint prototype
  26. 26. www.surrey.ac.uk/dwrc/ Audio annotations and voting options www.surrey.ac.uk/dwrc/
  27. 27. www.surrey.ac.uk/dwrc/ Newspaper formats Print origin: print format Print origin: web format Web origin: web format Web origin: print format
  28. 28. www.surrey.ac.uk/dwrc/ Feedback from interactive newsprint experiment (Frohlich et al 2017) • Responses varied depended on users’ existing news reading habits (paper v screen) • There were perceived values of audio in providing extra information, local commentary in a regional ‘voice’, and access to original interviews and other evidence for the stories • Users would often read and listen out of synch, to consume the material faster ( a ‘radio-newspaper’) • Print formats with interactive ’extras’ were seen as most attractive. Extras should give free added value. • Some users wanted the printed paper to be more pictorial with textual content moving to speech
  29. 29. www.surrey.ac.uk/dwrc/ Feedback continued: Thumb selection and pinch regions
  30. 30. www.surrey.ac.uk/dwrc/ Next generation paper www.surrey.ac.uk/dwrc/
  31. 31. www.surrey.ac.uk/dwrc/ Next generation paper project November 2017 for 30 months
  32. 32. www.surrey.ac.uk/dwrc/ Objectives: To generalise audiopaper to ‘webpaper’ 1. To connect complementary print and web media through touch 2. To support audio and visual playback of associated web media on a variety of devices. Make paper interact with the devices around it. 3. To develop and integrate two big classes of augmented paper in a common architectural framework (c.f. 1G passive paper) 1. 2G optically recognised paper 2. 3G touch sensitive paper 4. To create and test compelling demonstrations for BOOKS in the travel and tourism domain 5. To research and develop new business models www.surrey.ac.uk/dwrc/
  33. 33. www.surrey.ac.uk/dwrc/ Common architecture www.surrey.ac.uk/dwrc/
  34. 34. www.surrey.ac.uk/dwrc/ Domain: travel books and records www.surrey.ac.uk/dwrc/ Before During After
  35. 35. www.surrey.ac.uk/dwrc/ Conclusions www.surrey.ac.uk/dwrc/
  36. 36. www.surrey.ac.uk/dwrc/ Answers to research questions What is the role of augmenting paper with audio? • Mixed up with augmenting text and image with audio (on e- books) • Audio annotation can have all kinds of values from adding atmosphere, emotion, triggering memory, storytelling and elaboration. • In a news context audio can add extra information with a regional voice, and provide access to source interviews • Audiopaper is interactively intuitive because you read printed material as usual, whilst listening to sounds • It is seen as tangible, sharable, accessible, novel and attractive, and complements other forms of screen-based playback
  37. 37. www.surrey.ac.uk/dwrc/ Answers to research questions How can we combine the best of print and web media more generally? • Generalising ‘audiopaper’ to ‘webpaper’ leads to a vision of paper interacting with audiovisual content on a variety of devices nearby • Two types of technology need to be supported in a common framework: optical (2G) and printed electronic (3G) • Eventually links could be two-way allowing web material to be printed with working hotlinks, or apps with paper interfaces
  38. 38. www.surrey.ac.uk/dwrc/ The webpaper opportunity PRINT MEDIA WEB MEDIA www.surrey.ac.uk/dwrc/
  39. 39. www.surrey.ac.uk/dwrc/ References www.surrey.ac.uk/dwrc/ Frohlich, D.M. (2004) Audiophotography: Bringing photos to life with sounds. Kluwer Academic Publishers. Frohlich, D.M. (2015) Fast design, slow innovation: Audiophotography ten years on. Springer. Frohlich, D.M. & Tallyn E. (1999) Audiophotography: Practice and prospects. CHI ’99 Extended Abstracts: 296-297. New York, ACM Press. Frohlich D.M., Clancy T., Robinson J. & Costanzo E. (2004) The audiophoto desk. Proceedings of 2AD: Second International Conference on Appliance Design (p139). Frohlich, D.M. et al (2017) Designing interactive newsprint. International Journal of Human Computer Studies 104:36-49. Lindley, S. E., & Monk, A. F. (2005). Augmenting photographs with sound for collocated sharing. In Home-Oriented Informatics and Telematics (pp. 155-170). Springer US. Signer & Norrie 2010 Interactive paper: Past, present and future. UbiComp ‘10

×