Songs of Data: An Introduction to Sonification
•Download as PPTX, PDF•
1 like•582 views
Sonification is a complementary, but lesser known, technique to visualization. In this seminar, we will introduce the technique and discuss some applications, such as working with the texts of Shakespeare or social media data. We will discuss some of the principles in designing sonifications to explore data sets, some of the technologies used and the difficulties encountered.
Recommended
Recommended
More Related Content
Similar to Songs of Data: An Introduction to Sonification
Similar to Songs of Data: An Introduction to Sonification (13)
Recently uploaded
Recently uploaded (20)
Songs of Data: An Introduction to Sonification
- 1. Songs of Data An introduction to sonification Iain Emsley Oxford e-Research Centre, University of Oxford iain.emsley@oerc.ox.ac.uk @iainemsley @minnelieder 1
- 2. Overview • Introduction to Sonification • Sonifying Hamlet • Auditory Beacons • Identifying Signal to Noise in Twitter • Hemlines and Big Macs • Some Principles • Conclusions 2
- 3. Introduction to Sonification • What is sonification? – Sonification is an alternative to visualization “the use of non-speech audio to convey information. More specifically, sonification is the transformation of data relations into perceived relations in an acoustic signal for the purposes of facilitating communication or interpretation.” (Kramer, 1997) • Using it for analysis 3
- 4. Introduction to Sonification • Listening to Wikipedia - Hatnote • We Need You – Julie Freeman using Zooniverse 4
- 5. Sonifying Hamlet 5 • Sonifying the Variants • Auditory Beacons
- 6. Sonifying the Variants • From Play to Sonification • Using First Folio and Quartos data • Parsing the TEI XML, converting it with rule set into numbers, sonifying the data to produce sounds 6 Sonification
- 7. Auditory Beacons • Acts and Scenes – Different Instruments and Pitches • Stage Directions – Different instruments – Period versus Modern sounds? • Speakers – Increasing volume – Stereoscopic illusion using two streams
- 8. Identifying Signal to Noise in Twitter • Data taken from mining Drupalcon • What is the amount of information?
- 9. Hemlines and Big Macs • What do the above have in common?
- 10. Hemlines and Big Macs • Light hearted views of economic data • https://www.foreignaffairs.com/audios/2015-07-22/sound-economy
- 11. Some Principles • Consider the aspect of data that will be useful • Research the data and context • Group sounds together
- 12. Conclusions • Perceptions altered – Choices of sound – Use of multiple parameters • Use of spatial and temporal events • An alternative method to explain and explore data 12
- 13. Thank you for listening Any questions? iain.emsley@oerc.ox.ac.uk @iainemsley @minnelieder 13
- 14. References De Roure, David C., Cruickshank, Don G., Michaelides, Danius T., Page, Kevin R. and Weal, Mark J. (2002) On Hyperstructure and Musical Structure. The Thirteenth ACM Conference on Hypertext and Hypermedia (Hypertext 2002), Maryland, USA, 11 - 15 Jun 2002. ACM, 95-104. Iain Emsley and David De Roure, 2015. It will discourse most eloquent music: Sonifying variants of Hamlet., http://ora.ox.ac.uk/objects/uuid:1785e0ac-5cbb-4d35-8546-4495aa8baec8 William W. Gaver. 1986. Auditory icons: using sound in computer interfaces. Hum.-Comput. Interact. 2, 2 (June 1986), 167-177. http://dx.doi.org/10.1207/s15327051hci0202_3 The Big Mac index, The Economist, http://www.economist.com/content/big-mac-index Thomas Hermann, Andy Hunt, John G. Neuhoff (Eds.), The Sonification Handbook, Edited by Logos Publishing House, Berlin 2011, 586 pages, 1. edition (11/2011) Gregory Kramer. 1993. Auditory Display: Sonification, Audification, and Auditory Interfaces. Perseus Publishing. G. Kramer, B. Walker, T. Bonebright, et al., Sonification report: Status of the field and research agenda Prepared for the National Science Foundation by members of the International Community for Auditory Display (1997) http://sonify.psych.gatech.edu/publications/pdfs/1999-NSF-Report.pdf Chandrasekhar Ramakrishnan and Steven Greenwood, Entropy Sonification, Proceedings of the 15th International Conference on Auditory Display, Copenhagen, Denmark May 18 - 22, 2009 Digital facsimile of the Bodleian First Folio of Shakespeare's plays, Arch. G c.7, First Folio home page, http://firstfolio.bodleian.ox.ac.uk/ The tragedy of Hamlet Prince of Denmarke: an electronic edition, Hamlet, First Quarto, 1603. British Library Shelfmark: C.34.k.1, http://www.quartos.org/XML_Orig/ham-1603-22275x-bli-c01_orig.xml The tragedy of Hamlet Prince of Denmarke: an electronic edition, Hamlet, Second Quarto Variant, 1605. British Library Shelfmark: C.34.k.2, http://www.quartos.org/XML_Orig/ham-1605-22276a-bli-c01_orig.xml
Editor's Notes
- Sonification as an alternative or complement to visualisation. This is the standard definition of sonification. *pause* We believe that it can be extended into analytics. Does not help if we want to use this for analytics – see Bijsterveld and Supper’s work
- In Listening..., Hatnote sonifies the size of change using a Wikipedia feed with a simple sonification. We try to move to music rather than sound. Julie Freeman using music to sonify click stream actions on the Zooniverse site.
- William Gaver 1982 paper.
- ----- Meeting Notes (25/10/15 20:38) ----- Pipeline to transform the XML into numbers according to a simple set of rules. These numbers are then transformed into sound in the black box. Mention the Hinman collator here and stereoscopy. Used the First Folio Hamlet and the Quartos variants as the test data. One stream Two steams to create an audio version of a steroscopic illusion.
- Challenges of making the information useful for the listener. Acts & Scenes are relatively static. We can be confident that they will be in each play. Stage directions - use different instruments. *pause* do we use the period sounds versus modern sounds? How does this affect the listener? Speakers - same instrument with different pitches. Also use increasing volumes as a way marker.
- Mined hashtags from a Twitter stream from Drupalcon. Used entropy functions to work out the amount of information in the stream. Using two channels, we alter the perception by subtly moving the noise from the middle of the head towards one ear. A future experiment looks at extending this work and combining them
- Question for the audience.
- Both are light hearted view of economic data. Big Mac data as the purchasing-power parity index from the Economist. Used the idea of the Big Mac as an index for whether a currency is overvalued. Hemline – the swanee whistle as the sound – but connotations of sexism. Trying to think of a way of making a sound appealing but also recognisable.
- The brain can only understand a limited amount of simultaneous voices. Grouping the sounds together to help the listener understand groupings in the data.
- Either single channel or stereo channels. Helping the user associate the sound with the underlying meaning Stereo channels allows for stereoscopic channels. Sonification for interpretation and analysis. It is not as well researched as visualization.