SlideShare a Scribd company logo
Visualising Voices
developing linguistically versatile
digital audio analysis methods for
poetry in performance
Dr Caroline Ardrey, The University of Birmingham
Projects
The Baudelaire Song Project (AHRC-funded 2015 -2019) @baudelaireproj
Visualising Voice (Europeana Research Award, 2017)
• PI: Prof Helen Abbott (Modern Languages, University of Birmingham)
• Co-I: Dr Mylène Dubiau (Musicology, Université Toulouse, Jean-Jaurès)
• External Consultant: Dr Caroline Potter (French Musicology, Kingston University)
• Research Associate: Dr Caroline Ardrey (Modern Languages, University of Birmingham)
• Research Associate: Dr Caroline Ardrey (Modern Languages, University of Birmingham)
• Software Developer: Tom Cowley (Ed tech specialist, Red Circle Software)
• Nicholas Cook, Beyond the Score: Music as Performance (New York,
NY: OUP, 2014)
• Daniel Leech-Wilkinson, The Changing Sound of Music: Approaches to
Studying Recorded Musical Performance (London: CHARM, 2009)
• Charles Bernstein (PennSound), Close Listening: Poetry and the
Performed Word (New York, NY: OUP, 1998)
• Tanya Clement (PennSound), “Distant Listening or Playing
Visualisations Pleasantly with the Eyes and Ears”, Digital Studies / Le
Champ Numérique, 3, 2 (2012)
Digital Sound & Voice Studies
The Baudelaire Song Project
Charles Baudelaire (1821 – 1867)
• Verse: Les Fleurs du Mal (1857)
• Prose: Le Spleen de Paris / Petits poèmes en
prose (1868)
The Baudelaire Song Project
• 4 years of AHRC funding
• Core team of 3 researchers
• Interdisciplinary – word & music studies
• Database  broad overview of reception of Baudelaire in song
• Analyses  close listening (cf. Nicholas Cook)
• Working with digital sources / resources (audio files)
• Analyses largely dealing with songs in original French
• Strategies for dealing with other languages
Baudelaire in Song
• There are currently over 1100 songs in
the Baudelaire Song Project database
• Patterns begin to emerge amongst
certain groups of composers / singers
• Baudelaire’s reception history in song
can be mapped visually tracing
personal and professional links
between composers, songwriters and
singers
• The graph on the left represents a
small cross-section of the relationships
between composers setting Baudelaire
to music in the 19th & 20th centuries
Song Analysis Markup in
Sonic Visualiser
Louis Vierne, “Recueillement” (1921)
(sonnet by Baudelaire)
From Voice to Visualisation
Claude Debussy “La Mort des amants” (1890)
Poem structure layer data (SV export)
Sonnet form in French 14 lines 
Q1 – 4 lines
Q2 – 4 lines
--- volta ---
T1 – 3 lines
T2 – 3 lines
R = rest period (i.e. silence / instrumental interlude)
Visualising Voice
Visualising Voice
• Europeana Research Award (6 months)
• 1 researcher (me!) + 1 (main) software developer (non-academic)
• Public-facing focus
• Encourages users to engage with open-access digital archival materials
• Uses digital sources / resources (audio files)
• Simple, web-based interface for digital analysis
• Currently exploring strategies for working with other languages
• Potential for use in a pedagogical environment
https://visualisingvoice.eu
Paul Verlaine
(1844 – 1896)
Author: Otto Wegener (1849-1922)
Source: NYPL (CC-PD-Mark)
Author: Étienne Carjat (1828-1906)
Source: NYPL (CC-BY-2.0)
Arthur Rimbaud
(1854 – 1891)
Explore the Visualising Voice tool for yourself
https://visualisingvoice.eu
Visualising Voice: User Interface
Challenges of digital audio
analysis• Public engagement  how to make multilingual material accessible to a
broad / non-specialist audience?
• How to “standardize” the methodology?
• Need to work together with academics from different languages, from
audio analysis, from performance studies and musicology
• Availability of a sufficient / suitable range of audio recordings
• Quality of recordings affects accuracy of output
• Ethical approval needed for user-generated content
• Storage issues – both legal / ethical and in terms of file sizes!
• Working with digital audio materials brings copyright / legal issues
How to build-in linguistic versatility?
• Projects developed to deal with conventions of French versification
• Even simplified this still has something to tell us about speech in
general
• Questions over stress patterns in other languages – stress doesn’t
necessarily mean emphasis
• Need to work with specialists in poetry and in linguistics
• Underscores the collaborative aspect of work in the digital humanities
• Parallels between interdisciplinarity of ML and DH

More Related Content

Similar to Caroline Ardrey (University of Birmingham)

The convergence of "hard" and "soft"in music technology, Rolf Inge Godøy, UiO
The convergence of "hard" and "soft"in music technology, Rolf Inge Godøy, UiOThe convergence of "hard" and "soft"in music technology, Rolf Inge Godøy, UiO
The convergence of "hard" and "soft"in music technology, Rolf Inge Godøy, UiO
The Research Council of Norway, IKTPLUSS
 
Authentic materials2
Authentic materials2Authentic materials2
Authentic materials2hhs
 
Berklee Valencia Info Session
Berklee Valencia Info SessionBerklee Valencia Info Session
Berklee Valencia Info SessionBerklee Valencia
 
Challenges and Opportunities in Digital Musicology
Challenges and Opportunities in Digital Musicology Challenges and Opportunities in Digital Musicology
Challenges and Opportunities in Digital Musicology
Eleanor Selfridge-Field
 
A virtual jukebox for europe's sound heritage
A virtual jukebox for europe's sound heritageA virtual jukebox for europe's sound heritage
A virtual jukebox for europe's sound heritage
Europeana_Sounds
 
H03 david haskiya_music_channel
H03 david haskiya_music_channelH03 david haskiya_music_channel
H03 david haskiya_music_channel
evaminerva
 
The Europeana Music Collections
The Europeana Music CollectionsThe Europeana Music Collections
The Europeana Music Collections
David Haskiya
 
H03 david haskiya_music_channel
H03 david haskiya_music_channelH03 david haskiya_music_channel
H03 david haskiya_music_channel
evaminerva
 
Archiving and disseminating sound archives – 1. Processes and procedures in...
Archiving and disseminating  sound archives – 1. Processes and procedures  in...Archiving and disseminating  sound archives – 1. Processes and procedures  in...
Archiving and disseminating sound archives – 1. Processes and procedures in...
Phonothèque MMSH
 
Soundscape
SoundscapeSoundscape
Soundscape
Maria Leonida
 
IASA 2014 Conference - Cape Town, South Africa #iasa2014
IASA 2014 Conference - Cape Town, South Africa #iasa2014IASA 2014 Conference - Cape Town, South Africa #iasa2014
IASA 2014 Conference - Cape Town, South Africa #iasa2014
Karen Du Toit
 
Alex Germains Curriculum Vitae November 2015
Alex Germains Curriculum Vitae November 2015Alex Germains Curriculum Vitae November 2015
Alex Germains Curriculum Vitae November 2015alex germains
 
David L Page DCI Project 1 Seminar Presentation.20180816.pdf
David L Page DCI Project 1 Seminar Presentation.20180816.pdfDavid L Page DCI Project 1 Seminar Presentation.20180816.pdf
David L Page DCI Project 1 Seminar Presentation.20180816.pdf
David L Page
 
The O'Neill Henebry Wax Cylinder Project HEAnet 2015 Crónán Ó Doibhlin 2015
The O'Neill Henebry Wax Cylinder Project HEAnet 2015 Crónán Ó Doibhlin 2015The O'Neill Henebry Wax Cylinder Project HEAnet 2015 Crónán Ó Doibhlin 2015
The O'Neill Henebry Wax Cylinder Project HEAnet 2015 Crónán Ó Doibhlin 2015
University College Cork
 
Europeana creative sound archives and social networks @ British and Irish S...
Europeana creative  sound archives and social networks  @ British and Irish S...Europeana creative  sound archives and social networks  @ British and Irish S...
Europeana creative sound archives and social networks @ British and Irish S...
Lizzy Komen
 
Maria Lobytsyna - Using Authentic, Online texts
Maria Lobytsyna - Using Authentic, Online textsMaria Lobytsyna - Using Authentic, Online texts
Maria Lobytsyna - Using Authentic, Online texts
MLTA of NSW
 
Authentic materials 2018 copy ppt
Authentic materials 2018 copy pptAuthentic materials 2018 copy ppt
Authentic materials 2018 copy ppt
hhs
 
Singing planting wheat, a song recorded in the field in 1964 by Marceau Gast ...
Singing planting wheat, a song recorded in the field in 1964 by Marceau Gast ...Singing planting wheat, a song recorded in the field in 1964 by Marceau Gast ...
Singing planting wheat, a song recorded in the field in 1964 by Marceau Gast ...
Phonothèque MMSH
 
machine learning x music
machine learning x musicmachine learning x music
machine learning x music
Yi-Hsuan Yang
 
Pitch session #2
Pitch session #2Pitch session #2
Pitch session #2
MaMAEvent
 

Similar to Caroline Ardrey (University of Birmingham) (20)

The convergence of "hard" and "soft"in music technology, Rolf Inge Godøy, UiO
The convergence of "hard" and "soft"in music technology, Rolf Inge Godøy, UiOThe convergence of "hard" and "soft"in music technology, Rolf Inge Godøy, UiO
The convergence of "hard" and "soft"in music technology, Rolf Inge Godøy, UiO
 
Authentic materials2
Authentic materials2Authentic materials2
Authentic materials2
 
Berklee Valencia Info Session
Berklee Valencia Info SessionBerklee Valencia Info Session
Berklee Valencia Info Session
 
Challenges and Opportunities in Digital Musicology
Challenges and Opportunities in Digital Musicology Challenges and Opportunities in Digital Musicology
Challenges and Opportunities in Digital Musicology
 
A virtual jukebox for europe's sound heritage
A virtual jukebox for europe's sound heritageA virtual jukebox for europe's sound heritage
A virtual jukebox for europe's sound heritage
 
H03 david haskiya_music_channel
H03 david haskiya_music_channelH03 david haskiya_music_channel
H03 david haskiya_music_channel
 
The Europeana Music Collections
The Europeana Music CollectionsThe Europeana Music Collections
The Europeana Music Collections
 
H03 david haskiya_music_channel
H03 david haskiya_music_channelH03 david haskiya_music_channel
H03 david haskiya_music_channel
 
Archiving and disseminating sound archives – 1. Processes and procedures in...
Archiving and disseminating  sound archives – 1. Processes and procedures  in...Archiving and disseminating  sound archives – 1. Processes and procedures  in...
Archiving and disseminating sound archives – 1. Processes and procedures in...
 
Soundscape
SoundscapeSoundscape
Soundscape
 
IASA 2014 Conference - Cape Town, South Africa #iasa2014
IASA 2014 Conference - Cape Town, South Africa #iasa2014IASA 2014 Conference - Cape Town, South Africa #iasa2014
IASA 2014 Conference - Cape Town, South Africa #iasa2014
 
Alex Germains Curriculum Vitae November 2015
Alex Germains Curriculum Vitae November 2015Alex Germains Curriculum Vitae November 2015
Alex Germains Curriculum Vitae November 2015
 
David L Page DCI Project 1 Seminar Presentation.20180816.pdf
David L Page DCI Project 1 Seminar Presentation.20180816.pdfDavid L Page DCI Project 1 Seminar Presentation.20180816.pdf
David L Page DCI Project 1 Seminar Presentation.20180816.pdf
 
The O'Neill Henebry Wax Cylinder Project HEAnet 2015 Crónán Ó Doibhlin 2015
The O'Neill Henebry Wax Cylinder Project HEAnet 2015 Crónán Ó Doibhlin 2015The O'Neill Henebry Wax Cylinder Project HEAnet 2015 Crónán Ó Doibhlin 2015
The O'Neill Henebry Wax Cylinder Project HEAnet 2015 Crónán Ó Doibhlin 2015
 
Europeana creative sound archives and social networks @ British and Irish S...
Europeana creative  sound archives and social networks  @ British and Irish S...Europeana creative  sound archives and social networks  @ British and Irish S...
Europeana creative sound archives and social networks @ British and Irish S...
 
Maria Lobytsyna - Using Authentic, Online texts
Maria Lobytsyna - Using Authentic, Online textsMaria Lobytsyna - Using Authentic, Online texts
Maria Lobytsyna - Using Authentic, Online texts
 
Authentic materials 2018 copy ppt
Authentic materials 2018 copy pptAuthentic materials 2018 copy ppt
Authentic materials 2018 copy ppt
 
Singing planting wheat, a song recorded in the field in 1964 by Marceau Gast ...
Singing planting wheat, a song recorded in the field in 1964 by Marceau Gast ...Singing planting wheat, a song recorded in the field in 1964 by Marceau Gast ...
Singing planting wheat, a song recorded in the field in 1964 by Marceau Gast ...
 
machine learning x music
machine learning x musicmachine learning x music
machine learning x music
 
Pitch session #2
Pitch session #2Pitch session #2
Pitch session #2
 

Recently uploaded

Azure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHatAzure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHat
Scholarhat
 
Normal Labour/ Stages of Labour/ Mechanism of Labour
Normal Labour/ Stages of Labour/ Mechanism of LabourNormal Labour/ Stages of Labour/ Mechanism of Labour
Normal Labour/ Stages of Labour/ Mechanism of Labour
Wasim Ak
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
Atul Kumar Singh
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
MysoreMuleSoftMeetup
 
Introduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp NetworkIntroduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp Network
TechSoup
 
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
Nguyen Thanh Tu Collection
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
Vivekanand Anglo Vedic Academy
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
Pavel ( NSTU)
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
Sandy Millin
 
Multithreading_in_C++ - std::thread, race condition
Multithreading_in_C++ - std::thread, race conditionMultithreading_in_C++ - std::thread, race condition
Multithreading_in_C++ - std::thread, race condition
Mohammed Sikander
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
Special education needs
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
Jean Carlos Nunes Paixão
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
camakaiclarkmusic
 
How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
Jisc
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
Jisc
 
"Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe..."Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe...
SACHIN R KONDAGURI
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Thiyagu K
 
Francesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptxFrancesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptx
EduSkills OECD
 
A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
Peter Windle
 
A Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptxA Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptx
thanhdowork
 

Recently uploaded (20)

Azure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHatAzure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHat
 
Normal Labour/ Stages of Labour/ Mechanism of Labour
Normal Labour/ Stages of Labour/ Mechanism of LabourNormal Labour/ Stages of Labour/ Mechanism of Labour
Normal Labour/ Stages of Labour/ Mechanism of Labour
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
 
Introduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp NetworkIntroduction to AI for Nonprofits with Tapp Network
Introduction to AI for Nonprofits with Tapp Network
 
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
BÀI TẬP BỔ TRỢ TIẾNG ANH GLOBAL SUCCESS LỚP 3 - CẢ NĂM (CÓ FILE NGHE VÀ ĐÁP Á...
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
 
Synthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptxSynthetic Fiber Construction in lab .pptx
Synthetic Fiber Construction in lab .pptx
 
2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...2024.06.01 Introducing a competency framework for languag learning materials ...
2024.06.01 Introducing a competency framework for languag learning materials ...
 
Multithreading_in_C++ - std::thread, race condition
Multithreading_in_C++ - std::thread, race conditionMultithreading_in_C++ - std::thread, race condition
Multithreading_in_C++ - std::thread, race condition
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
 
CACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdfCACJapan - GROUP Presentation 1- Wk 4.pdf
CACJapan - GROUP Presentation 1- Wk 4.pdf
 
How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
 
The approach at University of Liverpool.pptx
The approach at University of Liverpool.pptxThe approach at University of Liverpool.pptx
The approach at University of Liverpool.pptx
 
"Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe..."Protectable subject matters, Protection in biotechnology, Protection of othe...
"Protectable subject matters, Protection in biotechnology, Protection of othe...
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
 
Francesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptxFrancesca Gottschalk - How can education support child empowerment.pptx
Francesca Gottschalk - How can education support child empowerment.pptx
 
A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
 
A Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptxA Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptx
 

Caroline Ardrey (University of Birmingham)

  • 1. Visualising Voices developing linguistically versatile digital audio analysis methods for poetry in performance Dr Caroline Ardrey, The University of Birmingham
  • 2. Projects The Baudelaire Song Project (AHRC-funded 2015 -2019) @baudelaireproj Visualising Voice (Europeana Research Award, 2017) • PI: Prof Helen Abbott (Modern Languages, University of Birmingham) • Co-I: Dr Mylène Dubiau (Musicology, Université Toulouse, Jean-Jaurès) • External Consultant: Dr Caroline Potter (French Musicology, Kingston University) • Research Associate: Dr Caroline Ardrey (Modern Languages, University of Birmingham) • Research Associate: Dr Caroline Ardrey (Modern Languages, University of Birmingham) • Software Developer: Tom Cowley (Ed tech specialist, Red Circle Software)
  • 3. • Nicholas Cook, Beyond the Score: Music as Performance (New York, NY: OUP, 2014) • Daniel Leech-Wilkinson, The Changing Sound of Music: Approaches to Studying Recorded Musical Performance (London: CHARM, 2009) • Charles Bernstein (PennSound), Close Listening: Poetry and the Performed Word (New York, NY: OUP, 1998) • Tanya Clement (PennSound), “Distant Listening or Playing Visualisations Pleasantly with the Eyes and Ears”, Digital Studies / Le Champ Numérique, 3, 2 (2012) Digital Sound & Voice Studies
  • 5. Charles Baudelaire (1821 – 1867) • Verse: Les Fleurs du Mal (1857) • Prose: Le Spleen de Paris / Petits poèmes en prose (1868)
  • 6. The Baudelaire Song Project • 4 years of AHRC funding • Core team of 3 researchers • Interdisciplinary – word & music studies • Database  broad overview of reception of Baudelaire in song • Analyses  close listening (cf. Nicholas Cook) • Working with digital sources / resources (audio files) • Analyses largely dealing with songs in original French • Strategies for dealing with other languages
  • 7. Baudelaire in Song • There are currently over 1100 songs in the Baudelaire Song Project database • Patterns begin to emerge amongst certain groups of composers / singers • Baudelaire’s reception history in song can be mapped visually tracing personal and professional links between composers, songwriters and singers • The graph on the left represents a small cross-section of the relationships between composers setting Baudelaire to music in the 19th & 20th centuries
  • 8. Song Analysis Markup in Sonic Visualiser
  • 9. Louis Vierne, “Recueillement” (1921) (sonnet by Baudelaire) From Voice to Visualisation
  • 10. Claude Debussy “La Mort des amants” (1890) Poem structure layer data (SV export) Sonnet form in French 14 lines  Q1 – 4 lines Q2 – 4 lines --- volta --- T1 – 3 lines T2 – 3 lines R = rest period (i.e. silence / instrumental interlude)
  • 12. Visualising Voice • Europeana Research Award (6 months) • 1 researcher (me!) + 1 (main) software developer (non-academic) • Public-facing focus • Encourages users to engage with open-access digital archival materials • Uses digital sources / resources (audio files) • Simple, web-based interface for digital analysis • Currently exploring strategies for working with other languages • Potential for use in a pedagogical environment https://visualisingvoice.eu
  • 13. Paul Verlaine (1844 – 1896) Author: Otto Wegener (1849-1922) Source: NYPL (CC-PD-Mark) Author: Étienne Carjat (1828-1906) Source: NYPL (CC-BY-2.0) Arthur Rimbaud (1854 – 1891)
  • 14. Explore the Visualising Voice tool for yourself https://visualisingvoice.eu Visualising Voice: User Interface
  • 15.
  • 16.
  • 17.
  • 18.
  • 19. Challenges of digital audio analysis• Public engagement  how to make multilingual material accessible to a broad / non-specialist audience? • How to “standardize” the methodology? • Need to work together with academics from different languages, from audio analysis, from performance studies and musicology • Availability of a sufficient / suitable range of audio recordings • Quality of recordings affects accuracy of output • Ethical approval needed for user-generated content • Storage issues – both legal / ethical and in terms of file sizes! • Working with digital audio materials brings copyright / legal issues
  • 20. How to build-in linguistic versatility? • Projects developed to deal with conventions of French versification • Even simplified this still has something to tell us about speech in general • Questions over stress patterns in other languages – stress doesn’t necessarily mean emphasis • Need to work with specialists in poetry and in linguistics • Underscores the collaborative aspect of work in the digital humanities • Parallels between interdisciplinarity of ML and DH

Editor's Notes

  1. Of course, analysing audio files is not, in itself, something new.