SlideShare a Scribd company logo
Analysis, Modelling and Synthesis of  British, Australian and American  Accents Qin Yan  Saeed Vaseghi Multimedia Communication Signal processing Lab Department of Electronic and Computer Engineering Brunel University Supported by EPSRC
Content ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],1.  Introduction to  Phonetics and Acoustics of Accents
[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
(b) Pitch prosody correlates of accents, include : (i) Pitch trajectory at  various  linguistic contexts and positions . e.g. pitch rise, at  the beginning of a voiced group or phrase, pitch fall at the end of a phrase . (ii) Pitch nucleus i.e. the timing and magnitude of the  prominent pitch  event  in    a voiced group. (c)  Duration and Timing correlates of accents, (i) Duration of vowels and dip h thongs . (ii) Relative duration and timings of the two  constituent vowels  of dip h thongs. (d) Laryngeal (glottal) correlates of accents , i.e the voice quality of speech  segments in certain contexts as a function of accent .
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Accent Profile (AP) Parameters Comments Rank Phonetic Parameters Substitution, insertion, deletion  Pronunciation differences obtained from phonetic transcription dictionaries ***** Supra-laryngeal and Laryngeal Correlates Formants & their trajectories 2 nd  formant with largest variance is most sensitive to accent  **** Glottal pulse (Voice Quality) Durations and shapes of opening and closing of glottal folds ** Prosody Correlates F 0  mean  Average of pitch * F 0  range  Range of pitch * Pitch Nucleus  Prominent point (stressed) within an intonation group (Tone Unit) *** Initial Pitch Rise First pitch slope of a narrative utterance *** Final Pitch Lowering  Final fall pitch slope of a narrative utterance *** Final Pitch Rise Final rise pitch slope of a narrative utterance  *** Timing and Delivery Correlates Speaking Rate  Phonemes or words per second  * Phoneme Duration  Vowel duration elongation and complete pronunciation all affect *** Excessive Co-articulation Clipped or short duration sounds  ****
Speech Accent Feature Analysis Method ,[object Object],[object Object],[object Object],[object Object],[object Object],HMM   Training Labeling & Segmentation Formants & Trajectories Pitch Contour Tracker Pitch  Marker Tone Nucleus  Features F0 Range/Mean Pitch Accents Accent Profile Speaking Rate & Durations Input Speech Block diagram illustration of the processes involved in accent analysis
Analysis   of  Duration Correlate  of AU, US and UK Accent Speech Figure:  Comparison of s peaking rates of British, Australian and American.   Figure: Comparison of phoneme durations of British, Australian and American. 0.02 0.04 0.06 0.08 0.1 0.12 0.14 0.16 0.18 0.2 aa ae ah ao aw ay eh er ey ih iy ow oy uh uw Australian British American Duration (sec)
Table : (%) word error of speech recognition across British, American and Australian accents. ,[object Object],[object Object],Comparison of speaking rates of British, American and Australian Accents. ,[object Object],[object Object],7.28 27.3 33.1 Australian 29.94 8.8  30.6 American 34.9 29.3 12.8 British Australian  Model American Model British Model Model Input  Speaking Rate (number/sec)   Phone   Word British 12.1 3.64 American 11.6 3.1 Australian 10.8 2.8
Formant Estimation with 2D-HMM Segmentation  & window LPC Model Polynomial roots LP-based Formant-candidate feature extraction method Formant  candidate Feature vector  Speech Frequency,Bandwidth Intensity Calculation ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object], estimator
Frequency(Hz) Time(s) Illustration of of LP spectrum and the modelling of 6 complex pole pairs of a speech segment with an HMM composed of 4 formant-states.  ,[object Object],[object Object],[object Object]
Three spectrogram examples of formant tracks superimposed on LPC spectrum of speech
Comparison of histograms (thin solid line) and Gaussian HMMs of formants of Australian English (bold dashed line). X axis: frequency (Hz); Y axis: probability. The figures show that HMMS are excellent models of the distribution of the formants.
Comparison of Formants Spaces of American, Australian and British Accents ,[object Object],[object Object],[object Object],[object Object],[object Object],F1 vs F2 space of British, Australian and American English.  Click phoneme to listen .
Figure : Comparison of trajectories and target time of formant of  British,   Australian and American  accents
[object Object],Formant Ranking using a normalised distance Figure : Comparison of formants of Australian, British and American (female) Formant Ranking Order Accent Pairs 4 th 3 rd 1 st 2 nd Australian &  American 4 th 3 rd 1 st 2 nd   British & American 3 rd 4 th 2 nd 1 st   British & Australian 4 3 2 1
Accent Morphing  Method Figure : Diagram of a voice morphing system used for accent conversion  Source Speech Speech Labeling & Segmentation Formant Mapping Formant Estimation Prosody Modification Accent Model HMM   Training/ Adaptation Accent Synthesised Speech ,[object Object],[object Object],[object Object],[object Object],Pitch Tracker
Formant Transformation via Non-Uniform LP Frequency Warping Figure Illustration of a non-uniform frequency warping using LP model frequency response. The spectrum is divided into a number of bands centered on the formants and a different set of warping parameters is applied to each band. F 01 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 -75 -70 -65 -60 -55 -50 -45 -40 -35 F 12 F 23 F 34 F 45 BW 1 BW 2 BW 3 BW 4 I 12 I 23 I 34 Magnitude (dB) Frequency (Hz) Figure : Illustration modification of spectrum towards formants of target accent  Speech Linear Prediction Model LP Spectrum  Mapping Formant Estimation Formant Transformation Ratios Accent modified  spectrum Formant HMMs Polynomial roots Pole estimation
The frequency bands of the source speaker [ F 01 F 12 F 23 F 34 F 45 ]  are mapped to the target accent using a set of warping  ratios  derived from differences in the formants of phonetic segments of speech across accents  as ) 1 ( ) 1 ( ) 1 (     i i i i i i f f  S i S i T i T i i i f f f f       1 1 ) 1 (  Where  f i T  and  f i S  are the  i th  formants of the source and target accents  The frequency mapping can be expressed as Figure : Illustration of warped(solid line)  and original(dash dot line) formant trajectories of  /aa/ in accent conversion from Australian to British.
Pitch Modification Using Time Domain PSOLA (TD-PSOLA) Source pitch marks Target pitch marks ,[object Object],Source Speech Pitch Marks Target  Speech Pitch Marks Illustration of mapping of pitch periods of a source speech to a target
Examples of changes in accent/duration modulation of pitch  (a)  ‘article’ in Australian, (b)  Australian-accent ‘article’ transformed to British accent (c)  ‘asked’ in Australian, (d)  Australian-accent ‘article’ transformed to British accent (a) (b) (c) (d)
Model  Estimation LP Model Formant Trajectory Source  Speech Target Speech LP Model Formant Trajectory Mapped  Speech Warping  Factors Target  Speaker HMM Model Source  Speaker HMM Model Formant  Tracking Formant Mapping Speech Recon struction Speech  Reconstruction LPC - Spectrum Warping / Pole Rotation Model  Estimation LP Model Formant Trajectory Source  Speech Target Speech LP Model Formant Trajectory Mapped  Speech Warping  Factors Target  Speaker HMM Model Source  Speaker HMM Model Formant  Tracking Formant Mapping Speech Recon - struction Speech  Reconstruction LPC - Spectrum Warping / Pole Rotation Transformed(AM m->f) American male American female An Outline of Voice-Morph: A system for Voice and Accent Conversion An example of voice conversion
Accent Conversion Demonstration Australian British Transformed British American Transformed ‘ Article’ ‘ Claim’ ‘ Cooperation ’ ‘ Beige’ Source Accent Target   Accent Spoken word ‘ Boston’ ‘ Opposition’ ‘ The occupied’
The End

More Related Content

What's hot

Minimal pairs and phonotactic constraints ms lizardo
Minimal pairs and phonotactic constraints   ms lizardoMinimal pairs and phonotactic constraints   ms lizardo
Minimal pairs and phonotactic constraints ms lizardo
Carl Richard Dagalea
 
Phonology: Phones, Syllables & Phonotactics
Phonology: Phones, Syllables & PhonotacticsPhonology: Phones, Syllables & Phonotactics
Phonology: Phones, Syllables & Phonotactics
Chad Eller
 
A Study of the Influence of /ɹ/ on /a/ and the Diphthongisation of Tense Vowe...
A Study of the Influence of /ɹ/ on /a/ and the Diphthongisation of Tense Vowe...A Study of the Influence of /ɹ/ on /a/ and the Diphthongisation of Tense Vowe...
A Study of the Influence of /ɹ/ on /a/ and the Diphthongisation of Tense Vowe...
Megan Byrne
 
江振宇/It's Not What You Say: It's How You Say It!
江振宇/It's Not What You Say: It's How You Say It!江振宇/It's Not What You Say: It's How You Say It!
江振宇/It's Not What You Say: It's How You Say It!
台灣資料科學年會
 
How many vowel sounds in English?
How many vowel sounds in English?How many vowel sounds in English?
How many vowel sounds in English?
Marcos Luk'aña
 
Ll Lower pri D - Vowel and consonant phonemes
Ll Lower pri D - Vowel and consonant phonemesLl Lower pri D - Vowel and consonant phonemes
Ll Lower pri D - Vowel and consonant phonemes
Languagelab Group
 
Minimal pairs and minimal sets in Phonology
Minimal pairs and minimal sets in PhonologyMinimal pairs and minimal sets in Phonology
Minimal pairs and minimal sets in Phonology
YahyaChoy
 
International Refereed Journal of Engineering and Science (IRJES)
International Refereed Journal of Engineering and Science (IRJES)International Refereed Journal of Engineering and Science (IRJES)
International Refereed Journal of Engineering and Science (IRJES)
irjes
 
Ph3 Introduction To The Syllable
Ph3 Introduction To The SyllablePh3 Introduction To The Syllable
Ph3 Introduction To The Syllable
Jordán Masías
 
Phonetics phonology
Phonetics phonologyPhonetics phonology
Phonetics phonology
AndresitoMaurtua
 
Suprasegmantal features
Suprasegmantal featuresSuprasegmantal features
Suprasegmantal features
HabibQazi2
 
Introduction to Phonetic Science
Introduction to Phonetic ScienceIntroduction to Phonetic Science
Introduction to Phonetic Science
Vinnytsya Language School
 
Class phonetics and phonology - phoneme
Class   phonetics and phonology - phonemeClass   phonetics and phonology - phoneme
Class phonetics and phonology - phoneme
Zahra Azlan
 
English phonology
English phonologyEnglish phonology
English phonology
leonardito24
 
Rhymes
RhymesRhymes
Lecture 3 phonetics
Lecture 3 phoneticsLecture 3 phonetics
Lecture 3 phonetics
DildoraYuldasheva1
 
G1074853
G1074853G1074853
G1074853
IJERD Editor
 

What's hot (17)

Minimal pairs and phonotactic constraints ms lizardo
Minimal pairs and phonotactic constraints   ms lizardoMinimal pairs and phonotactic constraints   ms lizardo
Minimal pairs and phonotactic constraints ms lizardo
 
Phonology: Phones, Syllables & Phonotactics
Phonology: Phones, Syllables & PhonotacticsPhonology: Phones, Syllables & Phonotactics
Phonology: Phones, Syllables & Phonotactics
 
A Study of the Influence of /ɹ/ on /a/ and the Diphthongisation of Tense Vowe...
A Study of the Influence of /ɹ/ on /a/ and the Diphthongisation of Tense Vowe...A Study of the Influence of /ɹ/ on /a/ and the Diphthongisation of Tense Vowe...
A Study of the Influence of /ɹ/ on /a/ and the Diphthongisation of Tense Vowe...
 
江振宇/It's Not What You Say: It's How You Say It!
江振宇/It's Not What You Say: It's How You Say It!江振宇/It's Not What You Say: It's How You Say It!
江振宇/It's Not What You Say: It's How You Say It!
 
How many vowel sounds in English?
How many vowel sounds in English?How many vowel sounds in English?
How many vowel sounds in English?
 
Ll Lower pri D - Vowel and consonant phonemes
Ll Lower pri D - Vowel and consonant phonemesLl Lower pri D - Vowel and consonant phonemes
Ll Lower pri D - Vowel and consonant phonemes
 
Minimal pairs and minimal sets in Phonology
Minimal pairs and minimal sets in PhonologyMinimal pairs and minimal sets in Phonology
Minimal pairs and minimal sets in Phonology
 
International Refereed Journal of Engineering and Science (IRJES)
International Refereed Journal of Engineering and Science (IRJES)International Refereed Journal of Engineering and Science (IRJES)
International Refereed Journal of Engineering and Science (IRJES)
 
Ph3 Introduction To The Syllable
Ph3 Introduction To The SyllablePh3 Introduction To The Syllable
Ph3 Introduction To The Syllable
 
Phonetics phonology
Phonetics phonologyPhonetics phonology
Phonetics phonology
 
Suprasegmantal features
Suprasegmantal featuresSuprasegmantal features
Suprasegmantal features
 
Introduction to Phonetic Science
Introduction to Phonetic ScienceIntroduction to Phonetic Science
Introduction to Phonetic Science
 
Class phonetics and phonology - phoneme
Class   phonetics and phonology - phonemeClass   phonetics and phonology - phoneme
Class phonetics and phonology - phoneme
 
English phonology
English phonologyEnglish phonology
English phonology
 
Rhymes
RhymesRhymes
Rhymes
 
Lecture 3 phonetics
Lecture 3 phoneticsLecture 3 phonetics
Lecture 3 phonetics
 
G1074853
G1074853G1074853
G1074853
 

Similar to Accent seminar

(Emerson) Phonetics & Phonology.pptx
(Emerson) Phonetics & Phonology.pptx(Emerson) Phonetics & Phonology.pptx
(Emerson) Phonetics & Phonology.pptx
ShamsUlFatah
 
Phonological CA
Phonological CAPhonological CA
Phonological CA
Adel Rahimi
 
B047006011
B047006011B047006011
B047006011
inventy
 
B047006011
B047006011B047006011
B047006011
inventy
 
Week 3 phonology copy
Week 3  phonology   copyWeek 3  phonology   copy
Week 3 phonology copy
Dr. Russell Rodrigo
 
Nurlen Power point Phoneme
Nurlen Power point PhonemeNurlen Power point Phoneme
Nurlen Power point Phoneme
nurlennurlen30
 
Introduction to Language and Linguistics 002: Introduction to Phonetics
Introduction to Language and Linguistics 002: Introduction to PhoneticsIntroduction to Language and Linguistics 002: Introduction to Phonetics
Introduction to Language and Linguistics 002: Introduction to Phonetics
Meagan Louie
 
DYNAMIC PHONE WARPING – A METHOD TO MEASURE THE DISTANCE BETWEEN PRONUNCIATIONS
DYNAMIC PHONE WARPING – A METHOD TO MEASURE THE DISTANCE BETWEEN PRONUNCIATIONS DYNAMIC PHONE WARPING – A METHOD TO MEASURE THE DISTANCE BETWEEN PRONUNCIATIONS
DYNAMIC PHONE WARPING – A METHOD TO MEASURE THE DISTANCE BETWEEN PRONUNCIATIONS
cscpconf
 
Phonology to be used
Phonology to be usedPhonology to be used
Phonology to be used
Jahanzeb Jahan
 
Acoustic phonetics
Acoustic phoneticsAcoustic phonetics
Acoustic phonetics
VivaAs
 
LING 100 - Review on Phonological Analysis
LING 100 - Review on Phonological AnalysisLING 100 - Review on Phonological Analysis
LING 100 - Review on Phonological Analysis
Meagan Louie
 
Phonology
PhonologyPhonology
Phonology
kashifshahbaz
 
Phonology
PhonologyPhonology
Phonology
febti mahani
 
2 phonetics slides final
2 phonetics slides final2 phonetics slides final
2 phonetics slides final
Jasmine Wong
 
Condi Rice - American Dialect Society
Condi Rice - American Dialect SocietyCondi Rice - American Dialect Society
Condi Rice - American Dialect Society
Lauren Hall-Lew
 
Unit 1
Unit 1Unit 1
Unit 1
mjgvalcarce
 
Research Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and ScienceResearch Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and Science
inventy
 
Basic concepts in phonetics
Basic concepts in phoneticsBasic concepts in phonetics
Basic concepts in phonetics
William Orellana
 
Main Branches of Linguistics LEPURA.pptx
Main Branches of Linguistics LEPURA.pptxMain Branches of Linguistics LEPURA.pptx
Main Branches of Linguistics LEPURA.pptx
CherryLaneLepura1
 
Teaching alphabetics and fluency in reading
Teaching alphabetics and fluency in readingTeaching alphabetics and fluency in reading
Teaching alphabetics and fluency in reading
Marcia Luptak
 

Similar to Accent seminar (20)

(Emerson) Phonetics & Phonology.pptx
(Emerson) Phonetics & Phonology.pptx(Emerson) Phonetics & Phonology.pptx
(Emerson) Phonetics & Phonology.pptx
 
Phonological CA
Phonological CAPhonological CA
Phonological CA
 
B047006011
B047006011B047006011
B047006011
 
B047006011
B047006011B047006011
B047006011
 
Week 3 phonology copy
Week 3  phonology   copyWeek 3  phonology   copy
Week 3 phonology copy
 
Nurlen Power point Phoneme
Nurlen Power point PhonemeNurlen Power point Phoneme
Nurlen Power point Phoneme
 
Introduction to Language and Linguistics 002: Introduction to Phonetics
Introduction to Language and Linguistics 002: Introduction to PhoneticsIntroduction to Language and Linguistics 002: Introduction to Phonetics
Introduction to Language and Linguistics 002: Introduction to Phonetics
 
DYNAMIC PHONE WARPING – A METHOD TO MEASURE THE DISTANCE BETWEEN PRONUNCIATIONS
DYNAMIC PHONE WARPING – A METHOD TO MEASURE THE DISTANCE BETWEEN PRONUNCIATIONS DYNAMIC PHONE WARPING – A METHOD TO MEASURE THE DISTANCE BETWEEN PRONUNCIATIONS
DYNAMIC PHONE WARPING – A METHOD TO MEASURE THE DISTANCE BETWEEN PRONUNCIATIONS
 
Phonology to be used
Phonology to be usedPhonology to be used
Phonology to be used
 
Acoustic phonetics
Acoustic phoneticsAcoustic phonetics
Acoustic phonetics
 
LING 100 - Review on Phonological Analysis
LING 100 - Review on Phonological AnalysisLING 100 - Review on Phonological Analysis
LING 100 - Review on Phonological Analysis
 
Phonology
PhonologyPhonology
Phonology
 
Phonology
PhonologyPhonology
Phonology
 
2 phonetics slides final
2 phonetics slides final2 phonetics slides final
2 phonetics slides final
 
Condi Rice - American Dialect Society
Condi Rice - American Dialect SocietyCondi Rice - American Dialect Society
Condi Rice - American Dialect Society
 
Unit 1
Unit 1Unit 1
Unit 1
 
Research Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and ScienceResearch Inventy : International Journal of Engineering and Science
Research Inventy : International Journal of Engineering and Science
 
Basic concepts in phonetics
Basic concepts in phoneticsBasic concepts in phonetics
Basic concepts in phonetics
 
Main Branches of Linguistics LEPURA.pptx
Main Branches of Linguistics LEPURA.pptxMain Branches of Linguistics LEPURA.pptx
Main Branches of Linguistics LEPURA.pptx
 
Teaching alphabetics and fluency in reading
Teaching alphabetics and fluency in readingTeaching alphabetics and fluency in reading
Teaching alphabetics and fluency in reading
 

More from Mayur Garg

16 high speedla-ns
16 high speedla-ns16 high speedla-ns
16 high speedla-ns
Mayur Garg
 
Web crawler synopsis
Web crawler synopsisWeb crawler synopsis
Web crawler synopsis
Mayur Garg
 
Web crawler synopsis
Web crawler synopsisWeb crawler synopsis
Web crawler synopsis
Mayur Garg
 
Attitude
AttitudeAttitude
Attitude
Mayur Garg
 
16 high speedla-ns
16 high speedla-ns16 high speedla-ns
16 high speedla-ns
Mayur Garg
 
Wireless presentation-1
Wireless presentation-1Wireless presentation-1
Wireless presentation-1
Mayur Garg
 

More from Mayur Garg (7)

16 high speedla-ns
16 high speedla-ns16 high speedla-ns
16 high speedla-ns
 
Nano
NanoNano
Nano
 
Web crawler synopsis
Web crawler synopsisWeb crawler synopsis
Web crawler synopsis
 
Web crawler synopsis
Web crawler synopsisWeb crawler synopsis
Web crawler synopsis
 
Attitude
AttitudeAttitude
Attitude
 
16 high speedla-ns
16 high speedla-ns16 high speedla-ns
16 high speedla-ns
 
Wireless presentation-1
Wireless presentation-1Wireless presentation-1
Wireless presentation-1
 

Recently uploaded

Azure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHatAzure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHat
Scholarhat
 
South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)
Academy of Science of South Africa
 
How to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRMHow to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRM
Celine George
 
Smart-Money for SMC traders good time and ICT
Smart-Money for SMC traders good time and ICTSmart-Money for SMC traders good time and ICT
Smart-Money for SMC traders good time and ICT
simonomuemu
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
Nicholas Montgomery
 
Cognitive Development Adolescence Psychology
Cognitive Development Adolescence PsychologyCognitive Development Adolescence Psychology
Cognitive Development Adolescence Psychology
paigestewart1632
 
C1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptx
C1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptxC1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptx
C1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptx
mulvey2
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
Israel Genealogy Research Association
 
Liberal Approach to the Study of Indian Politics.pdf
Liberal Approach to the Study of Indian Politics.pdfLiberal Approach to the Study of Indian Politics.pdf
Liberal Approach to the Study of Indian Politics.pdf
WaniBasim
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Fajar Baskoro
 
BBR 2024 Summer Sessions Interview Training
BBR  2024 Summer Sessions Interview TrainingBBR  2024 Summer Sessions Interview Training
BBR 2024 Summer Sessions Interview Training
Katrina Pritchard
 
How to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 InventoryHow to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 Inventory
Celine George
 
Digital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental DesignDigital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental Design
amberjdewit93
 
The simplified electron and muon model, Oscillating Spacetime: The Foundation...
The simplified electron and muon model, Oscillating Spacetime: The Foundation...The simplified electron and muon model, Oscillating Spacetime: The Foundation...
The simplified electron and muon model, Oscillating Spacetime: The Foundation...
RitikBhardwaj56
 
MARY JANE WILSON, A “BOA MÃE” .
MARY JANE WILSON, A “BOA MÃE”           .MARY JANE WILSON, A “BOA MÃE”           .
MARY JANE WILSON, A “BOA MÃE” .
Colégio Santa Teresinha
 
Film vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movieFilm vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movie
Nicholas Montgomery
 
World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024
ak6969907
 
Walmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdfWalmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdf
TechSoup
 
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Dr. Vinod Kumar Kanvaria
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
Dr. Mulla Adam Ali
 

Recently uploaded (20)

Azure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHatAzure Interview Questions and Answers PDF By ScholarHat
Azure Interview Questions and Answers PDF By ScholarHat
 
South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)
 
How to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRMHow to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRM
 
Smart-Money for SMC traders good time and ICT
Smart-Money for SMC traders good time and ICTSmart-Money for SMC traders good time and ICT
Smart-Money for SMC traders good time and ICT
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
 
Cognitive Development Adolescence Psychology
Cognitive Development Adolescence PsychologyCognitive Development Adolescence Psychology
Cognitive Development Adolescence Psychology
 
C1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptx
C1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptxC1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptx
C1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptx
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
 
Liberal Approach to the Study of Indian Politics.pdf
Liberal Approach to the Study of Indian Politics.pdfLiberal Approach to the Study of Indian Politics.pdf
Liberal Approach to the Study of Indian Politics.pdf
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
 
BBR 2024 Summer Sessions Interview Training
BBR  2024 Summer Sessions Interview TrainingBBR  2024 Summer Sessions Interview Training
BBR 2024 Summer Sessions Interview Training
 
How to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 InventoryHow to Setup Warehouse & Location in Odoo 17 Inventory
How to Setup Warehouse & Location in Odoo 17 Inventory
 
Digital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental DesignDigital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental Design
 
The simplified electron and muon model, Oscillating Spacetime: The Foundation...
The simplified electron and muon model, Oscillating Spacetime: The Foundation...The simplified electron and muon model, Oscillating Spacetime: The Foundation...
The simplified electron and muon model, Oscillating Spacetime: The Foundation...
 
MARY JANE WILSON, A “BOA MÃE” .
MARY JANE WILSON, A “BOA MÃE”           .MARY JANE WILSON, A “BOA MÃE”           .
MARY JANE WILSON, A “BOA MÃE” .
 
Film vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movieFilm vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movie
 
World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024World environment day ppt For 5 June 2024
World environment day ppt For 5 June 2024
 
Walmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdfWalmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdf
 
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
 

Accent seminar

  • 1. Analysis, Modelling and Synthesis of British, Australian and American Accents Qin Yan Saeed Vaseghi Multimedia Communication Signal processing Lab Department of Electronic and Computer Engineering Brunel University Supported by EPSRC
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7. (b) Pitch prosody correlates of accents, include : (i) Pitch trajectory at various linguistic contexts and positions . e.g. pitch rise, at the beginning of a voiced group or phrase, pitch fall at the end of a phrase . (ii) Pitch nucleus i.e. the timing and magnitude of the prominent pitch event in a voiced group. (c) Duration and Timing correlates of accents, (i) Duration of vowels and dip h thongs . (ii) Relative duration and timings of the two constituent vowels of dip h thongs. (d) Laryngeal (glottal) correlates of accents , i.e the voice quality of speech segments in certain contexts as a function of accent .
  • 8.
  • 9. Accent Profile (AP) Parameters Comments Rank Phonetic Parameters Substitution, insertion, deletion Pronunciation differences obtained from phonetic transcription dictionaries ***** Supra-laryngeal and Laryngeal Correlates Formants & their trajectories 2 nd formant with largest variance is most sensitive to accent **** Glottal pulse (Voice Quality) Durations and shapes of opening and closing of glottal folds ** Prosody Correlates F 0 mean Average of pitch * F 0 range Range of pitch * Pitch Nucleus Prominent point (stressed) within an intonation group (Tone Unit) *** Initial Pitch Rise First pitch slope of a narrative utterance *** Final Pitch Lowering Final fall pitch slope of a narrative utterance *** Final Pitch Rise Final rise pitch slope of a narrative utterance *** Timing and Delivery Correlates Speaking Rate Phonemes or words per second * Phoneme Duration Vowel duration elongation and complete pronunciation all affect *** Excessive Co-articulation Clipped or short duration sounds ****
  • 10.
  • 11. Analysis of Duration Correlate of AU, US and UK Accent Speech Figure: Comparison of s peaking rates of British, Australian and American. Figure: Comparison of phoneme durations of British, Australian and American. 0.02 0.04 0.06 0.08 0.1 0.12 0.14 0.16 0.18 0.2 aa ae ah ao aw ay eh er ey ih iy ow oy uh uw Australian British American Duration (sec)
  • 12.
  • 13.
  • 14.
  • 15. Three spectrogram examples of formant tracks superimposed on LPC spectrum of speech
  • 16. Comparison of histograms (thin solid line) and Gaussian HMMs of formants of Australian English (bold dashed line). X axis: frequency (Hz); Y axis: probability. The figures show that HMMS are excellent models of the distribution of the formants.
  • 17.
  • 18. Figure : Comparison of trajectories and target time of formant of British, Australian and American accents
  • 19.
  • 20.
  • 21. Formant Transformation via Non-Uniform LP Frequency Warping Figure Illustration of a non-uniform frequency warping using LP model frequency response. The spectrum is divided into a number of bands centered on the formants and a different set of warping parameters is applied to each band. F 01 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 -75 -70 -65 -60 -55 -50 -45 -40 -35 F 12 F 23 F 34 F 45 BW 1 BW 2 BW 3 BW 4 I 12 I 23 I 34 Magnitude (dB) Frequency (Hz) Figure : Illustration modification of spectrum towards formants of target accent Speech Linear Prediction Model LP Spectrum Mapping Formant Estimation Formant Transformation Ratios Accent modified spectrum Formant HMMs Polynomial roots Pole estimation
  • 22. The frequency bands of the source speaker [ F 01 F 12 F 23 F 34 F 45 ] are mapped to the target accent using a set of warping ratios derived from differences in the formants of phonetic segments of speech across accents as ) 1 ( ) 1 ( ) 1 (     i i i i i i f f  S i S i T i T i i i f f f f       1 1 ) 1 (  Where f i T and f i S are the i th formants of the source and target accents The frequency mapping can be expressed as Figure : Illustration of warped(solid line) and original(dash dot line) formant trajectories of /aa/ in accent conversion from Australian to British.
  • 23.
  • 24. Examples of changes in accent/duration modulation of pitch (a) ‘article’ in Australian, (b) Australian-accent ‘article’ transformed to British accent (c) ‘asked’ in Australian, (d) Australian-accent ‘article’ transformed to British accent (a) (b) (c) (d)
  • 25. Model Estimation LP Model Formant Trajectory Source Speech Target Speech LP Model Formant Trajectory Mapped Speech Warping Factors Target Speaker HMM Model Source Speaker HMM Model Formant Tracking Formant Mapping Speech Recon struction Speech Reconstruction LPC - Spectrum Warping / Pole Rotation Model Estimation LP Model Formant Trajectory Source Speech Target Speech LP Model Formant Trajectory Mapped Speech Warping Factors Target Speaker HMM Model Source Speaker HMM Model Formant Tracking Formant Mapping Speech Recon - struction Speech Reconstruction LPC - Spectrum Warping / Pole Rotation Transformed(AM m->f) American male American female An Outline of Voice-Morph: A system for Voice and Accent Conversion An example of voice conversion
  • 26. Accent Conversion Demonstration Australian British Transformed British American Transformed ‘ Article’ ‘ Claim’ ‘ Cooperation ’ ‘ Beige’ Source Accent Target Accent Spoken word ‘ Boston’ ‘ Opposition’ ‘ The occupied’