SlideShare a Scribd company logo
1 of 8
2023-11-03 1
ˈfoːniːm ɻʷɛkɪgˈnɪʃn
̩ fɚ ˈfan n
̩ ˈpɻʷɑfət̞
ˈjuːsɪz v
̩ ˈmoːɹˠ dəˈɹˠɛkt̞ ˌɻʷɛpɹˠɪzn
̩ ˈteːʃn
̩ z v
̩ ˈspiːʧ
dʒɪm oːˈɻʷiːgn
̩
Phoneme recognition for fan and prophet
Uses of more direct representations of speech
Jim O’Regan
Sidenote: I’m pretty sure my /əʊ/ is [oː]
2023-11-03 4
Overview
2023-11-03 5
● TA Duty
● Thesis supervision
● Speech data augmentation for improving phoneme transcriptions of aphasic
speech using wav2vec 2.0 for the PSST Challenge
○ Presented at RaPID4 Workshop, Marseille, France, June 25, 2022
● Language Variation in Parliamentary Speeches: First Steps Towards Robust
Phoneme Recognition
○ Presented at Nationella språkbankens höstworkshop, October 23, 2023 at the
University of Gothenburg
TA duty
2023-11-03 6
● Speech Technology (DT2112)
○ Jens Edlund
● Speech and Speaker Recognition (DT2119)
○ Jonas Beskow
Thesis supervision
2023-11-03 7
“Mispronunciation Detection with SpeechBlender Data Augmentation Pipeline.”
Yassine EL KHEIR
Examiner: Olov Engwall
Thesis supervision
2023-11-03 8
“Mispronunciation Detection with SpeechBlender Data Augmentation Pipeline.”
Yassine EL KHEIR
Examiner: Olov Engwall
Not online. Related paper:
Kheir, Y. E., Chowdhury, S. A., Ali, A., Mubarak, H., & Afzal, S. (2023). SpeechBlender:
Speech Augmentation Framework for Mispronunciation Data Generation. arXiv [Cs.SD].
Retrieved from http://arxiv.org/abs/2211.00923

More Related Content

Similar to 30% seminar "kappa"

Minin project review.pdf
Minin project review.pdfMinin project review.pdf
Minin project review.pdfSateeshReddy46
 
Performance estimation based recurrent-convolutional encoder decoder for spee...
Performance estimation based recurrent-convolutional encoder decoder for spee...Performance estimation based recurrent-convolutional encoder decoder for spee...
Performance estimation based recurrent-convolutional encoder decoder for spee...karthik annam
 
Multilingualism for Digital Europe
Multilingualism for Digital EuropeMultilingualism for Digital Europe
Multilingualism for Digital EuropeGeorg Rehm
 
Presentation at OEW2024 on NVL Digital Inclusion
Presentation  at OEW2024 on NVL Digital InclusionPresentation  at OEW2024 on NVL Digital Inclusion
Presentation at OEW2024 on NVL Digital InclusionEbba Ossiannilsson
 
Presentation at OEW2024 on NVL Digital Inclusion
Presentation at OEW2024 on NVL Digital InclusionPresentation at OEW2024 on NVL Digital Inclusion
Presentation at OEW2024 on NVL Digital InclusionEbba Ossiannilsson
 
Know4drr networks - Salzburg workshop final
Know4drr networks - Salzburg workshop finalKnow4drr networks - Salzburg workshop final
Know4drr networks - Salzburg workshop finalknow4drr
 
Let´s do it2
Let´s do it2Let´s do it2
Let´s do it2smarter86
 
Introduction of the SLE'17 conference
Introduction of the SLE'17 conferenceIntroduction of the SLE'17 conference
Introduction of the SLE'17 conferenceBenoit Combemale
 
CERLIS 2011 Emerging genres in the academy? Designing an EAP pedagogy for the...
CERLIS 2011 Emerging genres in the academy? Designing an EAP pedagogy for the...CERLIS 2011 Emerging genres in the academy? Designing an EAP pedagogy for the...
CERLIS 2011 Emerging genres in the academy? Designing an EAP pedagogy for the...cahafner
 
lip reading using deep learning presentation
lip reading using deep learning presentationlip reading using deep learning presentation
lip reading using deep learning presentationgokuldongala
 
Thom Kiddle: Responding to the challenge of testing and assessing speaking
Thom Kiddle: Responding to the challenge of testing and assessing speakingThom Kiddle: Responding to the challenge of testing and assessing speaking
Thom Kiddle: Responding to the challenge of testing and assessing speakingeaquals
 
LIP READING: VISUAL SPEECH RECOGNITION USING LIP READING
LIP READING: VISUAL SPEECH RECOGNITION USING LIP READINGLIP READING: VISUAL SPEECH RECOGNITION USING LIP READING
LIP READING: VISUAL SPEECH RECOGNITION USING LIP READINGIRJET Journal
 
Mixed approach blended learning as a theoretical framework for the applicati...
Mixed approach blended learning as a theoretical framework  for the applicati...Mixed approach blended learning as a theoretical framework  for the applicati...
Mixed approach blended learning as a theoretical framework for the applicati...suhailaabdulaziz
 

Similar to 30% seminar "kappa" (15)

LAC UWC 0810
LAC UWC 0810LAC UWC 0810
LAC UWC 0810
 
Minin project review.pdf
Minin project review.pdfMinin project review.pdf
Minin project review.pdf
 
Performance estimation based recurrent-convolutional encoder decoder for spee...
Performance estimation based recurrent-convolutional encoder decoder for spee...Performance estimation based recurrent-convolutional encoder decoder for spee...
Performance estimation based recurrent-convolutional encoder decoder for spee...
 
Multilingualism for Digital Europe
Multilingualism for Digital EuropeMultilingualism for Digital Europe
Multilingualism for Digital Europe
 
Presentation at OEW2024 on NVL Digital Inclusion
Presentation  at OEW2024 on NVL Digital InclusionPresentation  at OEW2024 on NVL Digital Inclusion
Presentation at OEW2024 on NVL Digital Inclusion
 
Presentation at OEW2024 on NVL Digital Inclusion
Presentation at OEW2024 on NVL Digital InclusionPresentation at OEW2024 on NVL Digital Inclusion
Presentation at OEW2024 on NVL Digital Inclusion
 
Know4drr networks - Salzburg workshop final
Know4drr networks - Salzburg workshop finalKnow4drr networks - Salzburg workshop final
Know4drr networks - Salzburg workshop final
 
Let´s do it2
Let´s do it2Let´s do it2
Let´s do it2
 
Introduction of the SLE'17 conference
Introduction of the SLE'17 conferenceIntroduction of the SLE'17 conference
Introduction of the SLE'17 conference
 
CERLIS 2011 Emerging genres in the academy? Designing an EAP pedagogy for the...
CERLIS 2011 Emerging genres in the academy? Designing an EAP pedagogy for the...CERLIS 2011 Emerging genres in the academy? Designing an EAP pedagogy for the...
CERLIS 2011 Emerging genres in the academy? Designing an EAP pedagogy for the...
 
lip reading using deep learning presentation
lip reading using deep learning presentationlip reading using deep learning presentation
lip reading using deep learning presentation
 
Thom Kiddle: Responding to the challenge of testing and assessing speaking
Thom Kiddle: Responding to the challenge of testing and assessing speakingThom Kiddle: Responding to the challenge of testing and assessing speaking
Thom Kiddle: Responding to the challenge of testing and assessing speaking
 
Speech Data Collection: Unlocking the Potential of Voice Technology
Speech Data Collection: Unlocking the Potential of Voice TechnologySpeech Data Collection: Unlocking the Potential of Voice Technology
Speech Data Collection: Unlocking the Potential of Voice Technology
 
LIP READING: VISUAL SPEECH RECOGNITION USING LIP READING
LIP READING: VISUAL SPEECH RECOGNITION USING LIP READINGLIP READING: VISUAL SPEECH RECOGNITION USING LIP READING
LIP READING: VISUAL SPEECH RECOGNITION USING LIP READING
 
Mixed approach blended learning as a theoretical framework for the applicati...
Mixed approach blended learning as a theoretical framework  for the applicati...Mixed approach blended learning as a theoretical framework  for the applicati...
Mixed approach blended learning as a theoretical framework for the applicati...
 

More from Jim O'Regan

How to use a toilet brush
How to use a toilet brushHow to use a toilet brush
How to use a toilet brushJim O'Regan
 
Speech recognition for Riksdag open data
Speech recognition for Riksdag open dataSpeech recognition for Riksdag open data
Speech recognition for Riksdag open dataJim O'Regan
 
Continued Fine-tuning as Single Speaker Adaptation
Continued Fine-tuning as Single Speaker AdaptationContinued Fine-tuning as Single Speaker Adaptation
Continued Fine-tuning as Single Speaker AdaptationJim O'Regan
 
Seminar: Language Variation in Parliamentary Speeches_ First Steps Towards Ro...
Seminar: Language Variation in Parliamentary Speeches_ First Steps Towards Ro...Seminar: Language Variation in Parliamentary Speeches_ First Steps Towards Ro...
Seminar: Language Variation in Parliamentary Speeches_ First Steps Towards Ro...Jim O'Regan
 
Seminar: PSST challenge LREC
Seminar: PSST challenge LRECSeminar: PSST challenge LREC
Seminar: PSST challenge LRECJim O'Regan
 
Language Variation in Parliamentary Speeches: First Steps Towards Robust Phon...
Language Variation in Parliamentary Speeches: First Steps Towards Robust Phon...Language Variation in Parliamentary Speeches: First Steps Towards Robust Phon...
Language Variation in Parliamentary Speeches: First Steps Towards Robust Phon...Jim O'Regan
 
PSST challenge LREC
PSST challenge LRECPSST challenge LREC
PSST challenge LRECJim O'Regan
 
Shallow-transfer rule-based machine translation from Czech to Polish
Shallow-transfer rule-based machine translation from Czech to PolishShallow-transfer rule-based machine translation from Czech to Polish
Shallow-transfer rule-based machine translation from Czech to PolishJim O'Regan
 
MT and Translator's Tools
MT and Translator's ToolsMT and Translator's Tools
MT and Translator's ToolsJim O'Regan
 

More from Jim O'Regan (9)

How to use a toilet brush
How to use a toilet brushHow to use a toilet brush
How to use a toilet brush
 
Speech recognition for Riksdag open data
Speech recognition for Riksdag open dataSpeech recognition for Riksdag open data
Speech recognition for Riksdag open data
 
Continued Fine-tuning as Single Speaker Adaptation
Continued Fine-tuning as Single Speaker AdaptationContinued Fine-tuning as Single Speaker Adaptation
Continued Fine-tuning as Single Speaker Adaptation
 
Seminar: Language Variation in Parliamentary Speeches_ First Steps Towards Ro...
Seminar: Language Variation in Parliamentary Speeches_ First Steps Towards Ro...Seminar: Language Variation in Parliamentary Speeches_ First Steps Towards Ro...
Seminar: Language Variation in Parliamentary Speeches_ First Steps Towards Ro...
 
Seminar: PSST challenge LREC
Seminar: PSST challenge LRECSeminar: PSST challenge LREC
Seminar: PSST challenge LREC
 
Language Variation in Parliamentary Speeches: First Steps Towards Robust Phon...
Language Variation in Parliamentary Speeches: First Steps Towards Robust Phon...Language Variation in Parliamentary Speeches: First Steps Towards Robust Phon...
Language Variation in Parliamentary Speeches: First Steps Towards Robust Phon...
 
PSST challenge LREC
PSST challenge LRECPSST challenge LREC
PSST challenge LREC
 
Shallow-transfer rule-based machine translation from Czech to Polish
Shallow-transfer rule-based machine translation from Czech to PolishShallow-transfer rule-based machine translation from Czech to Polish
Shallow-transfer rule-based machine translation from Czech to Polish
 
MT and Translator's Tools
MT and Translator's ToolsMT and Translator's Tools
MT and Translator's Tools
 

Recently uploaded

Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data SciencePaolo Missier
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceSamy Fodil
 
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdfFrisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdfAnubhavMangla3
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...ScyllaDB
 
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Skynet Technologies
 
Easier, Faster, and More Powerful – Notes Document Properties Reimagined
Easier, Faster, and More Powerful – Notes Document Properties ReimaginedEasier, Faster, and More Powerful – Notes Document Properties Reimagined
Easier, Faster, and More Powerful – Notes Document Properties Reimaginedpanagenda
 
الأمن السيبراني - ما لا يسع للمستخدم جهله
الأمن السيبراني - ما لا يسع للمستخدم جهلهالأمن السيبراني - ما لا يسع للمستخدم جهله
الأمن السيبراني - ما لا يسع للمستخدم جهلهMohamed Sweelam
 
Oauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftOauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftshyamraj55
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewDianaGray10
 
2024 May Patch Tuesday
2024 May Patch Tuesday2024 May Patch Tuesday
2024 May Patch TuesdayIvanti
 
ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityVictorSzoltysek
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfSrushith Repakula
 
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptxCyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptxMasterG
 
State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!Memoori
 
JohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard37
 
Generative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfGenerative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfalexjohnson7307
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGDSC PJATK
 
Vector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptxVector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptxjbellis
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxFIDO Alliance
 

Recently uploaded (20)

Design and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data ScienceDesign and Development of a Provenance Capture Platform for Data Science
Design and Development of a Provenance Capture Platform for Data Science
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
 
WebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM PerformanceWebAssembly is Key to Better LLM Performance
WebAssembly is Key to Better LLM Performance
 
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdfFrisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
 
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
 
Easier, Faster, and More Powerful – Notes Document Properties Reimagined
Easier, Faster, and More Powerful – Notes Document Properties ReimaginedEasier, Faster, and More Powerful – Notes Document Properties Reimagined
Easier, Faster, and More Powerful – Notes Document Properties Reimagined
 
الأمن السيبراني - ما لا يسع للمستخدم جهله
الأمن السيبراني - ما لا يسع للمستخدم جهلهالأمن السيبراني - ما لا يسع للمستخدم جهله
الأمن السيبراني - ما لا يسع للمستخدم جهله
 
Oauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoftOauth 2.0 Introduction and Flows with MuleSoft
Oauth 2.0 Introduction and Flows with MuleSoft
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overview
 
2024 May Patch Tuesday
2024 May Patch Tuesday2024 May Patch Tuesday
2024 May Patch Tuesday
 
ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps Productivity
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
 
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptxCyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
Cyber Insurance - RalphGilot - Embry-Riddle Aeronautical University.pptx
 
State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!State of the Smart Building Startup Landscape 2024!
State of the Smart Building Startup Landscape 2024!
 
JohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptx
 
Generative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfGenerative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdf
 
Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
 
Vector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptxVector Search @ sw2con for slideshare.pptx
Vector Search @ sw2con for slideshare.pptx
 
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
 

30% seminar "kappa"

  • 2. ˈfoːniːm ɻʷɛkɪgˈnɪʃn ̩ fɚ ˈfan n ̩ ˈpɻʷɑfət̞ ˈjuːsɪz v ̩ ˈmoːɹˠ dəˈɹˠɛkt̞ ˌɻʷɛpɹˠɪzn ̩ ˈteːʃn ̩ z v ̩ ˈspiːʧ dʒɪm oːˈɻʷiːgn ̩
  • 3. Phoneme recognition for fan and prophet Uses of more direct representations of speech Jim O’Regan
  • 4. Sidenote: I’m pretty sure my /əʊ/ is [oː] 2023-11-03 4
  • 5. Overview 2023-11-03 5 ● TA Duty ● Thesis supervision ● Speech data augmentation for improving phoneme transcriptions of aphasic speech using wav2vec 2.0 for the PSST Challenge ○ Presented at RaPID4 Workshop, Marseille, France, June 25, 2022 ● Language Variation in Parliamentary Speeches: First Steps Towards Robust Phoneme Recognition ○ Presented at Nationella språkbankens höstworkshop, October 23, 2023 at the University of Gothenburg
  • 6. TA duty 2023-11-03 6 ● Speech Technology (DT2112) ○ Jens Edlund ● Speech and Speaker Recognition (DT2119) ○ Jonas Beskow
  • 7. Thesis supervision 2023-11-03 7 “Mispronunciation Detection with SpeechBlender Data Augmentation Pipeline.” Yassine EL KHEIR Examiner: Olov Engwall
  • 8. Thesis supervision 2023-11-03 8 “Mispronunciation Detection with SpeechBlender Data Augmentation Pipeline.” Yassine EL KHEIR Examiner: Olov Engwall Not online. Related paper: Kheir, Y. E., Chowdhury, S. A., Ali, A., Mubarak, H., & Afzal, S. (2023). SpeechBlender: Speech Augmentation Framework for Mispronunciation Data Generation. arXiv [Cs.SD]. Retrieved from http://arxiv.org/abs/2211.00923