SlideShare a Scribd company logo
Lip Reading
Zainab Hamadi
Natalie Nader
Hawraa Al-Romani
Lebanese University-Speech and Language Therapy
Lip-reading= Speech reading
The act or process of determining the intended meaning of a speaker
by utilizing all visual clues accompanying speech attempts, as lip
movements, facial expressions, and bodily gestures, used especially
by people with impaired hearing.
What is Lip-reading?
Lip reading is said to be 80% guesswork
Only 1/3 of speech is visible on the lips
An “expert” lip reader is guessing at 66% of what is said!
When considering lip-reading, be aware that there is a high incidence of
visual impairment within the hearing impaired population.. Regular eye
checks are essential.
More about lip-reading:
More about lip-reading:
•Amplification:
Also has a significant role - a little sound in addition to lip-reading, makes a big
difference. Appropriate, functioning hearing aids, worn consistently, do make
lip-reading much easier.
•McGurk Effect:
Even in the normally hearing population, lip movements influence what listeners
hear. An example of this is known as the 'McGurk Effect' - an illusion caused
when what you hear someone say doesn't match the lip configuration that you
see. This is why watching dubbed movies is a strange experience.
Lip-reading in hearing:
Speechreading is also used by people who have typical hearing, especially in
situations that are noisy or the speech is unclear.
Woodhouse (2009) published five pieces of evidence that shows:
“speech-reading is an integral part of speech processing. Hearing
people's perception of speech is influenced by speech-read cues, and
those speech-read cues cannot be ignored.”
What is Visible?
Anatomically Physiologically Phonetically Phonemically
What is visible?
Partially Visible
Tongue tip
Cheek muscles
Teeth
Visible
Lips
Jaw
Invisible
Tongue body
Velum
Vocal folds
Breathing mechanism
Anatomically - Motorically
Anatomical visibility is
described at the level of
Positions and Movements
Lips open/closed
Lips spread/rounded
Jaw raised/lowered
Tongue tip raised/lowered
Tongue tip forward/back
Anatomically -Motorically
Lips protruded/retracted
What is visible?
vocal fold vibration, nasal resonance, and airflow patterns are not visible
What is visible?
• Place of articulation of stressed
vowels, and of consonants, is mostly
visible.
• Duration and rhythm are partially
visible.
• Place of articulation of unstressed
vowels, voicing and manner of
articulation of consonants, pitch and
intonation, and loudness are all
invisible
What is visible?
• Stressed vowels are mostly
identifiable
• Unstressed vowels are not
identifiable.
• Consonants articulated at or
near the back of the mouth are
invisible (e.g., k, g, h).
• Other consonants are only
identifiable within groups
(visemes) that have different
places of articulation.
What is visible?
WHY IS SPEECHREADING
DIFFICULT?
Problems relate to four main areas. These are:
1. The nature
of speech
2. The speaker
3. The
environment
4. The
speechreader
1-The Nature of Speech
 Frontal sounds (e.g. ‘p’) are the easiest to speechread.
 In contrast, it is very difficult to speechread middle sounds (e.g. ‘t’) or back
sounds (e.g. k, g, h - Kate, Gate and Hate) .
Many words also look alike. Alexander Graham Bell coined the term
‘homophene’ to describe words which look alike but do not sound alike.
e.g. Try saying the following three words without voice to friends. Can they tell
the difference? pat, mat, bat
Because so many speech shapes and words look alike, misunderstandings can
occur.
Why is speechreading difficult?
• A moustache or beard
• Poor lip movement (either minimal or exaggerated) ‘dead-pan’ faces.
• Hands covering mouths.
• Talking too quickly.
Why is speechreading difficult?
2-The Speaker:
Some people’s speaking habits or features make life very difficult for speech reader:
Why is speechreading difficult?
3-The Environment:
Lighting Distance Distractions
Poor lighting that is shining into
the speechreader’s eyes rather
than on the speaker’s face is a
problem.
A speechreader should try to be
positioned with his/her back to
the light source.
A speechreader should be a
comfortable distance from the
speaker so that hearing and
vision are maximised. (not too
close or too far)
Distractions in the environment
can make concentration difficult
for the speechreader.
In group situations, a
speechreader must try to be in
touch with topic changes and
who is speaking, otherwise
he/she is ‘left out’ very quickly.
o The innate ability to speechread varies from person to
person. This can only be improved to a certain extent by
training.
o To help speechreading, any visual defects should be
identified and corrected if possible.
o Speechreaders should also be prepared to admit when
they have not understood, rather than passively pretend
they have.
Why is speechreading difficult?
4-The SpeechReader:
Tips for Speechreading
Make sure you can see the speaker’s face clearly.
Hold the conversation in a quiet environment, with good lighting, and not a lot of
visual distractions.
Make sure that light is behind you, not the person you are trying to speechread.
Gently remind people that you need to see their face when they forget and look
down or away from you.
Tips for Speechreading
Ask for the topic of the conversation, if you are not sure.
If the speaker over–exaggerates, or talks too loudly, gently request that they speak
normally.
Remind speakers to move their hands or other objects away from their face.
If you still don’t understand after a repeat, ask the speaker to rephrase.
There are Four general approaches used to impart
speechreading skills (Tye-Murray, 1998).
Analytic Synthetic Pragmatic Holistic
Each approach had different models associated with them
1 Analytic
• The Analytic approach was considered a traditional method of instruction
for teaching speechreading skills,
• and is generally defined as an approach that focused on the smallest units
of speech to understand spoken communication.
• Hallmarks of this approach are rapid syllable drills emphasizing the practice
of building smaller verbal units (the syllable or viseme) into words and then
sentences (Hanavan, 2013).
definition
1- Analytic Approach:
1- Analytic Approach:
Theory
They assume that speech perception is, a bottom-up process
Where that 1st task is to analyze the incoming visual signal into its basic components
before assembling those components into words and sentences (Kaplan, et al. 1985).
1- Analytic Approach:
Instruction
Instruction: concentrates on the details of the sounds - learning to recognize how they
look on the lips and practicing their recognition in isolation and in single words
Exercises:
• Some of the practices include syllable discrimination exercises,
• With practice and improved proficiency, similar exercises can be done using
words selected based on the syllables intended for practice.
1- Analytic Approach:
where the speech-
reader would be
presented with two
syllables:
(e.g., “GA-BA” or
“BA-BA”)
two syllables were
the same or
different
limitations
• While studies have reported from modest to significant improvements in speech
recognition performance, there are limitations to this approach.
1- Analytic Approach:
English-speaking person
will creates about 13/15
specific speech
movements per second
in a comfortably paced
conversation
But even the best
trained professional
speechreaders can only
register about 8/9
movements per sec at
most.
Synthetic2
definition
Top-down approach
where the perception of the whole, or the overall meaning of the message is emphasized
more so than concentrating on smaller parts.
Exercises
for this method include speechreading sentence practice in a known context to aid in
determination of overall meaning.
(The sentences used to practice this approach should be “definite, natural, interesting,
pleasing, rhythmical and dignified”)
2- Synthetic Approach:
2- Synthetic Approach:
goal
The goal of the synthetic approach is for speechreaders to use context and any
known information to allow for educated guessing, when some sounds or parts of
the sentence is missing from auditory perception.
In other words, the meaning of a given sentence, if the context is known but
some of the words are ambiguous, can be inferred.
2- Synthetic Approach:
limitations
Include situations when:
o Speechreader is unable to determine the context of the message, or is
o Unable to determine the overall meaning of a message
o Unknowingly misinterprets the information,
leading to misunderstanding.
While repair strategies can help in such situations, it is largely the responsibility of the
speechreader to recognize when this is happening and to take the needed steps to
mitigate any confusion.
2- Synthetic Approach:
exercises
There are many exercises that can be used in this approach, most focusing on giving the
speechreader some clues such as key words or a topic that will be discussed, presenting
the message and having the speechreader respond in a variety of ways.
For example, the speechreader could:
o reply to a specific question,
o repeat a passage, or
o incorporate details from the presented message into subsequent discussion
2- Synthetic Approach:
Pragmatic3
definition
The Pragmatic Approach focuses primarily on creating the ideal environment and
context for the person with hearing loss in dialogue.
They employ communication strategies to ensure that residual hearing is
maximized to increase comprehension of the speaker.
3- Pragmatic Approach:
(Lind, 2009).
Theory
The aim of this approach is for the individual to:
• concentrate on interaction more than the reception of specific cues or sounds,
• to ask for modification of the speakers message, the context in which dialogue
takes place.
• develop specific strategies that they can employ in particular situations that are
found to be most difficult to communicate.
3- Pragmatic Approach:
The focus of this approach is based on how language is used in social situations
and how the use of language can affect those communicating; as a result, most of
the exercises are framed from the perspective of interaction.
3- Pragmatic Approach:
exercises
Practices and exercises used in the Pragmatic Approach tend to incorporate dialogue
between pairs or groups of speechreaders, or the speechreader and the
instructor/clinician.
With practice, the speechreader will employ communication strategies to ensure they are
fully engaged and correctly understanding the conversation.
3- Pragmatic Approach:
During dialogue btw
speechreader &
instructor/clinician, the
speechreader will have to
reply appropriately
The instructor provides
prompts & cues to help
the person get back on
track
if they do not
exercises
Other exercises can include:
 narratives,
 discussion, and
 role-playing.
Cues such as word order and sequencing, tense and word endings, matching
language to the situation and context, among others are important considerations
when using this approach
3- Pragmatic Approach:
limitations
• The most notable is that it is the speechreader’s existing skills that are
maximized, with little emphasis on developing new skills.
• There is no effort made to incorporate a bimodal approach (two sensory inputs
including both auditory and visual cues) to overcoming conversation
difficulties.
• Another serious limitation, is that there is currently no evidenced-based
research to be found on the efficacy of this approach.
3- Pragmatic Approach:
Holistic4
Definition (Eclectic approach)
The Holistic Approach incorporated aspects from the Analytic, Synthetic and
Pragmatic approaches.
The main objectives of a Holistic Approach included:
“the evaluation and management of overall communication skills, the
psychosocial aspects of hearing loss, the education of significant others (e.g.
parents, siblings and close friends), hearing aid orientation, an emphasis on
improving conversational and interactive skills, and the use of assistive
listening devices”
4- Holistic Approach:
goals
Yoshinaga-Itano (1988) also described a holistic approach to instructing
speechreading techniques to children.
The training goals included:
4- Holistic Approach:
increasing the child’s
knowledge of the
speechreading
process,
their ability to generalize
strategies to facilitate more
successful communication,
their tolerance for
difficult/frustrating
communicative
situations.
their role in generating
personal goals.
their motivation to
improve their
speechreading abilities
The rationale behind a Holistic Approach is two fold;
Firstly Analytic, Synthetic and Pragmatic approaches each train specific
aspects of speech perception and communication strategies that are useful, and
the starting point in determining which strategies could be applied is the
individual living with hearing loss.
Secondly, while there are both benefits and detriments to the Analytic,
Synthetic and Pragmatic approaches, an approach that incorporates aspects of
each is flexible and can be adapted to specific situations when called for.
4- Holistic Approach:
benifit
The benefit to using a Holistic paradigm is the client-oriented approach, which is
much more empowering to the person seeking help in coping with their hearing
loss, and ensures a program that is tailored to the individual or groups’ unique
needs.
4- Holistic Approach:
limitations
Unfortunately, there is a lack of evidence-based research to provide any validity
to this particular method, and an obvious need for this remains.
It could be argued however, that the research that upholds the value of the
Analytic, Synthetic and Pragmatic Approaches could be transferred to the
Holistic Approach as it incorporates aspects of all three of the preceding
methods, and the skills imparted are not new inventions without prior precedent.
4- Holistic Approach:
Study: Does lipreading improve?
The study addressed the research questions: Does lipreading improve between the ages
of 7 and 14 years? Does hearing loss affect the development of lipreading?
children with normal hearing (NH) and with hearing loss (HL) were tested using 4
lipreading instruments.
Results: For both groups, lipreading performance improved with age on all 4 measures
of lipreading, with the HL group performing better than the NH group.
Conclusions:
• Results showed that children's lipreading ability improves.
• Experience plays an important role in the development of this ability. (HL children
lipread better than those with NH)
In Hearing
In Deaf
References:
• The Impact of Speechreading Programs on Adults with Hearing Loss, Literature Review
Alena Wickware, Project Manager, National Speechreading Program, The Canadian Hard of
Hearing Association .
• http://www.ssc.education.ed.ac.uk/courses/deaf/ddec05f.html
• SLHS 511: Lipreading. Slides and study notes
• http://www.vicdeaf.com.au/files/editor_upload/File/Information%20Sheets/Speechreading%20_
Visual%20Cues_.pdf
• http://jslhr.pubs.asha.org/article.aspx?articleid=1802630
Lipreading in hearing impaired

More Related Content

What's hot

Auditory processing disorder (3)
Auditory processing disorder (3)Auditory processing disorder (3)
Auditory processing disorder (3)
Andrea Pomaro
 
The auditory-verbal-therapy for CWHI
The auditory-verbal-therapy for CWHIThe auditory-verbal-therapy for CWHI
The auditory-verbal-therapy for CWHI
karnal
 
Articulation disorders2
Articulation disorders2Articulation disorders2
Articulation disorders2
Anam_ Khan
 
Voice Therapy
Voice TherapyVoice Therapy
Voice Therapy
sahughes
 
Augmentative and alternative communication
Augmentative and alternative communicationAugmentative and alternative communication
Augmentative and alternative communication
Alexander Utlang
 
Earmolds & acoustic couplings overview
Earmolds & acoustic couplings overviewEarmolds & acoustic couplings overview
Earmolds & acoustic couplings overview
Lynn Royer
 

What's hot (20)

Assistive technology for deaf or hard of hearing
Assistive technology for deaf or hard of hearingAssistive technology for deaf or hard of hearing
Assistive technology for deaf or hard of hearing
 
Behavioural test in pediatric audiology
Behavioural test in pediatric audiologyBehavioural test in pediatric audiology
Behavioural test in pediatric audiology
 
Voice therapy to treat voice disorders
Voice  therapy to treat voice disordersVoice  therapy to treat voice disorders
Voice therapy to treat voice disorders
 
Auditory processing disorder (3)
Auditory processing disorder (3)Auditory processing disorder (3)
Auditory processing disorder (3)
 
The auditory-verbal-therapy for CWHI
The auditory-verbal-therapy for CWHIThe auditory-verbal-therapy for CWHI
The auditory-verbal-therapy for CWHI
 
Articulation disorders2
Articulation disorders2Articulation disorders2
Articulation disorders2
 
Voice therapy
Voice therapyVoice therapy
Voice therapy
 
4(a) early identification of hearing loss and invervention
4(a)  early identification of hearing loss and invervention4(a)  early identification of hearing loss and invervention
4(a) early identification of hearing loss and invervention
 
Electroglottography & Inverse Filtering Procedures
Electroglottography & Inverse Filtering ProceduresElectroglottography & Inverse Filtering Procedures
Electroglottography & Inverse Filtering Procedures
 
Voice Therapy
Voice TherapyVoice Therapy
Voice Therapy
 
Avt training
Avt trainingAvt training
Avt training
 
stuttering & nnf
stuttering & nnfstuttering & nnf
stuttering & nnf
 
Audiometer
AudiometerAudiometer
Audiometer
 
Misarticulation
MisarticulationMisarticulation
Misarticulation
 
Assistive devices for hearing impairment
Assistive devices for hearing impairmentAssistive devices for hearing impairment
Assistive devices for hearing impairment
 
1. fluency introduction
1. fluency introduction1. fluency introduction
1. fluency introduction
 
1. fluency introduction
1. fluency introduction1. fluency introduction
1. fluency introduction
 
Augmentative and alternative communication
Augmentative and alternative communicationAugmentative and alternative communication
Augmentative and alternative communication
 
Earmolds & acoustic couplings overview
Earmolds & acoustic couplings overviewEarmolds & acoustic couplings overview
Earmolds & acoustic couplings overview
 
Immittance audiometry
Immittance audiometryImmittance audiometry
Immittance audiometry
 

Viewers also liked

What is lipreading?
What is lipreading?What is lipreading?
What is lipreading?
Heidi Walsh
 
Abc pronunciary (r-controlled vowel & vowel digraph)
Abc pronunciary (r-controlled vowel & vowel digraph)Abc pronunciary (r-controlled vowel & vowel digraph)
Abc pronunciary (r-controlled vowel & vowel digraph)
Ngoc Cam
 
Slide-show on Biometrics
Slide-show on BiometricsSlide-show on Biometrics
Slide-show on Biometrics
Pathik504
 

Viewers also liked (20)

Lip reading activity
Lip reading activityLip reading activity
Lip reading activity
 
What is lipreading?
What is lipreading?What is lipreading?
What is lipreading?
 
Lorraine Braggins Lipreading assessment 2014
Lorraine Braggins Lipreading assessment 2014Lorraine Braggins Lipreading assessment 2014
Lorraine Braggins Lipreading assessment 2014
 
Read my lips
Read my lipsRead my lips
Read my lips
 
The Speech Sound Pics (SSP) Approach - Reading and Spelling Brain Training
The Speech Sound Pics (SSP) Approach - Reading and Spelling Brain TrainingThe Speech Sound Pics (SSP) Approach - Reading and Spelling Brain Training
The Speech Sound Pics (SSP) Approach - Reading and Spelling Brain Training
 
Lip Reading by Using 3-D Discrete Wavelet Transform with Dmey Wavelet
Lip Reading by Using 3-D Discrete Wavelet Transform with Dmey WaveletLip Reading by Using 3-D Discrete Wavelet Transform with Dmey Wavelet
Lip Reading by Using 3-D Discrete Wavelet Transform with Dmey Wavelet
 
Abc pronunciary (r-controlled vowel & vowel digraph)
Abc pronunciary (r-controlled vowel & vowel digraph)Abc pronunciary (r-controlled vowel & vowel digraph)
Abc pronunciary (r-controlled vowel & vowel digraph)
 
Speech therapy baton rouge
Speech therapy baton rougeSpeech therapy baton rouge
Speech therapy baton rouge
 
BRAIN GATE TECHNOLOGY(in nutshell)
BRAIN GATE TECHNOLOGY(in nutshell)BRAIN GATE TECHNOLOGY(in nutshell)
BRAIN GATE TECHNOLOGY(in nutshell)
 
Virtual Personal Assistant
Virtual Personal AssistantVirtual Personal Assistant
Virtual Personal Assistant
 
Google tech & products
Google tech & productsGoogle tech & products
Google tech & products
 
Cortana
Cortana Cortana
Cortana
 
Cortana : A Microsoft Virtual Personal Assistant
Cortana : A Microsoft Virtual Personal AssistantCortana : A Microsoft Virtual Personal Assistant
Cortana : A Microsoft Virtual Personal Assistant
 
MICROSOFT CORTANA
MICROSOFT  CORTANAMICROSOFT  CORTANA
MICROSOFT CORTANA
 
Applications of genetic engineering techniques in agriculture byB. DEVADATHA
Applications of genetic engineering  techniques in agriculture byB. DEVADATHAApplications of genetic engineering  techniques in agriculture byB. DEVADATHA
Applications of genetic engineering techniques in agriculture byB. DEVADATHA
 
Biometric authentication ppt by navin 6 feb
Biometric authentication ppt by navin 6 febBiometric authentication ppt by navin 6 feb
Biometric authentication ppt by navin 6 feb
 
Memristor
MemristorMemristor
Memristor
 
Virtual personal assistant
Virtual personal assistantVirtual personal assistant
Virtual personal assistant
 
Slide-show on Biometrics
Slide-show on BiometricsSlide-show on Biometrics
Slide-show on Biometrics
 
Bio-metrics Technology
Bio-metrics TechnologyBio-metrics Technology
Bio-metrics Technology
 

Similar to Lipreading in hearing impaired

Lessonplanning 130104100224-phpapp01
Lessonplanning 130104100224-phpapp01Lessonplanning 130104100224-phpapp01
Lessonplanning 130104100224-phpapp01
Princess Tabotabo
 
Lessonplanning 130104100224-phpapp01
Lessonplanning 130104100224-phpapp01Lessonplanning 130104100224-phpapp01
Lessonplanning 130104100224-phpapp01
Princess Tabotabo
 
Lessonplanning 130104100224-phpapp01ces
Lessonplanning 130104100224-phpapp01cesLessonplanning 130104100224-phpapp01ces
Lessonplanning 130104100224-phpapp01ces
Princess Tabotabo
 
Methods+Of+Language+Teaching
Methods+Of+Language+TeachingMethods+Of+Language+Teaching
Methods+Of+Language+Teaching
guest0c02e6
 
gA LESSON PLAN ON LISTENING SKILLS
gA LESSON PLAN ON LISTENING SKILLSgA LESSON PLAN ON LISTENING SKILLS
gA LESSON PLAN ON LISTENING SKILLS
Fatima Gul
 
A LESSON PLAN ON LISTENING SKILLS
A LESSON PLAN ON LISTENING SKILLSA LESSON PLAN ON LISTENING SKILLS
A LESSON PLAN ON LISTENING SKILLS
Fatima Gul
 

Similar to Lipreading in hearing impaired (20)

Take action
Take actionTake action
Take action
 
Speaking Skills
Speaking SkillsSpeaking Skills
Speaking Skills
 
Listening Skills
Listening SkillsListening Skills
Listening Skills
 
Listening
ListeningListening
Listening
 
The listening skill in Linguistics !!
The listening skill in Linguistics !!The listening skill in Linguistics !!
The listening skill in Linguistics !!
 
Lessonplanning 130104100224-phpapp012
Lessonplanning 130104100224-phpapp012Lessonplanning 130104100224-phpapp012
Lessonplanning 130104100224-phpapp012
 
Lessonplanning 130104100224-phpapp01
Lessonplanning 130104100224-phpapp01Lessonplanning 130104100224-phpapp01
Lessonplanning 130104100224-phpapp01
 
Lessonplanning
Lessonplanning Lessonplanning
Lessonplanning
 
Basic listening skills
Basic listening skillsBasic listening skills
Basic listening skills
 
Speaking skills
Speaking skills Speaking skills
Speaking skills
 
Lessonplanning 130104100224-phpapp01
Lessonplanning 130104100224-phpapp01Lessonplanning 130104100224-phpapp01
Lessonplanning 130104100224-phpapp01
 
Lessonplanning 130104100224-phpapp01ces
Lessonplanning 130104100224-phpapp01cesLessonplanning 130104100224-phpapp01ces
Lessonplanning 130104100224-phpapp01ces
 
Oral Presentation
Oral PresentationOral Presentation
Oral Presentation
 
Methods+Of+Language+Teaching
Methods+Of+Language+TeachingMethods+Of+Language+Teaching
Methods+Of+Language+Teaching
 
Methods of-language-teaching
Methods of-language-teachingMethods of-language-teaching
Methods of-language-teaching
 
Methods of-language-teaching
Methods of-language-teachingMethods of-language-teaching
Methods of-language-teaching
 
Teaching speaking and pronunciation ppt
Teaching speaking and pronunciation pptTeaching speaking and pronunciation ppt
Teaching speaking and pronunciation ppt
 
Developing Listening
Developing ListeningDeveloping Listening
Developing Listening
 
gA LESSON PLAN ON LISTENING SKILLS
gA LESSON PLAN ON LISTENING SKILLSgA LESSON PLAN ON LISTENING SKILLS
gA LESSON PLAN ON LISTENING SKILLS
 
A LESSON PLAN ON LISTENING SKILLS
A LESSON PLAN ON LISTENING SKILLSA LESSON PLAN ON LISTENING SKILLS
A LESSON PLAN ON LISTENING SKILLS
 

Recently uploaded

Industrial Training Report- AKTU Industrial Training Report
Industrial Training Report- AKTU Industrial Training ReportIndustrial Training Report- AKTU Industrial Training Report
Industrial Training Report- AKTU Industrial Training Report
Avinash Rai
 
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdfAdversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Po-Chuan Chen
 

Recently uploaded (20)

Sectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdfSectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdf
 
INU_CAPSTONEDESIGN_비밀번호486_업로드용 발표자료.pdf
INU_CAPSTONEDESIGN_비밀번호486_업로드용 발표자료.pdfINU_CAPSTONEDESIGN_비밀번호486_업로드용 발표자료.pdf
INU_CAPSTONEDESIGN_비밀번호486_업로드용 발표자료.pdf
 
50 ĐỀ LUYỆN THI IOE LỚP 9 - NĂM HỌC 2022-2023 (CÓ LINK HÌNH, FILE AUDIO VÀ ĐÁ...
50 ĐỀ LUYỆN THI IOE LỚP 9 - NĂM HỌC 2022-2023 (CÓ LINK HÌNH, FILE AUDIO VÀ ĐÁ...50 ĐỀ LUYỆN THI IOE LỚP 9 - NĂM HỌC 2022-2023 (CÓ LINK HÌNH, FILE AUDIO VÀ ĐÁ...
50 ĐỀ LUYỆN THI IOE LỚP 9 - NĂM HỌC 2022-2023 (CÓ LINK HÌNH, FILE AUDIO VÀ ĐÁ...
 
Solid waste management & Types of Basic civil Engineering notes by DJ Sir.pptx
Solid waste management & Types of Basic civil Engineering notes by DJ Sir.pptxSolid waste management & Types of Basic civil Engineering notes by DJ Sir.pptx
Solid waste management & Types of Basic civil Engineering notes by DJ Sir.pptx
 
Basic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumersBasic phrases for greeting and assisting costumers
Basic phrases for greeting and assisting costumers
 
Advances in production technology of Grapes.pdf
Advances in production technology of Grapes.pdfAdvances in production technology of Grapes.pdf
Advances in production technology of Grapes.pdf
 
Jose-Rizal-and-Philippine-Nationalism-National-Symbol-2.pptx
Jose-Rizal-and-Philippine-Nationalism-National-Symbol-2.pptxJose-Rizal-and-Philippine-Nationalism-National-Symbol-2.pptx
Jose-Rizal-and-Philippine-Nationalism-National-Symbol-2.pptx
 
NCERT Solutions Power Sharing Class 10 Notes pdf
NCERT Solutions Power Sharing Class 10 Notes pdfNCERT Solutions Power Sharing Class 10 Notes pdf
NCERT Solutions Power Sharing Class 10 Notes pdf
 
slides CapTechTalks Webinar May 2024 Alexander Perry.pptx
slides CapTechTalks Webinar May 2024 Alexander Perry.pptxslides CapTechTalks Webinar May 2024 Alexander Perry.pptx
slides CapTechTalks Webinar May 2024 Alexander Perry.pptx
 
NLC-2024-Orientation-for-RO-SDO (1).pptx
NLC-2024-Orientation-for-RO-SDO (1).pptxNLC-2024-Orientation-for-RO-SDO (1).pptx
NLC-2024-Orientation-for-RO-SDO (1).pptx
 
[GDSC YCCE] Build with AI Online Presentation
[GDSC YCCE] Build with AI Online Presentation[GDSC YCCE] Build with AI Online Presentation
[GDSC YCCE] Build with AI Online Presentation
 
Home assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdfHome assignment II on Spectroscopy 2024 Answers.pdf
Home assignment II on Spectroscopy 2024 Answers.pdf
 
Industrial Training Report- AKTU Industrial Training Report
Industrial Training Report- AKTU Industrial Training ReportIndustrial Training Report- AKTU Industrial Training Report
Industrial Training Report- AKTU Industrial Training Report
 
Mattingly "AI & Prompt Design: Limitations and Solutions with LLMs"
Mattingly "AI & Prompt Design: Limitations and Solutions with LLMs"Mattingly "AI & Prompt Design: Limitations and Solutions with LLMs"
Mattingly "AI & Prompt Design: Limitations and Solutions with LLMs"
 
Fish and Chips - have they had their chips
Fish and Chips - have they had their chipsFish and Chips - have they had their chips
Fish and Chips - have they had their chips
 
2024_Student Session 2_ Set Plan Preparation.pptx
2024_Student Session 2_ Set Plan Preparation.pptx2024_Student Session 2_ Set Plan Preparation.pptx
2024_Student Session 2_ Set Plan Preparation.pptx
 
Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
 
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdfAdversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
Adversarial Attention Modeling for Multi-dimensional Emotion Regression.pdf
 
How to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERPHow to Create Map Views in the Odoo 17 ERP
How to Create Map Views in the Odoo 17 ERP
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
 

Lipreading in hearing impaired

  • 1. Lip Reading Zainab Hamadi Natalie Nader Hawraa Al-Romani Lebanese University-Speech and Language Therapy
  • 2. Lip-reading= Speech reading The act or process of determining the intended meaning of a speaker by utilizing all visual clues accompanying speech attempts, as lip movements, facial expressions, and bodily gestures, used especially by people with impaired hearing. What is Lip-reading?
  • 3. Lip reading is said to be 80% guesswork Only 1/3 of speech is visible on the lips An “expert” lip reader is guessing at 66% of what is said! When considering lip-reading, be aware that there is a high incidence of visual impairment within the hearing impaired population.. Regular eye checks are essential. More about lip-reading:
  • 4. More about lip-reading: •Amplification: Also has a significant role - a little sound in addition to lip-reading, makes a big difference. Appropriate, functioning hearing aids, worn consistently, do make lip-reading much easier. •McGurk Effect: Even in the normally hearing population, lip movements influence what listeners hear. An example of this is known as the 'McGurk Effect' - an illusion caused when what you hear someone say doesn't match the lip configuration that you see. This is why watching dubbed movies is a strange experience.
  • 5. Lip-reading in hearing: Speechreading is also used by people who have typical hearing, especially in situations that are noisy or the speech is unclear. Woodhouse (2009) published five pieces of evidence that shows: “speech-reading is an integral part of speech processing. Hearing people's perception of speech is influenced by speech-read cues, and those speech-read cues cannot be ignored.”
  • 6. What is Visible? Anatomically Physiologically Phonetically Phonemically
  • 7. What is visible? Partially Visible Tongue tip Cheek muscles Teeth Visible Lips Jaw Invisible Tongue body Velum Vocal folds Breathing mechanism Anatomically - Motorically Anatomical visibility is described at the level of Positions and Movements
  • 8. Lips open/closed Lips spread/rounded Jaw raised/lowered Tongue tip raised/lowered Tongue tip forward/back Anatomically -Motorically Lips protruded/retracted What is visible?
  • 9. vocal fold vibration, nasal resonance, and airflow patterns are not visible What is visible?
  • 10. • Place of articulation of stressed vowels, and of consonants, is mostly visible. • Duration and rhythm are partially visible. • Place of articulation of unstressed vowels, voicing and manner of articulation of consonants, pitch and intonation, and loudness are all invisible What is visible?
  • 11. • Stressed vowels are mostly identifiable • Unstressed vowels are not identifiable. • Consonants articulated at or near the back of the mouth are invisible (e.g., k, g, h). • Other consonants are only identifiable within groups (visemes) that have different places of articulation. What is visible?
  • 12. WHY IS SPEECHREADING DIFFICULT? Problems relate to four main areas. These are: 1. The nature of speech 2. The speaker 3. The environment 4. The speechreader
  • 13. 1-The Nature of Speech  Frontal sounds (e.g. ‘p’) are the easiest to speechread.  In contrast, it is very difficult to speechread middle sounds (e.g. ‘t’) or back sounds (e.g. k, g, h - Kate, Gate and Hate) . Many words also look alike. Alexander Graham Bell coined the term ‘homophene’ to describe words which look alike but do not sound alike. e.g. Try saying the following three words without voice to friends. Can they tell the difference? pat, mat, bat Because so many speech shapes and words look alike, misunderstandings can occur. Why is speechreading difficult?
  • 14. • A moustache or beard • Poor lip movement (either minimal or exaggerated) ‘dead-pan’ faces. • Hands covering mouths. • Talking too quickly. Why is speechreading difficult? 2-The Speaker: Some people’s speaking habits or features make life very difficult for speech reader:
  • 15. Why is speechreading difficult? 3-The Environment: Lighting Distance Distractions Poor lighting that is shining into the speechreader’s eyes rather than on the speaker’s face is a problem. A speechreader should try to be positioned with his/her back to the light source. A speechreader should be a comfortable distance from the speaker so that hearing and vision are maximised. (not too close or too far) Distractions in the environment can make concentration difficult for the speechreader. In group situations, a speechreader must try to be in touch with topic changes and who is speaking, otherwise he/she is ‘left out’ very quickly.
  • 16. o The innate ability to speechread varies from person to person. This can only be improved to a certain extent by training. o To help speechreading, any visual defects should be identified and corrected if possible. o Speechreaders should also be prepared to admit when they have not understood, rather than passively pretend they have. Why is speechreading difficult? 4-The SpeechReader:
  • 17. Tips for Speechreading Make sure you can see the speaker’s face clearly. Hold the conversation in a quiet environment, with good lighting, and not a lot of visual distractions. Make sure that light is behind you, not the person you are trying to speechread. Gently remind people that you need to see their face when they forget and look down or away from you.
  • 18. Tips for Speechreading Ask for the topic of the conversation, if you are not sure. If the speaker over–exaggerates, or talks too loudly, gently request that they speak normally. Remind speakers to move their hands or other objects away from their face. If you still don’t understand after a repeat, ask the speaker to rephrase.
  • 19. There are Four general approaches used to impart speechreading skills (Tye-Murray, 1998). Analytic Synthetic Pragmatic Holistic Each approach had different models associated with them
  • 21. • The Analytic approach was considered a traditional method of instruction for teaching speechreading skills, • and is generally defined as an approach that focused on the smallest units of speech to understand spoken communication. • Hallmarks of this approach are rapid syllable drills emphasizing the practice of building smaller verbal units (the syllable or viseme) into words and then sentences (Hanavan, 2013). definition 1- Analytic Approach:
  • 23. Theory They assume that speech perception is, a bottom-up process Where that 1st task is to analyze the incoming visual signal into its basic components before assembling those components into words and sentences (Kaplan, et al. 1985). 1- Analytic Approach: Instruction Instruction: concentrates on the details of the sounds - learning to recognize how they look on the lips and practicing their recognition in isolation and in single words
  • 24. Exercises: • Some of the practices include syllable discrimination exercises, • With practice and improved proficiency, similar exercises can be done using words selected based on the syllables intended for practice. 1- Analytic Approach: where the speech- reader would be presented with two syllables: (e.g., “GA-BA” or “BA-BA”) two syllables were the same or different
  • 25. limitations • While studies have reported from modest to significant improvements in speech recognition performance, there are limitations to this approach. 1- Analytic Approach: English-speaking person will creates about 13/15 specific speech movements per second in a comfortably paced conversation But even the best trained professional speechreaders can only register about 8/9 movements per sec at most.
  • 27. definition Top-down approach where the perception of the whole, or the overall meaning of the message is emphasized more so than concentrating on smaller parts. Exercises for this method include speechreading sentence practice in a known context to aid in determination of overall meaning. (The sentences used to practice this approach should be “definite, natural, interesting, pleasing, rhythmical and dignified”) 2- Synthetic Approach:
  • 29. goal The goal of the synthetic approach is for speechreaders to use context and any known information to allow for educated guessing, when some sounds or parts of the sentence is missing from auditory perception. In other words, the meaning of a given sentence, if the context is known but some of the words are ambiguous, can be inferred. 2- Synthetic Approach:
  • 30. limitations Include situations when: o Speechreader is unable to determine the context of the message, or is o Unable to determine the overall meaning of a message o Unknowingly misinterprets the information, leading to misunderstanding. While repair strategies can help in such situations, it is largely the responsibility of the speechreader to recognize when this is happening and to take the needed steps to mitigate any confusion. 2- Synthetic Approach:
  • 31. exercises There are many exercises that can be used in this approach, most focusing on giving the speechreader some clues such as key words or a topic that will be discussed, presenting the message and having the speechreader respond in a variety of ways. For example, the speechreader could: o reply to a specific question, o repeat a passage, or o incorporate details from the presented message into subsequent discussion 2- Synthetic Approach:
  • 33. definition The Pragmatic Approach focuses primarily on creating the ideal environment and context for the person with hearing loss in dialogue. They employ communication strategies to ensure that residual hearing is maximized to increase comprehension of the speaker. 3- Pragmatic Approach: (Lind, 2009).
  • 34. Theory The aim of this approach is for the individual to: • concentrate on interaction more than the reception of specific cues or sounds, • to ask for modification of the speakers message, the context in which dialogue takes place. • develop specific strategies that they can employ in particular situations that are found to be most difficult to communicate. 3- Pragmatic Approach:
  • 35. The focus of this approach is based on how language is used in social situations and how the use of language can affect those communicating; as a result, most of the exercises are framed from the perspective of interaction. 3- Pragmatic Approach:
  • 36. exercises Practices and exercises used in the Pragmatic Approach tend to incorporate dialogue between pairs or groups of speechreaders, or the speechreader and the instructor/clinician. With practice, the speechreader will employ communication strategies to ensure they are fully engaged and correctly understanding the conversation. 3- Pragmatic Approach: During dialogue btw speechreader & instructor/clinician, the speechreader will have to reply appropriately The instructor provides prompts & cues to help the person get back on track if they do not
  • 37. exercises Other exercises can include:  narratives,  discussion, and  role-playing. Cues such as word order and sequencing, tense and word endings, matching language to the situation and context, among others are important considerations when using this approach 3- Pragmatic Approach:
  • 38. limitations • The most notable is that it is the speechreader’s existing skills that are maximized, with little emphasis on developing new skills. • There is no effort made to incorporate a bimodal approach (two sensory inputs including both auditory and visual cues) to overcoming conversation difficulties. • Another serious limitation, is that there is currently no evidenced-based research to be found on the efficacy of this approach. 3- Pragmatic Approach:
  • 40. Definition (Eclectic approach) The Holistic Approach incorporated aspects from the Analytic, Synthetic and Pragmatic approaches. The main objectives of a Holistic Approach included: “the evaluation and management of overall communication skills, the psychosocial aspects of hearing loss, the education of significant others (e.g. parents, siblings and close friends), hearing aid orientation, an emphasis on improving conversational and interactive skills, and the use of assistive listening devices” 4- Holistic Approach:
  • 41. goals Yoshinaga-Itano (1988) also described a holistic approach to instructing speechreading techniques to children. The training goals included: 4- Holistic Approach: increasing the child’s knowledge of the speechreading process, their ability to generalize strategies to facilitate more successful communication, their tolerance for difficult/frustrating communicative situations. their role in generating personal goals. their motivation to improve their speechreading abilities
  • 42. The rationale behind a Holistic Approach is two fold; Firstly Analytic, Synthetic and Pragmatic approaches each train specific aspects of speech perception and communication strategies that are useful, and the starting point in determining which strategies could be applied is the individual living with hearing loss. Secondly, while there are both benefits and detriments to the Analytic, Synthetic and Pragmatic approaches, an approach that incorporates aspects of each is flexible and can be adapted to specific situations when called for. 4- Holistic Approach:
  • 43. benifit The benefit to using a Holistic paradigm is the client-oriented approach, which is much more empowering to the person seeking help in coping with their hearing loss, and ensures a program that is tailored to the individual or groups’ unique needs. 4- Holistic Approach:
  • 44. limitations Unfortunately, there is a lack of evidence-based research to provide any validity to this particular method, and an obvious need for this remains. It could be argued however, that the research that upholds the value of the Analytic, Synthetic and Pragmatic Approaches could be transferred to the Holistic Approach as it incorporates aspects of all three of the preceding methods, and the skills imparted are not new inventions without prior precedent. 4- Holistic Approach:
  • 45. Study: Does lipreading improve? The study addressed the research questions: Does lipreading improve between the ages of 7 and 14 years? Does hearing loss affect the development of lipreading? children with normal hearing (NH) and with hearing loss (HL) were tested using 4 lipreading instruments. Results: For both groups, lipreading performance improved with age on all 4 measures of lipreading, with the HL group performing better than the NH group. Conclusions: • Results showed that children's lipreading ability improves. • Experience plays an important role in the development of this ability. (HL children lipread better than those with NH) In Hearing In Deaf
  • 46. References: • The Impact of Speechreading Programs on Adults with Hearing Loss, Literature Review Alena Wickware, Project Manager, National Speechreading Program, The Canadian Hard of Hearing Association . • http://www.ssc.education.ed.ac.uk/courses/deaf/ddec05f.html • SLHS 511: Lipreading. Slides and study notes • http://www.vicdeaf.com.au/files/editor_upload/File/Information%20Sheets/Speechreading%20_ Visual%20Cues_.pdf • http://jslhr.pubs.asha.org/article.aspx?articleid=1802630