Silent Sound Technology
Najeeb P [EPAKECS029]
Guide : Raseek C , Asst.Professor
Department of Computer Science and Engineering
Government Engineering College,Sreekrishnapuram
12th March 2014
Introduction
Why ..... ???
Methods
Design
Features
Restrictions
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 2
• Silence is the best answer for all the situations... even your
mobile understands!
• A technolgy that transforms the information without using our
vocal chords.
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 3
Introduction
Why ..... ???
Methods
Design
Features
Restrictions
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 4
Need For Silent Sound Technology
1
1
http://www.go-gulf.com/crowd talking on mobile phones-300x225.jpg
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 5
Need For Silent Sound Technology
• For a better way of communication in noisy public place.
• Perfect solution for those who lost their voice.
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 6
Introduction
Why ..... ???
Methods
Design
Features
Restrictions
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 7
Two methods are used
• Electromyography(EMG)
• Image Processing
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 8
Electromyography(EMG)
2
2
http://www.telecomspace.com/les/cebit/device.jpg
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 9
Electromyography(EMG)
• Even by saying words without producing sound weak electric
currents are sent from brain to speech muscles. This
phenomenon is called ELECTROMYOGRAPHS.
• A technique for evaluating and recording the electrical activity
produced by articulatory muscles.
• The transducers involved convert the pulses into electrical
signals.
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 10
Electromyography(EMG)
3
3
Reference[1]
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 11
Working..
• The sensors(each with two ne-wired electrodes) are attached
to the dierent part of the face
• The electrical activity is recorded
• The sensors has to be placed at various locations to obtain an
accurate signal
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 12
Working...
• Vocoder (voice encoder) converts this electrical signals into
speech patterns.
• Compare them with pre recorded speech pattern of spoken
words
• When there is a match, that sound is transmitted on to the
other end of the line.
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 13
Sensors used
• Pressure sensors
• Vibration sensors
• Electromagnetic sensor
• Motion sensors
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 14
Image Processing
4
4
http://www.telecomspace.com/silent sound/image processing.png
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 15
Image Processing
• Converting digital data tape into a lm image with minimal
corrections and calibrations.
• In the silent sound technology the output of this image
processing is an audio record.
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 16
Introduction
Why ..... ???
Methods
Design
Features
Restrictions
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 17
Components
• Data acquisition
• Online recognition
• Sound playback or synthesis
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 18
EMA based silent speech interface
5
5
Reference [1]
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 19
Data Collection and Processing[1]
Stimuli and Procedure
• A xed number of sentences for basic greeting and
conversation were selected form a list of most frequently used
sentences among AAC users
• The electromagnetic articulograph AG500 was used to register
the 3-D movements of the tongue, lip, and jaw when a subject
was talking.
• The articulograph records the movement by establishing a
calibrated electromagnetic eld.
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 20
Data Collection and Processing[1]
Data Processing
• Head movements were subtracted from the tongue and lip
locations.
• A zero-phase low-pass lter was applied for removing signal
noise.
• All sequences were manually segmented and annotated with
sentences.
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 21
Introduction
Why ..... ???
Methods
Design
Features
Restrictions
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 22
Features
• Native speakers can silently utter a sentence in their language,
and the receivers can hear the translated sentence in their
language.
• It appears as if the native speaker produced speech in a foreign
language.
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 23
Features
• The translation technology works for languages like English,
French and German.
• Allow people to make silent calls without bothering others.
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 24
Introduction
Why ..... ???
Methods
Design
Features
Restrictions
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 25
Restrictions
• This device presently needs nine leads to be attached to our
face which is quite impractical to make it usable.
• Complicated to identify person and emotions.
• Technology is dicult to apply in some language like Chinese,
where dierent tones can hold many dierent meanings.
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 26
Introduction
Why ..... ???
Methods
Design
Features
Restrictions
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 27
Applications
• Helping people who have lost their voice due to illness or
accident.
• Telling a trusted friend your PIN number over the phone
without anyone eavesdropping  assuming no lip-readers are
around.
• Silent Sound Techniques is applied in Military for
communicating secret/condential matters to others.
• Eective calls in crowded place.
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 28
Introduction
Why ..... ???
Methods
Design
Features
Restrictions
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 29
Conclusion
• Silent Sound Technology one of the recent trends in the eld of
information technology implements Talking without Talking.
• It will be one of the innovation and useful technology and in
coming future this technology will be use in our day to day life
• The online algorithm still has room for improvement.
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 30
REFERENCE
• [1] Ashok samal,Frank Rudzicz,Jordan R Green and Jun Wang,
Sentence recognition from articulatory movements for Silent
Speech Interfaces ,IEEE International Conference on
Acoustics, Speech, and Signal Processing (ICASSP), 2012 ,
Page(s): 4985 - 4988 .
• [2] Ashok samal,Jordan R Green, Jun Wang and Tom D.
Carrell, Vowel recognition from continuous articulatory
movements for speaker dependent application, Signal
Processing and Communication Systems (ICSPCS), 2010 ,
Page(s): 1-7.
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 31
• [3] Guangqi Cao, Meng M. Helen and Zhiyong Wu,A Unied
Framework for Multilingual Text-to-Speech Synthesis with
SSML Specication as Interface,IEEE Tsinghua Science and
Technology ,2009 , Page(s): 623 - 630 .
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 32
Thank You for the attention
Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 33

silent sound technology

  • 1.
    Silent Sound Technology NajeebP [EPAKECS029] Guide : Raseek C , Asst.Professor Department of Computer Science and Engineering Government Engineering College,Sreekrishnapuram 12th March 2014
  • 2.
    Introduction Why ..... ??? Methods Design Features Restrictions SilentSound Technology Najeeb P [EPAKECS029] Department of Computer Science 2
  • 3.
    • Silence isthe best answer for all the situations... even your mobile understands! • A technolgy that transforms the information without using our vocal chords. Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 3
  • 4.
    Introduction Why ..... ??? Methods Design Features Restrictions SilentSound Technology Najeeb P [EPAKECS029] Department of Computer Science 4
  • 5.
    Need For SilentSound Technology 1 1 http://www.go-gulf.com/crowd talking on mobile phones-300x225.jpg Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 5
  • 6.
    Need For SilentSound Technology • For a better way of communication in noisy public place. • Perfect solution for those who lost their voice. Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 6
  • 7.
    Introduction Why ..... ??? Methods Design Features Restrictions SilentSound Technology Najeeb P [EPAKECS029] Department of Computer Science 7
  • 8.
    Two methods areused • Electromyography(EMG) • Image Processing Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 8
  • 9.
  • 10.
    Electromyography(EMG) • Even bysaying words without producing sound weak electric currents are sent from brain to speech muscles. This phenomenon is called ELECTROMYOGRAPHS. • A technique for evaluating and recording the electrical activity produced by articulatory muscles. • The transducers involved convert the pulses into electrical signals. Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 10
  • 11.
    Electromyography(EMG) 3 3 Reference[1] Silent Sound TechnologyNajeeb P [EPAKECS029] Department of Computer Science 11
  • 12.
    Working.. • The sensors(eachwith two ne-wired electrodes) are attached to the dierent part of the face • The electrical activity is recorded • The sensors has to be placed at various locations to obtain an accurate signal Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 12
  • 13.
    Working... • Vocoder (voiceencoder) converts this electrical signals into speech patterns. • Compare them with pre recorded speech pattern of spoken words • When there is a match, that sound is transmitted on to the other end of the line. Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 13
  • 14.
    Sensors used • Pressuresensors • Vibration sensors • Electromagnetic sensor • Motion sensors Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 14
  • 15.
    Image Processing 4 4 http://www.telecomspace.com/silent sound/imageprocessing.png Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 15
  • 16.
    Image Processing • Convertingdigital data tape into a lm image with minimal corrections and calibrations. • In the silent sound technology the output of this image processing is an audio record. Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 16
  • 17.
    Introduction Why ..... ??? Methods Design Features Restrictions SilentSound Technology Najeeb P [EPAKECS029] Department of Computer Science 17
  • 18.
    Components • Data acquisition •Online recognition • Sound playback or synthesis Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 18
  • 19.
    EMA based silentspeech interface 5 5 Reference [1] Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 19
  • 20.
    Data Collection andProcessing[1] Stimuli and Procedure • A xed number of sentences for basic greeting and conversation were selected form a list of most frequently used sentences among AAC users • The electromagnetic articulograph AG500 was used to register the 3-D movements of the tongue, lip, and jaw when a subject was talking. • The articulograph records the movement by establishing a calibrated electromagnetic eld. Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 20
  • 21.
    Data Collection andProcessing[1] Data Processing • Head movements were subtracted from the tongue and lip locations. • A zero-phase low-pass lter was applied for removing signal noise. • All sequences were manually segmented and annotated with sentences. Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 21
  • 22.
    Introduction Why ..... ??? Methods Design Features Restrictions SilentSound Technology Najeeb P [EPAKECS029] Department of Computer Science 22
  • 23.
    Features • Native speakerscan silently utter a sentence in their language, and the receivers can hear the translated sentence in their language. • It appears as if the native speaker produced speech in a foreign language. Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 23
  • 24.
    Features • The translationtechnology works for languages like English, French and German. • Allow people to make silent calls without bothering others. Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 24
  • 25.
    Introduction Why ..... ??? Methods Design Features Restrictions SilentSound Technology Najeeb P [EPAKECS029] Department of Computer Science 25
  • 26.
    Restrictions • This devicepresently needs nine leads to be attached to our face which is quite impractical to make it usable. • Complicated to identify person and emotions. • Technology is dicult to apply in some language like Chinese, where dierent tones can hold many dierent meanings. Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 26
  • 27.
    Introduction Why ..... ??? Methods Design Features Restrictions SilentSound Technology Najeeb P [EPAKECS029] Department of Computer Science 27
  • 28.
    Applications • Helping peoplewho have lost their voice due to illness or accident. • Telling a trusted friend your PIN number over the phone without anyone eavesdropping assuming no lip-readers are around. • Silent Sound Techniques is applied in Military for communicating secret/condential matters to others. • Eective calls in crowded place. Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 28
  • 29.
    Introduction Why ..... ??? Methods Design Features Restrictions SilentSound Technology Najeeb P [EPAKECS029] Department of Computer Science 29
  • 30.
    Conclusion • Silent SoundTechnology one of the recent trends in the eld of information technology implements Talking without Talking. • It will be one of the innovation and useful technology and in coming future this technology will be use in our day to day life • The online algorithm still has room for improvement. Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 30
  • 31.
    REFERENCE • [1] Ashoksamal,Frank Rudzicz,Jordan R Green and Jun Wang, Sentence recognition from articulatory movements for Silent Speech Interfaces ,IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2012 , Page(s): 4985 - 4988 . • [2] Ashok samal,Jordan R Green, Jun Wang and Tom D. Carrell, Vowel recognition from continuous articulatory movements for speaker dependent application, Signal Processing and Communication Systems (ICSPCS), 2010 , Page(s): 1-7. Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 31
  • 32.
    • [3] GuangqiCao, Meng M. Helen and Zhiyong Wu,A Unied Framework for Multilingual Text-to-Speech Synthesis with SSML Specication as Interface,IEEE Tsinghua Science and Technology ,2009 , Page(s): 623 - 630 . Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 32
  • 33.
    Thank You forthe attention Silent Sound Technology Najeeb P [EPAKECS029] Department of Computer Science 33