Technical Seminar presentation
                 on

           Voice morphing

                       Presented
                           By
                     R.Naresh Babu


                       Supervised
                           By
                  Mrs.G.Sandhya Madam
1         VLITS
SEMINAR OUTLINES


    •What It is?
    •Need of Voice Morphing
    •Description the Morphing.
    •Technical details of Morphing.
    •Application areas.


2
Voice Morphing

    • Transition Phenomenon.

    • Technology       developed       at
      the Los Alamos             National
      Laboratory in New Mexico, USA by
      George Papcun .

3
What it actually
           performs ?
    • It is a technique to modify a source
      speaker's speech to sound as if it
      was spoken by a target speaker.
    • Voice morphing enables speech
      patterns to be cloned
      – And an accurate copy of a person's voice
        can be made that can wishes to say,
        anything in the voice of someone else.

4
Need of voice morphing

    • Text To Speech (TTS)
    • In public speech systems
    • For special effects ( just like video
      or image morphing is done ).
    • To diminish Ethnical barriers.


5
Voice Morphing Process

    • Preprocessing    or    representation
      conversion.
    • Pitch and Envelope analysis.
    • Morphing which includes Warping and
      interpolation.
    • Signal re-estimation.


6
Block Diagram




7
Pre-Processing

    • Involves processes like signal
      acquisition in discrete form and
      windowing.




8
Pitch And Envelope
              Analysis
    • This process will extract the pitch.
    • Formant information in the speech
      signal.




9
Conversion




10
Matching and Warping

     • DTW(Dynamic Time Warping)

      - Dynamic Time Warping (DTW) is used to
      find the best match between the pitch of the
      two sounds.




11
Signal Re-Estimation


     • Loss during Signal re-estimation

       - Due to signals being transformation into the
       cepstral domain, a magnitude function is used.
       This results in a loss of phase information in
       the representation of the data.

12
Summarized Block
        Diagram




13
Limitations
      
     •Lots of normalizing problems.
     •Some applications require extensive
     sound libraries.
     •Different languages require different
     phonetics.
     •It is very seldom complete.

14
Advantages

     • Allows speech model to be duplicated
       and an exact copy of a person’s voice.


     • Powerful combat zone weapon.



15
Disadvantages

     • Use to pull out the useful
       information.


     • It hides the actual identity of the
       user.


16
Conclusion
     • The approach we have adopted
       separates the sounds into two forms:
       - Spectral envelope information
       - Pitch and voicing information.
     • Dynamic Time Warping
       - Aligns the sounds with respect to their
       pitches.
     • Signal re-estimation algorithm.
       - Frames are converted back into a time domain
17     waveform.
Application Areas
     • Fake telephone conversations as
       evidence in courts of law.


     • Powerful battlefield weapon.
       - Provide fake orders to the enemy's troops,
       appearing to come from their own commanders.




18
Future Scope
     • Extending the functionality of tool.
       - Create a powerful and flexible morphing
       tool.


     • Increased user interaction.
       - Graphical User Interface could be designed
       and integrated to make the package more
       ‘user-friendly’.


19
Thank you!!!

20
Questions??

21

Voice morphing-101113123852-phpapp01 (1)

  • 1.
    Technical Seminar presentation on Voice morphing Presented By R.Naresh Babu Supervised By Mrs.G.Sandhya Madam 1 VLITS
  • 2.
    SEMINAR OUTLINES •What It is? •Need of Voice Morphing •Description the Morphing. •Technical details of Morphing. •Application areas. 2
  • 3.
    Voice Morphing • Transition Phenomenon. • Technology developed at the Los Alamos National Laboratory in New Mexico, USA by George Papcun . 3
  • 4.
    What it actually performs ? • It is a technique to modify a source speaker's speech to sound as if it was spoken by a target speaker. • Voice morphing enables speech patterns to be cloned – And an accurate copy of a person's voice can be made that can wishes to say, anything in the voice of someone else. 4
  • 5.
    Need of voicemorphing • Text To Speech (TTS) • In public speech systems • For special effects ( just like video or image morphing is done ). • To diminish Ethnical barriers. 5
  • 6.
    Voice Morphing Process • Preprocessing or representation conversion. • Pitch and Envelope analysis. • Morphing which includes Warping and interpolation. • Signal re-estimation. 6
  • 7.
  • 8.
    Pre-Processing • Involves processes like signal acquisition in discrete form and windowing. 8
  • 9.
    Pitch And Envelope Analysis • This process will extract the pitch. • Formant information in the speech signal. 9
  • 10.
  • 11.
    Matching and Warping • DTW(Dynamic Time Warping) - Dynamic Time Warping (DTW) is used to find the best match between the pitch of the two sounds. 11
  • 12.
    Signal Re-Estimation • Loss during Signal re-estimation - Due to signals being transformation into the cepstral domain, a magnitude function is used. This results in a loss of phase information in the representation of the data. 12
  • 13.
  • 14.
    Limitations   •Lots of normalizing problems. •Some applications require extensive sound libraries. •Different languages require different phonetics. •It is very seldom complete. 14
  • 15.
    Advantages • Allows speech model to be duplicated and an exact copy of a person’s voice. • Powerful combat zone weapon. 15
  • 16.
    Disadvantages • Use to pull out the useful information. • It hides the actual identity of the user. 16
  • 17.
    Conclusion • The approach we have adopted separates the sounds into two forms: - Spectral envelope information - Pitch and voicing information. • Dynamic Time Warping - Aligns the sounds with respect to their pitches. • Signal re-estimation algorithm. - Frames are converted back into a time domain 17 waveform.
  • 18.
    Application Areas • Fake telephone conversations as evidence in courts of law. • Powerful battlefield weapon. - Provide fake orders to the enemy's troops, appearing to come from their own commanders. 18
  • 19.
    Future Scope • Extending the functionality of tool. - Create a powerful and flexible morphing tool. • Increased user interaction. - Graphical User Interface could be designed and integrated to make the package more ‘user-friendly’. 19
  • 20.
  • 21.

Editor's Notes

  • #2 MAHATMA GANDHI MISSION ENGINEERING COLLEGE,NOIDA
  • #6 MAHATMA GANDHI MISSION ENGINEERING COLLEGE,NOIDA