Your SlideShare is downloading. ×
0
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
VOIP Colloquium SIP SPEECH PHONE
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

VOIP Colloquium SIP SPEECH PHONE

510

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
510
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. VOIP Colloquium SIP SPEECH PHONE Mathieu Benoit Sai Nithin Singh C. Supervisor: Prof. Carol Davids
  • 2. VOIP NEW ARCHITECTURE : IMS IP Multimedia Subsystem Convergence of by defined voice and 3GPP services! data and 3GPP2 standards. IP LAYER IP LAYER
  • 3. VOIP TECHNOLOGY : CONVERGENCE??? New age in telecommunications : ØNEW TECHNOLOGY (Wireless, VoIP,…) ØNEW APPLICATIONS (Tele banking, Tele medicine,…) ØNEW POSSIBILITIES ØNEW PROMISES ØNEW HOPES…For disabled people
  • 4. VoIP- A step forward for the hearing impaired VoIP offers us a unique opportunity to significantly improve communication : • Not only for those of us who can hear, but also for the audibly challenged. • A unique opportunity to bridge the gap that has long-existed between PSTN text phone users in different countries. • Finally, have a 21st Century Phone offering services with no barriers.
  • 5. Existing solution in the market … nTTY (Text Telephone) nTDD (Telecommunications Device for the Deaf) nTelephone Relay Assistance Center Highly trained professionals take calls from TDDs and relay the messages by telephone to hearing people or take telephone calls from hearing people and relay the messages via TDD to the hearing impaired e.g.: The 1-800-743-3333 provide the relay service for Sprint nVOIP : Few services not really efficient Only few concepts using video or IM messaging…
  • 6. Old problem… new solution. TEXT TEXT NO VOICE VOICE Hearing Enabled Hearing INTERNET Soft / Hard Phone Impaired SIPor PSTN SIP- Phone - Speech Synthesizer//Recognizer How VoIP Can Connect these two?
  • 7. SIP SPEECH PHONE: Text To Speech SIP PROXY SERVER Hello? TEXT VOICE Hearing INTERNET Hearing Enabled SIP- SIP- Phone Soft / Hard Phone Impaired // PSTN Speech Synthesizer// Synthesizer//Recognizer
  • 8. SIP SPEECH PHONE: Speech To Text SIP PROXY SERVER Yes! TEXT VOICE Hearing INTERNET Hearing Enabled SIP- SIP- Phone Soft / Hard Phone Impaired PSTN Speech Synthesizer //Recognizer //Recognizer
  • 9. VoIP Lab configuration
  • 10. VoIP Lab configuration SOFT PHONE 1 SIP PROXY SOFT PHONE 2 • Windows Platform • Linux Platform • Windows Platform • Java JDK • Java JDK • Java JDK • Java Media Framework • IM Manager • Java Media Framework • IDE Eclipse • Ethereal • IDE Eclipse • Ethereal • Ethereal
  • 11. Software Engineering DEVELOPMENT METHODOLOGY: -Software prototype ( Fast Development and validation tests) “Proof of Concept” - Programming Language : Java SPECIFICATION (based on RFC) : • RFC 3351 - User Requirements for the Session Initiation Protocol (SIP) in Support of Deaf, Hard of Hearing and Speech-impaired Individuals •RFC 3261- SIP: Session Initiation Protocol • RFC 3550 - RTP: A Transport Protocol for Real-Time Applications •RFC 3428 - Session Initiation Protocol (SIP) Extension for Instant Messaging
  • 12. Project Architecture USER SPEECH APPLICATION CALL/SESSION MANAGER MEDIA PROCESSING SIP INFRASTRUCTURE
  • 13. SIP Architecture • A SIP Soft Phone written in JAVA with voice and instant messaging client SIP •Open Source PHONE • Jain-Sip-Applet-Phone – based on JAIN SIP APIs • Use Java Media Framework (JMF). • SIP user-agent with audio support RTP • A SIP Proxy Server written entirely in the Java SIP • Open Source PROXY • JAIN-SIP Proxy Server – based on JAIN SIP APIs SERVER • Presence Server capability • Registrations uploading • Trace viewer
  • 14. SPEECH ARCHITECTURE • A speech synthesizer written entirely in the Java • Open Source SPEECH SPEECH • FreeTTS 1.2 – based on Java Speech APIs SYNTHETIZER SYNTHETIZER • A medium quality, unlimited domain, 16kHz diphone voice, called kevin16 • A speech recognizer written entirely in the Java • Open Source SPEECH SPEECH • Sphinx-4 – based on Java Speech APIs RECOGNIZER RECOGNIZER • A Small Vocabulary with approximately 100 words
  • 15. THE BUILDOUT CHALLENGE 1 : INTEGRATION SIP PROXY SERVER SPEECH SPEECH SIP SPEECH SPEECH RECOGNIZER RECOGNIZER PHONE SYNTHETIZER SYNTHETIZER CODE CODE CODE CODE CODE SIP- SIP- Phone Libraries, Libraries, Libraries, Configuration, Speech Configuration, Configuration, … Synthesizer //Recognizer … //Recognizer …
  • 16. THE BUILDOUT CHALLENGE 2: STREAMS SIP PROXY SERVER <IM SIP al Me sign sign ge> ss al S IP essa ag M e> <IM RTP STREAM AUDIO SIP- SIP- Phone SIP- SIP- Phone Speech Speech Synthesizer //Recognizer //Recognizer Synthesizer //Recognizer //Recognizer
  • 17. Proxy and Speech Engine Features 3 different voices: • an 8khz diphone, male, US English voice • a 16khz diphone, male US English voice • a 16khz limited domain, male US English voice
  • 18. Phone Features Menu • Configuration • Register • Unregister • Exit Display the list of contacts Manage contact with Add/Remove Action
  • 19. Phone Features Chat Box Send an IM Display the Using Speech conversation Synthesis Speech recognition Push-to-talk Make a phone Call Audio/RTP
  • 20. Conclusion STATE OF THE PROJECT: SIP Speech Phone is working in his first version Speech synthesis and recognition are functional Integration of complete Handling different stream and push audio synthesis in real stream call (in progress) FUTURE IMPROVEMENT: Utilization of continuous speech recognition Extend the vocabulary Add more voices Add Video Use of Avatar ( Language of signs)
  • 21. Thank you for your attention.

×