Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Speech2RTT Communicator: Application Overview

1,123 views

Published on

Speech2RTT® enables people who are deaf, hard of hearing, late-deafened, and speech-impaired, to communicate with anyone using an Android smart phone. Users are given the option of using:

* Speech to real-time text streaming technology; or,

* A virtual/physical/Bluetooth smart phone keyboard.

Speech2RTT® is an Android mobile app that handles all of the following processes, locally, using your Android smart phone’s memory, CPU and storage space simultaneously and in real time:

* Speech Recognition;

* Speech Transcription;

* Error Correction;

* Streaming transcribed text to other party;

* Receiving and display the other party’s text messages in real time;

Features
======

* Can be used by people who are deaf, hard of hearing, late-deafened, and speech-impaired to communicate with anyone using standard Android smart phones;

* Conversations are 100% private. No communications assistants (CAs) are involved;

* Fast: Less than 300 ms latency;

* No voice-training is needed, even with accents, since the speech recognition engine is speaker-independent;

* Provides free local and national real time text communications;

* Secure end-to-end encryption;

* Shows notifications received even when Speech2RTT® Communicator Beta is not active;

* Speech is transcribed into text in real-time;

* Streaming text will automatically “catch up” should there be an unstable network connection;

* There are no limits to the length of conversations;

* Users can continue old conversations from where they left off in a previous conversation, or start a new (clean) conversation.

* Allows users to search through contacts easily to locate people;

* Allows sharing chat conversations with participants;

* Automatically compresses the text being streamed, in real-time, for optimal bandwidth use;

* Saves contact information by using the first contact name occurring alphabetically (in the case of multiple contact listings);

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Speech2RTT Communicator: Application Overview

  1. 1. Speech2RTT Communicator An IDEAL Group, Inc. Innovation Creating, Innovating, Disrupting Presented by: Steve Jacobs, President IDEAL Group, Inc. Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 1 Download Speech2RTT from Google Play Store
  2. 2. Credits and Disclaimer • Thank you to the The Rehabilitation Engineering Research Center for Information and Communications Technology Access (LiveWell RERC) for funding the development of Speech2RTT® under a grant from the National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR grant number 90RE5023). NIDILRR is a Center within the Administration for Community Living (ACL), Department of Health and Human Services (HHS). • The contents of this presentation do not necessarily represent the policy of NIDILRR, ACL, or HHS, and you should not assume endorsement of Speech2RTT, by the Federal Government. 22Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved.
  3. 3. About Speech2RTT (1 of 2) Speech2RTT enables people who are deaf, hard of hearing, late-deafened, and speech-impaired, to communicate with anyone using an Android smart phone. Users are given the option of using: • Speech to real-time text streaming technology; or, • A virtual/physical/Bluetooth smart phone keyboard. 3Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved.
  4. 4. About Speech2RTT (2 of 2) The Bleeding Edge Speech2RTT® is an Android mobile app that handles all of the following processes, locally, using your Android smart phone’s memory, CPU and storage space simultaneously and in real time: • Speech Recognition; • Speech Transcription; • Error Correction; • Streaming transcribed text to other party; • Receiving and display the other party’s text messages in real time; Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 4
  5. 5. Using Speech2RTT: Always do the Following • After speaking each string of text, pause for two (2) seconds before commencing to speak again. • If you find that you are talking over each other, and that words are being dropped at the beginning of sentences, please take turns speaking/typing. • Speak as clearly and distinctly as possible; • Speak at a normal pace; • If words are transcribed incorrectly, repeat them; • If you opt to type your messages in real time, make sure that Speech2RTT’s “Stop Listening” button is activated. 5Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved.
  6. 6. The Challenge of Processing Everything Locally • There are astronomical differences in CPU power/speed, memory capabilities, and disk space from phone to phone. o Android CPU ratings (across 738 Android model devices) vary from a low of 318 to a current high of 237,346, with an average rating of 19,468. o The high to low processing power ratio is 746:1! o There are 18,017 model Android devices are currently in use, around the world! • Android device performance ratings: o CPU o Memory o Disk 6Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved.
  7. 7. Why Process Everything Locally? • A future release of Speech2RTT will include a Peer- to-Peer (P2P) communication (device to device, directly) feature without requiring the availability of communication networks, either fixed or wireless. • P2P communication applications that are operable in cases of catastrophic natural (and other) disasters that take out all communications can be life-saving. For example: • List of U.S. Billion-dollar disaster events, 1980–2017 7Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved.
  8. 8. Features (1/3) • Can be used by people who are deaf, hard of hearing, late-deafened, and speech-impaired to communicate with anyone using standard Android smart phones; • Conversations are 100% private. No communications assistants (CAs) are involved; • Fast: Less than 300 ms latency; • No voice-training is needed, even with accents, since the speech recognition engine is speaker-independent; • Provides free local and national real time text communications; Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 8
  9. 9. Features (2/3) • Secure end-to-end encryption; • Shows notifications received even when Speech2RTT® Communicator Beta is not active; • Speech is transcribed into text in real-time; • Streaming text will automatically “catch up” should there be an unstable network connection; There are no limits to the length of conversations; and, • Users can continue old conversations from where they left off in a previous conversation, or start a new (clean) conversation. Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 9
  10. 10. Features (3/3) • Allows users to search through contacts easily to locate people; • Allows sharing chat conversations with participants; • Automatically compresses the text being streamed, in real-time, for optimal bandwidth use; • Saves contact information by using the first contact name occurring alphabetically (in the case of multiple contact listings); Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 10
  11. 11. Can Provide Customized Word Prediction with third-party application Dictionaries can be automatically generated (user option) by enabling the keyboard to automatically word-mine and analyze a user’s Facebook and Twitter accounts, SMS messages and eMails accounts. Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 11
  12. 12. Pricing • Free until October 1, 2018 • $1/month thereafter Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 12
  13. 13. Why Such a Low Price? • Puts pressure on future competitors to keep prices reasonably low • People who are deaf, hard-of-hearing, and those with speech disabilities should not have to pay a premium to communicate with others, independently, or be forced to depend upon subsidized services which have many, limitations, including lack of privacy Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 13
  14. 14. Cost of Telecommunication Relay Services (TRS) Not Including Video Relay Services (VRS) 2017-2018 TRS rate per-minute compensation rates for interstate and Internet-based TRS, other than video relay service (VRS), as follows: • Interstate traditional TRS, $2.9186/minute; • Interstate captioned telephone service (CTS) and Internet Protocol captioned telephone service (IP CTS), $1.9467/minute; • IP Relay, $1.3350/minute;. Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 14
  15. 15. Currently: Supports 64 Languages (1 of 2) Afrikaans, Amharic, Arabic, Armenian, Azerbaijani, Basque, Bengali, Bulgarian, Catalan, Chinese (Cantonese), Chinese (Mandarin), Croatian, Czech, Danish, Dutch, English, Filipino, Finnish, French, Galician, Georgian, German, Greek, Gujarati, Hebrew, Hindi, Hungarian, Icelandic, Indonesian, Italian, Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 15
  16. 16. Currently: Supports 64 Languages (2 of 2) Japanese, Javanese, Kannada, Khmer, Korean, Lao, Latvian, Lithuanian, Malay, Malayalam, Marathi, Nepali, Norwegian, Persian, Polish, Portuguese, Romanian, Russian, Serbian, Sinhala, Slovak, Slovenian, Spanish, Sundanese, Swahili, Swedish, Tamil, Telugu, Thai, Turkish, Ukrainian, Urdu, Vietnamese, and Zulu. Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 16
  17. 17. Future Release: to 94 Countries (1 of 3) Algeria, Argentina, Armenia, Australia, Azerbaijan, Bahrain, Bangladesh, Bolivia, Brazil, Bulgaria, Cambodia, Canada, Chile, China, Colombia, Costa Rica, Croatia, Czech Republic, Denmark, Dominican Republic, Ecuador, Egypt, El Salvador, Ethiopia, Finland, France, Georgia, Germany, Ghana, Greece, Guatemala, Honduras, Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 17
  18. 18. Future Release: Add Simultaneous Speech • Current, Android, architectural, barriers prevent speech + speech2RTT from being implemented simultaneously. • Adds two more process to the list of local processes that needs to be handled simultaneously o Speech transmission o Speech reception o Speech recognition o Speech Transcription o Error Correction o Streaming transcribed text to other party; and, o Receiving and display the other party’s text messages in real time. Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 18
  19. 19. Future Release: to 94 Countries (2 of 3) Hong Kong, Hungary, Iceland, India, Indonesia, Iran, Iraq, Ireland, Israel, Italy, Japan, Jordan, Kenya, Kuwait, Laos, Latvia, Lebanon, Lithuania, Malaysia, Mexico, Morocco, Nepal, Netherlands, New Zealand, Nicaragua, Nigeria, Norway, Oman, Pakistan, Panama, Paraguay, Peru, Philippines, Poland, Portugal, Puerto Rico, Qatar, Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 19
  20. 20. Future Release: to 94 Countries (3 of 3) Romania, Russia, Saudi Arabia, Serbia, Singapore, Slovakia, Slovenia, South Africa, South Korea, Spain, Sri Lanka, State of Palestine, Sweden, Taiwan, Tanzania, Thailand, Tunisia, Turkey, Ukraine, United Arab Emirates, United Kingdom, United States, Uruguay, Venezuela, and Vietnam; Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 20
  21. 21. Word Expansion for KB Users with third-party application Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 21
  22. 22. Future Release: Braille Display Access for Deaf/Blind Users Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 22
  23. 23. Future Release: Literary Braille Choices Arabic, Catalan, Czech, Danish Grade 1/2, Dutch, English (UEB) Grade 1/2, English (United Kingdom) Grade 1/2, English (United States) Grade 1/2, French (Canada) Grade 1/2, French (France) Grade 1/2, German (Germany) Grade 0/1/2, German (Switzerland) Grade 0/1/2, Greek, Hindi, Hungarian, Italian, Korean Grade 1/2, Latvian, Norwegian Bokmal Grade 0/1/2/3, Polish, Portuguese Grade 1/2, Russian, Serbian, Slovak, Slovenian, Spanish, and Swedish. Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 23
  24. 24. Future Release: Computer Braille Choices Bulgarian, Chinese, Chinese (Taiwan), Croatian, Danish, English (Canada), English (United States), Estonian, Finnish, French, German, Hebrew, Hungarian, Icelandic, Italian, Lithuanian, Norwegian Bokmal, Portuguese, Romanian, Russian, Slovenian, Spanish, Swedish, Turkish, and Vietnamese. Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 24
  25. 25. Future Release: Peer to Peer (P2P) Mode (1/4) Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 25
  26. 26. Future Release: P2P Mode Benefits (2/4) • Enables fully offline connections between nearby devices (in close proximity to each other); • Connections between devices are high-bandwidth, low-latency, and fully encrypted, fast, and secure; • Uses a combination of Classic Bluetooth, Bluetooth LE, and WiFi hotspots while circumventing their respective weaknesses; and, • Users are not prompted to turn on Bluetooth or WiFi because when these features are required, they are activated automatically. Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 26
  27. 27. Future Release: P2P Mode Benefits (3/4) • Upon completion of a conversation, your smart phone is automatically returned to its prior operational state; • Walki-Talki feature; Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 27
  28. 28. Future Release: P2P Mode Benefits (4/4) • Can be a life-saving capability in the case of catastrophic natural (and other) disasters that take out communications networks both fixed and wireless. • List of U.S. Billion-dollar disaster events, 1980–2017 Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 28
  29. 29. Future Release: Real-Time Language Translation Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 29
  30. 30. Future Release: Halo Wifi Communications Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 30
  31. 31. Future Release: Android-Based AAC Interface Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 31
  32. 32. Speech2RTT Communicator Team Members • Steve Jacobs • Saurabh Gupta • Robert Felgar • Nermin Selimic • Gunnar Hellström • Kevin Dwinnell • Katie Robinson • Staffan Hellström Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 32
  33. 33. Benchmark Testing Protocol (1 of 2) Tests Used: • Available RAM • Speed of CPU • Speed of Disk I/O • Speed of Network Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved. 33
  34. 34. Benchmark Testing Protocol (2 of 2) 34Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved.
  35. 35. Using Speech2RTT: Never do the Following • Do not place 911 RTT calls or any other type of calls that could you consider critical, or an emergency. It was not designed to do this. • Do not use Speech2RTT to try and establish “TTY to RTT” or “RTT to TYY” communications. It was not designed to do this. • Do not use Speech2RTT when other VoIP, SIP, or Wi- Fi calling apps are running at the same time. It was not designed to do this. 35Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved.
  36. 36. Using Speech2RTT: Always do the Following • After speaking each string of text, pause for two (2) seconds before commencing to speak again. • If you find that you are talking over each other, and that words are being dropped at the beginning of sentences, please take turns speaking/typing. • Speak as clearly and distinctly as possible; • Speak at a normal pace; • If words are transcribed incorrectly, repeat them; • If you opt to type your messages in real time, make sure that Speech2RTT’s “Stop Listening” button is activated. 36Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved.
  37. 37. Additional Information Regarding Speech2RTT • Download Speech2RTT from Google Play Store • Flowcharts • Disclaimer • Privacy Policy • Use of Permissions • All Credits • Documentation • Press Kit 37Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved.
  38. 38. About IDEAL Group, Inc. • History • Companies: o Apps4android, Inc. o IDEAL Captions, Inc. o InftyReader Group, Inc. o Knowledge Discovery Solutions, Inc. o Speech2RTT Communications, Inc. 38Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved.
  39. 39. Contact Information Steve Jacobs, President and CEO IDEAL Group, Inc. steve.jacobs@ideal-group.org http://ideal-group.org Cell: (614) 777-0660 Fax: (614) 522-1031 TTY: (800) 750-0750 Skype: stevenijacobs IDEAL Group 39Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved.
  40. 40. Thank you for your time! 40Copyright© 2013-2018 by IDEAL Group, Inc. All rights reserved.

×