The document describes the design and development of a Speech to Sign Language Interpreter System (SSLIS). The system uses Sphinx 3.5 for automatic speech recognition (ASR) to convert speech to text. It then maps the recognized text to American Sign Language (ASL) videos stored in a database for translation and live signing. The system aims to improve accessibility for the deaf by providing free, open-source sign language interpretation software.