Making this document public after 5 years. In 2013, I conceptualized Voice enabled speakers and presented a detailed concept and we prepared a demo Ashutosh Agrawal Mohan Krishna Ranganathan Tauseef Khan Chetan Deshpande Darshan Virupaksha Chandramouli Venkatanarayan Suhas Rao (Suhas is in this video on linkedin) and many more involved. We also presented the demo to lot of firms for tech selling as a service and they did not believe in voice. The spooky thing was we named it SmartAlex. Below is the video of SmartAlex 9On linkedin) for Automation in Hotels (Shot in 2013). We had many usecases for hospitals, homes and usual skills. To our surprise over a year later Amazon launched a voice enabled speaker and guess what the name was? Alexa ! They for sure were working on Echo few years earlier than us. Anyways it was truly exciting and disappointing at the same time to have come that close something that has become so big today. Amazon/Google are yet to implement many features that were in original concept, I can certainly share across the original concept papers. For few it might be hilarious and astonishing at same time to see the product concept document.

1. ®

2. A solution that brings “Life” in the consumer products – Makes it interact, Speak,
Feel – So much so that you emotionally connect to it and refer to it as “Alex” !
SmartAlex® is “A voice assisted socially aware hybrid platform solution, capable
of intelligent social interaction and assistance“. The solution can be
deployed/integrated within any product - be it a consumer/enterprise product,
any smart device or any M2M solution. SmartAlex seamlessly interacts with Altiux
or any third party cloud platform/solutions and appends voice features to it also
it rapidly builds social intelligence, quickly adapts and learns from the
environment and puts in use that critical intelligence in assisting social
circles/hubs.
In addition SmartAlex® also designed to magically integrate with ‘Social
Automation’ solution viz. Home Automation, Office Automation or any
 Minimum development/Integration effort for deployment in existing customer solutions or
end products
 Smart Social Cloud Intelligence framework that builds on the Intelligence rapidly
 Configurable solution platform for resident/cloud/hybrid intelligence
 Secured* Always listening feature and Configurable consumer friendly wake up command
for active responses
 Fast and accurate Speech recognition services, powered by Nuance* Speech Engines
 Scalable to adapt/configure to any cloud automation platform

3. M2M/enterprise* automation and appends the existing automation solutions
with voice assisted control and convenience features.
SmartAlex® solution deployed in home automation (Convenience, Control) is
depicted above, one possibility being solutions integrated in Multimedia speakers
as platform applications.

4. SmartAlex® platform solution is capable of
getting deployed with any network enabled
system having listen (Mic) and Talk (Speaker)
functionality. The platform solution is scalable to
work with remote microphones (if required) for
accurate natural human interaction.
SmartAlex® solution can work with multiple
products having such solutions deployed in any
social hub. It gathers its intelligence from each
one of them and decides on the action to be
performed.
SmartAlex® Platform Overview
SmartAlex platform has 3 key component engines to accomplish the goal of “A
voice assisted, socially aware, interactive social assistance solution”
 vCoCo® (Voice Command and Control) Engine
o Analyse the voice command and act to control
 sSense® (Social Sense) Engine
o The social awareness intelligence with always ‘Mic ON’ feature
o Analyse speech and build social intelligence
 sAssist® (Social Assistance) Engine
o In contrast to Personal voice assistance on smartphones, Social
Assistance has different flavour of operation
o Analyse the voice and respond back with necessary information
sSense Engine
vCoCo
Engine
sAssist
Engine
Sensor Data Control
User Input/ Data Voice Assistance
SmartAlex®
‘RAVI’
Rapid Analytics of Voice Intelligence

5. SmartAlex® innovatively brings Users and their Machines closer, makes both the
worlds interact in a given social environment. Unlike the traditional thought of
user independent automation, SmartAlex® integrates both the worlds and
interacts with end users - Sharing useful, relevant information for making
consumer experience better. The solution gradually builds its social intelligence
and awareness bringing much needed consumer delight.
Comprehensive Platform Features:
 SmartAlex® cloud platform for voice enablement of any M2M/IoT platform
 Baby Alex SoC support for integration - having Resident/Hybrid/Cloud
backend service
 Configurable Critical Resident CoCo Solutions (Convenience and Control)
for environments having low/no connectivity to internet
 Platform powered by Altiux patented ‘RAVI’ Engine (Rapid Analytics of
Voice Intelligence engine) having
o Social awareness
o Context awareness
 Altiux proprietary ‘sSense’, ‘sAssist’ and ‘vCoCo’ engines
 Proprietary ‘ReachAlex’ feature to rapidly identify Alex over any IP network
for remote convenience and control applications
 Integrates with various over-the-air service provider features for opted
push functionalities
o News readouts
o Music streaming
o Any other form of content delivery over voice

6. ® Architecture – Satellite View
Altiux CCCP or any
other Platform
providers
Commands to
Altiux or 3rd
party cloud
CCCP Connection
to home
Gateway
Home Ecosystem
Baby Alex
Connected
VDK +
Resident
Speech
processing and
Engines
Connected
home status
read
Control and Command Information
Voice data information
Voice
channel
If Baby Alex VDK
present then
vxml
1. Voice Authorization
2. Voice Intelligence Engines
a. sSense
b. vCoCo
c. sAssist
3. Voice Data Analytics
4. Voice Social Circles
Device Platform
Loosely Coupled
Connection
Nuance/Google
etc. Speech
Engines
Speech input/output
Text input/output

7. ® enabled Application Infrastructure
Home1 Ecosystem Home2 Ecosystem HomeN Ecosystem
M2M
Connected
Cloud Platform
Nuance/Google
Voice Engines
Voice
Cloud API
Layer
M2M Cloud
Platform API
Layer
Social Interface
Open API’s
Open API’s
Restricted API’s
M2M Smart Home
Automation Application
Voice + Data

8. ® Roadmap
3PP – 3 Phase Plan
Phase I
Small All Cloud Solution – Voice enabled Smart Home
Features and Functionalities:
1. Voice Platform/Application
a. Voice Authentication
b. Interface definition
i. Input to system platform solution: Voice / Text
ii. Output from system platform system: Voice /Text
iii. Interaction definition with CCCP
c. Circle Framework definition
2. Gateway (Dummy)
a. Enabler for SmartAlex demonstration
b. Connected Speaker + Microphone (Single Unit) - WiFi
3. Wakeup and Act Module – ‘Alex’ keyword (Configurable keyword)
4. vCoCo – Control and Convenience Circle
a. Sensor Control
i. Basic Commands
ii. Confirmation readouts
b. Autonomous Intelligence
i. Basic Sensor control (Part Energy Saving)
Phase1
Phase2
Phase3Apr 2014
Aug 2014
Nov 2014
Detailed System
Architecture design
Feb 2014

9. Phase II
Semi Resident and Cloud Solution – Voice enabled Smart Home
Features and Functionalities:
1. vCoCo
a. Comprehensive Home Command and Control ‘Circle’
i. Voice authentication for varying accessibility profiles
b. Other prototype circles
i. Kitchen
ii. Personal Manager
iii. Primary Enterprise
2. Framework integration
a. vCoCo, sAssist and sSense
3. sAssist
a. Basic dialog manager (Integration)
b. Social Assistance
i. Weather
ii. Search (Information)
iii. Travel
iv. Maps
v. Health
c. Voice personal and social circles
i. Remote voice session with SmartAlex
ii. Session with other SmartAlex’s (From home)
1. Integrated with other sSense
4. sSense
a. Autonomous Intelligence framework
i. Presence
b. Data acquisition from different sensors
5. Gateway (Competency showcase)
a. Local Processing (Minimal Speech recognition)
b. Microphone Nodes (Arrays)
c. Gateway voice receptors and processors (Noise etc)

10. Phase III
Voice enabled Smart Home – Comprehensive solution
Features and Functionalities:
1. Maturing the engines vCoCo, sSense, sAssist
2. Adding on the Circles to accommodate more usecases
3. Data Analytics and Deep learning
a. M2M/IoT data – Home
4. Integration API’s for any Artificial Intelligence framework as a wrapper
a. To be explored