Presentation educating individuals with degenerative sight loss on how home automation and voice-enabled smart speakers can assist in their day to day living.
2. Who are we?
A company formed to deliver bespoke Voice
Experiences for Amazon Alexa and Google
Home devices.
Our brand under which Community and
Commercial products are published.
Our brand under which products for the
Health, Social Care, Charity, and Not-for-
Profit sectors are published.
3. Voice Assistants
● Voice Assistants, around since 2011, but originally tied to our
phones and laptops, began migrating to standalone devices in
2015.
● Viewed initially as “novelties” for playing music, plus a limited
set of built-in “request/response” functions. Eg. “Alexa, what’s
the weather in London today?” - this view is rapidly changing
4. Voice Assistants
● Now emerging as platforms capable of supporting
sophisticated and bespoke conversations.
○ Amazon = Alexa
○ Google = Google Assistant
○ Apple = Siri
○ Cortana = Microsoft
○ Others = Jibo, Olley, Mycroft
● Chatbots are also capable of this but using a written interface
5. How this tech works...
1. Speech input
2. Speech to text
3. Natural language processing - works out what you have said
4. Compute - works out what to reply/action to take
5. Text to speech
6. Speech output
6. How it can assist with sight loss?
● Home Automation
● Voice Applications
● V-Commerce
7. Home automation - the basics
● How it works
○ Started with control through your phone & has
migrated into commands via voice.
○ You give a command -> Action happens
○ Within the ecosystem of the voice assistant
○ Using a third party
■ If This Then That (IFTTT)
● Devices connect over your local wifi network
8. Home automation - the devices
● Light bulbs
● Thermostats
● Door Bells
● Smart Locks
● Smart Plugs
● Smart Devices
● Smart Home Ecosystems
9. Home automation - the devices
● Light bulbs
● Thermostats
● Door Bells
● Smart Locks
● Smart Plugs
● Smart Devices
● Smart Home Ecosystems
10. Home automation - the devices
● Light bulbs
● Thermostats
● Door Bells
● Smart Locks
● Smart Plugs
● Smart Devices
● Smart Home Ecosystems
11. Home automation - the devices
● Light bulbs
● Thermostats
● Door Bells
● Smart Locks
● Smart Plugs
● Smart Devices
● Smart Home Ecosystems
12. Home automation - the devices
● Light bulbs
● Thermostats
● Door Bells
● Smart Locks
● Smart Plugs
● Smart Devices
● Smart Home Ecosystems
13. Home automation - the devices
● Smart Devices
○ Blinds
○ Fridges
○ Lawnmowers
○ Kettles
○ Microwave
14. Home automation - the devices
● Smart Home Ecosystems
○ Harmony Hub
○ Samsung SmartThings
○ IFTTT
15. Voice Applications - the basics
● Several types
○ One Shots
○ Long running conversations
○ Services
● Alexa - Lots of apps (called skills)
● Google - Library of apps growing (called actions)
● Cortana - Integrated with Microsoft Environment - task
management - can open limited applications (voice search)
● Siri - Up until now, no external developers - one shot actions -
not classed as Voice Applications
16. ● Lists
● Timers
● Reminders
● Weather Fact Finding
● What’s the time
Voice Applications - One Shots
17. Voice Applications - long running
conversation
● Games
○ Lots by indie developers
■ Quizzes
■ Mazes
■ Daily Plays
○ Big developers getting on board
■ Trivial Pursuit
■ Jeopardy
■ BBC
18. Voice Applications - long running
conversation
● Mindfulness
○ Over 450 skills in the Amazon Alexa library
● Companion Applications
● Personal Assistant
○ Google Duplex
● Information discovery
○ Audio Websites
19. Voice Applications - services
● Talking Newspapers
● Local Councils
○ Bin collection etc.
● Uber
● Food Ordering
○ Dominos
20. V-Commerce
● Buying things via voice
● Easier on Amazon than Google
● Amazon have always allowed buying things from
Amazon.co.uk
● Amazon recently introduced in app purchases for voice
applications
● V-Commerce set to become one of the biggest selling points of
voice assistants for those resistant to the idea.
● Wall street have used an Voice Assistants to transfer billions of
dollars this year.
21. Voice Applications - other points
to consider
● Retaining conversational knowledge
○ If you asked a questions about Barack Obama, then
asked how old he is it would remember you were
talking about the former president
● Multimodal
○ Echo Look
○ Devices with screens
23. There are some drawbacks
● It's not Jarvis, Hal or the Star Trek Computer
● Everything is WiFi dependant
● Developers are not linguists
○ Not all have understood the nuances of the english
language
● Notifications are not here yet
○ User must offer up an input for anything to happen
24. There are some drawbacks
● You need to remember the name of all the applications
● They are not a replacement for screen readers
○ Design process is very different to that of a website
● Cost
○ Initial voice assistants are not expensive - but some of
the peripherals are.
● Complex to configure
○ End up with lots of wires (for something that is wireless)
25. In the news - let's clear some
things up...
● They are not always listening!
○ Listening for a wake word (Alexa, Hey Google, Hey Siri,
Cortana, etc.)
○ You can delete your recordings
● Alexa - Pocket Dial
○ Alexa recorded a conversation and sent it to someone in
their phonebook.
26. What does the future hold?
● More are coming
○ Facebook
○ Spotify
● No technology has been adopted
this quickly since the SmartPhone
28. Thank you!
If you have any further questions come
and speak to us...
Twitter
@RichMerrett815
@VeniLoqui
Medium
@rmerrett
Editor's Notes
Whether you are a medical professional, someone who has the early stages of sight loss or someone who has little or no sight at all.
Born out of, but separated from Ethereality Associates, and broad-based cloud-centric IT Consultancy, Veni Loqui is tightly focused on the emerging category of Voice powered applications.
Our medium to long-term aim is to leverage Voice in the Social Care space. We are currently discussing the use of Voice with Healthcare professionals focused on CBT and BA.
VoxLR8 is a short to medium-term vehicle to gain experience in developing Skills/Actions.
Voice assistants can
Replace screens
Compliment screens
Direct you to screens
Multiple Input
Voice
Touch
Text
Movement/Gestures
Voice assistants can
Replace screens
Compliment screens
Direct you to screens
Multiple Input
Voice
Touch
Text
Movement/Gestures
LED bulbs so last for around 25,000 hours
Requires a bridge (or hub)
From top of the range Philips Hue from £50 per bulb to £15
Lesser models which connect straight to the wifi - don’t need a hub & can cost as little as £12 per bulb
Range of colours
Setup by bulb or by room
Setup routines depending on what you need.
Good Night
Good Morning
Its Movie Time
Link them to IFTTT to do things like blink if you get a notification on Facebook or are mentioned in a tweet.
Can link to turn them all off on an action (so if a door opens the lights all turn on
Problem with leaving the light switch on - muscle memory - some companies starting to sell wifi light switches
Really good for security and ease if you are no longer able to find the lightswitch
NEST £220 plus fitting
HIVE - £250 plus fitting (British Gas’ version)
Allows you to change the temperature, find out what the temperature is set to wherever your voice assistant is - really useful if you can’t see the thermostat or it is in a difficult to reach place.
Also fall into the ecosystem category as both now have cameras/security systems, Plugs etc.
£90 - £179 for the Ring Doorbell (most common) others are available
Allows you to see whos at the door via a tablet or app
Allows you to talk to the person at the other side of the door through your voice assistant (or app)
Technology is moving fast on this one - the Artificial intelligence & Machine learning surrounding these devices is at a stage where it is able to recognise if the uniform someone is wearing is that of a delivery person or not, or if there is a chance the person is a salesman (wearing a suit). There are a few devices that can relay this back, but the technology is approaching and will be compatible with voice.
Won’t find one under £100
Allow you to lock or unlock your door with your voice or with proximity to your phone or a bluetooth device.
You could even, theoretically, name your front door ‘Pod Bay Doors’ (if your a fan of 2001, A Space Odyssey) and ask your Voice Assistant to “Open the pod bay doors” and your front door would be unlocked (hopefully!).
My personal favourite.
Allow you to control plug sockets with your voice
They can turn anything into a smart device, i’ve used them for:
Xmas lights
Bedside lights
Fans
Toastie machine
TV
Lights on a display cabinet
Get them for under £10 (or up to £50)
Can get plug extensions or replace your existing plug sockets with wifi enabled ones
Great if you can’t see the switches or your home does not provide good accessibility to the switches. They combine elements of safety and practicality.
These are devices which are connected to your WiFi & can be controlled through your voice.
Blinds - Open & shut - could link that with your lights so if you asked for the blinds to be shut your lights would automatically come on too.
Fridges - allow you to add things that are missing to your shopping list, or remind you when you are running low on something.
Lawnmowvers that can be setoff with your voice
Kettles can turn on and off with your voice.
Microwaves that you can control the settings & the timings with your voice
A slight caveat here, these are not cheap devices,
Will come down in price
Just the tip of the iceberg
Not a replacement for everyday activities it is merely there to augment them
Ecosystems - buy one kit/device & it links everything together & makes things voice enabled
Samsung Smart things has a range of devices (plugs, motion sensors, door sensors, presence sensors’ but also links to other smart devices (lightbulbs, locks, thermometers etc.) and it works with voice - so even if the original wifi device was not compatible with voice to begin with, with Samsung Smarthings you can make it compatible.
It also allows for routines - If my motion sensor is triggered and it is dark then my porch light comes on.
Great for security
Starter kit £125 - £200 for a starter kit
Harmony hub allows you to control any device with infrared, bluetooth, z-wave or on your WiFi network (up to 15 devices). Thus turning a range of things into voice enabled devices - TVs (plus the digital boxes that sit under then) HiFi Systems, Games Consoles, Ceiling Fans, anything that previously had a remote control.
Turn TV on, find your favourite channel or search for a show with your voice
Great for making your existing tech voice enabled
£175
IFTTT - As free online service which allows you to link “actions” to “outcomes” i.e. When your phone enters the area around your house, it automatically turns on your lights, or you leave your office and your heating comes on so your house is warm by the time you arrive home.
Written by either freelance developers or by companies themselves
Weather - multiple ways to ask the question, you could ask, do i need a coat today or just what is the weather, or how warm is it today
Lists - Useful for shopping lists, to do lists
Timers - Useful for when cooking, as an alarm clock
Reminders - Useful to set for medications or if you need to do something at a specific time.
Weather - Useful for working out whether to take an umbrella
Fact Finding - Useful to settle an argument or find out what time a shop opens
What’s the time - Useful if you don’t have a watch or phone to hand
Music
Games
Great to keep involvement in gaming circles - Destiny 2 (from the makers of Halo) had a voice companion app for Alexa
Hundreds of new voice games being released each month
As these become more complex, they will integrate more into mainstream gaming which if losing your sight - means you can stay involved with some of the latest gaming trends
Mindfulness
I could spend an hour talking on this alone
Help those prone to loneliness, anxiety and depressions
There are an increasing number of Voice Applications developers, designers, and psychologists who believe that Cognitive Behavioural Therapy (CBT) and Behavioural Activation both forms of ‘talking therapy’ are primed for a Voice Application revolution.
Companion
Links to mindfulness, its one of the places Veni Loqui see real potential for voice.
Personal Assistant
May have heard of Google Duplex, announced about 3 weeks ago, allows users to make reservations for hair appointments or restaurants without the need to lift a finger - the assistant does it all for you. (example)
Information Discovery
Googling something and following up (Google Assistant only)
Audio Websites
Open RPFB, I want information on Research, go back, can i have some information on fundraising. Allows for follow up questions, and
Problem is remembering the name of everything
Games
Great to keep involvement in gaming circles - Destiny 2 (from the makers of Halo) had a voice companion app for Alexa
Hundreds of new voice games being released each month
As these become more complex, they will integrate more into mainstream gaming which if losing your sight - means you can stay involved with some of the latest gaming trends
Mindfulness
I could spend an hour talking on this alone
Help those prone to loneliness, anxiety and depressions
There are an increasing number of Voice Applications developers, designers, and psychologists who believe that Cognitive Behavioural Therapy (CBT) and Behavioural Activation both forms of ‘talking therapy’ are primed for a Voice Application revolution.
Companion
Links to mindfulness, its one of the places Veni Loqui see real potential for voice.
Personal Assistant
May have heard of Google Duplex, announced about 3 weeks ago, allows users to make reservations for hair appointments or restaurants without the need to lift a finger - the assistant does it all for you. (example)
Information Discovery
Googling something and following up (Google Assistant only)
Audio Websites
Open RPFB, I want information on Research, go back, can i have some information on fundraising. Allows for follow up questions, and
Problem is remembering the name of everything
Although these can fall under both oneshot or long running conversation they are their own thing
Allow you to access services regardless of your situation.
This is changing but if you have a specific skill you need the name of then you will need to make sure you know the name of it.
Requires several hubs/bridges so there may be a requirement for further routers/switches
Think of it like fishing - you may be sitting by the water ‘fishing’ but you are not always catching a fish -
Constant loop - have i heard my name? - when yes start recording.
Celebrity Hunted - claimed to have hacked into contestants Alexa - they had not, they had hacked into their retail account & could see the recordings.