The document discusses the growing capabilities and adoption of natural language interfaces and the Internet of Things. It notes that by 2020, over 33 billion devices will be connected to the Internet and over 15 billion will be IoT devices. Voice and natural language interfaces are becoming more common, accurate and widely used. Systems that can understand language in context and complete tasks across different domains will create a virtuous cycle of more data, better accuracy and wider adoption.

1. Ok, Computer: understanding me in
the Internet of Things
Darren Harris, CTO

2. Natural Language

3. 2011
2012
2013
2014
2015

4. 55%
Teens
41%
Adults
Commissioned by Google (US)
Source: Northstar Research, October 2014

5. Speech Recognition:
Primary UI of the future?
0% 23% 45% 68% 90%
2015 2020
Eye Tracking
Touchless / 3D Touch
Voice Recognition
Gesture Recognition
Localised Haptics
Speech Recognition
Source: Tractica, 2015
32B?2015
16B2014
8B
2013
4B
2012
1,6B
2011
0,8B
2010
Source: Nuance, 2015

6. “The keyboard….how quaint”

7. 1760s-1840s 1850s-1940s 1950s-?
1 2 3

8. 1980s 1990s2000s
Industrial Internet
(Internet of Things)

9. YEAR
2011 2013 2015 2017 20192012 2014 2016 2018
Global
Smartphone
Penetration
Source: Statista 2015
UK / NL
20%
44%
53%
60%
67%
72%
77%
81%
10%
16%
20%
25%
28%
31%
34%
37%
72%
2015
>90%
UK
By
2020
>40%
Global
>3B
Phones

10. PCs & Laptops
Smartphones
Tablets
Internet Media
Smart TV
Smart Home Devices
Wearables
Internet of Things
YEAR
BILLIONSOFDEVICES
0
10
20
30
2007 2010 2013 2016 20192008 2009 2011 2012 2014 2015 2017 2018 2020
5
15
25
35
Source: Strategy Analytics, October 2014
>33B
devices
>15B
IoT
>4B
Home
By
2020

11. Connected World
IoT

12. “They don’t deu Sco’ish accents”

13. The Perfect Storm

14. What time is the next train
from Brighton to London?
1
2
3
5
1
4
Which platform for
the 7:49 this evening?
2
3
4
>90%
>99%
CapitoController *controller = [CapitoController getInstance];
[controller setupWithID:appKey host:testHost port:[NSNumber numberWithInt:443] useSSL:YES];
[[CapitoController getInstance] connect];

15. More Data
Better Accuracy
Wider
Adoption
Virtuous Circle
Model
inform(domain=“TrainTicketing")&
inform(limit=“1")&
inform(task=“NavigateTimes")&
inform(to=“London”)&
inform(from=“Brighton”)
=
What time is the next train from Brighton to London?
x
inform(domain=“TrainTicketing")&
inform(limit=“1")&
inform(task=“NavigateTimes")&
inform(to=“London”)&
inform(from=“Brighton”)
=
Shiomi next train from Brighton to London?

16. <T>
Voice
Model
What time is the next train from Brighton to London?
Lang
Domain
Entities
Time
Which platform for the 7:49 this evening to Victoria?
Text
Model
en_GB
TrainTicketing
Brighton
London
Now
en_GB
TrainTicketing19h49m
Pre-processingSemantic Output
{
"limit": "1",
"task": "NavigateTimes",
"domain": "TrainTicketing",
"from": “Brighton”,
"to": "London",
}
{
"task": "NavigatePlatform",
"domain": "TrainTicketing",
"start_datetime": {
"day": 14,
"month": 10,
"year": 2015,
"hour": 19,
"minute": 49
},
"to": "Victoria"
} Pre-processingSemantic Output
{
"limit": "1",
"task": "NavigateTimes",
"domain": "TrainTicketing",
"from": "Brighton",
"to": "London"
}
+
{
"task": "NavigatePlatform",
"domain": "TrainTicketing",
"start_datetime": {
"day": 14,
"month": 10,
"year": 2015,
"hour": 19,
"minute": 49
},
"from": "Brighton",
"to": "London Victoria"
"limit": "1"
}
Victoria
Post-ProcessingPost-Processing

17. {
"task": "NavigatePlatform",
"domain": "TrainTicketing",
"start_datetime": {
"day": 14,
"month": 10,
"year": 2015,
"hour": 19,
"minute": 49
},
"from": "Brighton",
"to": “London Victoria"
"limit": "1"
}

18. “Show me Nike Jordan’s in blue and grey size 9”
<T>

19. Show me Nike Air Force 1
shoes in size 43 in red

20. Take me to checkout

21. How much did I spend
last monthDid I get any interest on my
current account last month
Transfer €100 to my
savings account each month on
the 15th
Cancel my direct debit with
Vodafone
How much have I spent at
Zalando’s this year

22. Thank You
@CapitoSystems @darren_lh
darren.harris@capitosystems.com
www.capitosystems.com