We need you to bridge the future gap…
Chris Heilmann @codepo8, Lange Nacht der Startups, Berlin September 2016
Chris Heilmann
@codepo8
christianheilmann.com
The Future,
1991
Star Trek TNG S04E19 - The nth degree - http://gb.imdb.com/title/tt0708813/
Lifts…
Tablet computers…
Synchronisation with central servers / cloud
(it was in space, so no clouds, duh)
Glasses enabling blind people
to “see” their environment?
Voice and intent recognition?
Localising people?
Most of these are common now!
We live in a time of amazing
technology and people don’t
even realise it any longer.🏁
This wasn’t always the case…
🔩
Lift attendants…
https://www.flickr.com/photos/breynolds/353144443/
Whilst we use technology,
people are also afraid of it
and its implications on our
world, especially our jobs…
😨
So it is up to us to be good
lift attendants and bring the
benefits of technology to
people…
📡
And it is incredibly important
that we do so in a
transparent, trustworthy and
simple to access manner…
😃
In other words…
🤔
Not as apps that lock people
in or expect them to have a
certain hardware.🔒
The closed app honeymoon
is over…
📉http://www.recode.net/2016/6/8/11883518/app-boom-over-snapchat-uber
http://qz.com/253618/most-smartphone-users-download-zero-apps-per-month/
Stop throwing logs
in the way of your
users…
All technology in the non-
dystopian future is
ubiquitous…🔓
For longterm sustainability
and interest, your solutions
should be services and tie in
with what people already
use.
🖇
A huge service of that is and
will still be the web.
🌎
https://www.youtube.com/playlist?list=PLNYkxOF6rcIAWWNR_Q6eLPhsyx6VvYjVb
📚 Homework: Progressive Web Apps
Another big market is chat
systems.
💬
In any case, users have high
demands to apps these
days.💎
Demands on intelligent apps…
🍒
Personalized, friendly, approachable, natural
✅ Facial recognition, emotion detection
✅ Text and speech interactions
✅ 360 awareness of the user
Demands on intelligent apps…
⏱
Predictive, current, and familiar
✅ Changes in real-time based on user action and
new external data
✅ Predictive models based on user context to
anticipate actions
Demands on intelligent apps…
🔋
Always available, always contextual
✅ Robust information management required
✅ Experiences delivered across all form factors and a
wide variety of interaction models (e.g. touch,
speech, text)
✅ Distributed support, massive scale, elasticity
Yes, that is a lot to cover…
😳
The great news is that you
can use services to help you
with that.😅
Every big player in
computing has machine
learning services for you to
tap into…
🕹
http://www.ibm.com/watson/
IBM Watson
https://cloud.google.com/products/machine-learning/
Google’s Cloud ML Services/TensorFlow
https://cloud.google.com/products/machine-learning/
Amazon Machine learning / Alexa Skills
https://developers.facebook.com/docs/messenger-platform
Facebook Messenger/Bot Services
🤕
I can’t talk about all of them,
mainly because I haven’t
used all…
Here’s what I worked with
and I can chat about…
🤓
Roll your own with REST APIs
Simple to add: just a few lines 

of code required
Make the same API code call on iOS,
Android, and Windows
Integrate into the language 

and platform of your choice
Built by experts in their field from Microsoft
Research, Bing, and Azure Machine Learning
Quality documentation, sample code, and
community support
Easy Flexible Tested
GET A

KEY
BUILD
Microsoft Cognitive Services
Vision
From faces to feelings, allow your 

apps to understand images and video
👁
Vision
✅ Analyse an image
✅ OCR Scan Images
✅ Create context-aware cropping and
thumbnails
✅ Detect emotions
👁
Face detection
✅ Find faces and their angles
✅ Identify and verify people
✅ Cluster recognised people
9
Face detection
Detection	Result:	
JSON:	
[	
		{	
				"faceRectangle":	{	
						"width":	109,	
						"height":	109,	
						"left":	62,	
						"top":	62	
				},	
				"attributes":	{	
						"age":	31,	
						"gender":	"male",	
						"headPose":	{	
								"roll":	"2.9",	
								"yaw":	"-1.3",	
								"pitch":	"0.0"	
						}	
				"faceLandmarks":	{	
						"pupilLeft":	{	
								"x":	"93.6",	
								"y":	"88.2"	
						},	
						"pupilRight":	{	
								"x":	"138.4",	
								"y":	"91.7"	
						},	
					...
INPUT

IMAGE
FACIAL

RECTANGLE + LANDMARKS
DETECTION ATTRIBUTES
Face verification
Verification	Result:	
JSON:	
[	
{	
"isIdentical":false,	
"confidence":0.01		
}	
]
Given two faces, determine whether
they are the same person
Face verification
CLUSTERED BY
DETECTED PEOPLE
Speech
Hear and speak to your users by filtering
noise, identifying speakers, and
understanding intent🎤
Speech
✅ Voice Recognition (Speech to Text)
✅ Voice Output (Text to Speech)
✅ Presenter detection (who spoke when)
✅ Same Technology that powers Cortana
✅ So far, seven languages (en-US, en-GB, de-
DE, es-ES, fr-Fr, it-IT, zh-CN)
🎤
Language
Process text and learn how to recognize
what users want
🗯
Language Understanding
Intelligent Service (LUIS)
✅ Determine intent
✅ Detect Entities
✅ Improve Models
✅ Learns over time from your data
✅ Integrates seamlessly with Speech
Recognition
🗯
Knowledge
Tap into rich knowledge amassed from 

the web, academia, or your own data
🤔
Search
Access billions of web pages, images,
videos, and news with the power of Bing
APIs🔎
Emotion Speaker Recognition
Speech
Custom RecognitionComputer Vision
Face
Video
microsoft.com/cognitive
SearchSpeech Language KnowledgeVision
Linguistic Analysis
Language
Understanding
Bing Spell Check
Entity Linking
Knowledge
Exploration
Academic
Knowledge
Bing
Image Search
Bing
Video Search
Bing
Web Search
WebLM
Text Analytics Recommendations
Bing
Autosuggest
Bing
News Search
Translator
Microsoft Cognitive Services
Bot Framework Preview

Your bots – wherever your users converse
Bot Connector Service
Connect your bot(s) seamlessly to text/
sms, Office 365 mail, Skype, 

Slack, Twitter and more
A service to register your bot, 

configure channels and publish 

to the Bot Directory
Bot Builder SDK
Everything you need to build great
dialogs within your Node.js or C#
bot
An open source SDK hosted 

on GitHub
Bot Directory
Discover, try, and add bots to
conversation experiences
A public directory of bots 

registered and approved with Bot
Framework
www.botframework.com
Lots of demo apps…
Captionbot.ai CelebsLike.Me Projectmurphy.net
How-Old.net TwinsOrNot.net
😕
Let’s talk (very quickly) about
a dirty topic…
💸How can you afford all this?
Microsoft Bizspark Plus www.bizspark.com
Supporting Startups Through Their Life Cycle
Discovery
Startups need How we engage
An abundant of
resources and tools
Access to partners, VCs,
Introduction to local
customers
Microsoft Accelerator program:
Space, equipment, platforms
and 

tools estimated at $1M
Mentors, experts,
via accelerators
AccesstotopVCs,customers

&partners,introductionto
industryleaders,MarketingandPR
Alumni program

Success managers
Ongoing
support
A platform to
experiment with
Meetups, workshops
BizSpark
Office hours
Sounding board,
no strings
attached
Thriving ecosystem
Constant challenging
and guidance
A powerful Launchpad
to set up trajectory
Go to market and
BizDev support
Extensive tech
enablement
BizSpark+

Azure Offer $120K+
Validation Growth
Startups need How we engage Startups need How we engage
Microsoft Bizspark
WHAT YOU GET IS – 3 YEARS OF	
Free cloud services with Microsoft Azure up to $8.5k
Free software (Windows, Office, Visual Studio, SQL,…)
DO YOU QUALIFY?	
Developing software?
Privately held?
Less than five years old?
Making less than $1m annually?
FACTS	
75k+ actual members
Easy online registration
www.bizspark.com
Accelerator Program
We serve as a strategic
partner for startups and
provide unparalleled routes to
market by connecting
startups with our global
network of customers,
partners, business mentors
and technical experts.
We have 7 accelerators
around the world
Bangalore
Platforms & tools for
3 years
Access to Customers &
Partners
Office space Hands on mentoring No Equity!
Beijing
Berlin
Paris
London
Tel Aviv
Seattle
www.microsoftaccelerator.com
🦄Back to my world…
Technology should
help the human and
make a better world
for everyone!
Make your solutions
more human, and
this goal is easier to
achieve…
@But, wait a second, Chris…
Glasses enabling blind people
to “see” their environment?
http://captionbot.ai
http://captionbot.ai
http://captionbot.ai
https://www.youtube.com/watch?v=R2mC-NUAmMk
CHRIS HEILMANN
@CODEPO8
CHRISTIANHEILMANN.COM
THANKS!

Bridging the future gap