Suit up, bring extra oxygen
Internet space explorers needed.
Chris Heilmann @codepo8, Øredev 2016 - November 2016
CHRIS HEILMANN
@CODEPO8
HTTPS://CHRISTIANHEILMANN.COM
Hey, how are you?
I spent quite some time freaking out
and being annoyed with everything.
😱
…and I‘m a well-off, privileged person
with a great job with freedoms my
parents could only dream of!🙄
So today, I want us to consider our
space in this world, and what we can
do to get things a bit on track again.😎
As it says in the book so many people
put a lot of stake in right now:
“the geek shall inherit the earth”
(I think…)🤓
Chapter 1:
What the hell are we doing?
😶
https://techcrunch.com/2017/02/07/goat-25m-accel/
Social media drama and endless
discussions about how we can be
much more effective.🐚Lord of the flies reference,
in case you wondered…
Burnout, bad social interaction, stress
and unhealthy work environments…
🔥
Insecure, hard to maintain, over
architected and under documented
solutions…🔓
Chapter 2:
Things that already happened…
⏳
The future is already
here – it’s just not very
evenly distributed.
— William Gibson
People are freaking out!
http://www.bbc.com/news/technology-34066941
http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf
The robot takeover
http://www.bbc.com/news/technology-34066941
http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf
The robot takeover
http://www.bbc.com/news/technology-34066941
http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf
The robot takeover
http://www.bbc.com/news/technology-34066941
http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf
The robot takeover
http://www.bbc.com/news/technology-34066941
http://www.oxfordmartin.ox.ac.uk/downloads/academic/The_Future_of_Employment.pdf
How safe is my job?
Abstract thinking
Working with humans
Images
Words
Numbers
Routine Variety
You’re out
Get nervous
You’re OK
However, the wheel keeps turning…
🛰
https://arstechnica.com/the-multiverse/2016/06/an-ai-wrote-this-movie-and-its-strangely-moving/
http://www.theverge.com/2016/9/26/13055938/ai-pop-song-daddys-car-sony
https://www.technologyreview.com/s/603381/ai-software-learns-to-make-ai-software/
http://intelligentx.ai/
I do not fear computers.
I fear the lack of them.
— Isaac Asimov
http://www.zmescience.com/other/economics/china-factory-robots-03022017/
Chapter 3:
Things that are going very wrong…
😢
We’re all doomed. Again.
Technological progress
has merely provided
us with more efficient
means for going
backwards.
— Aldous Huxley
We’ve never been better connected
and able to communicate easier.
📡
And it seems to me we mostly use it to
be horrible to each other or persuade
people to do things they don’t want to
do.📢
Instead of getting people more
educated about technology, we tell
them to trust in companies and
believe that “everything works like
magic”.
🔮
If you’re looking for nightmares…
☠
The Power of Big Data and Psychographics
https://youtu.be/Yu3Vxy6lQwg
The Power of Big Data and Psychographics
https://youtu.be/Yu3Vxy6lQwg
The Power of Big Data and Psychographics
https://youtu.be/Yu3Vxy6lQwg
Dehumanised and
misguided…
The saddest aspect of
life right now is that
science gathers
knowledge faster than
society gathers wisdom.
— Isaac Asimov
We need more transparency,
information and informed people.
🔓
There is no way we can have a secure
and sensible human-computer
symbiosis if there is no sense of
ownership by humans.
💡
For years we used “free” systems that
spied on us - heck, we even bought
the devices that recorded our every
move.
1
📹
Of course, we’re too
clever for that!
!🐑
The lure of anime eyes and sparkles…
The lure of anime eyes and sparkles…
https://twitter.com/Laughing_Mantis/status/821978447551397888/
One kitchen sink, coming up…
Currently running Apps
User location
Phone Status and Identity (IMSI)
Access to USB Storage (including deletion)
Camera Access
Wifi Connection Information
Device ID and call information
Access internet data in background
Change system display settings
reorder running apps
prevent device from sleeping
Google play licence check
♥
Our data and information has already
been recorded and filed. It is almost
impossible not to have left a track.
📷✏🎙➡🗄
The demand of now is to get access to
this data and do some good with it.
🕯
Chapter 4:
Things that are amazing
😍
Making photos findable… https://photos.google.com
“Selfies” (Auto category) https://photos.google.com
“Tel Aviv” https://photos.google.com
“Tel Aviv” https://photos.google.com
“Katze” (cat) https://photos.google.com
“Hund” (dog) https://photos.google.com
“Essen” (food) https://photos.google.com
http://www.theverge.com/2017/2/8/14549798/pinterest-lens-visual-discovery-shazam
https://www.youtube.com/watch?v=XMdct-5bERQ
aipoly.com
https://www.newscientist.com/article/
2113299-googles-deepmind-ai-can-lip-read-
tv-shows-better-than-a-pro/?sf43896303=1
https://arxiv.org/pdf/1611.05358v1.pdf
46.8% vs 12.4% success rate
https://blogs.office.com/2016/12/02/accessibility-in-office-365-enabling-greater-digital-inclusion/
Cognitive services in Microsoft Office
Writing and reading
tools that change
display of text catered
to the needs of people
with learning
disabilities…
https://blogs.office.com/2016/01/19/learning-
tools-for-onenote-improves-learning-for-all/
https://www.youtube.com/watch?v=3Ztr44aKmQ8
https://channel9.msdn.com/Events/Build/2016/KEY01
“Live” translation of calls.
Adding automated content in context…
https://research.googleblog.com/2016/05/aw-so-cute-allo-helps-you-respond-to.html
"Zoom in. Now... enhance."
🔎
http://tvtropes.org/pmwiki/pmwiki.php/Main/EnhanceButton
"Zoom in. Now... enhance."
🔎
https://arxiv.org/abs/1702.00783
"Zoom in. Now... enhance."
🔎
Chapter 5:
Things that are becoming available…
🕹
https://deepmind.com/blog/open-sourcing-deepmind-lab/
https://github.com/deepmind/lab
https://arxiv.org/abs/1612.03801
Facebook’s alternatives…
Image may contain: dog,
outdoor and nature
https://code.facebook.com/posts/561187904071636
Learning from good data… http://image-net.org/
Learning from *lots* of data…
https://github.com/
openimages/dataset
Learning from *lots* of data…
https://github.com/
openimages/dataset
Refining the data with language
https://research.googleblog.com/2016/09/show-and-tell-image-captioning-open.html
Compare and enhance…
Detect syntax, mix and match
Add visual information
http://captionbot.ai
More APIs and demos to use…
Detection Result:
JSON:
[
{
"faceRectangle": {
"width": 109,
"height": 109,
"left": 62,
"top": 62
},
"attributes": {
"age": 31,
"gender": "male",
"headPose": {
"roll": "2.9",
"yaw": "-1.3",
"pitch": "0.0"
}
"faceLandmarks": {
"pupilLeft": {
"x": "93.6",
"y": "88.2"
},
"pupilRight": {
"x": "138.4",
"y": "91.7"
},
...
Detect Faces…
Verification Result:
JSON:
[
{
"isIdentical":false,
"confidence":0.01
}
]
Verify Faces
Cluster automatically…
Add quality by filtering with context…
https://www.microsoft.com/cognitive-services/en-us/custom-recognition-intelligent-service-cris
https://www.videobreakdown.com/
Understanding and fixing video automatically…
https://www.videobreakdown.com/
Transcripts were just a
start…
https://www.videobreakdown.com/
People, topics, sentiments…
Chapter 6:
Things that make me happy…
💖
https://www.flickr.com/photos/stuartwebster/5658827200 - Stuart Webster
.big()
Sophia Roshal
https://youtu.be/Yu3Vxy6lQwg
Saving users an expected 1.5
petabytes (that's 1.5 million
gigabytes) of data each day.
https://students.googleblog.com/2017/02/intern-impact-brotli-compression-for.html
Anamaria Cotîrlea
Chapter 7:
Finding your role in this play…
😉
What’s your plan
for tomorrow?
The Interrupters - "Take Back The Power” https://www.youtube.com/watch?v=q7Ol-YDS4Jc
The question of
whether computers
can think is like the
question of whether
submarines can swim.
— Edsger W. Dijkstra
http://www.techrepublic.com/article/inside-amazons-clickworker-platform-how-half-a-million-
people-are-training-ai-for-pennies-per-task/
https://www.wired.com/2017/02/programming-is-the-new-blue-collar-job/
Aided adaptation…
“
Any blue-collar coder will be plenty qualified
to sling JavaScript for their local bank. That’s
a solidly middle-class job…
“
The national average salary for IT jobs is about
$81,000 (more than double the national
average for all jobs), and the field is set to
expand by 12 percent from 2014 to 2024,
faster than most other occupations.
The future of computing needs first and
foremost people who are not afraid…
Our job right now is to
create interfaces that are
simple, human and fun
to use…
Machines and code are there to
help humans communicate better.
The more useful our “intelligent”
solutions are, the easier it will be for
people to stop fearing innovation…
🎙
We need to use our skills,
knowledge and products to give
people a sense of interaction and
data ownership.
🔬
It is up to us to make this revolution
one that improves all mankind, and
not only makes some quick money
and shows us more ads.
A
CHRIS HEILMANN
@CODEPO8
CHRISTIANHEILMANN.COM
THANKS!

Suit up, bring extra oxygen Internet space explorers needed.