Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

The Soul in The Machine - Developing for Humans (FrankenJS edition)

589 views

Published on

Wuerschdla gabs

Published in: Education
  • Be the first to comment

  • Be the first to like this

The Soul in The Machine - Developing for Humans (FrankenJS edition)

  1. 1. The Soul in The Machine - Developing for Humans Chris Heilmann @codepo8 - May 2017
  2. 2. PROLOGUE “VISIONS OF THE FUTURE”
  3. 3. Arthur C Clarke Aldous Huxley George Orwell Alan Moore
  4. 4. http://www.independent.co.uk/life-style/gadgets-and-tech/news/theresa-may-internet-conservatives-government-a7744176.html
  5. 5. https://www.newscientist.com/article/2113299- googles-deepmind-ai-can-lip-read-tv-shows- better-than-a-pro/?sf43896303=1 https://arxiv.org/pdf/1611.05358v1.pdf 46.8% vs 12.4% success rate
  6. 6. Technological progress has merely provided us with more efficient means for going backwards. — Aldous Huxley
  7. 7. Duophonix @ Deviantart http://duophonix.deviantart.com/art/Ihal-9000-184254683
  8. 8. CHRIS HEILMANN @CODEPO8 HTTPS://CHRISTIANHEILMANN.COM
  9. 9. ACT ONE “CREATURE COMFORTS WE ALL ENJOY”
  10. 10. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  11. 11. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  12. 12. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm https://www.bloomberg.com/news/articles/ 2017-02-28/jpmorgan-marshals-an-army-of- developers-to-automate-high-finance
  13. 13. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  14. 14. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm https://arxiv.org/abs/1702.00783
  15. 15. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm https://gwmt.nvidia.com/ http://www.trustedreviews.com/news/ nvidia-super-resolution-tool-launch
  16. 16. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  17. 17. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  18. 18. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  19. 19. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  20. 20. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  21. 21. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm Image may contain: dog, outdoor and nature
  22. 22. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm https://blogs.office.com/2016/12/02/accessibility-in- office-365-enabling-greater-digital-inclusion/
  23. 23. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm http://captionbot.ai
  24. 24. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm https://www.youtube.com/watch?v=XMdct-5bERQ
  25. 25. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  26. 26. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm https://research.googleblog.com/2016/05/aw-so-cute- allo-helps-you-respond-to.html
  27. 27. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  28. 28. ACT TWO “ENTER THE ENABLERS”
  29. 29. A few years ago all this was pure science fiction…
  30. 30. And even today it feels like it is too hard to do, right?
  31. 31. Wrong. The trick is to understand that we live in a world of services, clouds, databases and products.
  32. 32. All players are doing a great job giving you access… https://www.youtube.com/watch?v=ETeeSYMGZn0
  33. 33. Almost every company offers APIs for this.
  34. 34. REST endpoints with support for Node or even client-side JavaScript.
  35. 35. Images Audio Video (Foreign) Text Gestures Faces Emotions … build-stuff.json
  36. 36. A lot of work went into these APIs, work you might not want to do yourself…
  37. 37. Machines, corporations, services and products have harvested tons and tons of data over the last years.
  38. 38. The biggest problem was to understand the data – as it was a mess.
  39. 39. So we trained machines in thousands of iterations to get the best information out of a small set of fata.
  40. 40. What’s in a sentence?
  41. 41. Word dependencies
  42. 42. Labels
  43. 43. Speech / Language Syntax
  44. 44. Language stems
  45. 45. Morphology / Grammar
  46. 46. Better translation through sentences vs. words
  47. 47. Better translation through sentences vs. words
  48. 48. Better translation through sentences vs. words
  49. 49. Bad results? Use the same platforms to train your own data according to your specifications.
  50. 50. Add quality by filtering with context… https://www.microsoft.com/cognitive-services/en-us/custom-recognition-intelligent-service-cris
  51. 51. The good news for us is that we can now use these findings to build better interfaces.
  52. 52. ACT THREE “GO FORTH AND DO SOME GOOD”
  53. 53. The interfaces we build today condition the users of now and of tomorrow…
  54. 54. The interfaces we build today condition the users of now and of tomorrow…
  55. 55. It is time for us to use and build better, more human interfaces…
  56. 56. There is no such thing as a perfect user - think inclusive. https://www.microsoft.com/en-us/Design/inclusive It isn’t about allowing access but about avoiding barriers.
  57. 57. Our job right now is to create interfaces that are simple, human and fun to use…
  58. 58. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  59. 59. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  60. 60. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  61. 61. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  62. 62. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  63. 63. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users http://code.visualstudio.com/
  64. 64. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users https://channel9.msdn.com/Events/Build/2017/T6078
  65. 65. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users JSON: { "language": "en", "orientation": "Up", "regions": [ { "boundingBox": "41,77,918,440", "lines": [ { "boundingBox": "41,77,723,89", "words": [ { "boundingBox": "41,102,225,64", "text": "LIFE" }, { "boundingBox": "356,89,94,62", "text": "IS" }, { "boundingBox": "539,77,225,64", "text": "LIKE" } . . . TEXT: LIFE IS LIKE RIDING A BICYCLE TO KEEP YOUR BALANCE YOU MUST KEEP MOVING JSON: { "language": "en", "orientation": "Up", "regions": [ { "boundingBox": "41,77,918,440", "lines": [ { "boundingBox": "41,77,723,89" "words": [ { "boundingBox": "41,102,225,6 "text": "LIFE" }, { "boundingBox": "356,89,94,62 "text": "IS" }, { "boundingBox": "539,77,225,6 "text": "LIKE" } . . . TO KEEP YOUR BALANCE YOU MUST KEEP MOVING
  66. 66. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  67. 67. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users http://cloudinary.com/blog/ automatically_art_directed_responsive_images
  68. 68. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  69. 69. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  70. 70. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users https://www.videobreakdown.com/
  71. 71. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  72. 72. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  73. 73. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  74. 74. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  75. 75. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  76. 76. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  77. 77. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  78. 78. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  79. 79. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  80. 80. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users 🎙" 🔊$
  81. 81. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  82. 82. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  83. 83. EPILOGUE “OH THE PLACES YOU WILL GO…”
  84. 84. The saddest aspect of life right now is that science gathers knowledge faster than society gathers wisdom. — Isaac Asimov
  85. 85. The future is already here – it’s just not very evenly distributed. — William Gibson
  86. 86. Let’s fix that! Right now!
  87. 87. CHRIS HEILMANN @CODEPO8 CHRISTIANHEILMANN.COM THANKS!

×